Target detection method and device, electronic equipment and storage medium

Abstract

The embodiment of the invention provides a target detection method and device, electronic equipment and a storage medium. The method comprises the following steps: determining a first imaging sub-region where a target halo is located in a first picture displayed in an imaging region of the shooting equipment; determining whether to adjust the shooting angle of the shooting equipment or not according to the size relationship between the probability that the target part moving track appears in the first imaging sub-region and a specified probability threshold value; and carrying out target part detection and identification by adopting shooting equipment. According to the scheme, halo of the target part in the picture can be effectively avoided, and the recognition effect of the target part is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of target detection, and in particular, to a target detection method, device, electronic device, and storage medium. Background Art

[0002] With the continuous improvement of security requirements, target part recognition (such as facial recognition) has become increasingly common in various application scenarios. The target part is recognized by obtaining a target part image of the target part. However, it is found in actual applications that due to the surrounding light sources, when obtaining the target part image of the target part, there may be halos in the captured image, which is very likely to cause the halos to block the target part in the obtained target part image, resulting in the inability to effectively detect the target part, reducing the detection accuracy of the target part, and causing recognition errors. Summary of the Invention

[0003] The present invention provides a target detection method, device, electronic device, and storage medium to effectively avoid halos in the target part of the image, thereby improving the recognition effect of the target part.

[0004] In a first aspect, an embodiment of the present invention provides a target detection method, the method including:

[0005] Determine a first imaging sub-region where a target halo is located in a first image displayed in an imaging region of a shooting device, the imaging region of the shooting device being pre-divided into multiple imaging sub-regions;

[0006] Determine whether to adjust the shooting angle of the shooting device according to the magnitude relationship between the probability of the target part movement trajectory appearing in the first imaging sub-region and a specified probability threshold;

[0007] Use the shooting device to perform target part detection and recognition.

[0008] In a second aspect, an embodiment of the present invention further provides a target detection device, the device including:

[0009] A determination module, configured to determine a first imaging sub-region where a target halo is located in a first image displayed in an imaging region of a shooting device, the imaging region of the shooting device being pre-divided into multiple imaging sub-regions;

[0010] An adjustment module, configured to determine whether to adjust the shooting angle of the shooting device according to the magnitude relationship between the probability of the target part movement trajectory appearing in the first imaging sub-region and a specified probability threshold;

[0011] A detection module, configured to use the shooting device to perform target part detection and recognition.

[0012] In a third aspect, an embodiment of the present invention further provides an electronic device, the electronic device comprising:

[0013] at least one processor; and

[0014] a memory communicatively connected to the at least one processor; wherein,

[0015] The memory stores a computer program that can be executed by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can perform the target detection method described in any one of the above embodiments.

[0016] In a fourth aspect, an embodiment of the present invention further provides a computer-readable medium, wherein the computer-readable medium stores computer instructions, and the computer instructions are used to enable a processor to implement any of the target detection methods described in the above embodiments when executed.

[0017] In an embodiment of the present invention, when a shooting device is used to detect a target part, a first imaging sub-region where a target halo is located in a first picture displayed by an imaging area of ​​the shooting device is determined, and it is determined whether the probability of a target part movement track appearing in the first imaging sub-region is greater than a specified probability threshold. If it is greater than the specified probability threshold, it means that the probability of the target part appearing in this part of the imaging sub-region is very high. If the target halo exists in the imaging sub-region, it is bound to affect the accuracy of the target part detection and recognition. Therefore, it is necessary to determine whether to adjust the shooting angle of the shooting device according to the relationship between the probability of the target part movement track appearing in the first imaging sub-region and the specified probability threshold so that the target halo in the picture displayed by the imaging area of ​​the shooting device avoids the target part. In this way, when the shooting device after adjusting the shooting angle is used to detect the target part, the detection and recognition accuracy of the target part in the first imaging sub-region can be improved. At the same time, the probability of the target part movement track appearing in the first imaging sub-region is greater than the probability of the target part movement track appearing in the second imaging sub-region. Therefore, even if the target halo enters the second imaging sub-region, it will not have much impact on the detection and recognition of the target part. In this way, the image in which the detection and recognition accuracy of the target part is reduced due to the target halo entering the imaging sub-region can be reduced.

[0018] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In conjunction with the accompanying drawings and with reference to the following specific embodiments, the above and other features, advantages, and aspects of the embodiments of the present invention will become more apparent. Throughout the drawings, the same or similar reference numerals denote the same or similar elements. It should be understood that the drawings are schematic and that the original and elements are not necessarily drawn to scale.

[0020] Figure 1 It is a schematic flowchart of a target detection method provided by an embodiment of the present invention;

[0021] Figure 2 It is a schematic diagram of the division of the imaging area of a shooting device in target detection provided by an embodiment of the present invention;

[0022] Figure 3a It is a schematic flowchart of a target detection provided by an embodiment of the present invention;

[0023] Figure 3b It is a schematic diagram of selecting an imaging sub-region from the imaging area of a shooting device provided by an embodiment of the present invention;

[0024] Figure 3c It is another schematic diagram of selecting an imaging sub-region from the imaging area of a shooting device provided by an embodiment of the present invention;

[0025] Figure 4 It is another schematic flowchart of a target detection method provided by an embodiment of the present invention;

[0026] Figure 5 It is a schematic structural diagram of a target detection device provided by an embodiment of the present invention;

[0027] Figure 6 It is a schematic structural diagram of an electronic device for implementing the target detection method provided by an embodiment of the present invention. Specific Embodiments

[0028] The embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. Although some embodiments of the present invention are shown in the drawings, it should be understood that the present invention can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. On the contrary, these embodiments are provided to more thoroughly and completely understand the present invention. It should be understood that the drawings and embodiments of the present invention are only for exemplary purposes and are not used to limit the protection scope of the present invention.

[0029] It should be understood that the steps described in the method embodiments of the present invention can be executed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present invention is not limited in this regard.

[0030] As used herein, the term "including" and its variations are open-ended, i.e., "including but not limited to". The term "based on" means "at least partially based on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Relevant definitions of other terms will be given in the following description.

[0031] It should be noted that concepts such as "first", "second", etc. mentioned in the present invention are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0032] It should be noted that the modifications of "one" and "a plurality of" mentioned in the present invention are illustrative rather than restrictive. Those skilled in the art should understand that, unless otherwise clearly specified in the context, it should be understood as "one or more".

[0033] The names of the messages or information exchanged between multiple devices in the embodiments of the present invention are only for illustrative purposes and are not used to limit the scope of these messages or information.

[0034] Figure 1 The flowchart shows a target detection method provided by an embodiment of the present invention. The embodiment of the present invention is applicable to the situation where a shooting device is used to detect and identify a target part. This method can be executed by a target detection device, which can be implemented in the form of software and / or hardware and is generally integrated in any electronic device with network communication functions. The electronic device can be a mobile terminal, a PC or a server, etc.

[0035] As Figure 1 shown, the target detection method of the embodiment of the present invention may include the following processes:

[0036] S110. Determine the first imaging sub-region where the target halo is located in the first picture displayed in the imaging region of the shooting device. The imaging region of the shooting device is pre-divided into multiple imaging sub-regions.

[0037] The shooting device can be a camera, a pan-tilt camera, and various detection and identification devices that carry a camera lens for image acquisition and perform detection and identification. See Figure 2 , the lens of the shooting device is equivalent to a convex lens. When light from an external object passes through the lens of the shooting device, it converges on the imaging region 210 of the shooting device to form a displayed picture. The imaging region 210 of the shooting device is pre-divided into multiple imaging sub-regions 211, and the imaging region of the shooting device is used to image the picture content of the corresponding detection region of the shooting device.

[0038] SeeFigure 2 The lens of a photographing device is a lens group composed of many lenses. Each lens has high permeability, but inevitably, a part of the light is reflected and scattered. The light that does not maintain the same direction as other incident light causes the appearance of halos and enters the imaging sub-region, which will cause halos to appear in the first image displayed in the imaging area of the photographing device. The appearance of halos will cause the halos to be mixed with the feature of the target part (such as facial features) in the imaging sub-region, affecting the detection and recognition accuracy of the target part. Therefore, when it is detected that there is a target halo in the first image displayed in the imaging area of the photographing device, it is necessary to determine the first imaging sub-region where the target halo is located in the imaging area of the photographing device, so as to determine whether to effectively suppress the target halo appearing in the first imaging sub-region.

[0039] S120. Determine whether to adjust the shooting angle of the photographing device according to the relationship between the probability of the target part movement trajectory appearing in the first imaging sub-region and the specified probability threshold.

[0040] Determine whether the probability of the target part movement trajectory appearing in the first imaging sub-region is greater than the specified probability threshold. If the probability of the target part movement trajectory appearing in the first imaging sub-region is greater than the specified probability threshold, it means that the probability of the target part appearing in this part of the imaging sub-region is very high. If there is a target halo in this imaging sub-region, it will inevitably affect the detection and recognition accuracy of the target part. Therefore, it is necessary to determine whether to adjust the shooting angle of the photographing device according to the relationship between the probability of the target part movement trajectory appearing in the first imaging sub-region and the specified probability threshold, so that the target halo in the image displayed in the imaging area of the photographing device avoids the first imaging sub-region after the shooting angle of the photographing device is adjusted, realizing that the target halo avoids the target part. In this way, when detecting the target part by using the photographing device after adjusting the shooting angle, the detection and recognition accuracy of the target part in the first imaging sub-region can be improved.

[0041] As an optional but non-limiting implementation manner, determining whether to adjust the shooting angle of the photographing device according to the relationship between the probability of the target part movement trajectory appearing in the first imaging sub-region and the specified probability threshold includes the following steps:

[0042] If the probability of the target part movement trajectory appearing in the first imaging sub-region is greater than the specified probability threshold, then adjust the shooting angle of the photographing device so that the target halo existing in the second image displayed in the imaging area of the photographing device enters the second imaging sub-region of the imaging area of the photographing device or there is no target halo in the second image displayed in the imaging area of the photographing device, and the possibility of the target part movement trajectory appearing in the first imaging sub-region is greater than the possibility of the target part movement trajectory appearing in the second imaging sub-region.

[0043] See Figure 3a When the target halo appears in the first image displayed in the imaging area of the imaging device, if there is no target part or the frequency of the target part appearing is very low in the first imaging sub-region where the target halo is located, even if the target halo enters the first imaging sub-region for display, the influence of the target halo on the detection and recognition of the target part is relatively small. At this time, it is not very necessary to suppress the target halo entering the first imaging sub-region. If the target part frequently appears in the first imaging sub-region where the target halo appears, then the target halo in the first image displayed in the subsequent imaging area of the imaging device will frequently interfere with the target part.

[0044] Therefore, it is necessary to detect the probability of the target part movement trajectory appearing in each imaging sub-region in the imaging area of the imaging device. When determining the first imaging sub-region where the target halo is located in the first image, query whether the probability of the target part movement trajectory appearing in the first imaging sub-region is greater than the specified probability threshold. If it is greater than the specified probability threshold, it means that the first imaging sub-region will frequently appear the target part among all imaging sub-regions in the imaging area of the imaging device. When the target halo appears in the first imaging sub-region, it will interfere with the detection and recognition of the target part in the corresponding image of the first imaging sub-region. Therefore, it is necessary to suppress the target halo entering the first imaging sub-region.

[0045] See Figure 3b And Figure 3c When suppressing the target halo entering the first imaging sub-region, the shooting angle of the lens of the imaging device can be adjusted. Through the lens adjustment, the target halo formed by the light passing through the lens and projected onto the imaging area of the imaging device will no longer be in the first imaging sub-region, but enter the second imaging sub-region of the imaging area of the imaging device from the first imaging sub-region or directly move outside the imaging area of the imaging device, so that there is no target halo in the second image displayed in the imaging area of the imaging device. The acquisition time of the second image is later than the acquisition time of the first image, and the second image is the image displayed in the imaging area of the imaging device after the first image displayed in the imaging area of the imaging device.

[0046] Among them, the imaging device is built-in with a micro gimbal. Through the micro gimbal, the shooting angle of the lens of the imaging device can be adjusted so that the imaging area of the imaging device can collect the image content of different detection areas.

[0047] Especially important is that the possibility of the target part movement trajectory appearing in the first imaging sub-region is greater than the possibility of the target part movement trajectory appearing in the second imaging sub-region. Then, even if the target halo enters the second imaging sub-region, it will not have too much impact on the detection and recognition of the target part, so as to reduce the impact of the target halo entering the imaging sub-region on the accuracy of the detection and recognition of the target part.

[0048] As an optional but non-limiting implementation, before adjusting the shooting angle of the shooting device, the following steps A1 - A2 are further included:

[0049] Step A1: Determine the probability of the target part movement trajectory appearing in each imaging sub-region of the imaging area of the shooting device. The probability of the target part movement trajectory appearing in the imaging sub-region is determined based on the statistics of the target part movement trajectory appearing in each imaging sub-region in multiple third pictures displayed in the imaging area of the shooting device. The acquisition time of the third picture is earlier than the acquisition time of the first picture.

[0050] Step A2: Based on the probability of the target part movement trajectory appearing in each imaging sub-region, determine the probability of the target part movement trajectory appearing in the first imaging sub-region.

[0051] See Figure 2 , the imaging area of the shooting device is pre-divided into multiple imaging sub-regions. For each imaging sub-region of the shooting device, it is detected in real time whether there is a target part movement trajectory in the third picture displayed in the imaging area of the shooting device. The acquisition time of the third picture is earlier than the acquisition time of the first picture. The third picture is an image picture formed by the imaging of the imaging area of the shooting device before the first picture.

[0052] Optionally, by detecting and analyzing in real time the position of the target part movement trajectory in the multiple third pictures displayed in the imaging area of the shooting device, the probability value of the target part movement trajectory appearing in each imaging sub-region in the imaging area of the shooting device is statistically obtained in real time.

[0053] Optionally, by statistically analyzing the position of the target part appearing in the imaging area of the shooting device and based on the statistically obtained position of the target part, determine the number of target parts in each imaging sub-region in the imaging area of the shooting device. Furthermore, based on the number of target parts in each imaging sub-region in the imaging area of the shooting device, determine the probability value of the target part movement trajectory appearing in each imaging sub-region in the imaging area of the shooting device.

[0054] Optionally, after determining the probability of the target part movement trajectory appearing in each imaging sub-region of the imaging area of the shooting device, the following steps are further included:

[0055] Determine the size of the target part appearing in each imaging sub-region of the imaging area of the shooting device; based on the size of the target part appearing in each imaging sub-region, correct the probability of the target part movement trajectory appearing in each imaging sub-region.

[0056] According to the size of the target part appearing in each imaging sub-region, correct the probability value of the movement trajectory of the target part appearing in each imaging sub-region. If the size of the target part deviates more from the optimal size of the target part, then reduce the probability value of the movement trajectory of the target part appearing in this imaging sub-region according to a preset ratio, so as to achieve the probability correction of the movement trajectory of the target part appearing in each imaging sub-region.

[0057] S130. Use a shooting device to detect and identify the target part.

[0058] Optionally, using a shooting device to detect and identify the target part includes: after adjusting the shooting angle of the shooting device, using the shooting device to detect and identify the target part.

[0059] See Figure 3a , after adjusting the shooting angle of the shooting device, the target halo existing in the second picture displayed in the imaging area of the shooting device will enter the second imaging sub-region that enters the imaging area of the shooting device according to the adjustment and will not enter the first imaging sub-region, or there will be no target halo entering the imaging area of the shooting device to ensure that there is no target halo in the second picture displayed in the imaging area of the shooting device. At this time, the shooting device can be directly used to collect the image of the target part to obtain the corresponding image screen. Since there is no longer a target halo entering the first imaging sub-region where the movement trajectory of the target part appears subsequently, the accuracy of the detection and identification of the target part will not be affected by the target halo during the detection and identification of the target part.

[0060] Optionally, the second imaging sub-region is the imaging sub-region near the edge position of the imaging area of the shooting device among the respective imaging sub-regions of the imaging area of the shooting device. The imaging sub-region near the edge position of the imaging area of the shooting device is usually located at the edge. For the detection and identification device, usually the target part entering the imaging area of the shooting device will be located in the middle area rather than the edge area of the corresponding detection area of the imaging area of the shooting device.

[0061] In an embodiment of the present invention, when using a photographing device to detect a target part, the first imaging sub-region where the target halo is located in the first picture displayed in the imaging region of the photographing device is determined, and it is determined whether the probability of the target part moving trajectory appearing in the first imaging sub-region is greater than a specified probability threshold. If it is greater than the specified probability threshold, it means that the probability of the target part appearing in this part of the imaging sub-region is very high. If there is a target halo in this imaging sub-region, it will inevitably affect the accuracy of target part detection and recognition. Therefore, it is necessary to adjust the shooting angle of the photographing device so that the target halo in the picture displayed in the imaging region of the photographing device enters the second imaging sub-region of the imaging region of the photographing device or there is no target halo in the picture displayed in the imaging region of the photographing device. In this way, when using the photographing device after adjusting the shooting angle to detect the target part, the detection and recognition accuracy of the target part in the first imaging sub-region can be improved; at the same time, the possibility of the target part moving trajectory appearing in the first imaging sub-region is greater than the possibility of the target part moving trajectory appearing in the second imaging sub-region. Then, even if the target halo enters the second imaging sub-region, it will not have much impact on the detection and recognition of the target part, so as to reduce the impact of the target halo entering the imaging sub-region on the detection and recognition accuracy of the target part becoming low.

[0062] Figure 4 It is a schematic flowchart of another target detection method provided by an embodiment of the present invention. The technical solution of this embodiment further optimizes the process of adjusting the shooting angle of the photographing device in the previous embodiment on the basis of the technical solution of the previous embodiment. This embodiment can be combined with each optional solution in one or more of the above embodiments.

[0063] As Figure 4 shown, the target detection method of the embodiment of the present invention may include the following processes:

[0064] S410. Determine the first imaging sub-region where the target halo is located in the first picture displayed in the imaging region of the photographing device. The imaging region of the photographing device is pre-divided into multiple imaging sub-regions.

[0065] S420. If the probability of the target part moving trajectory appearing in the first imaging sub-region is greater than a specified probability threshold, according to the first imaging sub-region where the target halo is located in the first picture, at least one third imaging sub-region that can allow the target halo in the first picture to enter is determined from each imaging sub-region of the imaging region of the photographing device according to the shooting angle adjustment range supported by the photographing device.

[0066] When adjusting the shooting angle of a shooting device, since the detection area specified for each shooting device is a relatively fixed area, if the adjustment range of the shooting angle of the shooting device is large, although the target halo can be adjusted outside the imaging area of the shooting device, it may also cause the shooting device to no longer be able to continue detecting the detection area specified for the shooting device. Therefore, when adjusting the shooting angle of the shooting device, it is also necessary to consider the shooting angle adjustment range supported by the shooting device. Without exceeding the shooting angle adjustment range supported by the shooting device, and within the adjustment ability of the shooting device, determine a third imaging sub-region that can allow the target halo in the first frame to be adjusted into from each imaging sub-region of the shooting device imaging area. Among them, it can be represented by the sub-region number of at least one third imaging sub-region in the shooting device imaging area. Each imaging sub-region corresponds to an adjustment azimuth angle and is associated with the sub-region number of the imaging sub-region.

[0067] S430. Determine a second imaging sub-region from at least one third imaging sub-region, and adjust the shooting angle of the shooting device according to the position of the second imaging sub-region in the shooting device imaging area, so that the target halo in the second frame displayed in the shooting device imaging area enters the second imaging sub-region of the shooting device imaging area or there is no target halo in the second frame displayed in the shooting device imaging area, and the possibility of the target part movement trajectory appearing in the first imaging sub-region is greater than the possibility of the target part movement trajectory appearing in the second imaging sub-region.

[0068] When determining at least one third imaging sub-region, further screening and processing can be performed according to the influence degree on the detection and recognition of the target part after the target halo in the first frame is adjusted into each third imaging sub-region, and select the third imaging sub-region with the lowest possible influence degree on the detection and recognition of the target part as the second imaging sub-region that the target halo in the first frame is to be adjusted into.

[0069] As an optional but non-limiting implementation manner, determining a second imaging sub-region from at least one third imaging sub-region includes the following steps:

[0070] Select the imaging sub-regions that extend forward and backward to the edge position along the direction of the target part movement trajectory that appears in the first imaging sub-region from at least one third imaging sub-region and use them as the second imaging sub-regions.

[0071] Before adjusting the shooting angle of the shooting device, it is assumed that the moving trajectory of the target part may appear in the imaging sub-region 1 of the imaging area of the shooting device. However, after adjusting the shooting angle of the shooting device, due to the angle adjustment of the shooting device, the same target part will appear in the imaging sub-region 2 of the imaging area of the shooting device, resulting in the target shooting device appearing in the imaging sub-region where it is desired to appear.

[0072] Therefore, when determining the second imaging sub-region from at least one third imaging sub-region, the moving trajectory direction of the target part that appears in the first imaging sub-region can be considered, and it is extended forward and backward along the moving trajectory direction of the target part to the edge position of the imaging area of the shooting device. The imaging sub-region that extends to the edge position of the imaging area of the shooting device and is located in at least one third imaging sub-region is used as the second imaging sub-region. Since the second imaging sub-region is selected according to the moving trajectory direction of the target part, according to the continuity of the movement of the target part, although the target part is not initially in the imaging sub-region where it is desired to appear after the angle adjustment, as long as the target part moves along the original moving trajectory, it will gradually enter the desired imaging sub-region. This can not only suppress the target halo but also achieve the natural entry of the target part into the desired area in the imaging sub-region of the shooting device for the detection and recognition of the target part without being perceived.

[0073] As another optional but non-limiting implementation manner, determining the second imaging sub-region from at least one third imaging sub-region includes the following steps:

[0074] Determine the imaging sub-regions located at the edge position of the imaging area of the shooting device and on both sides of the target part trajectory that appears in the first imaging sub-region from at least one third imaging sub-region and use them as the second imaging sub-regions.

[0075] As an optional but non-limiting implementation manner, determining the second imaging sub-region from at least one third imaging sub-region includes the following steps C1 - C2:

[0076] Step C1: Determine the influence degree of the target halo on the detection and recognition of the target part in the first picture displayed in the imaging area of the shooting device.

[0077] Step C2: According to the influence degree on the detection and recognition of the target part, determine the second imaging sub-region from at least one third imaging sub-region, where the detection accuracy of the target part after the target halo enters the second imaging sub-region is greater than the detection accuracy of the target part after the target halo enters each of the second imaging sub-regions other than the second imaging sub-region in at least one third imaging sub-region.

[0078] If there are multiple target halos in the first image displayed in the imaging area of the imaging device, it is necessary to separately count the influence degree of each target halo on the image, and comprehensively consider the influence degree of each target halo on the detection and recognition of the target part, as well as the probability value of the movement trajectory of the target part in each area of the image displayed in the imaging area of the imaging device. By adjusting the micro gimbal of the imaging device, an imaging sub-area with the least global influence on the detection and recognition of the target part is obtained for the target halo to enter.

[0079] S440. After adjusting the shooting angle of the shooting device, use the shooting device to detect and recognize the target part.

[0080] As an optional but non-limiting implementation method, when using the shooting device to detect and recognize the target part, the following steps are also included:

[0081] A guiding frame is provided on the display screen of the shooting device. The guiding frame is used to guide the target part to adjust its position so that the target part enters the guiding frame on the display screen of the shooting device, and there is no target halo in the local display screen corresponding to the guiding frame.

[0082] When determining the second imaging sub-area from at least one third imaging sub-area, if imaging sub-areas located at the edge positions of the imaging area of the shooting device are selected on both sides of the movement trajectory of the target part from at least one third imaging sub-area, without considering the movement trajectory direction of the target part in the middle, then the target part still cannot enter along the original movement trajectory. For this reason, a guiding frame needs to be provided on the display screen of the shooting device, and the target part is allowed to adjust its position through the guiding frame.

[0083] As an optional but non-limiting implementation method, when using the shooting device to detect and recognize the target part, the following steps D1 - D2 are also included:

[0084] Step D1: Detect whether the target halo in the first image displayed in the imaging area of the shooting device is a halo generated by a moving light source.

[0085] Step D2: If so, determine the movement trajectory of the light source corresponding to the target halo in the first image displayed in the imaging area of the shooting device, and dynamically adjust the shooting angle of the shooting device based on the movement trajectory of the light source corresponding to the target halo in the first image displayed in the imaging area of the shooting device, so that the target halo existing in the second image displayed in the imaging area of the shooting device remains in the second imaging sub-area of the imaging area of the shooting device or there is no target halo in the second image displayed in the imaging area of the shooting device.

[0086] If the target halo in the first image displayed in the imaging area of the imaging device is a halo formed by a movable light source such as the sun light source, automatically calculate the movement trajectory of the sun light source, and dynamically adjust the angle of the micro gimbal of the imaging device to ensure that the target halo in the first image displayed in the imaging area of the imaging device is always in the second imaging sub-region.

[0087] In the technical solution of the embodiment of the present invention, when using the imaging device to detect the target part, determine the first imaging sub-region where the target halo is located in the first image displayed in the imaging area of the imaging device, and determine whether the probability of the target part movement trajectory appearing in the first imaging sub-region is greater than the specified probability threshold. If it is greater than the specified probability threshold, it means that the probability of the target part appearing in this part of the imaging sub-region is very high. If there is a target halo in this imaging sub-region, it will inevitably affect the accuracy of target part detection and recognition. Therefore, it is necessary to adjust the shooting angle of the imaging device so that the target halo in the image displayed in the imaging area of the imaging device enters the second imaging sub-region of the imaging area of the imaging device or there is no target halo in the image displayed in the imaging area of the imaging device. In this way, when using the imaging device with the adjusted shooting angle to detect the target part, the detection and recognition accuracy of the target part in the first imaging sub-region can be improved; at the same time, the possibility of the target part movement trajectory appearing in the first imaging sub-region is greater than the possibility of the target part movement trajectory appearing in the second imaging sub-region. Then, even if the target halo enters the second imaging sub-region, it will not have too much impact on the detection and recognition of the target part. In this way, the influence of the decrease in the detection and recognition accuracy of the target part caused by the target halo entering the imaging sub-region can be reduced.

[0088] Figure 5 It is a schematic structural diagram of a target detection device provided by an embodiment of the present invention. The embodiment of the present invention is applicable to the situation of using an imaging device to detect and recognize a target part. The target detection device can be implemented in the form of software and / or hardware, and is generally integrated on any electronic device with network communication functions. The electronic device can be a mobile terminal, a PC or a server, etc.

[0089] As Figure 5 shown, the target detection device of the embodiment of the present invention may include: a determination module 510, an adjustment module 520, and a detection module 530. Among them:

[0090] The determination module 510 is configured to determine the first imaging sub-region where the target halo is located in the first image displayed in the imaging area of the imaging device, and the imaging area of the imaging device is pre-divided into multiple imaging sub-regions;

[0091] The adjustment module 520 is configured to determine whether to adjust the shooting angle of the imaging device according to the magnitude relationship between the probability of the target part movement trajectory appearing in the first imaging sub-region and the specified probability threshold;

[0092] The detection module 530 is used to detect and identify the target part by using the photographing device.

[0093] Based on the technical solution of the above embodiment, optionally, whether to adjust the shooting angle of the shooting device is determined according to the relationship between the probability of the target part movement trajectory appearing in the first imaging sub-region and the specified probability threshold, including:

[0094] If the probability of the target part movement trajectory appearing in the first imaging sub-region is greater than the specified probability threshold, the shooting angle of the shooting device is adjusted so that the target halo existing in the second imaging sub-region of the imaging area of the shooting device enters the second imaging sub-region of the imaging area of the shooting device or there is no target halo in the second picture displayed in the imaging area of the shooting device, and the possibility of the target part movement trajectory appearing in the first imaging sub-region is greater than the possibility of the target part movement trajectory appearing in the second imaging sub-region.

[0095] Based on the technical solution of the above embodiment, optionally, before adjusting the shooting angle of the shooting device, it further includes:

[0096] Determine the probability of the target part movement trajectory appearing in each imaging sub-region of the imaging area of the shooting device. The probability of the target part movement trajectory appearing in the imaging sub-region is determined based on the statistics of the target part movement trajectory appearing in each imaging sub-region in a plurality of third pictures displayed in the imaging area of the shooting device, and the acquisition time of the third picture is earlier than the acquisition time of the first picture;

[0097] Based on the probability of the target part movement trajectory appearing in each imaging sub-region respectively, determine the probability of the target part movement trajectory appearing in the first imaging sub-region.

[0098] Based on the technical solution of the above embodiment, optionally, the method further includes:

[0099] Determine the size of the target part appearing in each imaging sub-region of the imaging area of the shooting device;

[0100] Based on the size of the target part appearing in each imaging sub-region, correct the probability of the target part movement trajectory appearing in each imaging sub-region.

[0101] Based on the technical solution of the above embodiment, optionally, adjusting the shooting angle of the shooting device includes:

[0102] According to the first imaging sub-region where the target halo is located in the first picture, at least one third imaging sub-region that can allow the target halo in the first picture to enter is determined from each imaging sub-region of the imaging area of the shooting device according to the shooting angle adjustment range supported by the shooting device;

[0103] Determine a second imaging sub-region from at least one third imaging sub-region, and adjust the shooting angle of the shooting device according to the position of the second imaging sub-region in the imaging region of the shooting device.

[0104] Based on the technical solution of the above embodiment, optionally, determining a second imaging sub-region from at least one third imaging sub-region includes:

[0105] Select an imaging sub-region that extends along the moving trajectory direction of the target part that appears in the first imaging sub-region to the edge position from at least one third imaging sub-region as the second imaging sub-region.

[0106] Based on the technical solution of the above embodiment, optionally, determining a second imaging sub-region from at least one third imaging sub-region includes:

[0107] Determine an imaging sub-region that is located at the edge position of the imaging region of the shooting device and on both sides of the trajectory of the target part that appears in the first imaging sub-region from at least one third imaging sub-region as the second imaging sub-region.

[0108] Based on the technical solution of the above embodiment, optionally, determining a second imaging sub-region from at least one third imaging sub-region includes:

[0109] Determine the influence degree of the target halo on the detection and recognition of the target part in the first picture displayed in the imaging region of the shooting device;

[0110] According to the influence degree on the detection and recognition of the target part, determine a second imaging sub-region from at least one third imaging sub-region, wherein the detection accuracy of the target part after the target halo enters the second imaging sub-region is greater than the detection accuracy of the target part after the target halo enters each of the second imaging sub-regions other than the second imaging sub-region in at least one third imaging sub-region.

[0111] Based on the technical solution of the above embodiment, optionally, when using the shooting device to detect and recognize the target part, it further includes:

[0112] Detect whether the target halo in the first picture is a halo generated by a moving light source;

[0113] If so, determine the moving trajectory of the light source corresponding to the target halo in the first picture, and dynamically adjust the shooting angle of the shooting device based on the moving trajectory of the light source corresponding to the target halo in the first picture, so that the target halo existing in the second picture displayed in the imaging region of the shooting device remains in the second imaging sub-region of the imaging region of the shooting device or there is no target halo in the second picture displayed in the imaging region of the shooting device.

[0114] Based on the technical solution of the above embodiment, optionally, when using a photographing device to detect and identify a target part, it further includes:

[0115] A guiding frame is provided on the display screen of the photographing device. The guiding frame is used to guide the target part to adjust its position so that the target part enters the guiding frame in the display screen of the photographing device, and there is no target halo in the partial display screen corresponding to the guiding frame.

[0116] In the technical solution provided by the embodiment of the present invention, when using a photographing device to detect a target part, determine the first imaging sub-region where the target halo is located in the first image displayed in the imaging area of the photographing device, and determine whether the probability of the target part movement trajectory appearing in the first imaging sub-region is greater than a specified probability threshold. If it is greater than the specified probability threshold, it means that the probability of the target part appearing in this part of the imaging sub-region is very high. If there is a target halo in this imaging sub-region, it will inevitably affect the accuracy of target part detection and recognition. Therefore, it is necessary to adjust the shooting angle of the photographing device so that the target halo in the image displayed in the imaging area of the photographing device enters the second imaging sub-region of the imaging area of the photographing device or there is no target halo in the image displayed in the imaging area of the photographing device. In this way, when using the photographing device with the adjusted shooting angle to detect the target part, the detection and recognition accuracy of the target part in the first imaging sub-region can be improved; at the same time, the possibility of the target part movement trajectory appearing in the first imaging sub-region is greater than the possibility of the target part movement trajectory appearing in the second imaging sub-region. Then, even if the target halo enters the second imaging sub-region, it will not have much impact on the detection and recognition of the target part, so as to reduce the impact on the detection and recognition accuracy of the target part caused by the target halo entering the imaging sub-region.

[0117] The target detection device provided by the embodiment of the present invention can execute the target detection method provided by any embodiment of the present invention, and has corresponding functional modules and beneficial effects for executing the target detection method.

[0118] It should be noted that the various units and modules included in the above device are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be realized; in addition, the specific names of the functional units are only for the convenience of mutual distinction and do not limit the protection scope of the embodiment of the present invention.

[0119] Figure 6 It is a schematic structural diagram of an electronic device provided by an embodiment of the present invention. Next, refer to Figure 6 , which shows an electronic device suitable for implementing the embodiment of the present invention (for example Figure 6Schematic diagram of the structure of the terminal device or server) 600 in. The terminal device in the embodiments of the present invention may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Tablet Computers), PMPs (Portable Multimedia Players), in-vehicle terminals (such as in-vehicle navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 6 The electronic device shown is merely an example and should not impose any limitations on the functions and scope of use of the embodiments of the present invention.

[0120] As Figure 6 As shown, the electronic device 600 may include a processing device (such as a central processing unit, a graphics processing unit, etc.) 601, which may perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 602 or the program loaded from the storage device 608 into the random access memory (RAM) 603. In the RAM 603, various programs and data required for the operation of the electronic device 600 are also stored. The processing device 601, the ROM 602, and the RAM 603 are connected to each other through a bus 604. The editing / output (I / O) interface 605 is also connected to the bus 604.

[0121] Generally, the following devices may be connected to the I / O interface 605: an input device 606 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 607 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 608 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 609. The communication device 609 may allow the electronic device 600 to communicate with other devices wirelessly or wiredly to exchange data. Although Figure 6 The electronic device 600 with various devices is shown, but it should be understood that it is not required to implement or have all the shown devices. More or fewer devices may be implemented or had alternatively.

[0122] In particular, according to the embodiments of the present invention, the process described above with reference to the flowchart may be implemented as a computer software program. For example, the embodiments of the present invention include a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program contains program codes for executing the object detection method shown in the flowchart. In such an embodiment, the computer program may be downloaded and installed from the network through the communication device 609, or installed from the storage device 608, or installed from the ROM 602. When the computer program is executed by the processing device 601, the above functions defined in the object detection method of the embodiments of the present invention are executed.

[0123] The names of the messages or information exchanged between multiple devices in the embodiments of the present invention are for illustrative purposes only and are not used to limit the scope of these messages or information.

[0124] The electronic device provided in the embodiment of the present invention and the object detection method provided in the above embodiment belong to the same inventive concept. Technical details not described in detail in this embodiment can be referred to the above embodiment, and this embodiment has the same beneficial effects as the above embodiment.

[0125] The embodiment of the present invention provides a computer storage medium, on which a computer program is stored, and when the program is executed by a processor, it implements the object detection method provided in the above embodiment.

[0126] It should be noted that the computer-readable medium in the present invention can be a computer-readable signal medium, a computer-readable storage medium, or any combination of the two. The computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples of the computer-readable storage medium can include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present invention, the computer-readable storage medium can be any tangible medium that contains or stores a program, and this program can be used by or in combination with an instruction execution system, apparatus, or device. In the present invention, the computer-readable signal medium can include a data signal propagated in a baseband or as part of a carrier wave, in which the computer-readable program code is carried. Such a propagated data signal can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. The computer-readable signal medium can also be any computer-readable medium other than the computer-readable storage medium, and this computer-readable signal medium can send, propagate, or transmit a program for use by or in combination with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted by any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0127] In some embodiments, the client and the server may communicate using any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.

[0128] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0129] The above-mentioned computer-readable medium carries one or more programs. When the above-mentioned one or more programs are executed by the electronic device, the electronic device: determines the first imaging sub-area where the target halo is located in the first picture displayed by the imaging area of ​​the shooting device, and the imaging area of ​​the shooting device is pre-divided into multiple imaging sub-areas; determines whether to adjust the shooting angle of the shooting device according to the relationship between the probability of the target part moving trajectory appearing in the first imaging sub-area and the specified probability threshold; and uses the shooting device to detect and identify the target part.

[0130] Computer program code for performing the operations of the present invention may be written in one or more programming languages ​​or a combination thereof, including, but not limited to, object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0131] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present invention. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0132] The units involved in the embodiments of the present invention may be implemented by software or hardware. The name of a unit does not limit the unit itself in some cases. For example, the first acquisition unit may also be described as a "unit for acquiring at least two Internet Protocol addresses".

[0133] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0134] In the context of the present invention, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0135] The above description is only a preferred embodiment of the present invention and an explanation of the technical principles used. Those skilled in the art should understand that the disclosure scope involved in the present invention is not limited to the technical solution formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present invention (but not limited to) by each other.

[0136] In addition, although each operation is described in a specific order, this should not be construed as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be construed as limiting the scope of the present invention. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0137] Although the subject matter has been described in language specific to structural features and / or methodological logical actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims.

Claims

1. A target detection method, characterized in that, the method includes: determining a first imaging sub-region where a target halo is located in a first picture displayed in an imaging area of a photographing device, the imaging area of the photographing device being pre-divided into multiple imaging sub-regions; determining whether to adjust the photographing angle of the photographing device according to the magnitude relationship between the probability of a target part movement trajectory appearing in the first imaging sub-region and a specified probability threshold; performing target part detection and recognition using the photographing device.

2. The method according to claim 1, characterized in that, determining whether to adjust the photographing angle of the photographing device according to the magnitude relationship between the probability of a target part movement trajectory appearing in the first imaging sub-region and a specified probability threshold includes: if the probability of a target part movement trajectory appearing in the first imaging sub-region is greater than the specified probability threshold, adjusting the photographing angle of the photographing device so that the target halo existing in a second picture displayed in the imaging area of the photographing device enters a second imaging sub-region of the imaging area of the photographing device or there is no target halo in the second picture displayed in the imaging area of the photographing device, and the possibility of a target part movement trajectory appearing in the first imaging sub-region is greater than the possibility of a target part movement trajectory appearing in the second imaging sub-region.

3. The method according to claim 2, characterized in that, before adjusting the photographing angle of the photographing device, it further includes: determining the probability of a target part movement trajectory appearing in each imaging sub-region of the imaging area of the photographing device, the probability of a target part movement trajectory appearing in the imaging sub-region being determined based on the statistics of the target part movement trajectories appearing in each imaging sub-region in multiple third pictures displayed in the imaging area of the photographing device, and the acquisition time of the third pictures being earlier than the acquisition time of the first picture; determining the probability of a target part movement trajectory appearing in the first imaging sub-region based on the probabilities of a target part movement trajectory appearing in each imaging sub-region.

4. The method according to claim 2, characterized in that, adjusting the photographing angle of the photographing device includes: according to the first imaging sub-region where the target halo is located in the first picture, determining at least one third imaging sub-region that can allow the target halo in the first picture to enter from each imaging sub-region within the photographing angle adjustment range supported by the photographing device; determining a second imaging sub-region from the at least one third imaging sub-region and adjusting the photographing angle of the photographing device according to the position of the second imaging sub-region in the imaging area of the photographing device.

5. The method according to claim 4, characterized in that, determining a second imaging sub-region from the at least one third imaging sub-region includes: selecting an imaging sub-region that extends forward and backward along the direction of the target part movement trajectory appearing in the first imaging sub-region to the edge position from the at least one third imaging sub-region and using it as the second imaging sub-region; or, determining an imaging sub-region located at the edge position of the imaging area of the photographing device and on both sides of the target part trajectory appearing in the first imaging sub-region from the at least one third imaging sub-region and using it as the second imaging sub-region.

6. The method according to claim 4 or 5, It is characterized in that Determining a second imaging sub-region from at least one third imaging sub-region includes: Determining the degree of influence of the target halo on the detection and recognition of the target part in the first picture displayed in the imaging area of the shooting device; According to the degree of influence on the detection and recognition of the target part, determining a second imaging sub-region from at least one third imaging sub-region, wherein after the target halo enters the second imaging sub-region, the detection accuracy of the target part is greater than that after the target halo enters each of the second imaging sub-regions other than the second imaging sub-region in at least one third imaging sub-region.

7. The method according to claim 1, It is characterized in that When using the shooting device to detect and recognize the target part, it further includes: Detecting whether the target halo in the first picture is a halo generated by a moving light source; If so, determining the moving trajectory of the light source corresponding to the target halo in the first picture, and dynamically adjusting the shooting angle of the shooting device based on the moving trajectory of the light source corresponding to the target halo in the first picture, so that the target halo existing in the second picture displayed in the imaging area of the shooting device remains in the second imaging sub-region of the imaging area of the shooting device or there is no target halo in the second picture displayed in the imaging area of the shooting device.

8. A target detection device, It is characterized in that The device includes: A determination module, configured to determine a first imaging sub-region where a target halo is located in a first picture displayed in an imaging area of a shooting device, and the imaging area of the shooting device is pre-divided into multiple imaging sub-regions; An adjustment module, configured to determine whether to adjust the shooting angle of the shooting device according to the relationship between the probability of the appearance of the target part moving trajectory in the first imaging sub-region and a specified probability threshold; A detection module, configured to use the shooting device to detect and recognize the target part.

9. An electronic device, It is characterized in that The electronic device includes: One or more processors; A storage device, configured to store one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the target detection method as described in any one of claims 1-7.

10. A storage medium containing computer-executable instructions, It is characterized in that The computer-executable instructions are used to execute the target detection method as described in any one of claims 1-7 when executed by a computer processor.

Images