Control method, apparatus and device for camera device, and storage medium

Abstract

The present application relates to the technical field of monitoring control. Disclosed are a control method, apparatus and device for a camera device, and a storage medium. The disclosed control method for a camera device is applied to a control module in a camera, wherein the camera comprises a bullet-camera fisheye lens and a dome-camera telephoto lens, and the method comprises: after a captured picture captured by a bullet-camera fisheye lens is acquired, identifying, from the captured picture, a target to be focused on; controlling a dome-camera telephoto lens to capture a spatially compressed picture which includes detailed features of said target; on the basis of the spatially compressed picture, analyzing a motion behavior of said target; and on the basis of the motion behavior, adjusting a photographing angle of the bullet-camera fisheye lens, and adjusting a monitoring angle and a monitoring range of the dome-camera telephoto lens. That is, on the basis of the detailed features included in the spatially compressed picture, the motion behavior of said target is analyzed, and on the basis of the motion behavior, the bullet-camera fisheye lens and the dome-camera telephoto lens are adjusted, so as to prevent said target from being lost against the background during the tracking of said target, thereby improving the monitoring efficiency of camera devices.

Description

Control methods, devices, equipment and storage media for camera equipment Technical Field

[0001] This application relates to the field of monitoring and control technology, and in particular to control methods, devices, equipment and storage media for camera equipment. Background Technology

[0002] A camera is a video input device that is widely used in various fields to ensure the safety of the monitored scenes.

[0003] Currently, surveillance cameras are often categorized based on their monitoring range and resolution. Therefore, surveillance cameras typically combine a bullet camera design with a telephoto lens to capture the largest and clearest possible image. Some cameras also utilize PTZ cameras for even clearer images. In scenarios requiring high-resolution footage, bullet and PTZ cameras are often combined. However, the common combination of bullet and PTZ cameras is often affected by the characteristics of the lenses themselves, leading to reduced monitoring efficiency.

[0004] The above content is only used to help understand the technical solution of this application and does not represent an admission that the above content is prior art. Technical issues

[0005] The main purpose of this application is to provide a control method for camera equipment, which aims to solve the technical problem that the monitoring range of commonly used combination cameras of bullet and PTZ cameras is often limited due to the influence of the structure of the bullet or PTZ camera. Technical solutions

[0006] To achieve the above objectives, this application proposes a control method for a camera device, the method comprising:

[0007] After acquiring the captured image from the fisheye lens, the target to be focused is identified from the captured image;

[0008] The telephoto lens of the PTZ camera is controlled to capture a spatially compressed image containing detailed features of the target to be focused on;

[0009] The motion behavior of the target to be focused is analyzed based on the spatial compression image.

[0010] Based on the aforementioned motion behavior, the shooting angle of the bullet camera's fisheye lens is adjusted, and the monitoring angle and monitoring range of the PTZ camera's telephoto lens are also adjusted.

[0011] In one embodiment, the step of controlling the telephoto lens of the PTZ camera to capture a spatially compressed image containing detailed features of the target to be focused on further includes:

[0012] Select a set of target images containing the target to be focused from the frame images of the captured scene;

[0013] Identify the specific location of the target to be focused in the captured image from the target image set, and control the telephoto lens of the PTZ camera based on the specific location;

[0014] The step of controlling the telephoto lens of the PTZ camera to capture a spatially compressed image containing detailed features of the target to be focused includes:

[0015] The required viewing angle of the telephoto lens of the PTZ camera needs to be adjusted based on the specific location.

[0016] Based on the stated visual angle, control the telephoto lens of the PTZ camera to capture a close-up image of the target to be focused on;

[0017] A sharpness analysis was performed on the close-up image.

[0018] If the clarity of the close-up image meets the preset clarity requirement, then the close-up image is determined to be a spatially compressed image containing the detailed features of the target to be focused on.

[0019] In one embodiment, the step of performing sharpness analysis on the close-up image includes:

[0020] Frequency domain analysis is performed on the close-up image to determine the image frequency of the target to be focused in the close-up image;

[0021] Based on the image frequency, a preliminary determination is made of image areas in the close-up shot whose clarity does not meet the preset clarity requirements;

[0022] Pixel analysis is performed on the image region to determine whether the features in the image region will detract from the overall clarity of the close-up image;

[0023] If the image area does not impair the overall clarity of the close-up image, then the close-up image is determined to meet the preset clarity requirement;

[0024] If the image region would compromise the overall sharpness of the close-up image, then the close-up image is determined not to meet the preset sharpness requirement. In one embodiment, the step of analyzing the motion behavior of the target to be focused based on the spatially compressed image includes:

[0025] Extract the motion features of the target to be tracked from the spatially compressed image;

[0026] The movement characteristics of the moving parts of the target to be focused and the inertial characteristics of the target to be focused during the movement process are identified from the motion characteristics.

[0027] The motion expectation of the target to be focused is determined based on the motion characteristics;

[0028] The authenticity of the expected motion is determined based on the inertial characteristics.

[0029] If the expected motion is determined to be real, then the motion behavior of the target to be focused is predicted based on the movement features and the inertial features.

[0030] If it is determined that the expected motion is not real, then the true intention of the target to be focused is determined based on the inertial characteristics;

[0031] Based on the stated true intent, predict the motion behavior of the target to be focused.

[0032] In one embodiment, the step of analyzing the motion behavior of the target to be focused based on the spatially compressed image includes:

[0033] Extract the motion features of the target to be tracked from the spatially compressed image;

[0034] The movement characteristics of the moving parts of the target to be focused and the inertial characteristics of the target to be focused during the movement process are identified from the motion characteristics.

[0035] The motion expectation of the target to be focused is determined based on the motion characteristics;

[0036] The authenticity of the expected motion is determined based on the inertial characteristics.

[0037] If the expected motion is determined to be real, the motion behavior of the target to be focused is predicted based on the movement features and the inertial features; if the expected motion is determined to be unreal, the true intention of the target to be focused is determined based on the inertial features.

[0038] Based on the stated true intent, predict the motion behavior of the target to be focused.

[0039] In one embodiment, the step of identifying the target to be focused from the captured image after acquiring the image captured by the fisheye lens includes:

[0040] After acquiring the captured image from the fisheye lens, the focus area of ​​the target to be tracked is determined from the captured image;

[0041] If there are multiple focal regions, the focal region with the shortest focal length is determined as the target focal region.

[0042] If multiple targets are identified in the target focus area, each of the targets is determined to be a target to be focused.

[0043] In one embodiment, the steps of adjusting the shooting angle of the bullet camera fisheye lens and adjusting the monitoring angle and monitoring width of the PTZ camera telephoto lens based on the motion behavior include:

[0044] Predict the motion trajectory of the target to be focused based on the motion behavior;

[0045] Based on the motion trajectory, predict the predicted position of the target to be focused on in the captured image within a preset time period;

[0046] The adjustment parameters of the telephoto lens of the PTZ camera and the adjustment data of the fisheye lens of the bullet camera are determined based on the predicted position.

[0047] Adjust the monitoring angle and monitoring range of the telephoto lens of the PTZ camera according to the adjustment parameters;

[0048] Adjust the shooting angle of the gun's fisheye lens according to the adjustment data.

[0049] Furthermore, to achieve the above objectives, this application also proposes a control device for a camera device, applied to a control module within a camera, the camera including a bullet fisheye lens and a PTZ telephoto lens, the device comprising:

[0050] The identification module is used to identify the target to be focused from the captured image after acquiring the image captured by the fisheye lens of the gun.

[0051] The control module is used to control the telephoto lens of the PTZ camera to capture a spatially compressed image containing the detailed features of the target to be focused on;

[0052] The motion analysis module is used to analyze the motion behavior of the target to be focused based on the spatially compressed image;

[0053] The adjustment module is used to adjust the shooting angle of the bullet camera fisheye lens and the monitoring angle and monitoring range of the PTZ camera telephoto lens based on the motion behavior.

[0054] In addition, to achieve the above objectives, this application also proposes a control device for a camera device, the device comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, the computer program being configured to implement the steps of the control method for the camera device as described above.

[0055] In addition, to achieve the above objectives, this application also proposes a storage medium, which is a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, it implements the steps of the control method for the camera device as described above.

[0056] In addition, to achieve the above objectives, this application also provides a computer program product, which includes a computer program that, when executed by a processor, implements the steps of the control method for the camera device as described above. Beneficial effects

[0057] By configuring the camera equipment with a bullet fisheye lens and a PTZ telephoto lens, a wider field of view can be captured using the bullet fisheye lens. After identifying the target in the captured image, the PTZ telephoto lens captures a spatially compressed image containing the detailed features of the target. This allows for the extraction of more detailed features from the spatially compressed image. Because the bullet fisheye lens has a wide field of view and can also capture high-quality images, this image can be used as the detailed background for the spatially compressed image captured by the PTZ telephoto lens. Since the spatially compressed image captured by the PTZ telephoto lens contains more detailed features, the movement behavior of the target can be analyzed based on the details contained in the spatially compressed image. Adjusting the bullet fisheye lens and PTZ telephoto lens according to the movement behavior prevents the analysis of the target's behavior from being detached from the background and avoids the inability to accurately capture the target's movement behavior from the captured image. Therefore, the monitoring efficiency of the camera equipment is improved. Attached Figure Description

[0058] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0059] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0060] Figure 1 is a flowchart illustrating the control method for the camera device according to Embodiment 1 of this application.

[0061] Figure 2 is a shooting reference screen provided by the control method of the camera equipment of this application;

[0062] Figure 3 is a flowchart illustrating the control method for the camera device according to Embodiment 2 of this application.

[0063] Figure 4 is a flowchart illustrating the control method for the camera device of this application in Embodiment 3.

[0064] Figure 5 is a flowchart illustrating the control method for the camera device of this application in Embodiment 4.

[0065] Figure 6 is a flowchart illustrating the control method for the camera device of this application in Embodiment 5.

[0066] Figure 7 is a schematic diagram of the module structure of the control device of the camera equipment according to an embodiment of this application;

[0067] Figure 8 is a schematic diagram of the hardware operating environment involved in the control method of the camera device in the embodiments of this application.

[0068] The realization of the purpose, functional features and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Embodiments of the present invention

[0069] It should be understood that the specific embodiments described herein are merely illustrative of the technical solutions of this application and are not intended to limit this application.

[0070] To better understand the technical solution of this application, a detailed description will be provided below in conjunction with the accompanying drawings and specific embodiments. The main solution of this application embodiment is: a camera control module, wherein the camera includes a bullet fisheye lens and a PTZ telephoto lens. After acquiring the captured image by the bullet fisheye lens, the control module identifies the target to be focused from the captured image; controls the PTZ telephoto lens to capture a spatially compressed image containing the detailed features of the target to be focused; analyzes the motion behavior of the target to be focused based on the spatially compressed image; and adjusts the shooting angle of the bullet fisheye lens and the monitoring angle and monitoring range of the PTZ telephoto lens based on the motion behavior.

[0071] In this embodiment, for ease of description, the following description will focus on the camera control module as the execution subject.

[0072] Because current technologies are often categorized based on monitoring range and resolution, surveillance cameras typically combine a bullet camera design with a telephoto lens to capture the largest and clearest possible image. Some cameras also utilize PTZ cameras for even clearer images. In scenarios requiring high-resolution footage, bullet and PTZ cameras are often combined. However, the common combination of bullet and PTZ cameras is often affected by the characteristics of the lenses themselves, leading to reduced monitoring efficiency.

[0073] This application provides a solution that, by configuring the camera device with a bullet fisheye lens and a PTZ telephoto lens, allows the bullet fisheye lens to capture a wider field of view. After identifying the target in the captured image, the PTZ telephoto lens captures a spatially compressed image containing the detailed features of the target. This facilitates the extraction of more detailed features from the spatially compressed image. Because the bullet fisheye lens has a wide field of view and can also capture high-quality images, this image serves as the detailed background for the spatially compressed image captured by the PTZ telephoto lens. Since the spatially compressed image captured by the PTZ telephoto lens contains more detailed features, the movement behavior of the target can be analyzed based on the detailed features contained in the spatially compressed image. The bullet fisheye lens and PTZ telephoto lens can then be adjusted according to the movement behavior to prevent the analysis of the target's behavior from being detached from the background and to avoid the inability to accurately capture the target's movement behavior from the captured image. Therefore, the monitoring efficiency of the camera device is improved.

[0074] It should be noted that the executing entity in this embodiment can be a computing service device with data processing, network communication, and program execution functions, such as a tablet computer, personal computer, or mobile phone, or an electronic device capable of performing the above functions, such as a camera control module. The following description uses a camera control module as an example to illustrate this embodiment and the subsequent embodiments.

[0075] Based on this, this application provides a control method for a camera device, applied to the control module of a camera. The camera includes a bullet fisheye lens and a PTZ telephoto lens. Referring to Figure 1, Figure 1 is a flowchart illustrating the first embodiment of the control method for the camera device of this application. In this embodiment, the control method for the camera device includes steps S10 to S40:

[0076] Step S10: After acquiring the captured image by the gun's fisheye lens, identify the target to be focused from the captured image;

[0077] It should be noted that a bullet camera can be a rectangular camera device, typically equipped with a C or CS type lens mount. A fisheye lens can be an extreme ultra-wide-angle lens with a short focal length and a wide angle of view, capable of capturing extremely wide scenes. A bullet fisheye lens can be a rectangular fisheye lens. The captured footage can be video or photographic footage taken using a bullet fisheye lens. The target to be focused on can be a moving object such as an animal, vehicle, or person.

[0078] It is understandable that, since a bullet fisheye lens can capture a 180-degree horizontal field of view, it is necessary to use a bullet fisheye lens to obtain a wider field of view within the scene to be monitored, so as to obtain more motion features of the target to be focused from a single field of view.

[0079] Understandably, combining a bullet camera with a fisheye lens makes the camera suitable for any scenario, as bullet cameras ensure continuous and effective surveillance and provide clear images even in complete darkness, while fisheye lenses have high light transmittance and can obtain good image quality in low-light conditions.

[0080] Step S20: Control the telephoto lens of the PTZ camera to capture a spatially compressed image containing the detailed features of the target to be focused on;

[0081] It should be noted that a PTZ camera can be a spherical camera. A telephoto lens can be a long-range lens or a telephoto lens, capable of bringing distant scenes closer and making details more clearly visible. Detail features can be more characteristics of the subject being focused on; for example, if the subject is a person, the details could be facial features, hair features, clothing features, or footstep features. Spatial compression footage can be footage captured by compressing space using a telephoto lens.

[0082] Understandably, while fisheye lenses can improve image quality, their wide field of view means they cannot capture the detailed features of the target. Therefore, using a telephoto lens on a PTZ camera to capture the detailed features of the target is necessary to obtain both a wider field of view and more detailed features.

[0083] Understandably, PTZ cameras support high-definition and even ultra-high-definition video recording. High-resolution images can provide more detailed information, helping to improve the accuracy and effectiveness of monitoring. Furthermore, telephoto lenses can easily capture details at a distance, allowing for clear images without getting close to the subject. Combining a PTZ camera with a telephoto lens enables high-resolution images captured by the telephoto lens, allowing features in the captured images to be displayed more clearly.

[0084] Step S30: Analyze the motion behavior of the target to be focused based on the spatially compressed image;

[0085] It should be noted that movement can refer to the movement trend of the target to be focused on.

[0086] Understandably, in order for the camera to accurately track the target, it is necessary to analyze the target's motion behavior based on the spatially compressed image.

[0087] Understandably, because spatially compressed images contain a large number of detailed features of the target to be focused on, the motion behavior of the target to be focused on can be analyzed more accurately based on spatially compressed images.

[0088] Step S40: Based on the motion behavior, adjust the shooting angle of the bullet camera fisheye lens, and adjust the monitoring angle and monitoring range of the PTZ camera telephoto lens.

[0089] It should be noted that the shooting angle can be the physical rotation angle of the bullet fisheye lens or the shooting angle of the bullet fisheye lens. The monitoring angle can be the physical rotation angle of the telephoto lens of the PTZ camera or the shooting angle of the telephoto lens of the PTZ camera. The monitoring range can be the focal length of the telephoto lens of the PTZ camera; the shorter the focal length, the wider the monitoring range; the longer the focal length, the shorter the monitoring range, but the more detailed features are captured. Understandably, to accurately track the target, the bullet fisheye lens and the telephoto lens of the PTZ camera can be adjusted according to the target's movement. This allows the bullet fisheye lens to accurately provide a reference background for target tracking, and the telephoto lens to acquire more detailed features of the target. Based on these detailed features, the target can be accurately identified, avoiding target loss and thus improving the tracking efficiency.

[0090] In the specific implementation, referring to Figure 2, the upper image in Figure 2 is the shooting image captured by the bullet camera's fisheye lens, and the lower image in Figure 2 is the spatially compressed image captured by the telephoto lens of the PTZ camera.

[0091] This embodiment provides a control method for a camera device. By configuring the camera device with a bullet fisheye lens and a PTZ telephoto lens, a wider field of view can be captured using the bullet fisheye lens. After identifying the target to be focused on in the captured image, the PTZ telephoto lens captures a spatially compressed image containing the detailed features of the target to be focused on. This facilitates the acquisition of more detailed features of the target to be focused from the spatially compressed image. Since the bullet fisheye lens has a wide shooting angle and can also capture high-quality images, the image captured by the bullet fisheye lens is used as the detailed background of the spatially compressed image captured by the PTZ telephoto lens. Because the spatially compressed image captured by the PTZ telephoto lens contains more detailed features, the movement behavior of the target to be focused can be analyzed based on the detailed features contained in the spatially compressed image. The bullet fisheye lens and the PTZ telephoto lens are adjusted according to the movement behavior to avoid detachment from the background when analyzing the behavior features of the target to be focused on, and to avoid the inability to accurately acquire the movement behavior of the target to be focused from the captured image. Therefore, the monitoring efficiency of the camera device is improved.

[0092] Based on the first embodiment of this application, in the second embodiment of this application, the content that is the same as or similar to that in the first embodiment described above can be referred to the above description and will not be repeated hereafter. Based on this, please refer to Figure 3. Before step S20, the control method of the camera device further includes steps S21 to S22:

[0093] Step S21: Select a set of target images containing the target to be focused from the frame images of the captured scene;

[0094] Step S22: Identify the specific position of the target to be focused in the shooting frame from the target image set, so as to control the telephoto lens of the PTZ camera based on the specific position.

[0095] Understandably, by automatically filtering and identifying the target to be focused from the frame images of the captured image, and by including the target image set, the position of the target to be focused in the captured image can be accurately determined. Since the background of the target to be focused in the captured image is fixed, and there is a certain proportional relationship between the captured image and the actual scene, the position of the target to be focused in the actual scene can be accurately determined by the position of the target to be focused in the captured image. Based on this position, the telephoto lens of the PTZ camera can be precisely controlled, so that the telephoto lens of the PTZ camera can accurately track the target to be focused.

[0096] It is understandable that when a telephoto lens of a PTZ camera compresses the spatial distance between the lens and the target, it will blur the environmental information around the target. In order to accurately and efficiently track the target, it is necessary to provide environmental information for tracking the target using the footage captured by the fisheye lens of a bullet camera. Combining the footage captured by both lenses can improve the monitoring efficiency of the camera equipment.

[0097] Further, step S20 includes:

[0098] The required viewing angle of the telephoto lens of the PTZ camera needs to be adjusted based on the specific location.

[0099] Based on the stated visual angle, control the telephoto lens of the PTZ camera to capture a close-up image of the target to be focused on;

[0100] A sharpness analysis was performed on the close-up image.

[0101] If the clarity of the close-up image meets the preset clarity requirement, then the close-up image is determined to be a spatially compressed image containing the detailed features of the target to be focused on.

[0102] It should be noted that the angle of view can be the field of vision that the lens can capture. A close-up shot can be a shot that highlights the details of the target being focused on.

[0103] Understandably, a specific location allows the telephoto lens of a PTZ camera to quickly focus on the target. After capturing a close-up of the target, in order to include more effective features in the compressed image, it is necessary to perform a sharpness analysis on the close-up.

[0104] Understandably, by automatically adjusting the viewing angle of the telephoto lens of the PTZ camera, it can accurately aim at the target to be focused, thereby capturing high-quality close-up images to improve the efficiency and accuracy of monitoring. Then, by performing a sharpness analysis on the close-up images and ensuring that they meet the preset sharpness requirements, the acquired images can be guaranteed to have sufficient detail and quality.

[0105] Understandably, the process of automatically adjusting the lens angle and clarity analysis can dynamically adjust the allocation of monitoring resources according to actual needs, prioritizing attention to important targets, which helps to make more rational use of monitoring resources and avoid unnecessary waste.

[0106] Furthermore, the step of performing a sharpness analysis on the close-up image includes:

[0107] Frequency domain analysis is performed on the close-up image to determine the image frequency of the target to be focused in the close-up image;

[0108] Based on the image frequency, a preliminary determination is made of image areas in the close-up shot whose clarity does not meet the preset clarity requirements;

[0109] Pixel analysis is performed on the image region to determine whether features in the image region will detract from the overall sharpness of the close-up image. If the image region does not detract from the overall sharpness of the close-up image, then the close-up image is determined to meet the preset sharpness requirement; if the image region does detract from the overall sharpness of the close-up image, then the close-up image is determined not to meet the preset sharpness requirement. It should be noted that image frequency can be an indicator of the drastic degree of grayscale change in an image, reflecting the speed of spatial change in pixel grayscale values.

[0110] Understandably, by performing frequency domain analysis on close-up images, high-frequency components in the image can be accurately identified. Since high-frequency components usually correspond to the details and edges of the image, the image areas in the close-up image that do not meet the sharpness requirements can be accurately analyzed based on the image frequency.

[0111] Understandably, since some areas may be locally blurred but do not affect the overall clarity, in order to reduce unnecessary processing, pixel analysis of image areas can be performed to determine whether their features will damage the overall clarity, thereby reducing the possibility of misjudgment.

[0112] Furthermore, the step of performing pixel analysis on the image region to determine whether features in the image region will detract from the overall clarity of the close-up image includes:

[0113] Analyze the grayscale values ​​of each pixel in the image region;

[0114] Determine the grayscale difference between adjacent pixels;

[0115] Based on the grayscale value, extract the feature information contained in the image region;

[0116] Determine whether the feature information is a valid feature;

[0117] If the feature information is not a valid feature, it is determined that the feature in the image region will not damage the overall clarity of the close-up image; if the feature information is a valid feature, it is determined that the feature in the image region will damage the overall clarity of the close-up image.

[0118] It should be noted that effective features can be those that are useful for identifying and tracking focused targets.

[0119] Understandably, by acquiring the grayscale value of each pixel in an image region, the brightness distribution of pixels in the image region can be understood. Then, by calculating the difference in grayscale values ​​between adjacent pixels, edges and details in the image can be identified. Regions with large grayscale differences usually represent edges or high-contrast details. Grayscale values ​​and grayscale differences are used to extract feature information in the image region. By filtering effective features from the feature information, interfering features are removed, avoiding mistaking irrelevant noise or interference for features that will affect sharpness. Furthermore, by determining whether the feature information is effective, the number of steps in image processing is reduced, thereby improving the efficiency and accuracy of image processing and further enhancing the monitoring efficiency of the camera equipment.

[0120] Furthermore, the step of determining whether the feature information is a valid feature includes:

[0121] Determine whether the characteristic information is helpful in identifying the target to be focused;

[0122] If it is determined that there is assistance involved, then the feature information is determined to be a valid feature;

[0123] If it is determined that there is no assistance, then the feature information is determined to be a invalid feature.

[0124] Understandably, by judging whether the characteristic information is helpful, we can filter out the feature information that is effective in identifying the target to be focused on, thereby reducing unnecessary calculations and processing and improving the efficiency and response speed of the system.

[0125] Based on the first and second embodiments of this application, in the third embodiment of this application, the content that is the same as or similar to the above embodiments can be referred to the above description, and will not be repeated hereafter. Based on this, please refer to Figure 4, step S30 includes steps S31 to S32:

[0126] Step S31: Extract the motion features of the target to be tracked from the spatially compressed image;

[0127] Step S32: Predict the motion behavior of the target to be focused based on the motion features.

[0128] It should be noted that action characteristics can include the characteristics of a person's swaying, the direction a person faces, the swaying of a person's clothes, the rotation of a wheel, the footsteps of an animal, the direction of an animal's fur, etc.

[0129] Understandably, by extracting the motion features of the target from the spatially compressed image, the target's motion behavior can be identified and tracked more accurately, thereby effectively reducing false positives and false negatives and improving the overall performance of the tracking system.

[0130] It is understandable that predicting the motion behavior of the target from the extracted motion features can also provide important reference information for subsequent tracking and analysis, helping to predict the target's trajectory in advance.

[0131] Further, step S32 includes:

[0132] The movement characteristics of the moving parts of the target to be focused and the inertial characteristics of the target to be focused during the movement process are identified from the motion characteristics.

[0133] The motion authenticity of the target to be focused is determined based on the movement characteristics and the inertial characteristics.

[0134] If the motion of the target to be focused is determined to be real, the motion behavior of the target to be focused is predicted based on the motion features and the inertial features.

[0135] It should be noted that motion realism can refer to the consistency between the motion trend and motion characteristics of the target to be focused on; that is, the consistency between the movement characteristics and the inertial characteristics. Movement characteristics can be features exhibited during the target's movement. Inertial characteristics can be features generated by inertia accompanying movement. Since inertia arises naturally during motion and follows the motion trend, the motion trend of the target to be focused on can be determined based on inertial characteristics.

[0136] Understandably, by analyzing the target's movement characteristics, we can identify the main parts of the target's movement and its movement patterns, such as the swinging of limbs and the rotation of the torso. At the same time, by analyzing the target's inertial characteristics during movement, we can understand the target's movement trend and stability. Furthermore, by comprehensively analyzing the target's movement characteristics and inertial characteristics, we can also determine whether the target's movement conforms to its normal movement pattern and dynamic characteristics, thereby confirming the authenticity of its movement.

[0137] Understandably, filtering out false or unnatural motion features can improve the accuracy of predictions.

[0138] Furthermore, the step of determining the motion authenticity of the target to be focused based on the movement features and the inertial features includes:

[0139] The motion expectation of the target to be focused is determined based on the motion characteristics;

[0140] The authenticity of the expected motion is determined based on the inertial characteristics.

[0141] It should be noted that the motion expectation can be a motion trend determined based on the movement characteristics.

[0142] It is understandable that, since the true motion trend of the target to be focused can be determined through inertial characteristics, the authenticity of the target's motion can be accurately judged by combining the motion expectation determined based on the motion characteristics with the inertial characteristics.

[0143] Furthermore, after the step of determining the motion authenticity of the target to be focused based on the movement features and the inertial features, the method further includes:

[0144] If it is determined that the motion of the target to be focused is not real, then the true intention of the target to be focused is determined based on the inertial characteristics;

[0145] Based on the stated true intent, predict the motion behavior of the target to be focused.

[0146] Understandably, analyzing physical characteristics can provide more reliable predictive basis, thereby improving the accuracy of predicting the future behavior of a target. In other words, by considering inertial characteristics, the behavior of a target can be assessed more comprehensively, thereby reducing the risk of misjudgment caused by misunderstanding the target's intentions.

[0147] Based on the above embodiments of this application, in the fourth embodiment of this application, the same or similar content as the above embodiments can be referred to the above description, and will not be repeated hereafter. Based on this, please refer to Figure 5, step S10 includes steps S11 to S13:

[0148] Step S11: After acquiring the captured image from the fisheye lens, determine the focus area of ​​the target to be tracked from the captured image;

[0149] Step S12: If there are multiple focal areas, determine the focal area with the shortest focal length as the target focal area; Step S13: Identify the target to be focused from the target focal area.

[0150] It should be noted that the focal area can be any region in the image that may be the subject in focus. For example, if there are multiple people in the same frame, the area where each person is located can be considered a focal area. Focal length can refer to the distance from the optical center of the lens to the imaging plane (such as the camera sensor or film).

[0151] Understandably, by identifying the focal area of ​​the target to be tracked from the footage captured by the fisheye lens, the potential target area can be quickly located, thereby improving monitoring efficiency.

[0152] Understandably, by comparing the focal lengths of multiple focal areas and selecting the focal area with the shortest focal length as the target focal area, the target can be identified and tracked more accurately. This is because the shorter the focal length, the closer the target is to the camera, and the greater the potential danger.

[0153] Understandably, by identifying the target to be focused from the target focus area, the camera's focusing resources can be effectively utilized, avoiding unnecessary focusing on unimportant areas, thereby improving the overall system's resource utilization.

[0154] Furthermore, if multiple focusing targets are identified in the target focusing area, each of the focusing targets is determined to be a target to be focused. Based on the above embodiments of this application, in the fifth embodiment of this application, the same or similar content as the above embodiments can be referred to the above description, and will not be repeated hereafter. Based on this, please refer to Figure 6, step S40 includes steps S1 to S5:

[0155] Step S1: Predict the motion trajectory of the target to be focused based on the motion behavior;

[0156] Step S2: Based on the motion trajectory, predict the predicted position of the target to be focused on in the captured image within a preset time period;

[0157] Step S3: Determine the adjustment parameters of the telephoto lens of the PTZ camera and the adjustment data of the fisheye lens of the bullet camera based on the predicted position; Step S4: Adjust the monitoring angle and monitoring range of the telephoto lens of the PTZ camera based on the adjustment parameters.

[0158] Step S5: Adjust the shooting angle of the gun's fisheye lens according to the adjustment data.

[0159] It should be noted that the adjustment parameters can be the focal length data, shooting angle data, and the required physical rotation angle for a PTZ camera telephoto lens. The adjustment data can be the physical rotation angle required for a bullet camera fisheye lens.

[0160] Understandably, by predicting the motion trajectory and position of the target to be focused, the camera parameters can be prepared and adjusted in advance, so that a clear shot can be taken immediately when the target reaches the predicted position, further improving the response speed and shooting efficiency of the camera equipment.

[0161] Understandably, by adjusting the monitoring angle and coverage of the telephoto lens of the PTZ camera, and adjusting the shooting angle of the fisheye lens of the bullet camera, it is possible to ensure the most accurate focusing on the target at any time, thereby obtaining high-quality images.

[0162] Further, step S3 includes:

[0163] Based on the predicted position, determine whether it is necessary to adjust the monitoring angle and monitoring range of the telephoto lens of the PTZ camera, and determine whether it is necessary to adjust the shooting angle of the fisheye lens of the bullet camera.

[0164] If it is necessary to adjust the monitoring angle and monitoring range of the telephoto lens of the PTZ camera, the adjustment parameters of the telephoto lens of the PTZ camera are determined according to the preset position.

[0165] And / or if it is necessary to adjust the shooting angle of the gun's fisheye lens, the adjustment data of the gun's fisheye lens shall be determined according to the preset position.

[0166] It should be noted that the monitoring angle and shooting angle data correspond to the angles that the telephoto lens of a PTZ camera needs to physically rotate. The monitoring width corresponds to the focal length data. The shooting angle corresponds to the angles that the fisheye lens of a bullet camera needs to adjust physically.

[0167] Understandably, by adjusting the monitoring angle and width, the monitoring area can be expanded to ensure that the target location is always within the monitoring range. Furthermore, telephoto lenses can capture details at a distance, and after adjustment, specific targets can be monitored more accurately, improving the monitoring effect. Optimizing the lens angle and width can also reduce blind spots in monitoring and provide more comprehensive security.

[0168] Furthermore, the step of determining whether the monitoring angle and monitoring range of the telephoto lens of the PTZ camera need to be adjusted based on the predicted position includes:

[0169] Detect the position difference between the predicted position and the current position, where the current position is the position of the target to be focused in the spatially compressed image;

[0170] Determine a safe distance between the current position and the directional edge of the spatially compressed image, wherein the directional edge is the developing edge corresponding to the direction of motion of the target to be focused in the spatially compressed image;

[0171] Determine whether the positional difference is greater than the safe distance;

[0172] If the distance exceeds the safe distance, then it is determined that the monitoring angle and monitoring range of the telephoto lens of the PTZ camera need to be adjusted.

[0173] Understandably, by detecting the positional difference between the predicted position and the current position, the movement of the target to be focused can be understood in real time, allowing for rapid adjustment of the lens angle to ensure that the target remains within the monitoring range.

[0174] Understandably, determining the safe distance between the current location and the edge of the spatially compressed image can prevent the target from being lost due to being out of the monitoring range when it approaches the edge of the image, thereby ensuring that the target is always visible in the image and improving the continuity and integrity of monitoring.

[0175] Understandably, the system automatically determines whether the positional difference is greater than the safe distance to make a decision. If the positional difference is too large, it automatically adjusts the monitoring angle and width of the telephoto lens of the PTZ camera to adapt to the movement of the target, thereby improving the intelligence of the camera equipment.

[0176] Furthermore, the step of determining whether the shooting angle of the gun's fisheye lens needs to be adjusted based on the predicted position includes:

[0177] Determine whether the predicted position belongs to the distortion position in the captured image;

[0178] If the location is at the aforementioned distortion position, it is determined that the gun's fisheye lens needs to be adjusted.

[0179] If the location is within the edge of the distortion position, it is determined that the gun's fisheye lens does not need to be adjusted.

[0180] It should be noted that the distortion location can be the location in the image captured by the fisheye lens of the bullet camera that appears distorted.

[0181] Understandably, due to the edge distortion characteristic of bullet fisheye lenses, although distortion correction algorithms can be used to correct it, the distortion of bullet fisheye lenses is too obvious. Currently, no algorithm can completely correct the distortion of bullet fisheye lenses. In order to accurately determine the position of the target to be focused on in the shooting image, when the predicted position is detected to be a distorted position in the shooting image, the shooting angle of the bullet fisheye lens needs to be adjusted in time so that the predicted position falls within the edge of the distorted position.

[0182] It should be noted that the above examples are only for understanding this application and do not constitute a limitation on the control method of the camera device of this application. Any simple modifications based on this technical concept are within the protection scope of this application.

[0183] This application also provides a control device for a camera device. Referring to Figure 7, the control device for the camera device includes:

[0184] The identification module 10 is used to identify the target to be focused from the captured image after acquiring the image captured by the fisheye lens of the bullet camera; the control module 20 is used to control the telephoto lens of the PTZ camera to capture a spatially compressed image containing the detailed features of the target to be focused.

[0185] Motion analysis module 30 is used to analyze the motion behavior of the target to be focused based on the spatial compression image;

[0186] The adjustment module 40 is used to adjust the shooting angle of the bullet camera fisheye lens and the monitoring angle and monitoring range of the PTZ camera telephoto lens based on the motion behavior.

[0187] Optionally, the control module 20 is further configured to filter a set of target images containing a target to be focused from the frame images of the captured image; identify the specific position of the target to be focused in the captured image from the set of target images, so as to control the telephoto lens of the PTZ camera based on the specific position.

[0188] Optionally, the control module 20 is further configured to determine the viewing angle that the telephoto lens of the PTZ camera needs to be adjusted based on the specific location; control the telephoto lens of the PTZ camera to capture a close-up image of the target to be focused according to the viewing angle; perform a sharpness analysis on the close-up image; and if the sharpness of the close-up image meets the preset sharpness requirements, determine that the close-up image is a spatially compressed image containing the detailed features of the target to be focused.

[0189] Optionally, the control module 20 is further configured to perform frequency domain analysis on the close-up image to determine the image frequency of the target to be focused on in the close-up image; based on the image frequency, preliminarily determine the image region in the close-up image whose clarity does not meet the preset clarity requirement; perform pixel analysis on the image region to determine whether the features in the image region will damage the overall clarity of the close-up image; if the image region will not damage the overall clarity of the close-up image, then determine that the close-up image meets the preset clarity requirement; if the image region will damage the overall clarity of the close-up image, then determine that the close-up image does not meet the preset clarity requirement.

[0190] Optionally, the control module 20 is further configured to analyze the grayscale value of each pixel in the image region; determine the grayscale difference between adjacent pixels; extract feature information contained in the image region based on the grayscale value; determine whether the feature information is a valid feature; if the feature information is not a valid feature, determine that the feature in the image region will not damage the overall clarity of the close-up image; if the feature information is a valid feature, determine that the feature in the image region will damage the overall clarity of the close-up image.

[0191] Optionally, the control module 20 is further configured to determine whether the characteristic information is helpful in identifying the target to be focused; if it is determined to be helpful, the characteristic information is determined to be a valid feature; if it is determined not to be helpful, the characteristic information is determined to be a non-valid feature. Optionally, the motion analysis module 30 is further configured to extract the motion features of the target to be tracked from the spatially compressed image; and predict the motion behavior of the target to be focused based on the motion features.

[0192] Optionally, the motion analysis module 30 is further configured to identify the movement features of the moving parts of the target to be focused from the motion features, as well as the inertial features of the target to be focused during the movement process; determine the authenticity of the motion of the target to be focused based on the movement features and the inertial features; and if the motion of the target to be focused is determined to be authentic, predict the motion behavior of the target to be focused based on the movement features and the inertial features.

[0193] Optionally, the motion analysis module 30 is further configured to determine the motion expectation of the target to be focused based on the movement characteristics; and to determine the authenticity of the motion expectation based on the inertial characteristics.

[0194] Optionally, the motion analysis module 30 is further configured to, if it is determined that the motion of the target to be focused is not real, determine the true intention of the target to be focused based on the inertial characteristics; and predict the motion behavior of the target to be focused based on the true intention.

[0195] Optionally, the identification module 10 is further configured to, after acquiring the captured image from the fisheye lens, determine the focus area of ​​the target to be tracked from the captured image; if there are multiple focus areas, determine the focus area with the shortest focal length as the target focus area; and identify the target to be focused from the target focus area.

[0196] Optionally, the identification module 10 is further configured to identify multiple focusing targets in the target focusing area, and then determine each of the focusing targets as a target to be focused.

[0197] Optionally, the adjustment module 40 is further configured to predict the motion trajectory of the target to be focused based on the motion behavior; predict the predicted position of the target to be focused in the shooting frame within a preset time period based on the motion trajectory; determine the adjustment parameters of the telephoto lens of the PTZ camera and the adjustment data of the fisheye lens of the bullet camera based on the predicted position; adjust the monitoring angle and monitoring width of the telephoto lens of the PTZ camera based on the adjustment parameters; and adjust the shooting angle of the fisheye lens based on the adjustment data.

[0198] Optionally, the adjustment module 40 is further configured to determine whether the monitoring angle and monitoring width of the telephoto lens of the PTZ camera need to be adjusted based on the predicted position, and to determine whether the shooting angle of the fisheye lens of the bullet camera needs to be adjusted; if the monitoring angle and monitoring width of the telephoto lens of the PTZ camera need to be adjusted, the adjustment parameters of the telephoto lens of the PTZ camera are determined based on the preset position; and / or if the shooting angle of the fisheye lens needs to be adjusted, the adjustment data of the fisheye lens of the bullet camera are determined based on the preset position.

[0199] Optionally, the adjustment module 40 is further configured to detect the position difference between the predicted position and the current position, where the current position is the position of the target to be focused in the spatially compressed image; determine the safe distance between the current position and the directional edge of the spatially compressed image, where the directional edge is the developing edge corresponding to the direction of movement of the target to be focused in the spatially compressed image; determine whether the position difference is greater than the safe distance; if it is greater than the safe distance, then determine that the monitoring angle and monitoring width of the telephoto lens of the PTZ camera need to be adjusted.

[0200] Optionally, the adjustment module 40 is further configured to determine whether the predicted position belongs to the distortion position in the captured image; if it belongs to the distortion position, it is determined that the gun-mounted fisheye lens needs to be adjusted; if it is located within the edge of the distortion position, it is determined that the gun-mounted fisheye lens does not need to be adjusted.

[0201] The camera control device provided in this application, employing the camera control method described in the above embodiments, can solve the technical problem that commonly used combination cameras (bullet and PTZ cameras) are often limited in monitoring range due to the influence of the bullet or PTZ camera structure. Compared with the prior art, the beneficial effects of the camera control device provided in this application are the same as those of the camera control method provided in the above embodiments, and other technical features in the camera control device are the same as those disclosed in the methods of the above embodiments, and will not be repeated here.

[0202] This application provides a control device for a camera device, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, which are executed by the at least one processor to enable the at least one processor to perform the control method of the camera device in the first embodiment described above.

[0203] Referring now to Figure 8, a schematic diagram of a control device suitable for implementing the camera device of the embodiments of this application is shown. The control device for the camera device in the embodiments of this application may include, but is not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Description), PMPs (Portable Media Players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. The control device for the camera device shown in Figure 8 is merely an example and should not impose any limitations on the functionality and scope of use of the embodiments of this application.

[0204] As shown in Figure 8, the control device of the camera equipment may include a processing unit 1001 (e.g., a central processing unit, a graphics processing unit, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1002 or a program loaded from a storage device 1003 into a random access memory (RAM) 1004. The RAM 1004 also stores various programs and data required for the operation of the camera equipment's control device. The processing unit 1001, ROM 1002, and RAM 1004 are interconnected via a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Typically, the following systems can be connected to the I / O interface 1006: input devices 1007 including, for example, a touchscreen, touchpad, keyboard, mouse, image sensor, microphone, accelerometer, gyroscope, etc.; output devices 1008 including, for example, a liquid crystal display (LCD), speaker, vibrator, etc.; storage devices 1003 including, for example, magnetic tape, hard disk, etc.; and communication devices 1009. Communication device 1009 allows the control device of the camera equipment to communicate wirelessly or wiredly with other devices to exchange data. Although the figures show control devices for camera equipment with various systems, it should be understood that it is not required to implement or possess all of the systems shown. More or fewer systems may be implemented alternatively. In particular, according to embodiments disclosed in this application, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments disclosed in this application include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device, or installed from storage device 1003, or installed from ROM 1002. When the computer program is executed by processing device 1001, it performs the functions defined in the methods of the embodiments disclosed in this application.

[0205] The camera control device provided in this application, employing the camera control method described in the above embodiments, can solve the technical problem that commonly used combination cameras (bullet and PTZ cameras) are often limited in monitoring range due to the influence of the bullet or PTZ camera structure. Compared with the prior art, the beneficial effects of the camera control device provided in this application are the same as those of the camera control method provided in the above embodiments, and other technical features in the camera control device are the same as those disclosed in the previous embodiment method, and will not be repeated here.

[0206] It should be understood that the various parts disclosed in this application can be implemented using hardware, software, firmware, or a combination thereof. In the description of the above embodiments, specific features, structures, materials, or characteristics can be combined in any suitable manner in one or more embodiments or examples.

[0207] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

[0208] This application provides a computer-readable storage medium having computer-readable program instructions (i.e., a computer program) stored thereon, the computer-readable program instructions being used to execute the control method of the camera device in the above embodiments.

[0209] The computer-readable storage medium provided in this application may be, for example, a USB flash drive, but is not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, system, or device. The program code contained on the computer-readable storage medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination thereof.

[0210] The aforementioned computer-readable storage medium may be included in the control device of the camera equipment; or it may exist independently and not assembled into the control device of the camera equipment.

[0211] The aforementioned computer-readable storage medium carries one or more programs that, when executed by the control device of the camera equipment, cause the control device of the camera equipment to: acquire the captured image from the fisheye lens, identify the target to be focused from the captured image; control the telephoto lens of the PTZ camera to capture a spatially compressed image containing the detailed features of the target to be focused; analyze the motion behavior of the target to be focused based on the spatially compressed image; and adjust the shooting angle of the fisheye lens and the monitoring angle and monitoring range of the telephoto lens of the PTZ camera based on the motion behavior.

[0212] Computer program code for performing the operations of this application can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, and C++, and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a Local Area Network (LAN) or a Wide Area Network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0213] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0214] The modules described in the embodiments of this application can be implemented in software or hardware. The names of the modules do not necessarily limit the functionality of the unit itself.

[0215] The readable storage medium provided in this application is a computer-readable storage medium that stores computer-readable program instructions (i.e., a computer program) for executing the control method of the above-described camera device. This solves the technical problem that commonly used combination cameras (bullet and PTZ cameras) are often limited in monitoring range due to the influence of the bullet or PTZ camera structure. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided in this application are the same as the beneficial effects of the control method of the camera device provided in the above embodiments, and will not be repeated here.

[0216] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the steps of the control method for the camera device as described above.

[0217] The computer program product provided in this application can solve the technical problem that the monitoring range of commonly used combination cameras (bullet and PTZ cameras) is often limited due to the structure of the bullet or PTZ camera. Compared with the prior art, the beneficial effects of the computer program product provided in this application are the same as the beneficial effects of the camera control method provided in the above embodiments, and will not be repeated here.

[0218] The above description is only a part of the embodiments of this application and does not limit the patent scope of this application. All equivalent structural transformations made under the technical concept of this application and using the contents of the specification and drawings of this application, or direct / indirect applications in other related technical fields, are included in the patent protection scope of this application.

Claims

1. A control method of an image pickup apparatus, characterized by, The control module applied within a camera, the camera including a bullet fisheye lens and a PTZ telephoto lens, the method comprising: After acquiring the captured image from the fisheye lens, the target to be focused is identified from the captured image; The telephoto lens of the PTZ camera is controlled to capture a spatially compressed image containing detailed features of the target to be focused on; The motion behavior of the target to be focused is analyzed based on the spatial compression image. Based on the aforementioned motion behavior, the shooting angle of the bullet camera's fisheye lens is adjusted, and the monitoring angle and monitoring range of the PTZ camera's telephoto lens are also adjusted.

2. The method of claim 1, wherein, Before the step of controlling the telephoto lens of the PTZ camera to capture a spatially compressed image containing detailed features of the target to be focused, the following is also included: Select a set of target images containing the target to be focused from the frame images of the captured scene; Identify the specific location of the target to be focused in the captured image from the target image set, so as to control the telephoto lens of the PTZ camera based on the specific location.

3. The method of claim 2, wherein, The step of controlling the telephoto lens of the PTZ camera to capture a spatially compressed image containing detailed features of the target to be focused includes: The required viewing angle of the telephoto lens of the PTZ camera needs to be adjusted based on the specific location. Based on the stated visual angle, control the telephoto lens of the PTZ camera to capture a close-up image of the target to be focused on; A sharpness analysis was performed on the close-up image. If the clarity of the close-up image meets the preset clarity requirement, then the close-up image is determined to be a spatially compressed image containing the detailed features of the target to be focused on.

4. The method of claim 3, wherein, The steps for performing sharpness analysis on the close-up image include: Frequency domain analysis is performed on the close-up image to determine the image frequency of the target to be focused in the close-up image; Based on the image frequency, a preliminary determination is made of image areas in the close-up shot whose clarity does not meet the preset clarity requirements; Pixel analysis is performed on the image region to determine whether the features in the image region will detract from the overall clarity of the close-up image; If the image area does not impair the overall clarity of the close-up image, then the close-up image is determined to meet the preset clarity requirement; If the image area would compromise the overall clarity of the close-up image, then the close-up image is determined not to meet the preset clarity requirement.

5. The method of claim 4, wherein, The step of performing pixel analysis on the image region to determine whether features in the image region will detract from the overall clarity of the close-up image includes: Analyze the grayscale values ​​of each pixel in the image region; Determine the grayscale difference between adjacent pixels; Based on the grayscale value, extract the feature information contained in the image region; Determine whether the feature information is a valid feature; If the feature information is not a valid feature, it is determined that the feature in the image region will not damage the overall clarity of the close-up image; If the feature information is a valid feature, it is determined that the feature in the image region will damage the overall clarity of the close-up image.

6. The method of claim 5, wherein, The step of determining whether the feature information is a valid feature includes: Determine whether the characteristic information is helpful in identifying the target to be focused; If it is determined that there is assistance involved, then the feature information is determined to be a valid feature; If it is determined that there is no assistance, then the feature information is determined to be a invalid feature.

7. The method of claim 1, wherein, The step of analyzing the motion behavior of the target to be focused based on the spatially compressed image includes: Extract the motion features of the target to be tracked from the spatially compressed image; Predict the motion behavior of the target to be focused based on the motion features.

8. The method of claim 7, wherein, The step of predicting the motion behavior of the target to be focused based on the motion features includes: The movement characteristics of the moving parts of the target to be focused and the inertial characteristics of the target to be focused during the movement process are identified from the motion characteristics. The motion authenticity of the target to be focused is determined based on the movement characteristics and the inertial characteristics. If the motion of the target to be focused is determined to be real, the motion behavior of the target to be focused is predicted based on the motion features and the inertial features.

9. The method of claim 8, wherein, The step of determining the motion authenticity of the target to be focused based on the movement features and the inertial features includes: The motion expectation of the target to be focused is determined based on the motion characteristics; The authenticity of the expected motion is determined based on the inertial characteristics.

10. The method of claim 8, wherein, After the step of determining the motion authenticity of the target to be focused based on the movement features and the inertial features, the method further includes: If it is determined that the motion of the target to be focused is not real, then the true intention of the target to be focused is determined based on the inertial characteristics; Based on the stated true intent, predict the motion behavior of the target to be focused.

11. The method of claim 1, wherein, After acquiring the captured image from the fisheye lens, the step of identifying the target to be focused from the captured image includes: After acquiring the captured image from the fisheye lens, the focus area of ​​the target to be tracked is determined from the captured image; If there are multiple focal regions, the focal region with the shortest focal length is determined as the target focal region. Identify the target to be focused from the target focus area.

12. The method of claim 11, wherein, The step of identifying the target to be focused from the target focusing region includes: If multiple targets are identified in the target focus area, each of the targets is determined to be a target to be focused.

13. The method of claim 1, wherein, The steps of adjusting the shooting angle of the bullet camera's fisheye lens and adjusting the monitoring angle and monitoring width of the PTZ camera's telephoto lens based on the motion behavior include: Predict the motion trajectory of the target to be focused based on the motion behavior; Based on the motion trajectory, predict the predicted position of the target to be focused on in the captured image within a preset time period; The adjustment parameters of the telephoto lens of the PTZ camera and the adjustment data of the fisheye lens of the bullet camera are determined based on the predicted position. Adjust the monitoring angle and monitoring range of the telephoto lens of the PTZ camera according to the adjustment parameters; Adjust the shooting angle of the gun's fisheye lens according to the adjustment data.

14. The method of claim 13, wherein, The steps of determining the adjustment parameters of the telephoto lens of the PTZ camera and the adjustment data of the fisheye lens of the bullet camera based on the predicted position include: Based on the predicted position, determine whether it is necessary to adjust the monitoring angle and monitoring range of the telephoto lens of the PTZ camera, and determine whether it is necessary to adjust the shooting angle of the fisheye lens of the bullet camera. If it is necessary to adjust the monitoring angle and monitoring range of the telephoto lens of the PTZ camera, the adjustment parameters of the telephoto lens of the PTZ camera are determined according to the preset position. And / or if it is necessary to adjust the shooting angle of the gun's fisheye lens, the adjustment data of the gun's fisheye lens shall be determined according to the preset position.

15. The method of claim 14, wherein, The step of determining whether the monitoring angle and monitoring range of the telephoto lens of the PTZ camera need to be adjusted based on the predicted position includes: Detect the position difference between the predicted position and the current position, where the current position is the position of the target to be focused in the spatially compressed image; Determine a safe distance between the current position and the directional edge of the spatially compressed image, wherein the directional edge is the developing edge corresponding to the direction of motion of the target to be focused in the spatially compressed image; Determine whether the positional difference is greater than the safe distance; If the distance exceeds the safe distance, then it is determined that the monitoring angle and monitoring range of the telephoto lens of the PTZ camera need to be adjusted.

16. The method of claim 14, wherein, The step of determining whether the shooting angle of the gun's fisheye lens needs to be adjusted based on the predicted position includes: Determine whether the predicted position belongs to the distortion position in the captured image; If the location is at the aforementioned distortion position, it is determined that the gun's fisheye lens needs to be adjusted. If the location is within the edge of the distortion position, it is determined that the gun's fisheye lens does not need to be adjusted.

17. A control device of an image pickup apparatus, characterized by comprising: A control module applied within a camera, the camera including a bullet fisheye lens and a PTZ telephoto lens, the device comprising: The identification module is used to identify the target to be focused from the captured image after acquiring the image captured by the fisheye lens. The control module is used to control the telephoto lens of the PTZ camera to capture a spatially compressed image containing the detailed features of the target to be focused on; The motion analysis module is used to analyze the motion behavior of the target to be focused based on the spatially compressed image. The adjustment module is used to adjust the shooting angle of the bullet camera fisheye lens and the monitoring angle and monitoring range of the PTZ camera telephoto lens based on the motion behavior.

18. A control device of an image pickup apparatus, characterized by comprising: The device includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, the computer program being configured to implement the steps of the control method for the camera device as claimed in any one of claims 1 to 16.

19. A storage medium, characterized by The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, it implements the steps of the control method for the camera device as described in any one of claims 1 to 16.

20. A computer program product, characterised in that, The computer program product includes a computer program that, when executed by a processor, implements the steps of the control method for the camera device as described in any one of claims 1 to 16.

Images