Method and apparatus for determining shooting device adjustment mode, electronic device, and medium

Abstract

The application discloses a kind of shooting equipment adjustment mode determination method, device, electronic equipment and medium, the method includes: determining the utilization of at least two shooting equipment in target area, and according to the utilization of each shooting equipment, in each shooting equipment determines the shooting equipment to be adjusted;According to the target object trajectory in the visual field of the shooting equipment to be adjusted and the target object trajectory in the visual field of other shooting equipment, determine target direction;According to target direction, determine the adjustment mode of the shooting equipment to be adjusted.The present application can realize the quick diagnosis of the shooting equipment with low utilization rate, and determine the adjustment mode accordingly, so as to improve the utilization rate of the shooting equipment.

Description

Technical Field

[0001] This invention relates to the field of data processing technology, and in particular to a method, apparatus, electronic device, and medium for determining the adjustment mode of a shooting device. Background Technology

[0002] With the widespread use of smart shooting devices, multiple shooting devices may be present at the same location. This may result in some angles being captured by multiple shooting devices, while other angles may be captured by few or no shooting devices. Therefore, it is necessary to determine whether the installation location and angle of these shooting devices are appropriate.

[0003] Existing technologies typically use video diagnostics to identify instances where cameras miss capturing images, specifically those cameras that capture a small number of target objects. However, this method can only identify cameras that miss images and requires manual intervention to determine the installation location and angle of the camera that missed the shots. Summary of the Invention

[0004] This invention provides a method, apparatus, electronic device, and medium for determining the adjustment mode of a shooting device, so as to quickly diagnose shooting devices with low utilization and automatically determine the adjustment mode in a targeted manner, thereby improving the utilization rate of the shooting device.

[0005] In a first aspect, embodiments of the present invention provide a method for determining the adjustment mode of a shooting device, the method comprising:

[0006] Determine the utilization rate of at least two shooting devices within the target area, and based on the utilization rate of each shooting device, identify the shooting device to be adjusted among them;

[0007] Determine the target direction based on the target object trajectory in the field of view of the camera to be adjusted and the target object trajectory in the field of view of other camera devices;

[0008] Based on the target direction, determine the adjustment method for the shooting equipment to be adjusted.

[0009] Secondly, embodiments of the present invention also provide a device for determining the adjustment method of a shooting device, the device comprising:

[0010] The module for determining the shooting equipment to be adjusted is used to determine the utilization rate of at least two shooting equipment in the target area, and to determine the shooting equipment to be adjusted among the shooting equipment based on the utilization rate of each shooting equipment.

[0011] The target direction determination module is used to determine the target direction based on the trajectory of the target object in the field of view of the shooting device to be adjusted and the trajectory of the target object in the field of view of other shooting devices.

[0012] The adjustment method determination module is used to determine the adjustment method of the shooting device to be adjusted based on the target direction.

[0013] Thirdly, embodiments of the present invention also provide an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement a method for determining the adjustment mode of the shooting device as described in any of the embodiments of the present invention.

[0014] Fourthly, embodiments of the present invention also provide a storage medium for storing computer-executable instructions, which, when executed by a computer processor, are used to perform a method for determining the adjustment mode of a shooting device as described in any of the embodiments of the present invention.

[0015] The technical solution of this invention determines the utilization rate of each shooting device within the target area, selects the shooting device with low utilization as the shooting device to be adjusted, compares the target object trajectory in the field of view of the shooting device to be adjusted with the target object trajectory in the field of view of other shooting devices to determine the target direction, and adjusts the shooting device to be adjusted according to the target direction. This invention can quickly diagnose shooting devices with low utilization and automatically determine the adjustment method accordingly, thereby improving the utilization rate of shooting devices.

[0016] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of the present invention, nor is it intended to limit the scope of the invention. Other features of the invention will become readily apparent from the following description. Attached Figure Description

[0017] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0018] Figure 1 This is a flowchart of a method for determining the adjustment mode of a shooting device according to Embodiment 1 of the present invention;

[0019] Figure 2 This is a schematic diagram of a target area provided in Embodiment 1 of the present invention;

[0020] Figure 3 This is a schematic diagram of the mapping relationship between a pixel coordinate system and a spatial coordinate system provided in Embodiment 1 of the present invention;

[0021] Figure 4This is a schematic diagram of the field of view of the shooting device to be adjusted when there are two target directions, as provided in Embodiment 1 of the present invention;

[0022] Figure 5 This is a flowchart of a method for determining the adjustment mode of a shooting device according to Embodiment 2 of the present invention;

[0023] Figure 6 This is a schematic diagram of the structure of a device for determining the adjustment mode of a shooting device provided in Embodiment 3 of the present invention;

[0024] Figure 7 This is a schematic diagram of the structure of an electronic device provided in Embodiment 4 of the present invention. Detailed Implementation

[0025] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.

[0026] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or device that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or devices. In the embodiments of this application, certain software, components, models, and other existing industry solutions may be mentioned. These should be considered exemplary, intended only to illustrate the feasibility of implementing the technical solutions of this application, and do not imply that the applicant has already used or necessarily used such solutions.

[0027] The acquisition, transmission, storage, use, and processing of data in this application all comply with the relevant provisions of national laws and regulations.

[0028] Example 1

[0029] Figure 1This is a flowchart of a method for determining the adjustment mode of a shooting device according to Embodiment 1 of the present invention. This embodiment is applicable to situations where the installation position and angle of the shooting device are adjusted to improve the utilization rate of the shooting device. The method can be executed by a device for determining the adjustment mode of the shooting device. The device for determining the adjustment mode of the shooting device can be implemented in hardware and / or software. The device for determining the adjustment mode of the shooting device can be configured in a server and used in conjunction with at least two shooting devices.

[0030] like Figure 1 As shown, the method includes:

[0031] S110. Determine the utilization rate of at least two shooting devices within the target area, and based on the utilization rate of each shooting device, determine the shooting device to be adjusted among them.

[0032] The target area is the region where the utilization rate of the camera equipment to be monitored; for example, it could be an intersection or a park. After determining the target area, all camera equipment associated with that target area can be added to the camera equipment set to determine its utilization rate. Figure 2 A schematic diagram of the target area is provided, such as... Figure 2 As shown, the target area is an intersection, with five camera devices (CAM1-CAM5) installed. The current installation location, current field of view, and images captured by each camera device are determined to facilitate the subsequent screening of low-utilization camera devices and the adjustment of camera devices.

[0033] The utilization rate of filming equipment indicates the extent to which filming equipment functions effectively and produces efficient results within a certain period. Filming equipment requiring adjustment refers to those with low utilization rates. Understandably, low utilization rates indicate potential problems such as equipment malfunction, idleness, or improper setup. Adjustments to the installation angle and position, or even removal of the equipment, are necessary to ensure optimal performance, improve utilization rates, and prevent over-installation of equipment.

[0034] In this embodiment, the utilization rate of each shooting device within the target area can be determined by combining at least one of the following factors: working time coverage, proportion of the area of ​​interest, visual field distinction, image quality, specific event triggering and response, and business relevance.

[0035] Among them, working time coverage rate refers to the proportion of the total time that the shooting equipment is in normal working condition.

[0036] The area of ​​interest ratio refers to the proportion of the area of ​​interest to the total area of ​​the field of view of the camera. The field of view is the area that the camera can capture, and the area of ​​interest refers to the area where the target object can actually be located. For example, when the target area is an intersection, the area of ​​interest could be the road and the pedestrian walkways on both sides of the road. The process involves identifying the area of ​​interest within the camera's field of view and calculating the ratio of the area of ​​the area of ​​interest to the total area of ​​the field of view.

[0037] Viewpoint discrimination refers to the degree of difference between the viewpoints of different shooting devices. Specifically, it involves determining the area that the viewpoint of the current shooting device can cover but is not covered by the viewpoints of other shooting devices, and then using the ratio of this area to the total viewpoint area of ​​the current shooting device as the viewpoint discrimination.

[0038] Image quality refers to the sharpness and contrast of images captured by the imaging device, as well as the effectiveness of the extracted target object area in actual business applications.

[0039] The triggering and response of a specific event refers to the number of times a specific event associated with the shooting device is triggered and responded to. For example, for a shooting device associated with a vehicle abnormal driving capture event, the triggering and response of a specific event can be represented by the number of times and the accuracy rate of triggering the vehicle abnormal driving capture event within a preset time period.

[0040] Business relevance refers to the actual contribution of images captured by the camera to a particular business function, and whether they truly play a role in assisting decision-making. For example, when identifying vehicle speed using camera devices set at preset intervals, images from at least two camera devices are needed to obtain accurate vehicle speed; in this case, the business relevance can be determined as 50%.

[0041] This embodiment does not limit the number or specific form of the factors used to determine the utilization rate of the shooting equipment. Different factors can be assigned the same or different weights. After determining at least one factor corresponding to the shooting equipment, the utilization rate of the shooting equipment is determined based on the sum of the products of the factor and its weight.

[0042] In this embodiment, based on the utilization rate of each shooting device, the shooting devices to be adjusted are determined. The utilization rates of the shooting devices can be sorted from low to high, and a certain number of shooting devices are selected as the shooting devices to be adjusted according to this order. This number can be a preset number, or it can be the product of the total number of shooting devices and a preset ratio; this embodiment does not impose any restrictions on this.

[0043] Furthermore, when identifying the shooting equipment to be adjusted among various shooting devices, in addition to considering utilization rate, factors such as the main body of the shooting equipment and the importance of the business or event associated with the shooting equipment can also be considered. Understandably, for certain high-specification shooting equipment, or when the business or event associated with the shooting equipment is of high importance, even if the utilization rate of the shooting equipment is low, its installation angle or position should not be adjusted.

[0044] In this embodiment, it is possible to quickly locate shooting devices with low utilization rates within the target area, and subsequently adjust them to improve the overall utilization rate of shooting devices within the target area, thus avoiding the installation of excessive or redundant shooting devices within the target area.

[0045] S120. Determine the target direction based on the target object trajectory in the field of view of the shooting device to be adjusted and the target object trajectory in the field of view of other shooting devices.

[0046] The target object can be a person, a vehicle, or other similar object. The target object trajectory is obtained by performing target detection, target feature extraction, target tracking, and trajectory drawing on the image captured by the shooting device. This embodiment does not limit the specific method for determining the target object trajectory.

[0047] Furthermore, when the target object is a person, it can be further refined into face and body. In this embodiment, when the target object includes both a face and a body, the target direction is determined separately for the trajectory of the face target object and the trajectory of the body target object. It is understandable that when the camera device to be adjusted can detect both face and body target objects, since the face target object is often difficult to detect completely, the target direction can be determined separately for the trajectory of the face target object and the trajectory of the body target object. When subsequently adjusting the installation position or angle of the camera device to be adjusted, the adjustment is prioritized based on the target direction determined by the trajectory of the face target object. This setting maximizes the utilization rate of the camera device to be adjusted.

[0048] It should be noted that the target object trajectory in this embodiment refers to the target object trajectory in a spatial coordinate system. Specifically, after obtaining the target object trajectory in the pixel coordinate system from the image captured by the imaging device, the target object trajectory is transformed into the spatial coordinate system according to the transformation relationship between the pixel coordinate system and the spatial coordinate system.

[0049] The transformation relationship between the pixel coordinate system and the spatial coordinate system can be determined by the lens parameters, installation height, and installation angle of the shooting device. Figure 3 A schematic diagram illustrating the mapping relationship between pixel coordinates and spatial coordinates is provided, such as... Figure 3As shown, a and b are the lens parameters of the CAM imaging device. Vectors in images captured by CAM. for The three-dimensional spatial vectors in the corresponding CAM's visible field ABCD can be used to determine the transformation relationship between the pixel coordinate system and the spatial coordinate system based on the CAM's installation height, installation angle, and a and b.

[0050] In this embodiment, the target object trajectory in the field of view of the camera to be adjusted, as well as the target object trajectory in the field of view of other camera devices, can be the target object trajectory obtained by fitting multiple target object trajectories over a period of time. Taking the target object trajectory in the field of view of the camera to be adjusted as an example, specifically, the trajectory of each target object in the field of view of the camera to be adjusted within a certain time period is determined; trajectory fitting is performed on each target object trajectory to obtain the target object trajectory corresponding to the camera to be adjusted.

[0051] The target direction refers to the direction that demonstrates the irreplaceable nature of the shooting equipment to be adjusted. Although the shooting equipment to be adjusted has a low utilization rate, it is irreplaceable in the target direction. It can be adjusted to shoot in the target direction to improve its utilization rate.

[0052] In an optional embodiment, the target direction can be defined as the direction that includes the trajectory of the target object within the field of view of the camera to be adjusted, but is not included in the target object trajectory within the field of view of other camera devices. It is understood that the camera to be adjusted is irreplaceable in the target direction only if its field of view includes the target direction.

[0053] For example, such as Figure 2 As shown, taking CAM3 as an example, if the target object trajectory in the field of view of CAM3 includes the DOC direction and the AOC direction, and the target object trajectory in the field of view of CAM1 includes the DOC direction, then CAM3 can be replaced by CAM1 in the DOC direction, and CAM3 is irreplaceable in the AOC direction, so the AOC direction is taken as the target direction.

[0054] In another optional embodiment, if the target object trajectory in the field of view of the shooting device to be adjusted and other shooting devices both contain the target direction, but the shooting device to be adjusted has a better shooting effect in the target direction, or the target direction of the target object trajectory accounts for a larger proportion in the field of view of the shooting device to be adjusted, or the number of times the target direction is contained in each target object trajectory corresponding to the shooting device to be adjusted is greater than the number of times the target direction is contained in each target object trajectory corresponding to other shooting devices, then it can also be considered that the shooting device to be adjusted is irreplaceable in the target direction.

[0055] In this embodiment, by performing target object trajectory analysis on the low-utilization shooting device to be adjusted, the substitutability of the device in each direction of the target object trajectory is determined, the target direction that cannot be replaced by other shooting devices in the vicinity is found, the angle is adjusted to maximize its role, improve the utilization rate of the shooting device to be adjusted in the irreplaceable direction, reduce the repetition rate in the replaceable direction, and ultimately improve the overall utilization rate of the shooting devices in the target area.

[0056] Furthermore, after determining the shooting device to be adjusted among the various shooting devices, the process may further include: if it is determined that there is no target direction, adjusting the direction of the field of view of the shooting device to be adjusted according to the direction of the target object trajectory in the field of view of the shooting device to be adjusted; and determining the target direction based on the target object trajectory in the adjusted field of view and the target object trajectories in the field of view of other shooting devices.

[0057] This embodiment also provides an adjustment method when the target direction cannot be determined. Specifically, if the shooting device to be adjusted is replaceable in all directions of the target object's trajectory, it indicates that the current installation position or angle of the shooting device is redundant, and its field of view needs to be adjusted until an irreplaceable target direction is found.

[0058] In an optional embodiment, the orientation of the field of view of the camera to be adjusted is adjusted according to the direction of the target object's trajectory within the field of view of the camera to be adjusted. This adjustment can be done by aligning the orientation of the field of view of the camera to be adjusted with the direction opposite to the target object's trajectory. In this adjustment method, the camera to be adjusted is in a state of shooting directly at the target object moving along its trajectory. At this time, it is determined whether a face target object can be obtained from the image captured by the camera to be adjusted. If a face target object is obtained, it is then determined whether the target direction can be determined based on the face target object's trajectory and the target object trajectories in the field of view of other camera devices.

[0059] In another optional embodiment, the viewing direction of the camera to be adjusted is adjusted according to the direction of the target object's trajectory within the viewing field of view. Alternatively, the viewing direction can be adjusted by a preset angle each time, pointing in the opposite direction of the target object's trajectory along the current viewing direction. After the angle adjustment, it is determined whether a face target object can be obtained from the image captured by the camera to be adjusted. If a face target object is obtained, it is determined whether the target direction can be determined based on the face target object's trajectory and the target object trajectories in the viewing fields of other camera devices. If neither of the above two conditions is met, the viewing direction is adjusted again by the preset angle in the opposite direction of the target object's trajectory along the current viewing direction.

[0060] It should be noted that if, after adjusting the field of view of the shooting equipment to be adjusted at least once, it is still impossible to determine an irreplaceable target direction, then the shooting equipment to be adjusted is considered to have low utilization and is not irreplaceable. In this case, its installation position can be changed to avoid redundant installation of shooting equipment in the target area.

[0061] S130. Determine the adjustment method of the shooting device to be adjusted according to the target direction.

[0062] In this embodiment, the adjustment method of the shooting device to be adjusted is determined according to the target direction. Specifically, it refers to aligning the field of view of the shooting device to be adjusted more specifically with the area in the target direction. It can be understood that since the shooting device to be adjusted is irreplaceable in the target direction, making the shooting device to be adjusted shoot in the target direction can improve the utilization rate of the shooting device.

[0063] In this embodiment, the adjustment method for the shooting device to be adjusted can be either the installation angle or the installation direction; this embodiment does not impose any limitations on this. Furthermore, when the shooting device to be adjusted is a gimbal shooting device, the installation angle can be automatically adjusted by rotating the gimbal, thereby automatically improving the utilization rate of the shooting device.

[0064] Furthermore, S130 may include:

[0065] A1. If the number of target directions is determined to be one, then adjust the shooting device to be adjusted until the visible field of view of the shooting device to be adjusted meets the maximum condition of the angle between the target directions.

[0066] A2. If the number of target directions is determined to be at least two, then adjust the shooting device to be adjusted until the field of view of the shooting device to be adjusted contains the intersection of the target directions.

[0067] In this embodiment, when there is only one target direction, the viewing direction of the camera to be adjusted is adjusted to meet the maximum angle condition of the target direction, that is, the angle between the viewing direction of the camera to be adjusted and the target direction is close to 180° (the viewing direction of the camera to be adjusted is opposite to the target direction). When the angle between the viewing direction of the camera to be adjusted and the target direction is close to 180°, and the target object is moving along the target direction, the camera to be adjusted is in a state of shooting directly at the target object. At this time, it is most likely to capture the complete target object. When the target object is a person, the probability of detecting a face target object is increased, thereby maximizing the utilization rate of the camera to be adjusted.

[0068] It should be noted that if the viewing angle of the camera to be adjusted cannot be adjusted to be close to 180° with the target direction due to limitations in installation angle, installation height, or installation position, simply adjust the viewing angle with the target direction to its maximum to ensure that the camera to be adjusted can shoot in the target direction.

[0069] In this embodiment, when there are multiple target directions, the intersection point between the multiple target directions is determined, and the field of view of the shooting device to be adjusted is adjusted until the field of view contains the intersection point between the target directions. Figure 4 A schematic diagram of the field of view of the shooting device to be adjusted when there are two target directions is provided. Figure 4 The CCP includes two target directions, the field of view of the adjusted shooting equipment, and the intersection between the target directions.

[0070] In this embodiment, the shooting device to be adjusted is aligned with an irreplaceable direction for shooting, so as to maximize the role of the shooting device to be adjusted and improve its utilization rate.

[0071] Furthermore, the target object may include a face and / or a human body, and the target direction may include the target direction corresponding to the trajectory of the face target object and / or the target direction corresponding to the trajectory of the human body target object; S130 may also include: if it is determined that the target direction includes at least one target direction corresponding to the trajectory of the face target object, then the adjustment method of the shooting device to be adjusted is determined according to the target direction corresponding to the trajectory of the face target object.

[0072] In this embodiment, when both facial and human targets can be detected simultaneously within the field of view of the camera to be adjusted, irreplaceable target directions are determined for the trajectories of the facial and human targets, respectively. When adjusting the camera to be adjusted, a face-first principle is followed. If at least one target direction corresponds to a facial target trajectory, that target direction is given first priority, and the adjustment method for the camera to be adjusted is determined based on the target direction corresponding to the facial target trajectory. Furthermore, the adjustment method can be determined by considering the number of targets. When no target direction corresponds to a facial target trajectory, but only a target direction corresponds to a human target trajectory, the adjustment method for the camera to be adjusted is directly determined based on the target direction corresponding to the human target trajectory. Similarly, this can be further determined by considering the number of targets.

[0073] The technical solution of this invention determines the utilization rate of each shooting device within the target area, selects the shooting device with low utilization as the shooting device to be adjusted, compares the target object trajectory in the field of view of the shooting device to be adjusted with the target object trajectory in the field of view of other shooting devices to determine the target direction, and adjusts the shooting device to be adjusted according to the target direction. This invention can quickly diagnose shooting devices with low utilization and automatically determine the adjustment method accordingly, thereby improving the utilization rate of shooting devices.

[0074] Example 2

[0075] Figure 5 This is a flowchart of a method for determining the adjustment mode of a shooting device according to Embodiment 2 of the present invention. Based on the above embodiments, the present invention further specifies the process of determining the utilization rate of the shooting device and the process of determining the target direction.

[0076] like Figure 5 As shown, the method includes:

[0077] S210. Determine the capture rate of the target shooting device based on the number of target objects captured by the target shooting device within a preset time period and the total number of target objects captured by all shooting devices in the target area.

[0078] In this embodiment, the process of determining the utilization rate is illustrated by taking the combination of several factors, including the capture rate, exclusive capture rate, and call rate, as an example.

[0079] The preset time period can be 24 hours, but this embodiment does not limit the specific value of the preset time period. The target shooting device refers to the shooting device that is currently performing utilization calculations.

[0080] In this embodiment, the number of target objects captured by the target imaging device within a preset time period is counted. Furthermore, the target objects captured by the target imaging device can be compared, and duplicate target objects are not counted again. The total number of target objects captured by all imaging devices within the target area within the preset time period is also counted. Similarly, the target objects captured by all imaging devices within the target area can be compared, and duplicate target objects are not counted again. The capture rate is obtained by dividing the number of target objects captured by the target imaging device by the total number of target objects captured by all imaging devices.

[0081] Understandably, the capture rate is positively correlated with the utilization rate of the target shooting equipment. The higher the capture rate, the higher the utilization rate, and vice versa.

[0082] S220. Determine the number of target objects exclusively captured by the target shooting device within a preset time period, and determine the exclusive capture rate of the target shooting device based on the number of target objects exclusively captured and the number of target objects captured by the target shooting device.

[0083] Among them, the exclusive capture object refers to the target object that can be captured by the target shooting device, but cannot be captured by other shooting devices in the target area.

[0084] In this embodiment, the number of exclusive capture objects captured by the target shooting device within a preset time period is counted, and the number of exclusive capture objects is divided by the number of target objects captured by the target shooting device to obtain the value as the exclusive capture rate.

[0085] Understandably, the exclusive capture rate is positively correlated with the utilization rate of the target shooting device. The higher the exclusive capture rate, the higher the utilization rate, and the more irreplaceable the target shooting device. Conversely, the lower the exclusive capture rate, the lower the utilization rate, and the less irreplaceable the target shooting device.

[0086] Furthermore, when the target object is a person, and the target imaging device can simultaneously capture both facial and human body targets, the device is designated to exclusively capture facial and human body targets, respectively, and the exclusive capture rate for each is calculated separately. In subsequent utilization rate calculations, different weights are assigned to the exclusive capture rates for facial and human body targets; optionally, the weight of the exclusive capture rate for facial targets can be set higher than that for human body targets. Calculating the exclusive capture rates for facial targets and human body targets separately, and assigning different weights to each, serves the purpose of assigning a higher weight to the exclusive capture rate for facial targets, since faces are more difficult to detect completely. When the target imaging device can capture a large number or a high percentage of facial targets, it indicates higher irreplaceability, and adjustments to the target imaging device should be avoided.

[0087] Furthermore, if the number of exclusively captured objects corresponding to the target shooting device is greater than or equal to a preset quantity threshold, and / or the exclusive capture rate of the target shooting device is greater than or equal to a preset proportion threshold, then even if the utilization rate of the target shooting device is low, it will not be used as a shooting device to be adjusted, and its installation position or angle will not be adjusted. It is understandable that the more exclusively captured objects a target shooting device captures, or the higher its proportion, the stronger its irreplaceability. When the target shooting device has high irreplaceability, it will not be adjusted.

[0088] Furthermore, S220 may include:

[0089] B1. If it is determined that within the preset time interval corresponding to the moment when the target shooting device captures the target object, no other shooting devices in the target area have captured the target object, then the target object is determined to be an exclusive capture target object.

[0090] B2. Count the number of target objects exclusively captured by the target shooting device within the preset time period.

[0091] The preset time interval can be 10 minutes, and this embodiment does not limit this. Furthermore, the time interval in this embodiment can include either the time interval before or after the capture time.

[0092] In this embodiment, when the target shooting device captures the target object, within a certain time interval at the moment the target object is captured, it is determined whether other shooting devices in the target area have captured the target object. If no other shooting devices have captured the target object, it means that the target object can only be captured by the target shooting device within a certain time, and it is regarded as the exclusive target object for capture.

[0093] by Figure 2 To illustrate this, let's take CAM3 as the target shooting device. If CAM3 captures target object 1 at 10:00, then we need to determine whether the images captured by CAM1, CAM2, CAM4, and CAM5 between 9:55 and 10:05 capture target object 1. If none of them capture target object 1, then target object 1 is the exclusive target object captured by CAM3.

[0094] Furthermore, when determining whether other cameras within the target area have captured the target object, the judgment can be made only for cameras whose distance from the target camera is less than or equal to a preset distance threshold. The advantage of this setting is that, when the target area is large, it can reduce the waste of computational resources while ensuring the accuracy of exclusively capturing the target object.

[0095] S230. Determine the call rate of the target shooting device based on the number of times the target shooting device is called within a preset time period and the total number of times all shooting devices in the target area are called.

[0096] The preset time period should be a value longer than the preset time interval; for example, the preset time period could be 30 days, but this embodiment does not impose this limitation. The target shooting device is invoked either through image or video playback based on user interface commands or through automatic event triggering. This embodiment does not limit the specific meaning of the shooting device being invoked.

[0097] In this embodiment, the number of times the target shooting device is called within a preset time period and the total number of times all shooting devices in the target area are called are counted. The number of times the target shooting device is called is divided by the total number of times it is called, and the result is used as the call rate of the target shooting device.

[0098] Understandably, the call rate is positively correlated with the utilization rate of the target shooting device; the higher the call rate, the higher the utilization rate, and vice versa.

[0099] S240. Determine the utilization rate of the target shooting device based on its capture rate, exclusive capture rate, and call rate.

[0100] In this embodiment, the capture rate, exclusive capture rate, and recall rate are pre-set with weights. When the exclusive capture rate includes exclusive face capture rate and exclusive human body capture rate, different weights are set for them respectively, and the weight of exclusive face capture rate is higher than that of exclusive human body capture rate. This embodiment does not limit the setting method or specific value of the weights.

[0101] In this embodiment, the sum of the product of the capture rate and its weight, the product of the face-only capture rate and its weight, the product of the human body-only capture rate and its weight, and the product of the call rate and its weight is taken as the utilization rate of the target shooting device.

[0102] S250. Based on the utilization rate of each shooting device, determine the shooting device to be adjusted among all shooting devices.

[0103] The specific process of selecting the shooting device to be adjusted from among the various shooting devices based on the utilization rate has been described in the above embodiments, and will not be repeated here.

[0104] S260, Determine at least one candidate direction corresponding to the trajectory of the target object in the field of view of the shooting device to be adjusted.

[0105] The trajectory of the target object within the field of view of the camera to be adjusted refers to the trajectory of each target object determined by the camera within a preset time period. The candidate direction refers to the direction contained within the target object's trajectory.

[0106] In this embodiment, for each target object trajectory in the field of view of the shooting device to be adjusted, the candidate directions are sequentially used to determine whether it is irreplaceable in that direction.

[0107] S270. If it is determined that within the preset time interval corresponding to the moment when the shooting device to be adjusted captures the target object, no other shooting device in the target area has captured the candidate direction of the target object's trajectory, then the candidate direction is determined as the target direction.

[0108] In this embodiment, when the camera device to be adjusted captures the target object, the capture status of other camera devices within a preset time interval at the capture time is searched. If none of the other camera devices have captured the target object, the candidate direction corresponding to the target object's trajectory is taken as the target direction. If other camera devices have captured the target object but have not captured the candidate direction of the target object's trajectory, the candidate direction that was not captured is taken as the target direction.

[0109] by Figure 2 Taking CAM3 as an example, if CAM3 captures target object 1 at 10:00, and the target motion trajectory 1 of target object 1 is in the AOC direction, then the images captured by CAM1, CAM2, CAM4, and CAM5 between 9:55 and 10:05 are examined. It is determined whether any other capturing device in the AOC direction can capture target object 1. If none of them capture target object 1, then the AOC direction is irreplaceable and is taken as the target direction. If CAM3 captures target object 2 at 11:00, and the target motion trajectory 2 of target object 2 is in the DOC direction, then the images captured by CAM1, CAM2, CAM4, and CAM5 between 10:55 and 11:05 are examined. It is determined whether any other capturing device in the DOC direction can capture target object 2. If CAM1 captures target object 2, then CAM3 in the DOC direction can be replaced by CAM1, and the DOC direction cannot be taken as the target direction.

[0110] Furthermore, other camera devices within the target area can refer to other camera devices in the surrounding area along the direction of movement of the target object. Figure 2 For example, when CAM3 captures target object 1, and the target motion trajectory 1 of target object 1 is in the AOC direction, since the visible directions of CAM1, CAM2, and CAM5 are all opposite to the direction of the target motion trajectory 1 of target object 1, it is only necessary to determine whether CAM4 can capture target object 1. The advantage of this setting is that it can reduce the amount of calculation and improve the speed of determining the target direction.

[0111] Furthermore, after determining multiple target directions based on the trajectories of each target object on the camera to be adjusted, each target direction can be fitted to obtain the final target direction, which can then be used for subsequent adjustments to the camera to be adjusted.

[0112] S280. Determine the adjustment method of the shooting device to be adjusted according to the target direction.

[0113] The specific process of adjusting the shooting equipment according to the target direction has been described in the above embodiments, and will not be repeated here.

[0114] The technical solution of this invention ranks the utilization rates of various shooting devices within a target area based on capture rate, exclusive capture rate, and recall rate. For shooting devices with low utilization rates, adjustments are made one by one, analyzing all feasible directions in the captured target object trajectories to identify irreplaceable directions. The important and irreplaceable target directions of the shooting device to be adjusted are determined. Based on these target directions, the adjustment angle and method of the shooting device to be adjusted are automatically determined, improving the accuracy of the shooting device in irreplaceable directions while reducing the repetition rate in replaceable directions, ultimately improving the overall utilization rate of shooting devices within the target area.

[0115] Example 3

[0116] Figure 6 This is a schematic diagram of a device for determining the adjustment method of a shooting device according to Embodiment 3 of the present invention. Figure 6 As shown, the device includes:

[0117] The camera device to be adjusted determination module 310 is used to determine the utilization rate of at least two camera devices in the target area, and to determine the camera device to be adjusted among the camera devices based on the utilization rate of each camera device.

[0118] The target direction determination module 320 is used to determine the target direction based on the trajectory of the target object in the field of view of the shooting device to be adjusted and the trajectory of the target object in the field of view of other shooting devices;

[0119] The adjustment method determination module 330 is used to determine the adjustment method of the shooting device to be adjusted based on the target direction.

[0120] The technical solution of this invention determines the utilization rate of each shooting device within the target area, selects the shooting device with low utilization as the shooting device to be adjusted, compares the target object trajectory in the field of view of the shooting device to be adjusted with the target object trajectory in the field of view of other shooting devices to determine the target direction, and adjusts the shooting device to be adjusted according to the target direction. This invention can quickly diagnose shooting devices with low utilization and automatically determine the adjustment method accordingly, thereby improving the utilization rate of shooting devices.

[0121] Optionally, the shooting equipment determination module 310 to be adjusted includes:

[0122] The capture rate determination unit is used to determine the capture rate of the target shooting device based on the number of target objects captured by the target shooting device within a preset time period and the total number of target objects captured by all shooting devices in the target area.

[0123] The exclusive capture rate determination unit is used to determine the number of target objects exclusively captured by the target shooting device within a preset time period, and to determine the exclusive capture rate of the target shooting device based on the number of target objects exclusively captured and the number of target objects captured by the target shooting device.

[0124] The call rate determination unit is used to determine the call rate of the target shooting device based on the number of times the target shooting device is called within a preset time period and the total number of times all shooting devices in the target area are called.

[0125] The utilization rate determination unit is used to determine the utilization rate of the target shooting device based on the capture rate, exclusive capture rate, and call rate of the target shooting device.

[0126] Optional, exclusive capture rate determination unit, specifically used for:

[0127] If it is determined that within the preset time interval corresponding to the moment when the target shooting device captures the target object, no other shooting devices in the target area have captured the target object, then the target object is determined to be the exclusive capture target object;

[0128] The number of target objects exclusively captured by the target shooting device within a preset time period is counted.

[0129] Optionally, the target direction determination module 320 includes:

[0130] The candidate direction determination unit is used to determine at least one candidate direction corresponding to the trajectory of the target object in the field of view of the shooting device to be adjusted.

[0131] The target direction determination unit is used to determine the candidate direction as the target direction if, within a preset time interval corresponding to the moment when the camera to be adjusted captures the target object, no other camera in the target area has captured the trajectory of the target object.

[0132] Optionally, the adjustment method determination module 330 includes:

[0133] The first adjustment method determination unit is used to adjust the shooting device to be adjusted if the number of target directions is one, until the visible field of view of the shooting device to be adjusted meets the maximum condition of the angle between the target directions.

[0134] The second adjustment method determination unit is used to adjust the shooting device to be adjusted if the number of target directions is at least two, until the field of view of the shooting device to be adjusted contains the intersection of the target directions.

[0135] Optionally, the target object includes a face and / or a human body, and the target direction includes the target direction corresponding to the trajectory of the face target object and / or the target direction corresponding to the trajectory of the human body target object;

[0136] The adjustment method determination module 330 includes:

[0137] The third adjustment method determination unit is used to determine the adjustment method of the shooting device to be adjusted based on the target direction corresponding to the trajectory of at least one face target object if the target direction is determined to include the target direction corresponding to the trajectory of at least one face target object.

[0138] Optionally, the device further includes:

[0139] The field of view orientation adjustment module is used to adjust the field of view orientation of the camera to be adjusted according to the direction of the trajectory of the target object in the field of view of the camera to be adjusted if it is determined that there is no target direction.

[0140] The target object re-determination module is used to determine the target direction based on the target object trajectory in the adjusted field of view and the target object trajectory in the field of view of other shooting devices.

[0141] The device for determining the shooting device adjustment method provided in the embodiments of the present invention can execute the method for determining the shooting device adjustment method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the method execution.

[0142] Example 4

[0143] Figure 7 A schematic diagram of an electronic device 10 that can be used to implement embodiments of the present invention is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the invention described and / or claimed herein.

[0144] like Figure 7As shown, the electronic device 10 includes at least one processor 11 and a memory, such as a read-only memory (ROM) 12 or a random access memory (RAM) 13, communicatively connected to the at least one processor 11. The memory stores computer programs executable by the at least one processor. The processor 11 can perform various appropriate actions and processes based on the computer program stored in the ROM 12 or loaded from storage unit 18 into the RAM 13. The RAM 13 may also store various programs and data required for the operation of the electronic device 10. The processor 11, ROM 12, and RAM 13 are interconnected via a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0145] Multiple components in electronic device 10 are connected to I / O interface 15, including: input unit 16, such as keyboard, mouse, etc.; output unit 17, such as various types of displays, speakers, etc.; storage unit 18, such as disk, optical disk, etc.; and communication unit 19, such as network card, modem, wireless transceiver, etc. Communication unit 19 allows electronic device 10 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0146] Processor 11 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. Processor 11 performs the various methods and processes described above, such as the method for determining the adjustment mode of the shooting device.

[0147] In some embodiments, the method for determining the shooting device adjustment mode can be implemented as a computer program tangibly contained in a computer-readable storage medium, such as storage unit 18. In some embodiments, part or all of the computer program can be loaded and / or installed on electronic device 10 via ROM 12 and / or communication unit 19. When the computer program is loaded into RAM 13 and executed by processor 11, one or more steps of the method for determining the shooting device adjustment mode described above can be performed. Alternatively, in other embodiments, processor 11 can be configured to perform the method for determining the shooting device adjustment mode by any other suitable means (e.g., by means of firmware).

[0148] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), payload-programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0149] Computer programs used to implement the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when executed by the processor, the computer programs cause the functions / operations specified in the flowcharts and / or block diagrams to be performed. The computer programs may be executed entirely on a machine, partially on a machine, or as a standalone software package, partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0150] In the context of this invention, a computer-readable storage medium can be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, apparatus, or device. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination thereof. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0151] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the electronic device. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).

[0152] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as data servers), or computing systems that include middleware components (e.g., application servers), or computing systems that include frontend components (e.g., user computers with graphical user interfaces or web browsers through which users can interact with implementations of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., communication networks). Examples of communication networks include local area networks (LANs), wide area networks (WANs), blockchain networks, and the Internet.

[0153] A computing system can include clients and servers. Clients and servers are generally located far apart and typically interact through communication networks. The client-server relationship is created by computer programs running on the respective computers and having a client-server relationship with each other. The server can be a cloud server, also known as a cloud computing server or cloud host, which is a hosting product within the cloud computing service system to address the shortcomings of traditional physical hosts and VPS services, such as high management difficulty and weak business scalability.

[0154] It should be understood that the various forms of processes shown above can be used, with steps reordered, added, or deleted. For example, the steps described in this invention can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution of this invention can be achieved, and this is not limited herein.

[0155] The specific embodiments described above do not constitute a limitation on the scope of protection of this invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this invention should be included within the scope of protection of this invention.

Claims

1. A method for determining the adjustment mode of a shooting device, characterized in that, include: Determine the utilization rate of at least two shooting devices within the target area, and based on the utilization rate of each shooting device, identify the shooting device to be adjusted among them; Determine the utilization rate of at least two shooting devices within the target area, including: The capture rate of the target shooting device is determined based on the number of target objects captured by the target shooting device within a preset time period and the total number of target objects captured by all shooting devices in the target area. Determine the number of target objects exclusively captured by the target shooting device within a preset time period, and determine the exclusive capture rate of the target shooting device based on the number of target objects exclusively captured and the number of target objects captured by the target shooting device. The call rate of the target shooting device is determined based on the number of times the target shooting device is called within a preset time period and the total number of times all shooting devices in the target area are called. The utilization rate of the target shooting device is determined based on its capture rate, exclusive capture rate, and call rate. Determine the target direction based on the target object trajectory in the field of view of the camera to be adjusted and the target object trajectory in the field of view of other camera devices; Based on the target direction, determine the adjustment method for the shooting equipment to be adjusted.

2. The method according to claim 1, characterized in that, Determine the number of target objects that the target shooting device can exclusively capture within a preset time period, including: If it is determined that within the preset time interval corresponding to the moment when the target shooting device captures the target object, no other shooting devices in the target area have captured the target object, then the target object is determined to be the exclusive capture target object; The number of target objects exclusively captured by the target shooting device within a preset time period is counted.

3. The method according to claim 1, characterized in that, Based on the target object trajectory in the field of view of the camera to be adjusted and the target object trajectory in the field of view of other camera devices, determine the target direction, including: Determine at least one candidate direction corresponding to the trajectory of the target object in the field of view of the shooting device to be adjusted; If it is determined that within a preset time interval corresponding to the moment when the camera to be adjusted captures the target object, no other camera in the target area has captured the candidate direction of the target object's trajectory, then the candidate direction is determined as the target direction.

4. The method according to claim 1, characterized in that, Based on the target direction, determine the adjustment method for the shooting equipment to be adjusted, including: If the number of target directions is determined to be one, then the camera to be adjusted is adjusted until the visible field of view of the camera to be adjusted meets the maximum condition of the angle between the target directions. If the number of target directions is determined to be at least two, then the camera device to be adjusted is adjusted until the field of view of the camera device to be adjusted contains the intersection of the target directions.

5. The method according to claim 4, characterized in that, The target object includes a face and / or a human body, and the target direction includes the target direction corresponding to the trajectory of the face target object and / or the target direction corresponding to the trajectory of the human body target object; Based on the target direction, determine the adjustment method for the shooting equipment to be adjusted, including: If the target direction is determined to include the target direction corresponding to the trajectory of at least one facial target object, then the adjustment method of the shooting device to be adjusted is determined according to the target direction corresponding to the trajectory of the facial target object.

6. The method according to claim 1, characterized in that, After identifying the shooting equipment to be adjusted from among the various shooting devices, the following is also included: If it is determined that there is no target direction, then adjust the direction of the field of view of the camera to be adjusted according to the direction of the target object's trajectory in the field of view of the camera to be adjusted; The target direction is determined based on the target object trajectory in the adjusted field of view and the target object trajectory in the field of view of other shooting devices.

7. A device for determining the adjustment method of a shooting device, characterized in that, include: The module for determining the shooting equipment to be adjusted is used to determine the utilization rate of at least two shooting equipment in the target area, and to determine the shooting equipment to be adjusted among the shooting equipment based on the utilization rate of each shooting equipment. The module for determining the shooting equipment to be adjusted includes: The capture rate determination unit is used to determine the capture rate of the target shooting device based on the number of target objects captured by the target shooting device within a preset time period and the total number of target objects captured by all shooting devices in the target area. The exclusive capture rate determination unit is used to determine the number of target objects exclusively captured by the target shooting device within a preset time period, and to determine the exclusive capture rate of the target shooting device based on the number of target objects exclusively captured and the number of target objects captured by the target shooting device. The call rate determination unit is used to determine the call rate of the target shooting device based on the number of times the target shooting device is called within a preset time period and the total number of times all shooting devices in the target area are called. The utilization rate determination unit is used to determine the utilization rate of the target shooting device based on the capture rate, exclusive capture rate and call rate of the target shooting device. The target direction determination module is used to determine the target direction based on the trajectory of the target object in the field of view of the shooting device to be adjusted and the trajectory of the target object in the field of view of other shooting devices. The adjustment method determination module is used to determine the adjustment method of the shooting device to be adjusted based on the target direction.

8. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the program, it implements the method for determining the adjustment mode of the shooting device as described in any one of claims 1-6.

9. A storage medium for storing computer-executable instructions, characterized in that, The computer-executable instructions, when executed by a computer processor, are used to perform the method for determining the adjustment mode of the shooting device as described in any one of claims 1-6.

Images