Target snapshot information determination method and device, equipment and medium
By determining the target information and image data of the capture target corresponding to the image acquisition device in the security camera, and determining the optimal image acquisition device based on identification and attitude comparison, the problems of excessive memory usage and reduced target capture rate caused by multiple image sensors are solved, and memory saving and capture effect are improved.
Patent Information
- Application Number
- CN202510142735.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-02-08
- Publication Date
- 2025-03-07
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Multiple image sensors in security cameras cause excessive memory usage, especially in scenarios where there are more targets to capture, resulting in a reduced target capture rate.
By determining the target information and image data of the capture target corresponding to the image acquisition device, determining the same capture target based on the identification, and determining the optimal image acquisition device through attitude comparison, the target information and image data are stored in the cache of the optimal device.
It saves memory overhead, avoids the problem of not being able to capture targets in time and analyze targets in time due to insufficient memory, and ensures target capture effect and improves work efficiency.
Smart Images

Figure CN119583944A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of computer vision technology, and in particular to a method, device, equipment and medium for determining target capture information. Background Art
[0002] When there are multiple image sensors in a security camera, caching the optimal frames of all targets from appearance to disappearance in multiple channels often results in excessive memory usage. Security cameras usually have limited memory, so for scenes with a large number of targets to be captured, such as intersections in large urban shopping malls, the target capture rate will be greatly reduced. Summary of the invention
[0003] The embodiments of the present application provide a method, device, equipment and medium for determining target snapshot information, so as to save memory overhead, ensure the target snapshot effect and improve the work efficiency of determining target snapshot information.
[0004] A method for determining target snapshot information provided by an embodiment of the present application includes: Determine target information and image data of at least one captured target corresponding to at least one image acquisition device; wherein the target information of the captured target includes: an identifier of the captured target and a posture of the captured target; Based on the identification of the captured target, determining the same captured target corresponding to different image acquisition devices; For the same capture target corresponding to the different image acquisition devices, the optimal image acquisition device corresponding to the capture target is determined by comparing the postures of the capture targets corresponding to different image acquisition devices, and the target information and image data of the capture target corresponding to the optimal image acquisition device are stored in the cache corresponding to the optimal image acquisition device.
[0005] The embodiment of the present application determines the target information and image data of at least one capture target corresponding to at least one image acquisition device; wherein the target information of the capture target includes: an identifier of the capture target and a posture of the capture target; thereby further determining the same capture target corresponding to different image acquisition devices based on the identifier of the capture target; and, for the same capture target corresponding to the different image acquisition devices, determining the optimal image acquisition device corresponding to the capture target by comparing the postures of the capture targets corresponding to different image acquisition devices, and storing the target information and image data of the capture target corresponding to the optimal image acquisition device in the cache corresponding to the optimal image acquisition device. It can be seen that since only the target information and image data of the capture target corresponding to the optimal image acquisition device are stored in the cache corresponding to the optimal image acquisition device, and the storage of data of all channels is avoided, memory overhead can be greatly saved, and the failure to capture the target and perform analysis in time due to insufficient memory can be avoided; and since the optimal image acquisition device corresponding to the capture target is determined by comparing the postures of the capture targets corresponding to different image acquisition devices, the embodiment of the present application can also ensure the target capture effect. In summary, the embodiments of the present application improve the efficiency and effect of target capture, thereby improving the work efficiency of determining target capture information.
[0006] In some embodiments, the target information of the captured target further includes: the type of the captured target; The determining, based on the identification of the captured target, that different image acquisition devices correspond to the same captured target includes: Based on the identifier of the capture target and the type of the capture target, the same capture target corresponding to different image acquisition devices is determined, wherein the identifier of the same capture target is the same and the type is also the same.
[0007] Therefore, the embodiments of the present application can further achieve accurate capture of targets with the same target identifier and the same target type, thereby avoiding the occurrence of capture errors caused by only capturing targets with the same target identifier.
[0008] In some embodiments, for the same captured target corresponding to the different image acquisition devices, determining the optimal image acquisition device corresponding to the captured target by comparing the postures of the captured targets corresponding to the different image acquisition devices includes: For the same capture target corresponding to the different image acquisition devices, the optimal capture target posture is determined by comparing the postures of the capture targets corresponding to different image acquisition devices, and the image acquisition device corresponding to the optimal capture target posture is determined as the optimal image acquisition device corresponding to the capture target.
[0009] In some embodiments, the target information of the captured target further includes: the clarity of the captured target; For the same captured target corresponding to the different image acquisition devices, determining the optimal image acquisition device by comparing the postures of the captured targets corresponding to the different image acquisition devices, further comprising: For the same capture target corresponding to the different image acquisition devices, when there are multiple image acquisition devices corresponding to the capture target with the same and optimal posture, the clarity of the capture targets corresponding to different image acquisition devices with the same and optimal posture of the capture target is compared to determine the optimal clarity of the capture target, and the image acquisition device corresponding to the optimal clarity of the capture target is determined as the optimal image acquisition device corresponding to the capture target.
[0010] Therefore, in the embodiment of the present application, when the posture of the capture target is the same, the clarity of the capture target can be further combined to determine the optimal image acquisition device corresponding to the capture target, thereby achieving more accurate and better determination of the optimal image acquisition device, and then the subsequent determination of the target capture information based on the target information and image data of the capture target corresponding to the optimal image acquisition device can be more accurate and better.
[0011] In some embodiments, the target information of the captured target further includes: the state of the captured target; The method further comprises: For the same captured target corresponding to the different image acquisition devices, when it is determined that the captured target is in a disappeared state, an optimal image frame of the captured target is determined, and based on the optimal image frame, attribute information of the captured target is determined.
[0012] In some embodiments, the target information of the captured target further includes: an optimal image frame of the captured target; Determining the optimal image frame of the captured target includes: An optimal image frame of the captured target is determined from the target information of the captured target.
[0013] In some embodiments, the method further comprises: If the identifier of the current capture target corresponding to the current image acquisition device does not exist in the cache corresponding to any of the image acquisition devices, the current image acquisition device is determined as the optimal image acquisition device corresponding to the current capture target, and the target information and image data of the current capture target are stored in the cache corresponding to the optimal image acquisition device.
[0014] An embodiment of the present application provides a device for determining target snapshot information, including: An input unit, used to determine target information and image data of at least one captured target corresponding to at least one image acquisition device; wherein the target information of the captured target includes: an identifier of the captured target and a posture of the captured target; A same capture target determination unit, used for determining the same capture target corresponding to different image acquisition devices based on the identifier of the capture target; The optimal cache unit is used to determine the optimal image acquisition device corresponding to the same capture target corresponding to the different image acquisition devices by comparing the postures of the capture targets corresponding to different image acquisition devices, and store the target information and image data of the capture target corresponding to the optimal image acquisition device in the cache corresponding to the optimal image acquisition device.
[0015] Another embodiment of the present application provides an electronic device, which includes a memory and a processor, wherein the memory is used to store program instructions, and the processor is used to call the program instructions stored in the memory and execute any of the above methods according to the obtained program.
[0016] Another embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are used to enable the computer to execute any of the above methods. BRIEF DESCRIPTION OF THE DRAWINGS
[0017] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0018] Figure 1 A flowchart of a method for determining target snapshot information provided in an embodiment of the present application; Figure 2 A schematic diagram of the main process of a method for determining target snapshot information provided by an embodiment of the present application; Figure 3 A schematic diagram of a multi-channel target optimization sub-process provided in an embodiment of the present application; Figure 4 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application; Figure 5 A schematic diagram of the structure of a device for determining target snapshot information provided in an embodiment of the present application. DETAILED DESCRIPTION
[0019] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0020] The embodiments of the present application provide a method, device, equipment and medium for determining target snapshot information, so as to save memory overhead, ensure the target snapshot effect and improve the work efficiency of determining target snapshot information.
[0021] Among them, the method and the device, equipment, and medium are based on the same application concept. Since the principles of solving problems by the method and the device, equipment, and medium are similar, the implementation of the device, equipment, medium, and method can refer to each other, and the repeated parts will not be repeated.
[0022] The terms "first", "second", etc. (if any) in the specification and claims of the embodiments of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments described herein can be implemented in a sequence other than the content illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.
[0023] The following examples and embodiments are to be understood as illustrative examples only. Although this specification may refer to "one", "an" or "some" examples or embodiments in several places, this does not mean that each such reference relates to the same example or embodiment, nor does it mean that the feature applies only to a single example or embodiment. Individual features of different embodiments may also be combined to provide other embodiments. In addition, terms such as "including" and "comprising" should be understood as not limiting the described embodiments to consist only of those features that have been mentioned; such examples and embodiments may also include features, structures, units, modules, etc. that are not specifically mentioned.
[0024] The following is a detailed description of each embodiment of the present application in conjunction with the accompanying drawings. It should be noted that the display order of the embodiments of the present application only represents the order of the embodiments, and does not represent the advantages and disadvantages of the technical solutions provided by the embodiments.
[0025] See also Figure 1, a method for determining target snapshot information provided by an embodiment of the present application includes: S101, determining target information and image data of at least one captured target corresponding to at least one image acquisition device; wherein the target information of the captured target includes: an identification (ID) of the captured target and a posture of the captured target; Among them, the above-mentioned image acquisition devices, for example, multiple image sensors (or cameras).
[0026] For example, when there are multiple image sensors in a security camera, image data of multiple channels can be acquired, and each of the channels is an image acquisition device (camera).
[0027] The capture target (also referred to as target in the present embodiment) is, for example, a pedestrian, a motor vehicle, a non-motor vehicle, etc. (referred to as human, motor vehicle, non-motor vehicle, etc.) The specific capture target can be determined according to actual needs and is not limited in the present embodiment.
[0028] The posture of the captured target, for example, the target facing forward, sideways, or facing away from the camera, etc., can be determined by detecting the target using a preset neural network model, that is, the collected image data is input into a preset neural network model for detecting the target posture, and the target posture information can be output.
[0029] S102, determining the same capture target corresponding to different image acquisition devices based on the identifier of the capture target; S103. For the same capture target corresponding to the different image acquisition devices, determine the optimal image acquisition device corresponding to the capture target by comparing the postures of the capture targets corresponding to the different image acquisition devices, and store the target information and image data of the capture target corresponding to the optimal image acquisition device in a cache corresponding to the optimal image acquisition device.
[0030] In some embodiments, the target information of the captured target further includes: the type of the captured target; The determining, based on the identification of the captured target, that different image acquisition devices correspond to the same captured target includes: Based on the identifier of the capture target and the type of the capture target, the same capture target corresponding to different image acquisition devices is determined, wherein the identifier of the same capture target is the same and the type is also the same.
[0031] The type of the captured target, for example: face, body, non-motor vehicle, motor vehicle, etc.
[0032] That is to say, in the embodiment of the present application, if it is determined that the target types and identifiers of two targets are consistent, then the two targets are determined to be the same target, thereby avoiding the situation where different targets are mistakenly judged as the same target.
[0033] In some embodiments, for the same captured target corresponding to the different image acquisition devices, determining the optimal image acquisition device corresponding to the captured target by comparing the postures of the captured targets corresponding to the different image acquisition devices includes: For the same capture target corresponding to the different image acquisition devices, the optimal capture target posture is determined by comparing the postures of the capture targets corresponding to different image acquisition devices, and the image acquisition device corresponding to the optimal capture target posture is determined as the optimal image acquisition device corresponding to the capture target.
[0034] That is to say, in the embodiment of the present application, for targets with the same target identification and target type in different channels, the target posture is compared. If the posture is the same, the target clarity is further compared to obtain the optimal channel corresponding to the target. If the target posture and clarity in the current channel are better than the optimal channel, the optimal frame information of the target cached in the optimal channel is cleared, the current frame information of the current channel is stored in the cache corresponding to the current channel, and the current channel is set as the optimal channel. That is, if there are multiple channels, one of them is the optimal channel, and the optimal frame information (the target posture is optimal and the target clarity is the highest) is cached, thereby reducing memory usage and improving the target capture rate.
[0035] In some embodiments, the target information of the captured target further includes: the clarity of the captured target; For the same captured target corresponding to the different image acquisition devices, determining the optimal image acquisition device by comparing the postures of the captured targets corresponding to the different image acquisition devices, further comprising: For the same capture target corresponding to the different image acquisition devices, when there are multiple image acquisition devices corresponding to the capture target with the same and optimal posture, the clarity of the capture targets corresponding to different image acquisition devices with the same and optimal posture of the capture target is compared to determine the optimal clarity of the capture target, and the image acquisition device corresponding to the optimal clarity of the capture target is determined as the optimal image acquisition device corresponding to the capture target.
[0036] The clarity of the captured target, for example, can be reflected by a specific numerical value. Similar to the target posture, it can also be determined by detection through a preset neural network model, that is, the collected image data is input into a preset neural network model for detecting the target clarity, and the target clarity information can be output.
[0037] In some embodiments, the target information of the captured target further includes: the state of the captured target; The method further comprises: For the same captured target corresponding to the different image acquisition devices, when it is determined that the captured target is in a disappeared state, an optimal image frame of the captured target is determined, and based on the optimal image frame, attribute information of the captured target is determined.
[0038] The state of the captured target, for example, the state of the target just appearing in the camera's field of view is "appeared", and then it is "updated", and the state of the target disappearing from the camera's field of view is "deleted", that is, the target state can be divided into: appear, update, and delete.
[0039] That is to say, in the embodiment of the present application, it can be determined whether the current target in the current channel is in a disappearing state. If it is in a disappearing state, a structural analysis is performed on the optimal image frame of the optimal channel of the current target to obtain structured data. For example, after selecting a frame (optimal image frame) in which the current target of the optimal channel appears and disappears within the camera field of view, this frame is sent to a preset attribute operator for processing, and the attribute information of the current target can be further obtained. If the current target is not in a disappearing state, continue to traverse the remaining targets until all targets in the current channel are traversed, and then traverse all targets in other channels, and so on, until all targets in all channels are traversed. If there is a target in a disappearing state during the process, a structural analysis is performed on the target.
[0040] In some embodiments, the target information of the captured target further includes: an optimal image frame of the captured target; Determining the optimal image frame of the captured target includes: An optimal image frame of the captured target is determined from the target information of the captured target.
[0041] The optimal image frame of the captured target is, for example, a frame of image selected from a plurality of consecutive frames of images containing the captured target, in which the target has the best posture and clarity. How to select the optimal image frame can be determined according to actual needs and is not limited in the embodiments of the present application.
[0042] In the embodiment of the present application, if the target information of the captured target includes the optimal image frame information of the captured target, the optimal image frame of the captured target can be determined directly from the target information of the captured target.
[0043] In some embodiments, the method further comprises: If the identifier of the current capture target corresponding to the current image acquisition device does not exist in the cache corresponding to any of the image acquisition devices, the current image acquisition device is determined as the optimal image acquisition device corresponding to the current capture target, and the target information and image data of the current capture target are stored in the cache corresponding to the optimal image acquisition device.
[0044] That is to say, in the embodiment of the present application, it can be determined whether the current target of the current channel is in the cache corresponding to the existing channel. If so, it means that the current target has appeared before, and the target information and image data of the current captured target exist in the cache corresponding to the existing channel; if not, it means that the current target appears for the first time, then the current channel can be directly determined as the optimal channel corresponding to the current captured target, and the target information and image data of the current captured target can be cached in the cache corresponding to the optimal channel.
[0045] Other specific examples of the embodiments of the present application are further described below.
[0046] See also Figure 2 The target capture information determination method provided in the embodiment of the present application includes: S201: Create an optimal operator.
[0047] In this embodiment, a preferred operator is created for each channel, and the preferred operator is used to search for target information under the channel.
[0048] During the creation of the preferred operator for each channel, the camera ID (camera_ID) of all channels and the corresponding preferred operator handle are recorded and saved in a global (static) variable (m_mapSelHndl).
[0049] Among them, camera_ID is the key and the preferred operator handle is the value (the key and value are in a one-to-one correspondence, one key corresponds to one value). The preferred target cache information (i.e., target information) under the corresponding channel can be found in each preferred operator handle. The cache information includes: target ID, target type, target box (i.e., the external rectangular box of the target), target posture, target clarity, target status, optimal image frame data of the target, etc.
[0050] The target IDs input to the preferred operator handle of different channels are the same, so that the target cache information in the preferred operator handle corresponding to different channels can be queried using camera_ID, target ID and target type.
[0051] Among them, the preferred operator handle is used to determine the preferred target cache information under the corresponding channel, and the cache information includes: target ID, target type, target frame, target posture, target clarity, target state, image frame data where the optimal target is located, etc.
[0052] Since the target information collected by different channels needs to be optimized separately, several optimization operator handles can be created for several channels. After creation, they need to be saved, for example, in m_mapSelHndl.
[0053] The global refers to that m_mapSelHndl can be obtained from any place in the preferred operator library, and the static refers to that it always exists during the program execution.
[0054] The preferred operator library refers to a compiled binary file, that is, a binary file compiled by the method provided in the embodiment of the present application.
[0055] In addition, in this embodiment, for the preferred operator handle corresponding to each channel, a corresponding red-black tree handle is created, and the target comparison function pointer is passed in. In this function, it is determined whether it is the same target based on the target ID and target type. If so, the corresponding value is returned, which is equivalent to creating a red-black tree for each channel (camera), and the target information collected by each is saved in its own red-black tree. The creation of a red-black tree can be understood as creating a tree, and then using the node insertion method to insert nodes (i.e. target information) into this tree, and so on, to perform node query, statistics, etc. In addition, the red-black tree can also be deleted to release memory.
[0056] That is to say, in this embodiment, a target node comparison method based on a red-black tree is provided, in which a node comparison function is passed in (i.e., when a red-black tree is created, a comparison method used for node query can be customized). If the target type and ID of the current target node and the historical optimal target node are consistent, then the two target nodes are deemed to be the same, and whether to update the historical optimal target node is determined based on the posture data in the current target node and the historical optimal target node. The red-black tree, i.e., a data structure, has the characteristics of fast search for target nodes. In this embodiment, the creation, node insertion, node query, node statistics, and red-black tree deletion of a red-black tree are realized; wherein, a target information is a data node of a red-black tree, and the target information may include: target ID, target type, target frame, target posture, clarity, corresponding optimal image frame information, etc. By inputting the target ID and target type into the node query method, it is possible to query whether the target already exists in the red-black tree. If so, the node information corresponding to the target is returned, otherwise the node does not exist.
[0057] S202, inputting the image data of the i-th path (i.e., the i-th channel) and all target information in the path into the optimization operator; The target information includes: target ID, target type, target frame, target posture, target state, target clarity, optimal image frame data of the target, etc.
[0058] That is to say, in this step, the target information of each target in the current collected image data of each channel is inserted into the corresponding red-black tree, and different channels correspond to different red-black trees.
[0059] S203, traverse all targets; That is, the current target is determined, and subsequent operations are performed for each current target respectively.
[0060] S204, performing multi-channel target optimization for the current target; That is, this step enters the multi-channel target optimization sub-process for the currently traversed target. The specific process is as follows: Figure 3 As shown (detailed description will be given later), the result of executing this sub-process is to obtain the optimal image frame of the corresponding optimal channel for the current target.
[0061] S205, identifying the current target state; That is, for the current target, identify whether its current state is a disappeared state.
[0062] S206: Determine whether the current target is in a disappearing state. If yes, execute step S207; otherwise, execute step S203.
[0063] For example, it is determined whether the j-th target (i.e., the current target) in the current channel is in a disappearing state. If it is in a disappearing state, then based on the execution result of step S204, i.e., the optimal image frame of the optimal channel corresponding to the j-th target, a structural analysis is performed on the j-th target to obtain the structural data of the j-th target. Specifically, for example, after selecting a frame in which the j-th target appears and disappears within the camera's field of view, this frame is sent to a preset attribute operator (an algorithm for analyzing its attributes) for processing to further obtain the attribute information of this target. If it is not in a disappearing state, continue to traverse the remaining targets and execute step S203 until all targets in the current channel are traversed, and then traverse all targets in other channels, and so on, until all channels are traversed.
[0064] S207 . Based on the optimal image frame of the optimal channel corresponding to the current target (the execution result of step S204 ), a structured analysis is performed on the current target to obtain structured data (ie, attribute information) corresponding to the current target.
[0065] See also Figure 3The multi-channel target optimization sub-process provided in the embodiment of the present application includes: S301, input the jth target in the current channel; That is, input the ID of the current target, so as to determine the current channel number camera_ID in the image frame data, and query the preferred operator handle sel_pic_hndl corresponding to the current channel in the global static variable m_mapSelHndl according to the current channel number; S302, determine whether the ID of the j-th target in the current channel is in the cache of all channels, if yes, execute step S303; otherwise, execute step S306.
[0066] That is, it is determined whether the ID of the j-th target in the current channel is in the cache corresponding to each channel. Specifically, the preferred operator handle of each channel is obtained by traversing m_mapSelHndl which stores the channel number and the preferred handle, and the red-black tree handle in the preferred operator handle is used to determine whether the j-th target of the current channel is in the target information in the preferred operator handle of each channel according to the target ID and target type. If it exists, it means that the target has appeared and exists in a certain channel, that is, the target information of the target has been cached in the optimal channel, and step S303 is executed; if it does not exist, it means that the target appears for the first time, and step S306 is executed; S303, for the current target, taking out the target information in the optimal channel and comparing it with the target information of the current channel; One camera_ID corresponds to one preferred handle. If there is a camera_ID, m_mapSelHndl can be determined, which is equivalent to determining the preferred operator handle corresponding to this camera_ID, and then the target information under the handle is determined.
[0067] S304. According to the comparison result, determine whether the posture and clarity of the current target in the current channel are better. If so, execute step S305; otherwise, end the sub-process.
[0068] S305, clearing target information of the optimal channel for the current target; S306: Insert the target information and image data of the current target into the cache of the current channel, and use the current channel as the optimal channel.
[0069] It can be seen that, in this embodiment, for the same capture target corresponding to different image acquisition devices (channels), the postures (or further combined with clarity) of the capture targets corresponding to different image acquisition devices are compared to determine the optimal image acquisition device corresponding to the capture target, and the target information and image data of the capture target corresponding to the optimal image acquisition device are stored in the cache corresponding to the optimal image acquisition device. If the capture target has target information and image data corresponding to the cache of the historical optimal image acquisition device, the target information and image data corresponding to the cache of the historical optimal image acquisition device are cleared. That is, in this embodiment of the application, for the same capture target, only one optimal image acquisition device is determined, and only the target information and image data of the target corresponding to the optimal image acquisition device are stored, thereby reducing memory usage and improving the target capture rate.
[0070] The following is an introduction to the equipment or device provided in the embodiments of the present application, in which the explanations or examples of technical features that are the same or corresponding to those described in the above method will not be repeated later.
[0071] An electronic device (such as a security camera) provided in an embodiment of the present application is shown in FIG. Figure 4 , for example: The processor 600 is used to read the program in the memory 620 and execute the following process: Determine target information and image data of at least one captured target corresponding to at least one image acquisition device; wherein the target information of the captured target includes: an identifier of the captured target and a posture of the captured target; Based on the identification of the captured target, determining the same captured target corresponding to different image acquisition devices; For the same capture target corresponding to the different image acquisition devices, the optimal image acquisition device corresponding to the capture target is determined by comparing the postures of the capture targets corresponding to different image acquisition devices, and the target information and image data of the capture target corresponding to the optimal image acquisition device are stored in the cache corresponding to the optimal image acquisition device.
[0072] In some embodiments, the target information of the captured target further includes: the type of the captured target; The determining, based on the identification of the captured target, that different image acquisition devices correspond to the same captured target includes: Based on the identifier of the capture target and the type of the capture target, the same capture target corresponding to different image acquisition devices is determined, wherein the identifier of the same capture target is the same and the type is also the same.
[0073] In some embodiments, for the same captured target corresponding to the different image acquisition devices, determining the optimal image acquisition device corresponding to the captured target by comparing the postures of the captured targets corresponding to the different image acquisition devices includes: For the same capture target corresponding to the different image acquisition devices, the optimal capture target posture is determined by comparing the postures of the capture targets corresponding to different image acquisition devices, and the image acquisition device corresponding to the optimal capture target posture is determined as the optimal image acquisition device corresponding to the capture target.
[0074] In some embodiments, the target information of the captured target further includes: the clarity of the captured target; For the same captured target corresponding to the different image acquisition devices, determining the optimal image acquisition device by comparing the postures of the captured targets corresponding to the different image acquisition devices, further comprising: For the same capture target corresponding to the different image acquisition devices, when there are multiple image acquisition devices corresponding to the capture target with the same and optimal posture, the clarity of the capture targets corresponding to different image acquisition devices with the same and optimal posture of the capture target is compared to determine the optimal clarity of the capture target, and the image acquisition device corresponding to the optimal clarity of the capture target is determined as the optimal image acquisition device corresponding to the capture target.
[0075] In some embodiments, the target information of the captured target further includes: the state of the captured target; The processor 600 is further configured to read the program in the memory 620 and execute the following process: For the same captured target corresponding to the different image acquisition devices, when it is determined that the captured target is in a disappeared state, an optimal image frame of the captured target is determined, and based on the optimal image frame, attribute information of the captured target is determined.
[0076] In some embodiments, the target information of the captured target further includes: an optimal image frame of the captured target; Determining the optimal image frame of the captured target includes: An optimal image frame of the captured target is determined from the target information of the captured target.
[0077] In some embodiments, the processor 600 is further configured to read a program in the memory 620 and execute the following process: If the identifier of the current capture target corresponding to the current image acquisition device does not exist in the cache corresponding to any of the image acquisition devices, the current image acquisition device is determined as the optimal image acquisition device corresponding to the current capture target, and the target information and image data of the current capture target are stored in the cache corresponding to the optimal image acquisition device.
[0078] The transceiver 610 is configured to receive and send data under the control of the processor 600 .
[0079] Among them, Figure 4 In the embodiment, the bus architecture may include any number of interconnected buses and bridges, specifically one or more processors represented by processor 600 and various circuits of memory represented by memory 620 are linked together. The bus architecture may also link together various other circuits such as peripherals, voltage regulators, and power management circuits, which are well known in the art and are therefore not further described herein. The bus interface provides an interface. The transceiver 610 may be a plurality of components, namely, a transmitter and a receiver, providing a unit for communicating with various other devices on a transmission medium, including wireless channels, wired channels, optical cables, and other transmission media. For different user devices, the user interface 630 may also be an interface capable of externally and internally connecting required devices, and the connected devices include but are not limited to a keypad, a display, a speaker, a microphone, a joystick, and the like.
[0080] The processor 600 is responsible for managing the bus architecture and general processing, and the memory 620 can store data used by the processor 600 when performing operations.
[0081] In some embodiments, the processor 600 may be a CPU (central processing unit), an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array) or a CPLD (Complex Programmable Logic Device), and the processor may also adopt a multi-core architecture.
[0082] The processor calls the computer program stored in the memory to execute any of the methods provided in the embodiments of the present application according to the obtained executable instructions. The processor and the memory can also be arranged physically separately.
[0083] It should be noted here that the above-mentioned device provided in the embodiment of the present application can implement all the method steps implemented in the above-mentioned method embodiment, and can achieve the same technical effect. The parts and beneficial effects of this embodiment that are the same as those in the method embodiment will not be described in detail here.
[0084] See also Figure 5 , an object capture information determination device (for example, a security camera) provided in an embodiment of the present application includes: The input unit 11 is used to determine the target information and image data of at least one captured target corresponding to at least one image acquisition device; wherein the target information of the captured target includes: the identification of the captured target and the posture of the captured target; A same capture target determining unit 12, used to determine the same capture target corresponding to different image acquisition devices based on the identifier of the capture target; The optimal cache unit 13 is used to determine the optimal image acquisition device corresponding to the same capture target corresponding to the different image acquisition devices by comparing the postures of the capture targets corresponding to different image acquisition devices, and store the target information and image data of the capture target corresponding to the optimal image acquisition device in the cache corresponding to the optimal image acquisition device.
[0085] In some embodiments, the target information of the captured target further includes: the type of the captured target; The determining, based on the identification of the captured target, that different image acquisition devices correspond to the same captured target includes: Based on the identifier of the capture target and the type of the capture target, the same capture target corresponding to different image acquisition devices is determined, wherein the identifier of the same capture target is the same and the type is also the same.
[0086] In some embodiments, for the same captured target corresponding to the different image acquisition devices, determining the optimal image acquisition device corresponding to the captured target by comparing the postures of the captured targets corresponding to the different image acquisition devices includes: For the same capture target corresponding to the different image acquisition devices, the optimal capture target posture is determined by comparing the postures of the capture targets corresponding to different image acquisition devices, and the image acquisition device corresponding to the optimal capture target posture is determined as the optimal image acquisition device corresponding to the capture target.
[0087] In some embodiments, the target information of the captured target further includes: the clarity of the captured target; For the same captured target corresponding to the different image acquisition devices, determining the optimal image acquisition device by comparing the postures of the captured targets corresponding to the different image acquisition devices, further comprising: For the same capture target corresponding to the different image acquisition devices, when there are multiple image acquisition devices corresponding to the capture target with the same and optimal posture, the clarity of the capture targets corresponding to different image acquisition devices with the same and optimal posture of the capture target is compared to determine the optimal clarity of the capture target, and the image acquisition device corresponding to the optimal clarity of the capture target is determined as the optimal image acquisition device corresponding to the capture target.
[0088] In some embodiments, the target information of the captured target further includes: the state of the captured target; The optimal cache unit 13 is also used for: For the same captured target corresponding to the different image acquisition devices, when it is determined that the captured target is in a disappeared state, an optimal image frame of the captured target is determined, and based on the optimal image frame, attribute information of the captured target is determined.
[0089] In some embodiments, the target information of the captured target further includes: an optimal image frame of the captured target; Determining the optimal image frame of the captured target includes: An optimal image frame of the captured target is determined from the target information of the captured target.
[0090] In some embodiments, the optimal cache unit 13 is further used for: If the identifier of the current capture target corresponding to the current image acquisition device does not exist in the cache corresponding to any of the image acquisition devices, the current image acquisition device is determined as the optimal image acquisition device corresponding to the current capture target, and the target information and image data of the current capture target are stored in the cache corresponding to the optimal image acquisition device.
[0091] It should be noted that the division of units in the embodiments of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation. In addition, each functional unit in each embodiment of the present application may be integrated into a processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
[0092] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can essentially or partly contribute to the prior art or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) or a processor to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk, etc., and other media that can store program codes.
[0093] Any of the devices or apparatuses provided in the embodiments of the present application may specifically be a desktop computer, a portable computer, a smart phone, a tablet computer, a personal digital assistant (PDA), etc. It may include a central processing unit (CPU), a memory, an input / output device, etc. The input device may include a keyboard, a mouse, a touch screen, etc. The output device may include a display device, such as a liquid crystal display (LCD), a cathode ray tube (CRT), etc.
[0094] The memory may include a read-only memory (ROM) and a random access memory (RAM), and provides the processor with program instructions and data stored in the memory. In the embodiment of the present application, the memory may be used to store the program of any of the methods provided in the embodiment of the present application.
[0095] The processor calls the program instructions stored in the memory, and the processor is used to execute any of the methods provided in the embodiments of the present application according to the obtained program instructions.
[0096] The present application embodiment also provides a computer program product or computer program, which includes a computer instruction, which is stored in a computer-readable storage medium. The processor of the computer device reads the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction so that the computer device performs any of the methods described in the above embodiments. The program product can use any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, - but not limited to - an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of readable storage media (non-exhaustive list) include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.
[0097] The embodiment of the present application provides a computer-readable storage medium for storing computer program instructions used by the apparatus provided in the embodiment of the present application, which includes a program for executing any of the methods provided in the embodiment of the present application. The computer-readable storage medium may be a non-transitory computer-readable medium.
[0098] The computer-readable storage medium can be any available medium or data storage device that can be accessed by a computer, including but not limited to magnetic storage (such as floppy disks, hard disks, magnetic tapes, magneto-optical disks (MO), etc.), optical storage (such as CD, DVD, BD, HVD, etc.), and semiconductor storage (such as ROM, EPROM, EEPROM, non-volatile memory (NANDFLASH), solid-state drive (SSD)), etc.
[0099] It should be understood that: The access technology through which entities in the communication network transmit traffic can be any suitable current or future technology, such as WLAN (Wireless Local Access Network), WiMAX (Worldwide Interoperability for Microwave Access), LTE, LTE-A, 5G, Bluetooth, infrared, etc.; in addition, the embodiments can also apply wired technology, for example, IP-based access technology, such as a wired network or a fixed line.
[0100] Embodiments suitable for being implemented as software code or a portion thereof and running using a processor or processing functionality are independent of the software code and may be specified using any known or future developed programming language, such as a high-level programming language such as objective-C, C, C++, C#, Java, Python, Javascript, other scripting languages, etc., or a low-level programming language such as machine language or assembler.
[0101] The implementation of the embodiments is hardware independent and may be implemented using any known or future developed hardware technology or any mixture thereof, such as a microprocessor or CPU (central processing unit), MOS (metal oxide semiconductor), CMOS (complementary MOS), BiMOS (bipolar MOS), BiCMOS (bipolar CMOS), ECL (emitter coupled logic) and / or TTL (transistor-transistor logic).
[0102] Embodiments may be implemented as separate devices, apparatuses, units, components, or functions, or in a distributed manner, for example, one or more processors or processing functions may be used or shared in a process, or one or more processing segments or processing portions may be used and shared in a process, wherein one physical processor or more than one physical processor may be used to implement one or more processing portions dedicated to a specific process as described.
[0103] The device may be implemented by a semiconductor chip, a chipset, or a (hardware) module including such a chip or chipset.
[0104] The embodiments may also be implemented as any combination of hardware and software, such as ASIC (Application Specific IC (Integrated Circuit)) components, FPGA (Field Programmable Gate Array) or CPLD (Complex Programmable Logic Device) components or DSP (Digital Signal Processor) components.
[0105] The embodiments may also be implemented as a computer program product including a computer usable medium having computer readable program code embodied therein, the computer readable program code being adapted to perform the processes as described in the embodiments, wherein the computer usable medium may be a non-transitory medium.
[0106] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present application may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) containing computer-usable program codes.
[0107] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0108] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0109] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.
[0110] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.
Claims
1. A method for determining target snapshot information, characterized in that: The method comprises: Determine target information and image data of at least one captured target corresponding to at least one image acquisition device; wherein the target information of the captured target includes: an identifier of the captured target and a posture of the captured target; Based on the identification of the captured target, determining the same captured target corresponding to different image acquisition devices; For the same capture target corresponding to the different image acquisition devices, the optimal image acquisition device corresponding to the capture target is determined by comparing the postures of the capture targets corresponding to different image acquisition devices, and the target information and image data of the capture target corresponding to the optimal image acquisition device are stored in the cache corresponding to the optimal image acquisition device.
2. The method according to claim 1, characterized in that The target information of the captured target also includes: the type of the captured target; The determining, based on the identification of the captured target, that different image acquisition devices correspond to the same captured target includes: Based on the identifier of the capture target and the type of the capture target, the same capture target corresponding to different image acquisition devices is determined, wherein the identifier of the same capture target is the same and the type is also the same.
3. The method according to claim 1, characterized in that: For the same captured target corresponding to the different image acquisition devices, determining the optimal image acquisition device corresponding to the captured target by comparing the postures of the captured targets corresponding to the different image acquisition devices, including: For the same capture target corresponding to the different image acquisition devices, the optimal capture target posture is determined by comparing the postures of the capture targets corresponding to different image acquisition devices, and the image acquisition device corresponding to the optimal capture target posture is determined as the optimal image acquisition device corresponding to the capture target.
4. The method according to claim 3, characterized in that The target information of the captured target also includes: the clarity of the captured target; For the same captured target corresponding to the different image acquisition devices, determining the optimal image acquisition device by comparing the postures of the captured targets corresponding to the different image acquisition devices, further comprising: For the same capture target corresponding to the different image acquisition devices, when there are multiple image acquisition devices corresponding to the capture target with the same and optimal posture, the clarity of the capture targets corresponding to different image acquisition devices with the same and optimal posture of the capture target is compared to determine the optimal clarity of the capture target, and the image acquisition device corresponding to the optimal clarity of the capture target is determined as the optimal image acquisition device corresponding to the capture target.
5. The method according to claim 1, characterized in that The target information of the captured target also includes: the state of the captured target; The method further comprises: For the same captured target corresponding to the different image acquisition devices, when it is determined that the captured target is in a disappeared state, an optimal image frame of the captured target is determined, and based on the optimal image frame, attribute information of the captured target is determined.
6. The method according to claim 5, characterized in that The target information of the captured target also includes: an optimal image frame of the captured target; Determining the optimal image frame of the captured target includes: An optimal image frame of the captured target is determined from the target information of the captured target.
7. The method according to claim 1, characterized in that The method further comprises: If the identifier of the current capture target corresponding to the current image acquisition device does not exist in the cache corresponding to any of the image acquisition devices, the current image acquisition device is determined as the optimal image acquisition device corresponding to the current capture target, and the target information and image data of the current capture target are stored in the cache corresponding to the optimal image acquisition device.
8. A device for determining target snapshot information, characterized in that: The device comprises: An input unit, used to determine target information and image data of at least one captured target corresponding to at least one image acquisition device; wherein the target information of the captured target includes: an identifier of the captured target and a posture of the captured target; A same capture target determination unit, used for determining the same capture target corresponding to different image acquisition devices based on the identifier of the capture target; The optimal cache unit is used to determine the optimal image acquisition device corresponding to the same capture target corresponding to the different image acquisition devices by comparing the postures of the capture targets corresponding to different image acquisition devices, and store the target information and image data of the capture target corresponding to the optimal image acquisition device in the cache corresponding to the optimal image acquisition device.
9. An electronic device, characterized in that: include: A memory for storing program instructions; A processor, configured to call the program instructions stored in the memory, and execute the method according to any one of claims 1 to 7 according to the obtained program.
10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are used to enable the computer to execute the method according to any one of claims 1 to 7.
Citation Information
Patent Citations
Method for selecting optimal viewing angle of video human face by multi-lens camera
CN101702234A
Method for selecting camera combination in visual perception network
CN102932605A
Control method, electronic equipment, computer readable storage medium and chip
CN111083364A
Intelligent solution for real-time optimal camera selection and linkage based on crime site
CN111757001A
Video index determination method, video playing method and computer equipment
CN114627403A