Video retrieval method, device, electronic device and storage medium

Abstract

The embodiment of the present application provides a video retrieval method, device, electronic device and storage medium, which relates to the field of data processing technology, including: obtaining a video retrieval request, the video retrieval request carries: retrieval conditions and a retrieval level that characterizes the level of detail of the retrieval result, the retrieval conditions include: target monitoring point and target time period; when the retrieval level is non-primary, according to the preset retrieval priority order, the monitoring video that meets the retrieval conditions is retrieved from the first video with the highest retrieval priority, if there is no complete video in the first video with the target monitoring point in the target time period, then the first missing time period of the missing video in the first video is determined; from other videos with a retrieval priority lower than the first video, the monitoring video with the target monitoring point in the first missing time period is retrieved until the video retrieval result that meets the retrieval level requirements is obtained. The scheme provided by the embodiment of the present application can improve the efficiency of video retrieval.

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to a video retrieval method, device, electronic device and storage medium. Background Art

[0002] In the field of monitoring, monitoring videos of monitoring points collected by monitoring equipment are usually obtained and stored to facilitate subsequent retrieval of the monitoring videos of the monitoring points.

[0003] In the related art, in order to ensure the security of surveillance videos, surveillance videos of each monitoring point are generally stored in different storage methods. For example, for a surveillance video of a monitoring point, the surveillance video of the monitoring point can be stored in the following three ways: the first storage method can be that the monitoring device uploads the collected surveillance video to the storage center for storage in real time; the second storage method can be that the monitoring device first stores the surveillance video locally, and uploads the local surveillance video to the storage center at a preset interval; the third storage method can be that the monitoring device stores the surveillance video to a long-term storage medium such as a CD or a tape. In this way, when the surveillance video of each monitoring point is retrieved later, it is necessary to traverse the surveillance video stored in each storage method, and retrieve the surveillance video of the target monitoring point in the target time period from the surveillance video stored in each storage method.

[0004] Although the above scheme can realize video retrieval, it is necessary to traverse the surveillance videos stored in each storage method, and retrieve the surveillance videos of the target monitoring point in the target time period from the surveillance videos stored in multiple storage methods, which is time-consuming and results in low efficiency of video retrieval. Summary of the invention

[0005] The purpose of the embodiments of the present application is to provide a video retrieval method, device, electronic device and storage medium to improve the efficiency of video retrieval. The specific technical solution is as follows:

[0006] In a first aspect, an embodiment of the present application provides a video retrieval method, the method comprising:

[0007] Obtaining a video retrieval request, wherein the video retrieval request carries: a retrieval condition and a retrieval level representing the detail level of the retrieval result, wherein the retrieval condition includes: a target monitoring point and a target time period;

[0008] In the case where the search level is non-primary, according to the preset search priority order, from the first video with the highest search priority, the surveillance video that meets the search condition is searched, if there is no complete video of the target monitoring point in the target time period in the first video, then the first missing time period of the missing video in the first video is determined;

[0009] The monitoring videos of the target monitoring point in the first missing time period are retrieved from other videos with a retrieval priority lower than the first video, until a video retrieval result that meets the retrieval level requirement is obtained.

[0010] In one embodiment of the present application, searching for surveillance videos of the target surveillance point in the first missing time period from other videos having a lower retrieval priority than the first video until a video retrieval result that meets the retrieval level requirement is obtained includes:

[0011] When the search level is medium, the surveillance video of the target monitoring point in the first missing time period is searched from the second video having a search priority lower than the first video to obtain a video search result.

[0012] In one embodiment of the present application, searching for surveillance videos of the target surveillance point in the first missing time period from other videos having a lower retrieval priority than the first video until a video retrieval result that meets the retrieval level requirement is obtained includes:

[0013] When the retrieval level is high, the surveillance video of the target surveillance point in the first missing time period is retrieved from a second video having a lower retrieval priority than the first video, and if the second video does not contain a complete video of the target surveillance point in the first missing time period, the second missing time period of the missing video in the second video is determined;

[0014] The monitoring videos of the target monitoring point in the second missing time period are retrieved from a third video having a retrieval priority lower than that of the second video to obtain a video retrieval result.

[0015] In one embodiment of the present application, the method further includes:

[0016] When the search level is primary, determining whether there is a surveillance video of the target surveillance point in the first video;

[0017] If so, determining that the video retrieval result is a surveillance video of the target surveillance point in the first video;

[0018] If not, it is determined whether there is a surveillance video of the target monitoring point in a second video with a search priority lower than that of the first video, and a video search result is obtained.

[0019] In one embodiment of the present application, the determining whether there is a surveillance video of the target surveillance point in a second video having a lower retrieval priority than the first video to obtain a video retrieval result includes:

[0020] Determine whether there is a surveillance video of the target surveillance point in a second video with a lower retrieval priority than the first video;

[0021] If so, determining that the video retrieval result is a surveillance video of the target surveillance point in the second video;

[0022] If not, it is determined whether there is a surveillance video of the target monitoring point in a third video having a lower retrieval priority than the second video, and a video retrieval result is obtained.

[0023] In one embodiment of the present application, searching for surveillance videos of the target surveillance point in the first missing time period from other videos having a lower retrieval priority than the first video until a video retrieval result that meets the retrieval level requirement is obtained includes:

[0024] When the determined first missing time period is greater than or equal to a preset duration threshold, the surveillance video of the target monitoring point in the first missing time period is retrieved from other videos with a retrieval priority lower than the first video, until a video retrieval result that meets the retrieval level requirements is obtained.

[0025] In one embodiment of the present application, the first video is: a video stored in a real-time streaming video storage manner; and / or

[0026] The second video is: a video stored in a historical stream video storage mode; and / or

[0027] The third video is a video stored in a long-term video storage manner.

[0028] In a second aspect, an embodiment of the present application provides a video retrieval device, the device comprising:

[0029] A request obtaining module, used to obtain a video retrieval request, wherein the video retrieval request carries: a retrieval condition and a retrieval level representing the detail level of the retrieval result, wherein the retrieval condition includes: a target monitoring point and a target time period;

[0030] A first video retrieval module is used to retrieve surveillance videos that meet the retrieval condition from the first video with the highest retrieval priority according to a preset retrieval priority order when the retrieval level is non-primary, and if the first video does not contain a complete video of the target monitoring point in the target time period, determine a first missing time period of the missing video in the first video;

[0031] The other video retrieval module is used to retrieve the surveillance video of the target monitoring point in the first missing time period from other videos with a retrieval priority lower than the first video, until a video retrieval result that meets the retrieval level requirement is obtained.

[0032] In one embodiment of the present application, the other video retrieval module is specifically used to:

[0033] When the search level is medium, the surveillance video of the target monitoring point in the first missing time period is searched from the second video having a search priority lower than the first video to obtain a video search result.

[0034] In one embodiment of the present application, the other video retrieval module is specifically used to:

[0035] When the retrieval level is high, the surveillance video of the target surveillance point in the first missing time period is retrieved from a second video having a lower retrieval priority than the first video, and if the second video does not contain a complete video of the target surveillance point in the first missing time period, the second missing time period of the missing video in the second video is determined;

[0036] The monitoring videos of the target monitoring point in the second missing time period are retrieved from a third video having a retrieval priority lower than that of the second video to obtain a video retrieval result.

[0037] In one embodiment of the present application, the device further includes:

[0038] a first video judging module, configured to judge whether there is a surveillance video of the target surveillance point in the first video when the search level is primary, and if so, trigger the first result obtaining module; if not, trigger the second result obtaining module;

[0039] The first result obtaining module is used to determine that the video retrieval result is a surveillance video in which the target surveillance point exists in the first video;

[0040] The second result obtaining module is used to determine whether there is a surveillance video of the target monitoring point in a second video having a lower retrieval priority than the first video, and obtain a video retrieval result.

[0041] In one embodiment of the present application, the second result obtaining module is specifically used to:

[0042] Determine whether there is a surveillance video of the target surveillance point in a second video with a lower retrieval priority than the first video;

[0043] If so, determining that the video retrieval result is a surveillance video of the target surveillance point in the second video;

[0044] If not, it is determined whether there is a surveillance video of the target monitoring point in a third video having a lower retrieval priority than the second video, and a video retrieval result is obtained.

[0045] In one embodiment of the present application, the other video retrieval module is specifically used to:

[0046] When the determined first missing time period is greater than or equal to a preset duration threshold, the surveillance video of the target monitoring point in the first missing time period is retrieved from other videos with a retrieval priority lower than the first video, until a video retrieval result that meets the retrieval level requirements is obtained.

[0047] In one embodiment of the present application, the first video is: a video stored in a real-time streaming video storage manner; and / or

[0048] The second video is: a video stored in a historical stream video storage mode; and / or

[0049] The third video is a video stored in a long-term video storage manner.

[0050] In a third aspect, an embodiment of the present application provides an electronic device, including a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other through the communication bus;

[0051] Memory, used to store computer programs;

[0052] The processor is used to implement any method step described in the first aspect when executing a program stored in the memory.

[0053] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, any method step described in the first aspect is implemented.

[0054] An embodiment of the present application also provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute any one of the method steps described in the first aspect above.

[0055] Beneficial effects of the embodiments of the present application:

[0056] In the video retrieval scheme provided in the embodiment of the present application, a video retrieval request can be obtained, wherein the video retrieval request carries: retrieval conditions and a retrieval level representing the level of detail of the retrieval result, the retrieval conditions include: target monitoring point and target time period; when the retrieval level is not primary, according to the preset retrieval priority order, the surveillance video that meets the retrieval conditions is retrieved from the first video with the highest retrieval priority, if there is no complete video with the target monitoring point in the target time period in the first video, then the first missing time period of the missing video in the first video is determined; from other videos with a retrieval priority lower than the first video, the surveillance video with the target monitoring point in the first missing time period is retrieved until the video retrieval result that meets the retrieval level requirements is obtained. In this way, when the retrieval level is not primary, the surveillance video with the target monitoring point in the target time period can be retrieved from the first video with the highest retrieval priority first, if the video that meets the above retrieval conditions in the first video is incomplete, then the first missing time period of the missing video in the first video can be determined, so that the surveillance video with the target monitoring point in the above first missing time period can be retrieved from other videos later, without the need to retrieve the surveillance video of the entire target time period from other videos, thereby narrowing the scope of the videos to be retrieved. It can be seen that the solution provided by the embodiment of the present application can improve the efficiency of video retrieval. BRIEF DESCRIPTION OF THE DRAWINGS

[0057] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application, and for ordinary technicians in this field, other embodiments can also be obtained based on these drawings.

[0058] Figure 1 A schematic diagram of the flow of the first video retrieval method provided in an embodiment of the present application;

[0059] Figure 2 A schematic diagram of a flow chart of a second video retrieval method provided in an embodiment of the present application;

[0060] Figure 3 A schematic diagram of a flow chart of a third video retrieval method provided in an embodiment of the present application;

[0061] Figure 4 A schematic diagram of a fourth video retrieval method provided in an embodiment of the present application;

[0062] Figure 5 A schematic diagram of the structure of a video retrieval device provided in an embodiment of the present application;

[0063] Figure 6 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0064] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field based on the present application belong to the scope of protection of the present application.

[0065] In order to improve the efficiency of video retrieval, the embodiments of the present application provide a video retrieval method, device, electronic device and storage medium, which are described in detail below.

[0066] The embodiment of the present application provides a video retrieval method, which can be applied to electronic devices such as electronic computers, servers, mobile phones, NVRs (Network Video Recorders), DVRs (Digital Video Recorders), and CVRs (Central Video Recorders). The video retrieval method includes:

[0067] Obtaining a video retrieval request, wherein the video retrieval request carries: a retrieval condition and a retrieval level representing the detail level of the retrieval result, the retrieval condition including: a target monitoring point and a target time period;

[0068] When the search level is non-primary, the surveillance video satisfying the search condition is searched from the first video with the highest search priority according to the preset search priority order. If there is no complete video of the target monitoring point in the target time period in the first video, the first missing time period of the missing video in the first video is determined;

[0069] From other videos with a lower retrieval priority than the first video, the surveillance videos of the target surveillance point in the first missing time period are retrieved until a video retrieval result that meets the retrieval level requirement is obtained.

[0070] In this way, when the search level is not primary, the surveillance videos of the target monitoring point in the target time period can be first searched from the first video with the highest search priority. If the videos in the first video that meet the above search conditions are incomplete, the first missing time period of the videos missing in the first video can be determined, so that the surveillance videos of the target monitoring point in the above first missing time period can be searched from other videos later. There is no need to search the surveillance videos of the entire target time period from other videos, which narrows the scope of the videos to be searched. It can be seen that the solution provided by the above embodiment can improve the efficiency of video search.

[0071] See also Figure 1 , Figure 1 The first video retrieval method provided in the present application is a flowchart of the method, which includes the following steps S101-S103:

[0072] S101, obtaining a video retrieval request.

[0073] The video retrieval request carries: retrieval conditions and a retrieval level representing the level of detail of the retrieval results.

[0074] The above search conditions refer to the conditions for retrieving videos, and the search conditions include: target monitoring points and target time periods. The above target monitoring points refer to the monitoring points corresponding to the videos to be retrieved; the above target time period refers to the time period in which the videos to be retrieved are located.

[0075] In addition, the above search conditions may also include one or more of the following conditions: an identifier of a monitoring device that collects video, an identifier of a storage device that stores video, an identifier of a video transmission path, and the like.

[0076] The above-mentioned search levels may include primary, intermediate, advanced, etc., which are used to characterize: the degree of detail of the requested search results. The higher the search level, the more detailed the search results obtained by the requested search; the lower the search level, the more concise the search results obtained by the requested search. Therefore, when the search level is low, the search speed can be accelerated because the search results obtained are relatively concise.

[0077] In one embodiment of the present application, a request for retrieving a video input by a user through an external input device may be obtained as a video retrieval request.

[0078] The external input device may be a mouse, keyboard, touchpad, audio acquisition device, etc.

[0079] In addition, selectable options regarding search conditions and search levels may also be displayed to the user, and the search conditions and search levels selected by the user may be determined to obtain a video search request.

[0080] S102, when the retrieval level is non-primary, the surveillance videos satisfying the retrieval conditions are retrieved from the first video with the highest retrieval priority in accordance with the preset retrieval priority order; if the first video does not contain a complete video of the target monitoring point in the target time period, the first missing time period of the missing video in the first video is determined.

[0081] The above retrieval priority order refers to the order of performing video retrieval from videos stored in different storage modes.

[0082] The above storage method refers to: a method of storing the surveillance video collected by the surveillance equipment in a storage medium.

[0083] For example, the above storage method may be: the monitoring device uploads the collected monitoring video to the storage center for storage in real time;

[0084] Alternatively, the monitoring device first stores the monitoring video locally, and then uploads the local monitoring video to the storage center at a preset interval;

[0085] Or the monitoring equipment stores the monitoring video to a long-term storage medium such as a CD or a tape;

[0086] Or the surveillance equipment stores the surveillance video locally for a long time;

[0087] Alternatively, the monitoring device stores the monitoring video in a transfer station, and uploads the monitoring video of the transfer station to a storage center at preset intervals.

[0088] The first video is the video with the highest search priority. It can be understood that when searching for videos, videos that meet the search conditions are searched from the first video first.

[0089] Specifically, in order to ensure the security of surveillance videos, the surveillance videos of each surveillance point are generally stored in different storage methods. When performing video retrieval, for the videos stored in different storage methods, the videos that meet the retrieval conditions can be searched from the above videos in turn according to the preset retrieval priority order until the retrieval results meet the detailed level required by the retrieval level;

[0090] Among them, when the search level is non-primary, for example, when the search level is intermediate or advanced, the surveillance video of the target monitoring point in the target time period can be first searched from the first video with the highest search priority, and based on the time period of the found surveillance video, it is determined whether the found surveillance video is complete. If it is complete, the surveillance video of the target monitoring point in the target time period can be directly obtained from the first video to obtain the search result;

[0091] If it is incomplete, the time period of the surveillance video found in the first video that is missing relative to the target time period can be determined as the first missing time period, so as to facilitate the subsequent search for the surveillance video of the first missing time period of the target monitoring point from other videos.

[0092] S103, searching for surveillance videos of the target surveillance point in the first missing time period from other videos with a search priority lower than the first video, until a video search result that meets the search level requirement is obtained.

[0093] The other videos refer to videos with a lower search priority than the first video. It can be understood that when it is difficult to find a video satisfying the search condition in the first video, other videos will be searched for videos satisfying the search condition.

[0094] Specifically, when there is no complete surveillance video of the target monitoring point in the target time period in the first video with the highest retrieval priority, the time period of the surveillance video found in the first video that is missing relative to the target time period can be determined as the first missing time period, and then the surveillance video of the first missing time period of the target monitoring point can be searched from other videos with a lower retrieval priority than the first video until a video retrieval result that meets the retrieval level requirements is obtained, and finally the retrieval result in the first video and the retrieval results in other videos are used as the total video retrieval result.

[0095] For example, assuming that the target time period is 10:00-12:00 and the target monitoring point is a parking lot, when the retrieval level is non-primary, you can first search for monitoring videos of the parking lot during the period of 10:00-12:00 from the first video. If the monitoring videos of the parking lot during the period of 10:00-11:00 are retrieved from the first video, you can first obtain the retrieval result F1 from the first video, and determine that the first missing time period is 11:00-12:00. Continue to retrieve the monitoring videos of the parking lot during the period of 11:00-12:00 from other videos, and obtain the retrieval result F2 in other videos, and obtain the video retrieval results that meet the retrieval level requirements. Finally, the above F1 and F2 are used as the final video retrieval results.

[0096] In one embodiment of the present application, when the determined first missing time period is greater than or equal to a preset time threshold, the surveillance videos of the target monitoring point in the first missing time period can be retrieved from other videos with a retrieval priority lower than the first video until a video retrieval result that meets the retrieval level requirements is obtained.

[0097] The duration threshold may be a threshold set manually or a threshold set based on different application scenarios, for example, 60 seconds, 5 minutes, 30 minutes, etc.

[0098] Specifically, after determining the first missing time period in the above step S102, it can be determined whether the above first missing time period is greater than or equal to the above time length threshold. If so, it means that the situation of missing surveillance video in the first video is relatively serious, and it is necessary to continue to retrieve the surveillance video of the target monitoring point in the first missing time period from other videos;

[0099] If not, it means that the situation of missing surveillance video in the first video is not serious. Therefore, there is no need to continue to retrieve the surveillance video of the target monitoring point in the first missing time period from other videos. The surveillance video retrieved from the first video can be directly used as the final video retrieval result.

[0100] In the video retrieval scheme provided in the above embodiment, a video retrieval request can be obtained, wherein the video retrieval request carries: retrieval conditions and a retrieval level representing the level of detail of the retrieval result, and the retrieval conditions include: target monitoring point and target time period; when the retrieval level is not primary, according to the preset retrieval priority order, the surveillance video that meets the retrieval conditions is retrieved from the first video with the highest retrieval priority, if there is no complete video with the target monitoring point in the target time period in the first video, then the first missing time period of the missing video in the first video is determined; from other videos with a retrieval priority lower than the first video, the surveillance video with the target monitoring point in the first missing time period is retrieved until the video retrieval result that meets the retrieval level requirements is obtained. In this way, when the retrieval level is not primary, the surveillance video with the target monitoring point in the target time period can be retrieved from the first video with the highest retrieval priority first, if the video that meets the above retrieval conditions in the first video is incomplete, then the first missing time period of the missing video in the first video can be determined, so that the surveillance video with the target monitoring point in the above first missing time period can be retrieved from other videos later, without the need to retrieve the surveillance video of the entire target time period from other videos, thereby narrowing the scope of the videos to be retrieved. It can be seen that applying the solution provided by the above embodiment can improve the efficiency of video retrieval.

[0101] In one embodiment of the present application, when performing video retrieval from other videos in the above step S103, when the retrieval level is intermediate, the surveillance video of the target monitoring point in the first missing time period can be retrieved from the second video with a lower retrieval priority than the first video to obtain the video retrieval result.

[0102] The second video is a video having a retrieval priority only lower than the first video.

[0103] Specifically, when the retrieval level is intermediate, it means that more detailed retrieval results are needed. Therefore, you can continue to search for surveillance videos of the target monitoring point in the first missing time period from the second video, and finally use the retrieval results in the first video and the second video as the total video retrieval results.

[0104] For example, assuming that the target time period is 20:00-24:00 and the target monitoring point is the gate of the community, when the retrieval level is intermediate, you can first search for monitoring videos of the gate of the community between 20:00-24:00 from the first video. If the monitoring videos of the gate of the community between 20:00-23:00 are retrieved from the first video, you can first obtain the retrieval result Q1 from the first video, and determine that the first missing time period is 23:00-24:00. Continue to retrieve the monitoring videos of the gate of the community between 23:00-24:00 from the second video, and obtain the retrieval result Q2 in the second video. Finally, the above Q1 and Q2 are used as the final video retrieval results.

[0105] In one embodiment of the present application, when the retrieval level is high, the surveillance video of the target monitoring point in the first missing time period is retrieved from the second video having a lower retrieval priority than the first video. If there is no complete video of the target monitoring point in the first missing time period in the second video, the second missing time period of the missing video in the second video is determined; and the surveillance video of the target monitoring point in the second missing time period is retrieved from the third video having a lower retrieval priority than the second video to obtain the video retrieval result.

[0106] The third video is a video with a lower retrieval priority than the second video.

[0107] Specifically, if the surveillance video retrieved from the first video is incomplete, and the search level is high, the surveillance video of the first missing time period of the target surveillance point in the second video can be further searched to determine whether the surveillance video of the first missing time period of the target surveillance point in the second video is complete. If it is complete, the video search results of the surveillance video retrieved from the first video and the surveillance video retrieved from the second video are obtained;

[0108] If it is incomplete, you can continue to determine the time period of the surveillance video found in the second video relative to the first missing time period as the second missing time period, and then search for the surveillance video of the second missing time period of the target monitoring point from the third video with a retrieval priority lower than the second video. Finally, the retrieval results in the first video, the retrieval results in the second video, and the retrieval results in the third video are used as the total video retrieval results.

[0109] For example, assuming that the target time period is 17:00-22:00, and the target monitoring point is the dormitory area, when the search level is high, the monitoring video of the dormitory area during the period of 17:00-22:00 can be first searched from the first video. If the monitoring video of the dormitory area during the period of 17:00-19:00 is retrieved from the first video, the search result W1 can be first obtained from the first video, and the first missing time period is determined to be 19:00-22:00;

[0110] Continue to retrieve the surveillance video of the dormitory area during the period of 19:00-22:00 from the second video. If the surveillance video of the dormitory area during the period of 19:00-21:00 is retrieved from the second video, the search result W2 can be first obtained from the second video, and the second missing time period is determined to be 21:00-22:00;

[0111] Continue to search the surveillance video of the dormitory area during 21:00-22:00 from the third video, obtain the search result W3 in the third video, and finally use the above W1, W2, and W3 as the final video search results.

[0112] See also Figure 2 , Figure 2 The flowchart of the second video retrieval method provided in the embodiment of the present application includes the following steps S201-S205:

[0113] S201, obtaining a video retrieval request.

[0114] The video retrieval request carries: retrieval conditions and a retrieval level representing the detail level of the retrieval results, and the retrieval conditions include: target monitoring points and target time periods.

[0115] S202, when the retrieval level is non-primary, the surveillance videos satisfying the retrieval conditions are retrieved from the first video with the highest retrieval priority in accordance with the preset retrieval priority order; if the first video does not contain a complete video of the target monitoring point in the target time period, the first missing time period of the missing video in the first video is determined.

[0116] S203, determine the search level, if the search level is intermediate, execute step S204, if the search level is high, execute step S205.

[0117] S204: Search for surveillance videos of the target surveillance point in the first missing time period from the second video whose search priority is lower than the first video, and obtain a video search result.

[0118] S205, from the second video with a lower retrieval priority than the first video, retrieve the surveillance video of the target surveillance point in the first missing time period, if there is no complete video of the target surveillance point in the first missing time period in the second video, then determine the second missing time period of the missing video in the second video. From the third video with a lower retrieval priority than the second video, retrieve the surveillance video of the target surveillance point in the second missing time period to obtain the video retrieval result.

[0119] See also Figure 3 , Figure 3 This is a flow chart of a third video retrieval method provided in an embodiment of the present application. Figure 1 The video retrieval method shown may also include the following steps S104-S106:

[0120] S104, when the search level is primary, determine whether there is a surveillance video of the target surveillance point in the first video, if so, execute step S105, if not, execute step S106.

[0121] Specifically, when the retrieval level is primary, it means that the video retrieval results need to be obtained quickly. Therefore, after obtaining the video retrieval request, you can first search from the first video with the highest retrieval priority to see whether there is a surveillance video of the above-mentioned target monitoring point. If so, execute step S105. If not, execute step S106.

[0122] S105: Determine that the video search result is a surveillance video in which the target surveillance point exists in the first video.

[0123] Specifically, when the search level is primary, it means that the user expects to obtain the search result as soon as possible. Therefore, if it is determined in S104 that the surveillance video of the target surveillance point exists in the first video, the search result indicating that the surveillance video of the target surveillance point exists in the first video can be directly returned.

[0124] In one embodiment of the present application, after returning the above retrieval results, video acquisition requests can continue to be received, and then based on the above request, the surveillance video of the target monitoring point in the target time period is obtained from the first video, and the surveillance video is returned.

[0125] S106, determining whether there is a surveillance video of the target surveillance point in a second video having a lower retrieval priority than the first video, and obtaining a video retrieval result.

[0126] Specifically, if it is determined in S104 that the surveillance video of the target surveillance point does not exist in the first video, the surveillance video of the target surveillance point can be retrieved from the second video to obtain a search result. If the surveillance video of the target surveillance point exists in the second video, the search result indicating that the surveillance video of the target surveillance point exists in the second video can be directly returned; if the surveillance video of the target surveillance point does not exist in the second video, the search result indicating that the surveillance video of the target surveillance point does not exist in the second video can be returned.

[0127] In one embodiment of the present application, when retrieving the surveillance video of the target surveillance point from the second video in step S106, the following steps may be performed:

[0128] Determine whether there is a surveillance video of the target monitoring point in the second video whose retrieval priority is lower than that of the first video; if so, determine that the video retrieval result is the surveillance video of the target monitoring point in the second video; if not, determine whether there is a surveillance video of the target monitoring point in the third video whose retrieval priority is lower than that of the second video, and obtain the video retrieval result.

[0129] Specifically, if there is surveillance video of the target monitoring point in the second video, the retrieval result of the surveillance video indicating that the target monitoring point exists in the second video can be directly returned; if there is no surveillance video of the target monitoring point in the second video, the third video can be searched to determine whether there is surveillance video of the target monitoring point in the third video. If there is, the retrieval result of the surveillance video indicating that the target monitoring point exists in the third video can be returned; if not, the retrieval result of the surveillance video indicating that the target monitoring point does not exist in the third video is returned.

[0130] In one embodiment of the present application, the first video may be a video stored in a real-time streaming video storage manner.

[0131] The real-time streaming video storage method refers to a method of storing the video collected by the monitoring device in real time.

[0132] Specifically, the first video may be a video obtained by storing the video collected by the monitoring device in real time using a real-time streaming video storage method. For example, the first video may be a video stored locally in the monitoring device, or it may be a video in a device such as an NVR, DVR, or CVR that stores videos in real time.

[0133] The second video may be a video stored in a historical stream video storage manner.

[0134] The above-mentioned historical stream video storage method refers to a method of periodically storing the videos collected by the monitoring equipment.

[0135] Specifically, after obtaining the video collected by the monitoring device, the video can be first stored in a periodic storage device, which can be a monitoring device, NVR, DVR, CVR, etc. After reaching a preset period, the video can be transferred to a long-term storage device for long-term storage of the video. The second video can be understood as: a video stored in a periodic storage device. The preset period can be 4 hours, 24 hours, 7 days, etc., and the long-term storage device can be a CD, a tape, etc.

[0136] The third video may be a video stored in a long-term video storage manner.

[0137] The long-term video storage method refers to a method of storing the video collected by the monitoring equipment for a long period of time.

[0138] Specifically, after obtaining the video collected by the monitoring device, the video can be stored in a long-term storage device to achieve long-term storage of the video, and the term of the long-term storage can be 1 year, 5 years, 20 years, etc. The third video can be understood as: a video stored in a long-term storage device.

[0139] See also Figure 4 , Figure 4 The flowchart of the fourth video retrieval method provided in the embodiment of the present application includes the following steps S401-S411:

[0140] S401, obtaining a video retrieval request.

[0141] The video retrieval request carries: retrieval conditions and a retrieval level representing the level of detail of the retrieval results.

[0142] The above search levels include elementary, intermediate, advanced, etc.

[0143] The above search conditions include: target monitoring point and target time period.

[0144] S402, determine whether there is a surveillance video of the target surveillance point in the first video, if yes, execute step S403, if not, execute step S411.

[0145] The first video is a video stored in a first storage mode with the highest priority, specifically a video stored in a real-time streaming video storage mode.

[0146] S403, determine whether the search level is primary, if yes, execute step S404, otherwise execute step S405.

[0147] S404: Determine that the video search result is a surveillance video in which the target surveillance point exists in the first video.

[0148] S405, determining whether the surveillance video of the target surveillance point and the target time period in the first video is complete, if yes, executing step S406, if no, executing step S407.

[0149] S406, searching the first video for the surveillance video of the target surveillance point and the target time period to obtain the video search result.

[0150] S407: Determine a first missing time period in which video recording is missing in the first video recording.

[0151] The second video is a video stored in a second storage mode with a lower priority than the first storage mode, specifically, a video stored in a historical stream video storage mode.

[0152] S408, determining whether the search level is intermediate, if yes, executing step S409, otherwise executing step S410.

[0153] S409, searching the second video for the surveillance video of the target surveillance point in the first missing time period to obtain a video search result.

[0154] S410, retrieve the surveillance video of the first missing time period of the target monitoring point from the second video, and when there is no complete video of the target monitoring point in the first missing time period in the second video, determine the second missing time period of the missing video, retrieve the surveillance video of the second missing time period of the target monitoring point from the third video, and obtain the video retrieval result.

[0155] The third video is a video stored in a third storage mode with the lowest priority, specifically, a video stored in a long-period video storage mode.

[0156] S411, searching whether there is a surveillance video of the target surveillance point in the second video, and obtaining a video search result.

[0157] In the video retrieval scheme provided in the above embodiment, a video retrieval request can be obtained, wherein the video retrieval request carries: retrieval conditions and a retrieval level representing the level of detail of the retrieval result, and the retrieval conditions include: target monitoring point and target time period; when the retrieval level is not primary, according to the preset retrieval priority order, the surveillance video that meets the retrieval conditions is retrieved from the first video with the highest retrieval priority, if there is no complete video with the target monitoring point in the target time period in the first video, then the first missing time period of the missing video in the first video is determined; from other videos with a retrieval priority lower than the first video, the surveillance video with the target monitoring point in the first missing time period is retrieved until the video retrieval result that meets the retrieval level requirements is obtained. In this way, when the retrieval level is not primary, the surveillance video with the target monitoring point in the target time period can be retrieved from the first video with the highest retrieval priority first, if the video that meets the above retrieval conditions in the first video is incomplete, then the first missing time period of the missing video in the first video can be determined, so that the surveillance video with the target monitoring point in the above first missing time period can be retrieved from other videos later, without the need to retrieve the surveillance video of the entire target time period from other videos, thereby narrowing the scope of the videos to be retrieved. It can be seen that applying the solution provided by the above embodiment can improve the efficiency of video retrieval.

[0158] Corresponding to the above-mentioned video retrieval method, the embodiment of the present application also provides a video retrieval device, which is described in detail below.

[0159] See also Figure 5 , Figure 5 A schematic diagram of the structure of a video retrieval device provided in an embodiment of the present application, the device comprising:

[0160] The request obtaining module 501 is used to obtain a video retrieval request, wherein the video retrieval request carries: a retrieval condition and a retrieval level representing the detail level of the retrieval result, wherein the retrieval condition includes: a target monitoring point and a target time period;

[0161] The first video retrieval module 502 is used to retrieve the surveillance video satisfying the retrieval condition from the first video with the highest retrieval priority according to the preset retrieval priority order when the retrieval level is non-primary, and if the first video does not contain a complete video of the target monitoring point in the target time period, determine the first missing time period of the missing video in the first video;

[0162] The other video retrieval module 503 is used to retrieve the surveillance video of the target monitoring point in the first missing time period from other videos with a lower retrieval priority than the first video, until a video retrieval result that meets the retrieval level requirement is obtained.

[0163] In one embodiment of the present application, the other video retrieval module 503 is specifically used to:

[0164] When the search level is medium, the surveillance video of the target monitoring point in the first missing time period is searched from the second video having a search priority lower than the first video to obtain a video search result.

[0165] In one embodiment of the present application, the other video retrieval module 503 is specifically used to:

[0166] When the retrieval level is high, the surveillance video of the target surveillance point in the first missing time period is retrieved from a second video having a lower retrieval priority than the first video, and if the second video does not contain a complete video of the target surveillance point in the first missing time period, the second missing time period of the missing video in the second video is determined;

[0167] The monitoring videos of the target monitoring point in the second missing time period are retrieved from a third video having a retrieval priority lower than that of the second video to obtain a video retrieval result.

[0168] In one embodiment of the present application, the device further includes:

[0169] a first video judging module, configured to judge whether there is a surveillance video of the target surveillance point in the first video when the search level is primary, and if so, trigger the first result obtaining module; if not, trigger the second result obtaining module;

[0170] The first result obtaining module is used to determine that the video retrieval result is a surveillance video in which the target surveillance point exists in the first video;

[0171] The second result obtaining module is used to determine whether there is a surveillance video of the target monitoring point in a second video having a lower retrieval priority than the first video, and obtain a video retrieval result.

[0172] In one embodiment of the present application, the second result obtaining module is specifically used to:

[0173] Determine whether there is a surveillance video of the target surveillance point in a second video with a lower retrieval priority than the first video;

[0174] If so, determining that the video retrieval result is a surveillance video of the target surveillance point in the second video;

[0175] If not, it is determined whether there is a surveillance video of the target monitoring point in a third video having a lower retrieval priority than the second video, and a video retrieval result is obtained.

[0176] In one embodiment of the present application, the other video retrieval module 503 is specifically used to:

[0177] When the determined first missing time period is greater than or equal to a preset duration threshold, the surveillance video of the target monitoring point in the first missing time period is retrieved from other videos with a retrieval priority lower than the first video, until a video retrieval result that meets the retrieval level requirements is obtained.

[0178] In one embodiment of the present application, the first video is: a video stored in a real-time streaming video storage manner; and / or

[0179] The second video is: a video stored in a historical stream video storage mode; and / or

[0180] The third video is a video stored in a long-term video storage manner.

[0181] In the video retrieval scheme provided in the above embodiment, a video retrieval request can be obtained, wherein the video retrieval request carries: retrieval conditions and a retrieval level representing the level of detail of the retrieval result, and the retrieval conditions include: target monitoring point and target time period; when the retrieval level is not primary, according to the preset retrieval priority order, the surveillance video that meets the retrieval conditions is retrieved from the first video with the highest retrieval priority, if there is no complete video with the target monitoring point in the target time period in the first video, then the first missing time period of the missing video in the first video is determined; from other videos with a retrieval priority lower than the first video, the surveillance video with the target monitoring point in the first missing time period is retrieved until the video retrieval result that meets the retrieval level requirements is obtained. In this way, when the retrieval level is not primary, the surveillance video with the target monitoring point in the target time period can be retrieved from the first video with the highest retrieval priority first, if the video that meets the above retrieval conditions in the first video is incomplete, then the first missing time period of the missing video in the first video can be determined, so that the surveillance video with the target monitoring point in the above first missing time period can be retrieved from other videos later, without the need to retrieve the surveillance video of the entire target time period from other videos, thereby narrowing the scope of the videos to be retrieved. It can be seen that applying the solution provided by the above embodiment can improve the efficiency of video retrieval.

[0182] The present application also provides an electronic device, such as Figure 6As shown, it includes a processor 601, a communication interface 602, a memory 603 and a communication bus 604, wherein the processor 601, the communication interface 602, and the memory 603 communicate with each other through the communication bus 604.

[0183] Memory 603, used for storing computer programs;

[0184] The processor 601 is used to implement the video retrieval method when executing the program stored in the memory 603.

[0185] The communication bus mentioned in the above electronic device can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The communication bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, only one thick line is used in the figure, but it does not mean that there is only one bus or one type of bus.

[0186] The communication interface is used for communication between the above electronic device and other devices.

[0187] The memory may include a random access memory (RAM) or a non-volatile memory (NVM), such as at least one disk memory. Optionally, the memory may also be at least one storage device located away from the aforementioned processor.

[0188] The above-mentioned processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.

[0189] In another embodiment provided in the present application, a computer-readable storage medium is provided, in which a computer program is stored. When the computer program is executed by a processor, the steps of any of the above-mentioned video retrieval methods are implemented.

[0190] In another embodiment provided by the present application, a computer program product including instructions is also provided, which, when executed on a computer, enables the computer to execute any video retrieval method in the above embodiments.

[0191] In the video retrieval scheme provided in the above embodiment, a video retrieval request can be obtained, wherein the video retrieval request carries: retrieval conditions and a retrieval level representing the level of detail of the retrieval result, and the retrieval conditions include: target monitoring point and target time period; when the retrieval level is not primary, according to the preset retrieval priority order, the surveillance video that meets the retrieval conditions is retrieved from the first video with the highest retrieval priority, if there is no complete video with the target monitoring point in the target time period in the first video, then the first missing time period of the missing video in the first video is determined; from other videos with a retrieval priority lower than the first video, the surveillance video with the target monitoring point in the first missing time period is retrieved until the video retrieval result that meets the retrieval level requirements is obtained. In this way, when the retrieval level is not primary, the surveillance video with the target monitoring point in the target time period can be retrieved from the first video with the highest retrieval priority first, if the video that meets the above retrieval conditions in the first video is incomplete, then the first missing time period of the missing video in the first video can be determined, so that the surveillance video with the target monitoring point in the above first missing time period can be retrieved from other videos later, without the need to retrieve the surveillance video of the entire target time period from other videos, thereby narrowing the scope of the videos to be retrieved. It can be seen that applying the solution provided by the above embodiment can improve the efficiency of video retrieval.

[0192] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium may be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive Solid State Disk (SSD)), etc.

[0193] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0194] Each embodiment in this specification is described in a related manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the device embodiment, electronic device embodiment, computer-readable storage medium embodiment, and computer program product embodiment, since they are basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0195] The above description is only a preferred embodiment of the present application and is not intended to limit the protection scope of the present application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application are included in the protection scope of the present application.

Claims

1. A video retrieval method, characterized in that: The method comprises: Obtaining a video retrieval request, wherein the video retrieval request carries: a retrieval condition and a retrieval level representing the detail of the retrieval result, the higher the retrieval level, the more detailed the retrieval result requested for retrieval, and the retrieval condition includes: a target monitoring point and a target time period; In the case where the search level is non-primary, according to the preset search priority order, from the first video with the highest search priority, the surveillance video that meets the search condition is searched, if there is no complete video of the target monitoring point in the target time period in the first video, then the first missing time period of the missing video in the first video is determined; The monitoring videos of the target monitoring point in the first missing time period are retrieved from other videos with a retrieval priority lower than the first video, until a video retrieval result that meets the retrieval level requirement is obtained.

2. The method according to claim 1, characterized in that The step of searching for surveillance videos of the target surveillance point in the first missing time period from other videos having a lower retrieval priority than the first video until a video retrieval result that meets the retrieval level requirement is obtained includes: When the search level is medium, the surveillance video of the target monitoring point in the first missing time period is searched from the second video having a search priority lower than the first video to obtain a video search result.

3. The method according to claim 1, characterized in that The step of searching for surveillance videos of the target surveillance point in the first missing time period from other videos having a lower retrieval priority than the first video until a video retrieval result that meets the retrieval level requirement is obtained includes: When the retrieval level is high, the surveillance video of the target surveillance point in the first missing time period is retrieved from a second video having a lower retrieval priority than the first video, and if the second video does not contain a complete video of the target surveillance point in the first missing time period, the second missing time period of the missing video in the second video is determined; The monitoring videos of the target monitoring point in the second missing time period are retrieved from a third video having a retrieval priority lower than that of the second video to obtain a video retrieval result.

4. The method according to claim 1, characterized in that: The method further comprises: When the search level is primary, determining whether there is a surveillance video of the target surveillance point in the first video; If so, determining that the video retrieval result is a surveillance video of the target surveillance point in the first video; If not, it is determined whether there is a surveillance video of the target monitoring point in a second video with a search priority lower than that of the first video, and a video search result is obtained.

5. The method according to claim 4, characterized in that The step of determining whether there is a surveillance video of the target surveillance point in a second video having a lower retrieval priority than the first video, and obtaining a video retrieval result, comprises: Determine whether there is a surveillance video of the target surveillance point in a second video with a lower retrieval priority than the first video; If so, determining that the video retrieval result is a surveillance video of the target surveillance point in the second video; If not, it is determined whether there is a surveillance video of the target monitoring point in a third video having a lower retrieval priority than the second video, and a video retrieval result is obtained.

6. The method according to any one of claims 1 to 5, characterized in that The step of searching for surveillance videos of the target surveillance point in the first missing time period from other videos having a lower retrieval priority than the first video until a video retrieval result that meets the retrieval level requirement is obtained includes: When the determined first missing time period is greater than or equal to a preset duration threshold, the surveillance video of the target monitoring point in the first missing time period is retrieved from other videos with a retrieval priority lower than the first video, until a video retrieval result that meets the retrieval level requirements is obtained.

7. The method according to claim 3, characterized in that The first video is: a video stored in a real-time streaming video storage mode; and / or The second video is: a video stored in a historical stream video storage mode; and / or The third video is a video stored in a long-term video storage manner.

8. A video retrieval device, characterized in that: The device comprises: A request obtaining module, used to obtain a video retrieval request, wherein the video retrieval request carries: a retrieval condition and a retrieval level representing the detail of the retrieval result. The higher the retrieval level, the more detailed the retrieval result of the requested retrieval. The retrieval condition includes: a target monitoring point and a target time period; A first video retrieval module is used to retrieve surveillance videos that meet the retrieval condition from the first video with the highest retrieval priority according to a preset retrieval priority order when the retrieval level is non-primary, and if the first video does not contain a complete video of the target monitoring point in the target time period, determine a first missing time period of the missing video in the first video; The other video retrieval module is used to retrieve the surveillance video of the target monitoring point in the first missing time period from other videos with a retrieval priority lower than the first video, until a video retrieval result that meets the retrieval level requirement is obtained.

9. An electronic device, characterized in that: It includes a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other through the communication bus; Memory, used to store computer programs; A processor, for implementing the method steps described in any one of claims 1 to 7 when executing a program stored in a memory.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method steps described in any one of claims 1 to 7 are implemented.

Images