Security integration platform security check machine historical video and image cooperative control method

Abstract

The application provides a security integrated platform security check machine historical video and image cooperative control method, comprising the following steps: querying video segmentation time information list according to a query time range to obtain a target video segmentation time information list; dividing the query time range according to the target video segmentation time information list to determine an effective video time period and an ineffective video time period; querying a security check X-ray image library according to the query time range to obtain a target security check X-ray image list; playing a security check video corresponding to the query time range; in response to the effective video time period, performing security check X-ray image caching and displaying according to a video stream time and the target security check X-ray image list; and in response to the ineffective video time period, starting an auxiliary timer and performing security check X-ray image caching and displaying according to a timer time and the target security check X-ray image list. The application reduces picture pulling and system response time and jitter caused by a large number of alignments, and improves system response speed.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of security inspection, in particular, relates to a security inspection machine historical video and image cooperative control method of security integrated platform. BACKGROUND

[0002] The rail transit security integrated platform contains a security inspection and detection system, when the historical bag image of the security inspection machine is checked, the camera before and after the security inspection machine needs to check the relevant personnel and their behavior.

[0003] CN106934326B gives a method, system and device for security inspection, which collects the bag information and the security inspection personnel information before the bag enters the security inspection machine and / or after the bag leaves the security inspection machine; obtains the bag scanning image of the bag when the bag enters the security inspection machine for scanning; associates the bag information, the bag scanning image and the security inspection personnel information in the storage system. The security inspection personnel can retrieve other associated information according to the face or bag attribute.

[0004] However, for the retrieval situation of unknown face attribute or bag attribute, the above technical solution cannot be used for query, and only the bag scanning image and monitoring video in the retrieval time period can be played frame by frame; the historical query of the bag scanning image and monitoring video is based on the scanning image time to obtain the historical video for display, which has the problem of video pulling, resulting in that the historical video cannot be played synchronously, cannot be well coordinated and controlled, and it is difficult to achieve good control effect.

[0005] How to implement the cooperative backtracking display of the security inspection image and the security inspection video of the security inspection machine is a main problem to be solved.

[0006] In order to solve the above problems, people have been seeking an ideal technical solution. SUMMARY

[0007] The present application aims at the deficiencies of the prior art, and provides a security inspection machine historical video and image cooperative control method of security integrated platform, which realizes the selection of the image related to the security inspection machine historical video quickly through the optimized query algorithm, realizes the cache of a certain number of images through the optimized cache technology, reduces the image pulling process, improves the system response speed, and meets the quick synchronous display of the security inspection machine historical video and image.

[0008] In order to achieve the above purpose, the technical scheme adopted by the present application is as follows: a security inspection machine historical video and image cooperative control method of security integrated platform, comprising the following steps:

[0009] According to the query time range, a video segment time information list is queried to obtain a target video segment time information list; and according to the target video segment time information list, the query time range is divided to determine an effective video time period and an ineffective video time period;

[0010] The construction of the video segment time information list comprises: when storing the security inspection video collected at the entrance and exit of the security inspection machine into a security inspection video library, obtaining security inspection effective video according to a target detection algorithm, and establishing a video segment time information list based on the time range of the security inspection effective video;

[0011] According to the query time range, a security inspection X-ray image library is queried to return an ordered list of image names whose image times are within the query time range, i.e., a target security inspection X-ray image list; wherein when storing the collected security inspection X-ray image into a security inspection X-ray image library, the security inspection X-ray image is named and sorted according to the image time;

[0012] The security inspection video corresponding to the query time range is played, and in response to the effective video time period, the security inspection X-ray image is cached and displayed according to the video stream time and the target security inspection X-ray image list; and in response to the ineffective video time period, an auxiliary timer is started and the security inspection X-ray image is cached and displayed according to the timer time and the target security inspection X-ray image list.

[0013] In one embodiment, the caching and displaying of the security inspection X-ray image according to the video stream time and the target security inspection X-ray image list comprises:

[0014] According to the video stream time and the target security inspection X-ray image list, it is checked whether the cached image of the image cache area meets the first preset caching requirement; if the first preset caching requirement is not met, the security inspection X-ray image is obtained from the security inspection X-ray image library according to the first caching acquisition strategy and cached to the image cache area until the cached image of the image cache area meets the first preset caching requirement;

[0015] If the first preset caching requirement is met, the target security inspection X-ray image list is searched to determine whether there is an image name named by the video stream time;

[0016] If there is an image name named by the video stream time, it is further searched whether there is a cached image named by the video stream time in the image cache area; in response to the cached image named by the video stream time, the cached image is taken out for display; and in response to the absence of the cached image named by the video stream time, a picture request command is sent to the security inspection X-ray image library, and after receiving the returned picture data packet, the picture is spliced and displayed;

[0017] If there is no image name named by the video stream time, it is returned to continue searching the target security inspection X-ray image list to determine whether there is an image name named by the following video stream time.

[0018] In one embodiment, the first preset cache requirement is that a time range of cached images meets a first preset time range or a number of cached images meets a first preset number; the first cache acquisition strategy is to determine a number of to-be-cached security X-ray images according to the first preset cache requirement and cached images of an image cache area, find a target security X-ray image list in combination with an image name of a last cached image of the image cache area, and acquire a to-be-cached security X-ray image list; and based on the to-be-cached security X-ray image list, corresponding security X-ray images are acquired from a security X-ray image library in a timely and orderly manner according to a first preset time interval.

[0019] In one embodiment, starting the auxiliary timer and caching and displaying the security X-ray images with the timer time and the target security X-ray image list comprises:

[0020] Starting the auxiliary timer and time stepping at a preset stepping interval, and taking a sum of the timer time and a start time of the invalid video time period as an auxiliary playing time;

[0021] According to the auxiliary playing time and the target security X-ray image list, checking whether cached images of the image cache area meet a second preset cache requirement; if the cached images do not meet the second preset cache requirement, acquiring security X-ray images from the security X-ray image library according to a second cache acquisition strategy and caching the security X-ray images to the image cache area until the cached images of the image cache area meet the second preset cache requirement; and if the cached images meet the second preset cache requirement, searching the security X-ray image list to determine whether there is an image name named with the auxiliary playing time;

[0022] If there is the image name named with the auxiliary playing time, further searching the image cache area to determine whether there is a cached image named with the auxiliary playing time; in response to the cached image named with the auxiliary playing time, taking out the cached image for display; and in response to no cached image named with the auxiliary playing time, sending a picture request command to the security X-ray image library, and after receiving a returned picture data packet, performing picture splicing and display;

[0023] If there is the image name named with the auxiliary playing time, further searching the image cache area to determine whether there is a cached image named with the auxiliary playing time; in response to the cached image named with the auxiliary playing time, taking out the cached image for display; and in response to no cached image named with the auxiliary playing time, sending a picture request command to the security X-ray image library, and after receiving a returned picture data packet, performing picture splicing and display;

[0024] If there is no image name named with the auxiliary playing time, returning to continue searching the target security X-ray image list to determine whether there is an image name named with a next auxiliary playing time.

[0025] In one embodiment, the second preset cache requirement is that a time range of cached images meets a second preset time range or a number of cached images meets a second preset number;

[0026] The second cache acquisition strategy is to determine the number of security X-ray images to be cached according to the second preset cache requirement and the cached images of the image cache area, find a target security X-ray image list in combination with the image name of the last cached image of the image cache area, and acquire a security X-ray image list to be cached; and based on the security X-ray image list to be cached, corresponding security X-ray images are acquired from the security X-ray image library in a timely and orderly manner according to a second preset time interval.

[0027] The second aspect of the present application provides a security and protection integrated platform security check machine historical video and image cooperative control device, comprising:

[0028] A video segment time information list construction module: when storing the security check video collected at the entrance and exit of the security check machine to the security check video library, the security check effective video is acquired according to the target detection algorithm, and the video segment time information list is established based on the time range of the security check effective video;

[0029] A target video segment time information list acquisition module is configured to query the video segment time information list according to a query time range, and obtain a target video segment time information list;

[0030] A time classification module is configured to divide the query time range according to the target video segment time information list, and determine an effective video time period and an ineffective video time period;

[0031] A target security X-ray image list acquisition module is configured to query the security X-ray image library according to the query time range, and return an ordered list of image names whose image times are located in the query time range, i.e., a target security X-ray image list; wherein when storing the collected security X-ray images to the security X-ray image library, the security X-ray images are named and sorted according to the image time;

[0032] A video playing module is configured to play the security check video corresponding to the query time range;

[0033] An image backtracking display module is configured to, according to the playing time, in response to the effective video time period, cache and display the security X-ray images according to the video stream time and the target security X-ray image list; and in response to the ineffective video time period, start an auxiliary timer and cache and display the security X-ray images according to the timer time and the target security X-ray image list.

[0034] The third aspect of the present application provides a security check system, comprising a security check machine, a camera, a live display device, a security check video library, a security X-ray image library and a cooperative backtracking display device,

[0035] The security inspection machine is used for scanning the row package entering the security inspection machine to generate a security inspection X-ray image and storing the security inspection X-ray image into the security inspection X-ray image library.

[0036] The camera is arranged at the entrance side and the exit side of the security inspection machine, and is used for collecting security inspection videos before and after the row package enters and leaves the security inspection machine and storing the security inspection videos into a security inspection video library.

[0037] The on-site display device is arranged beside the security inspection machine, and is used for displaying the security inspection videos shot by the camera and the security inspection X-ray images shot by the security inspection machine in real time; obtaining security inspection effective videos according to a target detection algorithm; and establishing a video effective time segment list based on a time range of the security inspection effective videos.

[0038] The cooperative backtracking display device is used for obtaining a query time range and playing the security inspection videos and the security inspection X-ray images in the query time range.

[0039] Compared with the prior art, the present application has prominent substantial features and significant progress, specifically,

[0040] The present application adopts a control mode completely different from the technical scheme of aligning the security inspection X-ray images with the monitoring videos, quickly realizes the selection of the security inspection X-ray images related to the security inspection machine historical videos based on the target video segment time information list and the target security inspection X-ray image list, reduces the system pulling operation and the jitter due to a large number of alignments through the optimization of the cache technology, improves the system response speed, and meets the fast synchronous control of the security inspection machine historical videos and images.

[0041] Further, the effective video time segment and the invalid video time segment of the query time range are determined based on the target video segment time information list; different time segments adopt different query and cache technologies, and the image pulling can also be made more suitable for the characteristics that a large number of security inspection X-ray images are located in the effective video time segment and a small number of security inspection X-ray images are located in the invalid video time segment, the frequency of the security inspection X-ray image pulling in the effective video time segment is ensured, the frequency of the security inspection X-ray image pulling in the invalid video time segment is reduced, the system pulling time is further reduced, and the system response speed is improved. BRIEF DESCRIPTION OF DRAWINGS

[0042] Figure 1 is a flowchart of embodiment 1 of the present application.

[0043] Figure 2 is a flowchart of the cache and display of the security inspection X-ray images in the effective video time segment.

[0044] Figure 3is a flowchart of the process of the application for buffering and displaying the invalid video time period security X-ray image.

[0045] Figure 4 is a security image and security video cooperative backtracking display interface of the security inspection machine according to embodiment 2 of the application. DETAILED DESCRIPTION

[0046] The technical solutions of the application will be further described in detail through specific embodiments.

[0047] Embodiment 1

[0048] The embodiment provides a security and protection integrated platform security inspection machine historical video and image cooperative control method, as shown in Figure 1 The method comprises the following steps:

[0049] According to the query time range, the video segmentation time information list is queried to obtain the target video segmentation time information list; according to the target video segmentation time information list, the query time range is divided to determine the effective video time period and the invalid video time period;

[0050] The construction steps of the video segmentation time information list comprise: when the security inspection video collected at the entrance and exit of the security inspection machine is stored in the security inspection video library, the security inspection effective video is obtained according to the target detection algorithm, and the video segmentation time information list is established based on the time range of the security inspection effective video;

[0051] According to the query time range, the security X-ray image library is queried to return an ordered list of image names whose image times are located in the query time range, that is, the target security X-ray image list; wherein when the collected security X-ray image is stored in the security X-ray image library, the security X-ray image is named and sorted according to the image time;

[0052] The security video corresponding to the query time range is played, in response to the effective video time period, the security X-ray image is buffered and displayed according to the video stream time and the target security X-ray image list; in response to the invalid video time period, the auxiliary timer is started and the security X-ray image is buffered and displayed according to the timer time and the target security X-ray image list.

[0053] It can be understood that the application adopts a completely different control method from the conventional technical solution of aligning the security X-ray image with the monitoring video, and by pulling the security X-ray image in the process of playing the security video, the security inspection machine historical video and image fast synchronous control is met.

[0054] Specifically, based on the target video segment time information list and the target security X-ray image list, the selection of the security X-ray image related to the security machine historical video can be quickly realized, the system pulling operation and the jitter due to a large number of alignments are reduced through the optimization of the cache technology, and the system response speed is improved.

[0055] In one embodiment, as shown in Figure 2 The cache and display of the security X-ray image according to the video stream time and the target security X-ray image list comprises the following steps.

[0056] According to the video stream time and the target security X-ray image list, it is checked whether the cached image of the image cache area meets the first preset cache requirement; if the first preset cache requirement is not met, the security X-ray image is acquired from the security X-ray image library according to the first cache acquisition strategy and is cached to the image cache area until the cached image of the image cache area meets the first preset cache requirement.

[0057] If the first preset cache requirement is met, the target security X-ray image list is searched to determine whether there is an image name named by the video stream time.

[0058] If there is an image name named by the video stream time, it is further searched whether there is a cached image named by the video stream time in the image cache area; in response to the cached image named by the video stream time, the cached image is taken out and displayed; in response to the absence of the cached image named by the video stream time, a picture request command is sent to the security X-ray image library, and after the returned picture data packet is received, the picture is spliced and displayed.

[0059] If there is no image name named by the video stream time, it is returned to continue searching the target security X-ray image list to determine whether there is an image name named by the following video stream time.

[0060] Preferably, the first preset cache requirement is that the time range of the cached image meets the first preset time range or the number of the cached image meets the first preset number. As long as the cached image meets any one of the above conditions, it is determined that the cached image meets the preset cache requirement.

[0061] For example, the preset time range is set to 5 minutes, and the preset number is set to 10; when the number of the cached image in the current image cache area is 10 or the time interval of the cached image is 5 minutes, it is determined that the cached image meets the preset cache requirement.

[0062] Further, the preset number of image cache or the preset time range of image cache is realized through the optimization of the cache technology, the image pulling process is reduced, the system response speed is improved, and the fast synchronization control of the security machine historical video and image is further met.

[0063] In one embodiment, the first cache acquisition strategy is to determine the number of security X-ray images to be cached according to the first preset cache requirement and the cached images in the image cache area, find the target security X-ray image list in combination with the image name of the last cached image in the image cache area, and acquire the security X-ray image list to be cached; based on the security X-ray image list to be cached, corresponding security X-ray images are acquired from the security X-ray image library in a timely and orderly manner according to a first preset time interval.

[0064] Still taking the preset cache requirement as an example, the preset time range is set to 5 minutes, and the preset number is 10, if the number of cached images in the current image cache area is 5, the image name of the last cached image is 22:58, and the image name of the last cached image is 23:00, it is determined that the number of security X-ray images to be cached is 5.

[0065] In combination with the image name 23:00 of the last cached image in the image cache area, the target security X-ray image list is found, if there are 15 image names in the target security X-ray image list within 5 minutes after the video stream time, and 15 is greater than the preset number 10, 5 security X-ray images after the image name 23:00 are acquired, and the security X-ray image list to be cached is constructed according to the image names of the 5 security X-ray images.

[0066] If there are 8 image names in the target security X-ray image list within 5 minutes after the video stream time, and 8 is less than the preset number 10, 3 security X-ray images after the image name 23:00 are acquired, and the security X-ray image list to be cached is constructed according to the image names of the 3 security X-ray images.

[0067] After acquiring the security X-ray image list to be cached, corresponding security X-ray images are acquired from the security X-ray image library in a timely and orderly manner according to a first preset step interval based on the security X-ray image list to be cached.

[0068] In one embodiment, as shown in Figure 3 the starting of the auxiliary timer and the cache and display of the security X-ray images in combination with the timer time and the target security X-ray image list include:

[0069] The auxiliary timer is started and time stepping is performed according to a preset step interval, and the sum of the timer time and the invalid video time period start time is taken as the auxiliary play time;

[0070] According to the auxiliary playing time and the target security X-ray image list, it is checked whether the cached image of the image cache area meets the second preset cache requirement; if the second preset cache requirement is not met, the security X-ray image is acquired from the security X-ray image library according to the second cache acquisition strategy and cached to the image cache area until the cached image of the image cache area meets the second preset cache requirement; if the second preset cache requirement is met, the security X-ray image list is searched to determine whether there is an image name named by the auxiliary playing time;

[0071] If there is an image name named by the auxiliary playing time, it is further searched whether there is a cached image named by the auxiliary playing time in the image cache area, and the cached image is taken out for display in response to the cached image named by the auxiliary playing time; in response to no cached image named by the auxiliary playing time, a picture request command is sent to the security X-ray image library, and picture splicing and display are performed after receiving the returned picture data packet;

[0072] If there is an image name named by the auxiliary playing time, it is further searched whether there is a cached image named by the auxiliary playing time in the image cache area, and the cached image is taken out for display in response to the cached image named by the auxiliary playing time; in response to no cached image named by the auxiliary playing time, a picture request command is sent to the security X-ray image library, and picture splicing and display are performed after receiving the returned picture data packet;

[0073] If there is no image name named by the auxiliary playing time, it is returned to continue searching the target security X-ray image list to determine whether there is an image name named by the auxiliary playing time.

[0074] It can be understood that no matter whether it is an invalid video time period or a valid video time period, a corresponding cache technology is set to cache the security X-ray image in advance, so as to reduce the real-time pulling step when the image is displayed and improve the system response speed.

[0075] Specifically, the second preset cache requirement is that the time range of the cached image meets a second preset time range or the number of the cached image meets a second preset number; the second cache acquisition strategy is to determine the number of the security X-ray image to be cached according to the second preset cache requirement and the cached image of the image cache area, find the target security X-ray image list in combination with the image name of the last cached image of the image cache area, acquire the security X-ray image list to be cached, and acquire the corresponding security X-ray image from the security X-ray image library in a second preset time interval and in order.

[0076] It can be understood that the second preset time range or the second preset number in the second preset cache requirement is different from the first preset time range or the first preset number in the first preset cache requirement, for example, the first preset number is greater than the second preset number; or the first preset time range is less than the second preset time.

[0077] It can be understood that the first preset time interval and the second preset time interval can be the same or different, preferably, the first preset time interval and the second preset time interval are different, and the second preset time interval is greater than the playing time interval, so that the image cache speed of the effective video time period is greater than the image cache speed and frequency of the invalid video time period, so that the image pulling is more in line with the characteristics that security X-ray image security mainly concentrates on the effective video time period, while ensuring the frequency of security X-ray image pulling in the effective video time period, the frequency of security X-ray image pulling in the invalid video time period is reduced, thereby reducing the system pulling time and improving the system response speed.

[0078] In specific implementation, when the playing time is located at the boundary point of the effective video time period and the invalid video time period, the retrieval display mode is switched to the retrieval display mode corresponding to the video time period after the boundary point. For example, the effective video time period before the boundary point and the invalid video time period after the boundary point, the timing control mode is preferred, that is, the auxiliary timer is started and the cache and display of the security X-ray image are performed according to the timer time. For another example, the invalid video time period before the boundary point and the effective video time period after the boundary point, the video stream time control mode is preferred, that is, the auxiliary timer is closed and the cache and display of the security X-ray image are performed according to the video stream time.

[0079] Further, the entrance and exit of the security inspection machine are provided with cameras at present, so as to collect security inspection videos before and after the luggage enters and leaves the security inspection machine; therefore, it can be understood that each security X-ray image should be associated with the security inspection videos before and after the luggage enters and leaves the security inspection machine.

[0080] Therefore, the security inspection videos collected at the entrance and exit of the security inspection machine are stored in the security inspection video library, the security effective videos are obtained according to the target detection algorithm, and the specific steps of establishing the video segmentation time information list based on the time range of the security effective videos are as follows:

[0081] The first security inspection video collected at the entrance of the security inspection machine is stored in the security inspection video library, and the time range of the security effective video in the first security inspection video is obtained according to the target detection algorithm;

[0082] The second security inspection video collected at the exit of the security inspection machine is stored in the security inspection video library, and the time range of the security effective video in the second security inspection video is determined according to the target detection algorithm;

[0083] Perform an OR operation on the time range of the first and second valid security check videos to obtain the valid video time range; the time range between any two valid video time ranges is the invalid video time range.

[0084] Create a list of video segment time information based on the valid and invalid video time ranges.

[0085] Example 2

[0086] The difference between this embodiment and Embodiment 1 is that: Figure 4 As shown, on the playback timeline, valid video time periods are assigned a first color, invalid video time periods are assigned a second color, and a playback cursor is set on the playback timeline to point to the playback time. Preferably, the first color is a prominent color such as green, and the second color is a background color such as gray; the playback cursor has a third color different from the first and second colors, and further, the playback cursor also has an indicator shape that protrudes from the playback timeline, such as a triangle.

[0087] It's understandable that assigning different colors to different video segments helps managers quickly skip invalid video segments and view security X-ray images.

[0088] According to the above technical solution, in one embodiment, during the playback of security inspection videos corresponding to the query time range, it is determined whether there is a dragging operation of the playback cursor; when there is a dragging operation of the playback cursor, the image cache in the image buffer is cleared, and it is determined whether the playback time indicated by the playback cursor after dragging is within a valid video time period or an invalid video time period. If it is within a valid video time period, the security inspection X-ray images are cached and displayed according to the video stream time and the target security inspection X-ray image list; if it is within an invalid video time period, an auxiliary timer is started and the security inspection X-ray images are cached and displayed according to the timer time and the target security inspection X-ray image list.

[0089] It's understandable that after the dragging operation is complete, the cached images can be checked based on the playback time indicated by the cursor after the drag. Cached images that do not meet the preset caching conditions can be deleted, while those that do meet the conditions can be reordered, and the remaining cached images can be retrieved and controlled. This reduces the number of cached images and the time spent caching, minimizing duplicate caching.

[0090] When there is no dragging of the playback cursor, the video is cached and displayed according to the video time period in which the playback cursor is located. Specifically, in response to a valid video time period, the security X-ray images are cached and displayed according to the video stream time and the target security X-ray image list. In response to an invalid video time period, an auxiliary timer is started and the security X-ray images are cached and displayed according to the timer time and the target security X-ray image list.

[0091] It can be understood that since there can be multiple security check machines in an actual station, in actual use, a device and time selection area can be set, and selection of a security check machine is performed by clicking the name of the security check machine in the device and time selection area; after the security check machine is selected, selection of a time range can be further performed, and the longest time range is 24 hours.

[0092] It can be understood that a play control area can also be set for play control, specifically, the play control area sets play / pause and stop buttons, and the whole play is controlled by clicking the play / pause and stop buttons and dragging the play cursor.

[0093] Embodiment 3

[0094] The embodiment provides a security integration platform security check machine historical video and image cooperative control device, and specifically comprises:

[0095] A video segment time information list construction module: when security check videos at entrances and exits of the security check machine are stored in a security check video library, security check effective videos are obtained according to a target detection algorithm, and a video segment time information list is established based on a time range of the security check effective videos;

[0096] A target security check X-ray image list acquisition module is configured to query the security check X-ray image library according to the query time range, and return an ordered list of image names whose image times are within the query time range, that is, the target security check X-ray image list; wherein when the collected security check X-ray images are stored in the security check X-ray image library, the security check X-ray images are named and sorted according to the image times;

[0097] A time classification module is configured to divide the query time range according to the target video segment time information list, and determine an effective video time period and an ineffective video time period;

[0098] A target security check X-ray image list acquisition module is configured to query the security check X-ray image library according to the query time range, and return an ordered list of image names whose image times are within the query time range, that is, the target security check X-ray image list; wherein when the collected security check X-ray images are stored in the security check X-ray image library, the security check X-ray images are named and sorted according to the image times;

[0099] A video play module is configured to play the security check video corresponding to the query time range;

[0100] An image backtracking display module is configured to, according to a play time, in response to the effective video time period, cache and display the security check X-ray images according to a video stream time and the target security check X-ray image list; and in response to the ineffective video time period, start an auxiliary timer and cache and display the security check X-ray images according to a timer time and the target security check X-ray image list

[0101] In a specific implementation, the cooperative backtracking display device and the on-site display device can be the same display device or different display devices; further, when the backtracking display device and the on-site display device are different display devices, the backtracking display device can be disposed at a remote end and connected to the security X-ray image library and the security video library through a network.

[0102] In use, the query time range can be input through a keyboard or received through the network from other devices.

[0103] Embodiment 4

[0104] The embodiment also provides a security system, which includes a security inspection machine, a camera, an on-site display device, a security video library, a security X-ray image library and a cooperative backtracking display device,

[0105] The security inspection machine is configured to scan a line or a package entering the security inspection machine and generate a security X-ray image stored in the security X-ray image library.

[0106] The camera is disposed at an entrance side and an exit side of the security inspection machine and configured to collect security videos before the line or the package enters the security inspection machine and after the line or the package leaves the security inspection machine and store the security videos in the security video library.

[0107] The on-site display device is disposed beside the security inspection machine and configured to display the security videos collected by the camera and the security X-ray images collected by the security inspection machine in real time.

[0108] The security effective videos are acquired according to a target detection algorithm, and a video effective time segmentation list is established based on a time range of the security effective videos.

[0109] The cooperative backtracking display device is the security integrated platform cooperative control device for historical videos and images of the security inspection machine according to Embodiment 2 and is configured to play the security videos and the security X-ray images according to a query time range.

[0110] It should also be noted that the relational terms herein such as first and second and the like are used only to differentiate one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between or among the entities or operations. Moreover, the terms "comprises", "comprising", or any other variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but can include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element preceded by "comprises... a" does not, without more constraints, foreclose the existence of additional identical elements in the process, method, article, or apparatus that comprises the listed element.

[0111] It should be noted that the specific implementation and the equivalent replacement of part of the technical features can be modified or replaced; without departing from the spirit of the technical scheme of the present application, which should be covered in the technical scheme range of the present application.

Claims

1. A security integrated platform security check machine historical video and image cooperative control method, characterized in that, The method comprises the following steps: According to the query time range, the video segmentation time information list is queried to obtain the target video segmentation time information list; According to the target video segmentation time information list, the query time range is divided to determine the effective video time period and the invalid video time period; The construction of the video segmentation time information list comprises the following steps: when the security inspection video collected at the entrance and exit of the security inspection machine is stored in the security inspection video library, the security inspection effective video is obtained according to the target detection algorithm, and the video segmentation time information list is established based on the time range of the security inspection effective video; According to the query time range, the security inspection X-ray image library is queried to obtain the target security inspection X-ray image list; wherein when the collected security inspection X-ray image is stored in the security inspection X-ray image library, the security inspection X-ray image is named and sorted according to the image time; when the security inspection X-ray image library is queried according to the query time range, the image name with the image time located in the query time range is obtained, and an ordered list is established according to the time, that is, the target security inspection X-ray image list is obtained; The security inspection video corresponding to the query time range is played, in response to the effective video time period, the security inspection X-ray image is cached and displayed according to the video stream time and the target security inspection X-ray image list; in response to the invalid video time period, the auxiliary timer is started and the security inspection X-ray image is cached and displayed according to the timer time and the target security inspection X-ray image list.

2. The security integrated platform security check machine historical video and image cooperative control method according to claim 1, characterized in that, The caching and displaying of the security inspection X-ray image according to the video stream time and the target security inspection X-ray image list comprises: According to the video stream time and the target security inspection X-ray image list, it is checked whether the cached image of the image cache area meets the first preset caching requirement; if the first preset caching requirement is not met, the security inspection X-ray image is obtained from the security inspection X-ray image library according to the first caching acquisition strategy and cached to the image cache area until the cached image of the image cache area meets the first preset caching requirement; If the first preset caching requirement is met, the target security inspection X-ray image list is searched to determine whether there is an image name named by the video stream time; If there is an image name named by the video stream time, it is further searched whether there is a cached image named by the video stream time in the image cache area, in response to the cached image named by the video stream time, the cached image is taken out for display; in response to the cached image named by the video stream time, a picture request command is sent to the security inspection X-ray image library, and after receiving the returned picture data packet, the picture is spliced and displayed; If there is no image name named by the video stream time, it is returned to continue searching the target security inspection X-ray image list to determine whether there is an image name named by the video stream time.

3. The security integrated platform security check machine historical video and image cooperative control method according to claim 2, characterized in that: The first preset caching requirement is that the time range of the cached image meets the first preset time range or the number of the cached image meets the first preset number; The first cache acquisition strategy is to determine the number of security X-ray images to be cached according to the first preset cache requirement and the cached images of the image cache area, find the target security X-ray image list in combination with the image name of the last cached image of the image cache area, and acquire the security X-ray image list to be cached; and based on the security X-ray image list to be cached, corresponding security X-ray images are acquired from the security X-ray image library in a timely and orderly manner according to a first preset time interval.

4. The security integrated platform security check machine historical video and image cooperative control method according to claim 1, characterized in that, The starting of the auxiliary timer and the caching and display of the security X-ray images according to the timer time and the target security X-ray image list include: starting the auxiliary timer and performing time stepping according to a preset stepping interval, and taking the sum of the timer time and the invalid video time period start time as the auxiliary playing time; checking whether the cached images of the image cache area meet the second preset cache requirement according to the auxiliary playing time and the target security X-ray image list; if the second preset cache requirement is not met, acquiring security X-ray images from the security X-ray image library according to the second cache acquisition strategy and caching them to the image cache area until the cached images of the image cache area meet the second preset cache requirement; if the second preset cache requirement is met, searching the security X-ray image list to determine whether there is an image name named with the auxiliary playing time; if there is an image name named with the auxiliary playing time, further searching the image cache area to determine whether there is a cached image named with the auxiliary playing time, and in response to the cached image named with the auxiliary playing time, taking out the cached image for display; in response to the absence of the cached image named with the auxiliary playing time, sending a picture request command to the security X-ray image library, and after receiving the returned picture data packet, performing picture splicing and display; if there is an image name named with the auxiliary playing time, further searching the image cache area to determine whether there is a cached image named with the auxiliary playing time, and in response to the cached image named with the auxiliary playing time, taking out the cached image for display; in response to the absence of the cached image named with the auxiliary playing time, sending a picture request command to the security X-ray image library, and after receiving the returned picture data packet, performing picture splicing and display; if there is no image name named with the auxiliary playing time, returning to continue searching the target security X-ray image list to determine whether there is an image name named with the auxiliary playing time.

5. The security integrated platform security check machine historical video and image cooperative control method according to claim 4, characterized in that: The second preset cache requirement is that the time range of the cached images meets a second preset time range or the number of the cached images meets a second preset number; The second cache acquisition strategy is to determine the number of security X-ray images to be cached according to the second preset cache requirement and the cached images of the image cache area, find the target security X-ray image list in combination with the image name of the last cached image of the image cache area, and acquire the security X-ray image list to be cached; and based on the security X-ray image list to be cached, corresponding security X-ray images are acquired from the security X-ray image library in a timely and orderly manner according to a second preset time interval.

6. The security integrated platform security check machine historical video and image cooperative control method according to claim 1, characterized in that: On the playing time axis, the effective video time period is assigned a first color and the invalid video time period is assigned a second color, and a playing cursor is set on the playing time axis to point to the playing time.

7. The security check machine historical video and image cooperative control method of the security integration platform according to claim 6, characterized in that: during playing the security check video corresponding to the query time range, it is judged whether there is a dragging play cursor operation; when there is a dragging play cursor operation, the image cache in the image buffer is emptied, and it is judged whether the play time indicated by the dragging play cursor is located in the effective video time period or the ineffective video time period; if it is located in the effective video time period, the security check X-ray image is cached and displayed according to the video stream time and the target security check X-ray image list; if it is located in the ineffective video time period, the auxiliary timer is started and the security check X-ray image is cached and displayed according to the timer time and the target security check X-ray image list.

8. The security integrated platform security check machine historical video and image cooperative control method according to claim 1, characterized in that, The specific steps of storing the security check video collected at the entrance and exit of the security check machine to the security check video library, acquiring the security check effective video according to the target detection algorithm, and establishing the video segmentation time information list based on the time range of the security check effective video are as follows: The first security check video collected at the entrance of the security check machine is stored to the security check video library, and the time range of the security check effective video in the first security check video is acquired according to the target detection algorithm; The second security check video collected at the exit of the security check machine is stored to the security check video library, and the time range of the security check effective video in the second security check video is determined according to the target detection algorithm; The first security check effective video time range and the second security check effective video time range are subjected to an OR operation to obtain the effective video time range; the ineffective video time range is between any two effective video time ranges; The video segmentation time information list is established according to the effective video time range and the ineffective video time range.

9. A security integrated platform security check machine history video and image cooperative control device, characterized in that: It comprises: a video segmentation time information list construction module: when the security check video collected at the entrance and exit of the security check machine is stored to the security check video library, the security check effective video is acquired according to the target detection algorithm, and the video segmentation time information list is established based on the time range of the security check effective video; a target video segmentation time information list acquisition module, which is used to query the video segmentation time information list according to the query time range to obtain the target video segmentation time information list; a time classification module, which is used to divide the query time range according to the target video segmentation time information list to determine the effective video time period and the ineffective video time period; a target security check X-ray image list acquisition module, which is used to query the security check X-ray image library according to the query time range to return an ordered list of image names whose image times are located in the query time range, i.e., the target security check X-ray image list; wherein when the collected security check X-ray image is stored to the security check X-ray image library, the security check X-ray image is named and sorted according to the image time; a video playing module, which is used to play the security check video corresponding to the query time range; an image backtracking display module, which is used to respond to the effective video time period according to the video stream time and the target security check X-ray image list to cache and display the security check X-ray image; and respond to the ineffective video time period to start the auxiliary timer and cache and display the security check X-ray image according to the timer time and the target security check X-ray image list.

10. A security system characterized by: The security inspection machine, the camera, the on-site display device, the security inspection video library, the security inspection X-ray image library and the cooperative backtracking display device, The security inspection machine is used for scanning the row bag entering the security inspection machine to generate the security inspection X-ray image and store the security inspection X-ray image into the security inspection X-ray image library; The camera is arranged at the entrance side and the exit side of the security inspection machine and is used for collecting the security inspection video before the row bag enters the security inspection machine and after the row bag leaves the security inspection machine and storing the security inspection video into the security inspection video library; The on-site display device is arranged beside the security inspection machine and is used for displaying the security inspection video shot by the camera and the security inspection X-ray image shot by the security inspection machine in real time; According to the target detection algorithm, the security inspection effective video is acquired, and the video effective time segmentation list is established based on the time range of the security inspection effective video; The cooperative backtracking display device is the cooperative control device of the security inspection machine historical video and image of the security protection integrated platform of claim 9 and is used for playing the security inspection video and the security inspection X-ray image according to the query time range.

Images