Video clip data pulling method based on barrier gate event, computer readable storage medium and computer equipment

Abstract

The invention relates to a video clip data pulling method based on a barrier gate event, a computer readable storage medium and computer equipment, and the method comprises the following steps: (S1) an event recognition step: recognizing the barrier gate event obtained by event monitoring and the corresponding time of the barrier gate event according to an event monitoring result; (S2) a demand forming step: forming a video clip pulling demand corresponding to the barrier gate event according to the barrier gate event and the corresponding time of the barrier gate event; and (S3) a video pulling step: communicating with an image acquisition device according to a video clip pulling demand corresponding to the barrier gate event, and acquiring a video clip corresponding to the video clip pulling demand from video data acquired by the image acquisition device. According to the method, the video clip corresponding to the event is pulled in real time according to the event identification result, so that basic data of the vehicle entering and exiting the barrier gate is complete, the video clip of the barrier gate event is pulled according to a customized demand, the data volume of video data transmission is reduced, the network bandwidth used for uploading and downloading is saved, and the user experience is improved. The video clip data pulling efficiency can be improved.

Description

Technical Field

[0001] The present application belongs to the technical field of barrier gate Internet of Things, and in particular, relates to a method for extracting video clip data based on barrier gate events, a computer-readable storage medium, and a computer device. Background Art

[0002] The barrier gate is a channel entrance and exit management device specially used for restricting the driving of motor vehicles on roads in regional places. It is widely used in regional places such as highway toll stations, parking lots, property communities, office buildings, etc. to manage the entry and exit of vehicles. At present, the existing barrier gates in the market have been networked to form a barrier gate management system. The barrier gate management system includes a server and various barrier gates distributed in various regional places. The server and the barrier gate communicate through a wired network or a wireless network.

[0003] At present, a serious problem in the barrier management system is that the online vehicle entry and exit data is not equal to the offline vehicle entry and exit data. Specifically, there is a deviation between the data of the opening and closing of the barrier in each area and the vehicle entry and exit of each area on the server of the barrier management system. The reason for this deviation may be that part of the barrier opening and closing action is generated offline, which cannot be recorded by the online barrier management system. It may also be that the data of vehicles entering the area and the data of vehicles leaving the area are not consistent, resulting in deviations, etc.

[0004] However, since the data of vehicle entry and exit controlled by the gate does not match the vehicle entry and exit data recorded in the server, the data of the server in the gate management system cannot truly and effectively reflect the vehicle entry and exit situation, resulting in management loopholes in the gate management system in the regional venue, causing various inconveniences and disputes in the current gate management system and regional venues. In order to solve these problems in the prior art, the present invention is hereby provided. Summary of the invention

[0005] The embodiments of the present application provide a method for extracting video clip data based on barrier gate events, a computer-readable storage medium, and a computer device. The solution can extract video clip data of various events at the barrier gate and retain them in the barrier gate management system, so as to improve the matching and data integrity of the data of vehicle entry and exit controlled by the barrier gate and the vehicle entry and exit data recorded in the server. It can also be used for post-processing when the information of vehicle entry and exit areas and places does not correspond, so as to facilitate the information management of vehicle entry and exit areas and places, so as to facilitate the development of functions related to vehicle entry and exit and the actual barrier gate management work.

[0006] In a first aspect, an embodiment of the present application provides a method for extracting video clip data based on a gate event, the method comprising the following steps:

[0007] (S1) an event identification step: according to the result of event monitoring, identifying the gate event obtained by the event monitoring and the corresponding time of the gate event;

[0008] (S2) demand forming step: forming a video clip pulling demand corresponding to the barrier gate event according to the barrier gate event and the corresponding time of the barrier gate event;

[0009] (S3) Video pulling step: according to the video segment pulling demand corresponding to the barrier event, communicate with the image acquisition device, and obtain the video segment corresponding to the video segment pulling demand from the video data collected by the image acquisition device.

[0010] In some possible embodiments, the barrier event is selected from the group consisting of barrier opening limit, barrier closing limit, barrier gate pole opening, barrier gate pole closing, barrier gate pole hovering, barrier gate pole function abnormality, barrier gate pole function abnormality recovery, barrier anti-smashing ground sensing coil function abnormality, barrier trigger ground sensing coil function abnormality, barrier display screen function abnormality, anti-smashing ground sensing vehicle detector function abnormality, remote control function abnormality, barrier anti-smashing ground sensing coil function abnormality recovery, barrier trigger ground sensing coil function abnormality recovery, barrier display screen function abnormality recovery, anti-smashing ground sensing vehicle detector function abnormality recovery, remote control function abnormality recovery, image acquisition device shooting start, image acquisition device performing portrait recognition, image acquisition device performing vehicle recognition, image acquisition device shooting end;

[0011] Preferably, the method further includes an event monitoring step (S0) of a barrier gate event object before the event identification step (S1): by setting an event listener to monitor changes in execution instructions of each barrier gate execution component, when the execution instruction of the barrier gate execution component changes, the event listener is triggered to perform event monitoring; the barrier gate execution component is selected from a trigger ground sensing coil, an anti-smashing ground sensing coil, a gate machine for controlling a gate rod, a trigger ground sensing vehicle detector, an anti-smashing ground sensing vehicle detector, a display screen, and a remote control.

[0012] In some possible embodiments, when the server sends an execution instruction of the barrier execution component to the barrier, the event monitoring step of the barrier event object of the method (S0) includes the event listener triggering event monitoring according to the execution instruction of the barrier execution component sent by the server;

[0013] Preferably, when the server sends an execution instruction of the barrier gate execution component to the barrier gate, the following steps are further performed before the event monitoring step of the barrier gate event object in the method (S0):

[0014] (P1) Vehicle license plate recognition step: recognizing the vehicle license plate information based on the video data or image data of the vehicle entering or exiting the gate;

[0015] (P2) Vehicle parking fee processing step: performing vehicle parking fee processing according to information of vehicle entering and / or exiting the gate;

[0016] (P3) Step of forming an execution instruction of the barrier gate execution component: Based on the vehicle license plate information and the vehicle parking fee processing information, the server forms an execution instruction of the barrier gate execution component and sends it to the barrier gate execution component.

[0017] In the vehicle parking fee processing step (P2), the user may be prompted whether the vehicle parking fee payment has been completed or has not been completed.

[0018] In some possible embodiments, when the server monitors an event by setting an event listener to monitor a data processing unit, the data processing unit is directly electrically connected to the barrier gate or connected via a local area network to obtain an execution instruction of a barrier gate execution component; the event monitoring step of the barrier gate event object of the method (S0) includes the following steps:

[0019] (S01) Event trigger application step: when the data processing unit captures the execution instruction change of the gate execution component, it sends an event monitoring trigger application to the server;

[0020] (S02) Event monitoring step: The server receives an event monitoring trigger application, and performs event monitoring on the execution instruction changes of the gate execution component captured by the data processing unit.

[0021] In some possible embodiments, the demand forming step of the method (S2) includes the following steps:

[0022] (S21) an event accumulation step: arranging the gate events identified by monitoring within a preset time period in cascade order according to the corresponding time of the gate events into a gate event pair, merging the gate events of the same type that are arranged continuously in the gate event pair, and recording the first time and the last time of the merged gate event;

[0023] (S22) Customizing demand step: According to the type of barrier gate event, the corresponding time of the barrier gate event and the estimated user preset time interval, a video clip pulling demand corresponding to the barrier gate event is formed.

[0024] In some possible embodiments, the video pulling step of the method (S3) includes the following steps:

[0025] (S31) Video positioning step: according to the video segment pulling demand corresponding to the gate event, communicating with the image acquisition device, acquiring and positioning the video data corresponding to the video segment pulling demand;

[0026] (S32) Video cropping step: according to the video segment extraction requirement corresponding to the barrier gate event, converting the video data into a unified format, and cropping the video data into video segments corresponding to the video segment extraction requirement;

[0027] (S33) Video transmission step: converting the barrier event, the time corresponding to the barrier event and the corresponding video clip into network data for transmission.

[0028] In a second aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the above-mentioned method for pulling video clip data are implemented.

[0029] In a third aspect, an embodiment of the present application provides a computer program product, which includes a computer program. When the computer program is executed by a processor, the steps of the above-mentioned video clip data pulling method are implemented.

[0030] In a fourth aspect, an embodiment of the present application provides a computer device, including:

[0031] one or more processors;

[0032] memory; and one or more computer programs, the processor and the memory are connected via a bus, wherein the one or more computer programs are stored in the memory and are configured to be executed by the one or more processors, characterized in that the processor implements the steps of the above-mentioned video clip data pulling method when executing the computer program.

[0033] In a fifth aspect, an embodiment of the present application provides a system, including a gate and a server connected to the gate via a network,

[0034] The barrier gate is provided with a plurality of barrier gate actuators, and the barrier gate actuators are selected from one or more of a trigger ground sensing coil, an anti-smashing ground sensing coil, a gate machine for controlling a gate rod, a trigger ground sensing vehicle detector, an anti-smashing ground sensing vehicle detector, a display screen, and a remote controller;

[0035] The server is used to implement the steps of the above-mentioned video clip data pulling method according to the change of the execution instruction of the gate execution component.

[0036] In some possible embodiments, the system further includes a data processing unit, wherein the data processing unit communicates with the server via a wired network or a wireless network, and is used to send information about changes in the gate execution instruction to the server. The connection between the data processing unit and the gate can be a wired network or a wireless network connection within a local area network; more preferably, the connection between the data processing unit and the gate is an electrical connection, which can directly monitor the changes in the execution instruction signal of the gate execution component.

[0037] In some possible embodiments, the server sends an execution instruction of the barrier gate execution component to the barrier gate, wherein the data processing unit communicates with the server via a wired network or a wireless network, and is used to forward the execution instruction of the barrier gate execution component sent by the server to the barrier gate to the barrier gate for execution. More preferably, the connection between the data processing unit and the barrier gate is an electrical connection, and the execution instruction of the barrier gate execution component sent by the server to the barrier gate can be directly forwarded to the barrier gate execution mechanism for execution. In this way, the event monitoring step of the barrier gate event object of the method (S0) includes the event listener triggering event monitoring according to the execution instruction of the barrier gate execution component sent by the server.

[0038] In some possible embodiments, the server sends an execution instruction of the barrier gate execution component to the barrier gate, wherein the server and the barrier gate communicate with the server via a wired network or a wireless network, and the server directly sends the execution instruction of the barrier gate execution component to the barrier gate, and the barrier gate controls the barrier gate execution mechanism to execute. In this way, the event monitoring step of the barrier gate event object of the method (S0) can also directly include the event listener triggering event monitoring according to the execution instruction of the barrier gate execution component sent by the server.

[0039] In some possible embodiments, the gate and the data processing unit are arranged in the same local area network, and communicate with each gate through a network signal transmission device. In some possible embodiments, several gates are electrically connected to one data processing unit respectively.

[0040] In some possible embodiments, the barrier gate is divided into an entrance barrier gate and an exit barrier gate.

[0041] In some possible embodiments, the barrier gate includes an image acquisition device, a trigger ground sensing coil, an anti-smashing ground sensing coil, a gate rod, a ground sensing vehicle detector, a display device, a gate machine for controlling the gate rod to be raised and lowered, and a barrier gate control board for controlling each execution component to work. The data processing unit is electrically connected to the barrier gate control board, and is used to receive the execution instruction issued by the server, and forward the execution instruction of the barrier gate execution component issued by the server to the barrier gate to the barrier gate for execution. More preferably, the data processing unit and the image acquisition device are respectively arranged in a local area network and connected through a network, and the image acquisition device is electrically connected to the barrier gate control board, and the data processing unit receives the execution instruction issued by the server, and forwards the execution instruction of the barrier gate execution component issued by the server to the barrier gate to the image acquisition device, and the image acquisition device controls the barrier gate control board for execution.

[0042] In some possible embodiments, the data processing unit is integrated with the barrier gate control panel and is configured to receive execution instructions issued by the server, forward the execution instructions of the barrier gate execution component issued by the server to the barrier gate to the barrier gate for execution; and upload the changes in the execution instructions of the barrier gate execution component to the server.

[0043] In some possible embodiments, the image acquisition device and the data processing unit communicate with the server through a wired network or a wireless network respectively; the data processing unit is used to receive the execution instructions issued by the server, and forward the execution instructions of the barrier execution component issued by the server to the barrier to the barrier for execution.

[0044] In some possible embodiments, the image acquisition device, the barrier gate control board, and the data processing unit communicate with the server through a wired network or a wireless network respectively; the data processing unit is used to receive the execution instructions issued by the server, and forward the execution instructions of the barrier gate execution component issued by the server to the barrier gate to the barrier gate control board for execution.

[0045] The present application provides a method for extracting video clip data based on barrier gate events, which extracts video clips corresponding to events in real time through the results of event recognition, so that the basic data of vehicles entering and exiting the barrier gate is complete, and the server crashes caused by excessive bandwidth occupation are avoided, and the data loss caused by offline control of the opening and closing of the barrier gate is avoided. It is convenient for the settlement of vehicle parking fees and the resolution of disputes over abnormal events, and provides a unified solution for different barrier gate manufacturers. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] In order to more clearly illustrate the technical solution of the embodiments of the present application, the following is a brief introduction to the drawings required for use in the embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0047] Figure 1 A schematic diagram of the system architecture of a barrier gate management system in the prior art (one barrier gate is shown, and other barrier gates are omitted);

[0048] Figure 2 It is a structural schematic diagram of a barrier gate in the prior art (showing two barrier gates);

[0049] Figure 3 A schematic diagram of the layout of the area managed by the gate management system provided in the embodiment of the present application;

[0050] Figure 4 A flowchart of a method for extracting video clip data based on a barrier gate event provided in a specific embodiment of the present application;

[0051] Figure 5 A flowchart of the steps of a method for extracting video clip data based on a barrier gate event provided in another specific embodiment of the present application;

[0052] Figure 6 A flowchart of a method for extracting video clip data based on a barrier gate event provided in another specific embodiment of the present application;

[0053] Figure 7 A flowchart of the specific steps of a method for extracting video clip data based on a gate event provided in yet another specific embodiment of the present application;

[0054] Figure 8 A specific flow chart of the demand formation step in the method for extracting video clip data based on a gate event provided in a specific embodiment of the present application;

[0055] Fig. 9 A specific flow chart of the video pulling step in the method for pulling video clip data based on a barrier gate event provided in a specific embodiment of the present application;

[0056] Fig.10 A schematic diagram of the architecture of a gate management system provided for a specific embodiment of the present application.

[0057] Fig.11 A schematic diagram of a computer-readable storage medium provided for a specific embodiment of the present application;

[0058] Fig.12 A functional block diagram of a computer device provided for a specific embodiment of the present application.

[0059] Fig.13 Another schematic diagram of the architecture of a gate management system provided for a specific embodiment of the present application. DETAILED DESCRIPTION

[0060] The features and exemplary embodiments of various aspects of the present application will be described in detail below. In order to make the purpose, technical solutions and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are only intended to explain the present application, rather than to limit the present application. For those skilled in the art, the present application can be implemented without the need for some of these specific details. The following description of the embodiments is only to provide a better understanding of the present application by illustrating the examples of the present application.

[0061] It should be understood that in the description of the specification and claims of this application, if there are terms such as "first", "second", etc., they are only used to distinguish the objects described, and do not have any order or technical meaning. Therefore, the objects defined as "first", "second", etc. may explicitly or implicitly include one or more of the objects. In addition, "one" or "a" and similar words do not indicate a quantitative limitation, but indicate the existence of at least one, and "multiple" means no less than two.

[0062] Some areas such as residential areas, office buildings, administrative buildings, gate management systems Figure 1 As shown, it includes multiple gates for controlling the entrance and exit of roads in the area (one gate is shown in the figure), a gate remote control (not shown), a client, and a server. The gate is connected to the server network through a router; the gate and the client (personal computer) are set in the same local area network, and the client host in the local area network can communicate with the external network through the router, such as the server communication on the World Wide Web, to obtain the vehicle entry and exit data of the gate. Multiple network interconnected gates are set in the local area network, and the client is used as a computer device for monitoring the operation of the gate in the local area network. The gate is connected to the Internet through a router and communicates with the server in the Internet. In this system, the gate remote control can communicate directly with the gate to control the opening and closing of the gate. When the gate remote control directly controls the gate rod to open and close, the server does not participate in the opening and closing of the gate. Therefore, the vehicle entry and exit data in the server and the vehicle entry and exit data in the area will have data asymmetry.

[0063] like Figure 2As shown, it is a schematic diagram of the overall structure of the barrier. The barrier 1 includes an image acquisition device 7, a trigger ground sensor coil 4, an anti-smashing ground sensor coil 6, a gate rod 5, a ground sensor vehicle detector, a display device, a gate machine 8 for controlling the gate rod 5 to be raised and lowered, and a barrier control board 3 for controlling each actuator to work, etc. The barrier can be connected to the network through an image acquisition device 7 or a barrier control board 3 (if the image acquisition device 7 is used to connect to the network, the image acquisition device is provided with a network interface; if the barrier control board 3 is used to connect to the network, the barrier control board 3 is provided with a network interface). For a specific example, the image acquisition device can be a camera, and the image acquisition device is connected to the network communication conversion device through an RJ45 network interface, so as to connect the barrier to the local area network. Of course, there are other ways to connect the barrier to the local area network. Figure 2 The arrow direction indicates the vehicle's travel direction.

[0064] like Figure 3 The figure is a schematic diagram of the layout of the regional places managed by the barrier management system provided in the embodiment of the present application. In some preferred embodiments of the present invention, according to the setting of the regional scene, according to the distinction between controlling vehicles to enter the regional place or vehicles to leave the regional place, the barrier can be divided into an entrance barrier and an exit barrier. Figure 3 As shown, area A can be the vehicle entrance and exit of the area, and the gate can be set in area A. The entrance gate includes an entrance image acquisition device (such as a license plate recognition device or a portrait recognition device), an entrance trigger ground sensing coil, an entrance anti-smashing ground sensing coil, an entrance trigger ground sensing vehicle detector, an entrance anti-smashing ground sensing vehicle detector, an entrance gate (where the lifting motor and spring are vulnerable parts), an entrance display screen (display device), an entrance gate rod, and an entrance control board that controls each execution component to work; wherein the entrance image acquisition device is connected to the local area network through the network interface RJ45; the exit gate includes an exit image acquisition device (recognition device), an exit trigger ground sensing coil, an exit anti-smashing ground sensing coil, an exit trigger ground sensing vehicle detector, an exit anti-smashing ground sensing vehicle detector, an exit gate (where the lifting motor and spring can control the gate rod lifting), an exit display screen (display device), an exit gate rod, and an exit control board that controls each execution component to work; wherein the exit image acquisition device is connected to the local area network through the network interface RJ45.

[0065] Figure 3 The regional scene 10 in the embodiment is a parking lot application scene, but is not limited to parking lot application scenes, and can also be an application scene of a residential area, an office building, or an administrative building. Figure 3For the parking lot application scenario shown, several parking spaces 11 are provided in the parking lot to facilitate users to park. A barrier is provided at the entrance and exit of the parking lot in the parking lot application scenario, and a speed bump is also provided at the entrance and exit of the barrier, so that vehicles 2 entering and leaving the parking lot can be effectively managed. In the prior art, due to offline management, the barrier remote controller communicates one-way with the barrier control panel that controls the opening of the barrier, and the barrier remote controller controls the execution of commands such as the opening, closing, and stopping of the barrier lever of the barrier. The vehicle entry and exit area scene can also be realized through the direct switch stop command of the barrier remote controller. The server is not involved in the control of vehicle entry and exit. In this way, the process of vehicle entry and exit is not authorized by the server, and the vehicle entry and exit information is not synchronized with the server. Therefore, the local offline vehicle entry and exit records and the online vehicle entry and exit records are inconsistent, the problem of incomplete data is prominent, and the related fee settlement problems and so on are caused.

[0066] With the widespread application of image acquisition equipment in barrier management systems, the present invention solves the problem of incomplete vehicle entry and exit data or vehicle entry data not corresponding to vehicle exit data in the prior art by using video clips bound to barrier events. Figure 4 As shown, a specific embodiment of the present invention provides a method for extracting video clip data based on a gate event, and the method comprises the following steps:

[0067] (S1) an event identification step: according to the result of event monitoring, identifying the gate event obtained by the event monitoring and the corresponding time of the gate event;

[0068] (S2) demand forming step: forming a video clip pulling demand corresponding to the barrier gate event according to the barrier gate event and the corresponding time of the barrier gate event;

[0069] (S3) Video pulling step: according to the video segment pulling demand corresponding to the barrier event, communicate with the image acquisition device, and obtain the video segment corresponding to the video segment pulling demand from the video data collected by the image acquisition device.

[0070] By pulling video clip data bound to barrier gate events, the video clips consistent with the barrier gate events are intercepted, stored, pulled, and pushed, which can monitor the entry and exit of vehicles in real time, including event notifications of vehicle entry and exit, accurately record and process various event information, and ensure that the barrier gate management system can respond to events in a timely and accurate manner. This solves many challenges faced by users in the existing technology when dealing with events related to surveillance videos, such as delayed event response and inconvenient video viewing.

[0071] In a specific implementation manner of the present invention, these barrier gate events are not only barrier gate events related to vehicle entry and exit, such as barrier gate opening limit, barrier gate closing limit, barrier gate rod opening, barrier gate rod closing, and barrier gate rod hovering, but may also include barrier gate events unrelated to vehicle entry and exit, such as barrier gate rod function abnormality, barrier gate rod function abnormality recovery, barrier gate anti-smashing ground sensing coil function abnormality, barrier gate triggering ground sensing coil function abnormality, barrier gate display screen function abnormality, anti-smashing ground sensing vehicle detector function abnormality, remote control function abnormality, barrier gate anti-smashing ground sensing coil function abnormality recovery, barrier gate triggering ground sensing coil function abnormality recovery, barrier gate display screen function abnormality recovery, anti-smashing ground sensing vehicle detector function abnormality recovery, remote control function abnormality recovery, image acquisition device shooting start, image acquisition device portrait recognition, image acquisition device vehicle recognition, image acquisition device shooting end, and fee payment completion. The monitoring of these abnormal events and their recovery facilitates the barrier management system to trace the abnormalities of the barrier's executive components. Through the capture and storage of video clips, it is easy to obtain users related to abnormal events and abnormal event recovery, related barrier executive components, causes of abnormal events, and abnormal recovery conditions for monitoring. This has a closed-loop tracking effect on the maintenance of the barrier, and provides reliable data support for subsequent video streaming, capture, storage, and streaming operations. The barrier opening limit and barrier closing limit are the barrier limit switches of the barrier. When the barrier is found to be opened to a certain height or angle, it will automatically stop opening or closing the barrier, and send the barrier opening limit and barrier closing limit signals.

[0072] like Figure 5 As shown, an overall flow chart of a method for extracting video clip data based on a barrier gate event is provided. In a specific embodiment of the present invention, the method further includes an event monitoring step (S0) of a barrier gate event object before the event identification step (S1): by setting an event listener to monitor changes in the execution instructions of each barrier gate execution component, when the execution instructions of the barrier gate execution component change, the event listener is triggered to perform event monitoring; the barrier gate execution component is selected from a trigger ground sensing coil, an anti-smashing ground sensing coil, a gate rod, a trigger ground sensing vehicle detector, an anti-smashing ground sensing vehicle detector, a display screen, and a remote control. The present invention preferably continuously monitors the event notification interface through a RESTful API (POST method). The interface follows a specific communication protocol (such as HTTP / HTTPS) to ensure the security and stability of data transmission. Through the event monitoring step, the method of the present invention can quickly capture barrier gate events related to and unrelated to vehicle entry and exit, and can incorporate a wide range of barrier gate events into the barrier gate management system to avoid subsequent loopholes in the barrier gate management system and deviations in execution logic due to data mismatch and non-correspondence.

[0073] In a specific implementation of the present invention, the technical solution of the present invention can be applied to the scenario where the execution instruction of the barrier gate execution component is intervened by the server. When the server sends the execution instruction of the barrier gate execution component to the barrier gate, the event monitoring step of the barrier gate event object of the method (S0) includes the event listener triggering event monitoring according to the execution instruction of the barrier gate execution component sent by the server. In this scenario, the event monitoring step can directly monitor the execution instruction of the barrier gate execution component sent by the server, and according to the changes in the execution instruction of the barrier gate execution component, the corresponding video clip of the barrier gate event is pulled from the image acquisition device. Since the server participates in the control process of vehicle entry and exit in the regional venue, this part of the vehicle entry and exit data is complete, and the pulled video clip can be retained for backup.

[0074] In a specific implementation of the present invention, when the server participates in the control process of vehicle entry and exit in a regional venue, the technical solution of the present invention can be integrated with the gate management system, such as license plate recognition, vehicle entry and exit fee calculation, etc. In a typical application scenario, Figure 6 As shown, when the server sends an execution instruction of the barrier execution component to the barrier, the following steps are performed before the event monitoring step of the barrier event object in the method (S0):

[0075] (P1) Vehicle license plate recognition step: recognizing the vehicle license plate information based on the video data or image data of the vehicle entering or exiting the gate;

[0076] (P2) Vehicle parking fee processing step: obtaining the vehicle parking fee according to the information of the vehicle entering and exiting the gate, and prompting the user that the vehicle parking fee payment has been completed or the payment has not been completed;

[0077] (P3) Step of forming an execution instruction of the barrier gate execution component: Based on the vehicle license plate information and the vehicle parking fee processing information, the server forms an execution instruction of the barrier gate execution component and sends it to the barrier gate execution component.

[0078] When the server sends an execution instruction of the barrier execution component to the barrier, the event monitoring step of the barrier event object in the method (S0) includes the event listener triggering event monitoring in the step of forming the execution instruction of the barrier execution component (P3); or the event listener triggering event monitoring in the step of processing the vehicle parking fee (P2); or the event listener triggering event monitoring in the step of recognizing the vehicle license plate (P1). Based on the monitoring triggered by these event processes, the barrier event can be more completely and effectively tracked, so as to pull the video clip data based on the barrier event, and pull the video clip corresponding to the barrier event from the image acquisition device.

[0079] In this way, the barrier event can be organically integrated with license plate recognition and vehicle parking fees. According to the information of license plate recognition, vehicle parking fees, barrier events (bar opening, bar closing, bar suspension), the time corresponding to the barrier event, etc., the correspondence and data integrity with the vehicle entry and exit data can be ensured, avoiding the problems such as missing data in the vehicle entry and exit information, inconsistency between the entry data and the exit data, and the inability to calculate the vehicle parking fee. These barrier events can contain necessary information, such as event type, event timestamp, and possible additional Info (other additional information: vehicle license plate, parking time, parking fee, barrier event location, corresponding execution component of the barrier event), etc. According to the event type and additional information, the events are classified or marked, such as distinguishing between emergency events and non-emergency events, safety-related events and equipment failure events, etc., to provide a basis for the system's automatic processing and priority scheduling.

[0080] When some servers are not involved in the control process of vehicles entering and exiting the regional venue, such as the offline control of vehicles entering and exiting the regional venue. In the specific implementation of the present invention, some localized processing methods can be used to monitor events. The typical solution of the present invention is, for example, Figure 7 As shown, when the server monitors the event by setting an event listener to monitor the data processing unit, the data processing unit is directly electrically connected to the gate or connected through a local area network to obtain the execution instruction of the gate execution component; the event monitoring step of the gate event object of the method (S0) includes the following steps:

[0081] (S01) Event trigger application step: when the data processing unit captures the execution instruction change of the gate execution component, it sends an event monitoring trigger application to the server;

[0082] (S02) Event monitoring step: The server receives an event monitoring trigger application, and performs event monitoring on the execution instruction changes of the gate execution component captured by the data processing unit.

[0083] The event monitoring step of the barrier event object of the present invention can be divided into two types according to the different events generated: one is initiated by the local barrier execution component; the other is triggered by the execution instruction of the barrier execution component issued by the server. According to the event notification information transmitted by the event monitoring step, key data is extracted from the barrier event record, including the event timestamp and the relevant image acquisition device identification (such as camera ID, IP address, etc.), so as to determine the target camera that needs to pull the video stream. The technical solution of the present invention can associate the barrier event with the camera in a variety of ways, such as through the event location information, the device information involved, etc., to ensure that the video source related to the event is accurately found, so as to pull the video clip from the video source. The image acquisition device can be a network camera, an IP camera, a license plate recognition device in the barrier management system, a portrait recognition device or a camera, etc. It cooperates with the server to complete the pulling of the video clip. The server can include a network video recorder (NVR), which records, stores and forwards the video.

[0084] In a specific embodiment of the present invention, Figure 8 As shown, the method (S2) demand forming step includes the following steps:

[0085] (S21) an event accumulation step: arranging the gate events identified by monitoring within a preset time period in cascade order according to the corresponding time of the gate events into a gate event pair, merging the gate events of the same type that are arranged continuously in the gate event pair, and recording the first time and the last time of the merged gate event;

[0086] (S22) Customizing demand step: According to the type of barrier gate event, the corresponding time of the barrier gate event and the estimated user preset time interval, a video clip pulling demand corresponding to the barrier gate event is formed.

[0087] In a specific embodiment of the present invention, Fig. 9 As shown, the video pulling step of the method (S3) includes the following steps:

[0088] (S31) Video positioning step: according to the video segment pulling demand corresponding to the gate event, communicating with the image acquisition device, acquiring and positioning the video data corresponding to the video segment pulling demand;

[0089] (S32) Video cropping step: according to the video segment extraction requirement corresponding to the barrier gate event, converting the video data into a unified format, and cropping the video data into video segments corresponding to the video segment extraction requirement;

[0090] (S33) Video transmission step: converting the barrier event, the time corresponding to the barrier event and the corresponding video clip into network data for transmission.

[0091] The technical solution of the present invention can reduce the amount of data transmitted by video data, save the network bandwidth used for uploading and downloading, and improve the efficiency of video segment data pulling by customizing the demand for cutting redundant and repeated video segments of barrier gate events. In the video pulling step (S3) of the present invention, according to the demand for pulling video segments corresponding to the barrier gate event, the image acquisition device is communicated to obtain the video segments corresponding to the video segment pulling demand from the video data collected by the image acquisition device. The video data pulled by the present invention can be the overall video stream positioning, and then the video segments are intercepted, and then pulled.

[0092] According to the event timestamp and the preset capture time length (such as 10 seconds before and after the event timestamp), the starting and ending points of the video clip to be captured are accurately determined in the located video stream. The time code information or key frame time markers in the video stream are used to achieve accurate time positioning to ensure that the captured video content covers the key moments of the event.

[0093] The technical solution of the present invention uses video processing technology and algorithms to extract video clips within a specified time range from a continuous video stream. During the interception process, the integrity of the video clips is ensured, including the video encoding format, audio data (if any), etc., which can be correctly retained. The boundary conditions of the video clips are handled properly, such as the problem that the starting point and the end point may not be on the key frame, and the intercepted video clips can be played normally through appropriate video encoding processing methods (such as inserting key frames, padding data, etc.). While intercepting the video clips, the metadata of the video clips is extracted and recorded, such as the video format (H.264, H.265, etc.), resolution, frame rate, audio parameters (if any), interception time range and other information, for subsequent video storage and task processing operations.

[0094] The technical solution of the present invention takes the network camera on the gate as an example of an image acquisition device. For each target camera, the information required to establish a connection is collected, including the camera's IP address, port number, communication protocol (such as RTSP), and possible authentication information (user name and password). This information can be obtained from the camera configuration data pre-stored in the database, or through interaction with the tenant's own business cloud system or the camera itself. According to the protocols and features supported by the camera, the corresponding connection parameters and request header information are prepared to ensure that a communication connection can be established smoothly with the camera.

[0095] After the video clip is pulled, the server can store the video clip data in the specified storage medium. Each stored video clip is assigned a unique identifier (such as UUID) and an association relationship is established with event information (such as event ID, timestamp, event type, etc.). At the same time, the metadata of the video clip (including video format, resolution, frame rate, duration, capture time range, etc.) is stored in the database for subsequent query and management.

[0096] The technical solution of the present invention can be applied to Figure 1 In the barrier management system of the prior art shown in the figure, multiple barriers are in the same local area network, and the server and the client in the local area network can monitor and control the vehicle entry and exit of the barrier according to the unique network address of each barrier. In some preferred embodiments of the present invention, the technical solution of the present invention can be applied to Fig.10 In the barrier gate management system shown, the barrier gate management system is provided with a data processing unit, and the data processing unit may be an RTU device connected to the local area network. The RTU device and multiple barrier gates are in the same local area network, and the RTU device can communicate with each barrier gate to obtain the execution instruction changes of the barrier gate execution component. In some possible embodiments, several barrier gates are electrically connected to one of the data processing units respectively. The data processing unit is used to receive the execution instructions issued by the server, forward the execution instructions of the barrier gate execution component issued by the server to the barrier gate to the barrier gate for execution, and upload the execution instruction changes of the barrier gate execution component to the server. In some possible embodiments, the data processing unit is integrated with the barrier gate control board, so that the network interface of the barrier gate control board can be shared. In some possible embodiments, the data processing unit is a separate RTU device, which shares the same local area network with the barrier gate, such as Fig.10 shown.

[0097] In some possible embodiments, the image acquisition device and the data processing unit communicate with the server through a wired network or a wireless network respectively; the data processing unit is used to receive the execution instruction issued by the server, and forward the execution instruction of the barrier execution component issued by the server to the barrier to the barrier for execution. The server establishes a connection with the image acquisition device and communicates with the image acquisition device to obtain the video stream of the image acquisition device. According to different network architecture forms, the video clip data extraction method based on barrier event of the present invention can be applied to these barrier management systems to realize the extraction of video clip data bound to barrier event, thereby realizing data matching and data integrity of vehicle entry and exit data, facilitating information management of vehicle entry and exit areas, and facilitating the development of functions related to vehicle entry and exit and actual barrier management work.

[0098] Reference Fig.11 , Fig.11It is a schematic diagram of the framework of the computer-readable storage medium of the specific implementation of the present application. The computer-readable storage medium 1 of the embodiment of the present application stores computer program instructions, and the program instructions implement the method provided by the present application when they are executed. Among them, the computer program instructions can form a program file and be stored in the above-mentioned computer-readable storage medium in the form of a software product, so that a computer device (which can be a personal computer, a server, or a network device, etc.) executes all or part of the steps of the methods of each implementation of the present application. The aforementioned computer-readable storage medium 1 includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, RandomAccess Memory), a disk or an optical disk, or a terminal device such as a computer, a server, a mobile phone, and a tablet. More specifically, the computer-readable storage medium in the embodiment of the present invention stores a computer program product, and the computer program product includes a computer program, and the computer program is executed by a processor to implement the steps of the above-mentioned method for pulling video clip data based on a gate event.

[0099] In addition, each functional unit in each embodiment of the present invention may be integrated into a processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.

[0100] More specifically, Fig.12 It is shown that an embodiment of the present invention provides a computer device 2, which can be used for pulling and intercepting video clips. The device includes: one or more processors; a memory; and one or more computer programs, wherein the processor and the memory are connected via a bus, wherein the one or more computer programs are stored in the memory and are configured to be executed by the one or more processors, and the processor implements the steps of the above-mentioned method for pulling video clip data based on gate events when executing the computer program. The computer device described in this embodiment can be a server, a client, a personal computer, a network device and other devices. Furthermore, the computer device described in this embodiment can be a server-client network composed of a server and a client.

[0101] The processor may also be referred to as a processor (Central Processing Unit). The processor may be an integrated circuit chip with signal processing capabilities. The processor may also be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, a discrete gate or transistor logic device, a discrete hardware component. A general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0102] The processor can adopt a general central processing unit (CPU), a general processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. The above-mentioned memory can store an operating system and other application programs. When the technical solution provided by the embodiment of the present application is implemented by software or firmware, the program code for implementing the technical solution provided by the embodiment of the present application is stored in the memory and executed by the processor. In one embodiment, the processor may include a memory inside. In another embodiment, the processor and the memory are two independent structures.

[0103] like Fig.13 As shown, an embodiment of the present invention provides a specific implementation of a barrier gate management system, including a barrier gate and a server connected to the barrier gate through a network, wherein the barrier gate is provided with a plurality of barrier gate execution components, and the barrier gate execution components are selected from one or more of a trigger ground sensing coil, an anti-smashing ground sensing coil, a gate rod, a trigger ground sensing vehicle detector, an anti-smashing ground sensing vehicle detector, a display screen, and a remote controller; the server is used to implement the above-mentioned video clip data pulling when the execution instruction of the barrier gate execution component changes. The barrier gate includes an image acquisition device, a trigger ground sensing coil, an anti-smashing ground sensing coil, a gate rod, a ground sensing vehicle detector, a display device, a gate machine for controlling the gate rod to be raised and lowered, and a barrier gate control panel for controlling each execution component to work. When the execution instruction of the execution component of the barrier gate changes, a barrier gate event is generated.

[0104] The data processing unit includes a processor and a memory, the processor and the memory are coupled, the memory stores a program, and when the program instructions stored in the memory are executed by the processor, the steps of the video clip data pulling method based on the barrier event of the present application are implemented.

[0105] More specifically, the processor may be a general component (eg, a central processing unit (CPU), a graphics processing unit (GPU), an application processor (AP), a sensor, a communication module, etc.), and the like.

[0106] Such an electronic device may be included in various types of electronic devices such as a personal computer (PC), a server device, a mobile device, and an embedded device.

[0107] The memory may be a DRAM, etc. The memory may include at least one of a volatile memory or a non-volatile memory. Non-volatile memories include ROM, programmable ROM (PROM), erasable PROM (EPROM), electrically erasable PROM (EEPROM), flash memory, phase change random access memory (PRAM), magnetoresistive RAM (MRAM), resistive RAM (RRAM), ferroelectric RAM (FRAM), etc. Volatile memories include DRAM, SRAM, SDRAM, PRAM, MRAM, RRAM, FeRAM, etc. In one embodiment, the memory may include at least one of a HDD, SSD, CF, SD, micro SD, mini SD, xD, and a memory stick.

[0108] The device can analyze input data in real time to extract valid information, based on the extracted information. For example, the device can be applied to robot devices (such as drones and advanced driver assistance systems (ADAS)), smart TVs, smart phones, medical devices, mobile devices, image display devices, measuring devices, and IoT devices, etc. In addition, the device can be installed on at least one of various other types of electronic devices. The device may include a processor, RAM, memory, various sensors including image acquisition devices, and communication modules. It may also include an input / output module, a security module, a power control device, etc. The processor can control the overall operation of the electronic device. The processor may include a processor core (single core) or multiple processor cores (multi-core). The processor may process or execute programs and / or data stored in the memory. The processor may be implemented as a CPU, a GPU, an AP, etc.

[0109] RAM can temporarily store programs, data or instructions. For example, programs and / or data stored in the memory can be temporarily stored in RAM according to the control or boot code of the processor. RAM can be implemented as dynamic RAM (DRAM), static RAM (SRAM), etc.

[0110] The information signal may include one of various types of recognition signals such as a voice recognition signal, an object recognition signal, an image recognition signal, and a biometric information recognition signal. The memory is a storage location for storing data, and may store an operating system (OS), various programs, and various data.

[0111] The sensor may collect peripheral information of the electronic device on which the electronic device is mounted. The sensor may sense or receive a signal (e.g., a video signal, an audio signal, a magnetic signal, a bio-signal, a touch signal, etc.) from the outside of the electronic device and convert the sensed or received signal into data. For example, the sensor may include at least one of various types of sensing devices (such as a microphone, an imaging device, an image sensor, a light detection and ranging (LIDAR) sensor, an ultrasonic sensor, an infrared sensor, a biosensor, and a touch sensor).

[0112] The communication module may be provided with various wired or wireless interfaces capable of communicating with an external device. For example, the communication module may include a communication interface capable of accessing a wired local area network (LAN), a wireless local area network (WLAN) (such as wireless fidelity (Wi-Fi)), a wireless personal area network (WPAN) (such as Bluetooth), a wireless universal serial bus (wireless USB), Zigbee, near field communication (NFC), radio frequency identification (RFID), power line communication (PLC) or a mobile cellular network (such as third generation (3G), fourth generation (4G) and long term evolution (LTE)).

[0113] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0114] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0115] When software is used for implementation, the method steps described in the above embodiments can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website site, a computer, a server, or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server, or data center. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or a data center that includes one or more available media integrations. The available medium may be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk Solid State Disk (SSD)), etc.

[0116] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

Claims

1. A method for extracting video clip data based on a gate event, characterized in that: The method comprises the following steps: (S1) an event identification step: according to the result of event monitoring, identifying the gate event obtained by the event monitoring and the corresponding time of the gate event; (S2) demand forming step: forming a video clip pulling demand corresponding to the barrier gate event according to the barrier gate event and the corresponding time of the barrier gate event; (S3) Video pulling step: according to the video segment pulling demand corresponding to the barrier event, communicate with the image acquisition device, and obtain the video segment corresponding to the video segment pulling demand from the video data collected by the image acquisition device.

2. The video segment data extraction method according to claim 1, characterized in that: The barrier event is selected from the group consisting of barrier opening limit, barrier closing limit, barrier pole opening, barrier pole closing, barrier pole hovering, barrier pole function abnormality, barrier pole function abnormality recovery, barrier anti-smashing ground sensing coil function abnormality, barrier trigger ground sensing coil function abnormality, barrier display screen function abnormality, anti-smashing ground sensing vehicle detector function abnormality, remote control function abnormality, barrier anti-smashing ground sensing coil function abnormality recovery, barrier trigger ground sensing coil function abnormality recovery, barrier display screen function abnormality recovery, anti-smashing ground sensing vehicle detector function abnormality recovery, remote control function abnormality recovery, image acquisition device shooting start, image acquisition device performing portrait recognition, image acquisition device performing vehicle recognition, image acquisition device shooting end, fee payment completion; Preferably, the method further includes an event monitoring step (S0) of a barrier gate event object before the event identification step (S1): by setting an event listener to monitor changes in execution instructions of each barrier gate execution component, when the execution instruction of the barrier gate execution component changes, the event listener is triggered to perform event monitoring; the barrier gate execution component is selected from a trigger ground sensing coil, an anti-smashing ground sensing coil, a gate machine for controlling a gate rod, a trigger ground sensing vehicle detector, an anti-smashing ground sensing vehicle detector, a display screen, and a remote control.

3. The video clip data extraction method according to claim 2, characterized in that: When the server sends an execution instruction of the barrier execution component to the barrier, the event monitoring step of the barrier event object of the method (S0) includes the event monitor triggering event monitoring according to the execution instruction of the barrier execution component sent by the server; Preferably, when the server sends an execution instruction of the barrier gate execution component to the barrier gate, the following steps are further performed before the event monitoring step of the barrier gate event object in the method (S0): (P1) Vehicle license plate recognition step: recognizing the vehicle license plate information based on the video data or image data of the vehicle entering or exiting the gate; (P2) Vehicle parking fee processing step: performing vehicle parking fee processing according to information of vehicle entering and / or exiting the gate; (P3) Step of forming an execution instruction of the barrier gate execution component: Based on the vehicle license plate information and the vehicle parking fee processing information, the server forms an execution instruction of the barrier gate execution component and sends it to the barrier gate execution component.

4. The video segment data extraction method according to claim 2, characterized in that: When the server monitors events by setting an event listener to monitor the data processing unit, the data processing unit is directly electrically connected to the barrier gate or connected via a local area network to obtain execution instructions of the barrier gate execution component; the event monitoring step of the barrier gate event object of the method (S0) includes the following steps: (S01) Event trigger application step: when the data processing unit captures the execution instruction change of the gate execution component, it sends an event monitoring trigger application to the server; (S02) Event monitoring step: The server receives an event monitoring trigger application, and performs event monitoring on the execution instruction changes of the gate execution component captured by the data processing unit.

5. The video segment data extraction method according to claim 1, characterized in that: The method (S2) comprises the following steps: (S21) an event accumulation step: arranging the gate events identified by monitoring within a preset time period in cascade order according to the corresponding time of the gate events into a gate event pair, merging the gate events of the same type that are arranged continuously in the gate event pair, and recording the first time and the last time of the merged gate event; (S22) Customizing demand step: According to the type of barrier gate event, the corresponding time of the barrier gate event and the estimated user preset time interval, a video clip pulling demand corresponding to the barrier gate event is formed.

6. The video segment data extraction method according to claim 1, characterized in that: The video pulling step of the method (S3) comprises the following steps: (S31) Video positioning step: according to the video segment pulling demand corresponding to the gate event, communicating with the image acquisition device, acquiring and positioning the video data corresponding to the video segment pulling demand; (S32) Video cropping step: according to the video segment extraction requirement corresponding to the barrier gate event, converting the video data into a unified format, and cropping the video data into video segments corresponding to the video segment extraction requirement; (S33) Video transmission step: converting the barrier event, the time corresponding to the barrier event and the corresponding video clip into network data for transmission.

7. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the video clip data pulling method according to any one of claims 1 to 6 are implemented.

8. A computer program product, comprising a computer program, characterized in that: When the computer program is executed by a processor, the steps of the video clip data pulling method according to any one of claims 1 to 6 are implemented.

9. A computer device comprising: one or more processors; Memory; and one or more computer programs, the processor and the memory are connected via a bus, wherein the one or more computer programs are stored in the memory and are configured to be executed by the one or more processors, characterized in that the processor implements the steps of the video clip data pulling method described in any one of claims 1 to 6 when executing the computer program.

10. A system comprising a gate and a server connected to the gate via a network, The barrier gate is provided with a plurality of barrier gate actuators, and the barrier gate actuators are selected from one or more of a trigger ground sensing coil, an anti-smashing ground sensing coil, a gate machine for controlling a gate rod, a trigger ground sensing vehicle detector, an anti-smashing ground sensing vehicle detector, a display screen, and a remote controller; The server is used to implement the steps of the video clip data pulling method described in any one of claims 1 to 6 when the execution instructions of the gate execution component change.

Images