Multi-mode security system

By analyzing the fixed picture information of the parking lot and the tree intrusion visual field characterization coefficient, the problem of inability to reasonably analyze and call monitoring resources in the existing technology is solved, efficient monitoring resource management and visual field coverage are achieved, reducing the impact of redundant data, and improving the impact of Work efficiency.

CN119094699APending Publication Date: 2024-12-06CHINESE PEOPLES LIBERATION ARMY UNIT 93204
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411089368.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-09
Publication Date
2024-12-06

AI Technical Summary

Technical Problem

The prior art cannot analyze the monitoring conditions of different areas of the scene based on the monitoring screen requirements of different areas of the application scenarios in combination with the factors affected by the field of view of different areas. It is impossible to call monitoring equipment resources predictably, making it difficult to detect local blind spots in the field of monitoring and generate a large number of them. Redundant data affects the efficient operation of the system.

Method used

By obtaining the fixed picture information set of the parking lot, analyzing and dividing it into multiple sub-regions, calculating the visual field representation coefficient of tree invasion. If the preset conditions are met, non-fixed picture information will be called to achieve monitoring of the target monitoring sub-regions and avoid monitoring field of view local blind spots and redundant data.

Benefits of technology

It realizes the analysis of monitoring screen requirements in different areas of the application scenario, selectively call monitoring equipment resources, timely discover and avoid local blind spots in the monitoring field of view, reduces energy consumption and improves work efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119094699A_ABST
    Figure CN119094699A_ABST
Patent Text Reader

Abstract

The security and protection system comprises the steps of obtaining a fixed picture information set of a parking lot; analyzing the fixed picture information set, and determining whether the current fixed picture is a target monitoring picture or not; dividing the parking lot area into a plurality of sub-areas, and determining whether the current sub-area is a target monitoring sub-area; calculating a tree invasion view representation coefficient based on the tree contour in the target monitoring sub-region, and if the tree invasion view representation coefficient meets a preset condition, calling non-fixed picture information corresponding to the current target monitoring sub-region; and completing monitoring of the current target monitoring sub-region based on the non-fixed picture information. In this way, monitoring conditions of different areas of the scene can be analyzed according to monitoring picture requirements of the different areas of the application scene in combination with view influence factors of the different areas, and monitoring equipment resources are selectively called for the different areas.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of the present application relate to the field of security monitoring, and in particular to multimodal security methods, devices, equipment, and computer-readable storage media. Background Art

[0002] The problem of vehicle parking is the focus of urban management. Safety accidents in parking lots and the disputes caused by them need to be recorded and warned in advance by a security monitoring system that can adapt to the scene requirements. However, large-scale security monitoring settings require the storage and analysis of a large amount of video data information. Current technical means use multimodal security monitoring technology to achieve technical complementarity of various solutions. The application scenarios of multimodal security systems that integrate radar monitoring technology, video monitoring technology and image information analysis technology are becoming more and more extensive. How to adaptably and reasonably use monitoring technology according to application scenarios is an issue that needs to be solved urgently.

[0003] For example, Chinese Patent Publication No.: CN114339168A, the invention discloses a regional security monitoring method, device, electronic device and storage medium, the method includes: dividing the monitored area into regions to obtain first and second monitoring areas, the first monitoring area is the shooting field of view coverage area of ​​the high-altitude monitoring device associated with it, and the second monitoring area is the shooting field of view blind spot of the high-altitude monitoring device; calling the high-altitude monitoring device to collect a first monitoring image of the first monitoring area to realize monitoring of the first monitoring area, wherein the first monitoring image carries first location information; calling the low-altitude mobile monitoring device to move according to a preset moving route to collect a second monitoring image of the second monitoring area to realize monitoring of the second monitoring area, wherein the second monitoring image carries second location information.

[0004] The prior art still has the following problems:

[0005] The existing technology cannot analyze the monitoring conditions of different areas of the scene according to the monitoring screen requirements of different areas of the application scenario in combination with the factors affecting the field of view of different areas, cannot predictively call monitoring equipment resources for different areas based on the analysis results, cannot timely discover and avoid local blind spots in the monitoring field of view, and cannot avoid the large amount of redundant data generated by real-time monitoring of application scenarios affecting the efficient operation of the system. Summary of the invention

[0006] According to the embodiments of the present application, a multimodal security solution is provided, which can overcome the problems of the prior art that it is impossible to analyze the monitoring conditions of different areas of the scene according to the monitoring screen requirements of different areas of the application scenario in combination with the factors affecting the field of view of different areas, and it is impossible to selectively call monitoring equipment resources for different areas based on the analysis results, thereby greatly improving work efficiency and reducing energy consumption.

[0007] In a first aspect of the present application, a multi-modal security method is provided, which comprises:

[0008] Get the fixed picture information set of the parking lot;

[0009] Analyze the fixed picture information set to determine whether the current fixed picture is a target monitoring picture;

[0010] Divide the parking lot area into a plurality of sub-areas, and determine whether the current sub-area is a target monitoring sub-area based on the number of target monitoring images in each sub-area;

[0011] Based on the tree outlines in the target monitoring sub-area, a tree intrusion visual field characterization coefficient is calculated, and if the tree intrusion visual field characterization coefficient meets a preset condition, non-fixed picture information corresponding to the current target monitoring sub-area is called;

[0012] Based on the non-fixed picture information, the monitoring of the current target monitoring sub-area is completed.

[0013] Further, the analyzing the fixed picture information set to determine whether the current fixed picture is a target monitoring picture includes:

[0014] Wherein, the fixed screen information set includes fixed screen information of multiple parking lots;

[0015] The fixed screen information in the fixed screen information set is analyzed respectively, and if the number of vehicles in the current fixed screen information is greater than a preset vehicle number threshold, the current fixed screen is determined to be a target monitoring screen.

[0016] Further, the determining whether the current sub-region is a target monitoring sub-region based on the number of target monitoring images in each sub-region includes:

[0017] If the number of target monitoring screens in the current sub-area is greater than a preset reference value, the current sub-area is determined to be the target monitoring sub-area.

[0018] Further, the calculating of the tree intrusion field representation coefficient based on the tree outline in the target monitoring sub-area includes:

[0019] Based on the tree outlines in the target monitoring sub-area, determining a maximum height value of the tree outline in a direction perpendicular to the ground and a maximum width value in the target monitoring sub-area;

[0020] Based on the maximum height value and the maximum width value, a tree invasion visual field characterization coefficient is calculated.

[0021] Furthermore, the calculating of the tree invasion field characterization coefficient based on the maximum height value and the maximum width value includes:

[0022] Based on the maximum height and maximum width values, the tree invasion field characterization coefficient can be calculated by the following formula:

[0023]

[0024] Wherein, E is the coefficient of tree invasion visual field characterization;

[0025] h is the maximum height value;

[0026] h0 is the preset maximum height reference value;

[0027] d is the maximum width value;

[0028] d0 is the preset maximum width reference value;

[0029] α is the tree silhouette height weight coefficient;

[0030] β is the weight coefficient of tree silhouette width;

[0031] e is a constant.

[0032] Furthermore, it also includes:

[0033] Based on the tree invasion visual field representation coefficients corresponding to several tree outlines in the fixed picture, the average value of the tree invasion visual field representation coefficients is calculated;

[0034] The average value of the tree intrusion visual field representation coefficient is used as the tree intrusion visual field representation coefficient of the fixed picture.

[0035] Furthermore, if the tree intrusion field representation coefficient meets a preset condition, calling the non-fixed picture information corresponding to the current target monitoring sub-area includes:

[0036] The tree intrusion field of view characterization coefficient is compared with a preset maximum tree intrusion field of view characterization coefficient threshold. If the tree intrusion field of view characterization coefficient is greater than the maximum tree intrusion field of view characterization coefficient threshold, the non-fixed picture information corresponding to the current target monitoring sub-area is called.

[0037] In a second aspect of the present application, a multi-modal security device is provided. The device comprises:

[0038] An acquisition module, used to acquire a fixed picture information set of a parking lot;

[0039] An analysis module, used for analyzing the fixed picture information set to determine whether the current fixed picture is a target monitoring picture;

[0040] A determination module, used to divide the parking lot area into a plurality of sub-areas, and determine whether the current sub-area is a target monitoring sub-area based on the number of target monitoring images in each sub-area;

[0041] A calculation module, for calculating a tree intrusion visual field characterization coefficient based on the tree outlines in the target monitoring sub-area, and if the tree intrusion visual field characterization coefficient meets a preset condition, calling non-fixed picture information corresponding to the current target monitoring sub-area;

[0042] The security module is used to monitor the current target monitoring sub-area based on the non-fixed picture information.

[0043] In a third aspect of the present application, an electronic device is provided, which includes a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the program, the method described above is implemented.

[0044] In a fourth aspect of the present application, a computer-readable storage medium is provided, on which a computer program is stored, and when the program is executed by a processor, the method according to the first aspect of the present application is implemented.

[0045] The multimodal security method provided in the embodiment of the present application obtains a fixed screen information set of the parking lot; analyzes the fixed screen information set to determine whether the current fixed screen is a target monitoring screen; divides the parking lot area into multiple sub-areas, and determines whether the current sub-area is a target monitoring sub-area based on the number of target monitoring screens in each sub-area; calculates a tree intrusion field of view characterization coefficient based on the tree outlines in the target monitoring sub-area, and if the tree intrusion field of view characterization coefficient meets a preset condition, calls the non-fixed screen information corresponding to the current target monitoring sub-area; based on the non-fixed screen information, completes the monitoring of the current target monitoring sub-area, realizes the analysis of monitoring conditions of different areas of the scene according to the monitoring screen requirements of different areas of the application scenario combined with the factors affecting the field of view of different areas, and selectively calls monitoring equipment resources for different areas, timely discovers and avoids local blind spots in the monitoring field of view, and also avoids a large amount of redundant data generated by real-time monitoring from affecting the efficient operation of the system, thereby greatly improving work efficiency.

[0046] It should be understood that the contents described in the Summary of the Invention are not intended to limit the key or important features of the embodiments of the present application, nor are they intended to limit the scope of the present application. Other features of the present application will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] The above and other features, advantages and aspects of the embodiments of the present application will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:

[0048] Figure 1 A diagram of the system architecture involved in the method provided in the embodiments of the present application.

[0049] Figure 2 is a flow chart of a multimodal security method according to an embodiment of the present application;

[0050] Figure 3 A logic flow chart for determining whether the current sub-area is a key monitoring sub-area according to an embodiment of the present application;

[0051] Figure 4 A logic flow chart for determining whether to call a non-fixed picture acquisition unit for a key monitoring sub-area according to an embodiment of the present application;

[0052] Figure 5 A schematic diagram of adjusting the viewing angle of a non-fixed image acquisition unit to a preset viewing angle according to an embodiment of the present application;

[0053] Figure 6 is a block diagram of a multimodal security device according to an embodiment of the present application;

[0054] Figure 7 It is a schematic diagram of the structure of a terminal device or a server suitable for implementing the embodiments of the present application. DETAILED DESCRIPTION

[0055] In order to make the purpose, technical solution and advantages of the embodiments of the present disclosure clearer, the technical solution in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present disclosure.

[0056] In addition, the term "and / or" in this article is only a description of the association relationship between the associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.

[0057] Figure 1A schematic diagram of an exemplary operating environment 100 in which the embodiments of the present disclosure can be implemented is shown. The operating environment 100 includes a fixed picture acquisition unit 101, a server 102 and a non-fixed picture acquisition unit 103.

[0058] The fixed picture acquisition unit 101 is used to obtain fixed picture information;

[0059] A non-fixed picture acquisition unit 103, used to acquire non-fixed picture information;

[0060] The server 102 may be a server that provides various services, such as a background server that processes the data uploaded by the acquisition units 101 and 103. The background server may analyze the received data and feed back the processing results to a terminal device, such as a mobile phone, PAD or other terminal device.

[0061] It should be noted that the server 102 can be hardware or software. When the server 102 is hardware, it can be implemented as a distributed server cluster consisting of multiple servers, or it can be implemented as a single server. When the server is software, it can be implemented as multiple software or software modules (for example, multiple software or software modules for providing distributed services), or it can be implemented as a single software or software module. No specific limitation is made here.

[0062] It should be understood that Figure 1 The number of collection units 101, 103 and servers 102 in the embodiment is only for illustration. Any number of collection units 101, 103 and servers may be provided according to implementation requirements.

[0063] Figure 2 A flowchart of a multi-modal security method according to an embodiment of the present disclosure is shown. The method may be Figure 1 Server 102 executes in.

[0064] S210, obtaining a fixed picture information set of the parking lot.

[0065] In some embodiments, a fixed picture information set of a parking lot may be acquired through the fixed collection unit 101; the fixed picture information set includes fixed picture information of a plurality of parking lots.

[0066] Among them, the position coordinates of each fixed image acquisition unit are determined by technicians in this field in advance based on the set coordinate origin, and a rectangular coordinate system is established along the plane where the ground is located to determine the position coordinates of each fixed image acquisition unit in the rectangular coordinate system.

[0067] S220, analyzing the fixed picture information set to determine whether the current fixed picture is a target monitoring picture.

[0068] In some embodiments, vehicle outlines are identified based on the fixed screen, the number of vehicle outlines in the fixed screen is determined as the number of vehicles Na in the fixed screen, and the number of vehicles Na is compared with a preset vehicle number threshold Na0. If the number of vehicles Na is less than or equal to the vehicle number threshold Na0, the fixed screen is determined to be a non-key monitoring screen; if the number of vehicles Na is greater than the vehicle number threshold Na0, the fixed screen is determined to be a key monitoring screen (target monitoring screen).

[0069] Among them, the vehicle quantity threshold The vehicle number threshold value can be determined by pre-calculating and pre-calculating and recording the average value of the number of vehicles in the fixed images of several fixed image acquisition units.

[0070] The more vehicles there are in the pictures obtained by the security monitoring with a fixed perspective, the greater the possibility of a safety accident occurring in the picture representing the current perspective. The present invention selects the pictures with more vehicles than the threshold as the key monitoring pictures, thereby realizing the analysis of the monitoring picture requirements in different areas of the application scenarios.

[0071] S230, dividing the parking lot area into a plurality of sub-areas, and determining whether the current sub-area is a target monitoring sub-area based on the number of target monitoring images in each sub-area.

[0072] In some embodiments, the parking lot area may be pre-divided into a plurality of sub-areas according to actual application scenarios.

[0073] In some embodiments, Figure 3 As shown, the number Nb of target monitoring images in each sub-area is compared with the preset reference value If the number Nb is less than or equal to the reference value The current area is determined to be a non-key monitoring sub-area; if the number Nb is greater than the reference value The current area is determined to be the key monitoring sub-area (target monitoring sub-area).

[0074] Preferably, the quantity reference value It can be determined based on the total number N of fixed image acquisition units in the sub-area. The reference value of the number The value range is [0.4N, 0.6N].

[0075] In the fixed images obtained by security monitoring in each sub-area of ​​the parking lot area, the more perspectives there are with a larger number of vehicles, which indicates that the vehicles are concentrated in the current sub-area. In the present disclosure, the parking lot area is divided into several sub-areas for analysis, thereby realizing the analysis of monitoring image requirements in different areas of the application scenarios.

[0076] S240, calculating a tree intrusion visual field characterization coefficient based on the tree outlines in the target monitoring sub-area, and if the tree intrusion visual field characterization coefficient meets a preset condition, calling non-fixed picture information corresponding to the current target monitoring sub-area.

[0077] In some embodiments, the outlines of trees can be extracted from a preprocessed fixed image through image processing technology, and an edge detection algorithm can be used to identify the edges of trees. The height and width of the trees can be determined based on a unit scale set in the image, and the maximum height and maximum width of the trees can be recorded. The maximum height of the tree outline in the direction perpendicular to the ground in the actual scene and the maximum width of the tree outline in the fixed image can be determined based on the proportional relationship between the set unit scale and the actual scale.

[0078] Furthermore, based on the maximum height value and the maximum width value, the tree invasion field characterization coefficient can be calculated by the following formula:

[0079]

[0080] Wherein, E is the coefficient of tree invasion visual field characterization;

[0081] h is the maximum height value;

[0082] h0 is the preset maximum height reference value, which can be preset according to the actual application scenario;

[0083] d is the maximum width value;

[0084] d0 is the preset maximum width reference value, which can be preset according to the actual application scenario;

[0085] α is the tree silhouette height weight coefficient;

[0086] β is the weight coefficient of tree silhouette width;

[0087] e is a constant.

[0088] Preferably, the maximum height reference value h0 is set to 3.5, in m; and the maximum width reference value d0 is set to 1.5, in m.

[0089] The tree outline height weight coefficient α and the tree outline width weight coefficient β can be preset according to the actual application scenario, for example, determined by historical data analysis, big data analysis, etc. Preferably, the tree outline height weight coefficient α can be set to 0.6; the tree outline width weight coefficient β can be set to 0.4.

[0090] Furthermore, it also includes:

[0091] Based on the tree intrusion visual field characterization coefficients corresponding to several tree outlines in the fixed picture, an average value of the tree intrusion visual field characterization coefficients is calculated, and the average value of the tree intrusion visual field characterization coefficients is used as the tree intrusion visual field characterization coefficient E1 of the fixed picture.

[0092] Based on the size parameters of each tree outline, the tree intrusion field of view characterization coefficient is calculated. The trees themselves and the swing of the trees will affect the field of view of security monitoring. In the key monitoring sub-area with a large number of vehicles, the higher the height of the trees, the greater the impact on the field of view of security monitoring, and the taller the trees, the greater the field of view impact during the swinging process. Similarly, the wider the trees, the greater the impact on the field of view of security monitoring, and the wider the trees, the larger the field of view blocked during the swinging process. In the present disclosure, the outlines of trees in security monitoring are taken into consideration, and the degree of influence of trees on security monitoring in key monitoring sub-areas is quantified based on the size parameters of the tree outlines, so that the monitoring conditions of different areas of the scene can be analyzed according to the monitoring screen requirements of different areas of the application scenario and the factors affecting the field of view of different areas.

[0093] In some embodiments, Figure 4 As shown, based on the tree invasion field of view characterization coefficient E1 of each fixed picture, the maximum tree invasion field of view characterization coefficient E of the fixed picture is determined. 1max , the maximum tree invasion field characterization coefficient E 1max The maximum tree invasion field characterization coefficient threshold E 10 For comparison, if the maximum tree invasion field representation coefficient E 1max Less than or equal to the maximum tree invasion field characterization coefficient threshold E 10 , it is determined that there is no need to call the non-fixed image acquisition unit for the key monitoring sub-area where the fixed image corresponding to the maximum tree intrusion visual field representation coefficient is located; if the maximum tree intrusion visual field representation coefficient E 1max Greater than the maximum tree invasion field characterization coefficient threshold E 10 , it is determined that the key monitoring sub-area where the fixed picture corresponding to the maximum tree intrusion field representation coefficient is located is called the non-fixed picture acquisition unit.

[0094] Preferably, the maximum tree invasion field characterization coefficient threshold E 10The value range is [1.05, 1.08].

[0095] S250, completing monitoring of the current target monitoring sub-area based on the non-fixed picture information.

[0096] In some embodiments, according to the distance between the key monitoring sub-region and a number of non-fixed image acquisition units, the non-fixed image acquisition unit corresponding to the minimum distance to the key monitoring sub-region may be called.

[0097] The distance between the key monitoring sub-area and the non-fixed image acquisition units can be determined based on the distance between the coordinate position of each non-fixed image acquisition unit and the edge of the key monitoring sub-area. The minimum value of the distance between the coordinate position of each non-fixed image acquisition unit and the edge of the key monitoring sub-area is determined as the distance between the non-fixed image acquisition unit and the key monitoring sub-area.

[0098] In some embodiments, Figure 5 As shown, the position coordinates of each fixed image acquisition unit in the key monitoring sub-area can be added and calculated, and the position coordinates obtained by the addition calculation can be determined as the reference position d (Xd, Yd).

[0099] Among them, Xd=Xa+Xb+Xc, Yd=Ya+Yb+Yc, that is, the reference position d(Xd, Yd) can be obtained by adding the position coordinates a(Xa, Ya), b(Xb, Yb) and c(Xc, Yc) of each fixed image acquisition unit in the key monitoring sub-area.

[0100] Furthermore, the non-fixed image acquisition unit e is adjusted to a preset viewing angle with the reference position d (Xd, Yd) as the viewing angle center position.

[0101] For further information, please refer to Figure 5 , adjust the viewing angle center line 1 of the non-fixed image acquisition unit e to pass through the reference position d (Xd, Yd).

[0102] In the present disclosure, the viewing angle of the non-fixed picture acquisition unit is adjusted to a preset viewing angle. Under the condition that the monitoring field of view of the key monitoring sub-area is affected, the nearest non-fixed picture acquisition unit can be called to obtain the picture of the key monitoring sub-area by changing the viewing angle, and the position coordinates of each fixed picture acquisition unit in the key monitoring sub-area are added to determine the relative center position of the key monitoring sub-area, and the viewing angle of the non-fixed picture acquisition unit is adjusted to the relative center position of the key monitoring sub-area, which is conducive to the comprehensive coverage of the key monitoring sub-area by the viewing angle of the non-fixed picture acquisition unit, and further, the monitoring conditions of different areas of the scene are analyzed according to the monitoring picture requirements of different areas of the application scenario combined with the factors affecting the field of view of different areas, and the monitoring equipment resources are selectively called for different areas to timely discover and avoid local blind spots in the monitoring field of view.

[0103] According to the embodiments of the present disclosure, the following technical effects are achieved:

[0104] The monitoring conditions of different areas of the scene can be analyzed according to the monitoring screen requirements of different areas of the application scenario and the factors affecting the field of view of different areas, and the monitoring equipment resources can be selectively called for different areas. That is, the monitoring conditions of different areas of the scene can be analyzed according to the monitoring screen requirements of different areas of the application scenario and the factors affecting the field of view of different areas, and the monitoring equipment resources can be selectively called for different areas. Local blind spots in the monitoring field of view can be discovered and avoided in a timely manner, and a large amount of redundant data generated by real-time monitoring can be avoided to affect the efficient operation of the system. While reducing resource consumption, work efficiency has been greatly improved.

[0105] It should be noted that, for the aforementioned method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the described order of actions, because according to the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all optional embodiments, and the actions and modules involved are not necessarily required by the present application.

[0106] The above is an introduction to the method embodiment. The following is a further explanation of the scheme described in this application through an apparatus embodiment.

[0107] Figure 6 A block diagram 600 of a multi-modal security device according to an embodiment of the present application is shown. Figure 6 Shown include:

[0108] An acquisition module 610 is used to acquire a fixed picture information set of a parking lot;

[0109] An analysis module 620 is used to analyze the fixed picture information set to determine whether the current fixed picture is a target monitoring picture;

[0110] A determination module 630 is used to divide the parking area into a plurality of sub-areas, and determine whether the current sub-area is a target monitoring sub-area based on the number of target monitoring images in each sub-area;

[0111] The calculation module 640 is used to calculate the tree intrusion visual field characterization coefficient based on the tree outline in the target monitoring sub-area, and if the tree intrusion visual field characterization coefficient meets the preset condition, call the non-fixed picture information corresponding to the current target monitoring sub-area;

[0112] The security module 650 is used to monitor the current target monitoring sub-area based on the non-fixed picture information.

[0113] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the described module can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0114] Figure 7 A schematic diagram of the structure of a terminal device or server suitable for implementing an embodiment of the present application is shown.

[0115] like Figure 7 As shown, the terminal device or server includes a central processing unit (CPU) 701, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 702 or the program loaded from the storage part 708 into the random access memory (RAM) 703. In the RAM 703, various programs and data required for the operation of the terminal device or server are also stored. The CPU 701, the ROM 702, and the RAM 703 are connected to each other via a bus 704. An input / output (I / O) interface 705 is also connected to the bus 704.

[0116] The following components are connected to the I / O interface 705: an input section 706 including a keyboard, a mouse, etc.; an output section 707 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 708 including a hard disk, etc.; and a communication section 709 including a network interface card such as a LAN card, a modem, etc. The communication section 709 performs communication processing via a network such as the Internet. A drive 710 is also connected to the I / O interface 705 as needed. A removable medium 711, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 710 as needed, so that a computer program read therefrom is installed into the storage section 708 as needed.

[0117] In particular, according to an embodiment of the present application, the above method flow steps can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program carried on a machine-readable medium, and the computer program includes a program code for executing the method shown in the flow chart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 709, and / or installed from the removable medium 711. When the computer program is executed by the central processing unit (CPU) 701, the above-mentioned functions defined in the system of the present application are executed.

[0118] It should be noted that the computer-readable medium shown in the present application may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In the present application, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the above.

[0119] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each box in the flow chart or block diagram can represent a module, a program segment or a part of the code, and the aforementioned module, program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0120] The units or modules involved in the embodiments described in the present application may be implemented by software or hardware. The units or modules described may also be arranged in a processor. The names of these units or modules do not, in some cases, constitute limitations on the units or modules themselves.

[0121] As another aspect, the present application further provides a computer-readable storage medium, which may be included in the electronic device described in the above embodiment; or may exist independently without being assembled into the electronic device. The above computer-readable storage medium stores one or more programs, and when the above programs are used by one or more processors to execute the method described in the present application.

[0122] The above description is only a preferred embodiment of the present application and an explanation of the technical principles used. Those skilled in the art should understand that the scope of application involved in the present application is not limited to the technical solution formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the aforementioned application concept. For example, the above features are replaced with (but not limited to) technical features with similar functions applied in the present application.

Claims

1. A multi-modal security device, characterized in that: include: An acquisition module, used to acquire a fixed picture information set of a parking lot; An analysis module, used for analyzing the fixed picture information set to determine whether the current fixed picture is a target monitoring picture; A determination module, used to divide the parking lot area into a plurality of sub-areas, and determine whether the current sub-area is a target monitoring sub-area based on the number of target monitoring images in each sub-area; A calculation module, for calculating a tree intrusion visual field characterization coefficient based on the tree outlines in the target monitoring sub-area, and if the tree intrusion visual field characterization coefficient meets a preset condition, calling non-fixed picture information corresponding to the current target monitoring sub-area; The security module is used to monitor the current target monitoring sub-area based on the non-fixed picture information.

2. A multi-modal security method, characterized in that: include: Get the fixed picture information set of the parking lot; Analyze the fixed picture information set to determine whether the current fixed picture is a target monitoring picture; Divide the parking lot area into a plurality of sub-areas, and determine whether the current sub-area is a target monitoring sub-area based on the number of target monitoring images in each sub-area; Based on the tree outlines in the target monitoring sub-area, a tree intrusion visual field characterization coefficient is calculated, and if the tree intrusion visual field characterization coefficient meets a preset condition, non-fixed picture information corresponding to the current target monitoring sub-area is called; Based on the non-fixed picture information, the monitoring of the current target monitoring sub-area is completed.

3. The method according to claim 2, characterized in that The fixed picture information set is analyzed to determine whether the current fixed picture is the target monitoring picture include: Wherein, the fixed screen information set includes fixed screen information of multiple parking lots; The fixed screen information in the fixed screen information set is analyzed respectively, and if the number of vehicles in the current fixed screen information is greater than a preset vehicle number threshold, the current fixed screen is determined to be a target monitoring screen.

4. The method according to claim 3, characterized in that The determining whether the current sub-region is a target monitoring sub-region based on the number of target monitoring images in each sub-region comprises: If the number of target monitoring screens in the current sub-area is greater than a preset reference value, the current sub-area is determined to be the target monitoring sub-area.

5. The method according to claim 4, characterized in that The calculating of the tree intrusion field characterization coefficient based on the tree outline in the target monitoring sub-area includes: Based on the tree outlines in the target monitoring sub-area, determining a maximum height value of the tree outline in a direction perpendicular to the ground and a maximum width value in the target monitoring sub-area; Based on the maximum height value and the maximum width value, a tree invasion visual field characterization coefficient is calculated.

6. The method according to claim 5, characterized in that The calculating of the tree invasion field characterization coefficient based on the maximum height value and the maximum width value comprises: Based on the maximum height and maximum width values, the tree invasion field characterization coefficient can be calculated by the following formula: Wherein, E is the coefficient of tree invasion visual field characterization; h is the maximum height value; h0 is the preset maximum height reference value; d is the maximum width value; d0 is the preset maximum width reference value; α is the tree silhouette height weight coefficient; β is the weight coefficient of tree silhouette width; e is a constant.

7. The method according to claim 6, characterized in that Also includes: Based on the tree invasion visual field representation coefficients corresponding to several tree outlines in the fixed picture, the average value of the tree invasion visual field representation coefficients is calculated; The average value of the tree intrusion visual field representation coefficient is used as the tree intrusion visual field representation coefficient of the fixed picture.

8. The method according to claim 7, characterized in that If the tree intrusion field representation coefficient meets the preset conditions, calling the non-fixed picture information corresponding to the current target monitoring sub-area includes: The tree intrusion field of view characterization coefficient is compared with a preset maximum tree intrusion field of view characterization coefficient threshold. If the tree intrusion field of view characterization coefficient is greater than the maximum tree intrusion field of view characterization coefficient threshold, the non-fixed picture information corresponding to the current target monitoring sub-area is called.

9. An electronic device comprising a memory and a processor, wherein a computer program is stored in the memory, wherein: When the processor executes the computer program, the method according to any one of claims 2 to 8 is implemented.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 2 to 8 is implemented.