Storefront violation identification method and device based on semantic segmentation, and storage medium

A semantic segmentation and recognition method technology, applied in the field of image processing, can solve problems such as target misdetection, detection accuracy reduction, edge irregularity, etc., to avoid the influence of external factors, reduce false detection and missed detection, and reduce regulatory pressure Effect

Pending Publication Date: 2020-09-15
SHENZHEN ZTE NETVIEW TECH +1
View PDF4 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

There are two main methods of monitoring store facade violations: the first is the monitoring method of fixed cameras, such as the surveillance camera or ball camera installed on the street wall. Since the area captured by the fixed camera is relatively fixed, the scene analysis is relatively simple. , the area of ​​concern can be segmented through some auxiliary means, and then the violations caused by the random placement of items outside the store in the area of ​​interest can be detected; the second is the monitoring method of mobile cameras, such as vehicle body enforcement devices, etc. Movement status, there are many uncertain factors in terms of movement speed, distance from the store, environmental occlusion, etc. At this time, it will become very difficult to obtain the area of ​​interest, and the same method is difficult to apply
[0003] When processing the shooting content of the camera, the target in the image or video is often detected with the help of deep learning, and the accuracy and speed of target detection are improved through various detection methods. However, no matter what type of target detection method is currently used, there are A problem: simply use a rectangular box to give the position of the target
In fact, when this detection method encounters more complex problems, such as irregular edges of items placed outside the store, overlapping between items, and close proximity of different categories of items, it will lead to illegal operation of the store. The accuracy of the detection is reduced, the actual application effect becomes worse, and it is easy to cause false detection or missed detection of the target.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Storefront violation identification method and device based on semantic segmentation, and storage medium
  • Storefront violation identification method and device based on semantic segmentation, and storage medium
  • Storefront violation identification method and device based on semantic segmentation, and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0026] Please refer to figure 1 , the present application discloses a method for identifying storefront violations based on semantic segmentation, which includes steps S110-S140, which will be described separately below.

[0027] In step S110, frame images of one or more storefronts are acquired, that is, one frame image may contain photographed images of one or more storefronts.

[0028] In this embodiment, there may be multiple shooting sources of the frame image. For example, to obtain photographs taken of one or more shop fronts, the photographs are taken as a frame image, that is, each photograph obtained by taking photos of shops along the street with a camera is used as a frame image. In another case, the captured video for one or more shop fronts is obtained, and each frame in the captured video is used as a frame image, that is, a video camera is used to shoot a store along the street to obtain a continuous frame of captured video, and each The frame video picture i...

Embodiment 2

[0058] Please refer to Figure 4 , on the basis of the method for identifying storefront violations based on semantic segmentation disclosed in Embodiment 1 of the present application, an improved method for identifying storefront violations is also disclosed, which includes steps S210-S300, which will be described separately below.

[0059] In step S210, frame images of one or more storefronts are acquired, that is, one frame image may contain photographed images of one or more storefronts.

[0060]The frame image here can have multiple shooting sources, for example, from a photo taken for one or more shop fronts, and the photo is taken as a frame image; One frame of picture is used as a frame image.

[0061] In step S220, the frame image is identified according to the preset semantic segmentation violation identification model, and the identification area belonging to the violation in the frame image is obtained.

[0062] It should be noted that the semantic segmentation v...

Embodiment 3

[0079] Please refer to Figure 5 , this embodiment discloses a storefront violation identification device, which includes an imaging device 31, a processing device 32 and a display device 33, which will be described separately below.

[0080] The imaging device 31 has a camera capable of capturing images of one or more storefronts and generating corresponding frame images. Specifically, the imaging device 31 may be a camera or a video camera. For example, law enforcement personnel use mobile phones, professional cameras, law enforcement cameras and other types of imaging equipment to take pictures of store facades along the street, thereby generating frame images; The fixed camera installed on the vehicle or the mobile camera installed on the law enforcement vehicle can capture the video of the shop front along the street, so as to generate a frame image.

[0081] The processing device 32 is connected to the imaging device 31, and the processing device 32 can obtain frame ima...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a storefront violation identification method and device based on semantic segmentation and a storage medium. The storefront violation identification method comprises the steps:acquiring frame images of one or more storefronts; identifying the frame image according to a preset semantic segmentation violation identification model to obtain an identification area belonging toviolation in the frame image; filtering each identification area in the frame image according to a preset mask, and reserving the identification area of the interested storefront; and outputting an identification result of the identification area of the interested storefront. According to the storefront violation identification method and device, each identification area in the frame image is filtered according to the preset mask; therefore, the interference of the non-storefront area in the frame image can be eliminated to the greatest extent, and only the identification area of the interested storefront is concerned with the violation situation, so that the influence of external factors is effectively avoided, and the situations of false detection and missing detection are greatly reduced, and the storefront violation identification accuracy is improved.

Description

technical field [0001] The invention relates to the technical field of image processing, in particular to a semantic segmentation-based storefront violation identification method, device, and storage medium. Background technique [0002] With the proposal and continuous implementation of smart cities and smart communities, the intelligent management of street shops is imperative. There are two main methods of monitoring store facade violations: the first is the monitoring method of fixed cameras, such as the surveillance camera or ball camera installed on the street wall. Since the area captured by the fixed camera is relatively fixed, the scene analysis is relatively simple. , the area of ​​concern can be segmented through some auxiliary means, and then the violations caused by the random placement of items outside the store in the area of ​​interest can be detected; the second is the monitoring method of mobile cameras, such as vehicle body enforcement devices, etc. In th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/34G06K9/62
CPCG06V10/267G06F18/214
Inventor 郭闯世邵新庆刘强徐明
Owner SHENZHEN ZTE NETVIEW TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products