Vending monitoring method, device and system, electronic equipment and storage medium

By monitoring and image recognition of the garbage dumping areas in the target area, we can determine whether there are illegal vendors, and solve the problems of high monitoring costs and excessive resource utilization in the existing technology, and achieve efficient and low-cost vendor monitoring.

CN119445458APending Publication Date: 2025-02-14SHENZHEN INTELLIFUSION TECHNOLOGIES CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202310945582.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-07-28
Publication Date
2025-02-14

AI Technical Summary

Technical Problem

Existing vendor monitoring methods require the establishment of a large number of monitoring tools in the target area, resulting in high monitoring costs and excessive resource utilization.

Method used

By monitoring the garbage dumping area in the target area, obtaining monitoring images and image recognition, determining whether there are illegal vendors based on the amount or type of garbage, reducing the monitoring range and camera layout.

Benefits of technology

It reduces the cost of surveillance of vendors, improves monitoring efficiency, and effectively monitors vendors through the implicit relationship between garbage conditions and vendors.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119445458A_ABST
    Figure CN119445458A_ABST
Patent Text Reader

Abstract

The embodiment of the invention provides a vendor monitoring method, and the method comprises the steps: obtaining a monitoring image of a garbage stacking region in a preset time period, determining the garbage quantity or the garbage type of the garbage stacking region in the preset time period according to the monitoring image, determining whether there is an illegal vendor in a target region according to the garbage quantity or the garbage type, and if yes, determining whether there is an illegal vendor in the target region. The target area is determined according to the garbage stacking area. By multiplexing the monitoring image in the garbage stacking area in the target area, image recognition can be performed on the monitoring image, and whether illegal vendors exist in the target area or not is determined according to the garbage quantity or the garbage type in the garbage stacking area. According to the embodiment of the invention, the traders are monitored by using the implicit relationship between the garbage condition of the garbage stacking area and the traders, the monitoring range is reduced, the monitoring images of the garbage stacking area can be reused, and the number of arranged cameras is reduced, so that the monitoring cost is reduced.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of urban management, and in particular to a vendor monitoring method, device, system, electronic equipment and storage medium. Background Art

[0002] With the development of cities, there are more and more vendors, and the garbage generated by vendors is also a test for city managers. In traditional vendor monitoring technology, monitoring tools are used to monitor the target area, and image recognition is performed based on the monitoring images of the target area. The nature of the vendors in the target area is determined based on the recognition results. According to current monitoring technology, a large number of monitoring tools need to be set up in the target area to obtain monitoring images, which will occupy a lot of public resources. Therefore, the existing vendor monitoring method requires the placement of a large number of monitoring tools, which makes the vendor monitoring cost high. Summary of the invention

[0003] The embodiment of the present invention provides a vendor monitoring method, which aims to solve the problem that the existing vendor monitoring method cannot determine whether there are illegal vendors in the target area by analyzing the garbage in the target area. By reusing the monitoring screen in the garbage dumping area in the target area, by performing image recognition on the monitoring screen, it is determined whether there are illegal vendors in the target area according to the recognition result. Since only the garbage dumping area in the target area is monitored, the monitoring range is reduced, the arrangement of cameras is reduced, thereby reducing the monitoring cost, enriching the monitoring content, and improving the monitoring efficiency.

[0004] In a first aspect, an embodiment of the present invention provides a vendor monitoring method, characterized in that the method comprises the following steps:

[0005] Obtain monitoring images of the garbage dumping area within a preset period of time;

[0006] Determine the amount or type of garbage in the garbage dumping area within the preset time period according to the monitoring image;

[0007] According to the amount of garbage or the type of garbage, it is determined whether there are illegal vendors in the target area, and the target area is determined according to the garbage stacking area.

[0008] In a second aspect, an embodiment of the present invention further provides a vendor monitoring device, the vendor monitoring device comprising:

[0009] An acquisition module is used to acquire monitoring images of the garbage dumping area within a preset time period;

[0010] A first determination module, configured to determine the amount or type of garbage in the garbage dumping area within the preset time period according to the monitoring image;

[0011] The second determination module is used to determine whether there are illegal vendors in the target area according to the amount of garbage or the type of garbage, and the target area is determined according to the garbage stacking area.

[0012] In a third aspect, an embodiment of the present invention provides an electronic device, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the vendor monitoring method provided in the embodiment of the present invention when executing the computer program.

[0013] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the steps of the vendor monitoring method provided in the embodiment of the invention are implemented.

[0014] In an embodiment of the present invention, a monitoring image of a garbage dumping area within a preset period of time is obtained, and the amount of garbage or the type of garbage in the garbage dumping area within the preset period of time is determined based on the monitoring image. Based on the amount of garbage or the type of garbage, it is determined whether there are illegal vendors in the target area, and the target area is determined based on the garbage dumping area. By reusing the monitoring image of the garbage dumping area in the target area, image recognition can be performed on the monitoring image, and based on the amount of garbage or the type of garbage in the garbage dumping area, it can be determined whether there are illegal vendors in the target area. Since only the garbage dumping area in the target area is monitored, the implicit relationship between the garbage situation in the garbage dumping area and the vendors is used to monitor the vendors, which reduces the monitoring range, and the monitoring image of the garbage dumping area can be reused, reducing the number of cameras deployed, thereby reducing the monitoring cost. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0016] Figure 1 is a flow chart of a vendor monitoring method provided by an embodiment of the present invention;

[0017] Figure 2 is another flow chart of a vendor monitoring method provided in an embodiment of the present invention;

[0018] Figure 3 is a schematic diagram of the structure of a vendor monitoring device provided in an embodiment of the present invention;

[0019] Figure 4 It is a structural schematic diagram of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0020] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0021] like Figure 1 As shown, Figure 1 : is a flow chart of a vendor monitoring method provided by an embodiment of the present invention, the vendor monitoring method comprising the steps of:

[0022] 101. Obtain monitoring images of the garbage dumping area within a preset time period.

[0023] In an embodiment of the present invention, the monitoring method can be applied to a city management platform, which stores image information of various streets. The image information includes monitoring images of garbage dumping areas distributed on various streets.

[0024] The above image information can be captured in real time by cameras distributed on the streets and uploaded to the city management platform. After being analyzed and processed by the city management platform, the analysis results are fed back to the city management personnel through the terminal. The above camera can monitor the garbage situation in the above garbage dumping area, such as monitoring the amount of garbage, the type of garbage, the filling degree of the garbage bin, etc. This embodiment analyzes the monitoring of the above garbage situation and judges the vendor situation by analyzing the monitoring image.

[0025] The terminal may be an electronic device having image storage, image processing and analysis functions, for example, a display device having image storage, image processing and analysis functions.

[0026] The above vendor type information may include the types of goods sold by the vendor, the size of the vendor, and the vendor's business license information. Specifically, the vendor type information can be investigated for resident vendors and the information of vendors who have obtained business licenses can be entered. The entered vendor type information can be used by management personnel to determine illegal vendors.

[0027] The above acquisition method can be done by citizens or managers taking photos and uploading them to the city management platform, or by cameras distributed in various garbage dumping areas on the streets taking real-time photos and uploading them to the city management platform. Specifically, managers take photos of the garbage in the above garbage dumping areas and upload them to the city management platform, or managers directly view the camera images in the above garbage dumping areas through the city management platform, and capture the camera images as needed, and upload them to the city management platform for processing and analysis. The city management platform processes and analyzes the uploaded images, saves them to the terminal, and displays them to the managers through the terminal.

[0028] The above-mentioned garbage dumping area can be an area for garbage or waste dumping, and there can be multiple garbage dumping areas in one area. The garbage dumping area can be equipped with a camera and connected to the urban management platform, and the garbage situation in the garbage dumping area can be monitored in real time through the camera. And for the management of the garbage dumping area, the management personnel need to regularly monitor and inspect the garbage dumping area to ensure that it complies with relevant laws and regulations and environmental standards, and take corresponding measures to solve any problems. Specifically, the garbage dumping area needs to be far away from the living resource area, such as the water source area, and equipped with a garbage sorting function. The camera equipped in the garbage dumping area needs to have the function of uploading images within a preset time period. More specifically, the above-mentioned garbage dumping area can be refined into various garbage stations distributed on the streets. Residents and vendors can put garbage through the garbage stations, and the number and type of street vendors along the above-mentioned streets can be determined according to the amount and type of garbage put in.

[0029] The above-mentioned preset time period can be set manually by the management personnel, and the images of the above-mentioned garbage dumping area are obtained within the preset time period to obtain the situation of the vendors. Alternatively, the preset time period can also be set dynamically. Specifically, it can be set dynamically according to the lunch peak period, and it can also be set dynamically according to the weather season. For example, if it is necessary to monitor the situation of vendors during the lunch peak period, the preset time period can be set to the lunch peak period. The preset time period can also be set dynamically according to the seasonal characteristics of short winter and long summer. For example, it can be extended by one hour in summer, or shortened by one hour in winter. The above-mentioned preset time period can be obtained by the following formula:

[0030] T=(T e -T s ) i

[0031] In the above formula, T is the preset time period, T e The end time of the preset time period can be the end time of the lunch peak period. s The starting time of the preset time period can be the starting time of the lunch peak period.i is a weather season parameter and can be set according to the specific implementation plan. The above formula can be used to obtain a time period that can better reflect the situation of vendors. By identifying the monitoring images of the garbage dumping area in the target area during this time period, representative vendor situation identification results can be obtained.

[0032] The monitoring images can be taken by citizens or managers and uploaded to the city management platform, or taken in real time by cameras distributed in the garbage dumping areas on the streets and uploaded to the city management platform. Specifically, the monitoring images are mainly used to identify garbage in the garbage dumping areas, and can be obtained through image recognition algorithms such as SVM, Decision Trees and SSD.

[0033] Specifically, by obtaining garbage information from the supporting cameras in the garbage dumping area or garbage station, the deployment of cameras can be reduced, and the garbage generated during a specific festival does not need to be deployed in a specific venue for the above vendor monitoring method. For example, at an Internet celebrity food festival, in order to monitor the vendor situation, there is no need to deploy additional cameras for monitoring the Internet celebrity food festival. It is only necessary to reuse the camera monitoring data of the garbage station or garbage dumping area within the Internet celebrity food festival area, and judge the vendor situation in the Internet celebrity food festival area based on the monitoring screen.

[0034] 102. Determine the amount or type of garbage in the garbage dumping area within a preset time period based on the monitoring image.

[0035] In an embodiment of the present invention, the amount of garbage or the type of garbage in the current garbage dumping area is obtained by acquiring images of the garbage in the garbage dumping area and uploading the images to the city management platform for analysis.

[0036] The above-mentioned amount of garbage will change with the number of vendors, so the above-mentioned amount of garbage is a dynamic data. In a specific implementation, the shape and area of ​​the garbage dump obtained can be analyzed by the above-mentioned image recognition algorithm, and the amount of garbage in the garbage dumping area can be roughly estimated based on the shape and area of ​​the garbage dumping, and according to the preset time period set above, a recording point is determined in the preset time period. When the recording point is reached, the monitoring image of the above-mentioned garbage dumping area is automatically obtained, and the monitoring image is analyzed by the image recognition method. The amount of garbage is determined by the analysis result and recorded. The number of vendors can be reflected by the recorded amount of garbage. Therefore, through the above method, the amount of garbage recorded at different recording points within the preset time period can dynamically reflect the number of vendors in the target area in real time.

[0037] The above garbage types can be roughly divided into four categories according to the nature or attributes of the vendors: recyclable garbage, hazardous garbage, kitchen waste and other garbage. The above garbage types can be mapped through garbage attributes. For example, when the above image recognition algorithm is used to identify and analyze the garbage, it is found that the garbage is yellow. According to the garbage attribute mapping, the garbage is fruit peel garbage, so it is inferred that the vendors in the target area include vendors selling fruits.

[0038] 103. Determine whether there are illegal vendors in the target area based on the amount or type of garbage.

[0039] In an embodiment of the present invention, by analyzing the amount and type of garbage in the above-mentioned garbage dumping area, the incremental amount of garbage and the type of vendors are obtained, and based on the incremental amount of garbage and the type of vendors, it is determined whether there are any illegal vendors in the target area. If there are illegal vendors, the management personnel will be warned through the city management platform, so that the management personnel can quickly locate and manage the illegal vendors.

[0040] The target area is determined based on the garbage dumping area. By identifying the increase in the amount of garbage and the type of garbage in the garbage dumping area, if the analysis result determines that the increase in the amount of garbage exceeds the threshold or the type of garbage is in violation of regulations, the management area to which the garbage dumping area belongs is set as the target area, and an early warning plan is formulated and implemented for the target area. The target area includes at least one garbage dumping area.

[0041] In an embodiment of the present invention, a monitoring image of a garbage dumping area within a preset period of time is obtained, and the amount of garbage or the type of garbage in the garbage dumping area within the preset period of time is determined based on the monitoring image. Based on the amount of garbage or the type of garbage, it is determined whether there are illegal vendors in the target area, and the target area is determined based on the garbage dumping area. By reusing the monitoring image of the garbage dumping area in the target area, image recognition can be performed on the monitoring image, and based on the amount of garbage or the type of garbage in the garbage dumping area, it can be determined whether there are illegal vendors in the target area. Since only the garbage dumping area in the target area is monitored, the implicit relationship between the garbage situation in the garbage dumping area and the vendors is used to monitor the vendors, which reduces the monitoring range, and the monitoring image of the garbage dumping area can be reused, reducing the number of cameras deployed, thereby reducing the monitoring cost.

[0042] Optionally, the step of determining the amount of garbage in the garbage dumping area within a preset time period based on the monitoring image includes determining the amount of garbage in the garbage dumping area at a first moment and the amount of garbage at a second moment based on the monitoring image.

[0043] In an embodiment of the present invention, the preset time period can be divided according to the distribution location of the garbage dumping area. For example, a 24-hour monitoring action can be performed in a location with high traffic volume, such as a commercial area. The monitoring action includes monitoring the amount and type of garbage at the garbage stations in the target area. By monitoring the amount of garbage at the garbage stations, the increment of the amount of garbage is obtained, and the number of vendors is determined according to the preset mapping of the increment of garbage to the number of vendors.

[0044] The first moment corresponds to the second moment, and both are included in the preset time period, and the second moment is after the first moment. It should be noted that the first moment and the second moment correspond to the shooting time of the garbage site. The preset time period corresponds to the selection of the first moment and the second moment, and the start moment of the preset time period is usually the first moment, and the end moment is the second moment.

[0045] The above-mentioned amount of garbage can be the total amount of garbage generated in the above-mentioned garbage dumping area or the above-mentioned garbage station within a period of time. In the actual implementation plan, for large-scale garbage storage areas such as the above-mentioned garbage dumping area, it is impossible to count the amount of garbage one by one, so the weight method, volume method and sampling method can be used to count the amount of garbage in the above-mentioned garbage dumping area. For small-scale garbage storage areas such as the above-mentioned garbage stations, the amount of garbage can be obtained by the management personnel classifying and counting the garbage on site.

[0046] In a possible embodiment, the garbage cans in the garbage station are photographed by using the cameras equipped at the garbage station, and the amount of garbage is analyzed according to the height of the garbage pile in the garbage can, and the analysis results are uploaded to the city management platform.

[0047] Optionally, the step of determining whether there are illegal vendors in the target area based on the amount of garbage includes determining an increment in the amount of garbage based on the amount of garbage at a first moment and the amount of garbage at a second moment, determining the number of vendors based on a mapping relationship between the increment in the amount of garbage and vendors, and judging whether there are illegal vendors in the target area based on the number of vendors.

[0048] In the embodiment of the present invention, the amount of garbage at the first moment and the second moment is recorded respectively, the difference between the amount of garbage at the first moment and the second moment is used to determine the increment of the amount of garbage, and then the number of vendors is reflected according to the increment of the amount of garbage. The number of vendors will be used as a basis for whether there are illegal vendors in the target area.

[0049] The garbage quantity at the first moment can be obtained by photographing and analyzing the garbage cans at a moment within the preset time period through the camera of the garbage station. Similarly, the garbage quantity at the second moment can be obtained by photographing and analyzing the garbage cans in the garbage station at another moment different from the first moment and after the first moment within the same preset time period. The obtained garbage quantity and time are then uploaded to the city management platform for processing and analysis.

[0050] The above-mentioned garbage quantity increment can be determined by the garbage quantity at the first moment and the garbage quantity at the second moment. Specifically, the garbage quantity increment is obtained by uploading the obtained garbage quantity and time to the city management platform for processing and analysis. For example, if the garbage quantity monitored at the first moment is 20 pieces and the garbage quantity monitored at the same location at the second moment is 30 pieces, then the garbage quantity increment during this preset time period is 10 pieces.

[0051] The above mapping relationship can be set by urban management personnel. Specifically, the above mapping relationship shows the relationship between the number of vendors and the increase in the amount of garbage. Because the speed of the increase in the amount of garbage is related to the number of vendors, it can be understood that the more vendors there are, the faster the increase in the amount of garbage. Therefore, this embodiment can be considered that the increase in the amount of garbage within a period of time is related to the number of vendors. For example, assuming that a vendor can produce 10 pieces in an hour, then within the above preset time period, the amount of garbage monitored at the first moment is 20 pieces, and the amount of garbage monitored at the same location at the second moment is 30 pieces. The increase in the amount of garbage within this preset time period is 10 pieces, which means that the mapping relationship between the number of vendors and the increase in the amount of garbage is that for every 10 more pieces produced, there is one more vendor in the preset time period.

[0052] Specifically, the city management platform is used to photograph and scan garbage sites in a preset area to obtain the increase in garbage quantity within a preset time period. The management personnel map the number of vendors in the preset area to the increase in garbage quantity, calculate the real-time number of vendors, and compare the number of vendors with the street vendor number warning value to determine whether to manage the illegal vendors.

[0053] More specifically, the above warning value needs to be set by the management personnel according to the business situation of the vendors on the street, and can be set according to the impact of the number of vendors on the street on the street circulation efficiency. For example, when the number of vendors on the street exceeds 10, the road will become crowded, so the 11th vendor will be guided to another street to operate, and so on.

[0054] Optionally, the step of determining whether there are illegal vendors in the target area based on the amount of garbage includes determining the flow of people in the target area during a target period of time, determining a threshold value for an increase in the amount of garbage based on the flow of people, comparing the increase in the amount of garbage with the threshold value for an increase in the amount of garbage, and confirming whether there are illegal vendors in the target area.

[0055] In the embodiment of the present invention, due to the different flow of people in the area, the amount of garbage and the increment of garbage are also different. Generally speaking, the greater the flow of people, the more garbage there is and the greater the increment of garbage. Therefore, it is necessary to limit the increment of garbage. By limiting the increment of garbage, the number of vendors can be controlled to achieve the purpose of normalizing the number of vendors in the target area.

[0056] The above-mentioned flow of people may refer to the number of people in a particular venue within a specific time period, and the flow of people may be used to reflect the density of people at that time. In this embodiment, the garbage quantity increment threshold may be determined by calculating the flow of people, and the garbage quantity increment threshold may be used to determine whether there are illegal vendors.

[0057] The above-mentioned garbage quantity increment threshold can be understood as a limited value for the garbage quantity increment. If the garbage quantity increment exceeds this value, a dangerous situation may occur.

[0058] The above target time period is determined according to the preset time period. Specifically, the target time period can be set according to the size of the flow of people. It should be noted that the target time period and the preset time period can be converted to each other under certain conditions. For example, when the preset time period is the lunch time from 12 noon to 1 pm, the management personnel need to manage this time period, then the preset time period can be used as the target time period, that is, 12 noon to 1 pm is used as the target time period.

[0059] The above-mentioned flow of people can be calculated by counting the flow of people in the target period. The garbage increment threshold is set according to the flow of people. Since the greater the flow of people, the more garbage will be generated, so the garbage increment threshold also needs to be increased to monitor the number of vendors reasonably.

[0060] By comparing the monitored increase in garbage quantity with the preset increase threshold of garbage quantity, if the increase in garbage quantity exceeds the increase threshold of garbage quantity, it means that the increase in garbage quantity is growing too fast, which reflects that there is too much garbage, so it may be caused by too many vendors. At this time, it is necessary to issue a warning to the management personnel through the urban management platform and manage the illegal vendors according to the early warning plan. This operation can directly obtain the number of vendors through the monitoring of the flow of people, and then manage the illegal vendors, making the monitoring process more convenient and quick.

[0061] Optionally, the step of determining the type of garbage in the garbage dumping area within a preset time period based on the monitoring image includes acquiring external features of the garbage in the garbage dumping area through the monitoring image, and determining the type of garbage in the garbage dumping area based on the external features of the garbage.

[0062] In the embodiment of the present invention, the garbage in the garbage dumping area or the garbage station can be identified by an image recognition algorithm to obtain the appearance features of the garbage, and the type of the garbage can be determined based on the preset appearance feature correspondence.

[0063] The above-mentioned garbage appearance characteristics may be the color of the garbage, the shape of the garbage, and the nature of the garbage. The above-mentioned garbage nature may be obtained through image recognition algorithms, such as liquid, viscous, etc. Through such property characteristic words, the nature of the garbage is defined, and the type of garbage is roughly determined. The type of the vendor can be reflected by determining the type of the garbage.

[0064] The above method steps can be used to scan and analyze small garbage storage areas, such as garbage sites. For large garbage storage areas, such as garbage dumping areas, it is necessary to divide the garbage dumping areas into regions, and classify the garbage types in each area according to each area, and finally classify them together through integrated analysis. Although this method is time-consuming, it can accurately classify garbage through image recognition algorithms and shorten the scanning and analysis time through regional division. The above regional division can be achieved by performing frame extraction analysis on the above garbage dumping areas, dividing the garbage dumping areas into regions based on the frame-by-frame images, and finally classifying the garbage in the frame-by-frame images.

[0065] Optionally, the step of determining the type of garbage in the garbage dumping area within a preset time period based on the monitoring image includes acquiring the color of garbage in the garbage dumping area based on the monitoring image, and determining the type of garbage in the garbage dumping area based on the color of the garbage.

[0066] In the embodiment of the present invention, the color attribute of the garbage in the garbage dumping area or the garbage station is obtained through the image recognition algorithm, and the type of garbage is determined through the garbage color attribute and big data analysis. Through this method, the type of garbage can be directly determined based on the garbage image obtained by the camera.

[0067] The camera images of the garbage dumping area or the garbage station are obtained and uploaded to the city management platform, which performs operations such as denoising on the images to make them clear.

[0068] Specifically, the type of garbage can be determined based on the color attributes of the garbage and big data analysis through the above-mentioned image recognition algorithm. For example, if the garbage identified by scanning is white, it means that the garbage is a plastic bag, if it is cyan, it means that the garbage is fruit peel garbage, and if it is red, it means that the garbage contains grease. Based on the specific garbage type analyzed by scanning, the types of vendors that may exist in the target area can be specifically analyzed and managed.

[0069] Optionally, the step of determining whether there are illegal vendors in the target area based on the garbage type also includes determining the type of vendors existing in the target area based on the garbage type, and determining whether there are illegal vendors in the target area based on the type of vendors existing in the target area and the type of vendors on the blacklist corresponding to the target area.

[0070] In the embodiment of the present invention, the manager determines the type of vendors in the target area by determining the garbage type. And based on the above-mentioned information upload record of vendors in the area, by comparing the blacklist in the target area with the acquired vendor type, it can be determined whether there are illegal vendors in the target area.

[0071] The type of vendors in the target area can be obtained by analyzing the type of garbage in the target area. The garbage in the target area is identified by the image recognition algorithm. The type of vendors in the target area is judged based on the color attributes of the garbage and the big data analysis results. For example, if the identified garbage contains white and cyan, it may indicate that the vendor in the target area is a fruit seller. For another example, if the identified garbage contains white and red, it may indicate that the vendor in the target area is a fried rice seller or a vendor that produces grease-based garbage.

[0072] The types of blacklist vendors in the above target areas can be set up through the management staff's requirements for the streets. For example, in a cultural street, vendors with a sense of fireworks should not exist, so vendors of stir-fry and barbecue will be set up on the blacklist to prohibit such vendors from selling in this street. By setting up the blacklist, vendors can be reasonably divided into regions and managed reasonably.

[0073] The management personnel can manage the illegal vendors by obtaining the list of blacklist vendor types in the current target area and identifying the vendor types in the garbage dump area in the above target area. The vendors can be effectively managed and monitored.

[0074] In an embodiment of the present invention, the monitoring images of the garbage dumping area in the target area during a preset period of time are acquired and analyzed and identified to obtain the amount of garbage and the type of garbage, and to determine whether there are illegal vendors in the target area during the preset period of time based on the amount of garbage and the type of garbage. Specifically, in the process of confirming the amount of garbage, the increment of the amount of garbage can be determined by setting the first moment and the second moment in the preset period of time, and by recording the amount of garbage at the first moment and the second moment to obtain the increment of the amount of garbage, and the increment threshold of the amount of garbage can be set according to the flow of people in the preset period of time, and the number of illegal vendors in the target area can be reflected according to the increment threshold of the amount of garbage and the increment of the amount of garbage. It is also possible to determine the type of vendor based on the above-mentioned garbage type, and manage and warn the illegal vendors in the target area based on the blacklist vendor type corresponding to the preset target area.

[0075] For example, during the lunch rush hour, which can be from 12:00 to 1:00 p.m., this time period can be recorded at different points, such as from 12:00 to 12:10 p.m., and then from 12:00 to 12:20 p.m., each recording point obtains the monitoring screen of the garbage dumping area in the target area, analyzes the monitoring screen through image recognition technology, obtains the amount of garbage and the type of garbage, calculates the incremental amount of garbage based on the amount of garbage at different recording points, and confirms the type of vendor based on the type of garbage at different recording points, records the flow of people at the recording points, determines the incremental threshold of the amount of garbage based on the flow of people, and further determines whether there are too many vendors by comparing the incremental amount of garbage based on the threshold of the amount of garbage. It is also possible to determine whether there are too many vendors in the area during the lunch rush hour by the incremental amount of garbage, and determine whether there are illegal vendors in the area during the lunch rush hour by comparing the vendor type with the blacklist vendor type in the target area, and finally manage and warn illegal vendors based on the analysis results of the monitoring screen.

[0076] like Figure 2 As shown, the embodiment of the present invention also provides another flow chart of a vendor monitoring method, characterized in that the method includes:

[0077] Acquire pictures or videos captured by the camera, identify the captured images or videos through a garbage identification algorithm, and perform big data analysis and processing. According to the analysis and processing results, set the time and space area, analyze the garbage types of the images or videos through a preset garbage type attribute mapping, obtain the total number of vendor types, and issue warnings to vendors in the area and time based on the preset vendor types that are not allowed in this area, or perform incremental analysis of the garbage quantity through a preset mapping of vendors and garbage quantities, calculate the number of vendors, and issue warnings to vendors in the area and time based on the preset warning quantity.

[0078] The above-mentioned garbage identification algorithm can be used to identify garbage in the above-mentioned garbage dumping area, and image recognition algorithms such as SVM, Decision Trees and SSD can be used. The above-mentioned preset time period and target area can also be used as the set time and space area.

[0079] Specifically, by performing garbage analysis on the above-obtained images or videos, and analyzing the amount of garbage, for example, assuming that a vendor can produce 10 pieces in one hour, then in the above-preset time period, the amount of garbage monitored at the first moment is 20 pieces, and the amount of garbage monitored at the same location at the second moment is 30 pieces, then the incremental amount of garbage in this preset time period is 10 pieces, which means that the mapping relationship between the number of vendors and the incremental amount of garbage is that every additional 10 pieces are produced, indicating that there is one more vendor in the preset time period, and the number of vendors is compared with the preset warning number, and vendors that exceed the warning number can be warned and managed. Or analyze the type of garbage, for example, if the garbage identified by scanning is white, it means that the garbage is a plastic bag, if the garbage identified by scanning is cyan, it means that the garbage is fruit peel garbage, and if the garbage identified by scanning is red, it means that the garbage contains grease. According to the type of garbage scanned, the type of vendors in the above-mentioned target area can be judged, and the vendor type that is not allowed to operate can be warned according to the blacklist of vendor types in the target area.

[0080] like Figure 3 As shown, an embodiment of the present invention further provides a vendor monitoring device, which is characterized by comprising:

[0081] An acquisition module 301 is used to acquire monitoring images of a garbage dumping area within a preset period of time;

[0082] A first determination module 302 is used to determine the amount or type of garbage in the garbage dumping area within the preset time period according to the monitoring image;

[0083] The second determination module 303 is used to determine whether there are illegal vendors in the target area according to the amount of garbage or the type of garbage, and the target area is determined according to the garbage stacking area.

[0084] Optionally, the above device includes:

[0085] The first determination submodule is used to determine the amount of garbage in the garbage dumping area at the first moment and the amount of garbage at the second moment according to the monitoring image.

[0086] Optionally, the above device further includes:

[0087] A second determining submodule, configured to determine a garbage quantity increment based on the garbage quantity at the first moment and the garbage quantity at the second moment;

[0088] A third determination submodule is used to determine the number of vendors according to the mapping relationship between the garbage quantity increment and the vendors;

[0089] The first judgment submodule is used to judge whether there are illegal vendors in the target area according to the number of vendors.

[0090] Optionally, the above device further includes:

[0091] A fourth determination submodule, configured to determine the flow of people in a target area within a target period, wherein the target period is determined according to the preset time period;

[0092] A fifth determination submodule is used to determine a garbage quantity increment threshold according to the human flow;

[0093] The sixth determination submodule is used to compare the garbage quantity increment with the garbage quantity increment threshold to confirm whether there are any illegal vendors in the target area.

[0094] Optionally, the first determining module 302 includes:

[0095] A first acquisition submodule is used to acquire the appearance characteristics of garbage in the garbage dumping area through monitoring images;

[0096] The seventh determination submodule is used to determine the type of garbage in the garbage storage area according to the appearance characteristics of the garbage.

[0097] Optionally, the second determining module 303 further includes:

[0098] The second acquisition submodule is used to acquire the color of garbage in the garbage dumping area according to the monitoring image;

[0099] The eighth determination submodule is used to determine the type of garbage in the garbage storage area according to the color of the garbage.

[0100] Optionally, the second determining module 303 further includes:

[0101] A ninth determination submodule, configured to determine the type of vendors existing in the target area according to the type of garbage;

[0102] The tenth determining submodule is used to determine whether there are illegal vendors in the target area based on the types of vendors existing in the target area and the types of blacklist vendors corresponding to the target area.

[0103] like Figure 4 As shown, an embodiment of the present invention further provides an electronic device, characterized in that it includes a processor, and the processor can execute any one of the above-mentioned vendor monitoring methods.

[0104] Specifically, it includes a processor 401 and a memory 402, and a computer program for executing the vendor monitoring method stored in the memory 402 and capable of running on the processor 401, wherein:

[0105] The processor 401 runs the computer program of the vendor monitoring method stored in the memory 402 to perform the following steps:

[0106] Obtain monitoring images of the garbage dumping area within a preset period of time;

[0107] Determine the amount or type of garbage in the garbage dumping area within the preset time period according to the monitoring image;

[0108] According to the amount of garbage or the type of garbage, it is determined whether there are illegal vendors in the target area, and the target area is determined according to the garbage stacking area.

[0109] Optionally, in the vendor monitoring method, the preset time period includes a first moment and a second moment, the second moment is after the first moment, and the processor 401 executes the step of determining the amount of garbage in the garbage dumping area within the preset time period according to the monitoring image, including:

[0110] The amount of garbage in the garbage dumping area at a first moment and the amount of garbage at a second moment are determined according to the monitoring image.

[0111] Optionally, in the vendor monitoring method, the processor 401 executes the step of determining whether there are illegal vendors in the target area according to the amount of garbage, including:

[0112] Determine an increase in the amount of garbage based on the amount of garbage at the first moment and the amount of garbage at the second moment;

[0113] Determine the number of vendors according to the mapping relationship between the increase in the amount of garbage and the vendors;

[0114] Determine whether there are illegal vendors in the target area based on the number of vendors.

[0115] Optionally, in the vendor monitoring method, the processor 401 executes the step of determining whether there are illegal vendors in the target area according to the amount of garbage, including:

[0116] Determining the flow of people in the target area within a target period, wherein the target period is determined according to the preset time period;

[0117] Determine a garbage quantity increment threshold value according to the human flow;

[0118] The garbage quantity increment is compared with the garbage quantity increment threshold to confirm whether there are any illegal vendors in the target area.

[0119] Optionally, in the vendor monitoring method, the processor 401 executes the step of determining the type of garbage in the garbage storage area within the preset time period according to the monitoring image, including:

[0120] Acquire the appearance characteristics of garbage in the garbage dumping area through monitoring images;

[0121] The type of garbage in the garbage storage area is determined based on the appearance characteristics of the garbage.

[0122] Optionally, in the vendor monitoring method, the processor 401 executes the step of determining the type of garbage in the garbage storage area within the preset time period according to the monitoring image, including:

[0123] Acquire the color of garbage in the garbage dumping area according to the monitoring image;

[0124] The type of garbage in the garbage dumping area is determined according to the color of the garbage.

[0125] Optionally, in the vendor monitoring method, the processor 401 executes the step of determining whether there are illegal vendors in the target area according to the garbage type, including:

[0126] Determining the type of vendors present in the target area according to the type of garbage;

[0127] It is determined whether there are illegal vendors in the target area based on the types of vendors existing in the target area and the types of blacklist vendors corresponding to the target area.

[0128] An embodiment of the present invention also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the various processes of the vendor monitoring method or the application-side vendor monitoring method provided in the embodiment of the present invention are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0129] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing the relevant hardware through a computer program, and the program can be stored in a computer-readable storage medium, and when the program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, the storage medium can be a disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM), etc.

[0130] The above disclosure is only the preferred embodiment of the present invention, which certainly cannot be used to limit the scope of the present invention. Therefore, equivalent changes made according to the claims of the present invention are still within the scope of the present invention.

Claims

1. A vendor monitoring method, characterized in that: The method comprises the following steps: Obtain monitoring images of the garbage dumping area within a preset period of time; Determine the amount or type of garbage in the garbage dumping area within the preset time period according to the monitoring image; According to the amount of garbage or the type of garbage, it is determined whether there are illegal vendors in the target area, and the target area is determined according to the garbage stacking area.

2. The vendor monitoring method according to claim 1, characterized in that: The preset time period includes a first moment and a second moment, the second moment is after the first moment, and the determining the amount of garbage in the garbage dumping area within the preset time period according to the monitoring image includes: The amount of garbage in the garbage dumping area at a first moment and the amount of garbage at a second moment are determined according to the monitoring image.

3. The vendor monitoring method according to claim 1 or 2, characterized in that: Determining whether there are illegal vendors in the target area according to the amount of garbage includes: Determine an increase in the amount of garbage based on the amount of garbage at the first moment and the amount of garbage at the second moment; Determine the number of vendors in the target area according to the mapping relationship between the increase in the amount of garbage and the number of vendors; It is determined whether there are illegal vendors in the target area according to the number of vendors in the target area.

4. The vendor monitoring method according to any one of claims 1 to 3, characterized in that: Determining whether there are illegal vendors in the target area according to the amount of garbage includes: Determining the flow of people in the target area within a target period, wherein the target period is determined according to the preset time period; Determine a garbage quantity increment threshold value according to the human flow; The garbage quantity increment is compared with the garbage quantity increment threshold to confirm whether there are any illegal vendors in the target area.

5. The vendor monitoring method according to any one of claims 1 to 4, characterized in that: The determining the type of garbage in the garbage dumping area within the preset time period according to the monitoring image includes: Acquire the appearance characteristics of garbage in the garbage dumping area through monitoring images; The type of garbage in the garbage storage area is determined based on the appearance characteristics of the garbage.

6. The vendor monitoring method according to any one of claims 1 to 5, characterized in that: The step of determining the type of garbage in the garbage dumping area within the preset time period according to the monitoring image includes: Acquire the color of garbage in the garbage dumping area according to the monitoring image; The type of garbage in the garbage dumping area is determined according to the color of the garbage.

7. The vendor monitoring method according to any one of claims 1 to 6, characterized in that: Determining whether there are illegal vendors in the target area according to the garbage type includes: Determining the type of vendors present in the target area according to the type of garbage; It is determined whether there are illegal vendors in the target area based on the types of vendors existing in the target area and the types of blacklist vendors corresponding to the target area.

8. A vendor monitoring device, characterized in that: The vendor monitoring device comprises: An acquisition module is used to acquire monitoring images of the garbage dumping area within a preset time period; A first determination module, configured to determine the amount or type of garbage in the garbage dumping area within the preset time period according to the monitoring image; The second determination module is used to determine whether there are illegal vendors in the target area according to the amount of garbage or the type of garbage, and the target area is determined according to the garbage stacking area.

9. An electronic device, characterized in that: include: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the vendor monitoring method according to any one of claims 1 to 7 when executing the computer program.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in the vendor monitoring method according to any one of claims 1 to 7 are implemented.