METHOD AND DEVICE FOR TRACKING AND USE OF AT LEAST ONE ENVIRONMENTAL PARAMETER
Patent Information
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2019-09-19
- Publication Date
- 2026-04-01
AI Technical Summary
Existing systems for detecting and managing cleanliness in urban environments are inefficient, costly, and lack the ability to adapt to real-time environmental conditions, leading to unnecessary resource allocation and environmental impact.
A camera-based system mounted on vehicles or fixed objects that analyzes environmental parameters, classifies waste, and adjusts operations based on real-time data processing, allowing for adaptive cleaning strategies and resource optimization.
Enhances urban cleanliness measurement and management by reducing resource consumption, extending equipment lifespan, and improving efficiency through adaptive cleaning protocols.
Description
Scope of the invention
[0001] The invention lies in the field of planning, measurement, monitoring and actions that can be activated through the analysis of environmental parameters detected by means of a camera, such as cleanliness in an urban environment. State of the art
[0002] Cleanliness detection in urban environments is described in particular in patent applications CN 106203498 and CN 106845408.
[0003] Methods for detecting or analyzing cleanliness are described in particular by national associations active against littering.
[0004] MOHAMMAD SAEED RAD ET AL: "A Computer Vision System to Localize and Classify Wastes on the Streets", ARXIV.ORG, October 31, 2017 (2017-10-31), DOI: 10.1007 / 978-3-319-68345-4_18, describes a fully automated computer vision application for waste quantification, based on deep learning to locate and classify different types of waste and based on images taken in streets and on sidewalks by an image acquisition system consisting of a high-resolution camera, mounted on the roof of a vehicle.
[0005] US 2018 / 074496 A1 relates to the use of drones for waste collection and management.
[0006] WENRUI LI ET AL: "A Multi-Level Assessment System for Smart City Street Cleanliness", PROCEEDINGS OF THE 30TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND KNOWLEDGE ENGINEERING, vol. 2018, 1 July 2018 (2018-07-01), pages 256-303, ISSN: 2325-9000, DOI: 10.18293 / SEKE2018-101 ISBN: 978-1-891706-44-8, proposes a multi-level assessment system on how street cleanliness is collected using mobile stations, connected to the city network, analyzed in the cloud and presented to city administrators online or on mobile.
[0007] JEONGMIN JEON ET AL: "Autonomous robotic street sweeping: Initial attempt for curbside sweeping", 2017 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS (ICCE), IEEE, January 8, 2017 (2017-01-08), pages 72-73, DOI: 10.1109 / ICCE.2017.7889234, presents an autonomous robotic sweeper developed by automating a commercially available manual sweeper and equipping it with two fisheye cameras for environmental detection. General description of the invention
[0008] The present invention represents an improvement over the systems and methods of the prior art.
[0009] The invention is defined by the claims in the appendix.
[0010] The invention also relates to a device that uses the aforementioned method.
[0011] In this document, "environmental parameter" means a variable element, whether natural or resulting from human, animal or plant activity, that can be detected by means of at least one camera.
[0012] The camera according to the invention preferably operates in the visible range, but its use is not limited to this part of the electromagnetic spectrum. It can, for example, operate, alternatively or in addition to the visible range, in the infrared (e.g., for temperature measurement) or the ultraviolet (e.g., for UV radiation analysis).
[0013] The device according to the invention consists of at least one camera mounted in a vehicle, e.g., a bicycle, a street sweeper, a drone, or on a fixed object, e.g., a lamppost. The camera is connected to a central unit located on the vehicle, the fixed object, or at a remote location. The central unit processes the images in real time. The images are analyzed by databases located on servers, e.g., in the cloud, and, using algorithms, elements (e.g., waste) are identified, classified, geolocated, and presented on a tracking interface, along with reports of analysis results by period and by selected information type. Detailed description of the invention
[0014] The invention is described in more detail in this chapter, by means of examples illustrated by the following figures: There figure 1 illustrates the method according to the invention applied to improving cleanliness. figure 2represents the system and steps involved in enhancing the value of the images. figure 3 represents the elements contained in the central unit of the device. figure 4 represents the monitoring of a city's cleanliness over time. figure 5 illustrates various types of reports on the cleanliness of a city. The figure 6 illustrates a variant of the invention in which a camera is attached to a sweeper. figure 7 shows an example of how a sweeper visualizes dirt. figure 8 This shows another example of how a sweeper visualizes dirt. figure 9 This illustrates an example that serves as the basis for a continuous improvement tool by presenting the causes of the influence of waste types on a cleanliness index, and therefore the types of waste that need to be addressed. Figure 10 illustrates the cleanliness index by location (streets and squares), ranked in ascending order, from the dirtiest street to the cleanest street.
[0015] The examples discussed below relate to the analysis and monitoring of cleanliness in urban areas.
[0016] Of course, the invention is not limited to this area.
[0017] The different steps of the method according to the invention are described in the figure 1 .
[0018] Camera 1 is mounted externally, on a pole, on a door, on the windshield of a vehicle, or on a moving object such as a bicycle. Camera 1 is connected to a control unit 6 located near the camera, e.g., inside the vehicle, or at a remote location. Camera 1 is connected to the control unit 6 via a wired connection on a Power of Ethernet module 17. Alternatively, the connection between camera 1 and control unit 6 is wireless.
[0019] The central unit 6 (Hardware) consists of a computer 2 (a processor 15, a broker, artificial intelligence, network management, and voltage management). An optional internal battery 21, if the central unit is on the vehicle or on the same mount as the camera 1, allows data processing via a buffer memory as soon as the external power supply 19 is cut off.
[0020] Network management is done by a dedicated unit 3 in order to access and send data remotely.
[0021] Geolocation is performed by part 4 of the central unit 6, via antenna 18.
[0022] Another part 5 of the central unit 6 is a wireless transmission system which allows, among other things, the system configuration to be carried out.
[0023] Other elements 17, 4, 5 and 2 are illustrated on the figure 3 are connected to a routing module 14.
[0024] The central unit 6 can transmit control signals to the energy management unit, including those for the sweeper. The central unit 6 can transmit its data to servers 13. These servers consist of a "front end" server 10 and a "back end" server 7. The "front end" server manages mapping and tracking 12, while the "back end" server 7 manages the database 8, data analysis 9, and reports 11.
[0025] A map of a city's cleanliness can be created (see figure 4 ) with a classification and distribution of the different types of waste according to monitoring 12 or according to data and analysis files in the form of reports or summaries 11.
[0026] The lines with triangles, circles, and squares represent the dirt level of each street. The gray dots represent each geolocated point where at least one piece of litter has been identified, selected, and geolocated. The monitoring can be displayed in real time. Its use is primarily focused on daily information or information at a specific time (for example, April 23, 2018, at 1:00 PM).
[0027] The elements shown are configurable, as are the number and type of waste presented.
[0028] This information includes various analyses that are represented with different kinds of diagrams which, depending on the use of the data, allow for its valuation, understanding or interpretation in order to offer the user the possibility of making continuous improvement decisions.
[0029] Analysis algorithms make it possible to enhance the results of detections by proposing, advantageously and automatically, continuous improvements, such as the analysis of the ideal distance between bins in relation to measured cleanliness.
[0030] The device according to the invention can also be easily integrated into existing scanning installations.
[0031] Measuring urban cleanliness allows us to assess and diagnose the cleanliness of a city, to improve it while reducing costs and environmental impacts due to litter.
[0032] The invention offers the possibility of continuously measuring urban cleanliness and of mapping the impact of a city's waste.
[0033] The invention also makes it possible to plan measures, then evaluate and present them, to act and put in place levers for action (continuous improvement) to make the city cleaner.
[0034] There figure 6 illustrates an example of an embodiment of the invention in which a camera is fixed to a sweeper.
[0035] The device according to the invention makes it possible to visualize the dirt in front of the mobile suction unit (see figures 7 and 8 ) and using a camera, e.g. regulate the suction power to limit the system's energy consumption (not using 100% of the power to pick up a cigarette, for example, but only 10%).
[0036] The system according to the invention measures urban waste objectively and automatically. Cameras are placed on the city's street sweepers. Algorithms, e.g., neural networks, identify, classify, and count the waste and transmit this data in real time.
[0037] Each identified item (cigarette butt, packaging, droppings, etc.) is geolocated and classified.
[0038] A street sweeper is designed for sweeping sidewalks, roads, and municipal parks. The types of debris to be swept are varied and specific to urban environments: fallen leaves, greasy paper, bottles, cigarette butts, chewing gum, etc. The types of flooring are also very diverse, ranging from the most durable to the most fragile: asphalt, paving stones, stone slabs, etc.
[0039] A vacuuming and sweeping system is most often broken down into 11 elements: 1. A water tank 2. A waste container 3. A water pump 4. Spray nozzles 5. A suction inlet 6. A suction hose 7. Screens 8. A turbine (blower) 9. Side and front screens 10. Drain openings 11. Brushes
[0040] There are different suction and sweeping systems. The differences are minimal, but the operation remains essentially the same.
[0041] The water tank is filled before sweeping. The rubbish bin also contains some water to "stick" the dust by moistening it.
[0042] The water pump supplies water to the brush's spray nozzles. They operate on demand. This allows certain debris to be moistened as needed and then collected by two brushes rotating in opposite directions.
[0043] The skip's blower creates a vacuum that draws waste through the suction inlet. Recirculating water is sprayed to help the waste slide more easily from the suction hose into the skip. Just before the waste enters the skip, the air, water, and waste are separated.
[0044] Air flows through screens and is expelled by the hydraulically driven blower. The water is separated and flows into the recirculation water tank via the side and front screens. Once in the tank, the water is returned to the suction inlet by a recirculation pump.
[0045] The invention offers advantages in particular in the following areas: 1. Scanning optimization
[0046] The sweeper is capable of adapting its energy demand according to the amount of waste detected, analyzed, and mapped. The system can therefore determine whether it needs to use more or less water through the spray nozzles, increase or decrease the power of the energy generator and / or the suction nozzle, manage the rotation speed of the brushes, etc.
[0047] The turbine drive system, which reacts to the waste, impacts the thermal (or electric) engine, the hydraulic pump, the hydraulic motor, and the entire system driving the turbine.
[0048] The sweeper therefore adapts to its environment and can thus have better efficiency in controlling the suction turbine. It operates according to external needs and no longer according to a predefined and non-adaptable model. 2. Reduced wear and tear on sweepers
[0049] The device according to the invention allows the sweeper tools to be used at the opportune time with the appropriate power.
[0050] The lifespan of a sweeper is between 8 and 10 years, corresponding to an average of 7,000 to 10,000 operating hours. Wear and tear is due to intensive use. The introduction of Cortexia's software makes it possible to determine the type of waste, the quantity, and its location.
[0051] This adaptation makes it possible to significantly reduce wear on sweepers at different levels: brushes, suction tubes, seals, filters, suction nozzle, etc.
[0052] This results in an extension of the lifespan of the parts as well as a reduction in the services required. 3. Consumption optimization
[0053] The sweeper no longer needs to run at full speed continuously. This reduces engine usage, which in turn lowers fossil fuel and electricity consumption, ultimately resulting in fewer pollutants being released.
[0054] The amount of water used is regulated according to needs: the type and quantity of waste. Not all waste needs to be moistened. Therefore, it is possible to consume less water, which allows for more frequent trips to refill the water tank and thus reduces thermal energy consumption. 4, Hazardous material detection and sorting
[0055] The data collected by the device of the invention allows harsh and demanding environments with high cleanliness requirements to detect vacuumed items and link them to their source. For example, at an airport, the device can detect parts on the tarmac that correspond to specific aircraft types. Similarly, the sweepers are also capable of sorting accumulated waste according to defined parameters such as hazard level, safety, and the need for recycling. 5. Optimizing the route of the sweepers
[0056] The routes of street sweepers can be programmed and followed manually or automatically, based on parameters such as the level of dirt, the type of waste, the location, the distance to the waste disposal point, or traffic density. In this way, the sweepers move "intelligently" along roads where cleanliness actually needs improvement. This avoids the sometimes unnecessary movement of sweepers along a predetermined route and schedule. 6. Analysis of sweeper routes / Data processing
[0057] The algorithms according to the invention make it possible to use the collected data to create a map of the city and thus provide periodic reports. They make it possible to objectively assess cleanliness and identify areas for intervention (for example, critical locations and waste).
[0058] A history (space and time) is created, allowing us to determine if the cleaning days, durations, and locations are appropriate. This makes it possible to adapt to actual needs. 7. Resource optimization
[0059] The data collected by the device of the invention allows the street cleaning service not to clean more when it is dirty, but to clean better.
[0060] An index translates the perception of cleanliness on a scale of 0 (dirty) to 5 (clean). The city of Zurich, for example, sets a target of 3.5 to 3.7. Neighborhoods that consistently exceed this target are considered too clean. The city will reallocate its resources to areas that fall below the target.
[0061] The accumulated data makes it possible to automate this allocation of resources and to optimize the continuous improvement loop.
[0062] The proposed cleanliness measurement can be used / enhanced by taking concrete actions to improve it in cities. Reports and real-time views of cleanliness in a given location allow for preventive and corrective actions to be taken.11 and 12
[0063] Indeed, there are multiple levers for action to maintain cleanliness, and their effects on cleanliness will be measurable: a) Better inform the public through awareness campaigns b) Better inform the public through targeted campaigns c) Clean better instead of cleaning more d) Better define the needs in terms of technical cleaning resources e) Better allocate technical cleaning resources f) Better value the work of staff through technology g) Better allocate personnel resources h) Optimize infrastructure i) Optimize the use of machinery j) Optimize street furniture k) Improve work efficiency
[0064] These improvements offered by the invention are in line with people's perceptions, with costs and environmental impact.
[0065] For example, the impact of a clean bin compared to a dirty one can be assessed by measuring the percentage reduction in waste, using accumulated data. With a bin, it's possible to evaluate the average distances between two bins and deduce the optimal distance for a given level of cleanliness. It's also possible to assess the suitability of the bin's location, its ideal shape, and its size to achieve maximum efficiency in terms of attractiveness, maintenance, ease of use, and durability.
[0066] The algorithm can consider thousands of possibilities for continuous improvement and seek the optimum for each situation, taking into account a desired perception, a cost, and an environmental impact.
[0067] THE figures 9 And 10 illustrate an example that serves as the basis for a continuous improvement tool. On the figure 9The diagram represents the dirtiness level, the inverse of cleanliness. The higher the number, the more dirt is present, and here three types of waste dominate in this city: paper (the most common), cigarettes (second), and bottles (third). We also observe an increase in this waste depending on the season, with a peak in dirtiness in August in this tourist city.
[0068] On the figure 9The method shows the evolution of the cleanliness index value over a 5-month period between April and August 2019. The values obtained show some streets cleaner than others (highest index = clean). The method therefore allows for allocating more resources to areas that are dirty, while taking resources from areas where excessive cleanliness is observed. The method according to the invention makes it possible to identify the most appropriate solution to achieve the objective of balancing the use of human and material resources.
[0069] As previously stated, the invention is not limited to the analysis and improvement of urban cleanliness.
Claims
1. Method for analysing and monitoring cleanliness in an urban environment in order to improve cleanliness in urban environments, said method comprising the following successive steps: - Planning automatic measurements of at least one environmental parameter in an urban environment, said at least one environmental parameter comprising a variable element that is natural or results from human or animal activity and can be detected using at least one camera; - Real-time monitoring of said at least one environmental parameter using at least one camera carried on board a vehicle or fastened to a static support; - Geolocating said at least one environmental parameter using a central unit connected to said at least one camera; - Classifying, using the central unit, said at least one environmental parameter according to its characteristics such as category, danger or type; and - Improving cleanliness in an urban environment based on the data obtained in the two preceding steps, comprising optimization of the use of at least one street sweeper and its natural resources by adapting the water and electricity used by said at least one street sweeper.
2. Method according to the preceding claim, wherein the energy demand of said at least one street sweeper is adjusted as a function of the quantity of variable element detected, analysed and mapped.
3. Method according to Claim 2, wherein the sweeping power is adjusted as a function of the level of dirtiness.
4. Method according to Claim 2 or 3, wherein the tools of the street sweeper are used at the appropriate time with the appropriate power depending on the variable element type, the variable element quantity and the location of the variable element so as to reduce wear on the street sweepers.
5. Method according to one of Claims 2 to 4, wherein the path of said at least one street sweeper is optimized as a function of the level of dirtiness, the type of waste, the location, the distance to an emptying location, or the density of the traffic.
6. Method according to one of the preceding claims, wherein the distance between trash containers, the location of a trash container, the shape of the trash container or the size of the trash container is optimized.
7. Method according to one of Claims 2 to 6, wherein the allocation of staff resources is optimized.
8. Method according to any one of the preceding claims, wherein the optimization of resources is carried out automatically, so as to create a continuous improvement loop.
9. Method according to one of the preceding claims, wherein a map is drawn with classification and distribution of the different types of waste, based on monitoring or on data and analysis files in the form of records or reports.
10. Device comprising a vehicle or a static support provided with at least one camera (1) connected to a central unit (6) arranged on the vehicle, the static support or in a remote location; said central unit (6) being configured to process images in real time, so as to geolocate and classify at least one environmental parameter, said device being configured to implement the method according to Claim 1.
11. Device according to the preceding claim, said vehicle being a street sweeper.
12. Device according to the preceding claim, comprising means for optimizing suction, sweeping, reducing wear, optimizing consumption, optimizing paths and analysing the routes of said street sweeper as a function of the quantity of variable elements detected, analysed and mapped.