Image acquisition system for automated traffic control
Patent Information
- Application Number
- FR2024005791
- Authority / Receiving Office
- FR · FR
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-06-03
- Publication Date
- 2025-11-07
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
Title of the invention: Image acquisition system for automated traffic control. Technical field
[0001] The present invention relates to a system and method for image acquisition for automated road traffic control. Technical background
[0002] It is common practice to control or monitor road traffic using automated systems comprising speed guns—radar or laser devices for measuring the speed and position of vehicles—and optical systems configured for acquiring images of the interior and / or exterior of vehicles. These automated systems are programmed to detect and characterize certain traffic violations committed by vehicle drivers through the combined analysis of speed gun signals and acquired images. In particular, they make it possible to generate the elements for classifying and proving the violation, and to extract information from the images such as license plate numbers, enabling the identification of the owner of the offending vehicle for the purpose of issuing a traffic ticket.
[0003] The reliability of these automated systems relies in part on the acquisition of images of sufficient quality to identify the elements relevant to characterizing the offense. This identification must be unambiguous regardless of the lighting or weather conditions under which these images are acquired. Therefore, it is essential that the optical systems of automated traffic enforcement systems exhibit the best optical performance, day and night, in good weather or inclement conditions, to ensure perfect correlation between the data from the speed cameras and the images acquired by these systems for each vehicle checked.
[0004] To this end, it is common practice to equip image acquisition systems with a high-intensity lighting device capable of illuminating a vehicle for a brief moment, typically between a few thousandths and a few hundredths of a second, in order to capture its movement and / or compensate for poor lighting conditions when taking a photograph of the vehicle at the moment it commits the offense. This lighting device, commonly called a "photographic flash" or simply "flash," is particularly advantageous in degraded ambient light conditions, especially at night or during inclement weather. It also offers the possibility of obtaining a color image of the vehicle regardless of ambient light conditions. A color image allows generally provides better vehicle identification and is sometimes required by certain laws to establish an offense.
[0005] GB 2272305 A [RICOH KK [JP]] 11.05.1994 describes an image acquisition system for automated traffic enforcement, enabling the acquisition of photographs of a vehicle committing an infraction, such as speeding, at various magnifications and angles. The system includes a stroboscopic flash for illuminating the vehicle during photograph acquisition.
[0006] EP 2 157 558 Al [JENOPTIK ROBOT GMBH] 24.02.2010 describes a method and a road traffic control system in which the intensity of vehicle illumination during control varies according to their position on the roadway. This improves the visibility of elements relevant to characterizing the offense, optimizes energy consumption, and increases the lifespan of the flashing bulbs used for illumination.
[0007] WO 2020 / 014731 Al [ACUSENSUS PTY LTD [AU]] 23.01.2020 describes a road traffic enforcement system comprising a flash-type illumination device configured to illuminate an offending vehicle within a narrow range of the electromagnetic spectrum between 700 and 1000 nm. This type of illumination reduces the negative consequences of glare when acquiring an image of the vehicle and provides better visibility of the vehicle's interior.
[0008] It is also common to equip image acquisition systems for automated traffic control with an infrared image acquisition device, either as a replacement for or in addition to a visible light image acquisition device. The advantage of using an infrared image acquisition device is the ability to reveal certain specific features of the vehicle or its driver that are difficult to see with visible light image acquisition devices, particularly in low-light conditions. These features include the vehicle's registration number and the interior of the passenger compartment. Infrared images can also be digitally processed for calculating vehicle speed.
[0009] CN 101770692 A [UNIV JILIANG CHINA] 07.07.2010 describes a vehicle speed enforcement system comprising an illumination device using near-infrared radiation and an image acquisition device sensitive to said radiation. The system makes it possible to replace the use of a control system based on a visible light flash illumination device, and thus to avoid the use of flash bulbs, which generally have a short lifespan, and to eliminate the risk of dazzling drivers.
[0010] WO 2010 / 085931 Al [JENOPTIK ROBOT GMBH [DE]] 05.08.2010 describes a system for measuring the speed of a vehicle on a section of road. The system comprises two infrared cameras located at opposite ends of the section, configured to acquire an image of a vehicle's license plate. Each camera is associated with a timer for calculating the vehicle's speed. The system further comprises a visible light-sensitive camera and a visible light flash illumination device for acquiring a color image of the vehicle if its speed exceeds the permitted limit.
[0011] US 2013 / 191014 A1 [XEROX CORP [US]] 25.07.2013 describes a speed measurement method for automated traffic control systems based on the digital processing of a plurality of infrared images of a vehicle acquired at a given frequency. The speed is calculated from an estimate of the displacement of a vehicle wheel between two successive images.
[0012] WO 2014 / 163892 A1 [3M INNOVATIVE PROPERTIES CO [US]] 09.10.2014 describes a system for measuring the speed of a vehicle on a road segment. The system comprises two infrared cameras located at opposite ends of the segment and configured to acquire an image of a vehicle's license plate and calculate its speed by time-stamping the difference. The system further comprises a visible light-sensitive camera and a visible light flash illumination device for acquiring a color image of the vehicle if its speed exceeds the permitted limit.
[0013] WO 2017 / 006583 Al [OMRON TATEISI ELECTRONICS CO [JP]] 12.01.2017 describes a road traffic control system configured to acquire monochrome images of offending vehicles under infrared illumination. The monochrome images are subsequently colorized based on the application of an RGB color model in which the intensity of each of the colors red, green, and blue is associated with a range of the infrared electromagnetic spectrum.
[0014] WO 2019 / 137385 A1 [UNIV HEFEI NORMAL [CN]] 18.07.2019 describes a vehicle speed control system comprising an infrared-sensitive camera, a visible-light-sensitive camera, a visible-light illumination device, and a photosensitive sensor. The system has two operating modes depending on ambient lighting conditions: a first mode adapted to degraded ambient lighting conditions in which only the infrared-sensitive camera is used to acquire images of speeding vehicles; a second mode adapted to optimal ambient lighting conditions in which only the visible-light-sensitive camera is used for this acquisition. The visible-light illumination device is used in the second mode to provide supplemental illumination as needed. The system reduces energy consumption, increases the lifespan of its components and reduces the risk of glare for drivers by using high-intensity flash-type illumination devices.
[0015] EP 4 261 803 Al [ROADIA GMBH [DE] 18.10.2023 describes a method and a system for measuring vehicle speed on a road based on an analysis of the direction of velocities calculated for a vehicle from the processing of several images of said vehicle. The system includes a flash device to improve image quality. Summary of the invention Technical problem
[0016] The nature of the physical evidence and the conditions under which it must be acquired to establish proof of a vehicle's violation by an automated traffic enforcement system are generally determined by the laws and regulations in force in the countries, cities, or regions where said system is deployed. They may therefore vary from one country, region, or city to another.
[0017] Also, some laws and / or regulations require, in order for a reported offence to be legally admissible, that a colour photograph of the vehicle in question be provided, the colour photograph then being considered as an element of evidence of the offence allowing the vehicle to be identified unambiguously.
[0018] However, it is well known that a color photograph of sufficient quality to allow clear and unambiguous identification of the elements necessary to establish an offense can only be acquired using a lighting or illumination device of sufficient intensity, particularly when ambient lighting conditions are poor, for example, at night. Image acquisition systems and devices using only or primarily cameras and lighting devices operating in the infrared electromagnetic spectrum are therefore not suitable for meeting such a requirement, including those involving post-processing colorization of the images.
[0019] Furthermore, restrictions imposed by road traffic laws and / or regulations may vary depending on the type or category of vehicles in circulation and / or the area in which they are likely to circulate. For example, speed limits and / or lane change restrictions may differ depending on the tonnage and / or dimensions of vehicles: vehicles with a mass of 3.5 tonnes or more may be subject to a lower maximum speed than other vehicles of a lower mass, as well as a prohibition on overtaking by lane change on certain sections of road. According to other examples, some municipalities may prohibit, permanently or during a given time period, the circulation of certain types of vehicles in certain urban areas as part of a program to combat urban pollution.
[0020] However, while traffic enforcement is increasingly carried out by automated traffic control systems, these systems fail to acquire images in a timely and effective manner, taking into account the restrictions applicable to each vehicle category or driver behavior. In other words, they do not make any positive distinctions based on vehicle category and / or the type of infraction committed. Generally, they systematically acquire images as soon as an infraction is detected, regardless of whether or not it relates to the category of vehicle involved. It also happens that certain vehicle categories are only very rarely checked, for example, vehicles for which the maximum authorized speed is lower than that of another vehicle category.
[0021] Three major drawbacks arise from this situation. First, further processing of violations detected by automated traffic control systems is necessary to eliminate those that are not warranted. Second, certain vehicle categories may escape detection due to limitations inherent in the system. Third, for automated traffic control systems using color photographic devices under visible light, there is excessive and unnecessary use of flash-type illumination devices, resulting in higher energy consumption, a reduced lifespan for said devices, and an increased risk of untimely and unnecessary glare for drivers, particularly in degraded ambient light conditions and / or inclement weather.
[0022] There is therefore a need for a versatile image acquisition system for automated road traffic control capable of providing a quality color photograph of any vehicle in violation conditions according to the legislation and / or regulations applicable to each vehicle category while reducing the superfluous use of flash-type illumination devices and the risk of dazzling drivers. Technical solution
[0023] According to a first aspect of the invention, an image acquisition system for automated road traffic control is provided as described in claim 1, the dependent claims being advantageous embodiments.
[0024] According to a second aspect of the invention, a method for acquiring road traffic control images is provided as described in claim 11, the dependent claims being advantageous embodiments. Brief description of the drawings
[0025] [Fig-1] is a schematic representation of a road controlled by means of a road traffic control unit.
[0026] [Fig.2] is a schematic representation of the structure of an image acquisition system for a road traffic control automation system according to the invention.
[0027] [Fig.3] is a process diagram of an image acquisition system for a road traffic control automation system according to the invention.
[0028] [Fig.4] is a process diagram of an image acquisition system for a road traffic control automation system according to certain embodiments. Detailed description of the implementation methods
[0029] For the purposes of this invention, a "category" of vehicles means a category representing a distinctive characteristic of a type of vehicle, in particular its size (height and / or length), weight, number of axles, and / or engine. For example, in France, a category may be one of the eight main vehicle categories, or one of their subcategories, as defined by Article R311-1 of the French Highway Code in force on May 15, 2024.
[0030] With reference to [Fig. 1], by way of example, a traffic control device 1001 is positioned near a road 1002 on which a vehicle 1003 is traveling. Equivalently, the traffic control device 1001 can be mounted on a bridge or gantry crossing the road 1002, or even on a gantry. The road 1002 can be any type of traffic area allowing vehicle traffic, for example, a highway, a street, a path, etc. Preferably, the road 1002 comprises at least two traffic lanes 1002a, 1002b. The traffic lanes 1002a, 1002b are generally delimited by markings applied to the surface of the road 1002. These markings are generally visual signs such as a solid line, a broken line, or cones.
[0031] The automated traffic control unit 1001 is generally fixed relative to the traffic lanes 1002a and 1002b of road 1002. It is located at a defined distance from the edge of the road to allow sufficient clearance. It is preferably mounted at a height greater than 1.2 m, or even greater than 2 m, or even greater than 3 m. For this purpose, the automated traffic control unit 1001 can be mounted on a mast or a gantry (not shown). The elevated positioning of the automated traffic control unit 1001 helps to limit the obstruction of the detection fields of the speed camera and the optical systems of the automated traffic control unit 1001.
[0032] Generally, for speed control, the control unit 1001 is oriented towards an offense line 1005 which serves as a reference line. This offense line 1005 is generally a virtual line whose position is determined during the installation of the control unit 1001. For monitoring of crossing a stop line, such as a traffic light or stop line, the offense line 1005 is often a road marking.
[0033] According to a first aspect of the invention, with reference to [Fig. 2] & 3, a 2000 image acquisition system for a 1001 road traffic control automated system is provided, comprising: - a 2001 infrared illumination device; - a 2002 camera sensitive to infrared radiation; - a 2003 road vehicle tracking device; - a 2004 visible light flash-type lighting device; - a 2005 color photographic device; - a 2006 data processing device configured to process IM-IR infrared images acquired by the 2002 camera sensitive to infrared radiation by applying a first ALG-1 classification algorithm previously trained to detect vehicles 1003, said algorithm being further previously trained to classify vehicles 1003 according to their CAT category, and / or classify one or more COMP behaviors of the drivers of vehicles 1003; System 2000 is configured to perform the following steps: (a) measure 3001 the TRJ trajectory, POS position and VIT speed of at least one vehicle 1003 using the road vehicle tracking device 2003; (b) illuminate 3002 the vehicle 1003 using the infrared illumination device 2001; (c) acquire 3003, using the infrared-sensitive camera 2002, at least one IM-IR infrared image of the vehicle 1003 illuminated by the infrared illumination device 2001; (d) process 3004 the IM-IR infrared image of said vehicle 1003 using the data processing device 2006; when the vehicle's speed (VIT), vehicle position (POS), vehicle category (CAT), and / or driver behavior (COMP) meets at least one CR-INF infraction criterion: (e) illuminate 3005 the vehicle using the visible light lighting device; (f) acquire 3006 an IM-VIS color image of the illuminated vehicle 1003 using the color photographic device 2005.
[0034] By CRIT-INF criterion of infringement, it is understood that any criterion of infringement which can be defined on the basis of laws and / or regulations concerning prohibitions is understood to mean and restrictions affecting the vehicle's VIT speed, vehicle's POS position, vehicle's CAT category, and / or a driver's COMP behavior at the location of the 1001 road automation system installation.
[0035] The processing device 2006 can be of any suitable type. In particular, it can be a controller-type electronic circuit. The electronic circuit can include one or more central processing units (CPUs) and / or one or more graphics processing units (GPUs). It can also include other electronic components such as input / output interfaces, non-volatile or volatile storage devices, and communication buses for data transfer between internal components of the device or with external components. One of the input / output devices can be a user interface for human-machine interaction, for example, a graphical user interface for displaying human-understandable information during a maintenance operation.
[0036] The data processing device 2006 can perform its assigned tasks by executing a computer program. This program comprises instructions which, when executed by the data processing device, cause the device to carry out the configuration procedure. The computer program can comprise instructions written in any type of programming language, compiled or interpreted.
[0037] According to certain advantageous embodiments, a CR-INF violation criterion for the vehicle speed VIT 1003 is exceeding the maximum authorized speed for one or more vehicle categories (CAT) (1003). For example, in France, where legislation imposes a maximum speed of 130 km / h on roads for vehicles of category M1 (cars) or L (motorcycles) and a maximum speed of 90 km / h for vehicles of categories M2, M3 (buses), N and O (trucks, motorhomes), the violation criterion may be one of these limitations applied to said categories.
[0038] One advantage of this embodiment is that it employs positive discrimination based on the vehicle category and the maximum speed limit for that category. Thus, a color image will only be acquired when the speed of a vehicle in a defined category exceeds the maximum speed limit for that vehicle category. The violation can then only be detected for that vehicle category; the system does not acquire images of vehicles in other categories, even if their speed also exceeds the aforementioned maximum speed limit.
[0039] In addition to speed control, the system according to the invention is adapted to characterize other types of offenses. Thus, according to certain advantageous embodiments, the CR-INF offense criterion for the TRJ trajectory and / or the POS position of the vehicle 1003 is chosen from among the unauthorized crossing of a stop line, failure to respect distances between vehicles, prohibition of road traffic in a defined geographical area, prohibition of traffic on a road for one or more categories of vehicle, unauthorized overtaking of one vehicle by another according to one or more categories of vehicle.
[0040] By way of example, an unauthorized crossing of a stop line may be the unauthorized crossing of a traffic light line or a stop line such as a "stop" sign. A road traffic ban in a defined geographical area may be a ban on the circulation of certain vehicles considered polluting in certain low-emission urban areas, or temporary traffic bans for reasons of safety and / or public health. A ban on circulation on a roadway for one or more categories of vehicles may be a ban on circulation on lanes reserved for certain categories of vehicles such as buses, taxis, or certain electric vehicles.
[0041] The CR-INF offense criterion may also relate to certain driver behaviors, particularly when considered risky or dangerous under applicable law. In this respect, according to certain embodiments, the CR-INF offense criterion for the COMP behavior of the vehicle driver 1003 is selected from the use of a prohibited device by the vehicle driver and the failure to wear personal protective equipment. Examples of the CR-INF offense criterion relating to the use of a prohibited device may include the driver's use of a mobile telecommunications device or any other electronic device likely to distract the driver, such as a mobile phone, an interactive tablet, or a television.
[0042] Although the registration number is not always required to identify the perpetrator of a traffic violation, most national legislations nevertheless refer to this number to identify the owners of offending vehicles when issuing a traffic ticket. Therefore, according to certain advantageous embodiments, the first ALG-1 classification algorithm is further trained beforehand to extract the vehicle registration number from infrared images.
[0043] In addition to identifying the owner of the offending vehicle, the extraction of the The registration number can also be used to detect an offense when an offense criterion applies to that number. Thus, according to certain preferred embodiments, the system is further configured to perform steps (e) and (f) when the registration number meets at least one CR-INF offense criterion. For example, vehicle traffic in a defined geographic area, such as an urban area, may be permitted only to a certain number of vehicles. restricted to vehicles identified by their registration number. In other words, a list of vehicles identified by their registration number is established beforehand, and only vehicles on this list are authorized to circulate within the defined geographical area. Any vehicle circulating at the automated control point whose registration number is not on the list of authorized vehicles is in violation; steps (e) and (f) are then executed. The list of registration numbers of authorized vehicles can be of any type. It can be a list of specifically authorized vehicles regardless of their category. It can also be a list of vehicles from one or more particular categories whose registration number is associated with those categories, for example, category M1 vehicles (cars) for France, or vehicles with a specific type of engine, such as electric or hybrid.
[0044] The detection of an offense by an automated traffic enforcement system, particularly with regard to the elements defining the offense, can sometimes fail or be marred by fatal errors that prevent the offense from being legally validated. Furthermore, certain laws or regulations may require that the elements defining the offense be detected on color images rather than infrared images. According to certain advantageous embodiments, with reference to [Fig. 4], the 2006 data processing device is further configured to perform the following steps: (g) process 3007 the IM-VIS color image of vehicle 1003 acquired using photographic device 2005 by applying a second ALG-2 classification algorithm previously trained to detect, from said IM-VIS color images, vehicles 1003, said algorithm being further previously trained to classify vehicles according to their CAT category, and / or classify one or more COMP behaviors of drivers of vehicles 1003; (h) compare 3008 the information inferred during processing by the first ALG-1 algorithm with the information inferred from processing by the second ALG-2 classification algorithm; (i) validate 3009 the information inferred during processing by the first ALG-1 algorithm if said information corresponds to that inferred during processing by the second ALG-2 classification algorithm.
[0045] Comparing the information inferred by the two algorithms ALG-1 and ALG-2 ensures a double verification of the typing elements used to detect the infringement. The risk of errors is reduced, and because the typing is also performed on color images, it complies with the requirements of certain relevant laws and regulations.
[0046] For the implementation of the invention, the first classification algorithm and / or the second classification algorithm is of any type suitable for performing object classification based on image analysis. According to some preferred embodiments, the first classification algorithm ALG-1 and / or the second classification algorithm ALG-2 are convolutional artificial neural networks, preferably convolutional artificial neural networks adapted for execution on embedded systems. Examples of consultative neural networks are the MobileNet versions as described in Howard, Andrew G., et al. (2017) "Mobilenets: Efficient convolutional neural networks for mobile vision applications." arXiv preprint arXiv: 1704.04861; Sandler, Mark, et al. (2018) "Mobilenetv2: Inverted residuals and linear bottlenecks." Proceedings of the IEEE conférence on computer vision and pattern récognition ; Howard, Andrew, et al. (2019) "Searching for mobilenetv3." Proceedings of the IEEE / CVF international conférence on computer vision ; Qin, Danfeng, et al. (2024) "MobileNetV4-Universal Models for the Mobile Ecosystem." arXiv preprint arXiv:2404.10518. .
[0047] According to a first example, particularly suitable for embodiments in which a CR-INF violation criterion for the vehicle's speed (VIT) is exceeding the maximum authorized speed for one or more vehicle categories (CATs) (VCs) (VCs) (V) (V), the first ALG-1 classification algorithm is a MobileNetv2-type convolutional neural network. The network is pre-trained on a set of images of road vehicles classified into 13 categories. The training set may include a substantially similar number of images, infrared or visible light, of vehicles for each category. Alternatively, it may include a different number of images for each category, this number being representative of the frequency with which vehicles of each category travel on the road.For example, on a road where category N or O vehicles (heavy goods vehicles) according to French legislation represent 40% of road traffic, the training set can consist of at least 40% images of this category.
[0048] According to a second example, particularly suitable for embodiments in which the CR-INF criterion for the COMP behavior of the driver of vehicle 1003 is chosen from the use of a device prohibited by the driver of the vehicle and the non-wearing of personal protective equipment, the first ALG-1 classification algorithm is a convolutional neural network comprising two modules.
[0049] A first module is configured to detect and delimit the portion of vehicle images corresponding to the driver. To this end, it may be pre-trained on a set of training images comprising Vehicle images in which the portion of the image corresponding to the driver is annotated. A second module is configured to detect the presence or absence of an infraction. To do this, it can be pre-trained on a set of training images comprising vehicle images categorized according to whether the vehicle drivers are committing an infraction, such as the use or non-use of a prohibited device, for example a mobile phone, or the wearing or non-wearing of safety equipment, for example a helmet for two-wheeled vehicles or a seatbelt.
[0050] The 2003 road vehicle tracking device is any device adapted and configured to measure the POS position, TRAJ trajectory and / or VIT speed of road vehicles on the traffic lane(s) where a road traffic control system is likely to be operated.
[0051] The tracking device 2003 may, in particular, exploit echo and / or reflection phenomena of electromagnetic waves. According to preferred embodiments, the vehicle tracking device 2003 (1003) comprises a rangefinder, preferably of the Lidar or RADAR type.
[0052] In addition or as an alternative, the tracking device 2003 may be a video image acquisition and processing device configured to measure the position POS, trajectory TRAJ, and / or speed VIT based on an analysis of said images. Accordingly, in certain embodiments, the vehicle tracking device 2003 includes a video acquisition device configured to determine the position and trajectory of vehicles from a video.
[0053] According to a second aspect of the invention, with reference to [Fig.3], an image acquisition method for automated traffic control is provided, said method comprising the following steps: (a) measure 3001 the trajectory TRAJ, the position POS and the speed VIT of at least one vehicle 1003; (b) illuminate vehicle 1001 3002 using infrared radiation; (c) acquire at least one IM-IR infrared image of the vehicle illuminated by said infrared radiation; (d) process 3004 the IM-IR infrared image of said vehicle 1003 by applying a first ALG-1 classification algorithm previously trained to detect vehicles 1003, said algorithm being further previously trained to classify vehicles according to their CAT category, and / or classify one or more COMP behaviors of the drivers of vehicles 1003; when the vehicle's speed (VIT), vehicle position (POS), vehicle category (CAT 1003), and / or driver behavior (COMP) meets at least one criterion for an offense: (e) illuminate vehicle 1003 using visible light; (f) acquire an IM-VIS color image of the illuminated vehicle 1003 using visible light.
[0054] A method according to the second aspect of the invention can, in particular, be implemented by the system according to the first aspect of the invention. All embodiments described above concerning the system according to the first aspect of the invention apply mutatis mutandis to the method according to the second aspect of the invention.
[0055] In particular, according to certain preferred embodiments, the first ALG-1 classification algorithm is further pre-trained to extract, from infrared images, the vehicle registration number, and steps (e) and (f) when the registration number meets at least one CRIT-INF violation criterion.
[0056] According to certain preferred embodiments, the process further comprises the following steps: (g) process the IM-VIS color image of vehicle 1003 by applying a second ALG-2 classification algorithm previously trained to detect, from said color images, the vehicles, said algorithm being further previously trained to classify vehicles 1003 according to their CAT category, and / or classify one or more COMP behaviors of drivers of vehicles 1003; (h) compare the information inferred during processing by the first ALG-1 algorithm with the information inferred from processing by the second ALG-2 classification algorithm; (i) validate the information inferred during processing by the first ALG-1 algorithm if said information corresponds to that inferred during processing by the second ALG-2 classification algorithm. References Literature patent
[0057] GB 2272305 A [RICOH KK [JP]] 11.05.1994.
[0058] EP 2 157 558 Al [JENOPTIK ROBOT GMBH] 02.24.2010.
[0059] CN 101770692 A [UNIV JILIANG CHINA] 07.07.2010.
[0060] WO 2010 / 085931 Al [JENOPTIK ROBOT GMBH [DE]] 05.08.2010.
[0061] US 2013 / 191014 Al [XEROX CORP [US]] 07.25.2013.
[0062] WO 2014 / 163892 Al [3M INNOVATIVE PROPERTIES CO [US]] 09.10.2014.
[0063] WO 2017 / 006583 Al [OMRON TATEISI ELECTRONICS CO [JP]] 12.01.2017.
[0064] WO 2019 / 137385 Al [UNIV HEFEI NORMAL [CN]] 18.07.2019.
[0065] WO 2020 / 014731 Al [ACUSENSUS PTY LTD [AU]] 23.01.2020.
[0066] EP 4 261 803 Al [ROADIA GMBH [DE] 18.10.2023. Littérature non-brevet
[0067] Andrew G., et al. (2017) "Mobilenets: Efficient convolutional neural networks for mobile vision applications." arXiv preprint arXiv: 1704.04861.
[0068] Mark, et al. (2018) "Mobilenetv2: Inverted residuals and linear bottlenecks." Proceedings of the IEEE conférence on computer vision and pattern récognition.
[0069] Howard, Andrew, et al. (2019) "Searching for mobilenetv3." Proceedings of the IEEE / CVF international conférence on computer vision.
[0070] Qin, Danfeng, et al. (2024) "MobileNetV4-Universal Models for the Mobile Ecosystem." arXiv preprint arXiv:2404.10518.
Claims
1. Demands Image acquisition system (2000) for automated road traffic control system (1001) comprising: - an infrared illumination device (2001); - a camera (2002) sensitive to infrared radiation; - a device (2003) for tracking road vehicles; - a visible light flash-type lighting device (2004); - a photographic device (2005) in color; - a data processing device (2006) configured to process infrared images (IM-IR) acquired by the camera (2002) sensitive to infrared radiation by applying a first classification algorithm (ALG-1) previously trained to detect vehicles (1003), said algorithm being further previously trained to classify vehicles (1003) according to their category (CAT), and / or classify one or more behaviors (COMP) of the drivers of the vehicles (1003); the system (2000) is configured to perform the following steps: (a) measure (3001) the trajectory (TRJ), position (POS) and speed (VIT) of at least one vehicle (1003) using the road vehicle tracking device (2003); (b) illuminate (3002) the vehicle (1003) using the infrared illumination device (2001); (c) acquire (3003), using the infrared-sensitive camera (2002), at least one infrared image (IM-IR) of the vehicle (1003) illuminated by the infrared illumination device (2001); (d) process (3004) the infrared image (IM-IR) of said vehicle (1003) using the data processing device (2006); when the vehicle speed (VIT), vehicle position (POS), vehicle category (CAT), and / or driver behavior (COMP) meets at least one (CR-INF) offence criterion: (e) illuminate (3005) the vehicle using the lighting device in visible light; (f) acquire (3006) a color image (IM-VIS) of the illuminated vehicle (1003) using the color photographic device (2005).
2. System (2000) according to claim 1, wherein the (CR-INF) violation criterion for the speed (VIT) of the vehicle (1003) is exceeding the maximum authorized speed for one or more categories (CAT) of vehicles (1003).
3. System (2000) according to any one of claims 1 to 2, wherein the (CR-INF) violation criterion for the trajectory (TRJ) and / or the position (POS) of the vehicle (1003) is selected from unauthorized crossing of a stop line, failure to maintain distances between vehicles, prohibition of road traffic in a defined geographical area, prohibition of traffic on a road lane for one or more vehicle categories, unauthorized overtaking of one vehicle by another according to one or more vehicle categories.
4. System (2000) according to any one of claims 1 to 3, wherein the criterion (CR-INF) for the behavior (COMP) of the driver of the vehicle (1003) is selected from the use of a prohibited device by the driver of the vehicle and the failure to wear personal protective equipment.
5. System (2000) according to any one of claims 1 to 4, wherein the first classification algorithm (ALG-1) is further pre-trained to extract vehicle registration numbers from infrared images.
6. System (2000) according to claim 5, further configured to perform steps (e) and (f) when the registration number satisfies at least one (CR-INF) violation criterion.
7. System (2000) according to any one of claims 1 to 6, wherein the data processing device (1006) is further configured to perform the following steps: g) process the color image (IM-VIS) of the vehicle (1003) acquired using the photographic device (2005) by applying a second classification algorithm (ALG-2) previously trained to detect, from said color images (IM-VIS), the vehicles (1003), said algorithm being further previously trained to classify the vehicles according to their category (CAT), and / or classify one or more behaviors (COMP) of the drivers of the vehicles (1003); (h) compare the information inferred during processing by the first algorithm (ALG-1) with the information inferred from processing by the second classification algorithm (ALG-2); (i) validate the information inferred during processing by the first algorithm (ALG-1) if said information corresponds to that inferred during processing by the second classification algorithm (ALG-2).
8. System (2000) according to any one of claims 1 to 7, such that first classification algorithm (ALG-1) and / or second classification algorithm (ALG-2) are convolutional artificial neural networks.
9. System according to any one of claims 1 to 7, such that the vehicle tracking device (1003) (2003) comprises a rangefinder, preferably of the LIDAR or RADAR type.
10. System according to any one of claims 1 to 8, such that the vehicle tracking device (1003) (2003) further comprises a video acquisition device configured to determine the position and trajectory of vehicles from a video.
11. Image acquisition method for an automated traffic control system (1001), said method comprises the following steps: (a) measuring (3001) the trajectory (TRAJ), position (POS) and speed (VIT) of at least one vehicle (1003); (b) illuminating (3002) the vehicle (1001) with infrared radiation; (c) acquiring (3003) at least one infrared image (IM-IR) of the vehicle (1003) illuminated by said infrared radiation; (d) processing (3004) the infrared image (IM-IR) of said vehicle (1003) by applying a first classification algorithm (ALG-1) previously trained to detect vehicles (1003), said algorithm being further previously trained to classify vehicles according to their category (CAT), and / or classify one or more behaviors (COMP) of the drivers of the vehicles (1003);when the vehicle's speed (VIT), vehicle position (POS), vehicle category (CAT) (1003), and / or driver conduct (COMP) meets at least one offence criterion: (e) illuminating (3005) the vehicle (1003) with visible light; (f) acquiring a colour image (IM-VIS) of the vehicle illuminated (1003) with visible light.
12. A method according to claim 11, wherein the first classification algorithm (ALG-1) is further pre-trained to extract vehicle registration numbers from infrared images and perform steps (e) and (f) when the registration number meets at least one (CRIT-INF) violation criterion.
13. The method according to claim 12, further comprising the following steps: (g) process the color image (IM-VIS) of the vehicle (1003) by applying a second classification algorithm (ALG-2) previously trained to detect, from said color images, the vehicles, said algorithm being further previously trained to classify the vehicles (1003) according to their category (CAT), and / or classify one or more behaviors (COMP) of the drivers of the vehicles (1003); (h) compare the information inferred during processing by the first algorithm (ALG-1) with the information inferred from processing by the second classification algorithm (ALG-2); (i) validate the information inferred during processing by the first algorithm (ALG-1) if said information corresponds to that inferred during processing by the second classification algorithm (ALG-2).
Citation Information
Patent Citations
Far infrared light-supplemented system for snapping violated vehicles on road
CN101770692A
Method and device for photographing a vehicle
EP2157558A1
Method and system for measuring the speed of vehicles in road traffic
EP4261803A1
Vehicle photographing apparatus
GB2272305A
Vehicle speed determination via infrared imaging
US20130191014A1