Active tram passenger safety system using machine vision technology and adaptive laser illumination in stop area

Abstract

FIELD: transport safety.SUBSTANCE: systems for ensuring the safety of passengers in urban ground transport. The active complex for ensuring the safety of tram passengers using machine vision technologies and adaptive laser illumination in the stop area contains a system of digital video cameras using machine vision technologies to improve the accuracy of determining passengers and vehicles participating in road traffic, carries out continuous video analysis of ground vehicles and passengers located in the pick-up and drop-off area of stops, and transmits control signals to the adaptive laser illumination system of the passenger pick-up and drop-off zone, located in the upper part of the tram cars on the side where the doors open, and an LED traffic light located in the driver's field of binocular vision, also includes a source of sound notification for ground vehicles in order to prevent the occurrence of emergency situations.EFFECT: increasing the safety of tram passengers during pick-up and drop-off and preventing emergency situations.10 cl, 5 dwg

Description

[0001] Field of technology to which the invention relates

[0002] The invention relates to devices for ensuring the safety of passengers on urban rail ground transportation, in particular, to signaling devices for the movement and stop of public transport. The system enables the creation of conditions for ensuring the safety of tram passengers by introducing additional signaling devices and drivers of vehicles participating in road traffic, such as cars, buses, motorcycles, bicycles, and other ground vehicles. It also improves the level of information provided to tram passengers during boarding and disembarking, taking into account anatomical, behavioral, and psychological factors. This allows for the creation of conditions for preventing potential emergency situations and reducing passenger injuries.

[0003] In the dynamically changing flow of urban traffic, the information field in the form of road signs, including those equipped with lighting systems, is oversaturated for human perception. Therefore, the development of such an intelligent transportation system could create additional conditions for focusing attention and enhancing safety measures in interactions between personal ground transportation, urban passenger ground rail transport, and passengers.

[0004] Description of the invention

[0005] When organizing tram stops with passengers exiting onto the roadway, these stops are made in locations not equipped with dedicated, separate stop shelters for boarding and disembarking passengers. Vehicles traveling behind and to the right of the tram, on the side where the doors open, are required to stop before the tram doors open to ensure the safe boarding and disembarking of passengers. Tram stops are designated by "Tram Stop" signs posted above the roadway, as well as a yellow zigzag line painted on the road surface. Additionally, a "Attention, Passenger!" sign is placed on the rear of the tram, informing drivers of other vehicles that the boarding and disembarking procedure has begun.

[0006] In accordance with paragraph 14.6 of the Russian Federation Traffic Regulations, "If the "Attention, passenger!" light sign is on a stopped public transport vehicle, a driver approaching from behind must stop in front of marking 1.17.2, or, if there is none, in front of the public transport vehicle, without obstructing pedestrians boarding or disembarking from the roadway or from the boarding area located thereon. Driving is permitted only when there are no pedestrians on the roadway and after the "Attention, passenger!" light sign has been turned off. However, drivers often ignore these signals and do not comply with this rule due to anatomical, psychological, and behavioral factors, and continue driving, which creates situations of increased danger on sections of the road where such stops are located.It is necessary to implement additional measures to improve the information provided to drivers about the moment when trams stop and the beginning of the process of boarding and disembarking passengers, in order to ensure that vehicles traveling behind and to the right of the tram come to a complete stop.

[0007] In the dynamically changing flow of urban traffic, the information field in the form of road signs, including those equipped with lighting systems, is oversaturated for human perception. Therefore, the creation of an intelligent transportation system is required to emphasize and enhance safety measures in the interactions between personal ground transportation, urban passenger ground rail transport, and passengers.

[0008] The active tram passenger safety system, using machine vision technology and adaptive laser illumination at the stop, is a device designed to ensure the safety of passengers on urban rail transport using a video analytics and signaling system at public transport stops (trams). This active tram passenger safety system, using machine vision technology and adaptive laser illumination at the stop, includes a system of digital video cameras with various lens types, machine vision technology, lidars, and pulse-Doppler radars to improve the accuracy of passenger and vehicle detection.An active tram passenger safety system using machine vision technology and adaptive laser illumination at the stop area continuously analyzes vehicles and passengers in the boarding and alighting areas of tram stops. The device is equipped with adaptive laser illumination located on the top of tram cars on the door opening side. The active tram passenger safety system, using machine vision technology and adaptive laser illumination at the stop area, regulates the parameters of the adaptive laser illumination in the passenger boarding and alighting areas and door monitoring based on data received from digital video cameras using machine vision technology.An LED traffic light, located on the rear (tail) of the tram car and within the binocular field of view of the driver operating the vehicle behind it on the road lanes parallel to the tram's path, adjacent to the passenger boarding and alighting area, changes its signals depending on the tram's progress. The device system includes an audible warning system for ground vehicles to prevent potential emergency situations. The device's hardware and software processes the signals according to preset algorithms and transmits them to the appropriate devices.The main technical result of this invention is to increase the level of safety for tram passengers during boarding and disembarking, as well as to prevent potential emergency situations, as well as to improve safety measures and focus attention during interactions between personal ground transport, urban passenger ground rail transport, and passengers.

[0009] State of the art

[0010] The following devices are closest in technical essence.

[0011] A device is known for signaling when a tram stops, containing a light board saying “Attention, passenger!”

[0012] [https: / / www.consultant.ru / document / cons_doc_LAW_2709 / 7c45508e360f5b7b8ae1443d73feb01f52a6199d / ]. One of the key drawbacks of this device is its limited functionality. The light board with the inscription "Attention, passenger!" serves solely as a visual alert, without providing additional information about the current state of the traffic situation surrounding the tram, the stages of its journey, or the actions of the tram driver. These limitations reduce the effectiveness of accident prevention, since the device does not take into account a dynamic environment, such as the simultaneous presence of passengers and vehicles participating in traffic in the area of ​​​​the tram's stop and passenger boarding / disembarking. This device is not equipped with video analytics and adaptive laser illumination of the passenger boarding / disembarking area, which reduces its ability to accurately and timely respond to changes in the tram's surrounding environment.

[0013] The lack of such technologies limits the device's ability to automatically detect and account for objects in the immediate vicinity of the tram, which could lead to insufficient passenger safety during boarding and alighting. It should also be noted that the illuminated display does not integrate with other transport system elements, such as sound alarms or automatic door control systems, which reduces the comprehensive approach to ensuring passenger safety and improving coordination during tram stops.

[0014] This sign is also located outside the human binocular field of vision, within the peripheral field of vision, which reduces its visibility and effectiveness. In the peripheral field of vision, objects are perceived less clearly and with less detail, which can lead to insufficient attention from drivers. This, in turn, increases the risk that drivers will not notice the sign, especially in busy tram traffic and visually impaired conditions.

[0015] Furthermore, the placement of the sign in the peripheral field of vision may not provide sufficient visibility in bright sunlight or adverse weather conditions such as rain or snow. This further reduces the likelihood that drivers will notice the illuminated sign and take the necessary steps to ensure safe operation. Insufficient visibility and limited visibility of the sign in the peripheral field of vision can significantly reduce its effectiveness in warning drivers and improving overall safety during tram stops.

[0016] Thus, although it has a visual warning function, this device does not provide sufficient protection for passengers and is not integrated into a wider safety system, which limits its effectiveness and functionality.

[0017] A device called "Tram Stop Safety System" [Patent RU191581U1] is known. The main drawback of this device is the lack of integration with modern video analytics technologies and adaptive laser illumination of the passenger boarding and alighting area, which could significantly improve safety. The device described in the patent relies on basic mechanical and visual signals, which limits its functionality and adaptability to complex urban conditions. Furthermore, the system does not include intelligent functions for dynamically responding to changes in the environment. This means that the device cannot effectively monitor and analyze the situation in real time, which is critical for ensuring safety in the dynamically changing traffic conditions in the immediate vicinity of tram stops.

[0018] The lack of automatic detection and identification of objects such as pedestrians and vehicles reduces the ability to prevent potential accidents. It's also worth noting that this device does not provide a mechanism for more precise and comprehensive safety management, such as integration with other transportation systems or automation of alert and control processes. This limits its effectiveness in high-traffic and complex traffic situations.

[0019] A device for signaling drivers of passing vehicles about a stopped public transport vehicle is known [Patent RU131890U1]. The main drawback of this device is the limited functionality of the system, which focuses primarily on visual signals, such as light indicators, designed to notify drivers of passing vehicles. This limits its ability to effectively interact with other elements of the transport infrastructure and does not take into account the possibility of comprehensive situation monitoring in real time. The device also does not incorporate modern technologies for environmental analysis, such as video analytics systems. The lack of such technologies reduces the accuracy and reliability of detection and notification of vehicles located in the boarding / disembarking area of ​​a tram stop, which can lead to insufficient information and an increased risk of accidents.

[0020] The device also lacks adaptive features that would allow it to dynamically change signals based on current conditions, such as the tram's progress, passenger boarding and alighting, lighting changes, weather conditions, or traffic density. This limits its effectiveness in challenging environments where standard signals may be ineffective.

[0021] A tram device is known for signaling drivers of wheeled vehicles traveling in the same direction about the start of passenger boarding and disembarking [Patent RU119152U1]. The main drawback of this device is the limited information content and one-way nature of the signals. The device uses only visual mechanical signals. This limitation does not take into account the need to provide additional information or context about the current situation, which can reduce the effectiveness of the signaling in highly dynamic traffic conditions. The device does not have adaptive features, such as LED backlighting, making it invisible to drivers at night. This limits its effectiveness in various conditions, as these signals may not be sufficiently visible or relevant in dynamic traffic conditions.

[0022] A device for blocking the opening of tram doors is known [Patent RU191687U1]. The main drawback of this device is the lack of modern technologies for analyzing the traffic situation around the tram, such as video analytics systems. This limits the accuracy and reliability of detection and notification of vehicles in the tram stop entry and exit areas, which can lead to insufficient information and an increased risk of accidents.

[0023] The known device is not designed to identify objects in the passenger boarding and disembarking area—the motion sensor is triggered regardless of the type of moving object. The motion sensor, mounted on the tram body and designed to detect objects such as moving vehicles within a range of 1 to 50 meters, may register false signals, which could lead to unjustified blocking of door controls and possible inconvenience for passengers.

[0024] Furthermore, the lack of adaptability to different operating conditions and scenarios may reduce the overall efficiency of the device and require additional costs for its setup and maintenance.

[0025] Problems that the invention is aimed at solving

[0026] 1. Improving visibility for road users - motorists, motorcyclists, bus drivers and other types of vehicles participating in traffic in the boarding and alighting area of ​​tram stops in low-light conditions: the use of adaptive laser illumination to increase the visibility of the passenger boarding and alighting area helps to increase the concentration of drivers in this area in low-light conditions or at night, which helps prevent potential accidents.

[0027] 2. Improving the efficiency of passenger boarding and disembarking management, namely, ensuring accurate and reliable recognition of objects located in the boarding and disembarking areas of tram stops, including passengers and vehicles participating in traffic, using machine vision technologies. The active passenger safety system of the tram provides early warning of potentially dangerous road situations and helps prevent accidents.

[0028] 3. Ensuring effective monitoring and recording of traffic violations by vehicles located in the boarding and alighting areas of tram stops: digital information obtained from digital video camera systems with various types of lenses using machine vision technologies, lidars and pulse-Doppler radars to improve the accuracy of identifying passengers and vehicles participating in road traffic, and processed on a hardware and software complex can be transmitted to video recording centers for traffic violations by vehicles - the State Traffic Safety Inspectorate of the Main Directorate of the Ministry of Internal Affairs of the Russian Federation or another authorized agency of the Russian Federation, for making a procedural decision on the violation in accordance with current legislation.

[0029] 4. Prevention of emergency situations in the area of ​​tram stops by timely warning of vehicles in difficult traffic situations: the device contains a sound warning source for ground vehicles, activated to prevent the occurrence of possible emergency situations based on data received by the hardware and software complex in real time from a system of digital video cameras using machine vision technologies.

[0030] 5. Improving the visibility and safety of the tram at various stages of its movement, including in conditions of limited visibility: an LED traffic light, located on the rear side of the rear (tail) part of the tram car body, in the field of binocular vision of the driver operating the vehicle moving behind on the road lanes parallel to the movement of the tram, associated with the area of ​​​​passenger boarding and disembarking, changes the signals in accordance with a pre-set algorithm depending on the stages of the tram's movement and data received from a system of digital video cameras using machine vision technologies.

[0031] 6. Strengthening safety measures and focusing attention on the interaction between personal ground transport, urban passenger ground rail transport, and passengers.

[0032] 7. Safe control of tram door opening and closing: achieved through the use of a hardware and software system based on an industrial computer. This system sends signals to the tram door opening and closing control interlock, including the targeted door opening interlock, based on real-time data from digital video cameras using machine vision technologies about objects in the passenger boarding and disembarking area, such as cars, motorcycles, buses, and other ground vehicles. The system operates automatically, but manual priority control is also possible via signals transmitted from the tram driver's control panel.

[0033] Disclosure of the invention. Technical result

[0034] The active tram passenger safety system using machine vision technology and adaptive laser illumination in the stop area contains a system of digital video cameras with various types of lenses using machine vision technology, lidars and pulse-Doppler radars to improve the accuracy of identifying passengers and vehicles involved in road traffic.

[0035] The digital video camera system using machine vision technologies provides continuous video analytics of ground vehicles and passengers located in the boarding and disembarking areas of tram stops by video recording the traffic situation surrounding the tram from the door opening area (the right side of the car body) and behind the tram.

[0036] Video cameras using machine vision technology are located at the top of tram cars on the right side of the car body, near the door opening, at the top of the front (head) and at the top of the rear (tail) of the tram. Machine vision cameras provide continuous video analysis of the traffic situation using object recognition, classification, and tracking techniques.

[0037] Long-range and wide-angle cameras monitor traffic conditions in the area where tram doors open, in the area where passengers board and disembark at tram stops, and behind the tram. Object detection and object tracking algorithms, such as YOLO (You Only Look Once), are used in industrial computers to recognize and classify objects, as well as track their trajectories in the video stream, including pedestrians and vehicles.

[0038] LiDAR sensors emit optical laser pulses and measure their return time after reflection from objects (pedestrians and vehicles), enabling the creation of precise 3D maps of the tram's surrounding traffic, including parameters such as object shapes and distances. The data received in real time from the lidars creates a detailed 3D point cloud that displays the distances to objects and their shapes, enabling highly accurate assessment of the location of objects in the immediate vicinity of the tram.

[0039] The transmission of data received from lidars and digital video cameras is based on algorithms pre-programmed on an industrial computer, which match 3D points from the LiDAR sensor with 2D images from digital video cameras. The combined use of long-range video cameras and wide-angle digital video cameras with lidars enables more efficient recognition and tracking of objects, such as pedestrians and vehicles, in road traffic.

[0040] Pulse-Doppler radar emits radio waves and measures changes in the frequency of the reflected signals, allowing it to detect moving objects and estimate their speed. It is particularly effective at detecting and tracking objects, such as pedestrians and vehicles, in low-visibility conditions such as rain or fog. The integration of radar and digital video camera data is achieved using algorithms that combine distance and speed information from radars with visual data from digital video cameras, enabling more effective recognition and tracking of objects, such as pedestrians and vehicles.

[0041] Digital information received from digital video camera systems with various types of lenses using machine vision technologies, lidars and pulse-Doppler radars to improve the accuracy of identifying passengers and vehicles participating in road traffic, and processed on a hardware and software complex can be transmitted to centers for video recording of traffic violations by vehicles - the State Traffic Safety Inspectorate of the Main Directorate of the Ministry of Internal Affairs of the Russian Federation or another authorized agency of the Russian Federation, for making a procedural decision on the violation in accordance with current legislation.

[0042] The adaptive laser lighting system, located at the top of the tram cars on the door-opening side, activates when the tram brakes at a stop and the doors are opened. Laser sources located at the front and rear of the tram car on the side where the first and last doors open illuminate red, informing other vehicle drivers of passenger boarding and disembarking. Laser sources located to the left and right of each tram door illuminate green, informing passengers that boarding and disembarking is possible in the stop area. After the tram doors close, the laser sources become inactive.In the event that a digital video camera system using machine vision technologies detects vehicles in the immediate vicinity of the passenger boarding and disembarking area during the process of boarding and disembarking passengers at open-air stops (with passengers exiting onto the roadway), the laser radiation sources located to the left and right of each of the tram doors change the color of the laser radiation from green to red, informing passengers that boarding and disembarking is currently dangerous, while the red laser radiation sources located at the front and rear (tail) of the tram car body begin to flash, informing drivers of other vehicles approaching the tram passenger boarding and disembarking area that tram passengers are currently boarding and disembarking.

[0043] At the same time, if the digital video camera system using technical vision technologies recognizes vehicles in the immediate vicinity of the passenger boarding and disembarking area during the process of boarding and disembarking passengers at open-type stops (with an exit onto the roadway), the hardware and software complex sends a signal to block the control of the targeted opening of the tram doors.

[0044] An active tram passenger safety system using machine vision technology and adaptive laser illumination in the stop area comprises an LED traffic light located on the rear (tail) of the tram car body. It is within the binocular field of view of the driver of the vehicle driving behind it on the road lanes parallel to the tram's movement, adjacent to the passenger boarding and alighting area. The LED traffic light changes its signals in accordance with a preset algorithm based on the tram's progress and data received from a digital video camera system using machine vision technology, informing drivers of vehicles following behind the tram as follows.When the tram is moving, the traffic light turns static green, informing drivers of vehicles following behind the tram that they can move to the right of the tram (in the door area). When the tram slows (begins to brake), the LED traffic light changes to static yellow, informing drivers of vehicles following the tram of the upcoming stop. When the tram brakes, the LED traffic light changes to static red, informing drivers of the braking action. The system operates automatically, but manual control is also possible via a driver's control panel.

[0045] An active system for ensuring the safety of tram passengers using machine vision technologies and adaptive laser illumination in the area of ​​a tram stop contains a source of sound notification for ground vehicles, activated in order to prevent the occurrence of possible emergency situations based on data received by the hardware and software system in real time from a system of digital video cameras using machine vision technologies.The sound notification source comes into an active state in the event that the algorithms of the hardware and software complex, based on digital information from a system of digital video cameras using technical vision technologies, determine the potential possibility of an emergency situation arising, in the event that during the process of boarding and disembarking tram passengers at open-type stops (with passengers exiting onto the roadway), vehicles moving in the immediate vicinity of the roadway area on the side where the tram doors open have a speed and trajectory of movement that do not allow braking before the beginning of the area where tram passengers board and disembark, or if they cross the projection line of the red laser illumination located in the rear (tail) part of the tram car body, without stopping movement in this area during the process of boarding and disembarking passengers, thus creating conditions for the occurrence of emergency situations.

[0046] An active tram passenger safety system using machine vision technology and adaptive laser illumination in the stop area contains a hardware and software system based on an industrial computer that receives digital information from a video system using machine vision technology, processes the data in accordance with pre-set algorithms, and sends signals that control the operation of the adaptive laser illumination of the passenger boarding / disembarking area, an LED traffic light, and an audio alert source to each of the devices, respectively, as well as transmitting signals to interlock the opening / closing control of the tram doors, including interlocking the address opening of the doors.

[0047] The technical devices described are located on the tram as follows:

[0048] Passenger boarding and disembarking area (from the door opening side, right side of the tram car body):

[0049] 1. Wide-angle video cameras:

[0050] - Above the door sides: Wide-angle video cameras are mounted on the side of the tram car body near the doors. This position provides a complete view of the area around the doors, including the passenger boarding and disembarking areas.

[0051] - On the sides of the tram car, at the front and rear of the tram, on the door-opening side: Additional wide-angle video cameras are located on the sides of the tram car, at the front and rear of the tram car. They are necessary for monitoring pedestrians and vehicles participating in traffic located on the door-opening side of the tram.

[0052] 2. Long-range video cameras:

[0053] - Above the doors: Long-range cameras are located above the doors, facing downwards. This provides visibility of the area in front of the doors and helps monitor passengers in the tram stop's boarding and alighting area.

[0054] 3. LiDAR sensors:

[0055] - On the sides of the tram car: Lidars are located at the front and rear of the tram, as well as on the sides of the car car. This arrangement allows for the creation of an accurate 3D map of the passenger boarding and alighting area, capturing pedestrians and vehicles operating in traffic and within the passenger boarding and alighting area at open-air stops.

[0056] - At the top of the tram above the doors: Lidars are located at the top of the tram above the doors next to long-range video cameras to cover the area around the doors and create a 3D map of the traffic situation surrounding the tram.

[0057] 4. Pulse-Doppler radars:

[0058] Side radars: Radars are located on the sides near the doors of the tram, which allows monitoring the movement of pedestrians and other vehicles near the tram.

[0059] 5. Adaptive laser illumination system.

[0060] - On the upper side of the tram car body on the side where the doors open, at the top right and left of each door above the wide-angle video cameras, next to the long-range video cameras and lidars.

[0061] - At the top of the front (head) and rear (tail) parts of the tram car body on the side where the first and last doors of the tram open.

[0062] Rear (tail) and front (head) parts of the tram car body:

[0063] 1. Wide-angle video cameras:

[0064] - Rear (tail) of the tram car body: Rear view cameras are located at the top of the rear (tail) of the tram car body, providing a view of the area behind the tram, including any moving vehicles.

[0065] - Front (head) part of the tram car body: rear view cameras are located at the top of the front (head) part of the tram car body, providing a view of the space in front of the tram.

[0066] 2. Long-range video cameras:

[0067] - At the top of the rear (tail) of the tram car: Long-range cameras are located at the top of the rear (tail) of the tram car, facing downward. This provides a view of the area behind the tram, including any moving vehicles.

[0068] - Front (head) of the tram car: Long-range cameras are located at the top of the front (head) of the tram car, facing downward. This provides a clear view of the area ahead of the tram, including any moving vehicles.

[0069] 3. LiDAR sensors:

[0070] - Rear (tail) of the tram car: Lidars are located on the rear (tail) of the tram car to provide 3D scanning of the space behind the tram. This location is necessary for accurate distance estimation and detection of objects behind the tram.

[0071] - Front (head) part of the tram car body: lidars are located on the front (head) part of the tram car body to provide three-dimensional scanning of the space in front of the tram.

[0072] 4. Pulse-Doppler radars:

[0073] - Rear (tail) part of the tram car body: Pulse-Doppler radars are located on the rear (tail) part of the tram car body to detect and track moving vehicles behind the tram.

[0074] 5. LED traffic light.

[0075] - The rear (tail) part of the tram car body, on the right (from the side where the tram doors open), in the field of binocular vision of the driver driving the vehicle moving behind on the road lanes parallel to the movement of the tram, associated with the area where passengers board and disembark.

[0076] 6. Sound alert source for ground vehicles.

[0077] - The rear (tail) part of the tram car body.

[0078] 7. The hardware and software complex based on an industrial computer is located in the technical compartment of the tram.

[0079] The technical result consists in increasing the level of safety of tram passengers during the process of boarding and disembarking and preventing the occurrence of possible injuries and emergency situations, as well as increasing safety measures and focusing attention during the interaction between personal ground transport, urban passenger ground rail transport, and passengers, through the coordinated operation of an active complex for ensuring the safety of tram passengers.

[0080] The order of actions during the implementation of the proposed method.

[0081] The active safety system for tram passengers using machine vision technologies and adaptive laser illumination in the stop area operates as follows.

[0082] 1. A system of digital video cameras with various lens types, using machine vision technologies, lidars, and pulse-Doppler radars, continuously analyzes ground vehicles and passengers in the tram stop boarding and alighting areas and transmits the corresponding digital information to the hardware and software system in real time for subsequent data analysis according to specified algorithms.

[0083] 2. The hardware and software system, based on an industrial computer, transmits signals to the interlock for controlling the opening and closing of tram doors in accordance with pre-set algorithms, including the interlock for addressable door opening, depending on the data on the identification of objects, such as passengers and vehicles participating in road traffic, obtained from digital video cameras using machine vision technologies in real time.

[0084] 3. The adaptive laser illumination system for the passenger boarding and alighting area, located at the top of the tram cars on the door opening side, changes operating modes such as turning the emitter on, off, emission color, continuous emission, and flashing depending on the data received from digital video cameras using machine vision technologies in real time on the relative positions of objects, such as passengers and vehicles participating in road traffic.

[0085] 4. The LED traffic light, located on the rear side of the rear (tail) part of the tram car body, is within the binocular vision of the driver operating the vehicle moving behind on the road lanes parallel to the tram's movement, associated with the passenger boarding and alighting area. It changes its signals in accordance with preset algorithms depending on the stages of the tram's movement and the data received from the digital video camera system using machine vision technologies. 5. The sound alert source for ground vehicles comes into an active state in order to prevent possible emergency situations based on the data received by the hardware and software complex in real time from the digital video camera system using machine vision technologies.

[0086] Information confirming the possibility of implementing the invention

[0087] The invention “Active complex for ensuring the safety of tram passengers using technical vision technologies and adaptive laser illumination in the stop area” proposes to use a number of digital devices known from the prior art, which allow the complex to operate by integrating modern technologies and ensure the active safety of tram passengers during boarding and disembarking.

[0088] Ensuring the safety of tram passengers during boarding and disembarking is carried out using a system of long-range digital video cameras 1 (Fig. 1, Fig. 2, Fig. 3, Fig. 4), wide-angle digital video cameras 2 (Fig. 1, Fig. 2, Fig. 3, Fig. 4), LiDAR sensors 3 (Fig. 1, Fig. 2, Fig. 3, Fig. 4), pulse-Doppler radars 4 (Fig. 1, Fig. 2, Fig. 3, Fig. 4) producing continuous video analytics of ground vehicles and passengers located in the boarding / disembarking area of ​​tram stops and transmitting the corresponding digital information to a hardware and software complex based on an industrial computer in real time, laser radiation sources 5 (Fig. 1, Fig. 2, Fig. 3, Fig.4), changing the operating modes, such as turning on, turning off the emitter, the color of the emission, continuous emission and flashing depending on the data received from digital video cameras using machine vision technologies in real time about the relative position of passengers and objects, such as passengers and vehicles participating in road traffic, LED traffic light 6 (Fig. 1, Fig. 2, Fig. 3), changing signals in accordance with pre-set algorithms depending on the stages of the tram's movement and the data received from the system of digital video cameras using machine vision technologies, sound notification source 7 (Fig. 1, Fig. 2, Fig. 3), coming to an active state in order to prevent the occurrence of possible emergency situations based on data from the above-mentioned digital devices in real time received by the hardware and software complex based on the industrial computer 8 (Fig. 1, Fig. 2, Fig.3), located in the technical compartment of the tram and receiving digital information in real time from digital video cameras, lidars and pulse-Doppler radars and processing the data in accordance with pre-set algorithms of the software and hardware complex corresponding to the block diagram (notation) of ensuring the safety of tram passengers due to the operation of the active complex for ensuring the safety of tram passengers using technical vision technologies and adaptive laser illumination in the stop area (Fig. 5), and sending signals regulating the operation of the adaptive laser illumination of the passenger boarding / disembarking area, the LED traffic light and the sound notification source to each of the devices in accordance with pre-set algorithms, and also transmitting signals to the interlock for controlling the opening / closing of tram doors, including the interlock for address opening of doors.

Claims

1. An active system for ensuring the safety of tram passengers using machine vision technologies and adaptive laser illumination in the area of ​​a stop, comprising a system of digital video cameras, an LED traffic light, a sound alert source, an adaptive laser illumination system for the area of ​​boarding and disembarking tram passengers, and a hardware and software system based on an industrial computer, characterized in that the hardware and software system is configured to receive and process data from the system of digital video cameras, determining the location and trajectories of movement of passengers and vehicles in the area of ​​boarding and disembarking tram passengers in real time and generating control signals for the adaptive laser illumination system, the LED traffic light, and the sound alert source.

2. The complex according to paragraph 1, characterized in that the digital video camera system contains video cameras with different types of lenses for long-range and wide-angle viewing.

3. The complex according to paragraph 1, characterized in that the digital video camera system additionally contains lidars (LiDAR sensors) to increase the accuracy of identifying passengers and vehicles.

4. The complex according to paragraph 1, characterized in that the digital video camera system additionally contains pulse-Doppler radars to increase the accuracy of identifying passengers and vehicles.

5. The complex according to paragraph 1, characterized in that the adaptive laser illumination system for the passenger boarding / disembarking area is located in the upper part of the tram car body on the side where the doors open.

6. The complex according to paragraph 1, characterized in that the adaptive laser illumination system is designed with the ability to change operating modes, namely, turning on and off the laser radiation, changing the color of the laser radiation, continuous radiation and flashing, depending on data on the location and trajectories of movement of passengers and vehicles.

7. The complex according to paragraph 1, characterized in that the software and hardware complex is designed with the ability to generate control signals for blocking the system for opening and closing the doors of the tram when determining the intersection of the trajectory of the vehicle with the area of ​​boarding and disembarking passengers.

8. The complex according to paragraph 1, characterized in that the LED traffic light is located on the rear part of the tram car body in the area of ​​binocular vision of drivers of vehicles moving behind along road lanes parallel to the movement of the tram and connected to the area of ​​boarding and disembarking passengers.

9. The complex according to paragraph 1, characterized in that the said LED traffic light is designed with the ability to send warning signals to vehicle drivers depending on the stages of the tram’s movement and the data received from the digital video camera system.

10. The complex according to paragraph 1, characterized in that the sound alert source is designed with the ability to send a warning signal to drivers when the digital video camera system detects a vehicle moving along a road lane adjacent to the passenger boarding / disembarking area and approaching said area during a tram stop and passenger boarding / disembarking.

Images