System for collecting passenger information in a vehicle

Abstract

The invention relates to systems for counting passengers and providing video surveillance in a vehicle. A hardware and software system for collecting passenger information in a vehicle comprises an on-board computer, a wireless communication module, a GPS module, an information storage module, a power controller, a remote server, at least one video surveillance camera, at least one camera for counting passengers and providing video surveillance, and a camera switch. The hardware and software system further comprises a vehicle state sensor, at least one door position sensor, and a vehicle ignition sensor. The invention makes it possible to reduce passenger counting errors, while at the same time increasing the volume of information collected and allowing remote adjustment of the working of the hardware and software system, as well as passenger monitoring and analysis for any period of time, with information being output to a remote server.

Description

[0001] COMPLEX FOR COLLECTING INFORMATION ON PASSENGER FLOW ON TRANSPORT VEHICLES

[0002] Field of technology

[0003] The invention relates to passenger flow counting and video surveillance systems on a vehicle, primarily passenger transport such as buses, trolleybuses, fixed-route taxis, trams, and is used to record and analyze passenger flow by average daily, seasonal and annual cycle on each route in order to improve the efficiency of urban passenger transport. The hardware and software complex is capable of operating both separately and in combination with pre-installed and standard on-board equipment of the vehicle.

[0004] State of the art

[0005] Various means for accounting for passenger traffic and video surveillance in transport are known. Thus, a device for counting passenger traffic based on stereo vision according to the Russian Federation patent RU2785198 (published on 05.12.2022; G06V20 / 59) relates to transport equipment that monitors the passenger traffic entering and exiting a vehicle, ensuring the accounting of each passenger, as well as video monitoring of events occurring during periods of vehicle stops for the purpose of boarding and disembarking passengers. The operation of the passenger counting module as part of this known device is based on constructing a distance map based on the received stereo frames, identifying moving objects and tracking their movement within the monitored boundaries to record the entry / exit of passengers. One of the disadvantages of the known device is the actual lack of video surveillance outside the time intervals of entry and exit of passengers, which negatively affects the safety of passenger transportation.

[0006] Russian patent RU196791 (published 16.03.2020; G06M3 / 08) discloses a device for counting passenger traffic, installed on the outside of a vehicle body and containing a housing with a protective glass, which combines a passenger traffic counter containing a processor module, a camera, a memory module, a power supply, a network interface and input / output interfaces. The device operates due to the ability to determine the trajectory of passengers in the calculation zone, which ensures recording the entry and exit of an individual passenger from the vehicle. One of the disadvantages of this known solution is the location of the equipment on the outside of the vehicle body, which negatively affects the durability of the system when exposed to external weather and man-made factors, such as precipitation, anti-icing agents in winter, air temperature, etc.

[0007] From the Russian patent RU121628 (published 27.10.2012; G07C9 / 00) an intelligent system for analyzing passenger flows using technical vision is known, which involves the use of a global positioning module, an on-board computer, video cameras for viewing the vehicle interior and automatic processing of images obtained from the video cameras using technical vision to count passengers in the vehicle interior.

[0008] Russian Federation Patent RU2789708 (published 07.02.2023; G07C9 / 00, G06V20 / 59) discloses counting and video surveillance cameras, the data from which is stored on a hard drive. The information can then be transmitted to external sources via a controller with the appropriate interfaces. The power controller ensures that the complex is turned on / off, as well as put into sleep mode and taken out of this mode. The declared technical result is more accurate tracking of passenger traffic, i.e. essentially reducing the counting error.

[0009] The passenger counter according to RU2789708 can be accepted as the closest analogue of the claimed invention.

[0010] The disadvantages of the above-mentioned known technical solutions, including the closest analogue, as well as other similar systems, are the actual absence of video surveillance outside the time intervals of entry and exit of passengers, which negatively affects the safety of passenger transportation; the constant operation of the device regardless of the state of the vehicle, which affects the accuracy of determining the number of passengers entering and exiting; the impossibility of monitoring the operation of the counter and receiving data from it in real time.

[0011] Disclosure of invention

[0012] The technical problem solved by the claimed invention is the creation of a hardware and software complex (hereinafter also referred to as the HSC) for reliable passenger flow counting on a vehicle in combination with a video surveillance function and the ability to remotely access the information received and adjust the HSC operation. The technical result of the claimed invention is a reduction in the error in passenger flow counting while simultaneously increasing the volume of useful information collected without increasing the requirements for the hardware resources used, including through video surveillance in the passenger compartment and the entry / exit area of ​​the vehicle above the doorway and ensuring the ability to remotely adjust the HSC operation and control and analyze passengers over any period of time with the output of information to a remote server.

[0013] The specified technical problem is solved, and the declared technical result is achieved in the declared hardware and software complex for collecting information about passenger traffic on a vehicle due to the fact that the hardware and software complex contains an on-board computer, a wireless communication module, a global positioning system module, an information storage module, a power controller, a remote server, at least one video surveillance camera, at least one passenger counting and video surveillance camera, and a camera switch. In this case, the camera switch is designed with the possibility of activating the operation of the specified at least one video surveillance camera and at least one passenger counting and video surveillance camera.

[0014] Low passenger counting error is achieved, among other things, by placing passenger counting and video surveillance cameras in the area of ​​the vehicle doorway in such a way that the viewing angle covers the entire vehicle entry / exit area and allows for fine-tuning of the area of ​​object capture in the monitored area.

[0015] In addition, the declared APCS allows remote adjustment of its operation, which consists in the fact that the passenger flow counting is duplicated by manual counting based on the collected video files, which becomes possible after uploading the data to a remote server, provided by the APCS. Based on the counting results, the on-board computer settings are adjusted, in particular, by adjusting the parameters of the camera coverage area and the parameters of the output image, and are loaded back into the declared APCS. As an example of such a setting, a part of the image larger than the width of the doorway is excluded from the obtained image for further analysis. This increases the speed of analysis and the accuracy of passenger flow determination, and also reduces the amount of insignificant or unnecessary data, the processing and storage of which requires additional computing resources, and in their absence, reduces the quality of work and the final result.Finally, control and analysis of passenger traffic at any time is ensured by instantaneous output of information to a remote server, for example, using a built-in modem (wireless communication module), which has an interface that allows the user to monitor in real time all processes controlled by the automated control system on board one or more vehicles.

[0016] The specified technical problem is solved, and the declared technical result is also achieved in specific versions of the declared automated system for collecting information on passenger traffic on vehicles, to which, however, this invention is not limited.

[0017] Thus, the APCS may additionally contain a vehicle status sensor. In this case, it is preferable if the APCS is designed with the ability to track the vehicle status and transmit information about the vehicle status to a remote server.

[0018] In addition or in addition to this, the APC may contain at least one door position sensor and / or vehicle ignition sensor. Then it is preferable that the camera switch is designed with the possibility of activating said cameras based on a signal from the door position sensor and / or vehicle ignition sensor.

[0019] It is also preferable if the information storage module is designed with the ability to store information about passenger flow.

[0020] In another possible embodiment of the invention, the APC may additionally contain a video surveillance monitor to ensure remote viewing of collected information about passenger flow in real time.

[0021] Implementation of the invention

[0022] The invention is further explained in more detail with reference to the attached figure, which schematically shows the claimed automated system for collecting information about passenger traffic on a vehicle.

[0023] The following elements are marked with positions on the figure:

[0024] 1 - on-board computer;

[0025] 2 - camera switch;

[0026] 3 - CCTV cameras;

[0027] 4 - passenger counting and video surveillance cameras;

[0028] 5 - information board;

[0029] 6 - GSM antenna of the satellite navigation device;

[0030] 7 - GPS / GLONASS antenna of the satellite navigation device; 8 - satellite navigation device;

[0031] 9 - door position sensors;

[0032] 10 - vehicle status sensor;

[0033] 11 - power controller;

[0034] 12 - ignition sensor;

[0035] 13 - GSM module of the on-board computer;

[0036] 14 - GSM antenna of the GSM module;

[0037] 15 - video surveillance monitor;

[0038] 16 - information storage module (for example, a hard drive).

[0039] The figure shows a schematic diagram of the claimed automated complex for collecting information about passenger traffic on a vehicle. In general, the automated complex comprises an on-board computer (1); a wireless communication module (13, 14) containing a GSM module (13) of the on-board computer and a GSM antenna (14) of the said GSM module (13); a global positioning system module (6, 7, 8) containing a GSM antenna (6) of the satellite navigation device, a GPS / G LONASS antenna (7) of the satellite navigation device and the satellite navigation device (8) itself; an information storage module (16), in particular a hard drive; a power controller (11); a remote server (not shown in the figure); at least one video surveillance camera (3); at least one passenger counting and video surveillance camera (4); and a camera switch (2) configured to activate the operation of said at least one video surveillance camera (3) and at least one passenger counting and video surveillance camera (4).

[0040] As will be disclosed below, the claimed automated system for collecting information about passenger traffic on a vehicle may contain one or more additional components, such as a sensor (or sensors) (9) for the position of vehicle doors, a sensor (10) for the state of the vehicle, a sensor (12) for the ignition of the vehicle, a video surveillance monitor (15), and an information board (5).

[0041] The on-board computer (1) is designed to ensure the operation of the entire automated control system and is connected to the camera switch (2), the satellite navigation device (8), the power controller (11), the GSM module (13) built into the on-board computer (1), the information storage module (16) and, if available, the video surveillance monitor (15).

[0042] The cameras (3) for video surveillance and the cameras (4) for counting passengers and video surveillance are intended, first of all, to carry out video surveillance in the vehicle cabin, if possible, covering the entire interior space of the vehicle cabin. In addition, the cameras (4) for counting passengers and video surveillance ensure the implementation by the declared APCS of the function of counting the number of passengers entering and leaving the vehicle.

[0043] As stated above, the passenger counting and video surveillance cameras (4) are installed directly in the vehicle entry / exit zone, unlike the video surveillance cameras (3), which, in particular, can be placed throughout the vehicle interior. Accordingly, the on-board computer (1) calculates the information received from the passenger counting and video surveillance cameras (4) and the video surveillance cameras (3) differently, in particular, due to different algorithms for processing the received data.

[0044] The operation of the said cameras (3, 4) is activated by means of the camera switch (2) to which they are connected. The operation of the camera switch (2), as stated above, is controlled by the on-board computer (1). The camera switch (2) turns on / off either the video surveillance cameras (3), or the passenger counting and video surveillance cameras (4), or both, with the start and / or end of the vehicle movement, the start and / or stop of the vehicle engine, the switching on or off of the declared APC as a whole, depending on other conditions. For example, if the APC contains a vehicle status sensor (10), as well as a global positioning system module (6, 7, 8), including a satellite navigation device (8) and a GSM antenna (6) and GPS / GLONASS antenna (7) connected to it, it is possible to track the vehicle status, such as stop, movement, etc., and activate or deactivate cameras (3, 4), as well as transmit information about the vehicle status to a remote server.In this case, such a variant is possible, in which it is the remote server, after receiving information about the state of the vehicle, that generates a signal to control the cameras (3, 4) and transmits it to the on-board computer (1) via the GSM module (13) and the GSM antenna (14) connected to it, and the on-board computer (1) generates a corresponding control signal for the switchboard (2) of the cameras. Also, the APC may contain at least one sensor (9) of the door position and / or a sensor (12) of the vehicle ignition, which, similarly to the sensor (10) of the vehicle state, transmit the corresponding information to the on-board computer (1) and, additionally, to the remote server, in response to which the on-board computer (1) directly or, preferably, having received a command from the remote server, generates a corresponding control signal for the switchboard (2) of the cameras.

[0045] All actions and results of the work of the automated control system, including video surveillance and passenger flow counting, as well as the state of the vehicle, can be saved in the information storage module (16), which is, for example, a hard disk, for the purposes of actually storing the received information, its subsequent processing and adjusting the work (settings) of the automated control system.

[0046] Provision of power supply to the components of the declared APC, with the exception of the remote server, is carried out by means of a power controller (11), which receives energy either from the TS or from another energy source, for example, a built-in or external battery.

[0047] To ensure remote viewing of collected information about passenger flow in real time, the APCS may include a video surveillance monitor (15), installed on the vehicle itself or remotely, for example, by being connected to a remote server.

[0048] The hardware components of the claimed ACS may be well-known to the specialist in the relevant devices. In particular, the specialist will have no questions when selecting suitable video surveillance cameras (3), passenger counting and video surveillance cameras (4), camera switch (2), wireless communication module components (13, 14), global positioning system module components (6, 7, 8), information storage module (16) - all of these are widely used technical means for the relevant purpose. The same applies to the power controller (11), which is an electronic device that ensures the receipt of power from the outside and its distribution between the ACS components with the required parameters (current, voltage, frequency). The remote server and the on-board computer (1) may be computers in a conventional, rack-mounted or industrial design.

[0049] The operation of the declared automated system for collecting information about passenger traffic on vehicles is carried out as follows.

[0050] The power controller 11 starts the on-board computer 1 at a specified time or according to a specified event, for example, having received a signal from the vehicle ignition sensor 12 that the vehicle has been started. In this case, the module (6, 7, 8) of the global positioning system, including the GSM antenna 6, the GPS / GLONASS antenna 7 and the satellite navigation device 8, sends data on the vehicle start to a remote server.

[0051] Then, having received a signal from the switchboard 2 of the cameras, the cameras 3 of video surveillance and the cameras 4 of passenger counting and video surveillance are switched on. Video surveillance in the vehicle interior is carried out continuously during the entire period of the vehicle operation; the video surveillance data from the cameras (3, 4) are displayed on the monitor 15 of video surveillance and recorded on the information storage module 16, which can be implemented, for example, on the basis of a hard disk.

[0052] The state and movement of the vehicle are monitored by means of the vehicle state sensors 10 and the module (6, 7, 8) of the global positioning system, in particular, the GPS / GLONASS antenna 7 and the satellite navigation device 8. Data on the nearest stops are displayed on the information board 5, and the location data are sent to a remote server.

[0053] When the doors are opened, the door position sensors 9 are triggered, and by the signal from them, the on-board computer 1 generates a signal to start monitoring the passenger flow using the passenger flow and video surveillance cameras 4. After the passengers have disembarked and boarded, the APCS starts counting the passenger flow using a built-in algorithm, the essence of which lies, in particular, in capturing an object crossing a selected virtual area in the frame and analyzing its trajectory by crossing checkpoints in the direction of entering or exiting the vehicle. Then, the received data is transmitted to a remote server via the built-in GSM module 13, connected to the GSM antenna 14. This cycle is carried out during the entire period of the vehicle operation.

[0054] Upon completion of the vehicle engine operation or another prescribed event, the power controller 11 switches off the APC, saving all data in the information storage module 16.

[0055] The declared hardware and software complex for collecting information about passenger traffic on a vehicle allows to increase the volume of useful information recorded, while eliminating unnecessary information and increased load on the hardware, and provides the ability to remotely adjust the operation of the APC and control and analysis of passenger traffic over any period of time with the output of information to a remote server, which together contributes to increasing the accuracy of counting passenger traffic on a vehicle.

Claims

CLAUSE OF INVENTION 1. A hardware and software system for collecting information about passenger traffic on a transport vehicle (TV), comprising: a power controller (11), at least one video surveillance camera (3) intended for placement in the vehicle cabin, at least one passenger counting and video surveillance camera (4) intended for placement in the vehicle entry / exit zone, a vehicle status sensor (10), at least one door position sensor (9), a vehicle ignition sensor (12), a camera switch (2) configured to activate the operation of at least one video surveillance camera (3) and at least one passenger counting and video surveillance camera (4), an on-board computer (1), a remote server configured to receive information from the on-board computer (1), perform passenger traffic counting, and adjust the settings of the on-board computer (1), a video surveillance monitor (15) to ensure remote viewing of the collected passenger traffic information in real time, a module (13,14) wireless communication, designed with the ability to transmit information from the on-board computer (1) to a remote server and back and output information to the video surveillance monitor (15), the module (6, 7, 8) of the global positioning system, and the module (16) for storing information, wherein the hardware and software complex is designed with the ability to track the state of the vehicle by means of the sensor (10) of the state of the vehicle and to transmit information about the state of the vehicle to a remote server, and the switch (2) of the cameras is designed with the ability to activate the said cameras (3, 4) by a signal from the sensor (9) of the door position and the sensor (12) of the ignition of the vehicle.

2. The hardware and software complex according to paragraph 1, characterized in that the information storage module (16) is designed with the ability to store information about passenger flow.

Images