Passenger safety monitoring system

Abstract

The invention discloses a passenger safety monitoring system, and relates to the field of safety monitoring, and the system comprises an image collection module which is used for collecting face images of people on a vehicle, and obtaining a first image set; the pressure acquisition module is used for acquiring the pressure value of each seat of the vehicle; the safety belt monitoring module is used for monitoring the safety belt state of each seat of the vehicle; the vehicle-mounted data processing center is respectively connected with the image acquisition module, the pressure acquisition module and the safety belt monitoring module, and is used for comparing the first image set with a database image set to determine the getting-on condition of a passenger, determining the seat occupation condition according to the pressure value, and sending the seat occupation condition to the vehicle-mounted data processing center; determining a safety belt wearing condition according to the safety belt state; the face image of each passenger is pre-stored in the database image set. According to the passenger safety monitoring system and method, passenger safety monitoring automation is achieved through the sensing technology, the face recognition technology, the mobile internet technology and the like, the monitoring efficiency is improved, and human errors are reduced.

Description

Technical Field

[0001] The present application relates to the field of safety monitoring, and in particular to a passenger safety monitoring system. Background Art

[0002] Passenger vehicles are an important part of public transportation, among which long-distance buses play a key role in long-distance travel or group outings. Long-distance buses carry many passengers and usually need to stop several times during the journey for passengers to get off, play, rest or resupply. Ensuring that all passengers have returned to the bus before re-departure after stopping is an important and challenging task.

[0003] The traditional method of counting people is for the driver or tour guide to call the roll one by one, which is not only inefficient but also prone to errors when there are many passengers or in a noisy environment. Although some passenger vehicles are equipped with basic video surveillance systems, these systems cannot be used as a tool to call the roll or ensure the integrity of passengers. In addition, these systems cannot provide real-time feedback or directly interact with passengers, making it difficult to meet the growing demand for ensuring passenger safety and improving service quality in actual operations. Summary of the invention

[0004] The purpose of this application is to provide a passenger safety monitoring system that can automate passenger safety monitoring, improve monitoring efficiency, reduce human errors, and ensure travel safety to the greatest extent.

[0005] To achieve the above objectives, this application provides the following solutions:

[0006] In a first aspect, the present application provides a passenger safety monitoring system, comprising:

[0007] An image acquisition module is used to acquire facial images of people in the vehicle to obtain a first image set;

[0008] A pressure collection module is used to collect the pressure value of each seat in the vehicle;

[0009] Seat belt monitoring module, used to monitor the status of seat belts in each seat of the vehicle;

[0010] The on-board data processing center is respectively connected to the image acquisition module, the pressure acquisition module and the seat belt monitoring module, and is used to compare the first image set with the database image set to determine the passenger boarding situation, determine the seat occupancy situation according to the pressure value, and determine the seat belt wearing situation according to the seat belt status; the passenger boarding situation includes: all passengers are on the bus, strangers are on the bus, and all passengers are not on the bus; the seat occupancy situation is occupied or unoccupied; the seat belt wearing situation is correctly worn or incorrectly worn; the database image set pre-stores the facial image of each passenger.

[0011] Optionally, if the seat occupancy status is unoccupied, the on-board data processing center does not determine the seat belt wearing status of the corresponding seat.

[0012] Optionally, the seat belt monitoring module includes:

[0013] The first sensor is arranged inside the retractor of the seat belt and is used to collect the pulled-out length of the webbing;

[0014] The second sensor is arranged inside the buckle of the safety belt and is used to collect the pressure value inside the buckle;

[0015] If the pulled-out length is greater than a first set threshold value, and the pressure value is greater than a second set threshold value, the seat belt is worn correctly; otherwise, the seat belt is worn incorrectly.

[0016] Optionally, if the facial images in the first image set are the same as the facial images in the database image set, then all passengers are on board; if there are facial images in the first image set that are not included in the database image set, then strangers are on board; if there are facial images in the database image set that are not included in the first image set, then not all passengers are on board.

[0017] Optionally, the passenger safety monitoring system further includes:

[0018] The cloud data processing center is connected to the vehicle-mounted data processing center and is used to remotely monitor the passenger boarding status, seat occupancy status and seat belt wearing status.

[0019] Optionally, the passenger safety monitoring system further includes:

[0020] An administrator terminal is connected to the cloud data processing center, and is used to receive a passenger status query instruction and vehicle status information input by an administrator, and display the passenger boarding status, the seat occupancy status, and the seat belt wearing status according to the passenger status query instruction, and upload the vehicle status information to the cloud data processing center; the vehicle status information includes the parking time and the estimated parking duration;

[0021] The passenger terminal is connected to the cloud data processing center, and is used to collect the passenger's facial image and upload it to the cloud data processing center to obtain the database image set, receive the vehicle status query instruction input by the passenger, and display the vehicle status information according to the vehicle status query instruction, obtain the passenger's real-time location and upload it to the cloud data processing center.

[0022] Optionally, the cloud data processing center is also used to calculate the estimated departure time according to the vehicle status information, and to issue a departure overtime reminder when the current time is later than the estimated departure time.

[0023] Optionally, the passenger terminal is also used to receive an alarm instruction input by a passenger, generate alarm information according to the alarm instruction, and upload the alarm information to the cloud data processing center; the alarm information includes the personal information, real-time location and danger description of the alarming passenger.

[0024] Optionally, the cloud data processing center is also used to remind passengers to seek help based on the alarm information.

[0025] Optionally, the passenger safety monitoring system further includes:

[0026] A display screen is connected to the vehicle-mounted data processing center and is used to display the passenger boarding status, seat occupancy status and seat belt wearing status in real time.

[0027] According to the specific embodiments provided in this application, this application has the following technical effects:

[0028] The present application provides a passenger safety monitoring system, which can determine the passenger boarding status by collecting facial images of people on the vehicle, such as whether all passengers have boarded the vehicle, there are strangers on the vehicle, or not all passengers have arrived, thereby realizing automated personnel counting; it can automatically determine the seat occupancy status by collecting the pressure value on the seat, and determine whether the seat belt is worn correctly by monitoring the seat belt status of the vehicle seat, thereby realizing automated safety monitoring of passengers during the vehicle journey and ensuring the safety of the journey. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0030] Figure 1 This is a schematic diagram of the structure of a passenger safety monitoring system in one embodiment of the present application. DETAILED DESCRIPTION

[0031] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0032] This application proposes a passenger safety monitoring system that can realize the automation of passenger safety monitoring, improve monitoring efficiency, reduce human errors, and ensure travel safety to the greatest extent.

[0033] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, the present application is further described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0034] In an exemplary embodiment, Figure 1 As shown, the present application proposes a passenger safety monitoring system, which includes: an on-board data processing center 101 , an image acquisition module 102 , a pressure acquisition module 103 and a seat belt monitoring module 104 .

[0035] In an exemplary embodiment, the image acquisition module 102 includes three cameras, which are respectively located at the front, middle and rear positions inside the vehicle. The image acquisition module 102 can ensure the complete acquisition of facial images of people on the vehicle to obtain a first image set. The database image set in the vehicle-mounted data processing center 101 pre-stores the facial image of each passenger. After obtaining the first image set, the vehicle-mounted data processing center 101 compares the first image set with the database image set to determine the passenger boarding situation: if the facial image in the first image set is the same as the facial image in the database image set, the passenger boarding situation is that all passengers are on the bus; if there are facial images in the first image set that are not included in the database image set, the passenger boarding situation is that strangers are boarding; if there are facial images in the database image set that are not included in the first image set, the passenger boarding situation is that not all passengers are present.

[0036] The pressure collection module 103 is used to collect the pressure value on each seat of the vehicle, and the vehicle-mounted data processing center 101 determines the seat occupancy status according to the pressure value. When the pressure value is greater than the set threshold, the seat occupancy status is determined to be occupied by someone, otherwise the seat occupancy status is determined to be unoccupied. In an exemplary embodiment, the set threshold is set to 10kg. If the seat pressure value is less than 10kg, it may be that an object is placed on the seat, and the seat occupancy status is determined to be unoccupied.

[0037] The seat belt monitoring module 104 is used to monitor the seat belt status of each seat in the vehicle. The vehicle data processing center 101 determines the seat belt wearing condition according to the seat belt status. In an exemplary embodiment, Figure 1As shown, the seat belt monitoring module 104 includes a first sensor 1041 and a second sensor 1042. The first sensor 1041 is arranged inside the retractor of the seat belt, and the second sensor 1042 is arranged inside the buckle of the seat belt. In an exemplary embodiment, the first sensor 1041 is a displacement sensor, which is used to collect the pulled-out length of the webbing. When the pulled-out length of the webbing is greater than the first set threshold, it is determined that the webbing is pulled out normally. The second sensor 1042 is a piezoelectric sensor, which is used to collect the pressure value inside the buckle. When the pressure value is greater than the second set threshold, it is determined that the buckle is normally fastened. When the on-board data processing center 101 determines that the webbing is pulled out normally and the buckle is normally fastened, it is determined that the wearing condition of the seat belt is correctly worn, otherwise the wearing condition of the seat belt is not correctly worn. The addition of the first sensor 1041 to collect the pulled-out length of the webbing is to prevent the use of fake buckles to deceive the seat belt monitoring. If the pulled-out length of the webbing does not exceed the set threshold, it is determined that the seat belt is not worn correctly. In particular, if the seat occupancy status is unoccupied, the vehicle-mounted data processing center 101 does not determine the seat belt wearing status of the corresponding seat.

[0038] In another exemplary embodiment of the present application, Figure 1 As shown, the passenger safety monitoring system proposed in the present application also includes an administrator terminal 105 , a passenger terminal 106 and a cloud data processing center 107 .

[0039] The cloud data processing center 107 is connected to the vehicle data processing center 101 for remotely monitoring passenger boarding conditions, seat occupancy conditions, and seat belt wearing conditions.

[0040] The administrator terminal 105 is connected to the cloud data processing center 107, and is used to receive the passenger status query instruction and vehicle status information input by the administrator, and display the passenger boarding status, seat occupancy status and seat belt wearing status according to the passenger status query instruction, and upload the vehicle status information to the cloud data processing center 107. The vehicle status information includes the parking time and the estimated parking time.

[0041] The passenger terminal 106 is connected to the cloud data processing center 107, and is used to collect facial images of all passengers and upload them to the cloud data processing center 107 to obtain a database image set, receive vehicle status query instructions input by the passengers, and display vehicle status information according to the vehicle status query instructions, obtain the real-time location of the passengers and upload it to the cloud data processing center 107.

[0042] In an exemplary embodiment, the administrator terminal 105 and the passenger terminal 106 are two modes of a mobile application, used by the administrator and the passenger, respectively. Before the start of the journey, the backstage staff enters the personal information of all passengers, such as name, mobile phone number, gender, and ID number, into the backstage, and the backstage automatically sends a text message verification code to each passenger. Passengers use the verification code to bind with the vehicle to be taken in the passenger terminal 106. Upload the face photo of the passenger, and save it to the vehicle data processing center 101 through the cloud data processing center 107 to obtain the database image set.

[0043] During the trip, the administrator can query the boarding status, seat occupancy and seat belt wearing status of passengers in real time through the administrator terminal 105, so as to timely discover safety hazards and deal with them effectively. In addition, the administrator uploads the parking time and estimated parking duration to the cloud data processing center 107 through the administrator terminal 105 according to the actual situation, and the passengers can query the above vehicle parking information through the passenger terminal 106. When the on-board data processing center 101 determines that the passengers are not fully boarded, the facial images of the passengers who have not boarded the bus are determined based on the comparison results of the first image set and the database image set, and the personal information of the passengers who have not boarded the bus is further determined, and then a reminder of the upcoming departure is sent to the corresponding passengers through the passenger terminal 106.

[0044] If a passenger encounters an emergency during getting off the bus, he or she can call the police through the passenger terminal 106. The passenger in distress can briefly enter a description of the danger and enter an alarm instruction in the passenger terminal 106. The passenger terminal 106 generates alarm information according to the alarm instruction and uploads the alarm information to the cloud data processing center 107. The alarm information includes the personal information and real-time location of the alarming passenger automatically obtained by the passenger terminal 106, as well as the description of the danger entered by the passenger himself or herself. The administrator terminal 105 can receive the alarm information in real time so that the administrator can arrange rescue according to the actual danger.

[0045] After the trip is over, the administrator terminal 105 receives the trip end instruction input by the administrator. The vehicle data processing center 101 clears the database image set according to the trip end instruction, and the cloud data processing center 107 unbinds all personal information of the passenger from the vehicle.

[0046] In an exemplary embodiment, the cloud data processing center 107 is also used to calculate the estimated departure time according to the parking time and the estimated parking duration, and to issue a departure timeout reminder when the current time is later than the estimated departure time. When the passenger boarding is a stranger, the cloud data processing center 107 will issue a stranger boarding reminder. The cloud data processing center 107 can also obtain passenger alarm information and issue a passenger help reminder.

[0047] In another exemplary embodiment of the present application, Figure 1As shown, the passenger safety monitoring system proposed in the present application further includes a display screen 108. The display screen 108 is connected to the vehicle data processing center 101 and is used to display the passenger boarding status, seat occupancy status and seat belt wearing status in real time.

[0048] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant regulations.

[0049] Those of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM may be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM).

[0050] The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. The non-relational database may include a distributed database based on blockchain, etc., but is not limited thereto. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., but is not limited thereto.

[0051] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0052] This article uses specific examples to illustrate the principles and implementation methods of this application. The description of the above embodiments is only used to help understand the method and core ideas of this application. At the same time, for those skilled in the art, according to the ideas of this application, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as limiting this application.

Claims

1. A passenger safety monitoring system, characterized in that: The passenger safety monitoring system comprises: An image acquisition module is used to acquire facial images of people in the vehicle to obtain a first image set; A pressure collection module is used to collect the pressure value of each seat in the vehicle; Seat belt monitoring module, used to monitor the status of seat belts in each seat of the vehicle; The on-board data processing center is respectively connected to the image acquisition module, the pressure acquisition module and the seat belt monitoring module, and is used to compare the first image set with the database image set to determine the passenger boarding situation, determine the seat occupancy situation according to the pressure value, and determine the seat belt wearing situation according to the seat belt status; the passenger boarding situation includes: all passengers are on the bus, strangers are on the bus, and all passengers are not on the bus; the seat occupancy situation is occupied or unoccupied; the seat belt wearing situation is correctly worn or incorrectly worn; the database image set pre-stores the facial image of each passenger.

2. The passenger safety monitoring system according to claim 1, characterized in that: If the seat occupancy status is that no one is occupied, the onboard data processing center does not determine the seat belt wearing status of the corresponding seat.

3. The passenger safety monitoring system according to claim 1, characterized in that: The seat belt monitoring module comprises: The first sensor is arranged inside the retractor of the seat belt and is used to collect the pulled-out length of the webbing; The second sensor is arranged inside the buckle of the safety belt and is used to collect the pressure value inside the buckle; If the pulled-out length is greater than a first set threshold value, and the pressure value is greater than a second set threshold value, the seat belt is worn correctly; otherwise, the seat belt is worn incorrectly.

4. The passenger safety monitoring system according to claim 1, characterized in that: If the facial images in the first image set are the same as the facial images in the database image set, then all passengers are on board; if there are facial images in the first image set that are not included in the database image set, then strangers are on board; if there are facial images in the database image set that are not included in the first image set, then not all passengers are on board.

5. The passenger safety monitoring system according to claim 1, characterized in that: The passenger safety monitoring system further comprises: The cloud data processing center is connected to the vehicle-mounted data processing center and is used to remotely monitor the passenger boarding status, seat occupancy status and seat belt wearing status.

6. The passenger safety monitoring system according to claim 5, characterized in that: The passenger safety monitoring system further comprises: An administrator terminal is connected to the cloud data processing center, and is used to receive a passenger status query instruction and vehicle status information input by an administrator, and display the passenger boarding status, the seat occupancy status, and the seat belt wearing status according to the passenger status query instruction, and upload the vehicle status information to the cloud data processing center; the vehicle status information includes the parking time and the estimated parking duration; The passenger terminal is connected to the cloud data processing center, and is used to collect the passenger's facial image and upload it to the cloud data processing center to obtain the database image set, receive the vehicle status query instruction input by the passenger, and display the vehicle status information according to the vehicle status query instruction, obtain the passenger's real-time location and upload it to the cloud data processing center.

7. The passenger safety monitoring system according to claim 6, characterized in that: The cloud data processing center is also used to calculate the estimated departure time according to the vehicle status information, and to issue a departure overtime reminder when the current time is later than the estimated departure time.

8. The passenger safety monitoring system according to claim 6, characterized in that: The passenger terminal is also used to receive an alarm instruction input by a passenger, generate alarm information according to the alarm instruction, and upload the alarm information to the cloud data processing center; the alarm information includes the personal information, real-time location and danger description of the alarming passenger.

9. The passenger safety monitoring system according to claim 8, characterized in that: The cloud data processing center is also used to remind passengers to ask for help based on the alarm information.

10. The passenger safety monitoring system according to claim 1, characterized in that: The passenger safety monitoring system further comprises: A display screen is connected to the vehicle-mounted data processing center and is used to display the passenger boarding status, seat occupancy status and seat belt wearing status in real time.

Images