Safety early warning method, system and equipment for getting off of passengers at back row of vehicle
By obtaining vehicle driving status information and monitoring passenger behavior, collecting rear images of the vehicle and issuing early warnings to passengers, the problem of insufficient safety guarantee for rear passengers in the existing technology is solved, and effective safety warnings and improved passenger safety awareness are achieved.
Patent Information
- Application Number
- CN202510447837.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-04-10
- Publication Date
- 2025-06-10
AI Technical Summary
The existing technology has limited safety guarantee effect when rear passengers get off the bus, and cannot be perceived and provided effective early warning in a timely manner, and the early warning method lacks intuitive and clear visual information.
By obtaining vehicle driving status information, we will determine the passenger's intention to get off the vehicle, collect the rear image of the vehicle's real-time location, and issue a safety warning to the passenger. The system includes a acquisition module, a judgment module, a collection module and an early warning module, and uses a camera to monitor the passenger's physical behavior and movements, and combines a speed sensor and a GPS sensor to obtain vehicle status information.
It realizes an effective warning of the safety of passengers getting off the bus, provides passengers with rear environment information in advance, reduces collision accidents caused by insufficient observation of the rear environment, and improves the safety of passengers when getting off the bus.
Smart Images

Figure CN120116878A_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the technical field of vehicle safety, and particularly relates to a method, a system and a device for safety warning of rear passengers getting off a vehicle. Background Art
[0002] With the continuous and rapid growth of the automobile ownership, road traffic safety issues have become increasingly prominent. Among various types of traffic accidents, collision accidents frequently occur when passengers get off the vehicle without fully observing the rear environment, posing a serious threat to people's lives and property safety.
[0003] In the prior art, there have been some methods for preventing rear collisions of vehicles. Among them, the more typical ones are Blind Spot Detection (BSD) and Rear Collision Warning System (RCTA). The blind spot monitoring system mainly uses sensors such as radars or cameras to monitor the blind spots on both sides of the vehicle. When it detects that another vehicle enters the blind spot, it will send a warning signal to the driver to assist the driver in avoiding collisions when changing lanes. The rear collision warning system focuses on detecting obstacles behind the vehicle through sensors during the vehicle's reverse process. When there is a collision risk, it will promptly send a warning to the driver to remind them to take corresponding measures.
[0004] However, these prior arts have obvious limitations. Their original design intention is mainly to assist the driver in changing lanes or reversing operations, and they are not specifically designed for the safety of rear passengers getting off the vehicle. In practical applications, the safety guarantee effect of these systems for rear passengers getting off the vehicle is very limited. For example, the blind spot monitoring and rear collision warning systems usually start when the driver performs specific operations (such as changing lanes, reversing), and for the behavior of rear passengers getting off the vehicle actively, these systems often cannot perceive in time and provide effective warnings.
[0005] In addition, there are also deficiencies in the warning timing and methods of the prior art. Most of the existing warning systems trigger warnings when the danger is approaching or the door has been opened. At this time, the passengers may already be in danger and cannot take effective risk avoidance measures in time. Moreover, the existing warning methods mainly rely on sound or simple light prompts, lacking intuitive and clear visual information display. Passengers may have difficulty accurately understanding the meaning of the warning and thus cannot make correct responses. Summary of the Invention
[0006] The purpose of the present invention is to provide a method, a system and a device for safety warning of rear passengers getting off a vehicle, so as to solve the technical defect in the prior art that the existing warning methods mainly rely on sound or simple light prompts, lacking intuitive and clear visual information display, and passengers may have difficulty accurately understanding the meaning of the warning and thus cannot make correct responses.
[0007] To achieve the above object, the present invention is implemented by the following technical solutions: In a first aspect, a method for safety warning of rear passengers getting off a vehicle is provided, including: Obtain vehicle driving state information; Utilize the obtained state information to determine whether the passengers in the vehicle have the intention to get off; Based on the determination result of the getting-off intention, collect the rear image of the real-time position of the vehicle and issue a safety warning to the passengers.
[0008] Further, the obtaining of the vehicle driving state information specifically includes: Obtain the driving speed information of the current vehicle and the position information of the current vehicle; wherein, the driving speed of the current vehicle is obtained based on a speed sensor, and the position information of the current vehicle is obtained based on a GPS sensor.
[0009] Further, the obtaining of the driving speed of the current vehicle based on a speed sensor specifically includes: Install speed sensors on the vehicle tires, and the number of speed sensors arranged on each vehicle tire is not less than two; Utilize the speed sensors to detect the wheel speed pulses of the vehicle tires, thereby obtaining the driving speed of the current vehicle.
[0010] Further, the utilization of the obtained state information to determine whether the passengers in the vehicle have the intention to get off specifically includes: Install a camera in the area inside the vehicle facing the rear passengers to capture the body behaviors and body movements of the passengers; wherein, the body behaviors of the passengers include the passengers unbuckling the seat belts, the passengers moving their hands and approaching the door handles, the passengers moving their hands to the door storage slots, and the passengers moving their hands to the side of the seats; the body movements include the passengers leaning forward, the passengers looking towards the door, and the passengers turning their heads backward to observe. Based on the obtained state information, when the camera monitors that the passengers in the vehicle show the situation that the passengers unfasten the seat belts and the passengers lean forward, or, show the situation that the passengers unfasten the seat belts, the passengers move their hands and approach the door handles, the passengers move their hands to the door storage slots, and the passengers move their hands to the side of the seats, it is determined that the passengers have a slight intention to get off; Based on the obtained state information, when the camera monitors that the passengers in the vehicle show the situation that the passengers unfasten the seat belts, the passengers lean forward, the passengers move their hands and approach the door handles, the passengers move their hands to the door storage slots, and the passengers move their hands to the side of the seats, it is determined that the passengers have a strong intention to get off.
[0011] Further, the unfastening of the seat belts by the passengers includes the seat belt unlocking state, the seat belt unlocking process, and the seat belt unlocking trigger action; Among them, the seat belt unlocking state is that the seat belt sensor detects that the seat belt is in the unlocked state; During the seat belt unlocking process, the seat belt tension sensor detects that the seat belt retractor is in a slack state or a pulled-out state, and the duration of the slack state or the pulled-out state is less than 4 - 5 seconds; The seat belt unlocking trigger action is that the camera monitors that the passenger's hand moves near the seat belt buckle and pinches the buckle button with the hand; The forward lean of the passenger includes a slight forward lean, an obvious forward lean, and a large forward lean; Among them, the slight forward lean is specifically that based on the vehicle seat, the passenger's body leans forward towards the front of the vehicle, so that the angle between the upper body of the body and the seat backrest is 10° - 20°; The obvious forward lean is specifically that based on the vehicle seat, the passenger's body leans forward towards the front of the vehicle, so that the angle between the upper body of the body and the seat backrest is 20° - 45°; The large forward lean is specifically that based on the vehicle seat, the passenger's body leans forward towards the front of the vehicle, so that the angle between the upper body of the body and the seat backrest is more than 45°; Further, when it is determined that the passenger has a slight intention to get off or a strong intention to get off, the hand movement judgment value range for the passenger's hand to move and approach the door handle, the passenger's hand to move to the door storage slot, and the passenger's hand to move towards the side of the seat is 10 cm - 30 cm; Before it is determined that the passenger has a slight intention to get off or a strong intention to get off, the obtained status information specifically includes: The driving speed information of the current vehicle and the distance information of the current vehicle from the passenger's destination.
[0012] Further, based on the result of the getting-off intention judgment, collecting the rear image of the vehicle's real-time position and sending a safety warning to the passenger specifically includes: When it is determined that the passenger has a slight intention to get off, collect the rear image of the vehicle's real-time position and display the rear image to the passenger; When it is determined that the passenger has a strong intention to get off, collect the rear image of the vehicle's real-time position, display the rear image to the passenger, and at the same time, send a voice warning to the passenger.
[0013] Further, collecting the rear image of the vehicle's real-time position and sending a safety warning to the passenger specifically includes: Install no less than two wide-angle night vision cameras at the rear of the vehicle. During the process of sending a safety warning to the passenger, display the movement trajectory changes of the vehicles, pedestrians, and cyclists behind the current vehicle; Among them, the movement trajectory changes include: The driving speed, driving direction, and time information of the rear vehicles, pedestrians, and cyclists to reach the current vehicle position.
[0014] In a second aspect, a safety warning system for a rear passenger to get off a vehicle is provided, including: An acquisition module for acquiring vehicle driving state information; A judgment module for judging whether the passengers in the vehicle have the intention to get off; A collection module for collecting the rear image of the real-time position of the vehicle; A warning module for sending a safety warning to the passengers in the vehicle.
[0015] In a third aspect, a mobile terminal is provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the steps of the safety warning method for a rear passenger to get off a vehicle as described above are implemented.
[0016] In a fourth aspect, a computer-readable storage medium is provided. The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the safety warning method for a rear passenger to get off a vehicle as described above are implemented.
[0017] In a fifth aspect, a computer program product is provided, including computer instructions, and the computer instructions instruct a computing device to execute the operations corresponding to the safety warning method for a rear passenger to get off a vehicle as described above.
[0018] Compared with the prior art, the present invention has the following beneficial effects: 1. By acquiring the vehicle driving state information to judge the intention of passengers to get off, and then collecting the rear image and sending a safety warning, it fills the gap in the safety warning for rear passengers to get off in the prior art and can effectively ensure the safety of rear passengers when getting off. Secondly, using the acquired vehicle driving state information to judge whether the passengers have the intention to get off, compared with most of the prior art that triggers warnings when danger is approaching or the door is opened, this solution can start the warning process at an early stage when the passengers have the idea of getting off, enabling the passengers to have enough time to understand the rear environment and make preparations in advance, greatly reducing the probability of collision accidents caused by insufficient observation of the rear environment.
[0019] 2. By acquiring the driving speed and position information of the current vehicle, warning information can be sent in a timely manner when the passengers reach the destination or during the process of reaching the destination.
[0020] 3. Installing a speed sensor on the vehicle tire can directly obtain the rotation information of the tire. Compared with installing it in other positions (such as the output shaft of the transmission, etc.), it reduces the error accumulation in the intermediate transmission link, thus more accurately reflecting the actual driving speed of the vehicle.
[0021] 4. By installing a camera in the vehicle to capture the limb behaviors and movements of passengers and setting reasonable criteria for judging mild and strong getting-off intentions, it is possible to accurately and timely judge the getting-off intentions of passengers, provide strong support for the safety warning of the getting-off of rear-row passengers in the vehicle, and effectively improve the safety when passengers get off the vehicle.
[0022] 5. Defining and detecting passengers unbuckling their seat belts can accurately capture the behavior information of passengers unbuckling their seat belts from multiple angles and levels, provide richer and more accurate data support for judging the getting-off intentions of passengers, and effectively improve the accuracy and reliability of the safety warning system for the getting-off of rear-row passengers in the vehicle.
[0023] 6. Conducting a detailed classification of passengers leaning forward and defining the angle range can improve the accuracy, objectivity, and consistency of the system's judgment of passengers' getting-off intentions, optimize the warning timing, enhance the user experience, and provide more powerful support for the safety warning system for the getting-off of rear-row passengers in the vehicle.
[0024] 7. Setting the numerical range for judging the movement of passengers' hands is of great significance for improving the accuracy of judging passengers' getting-off intentions, enhancing the adaptability and generality of the system, optimizing the warning strategy and timing, and reducing the risks of false judgment and missed judgment, and can effectively improve the performance and reliability of the safety warning system for the getting-off of rear-row passengers in the vehicle. BRIEF DESCRIPTION OF THE DRAWINGS
[0025] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for use in the embodiments will be briefly introduced below. It should be understood that the following drawings only show some embodiments of the present invention, and therefore should not be regarded as limiting the scope. For those of ordinary skill in the art, other related drawings can be obtained based on these drawings without creative efforts.
[0026] Figure 1 It is a flowchart of the safety warning method for the getting-off of rear-row passengers in the vehicle provided by the present invention; Figure 2 It is a schematic diagram of the safety warning system for the getting-off of rear-row passengers in the vehicle provided by the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS
[0027] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some, but not all, of the embodiments of the present invention. Components of the embodiments of the present invention generally described and illustrated in the drawings herein may be arranged and designed in a variety of different configurations.
[0028] Therefore, the detailed description of the embodiments of the present invention provided in the drawings below is not intended to limit the scope of the claimed invention, but merely represents selected embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts fall within the scope of protection of the present invention.
[0029] It should be noted that like reference numerals and letters denote like items in the following drawings. Therefore, once an item is defined in one drawing, it does not require further definition and explanation in subsequent drawings.
[0030] In the description of the embodiments of the present invention, it should be noted that if terms such as "upper", "lower", "horizontal", "inner", etc. indicate an orientation or positional relationship based on the orientation or positional relationship shown in the drawings, or the orientation or positional relationship in which the product of the invention is customarily placed during use, it is only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and thus should not be construed as a limitation of the present invention. In addition, terms such as "first", "second", etc. are only used for descriptive distinction and should not be construed as indicating or implying relative importance.
[0031] In addition, if the term "horizontal" appears, it does not mean that the component is required to be absolutely horizontal, but it can be slightly inclined. For example, "horizontal" only means that its direction is more horizontal relative to "vertical", and does not mean that the structure must be completely horizontal, but it can be slightly inclined.
[0032] In the description of the embodiments of the present invention, it should also be noted that unless otherwise clearly specified and limited, if terms such as "set", "installed", "connected", "coupled" are understood in a broad sense. For example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be directly connected or indirectly connected through an intermediate medium, and it can be the internal communication of two elements. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.
[0033] With the continuous and rapid growth of the number of automobiles, the issue of road traffic safety has become increasingly prominent. Among various types of traffic accidents, collision accidents frequently occur when passengers get out of the vehicle without fully observing the rear environment, posing a serious threat to people's lives and property safety.
[0034] In the prior art, there have been some methods for preventing rear collisions of vehicles. Among them, the more typical ones are Blind Spot Detection (BSD) and Rear Collision Warning System (RCTA). The blind spot detection system mainly uses sensors such as radar or cameras to monitor the blind spots on both sides of the vehicle. When it detects that another vehicle enters the blind spot, it will send a warning signal to the driver to assist the driver in avoiding collisions when changing lanes. The rear collision warning system focuses on detecting obstacles behind the vehicle through sensors during the vehicle's reverse process. When there is a collision risk, it will promptly send a warning to the driver to remind them to take corresponding measures.
[0035] However, these prior arts have obvious limitations. Their original design intention is mainly to assist the driver in changing lanes or reversing operations, and they are not specifically designed for the safety of rear passengers getting out of the vehicle. In practical applications, the safety protection effect of these systems for rear passengers getting out of the vehicle is very limited. For example, the blind spot detection and rear collision warning systems usually start when the driver performs specific operations (such as changing lanes, reversing), and for the behavior of rear passengers getting out of the vehicle actively, these systems often cannot perceive in time and provide effective warnings.
[0036] In addition, there are also deficiencies in the warning timing and method of the prior art. Most of the existing warning systems trigger warnings when the danger is already approaching or the door has been opened. At this time, the passengers may already be in danger and cannot take effective risk avoidance measures in time. Moreover, the existing warning methods mainly rely on sound or simple light prompts, lacking intuitive and clear visual information display. Passengers may have difficulty accurately understanding the meaning of the warning and thus cannot make the correct response.
[0037] To solve the above technical defects, the inventor provides a safety warning method, system and device for rear passengers getting out of a vehicle.
[0038] The following further describes the present invention in detail with reference to the accompanying drawings: In the first aspect, an embodiment of the present invention provides a safety warning method for rear passengers getting out of a vehicle, as Figure 1 shown, including: S101. Obtain vehicle driving state information; Exemplarily, first obtain the driving speed information of the current vehicle and the position information of the current vehicle; Among them, the current vehicle driving speed is obtained based on a speed sensor, and the current vehicle position information is obtained based on a GPS sensor; Specifically, the current vehicle driving speed is obtained based on a speed sensor, which specifically includes installing the speed sensor on the vehicle tire, and the number of speed sensors arranged on each vehicle tire is not less than two; Use the speed sensor to detect the wheel speed pulse of the vehicle tire, so as to obtain the current vehicle driving speed. Installing the speed sensor on the vehicle tire can directly obtain the rotation information of the tire. Compared with installing in other positions (such as the transmission output shaft, etc.), it reduces the error accumulation of the intermediate transmission link, thus more accurately reflecting the actual driving speed of the vehicle. Arranging not less than two speed sensors on each tire can improve the reliability of measurement through redundant design. When one of the sensors fails or is interfered, the other sensors can still work normally, ensuring the accuracy and continuity of the speed data, avoiding the speed information error caused by the failure of a single sensor, and further affecting the accuracy of the safety warning.
[0039] In addition, multiple speed sensors are distributed on each tire, which can adapt to different driving conditions and environmental conditions. For example, during vehicle driving, the tires may experience uneven force due to uneven road surfaces, turning, etc., resulting in fluctuations in the data measured by a single sensor. While multiple sensors work simultaneously, the data fusion algorithm can be used to process multiple measurement values to obtain more stable and accurate speed information, enhancing the robustness of the system in various complex situations and ensuring that the safety warning system can always work properly.
[0040] At the same time, the layout of multiple speed sensors helps with fault diagnosis. By comparing the measurement data of different sensors, abnormal sensors can be quickly detected. Once a certain sensor fails, the system can promptly issue an alarm to remind the maintenance personnel to check and replace it, avoiding the failure of the safety warning function due to sensor failure and ensuring the safe operation of the vehicle.
[0041] The speed sensor detects the wheel speed pulses of the vehicle tires, and can obtain the rotational speed information of the tires in real time. The frequency of the wheel speed pulses is proportional to the rotational speed of the tires. The system can calculate the driving speed of the vehicle in real time according to the frequency of the pulses. This way of obtaining the speed in real time enables the safety warning system to respond in a timely manner to the changes in the vehicle speed. When the intention of the passengers to get off the vehicle occurs, an accurate warning decision can be made based on the latest speed information, improving the timeliness of the warning. In this process, the detection of wheel speed pulses is a high-precision speed measurement method. By accurately counting the number of pulses and the time interval, the accurate rotational speed of the tires can be calculated, and then the driving speed of the vehicle can be obtained. The high-precision speed information is crucial for accurately assessing the degree of danger behind and determining the warning time. In addition, the method of obtaining the speed using wheel speed pulses is not limited by the vehicle driving speed range. Whether driving at a low speed or a high speed, the speed can be accurately measured, which enables the safety warning to work properly under various driving conditions and provides continuous and reliable safety protection for the rear passengers. At the same time, this method also has good adaptability to different types of vehicles (such as sedans, SUVs, trucks, etc.). As long as the vehicle is equipped with tires, this way can be used to obtain the speed information, improving the versatility of this safety warning method.
[0042] S102. Use the obtained status information to determine whether the passengers in the vehicle have the intention to get off; Exemplarily, install a camera in the area inside the vehicle facing the rear passengers to capture the body behaviors and body movements of the passengers; wherein, the passenger body behaviors include the passenger unbuckling the seat belt, the passenger's hand moving and approaching the door handle, the passenger's hand moving to the door storage slot, and the passenger's hand moving towards the side of the seat; the body movements include the passenger's body leaning forward, the passenger's gaze towards the door, and the passenger's head turning backward for observation; these behaviors and movements are the external manifestations of the passengers' intention to get off. Through comprehensive and detailed monitoring by the camera, rich information can be obtained, providing a data basis for accurately judging the passengers' intention to get off later. For example, actions such as the passenger unbuckling the seat belt and the hand moving close to the door handle may all be preludes to getting off. The camera can accurately capture these subtle changes, making the system's perception of the passengers' state more comprehensive. At the same time, the method of using the camera for monitoring is a non-intrusive detection method, which will not interfere with the normal behaviors and riding experiences of the passengers. The passengers do not need to wear any additional devices and will not feel uncomfortable because of the monitoring devices. This natural and comfortable monitoring method is more easily accepted by the passengers, which is beneficial to the popularization and application of this safety warning method.
[0043] The getting-off habits of different passengers may vary. By capturing various body behaviors and movements through a camera, it can adapt to the getting-off methods of various passengers. Whether the passenger is accustomed to unbuckling the seat belt first and then reaching for the door, or observing the surrounding environment first and then unbuckling the seat belt, the camera can capture the corresponding actions, thereby accurately judging the passenger's getting-off intention and improving the versatility and accuracy of the system.
[0044] Based on the acquired status information, when the camera monitors a passenger in the vehicle and there are situations where the passenger unbuckles the seat belt and the passenger's body leans forward, or, there are situations where the passenger unbuckles the seat belt, the passenger's hand moves and approaches the door handle, the passenger's hand moves to the door storage slot, and the passenger's hand moves to the side of the seat, it is determined that the passenger has a slight getting-off intention. This early judgment can enable the safety warning to make early warning preparations, start paying attention to the rear environment information when the passenger's getting-off intention is not very clear, and gain time for subsequent possible warning actions.
[0045] In addition, the judgment criteria for a slight getting-off intention are relatively loose, which can capture the early signs of the passenger's getting-off intention. This can avoid missing the passenger's getting-off intention due to overly strict judgment criteria, and at the same time reduce the situation of misjudging non-getting-off-related actions (such as adjusting the sitting posture, picking up items, etc.) of the passenger as a getting-off intention. By reasonably setting the judgment conditions for a slight getting-off intention, the accuracy of the system judgment is improved; at the same time, for some passengers who are slower or more cautious in their actions, they may have a long preparation time after unbuckling the seat belt before actually getting off. The judgment of a slight getting-off intention can provide personalized warning services for such passengers, give certain prompts when the passenger just shows signs of getting off, allowing the passenger to have enough time to understand the rear situation, and at the same time giving the system more time to prepare more detailed warning information.
[0046] Based on the acquired status information, when the camera monitors a passenger in the vehicle and there are situations where the passenger unbuckles the seat belt, the passenger's body leans forward, the passenger's hand moves and approaches the door handle, the passenger's hand moves to the door storage slot, and the passenger's hand moves to the side of the seat, it is determined that the passenger has a strong getting-off intention. At this time, an accurate safety warning can be immediately issued to remind the passenger to pay attention to the rear environment and avoid collision accidents. This timely warning can effectively reduce the safety risk when the passenger gets off and ensure the passenger's life safety; moreover, clarifying the judgment criteria for a strong getting-off intention can quickly respond after detecting relevant actions, reducing the reaction time, which is particularly important for dealing with emergencies. At the critical moment when the passenger is about to open the door, a quick and accurate warning can effectively avoid the occurrence of accidents and improve the efficiency and reliability of the entire safety warning system.
[0047] Furthermore, a passenger unbuckling the seat belt includes a seat belt unlocked state, a process of unlocking the seat belt, and an unlocking trigger action of the seat belt. Among them, the seat belt unlocked state means that the seat belt sensor detects that the seat belt is in an unlocked state. The seat belt sensor detecting that the seat belt is in an unlocked state provides a fundamental and crucial piece of information for determining whether the passenger intends to get off the vehicle. Unbuckling the seat belt is an important step before the passenger gets off the vehicle. Clearly detecting this state enables the system to accurately know the change in the usage situation of the passenger's seat belt, which is an important starting point for subsequent determination of the intention to get off the vehicle and helps to more precisely capture the starting signal of the passenger's getting-off behavior. At the same time, compared with other situations that may be misjudged (such as the seat belt being briefly loose for other reasons), directly detecting the seat belt unlocked state can avoid some interference factors because only when the passenger actively unlocks the seat belt does it conform to this state. Therefore, it can more accurately reflect that the passenger may have the intention to get off the vehicle, reduce misjudgments caused by other factors unrelated to getting off the vehicle, and improve the accuracy of the entire logic for determining the intention to get off the vehicle.
[0048] During the process of unlocking the seat belt, the seat belt tension sensor detects that the seat belt retractor is in a slack state or a pulled-out state, and the duration of the slack state or the pulled-out state is less than 4 - 5 seconds. This setting can capture the dynamic behavior of the passenger during the process of unbuckling the seat belt. When the passenger unbuckles the seat belt, the seat belt will change from being taut to slack or pulled out. By monitoring the state changes and the duration during this process, the operation behavior of the passenger can be understood in more detail, further confirming whether the passenger is performing the action of unbuckling the seat belt and providing richer dynamic information for determining the intention to get off the vehicle. Setting the duration limit to less than 4 - 5 seconds can effectively prevent the situation where the seat belt is briefly slack or pulled out due to vehicle bumps or the passenger briefly adjusting their posture from being misjudged as the passenger unbuckling the seat belt. Only the state changes with a duration within this range are considered as behaviors during the unlocking process, improving the reliability of the judgment and ensuring that the system can accurately identify the seat belt unlocking actions truly related to the intention to get off the vehicle.
[0049] The seat belt unlocking trigger action is that the camera monitors that the passenger's hand moves near the seat belt buckle and pinches the buckle button; the camera monitors that the passenger's hand moves near the seat belt buckle and pinches the buckle button. This detection can visually confirm that the passenger actively performs the operation of unfastening the seat belt. Through visual monitoring, the specific actions of the passenger can be directly observed, avoiding misjudgment situations that may occur relying solely on sensor data. For example, the sensor may generate incorrect signals due to malfunctions or external interference, but the actual actions captured by the camera are real and reliable, enabling a more accurate judgment of the passenger's intention to get off the vehicle. Incorporating the seat belt unlocking trigger action into the judgment system makes the entire judgment logic of the intention to get off the vehicle more complete. From the basic judgment of the seat belt unlocking state, to the dynamic monitoring during the unlocking process, and then to the visual confirmation of the unlocking trigger action, a multi-level and all-round judgment system is formed. This complete judgment logic can capture the behavioral characteristics of the passenger unfastening the seat belt more comprehensively, improve the accuracy and reliability of the judgment, and provide a more solid foundation for subsequent safety warnings.
[0050] In this embodiment, the forward lean of the passenger's body includes a slight forward lean, an obvious forward lean, and a large forward lean; among them, the slight forward lean specifically means that based on the vehicle seat, the passenger's body leans forward in the direction of the vehicle head, so that the angle between the upper body of the body and the seat backrest is 10° - 20°; the obvious forward lean specifically means that based on the vehicle seat, the passenger's body leans forward in the direction of the vehicle head, so that the angle between the upper body of the body and the seat backrest is 20° - 45°; the large forward lean specifically means that based on the vehicle seat, the passenger's body leans forward in the direction of the vehicle head, so that the angle between the upper body of the body and the seat backrest is more than 45°. Dividing the forward lean of the passenger's body into a slight forward lean, an obvious forward lean, and a large forward lean can more accurately judge the intensity of the passenger's intention to get off the vehicle. Different degrees of forward lean may imply different psychological states and levels of preparation for getting off the vehicle of the passenger; for example, a slight forward lean may just be the passenger adjusting the sitting posture or briefly observing the situation ahead, while an obvious forward lean and a large forward lean are more likely to indicate that the passenger is preparing to get off the vehicle, and the greater the degree of forward lean, the stronger the intention to get off the vehicle may be. Through this subdivision, corresponding warning strategies can be adopted according to different degrees of forward lean, improving the pertinence and accuracy of the warning.
[0051] Moreover, the forward lean habits of different passengers when preparing to get off the vehicle may be different. Some passengers may be used to leaning slightly forward and then pausing for a while before getting off, while some passengers may directly lean forward greatly to prepare to open the door. Subdividing the degree of forward lean can better adapt to the habits of various passengers, avoiding misjudgment or missed judgment of the intention to get off the vehicle of some passengers due to a unified standard, and improving the adaptability and generality of the system to different passengers.
[0052] In addition, specific angle ranges are defined for each degree of forward lean. For example, slight forward lean is in the range of 10° - 20°, obvious forward lean is in the range of 20° - 45°, and significant forward lean is above 45°. This provides a quantitative standard for judging the degree of forward lean of the passenger's body. Such a quantitative standard can improve the objectivity and consistency of the judgment, reduce errors caused by subjective judgment. Whether it is different systems or different operators, as long as they make judgments based on this standard, relatively consistent results can be obtained, ensuring the accuracy and reliability of the system's judgment. Moreover, the clear angle range is convenient for programming implementation in the system. Through the camera installed in the vehicle and image recognition technology, the system can accurately measure the angle between the upper body of the passenger and the seat backrest, and judge the degree of forward lean of the passenger according to the set angle range. This quantitative standard makes the judgment process of the system more automated and intelligent, improving the operation efficiency and accuracy of the system.
[0053] Finally, according to the different degrees of forward lean of the passenger's body, the system can optimize the warning timing. For slight forward lean, it can keep monitoring but not issue a warning for the time being; for obvious forward lean, it can start to prepare warning information, such as reminding the passenger to pay attention to oncoming vehicles behind; for significant forward lean, it can immediately issue a strong warning signal to remind the passenger to ensure safety before getting out of the car. This hierarchical warning strategy can improve the warning effect and avoid unnecessary interference to the passenger or the inability to avoid danger in a timely manner caused by premature or late warnings.
[0054] Furthermore, when it is judged that the passenger has a slight intention to get out of the car or a strong intention to get out of the car, the hand movement judgment value range for the passenger's hand to move and approach the door handle, the passenger's hand to move to the door storage slot, and the passenger's hand to move to the side of the seat is 10 cm - 30 cm. Setting the hand movement judgment value range at 10 cm - 30 cm can accurately capture the key hand movements related to the passenger getting out of the car. When the distance of the passenger's hand movement is within this range, it is very likely that the passenger intends to operate the door handle, take items from the door storage slot, or move to the side of the seat in preparation for getting out of the car. This range is neither too broad to misjudge some irrelevant hand movements nor too narrow to miss some effective signals of the intention to get out of the car, thus improving the accuracy of judging the passenger's intention to get out of the car. At the same time, the passenger may have various daily hand movements in the car, such as adjusting clothes, scratching the body, etc. Setting a movement range of 10 cm - 30 cm can effectively distinguish these daily movements from the movements related to getting out of the car. Generally speaking, the hand movement distance of daily movements is relatively small and lacks clear directionality, while the hand movement distance of movements related to getting out of the car is within this specific range and has an obvious target direction (such as the door handle, the door storage slot, etc.). By setting this value range, the system can more accurately identify the hand movements related to the intention to get out of the car.
[0055] The hand movement habits of different passengers when preparing to get off the vehicle may vary. Some passengers may be accustomed to slightly moving their hands first to feel for the position of the door handle, while some passengers may directly reach out more significantly to retrieve items from the door storage compartment. The numerical range of 10 cm to 30 cm can cover the hand movement habits of most passengers when getting off the vehicle. Whether it is a relatively cautious small movement or a relatively decisive large movement, they can all be effectively captured by the system, enhancing the adaptability and generality of the system to different passengers. Additionally, there may be differences in the position of the door handle, the layout of the door storage compartment, and the spatial distance between the seat and the door among different vehicle models. Setting this numerical range can, to a certain extent, accommodate these differences, enabling the safety warning to accurately judge the intention of passengers to get off the vehicle on a variety of different vehicle models, improving the generality and application scope of the system.
[0056] Furthermore, before determining that a passenger has a slight intention to get off the vehicle or a strong intention to get off the vehicle, the status information obtained specifically includes the driving speed information of the current vehicle and the distance information between the current vehicle and the passenger's destination. Considering the driving speed, the distance to the destination, and information such as the passenger's body movements and seat belt status comprehensively can more comprehensively and accurately judge the passenger's intention to get off the vehicle. For example, when the vehicle is driving at a slow speed and approaching the destination, actions such as the passenger unbuckling the seat belt and leaning forward are more likely to be preparations for getting off the vehicle. By comprehensively considering these information, it is possible to more reliably judge that the passenger has the intention to get off the vehicle.
[0057] S103. Based on the result of the determination of the intention to get off the vehicle, collect the rear image of the real-time position of the vehicle and issue a safety warning to the passenger; Exemplarily, when it is determined that the passenger has a slight intention to get off the vehicle, collect the rear image of the real-time position of the vehicle and display the rear image to the passenger, which can provide important information about the rear environment for the passenger. When the passenger is preparing to get off the vehicle, they may not be able to directly observe the situation behind the vehicle. By displaying the rear image, the passenger can understand whether there are oncoming vehicles, pedestrians, or other obstacles behind, thereby assisting them in making a decision on whether to get off the vehicle and avoiding safety accidents caused by getting off blindly; At the same time, the process of displaying the rear image is also a process of safety education. Even if the passenger initially only has a slight intention to get off the vehicle, after seeing the rear image, they will more intuitively realize the importance of paying attention to the rear environment when getting off the vehicle, thereby enhancing their safety awareness. This subtle educational method helps to cultivate good getting-off habits of passengers and improve the overall traffic safety level. Additionally, for a slight intention to get off the vehicle, only displaying the rear image without issuing a voice warning can avoid excessive interference to the passenger. The passenger may just have a temporary thought of getting off the vehicle and does not necessarily need to take immediate action. At this time, displaying the image allows the passenger to independently assess the risk of getting off the vehicle without interrupting their normal thinking and behavior.
[0058] When it is determined that the passenger has a strong intention to get off, the rear image of the vehicle's real-time position is collected. While showing the rear image to the passenger, a voice warning is issued to the passenger; a strong intention to get off means that the passenger is very likely to open the door and get off soon. At this time, issuing a voice warning can more directly and quickly remind the passenger to pay attention to the danger behind, timely stop the passenger's possible unsafe getting-off behavior, and effectively reduce the probability of accidents. At the same time, the combination of the voice warning and the rear image display forms a multi-sensory reminder method. The visual image display allows the passenger to see the actual situation behind, and the auditory voice warning further strengthens the danger signal, which can more effectively attract the passenger's attention and ensure that the passenger can fully pay attention to the safety situation behind under the strong intention to get off, avoiding danger caused by negligence; moreover, a strong intention to get off is often accompanied by a higher safety risk. At this time, more urgent and effective early warning measures are needed. The voice warning has a stronger sense of urgency and authority, which can attract the passenger's high attention in a short time, enable the passenger to quickly respond, and meet the safety needs in an emergency situation.
[0059] In this embodiment, collecting the rear image of the vehicle's real-time position and issuing a safety warning to the passenger specifically includes installing no less than two wide-angle night vision cameras at the rear of the vehicle. During the process of issuing a safety warning to the passenger, the movement trajectory changes of the vehicles, pedestrians, and cyclists behind the current vehicle are shown; among them, the movement trajectory changes include the driving speed, driving direction, and the time information to reach the position of the current vehicle of the vehicles, pedestrians, and cyclists behind.
[0060] In the above steps, installing no less than two wide-angle night vision cameras at the rear of the vehicle can significantly expand the rear vision range. A single camera may have a vision blind area, while multiple wide-angle cameras can cover a wider area, ensuring that the passenger can comprehensively understand the situation behind the vehicle, including oncoming vehicles, pedestrians, and cyclists from different angles, reducing potential safety hazards caused by limited vision; at the same time, the night vision function enables the camera to clearly capture the rear image even at night or in low-light conditions. When driving at night, the visibility of the vehicles, pedestrians, and cyclists behind is relatively low. The night vision camera can provide clear images, allowing the passenger to timely understand the dynamics behind and ensuring safe getting off. This is especially important for passengers who need to get off at night or in a dim environment. Finally, multiple cameras obtain information from different angles, complementing and verifying each other, which can improve the accuracy of monitoring the targets behind. For example, a single camera may not be able to accurately judge the distance and speed of a target due to the angle problem, but by combining the images of other cameras, the system can more precisely analyze the movement states of the vehicles, pedestrians, and cyclists behind, providing more reliable data support for subsequent safety warnings.
[0061] Furthermore, displaying the driving speed, driving direction, and the time information of the rear vehicle, pedestrians, and cyclists reaching the current vehicle's position can enable passengers to anticipate potential dangers in advance. Passengers can use this information to determine whether they have enough time to get off safely or whether they need to wait for the rear targets to pass before getting off. For example, if the rear vehicle is moving at a high speed and is about to reach the current vehicle's position, passengers can get prepared in advance to avoid collision accidents caused by suddenly opening the door.
[0062] In a second aspect, the present embodiment provides a safety warning system for a rear-seat passenger to get off a vehicle, as Figure 2 shown, including: An acquisition module, configured to acquire vehicle driving state information; A judgment module, configured to judge whether the passengers in the vehicle have the intention to get off; An acquisition module, configured to acquire the rear image of the real-time position of the vehicle; A warning module, configured to issue a safety warning to the passengers in the vehicle.
[0063] In a third aspect, a mobile terminal is provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the steps of the above-mentioned safety warning method for a rear-seat passenger to get off a vehicle are implemented.
[0064] In a fourth aspect, a computer-readable storage medium is provided. The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the above-mentioned safety warning method for a rear-seat passenger to get off a vehicle are implemented.
[0065] In a fifth aspect, a computer program product is provided, including computer instructions, and the computer instructions direct a computing device to perform operations corresponding to the above-mentioned safety warning method for a rear-seat passenger to get off a vehicle.
[0066] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and not to limit the scope of its protection. Although the present invention has been described in detail with reference to the above embodiments, those of ordinary skill in the art should understand that: after reading the present invention, those skilled in the art can still make various changes, modifications, or equivalent replacements to the specific implementation manners of the invention, but these changes, modifications, or equivalent replacements are all within the scope of the protection of the pending claims of the invention.
Claims
1. A vehicle rear passenger getting off safety warning method, characterized in that: include: Obtain vehicle driving status information; Using the acquired status information, determining whether the passenger in the vehicle intends to get off the vehicle; Based on the determination result of the intention to get off the vehicle, a rear image of the vehicle's real-time position is collected, and a safety warning is issued to the passenger.
2. The vehicle rear passenger getting off safety warning method according to claim 1, characterized in that: The obtaining of vehicle driving status information specifically includes: Acquire the current vehicle's driving speed information and the current vehicle's location information; wherein the current vehicle's driving speed is acquired based on a speed sensor, and the current vehicle's location information is acquired based on a GPS sensor.
3. The vehicle rear passenger getting off safety warning method according to claim 2, characterized in that: The current vehicle speed is obtained based on a speed sensor, specifically including: The speed sensors are installed on the tires of the vehicle, and the number of speed sensors arranged on each tire of the vehicle is not less than two; The speed sensor is used to detect the wheel speed pulse of the vehicle tire to obtain the current vehicle speed.
4. The vehicle rear passenger getting off safety warning method according to claim 1, characterized in that: The step of using the acquired state information to determine whether the passenger in the vehicle intends to get off the vehicle specifically includes: Install cameras in the area facing rear passengers in the vehicle to capture passengers' body behaviors and body movements; wherein the passenger body behaviors include passengers unbuckling seat belts, passengers moving their hands close to door handles, passengers moving their hands to door storage slots, and passengers moving their hands to the sides of seats; the body movements include passengers leaning forward, passengers looking toward the door, and passengers turning their heads backwards to observe; Based on the acquired status information, when the camera detects that a passenger in the vehicle unbuckles his seat belt and leans forward, or when a passenger unbuckles his seat belt, moves his hand close to the door handle, moves his hand to the door storage slot, or moves his hand to the side of the seat, it is determined that the passenger has a slight intention to get off the vehicle; Based on the acquired status information, when the camera monitors the passengers in the car and finds that the passenger unbuckles his seat belt, leans forward, moves his hand close to the door handle, moves his hand to the door storage slot, and moves his hand to the side of the seat, it is judged that the passenger has a strong intention to get off the car.
5. The vehicle rear passenger getting off safety warning method according to claim 4, characterized in that: The passenger unbuckling the seat belt includes the seat belt unlocking state, the seat belt unlocking process and the seat belt unlocking triggering action; Wherein, the seat belt unlocking state is that the seat belt sensor detects that the seat belt is in the unlocking state; During the seat belt unlocking process, the seat belt tension sensor detects that the seat belt retractor is in a relaxed state or a pulled-out state, and the duration of the relaxed state or the pulled-out state is less than 4 to 5 seconds; The seat belt unlocking triggering action is that the camera detects that the passenger's hand moves near the seat belt buckle and pinches the buckle button; The passenger's body leaning forward includes leaning forward slightly, leaning forward obviously, and leaning forward significantly; The slight forward leaning refers to the passenger leaning forward toward the front of the vehicle with the seat in the vehicle as the reference, so that the angle between the upper body and the seat back is 10° to 20°; The obvious forward leaning specifically refers to the passenger's body leaning forward toward the front of the vehicle based on the seat in the vehicle, so that the angle between the upper body and the seat back is 20° to 45°; The significant forward leaning specifically refers to the passenger leaning forward toward the front of the vehicle with the seat in the vehicle as the reference, so that the angle between the upper body and the seat back is greater than 45°; When judging that the passenger has a slight intention to get off the vehicle or a strong intention to get off the vehicle, the hand movement judgment values for the passenger's hand moving close to the door handle, the passenger's hand moving to the door storage slot, and the passenger's hand moving to the side of the seat are in the range of 10 cm to 30 cm; Before determining whether the passenger has a slight intention to get off the bus or a strong intention to get off the bus, the acquired status information specifically includes: The current vehicle's speed and the distance between the current vehicle and the passenger's destination.
6. The vehicle rear passenger getting off safety warning method according to claim 1, characterized in that: The method of collecting rear images of the vehicle's real-time position based on the determination result of the intention to get off the vehicle and issuing a safety warning to the passenger specifically includes: When it is determined that the passenger has a slight intention to get off the vehicle, a rear image of the vehicle's real-time position is collected and the rear image is displayed to the passenger; When it is determined that the passenger has a strong intention to get off the vehicle, the rear image of the vehicle's real-time position is collected, and the rear image is displayed to the passenger while a voice warning is issued to the passenger; The collecting of rear images of the vehicle's real-time position and issuing of safety warnings to the passengers is specifically performed by installing at least two wide-angle night vision cameras at the rear of the vehicle, and displaying the movement trajectory changes of vehicles, pedestrians and cyclists behind the current vehicle during the process of issuing safety warnings to the passengers; The movement trajectory change includes: Information about the speed, direction, and arrival time of vehicles, pedestrians, and cyclists behind you.
7. A vehicle rear passenger getting off safety warning system, characterized in that: include: An acquisition module, used to acquire vehicle driving status information; A judgment module is used to judge whether the passengers in the vehicle intend to get off the vehicle; A collection module is used to collect rear images of the vehicle's real-time position; The early warning module is used to issue safety warnings to passengers in the car.
8. A mobile terminal comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the steps of the vehicle rear passenger getting off safety warning method as described in any one of claims 1-6 are implemented.
9. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the vehicle rear passenger getting off safety warning method as described in any one of claims 1 to 6 are implemented.
10. A computer program product comprising computer instructions, characterized in that: The computer instructions instruct the computing device to execute operations corresponding to the vehicle rear passenger getting off safety warning method as described in any one of claims 1-6.
Citation Information
Cited By
Vehicle active safety system under personnel leaving scene and control method
CN120503731A
