Boarding and alighting identification method and system, electronic equipment and vehicle

Abstract

The invention provides a getting-on and getting-off identification method and system, electronic equipment and a vehicle, and relates to the technical field of vehicles. According to the method, the boarding behavior of the main driver is accurately judged by monitoring the specific state change of the vehicle. The method comprises the following steps: firstly detecting a first characteristic that a main driving position is not occupied, and then when at least one second characteristic including vehicle unlocking, main driving position door opening and in-vehicle air conditioner starting is monitored, judging that a main driver is about to get on the vehicle. And finally, after a third characteristic that the main driving position is occupied and the vehicle door is closed is monitored within a set time interval, it is confirmed that the main driver gets on the vehicle. According to the method, automatic and intelligent recognition of the driver in the getting-on process is achieved, and the convenience and safety of vehicle use are improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of vehicles, in particular to a method and system for identifying getting on and off a vehicle, an electronic device and a vehicle. BACKGROUND

[0002] In the process of using a vehicle, accurately identifying getting on and off the vehicle is of great significance. This not only improves the safety of passengers and drivers, avoiding accidents, such as warning passengers to get on and off the vehicle safely when approaching the destination. The existing method is mostly dependent on the client of a third-party platform to identify the passenger getting on the vehicle. This means that the traditional vehicle itself does not develop scene perception functions, and many technical applications completely rely on external platforms, resulting in the vehicle itself not having intelligent functions. This situation limits the flexibility and application potential of the vehicle system, and also makes it difficult to achieve real-time and accurate monitoring and response to the vehicle environment, and cannot fully realize the various potential advantages brought by vehicle intelligence. SUMMARY

[0003] The purpose of the present application is to provide a method and system for identifying getting on and off a vehicle, an electronic device and a vehicle to solve one or more technical problems existing in the prior art, at least to provide a beneficial choice or create conditions.

[0004] The solution to the technical problem of the present application is: on the one hand, the present application provides a method for identifying getting on and off a vehicle, comprising the following main driver getting on the vehicle identification steps: monitoring a first feature; wherein the first feature is that the main driver seat is not occupied; When the first feature is monitored, a second feature is monitored, and when at least one feature in the second feature is monitored, it is determined that the main driver will get on the vehicle, and a third feature is monitored; wherein the second feature includes vehicle unlocking, main driver seat door opening and vehicle air conditioning turning on; and the third feature includes main driver seat being occupied and main driver seat door being closed; When all features of the third feature are monitored within a first set interval, it is determined that the main driver gets on the vehicle.

[0005] Further, after determining that the main driver gets on the vehicle, the following passenger getting on the vehicle identification steps are performed: monitoring a fourth feature and a fifth feature; wherein the fourth feature includes P or N gear, vehicle parking on the roadside and double flasher turning on, and the fifth feature includes passenger seat being unoccupied and passenger seat door being opened; the passenger seat includes the co-driver seat and the rear seat; When all features of the fourth feature and at least one feature of the fifth feature are monitored, it is determined that the passenger will get on the vehicle, and a sixth feature is monitored; The sixth feature includes the passenger seat being occupied and the passenger seat door being closed. When all features of the sixth feature are monitored within a second set interval time, it is determined that the passenger is getting on.

[0006] Further, after determining that the passenger is getting on, the following passenger getting-off identification steps are performed: The seventh feature, the eighth feature and the ninth feature are monitored. The seventh feature is the P or N gear, the eighth feature includes the co-driver seat safety belt being unfastened, the co-driver seat door being opened and the navigation reaching the destination, and the ninth feature includes the rear seat door being opened and the navigation reaching the destination. When the seventh feature is monitored, and at least one of the eighth feature or at least one of the ninth feature is monitored, it is determined that the passenger is about to get off, and the tenth feature is monitored. The tenth feature includes the passenger seat door being closed and the passenger seat being unoccupied, and the previous time state is the passenger being about to get on or about to get off. When all features of the tenth feature are monitored, it is determined that the passenger is getting off.

[0007] Further, after determining that the driver is getting on, the following driver getting-off identification steps are performed: The eleventh feature is monitored. The eleventh feature includes the driver seat being occupied, the driver seat door being opened, the driver seat safety belt being unfastened and the P gear being engaged. When all features of the eleventh feature are monitored, it is determined that the driver is about to get off, and the twelfth feature is monitored. The twelfth feature includes the driver seat door being closed, the driver seat being unoccupied and the door being locked. When all features of the twelfth feature are monitored within a third set interval time, it is determined that the driver is getting off.

[0008] Further, the occupancy state of the driver seat and the passenger seat is monitored by a camera, a pressure sensor, an infrared sensor or a weight detection device; the door state is monitored by a camera, a micro switch, a proximity sensor, a hall switch, or is determined by the vehicle ECU processing the door state sensor signal; the vehicle unlocking state, the vehicle interior air conditioning state, the gear state and the double flash light state are obtained by the vehicle ECU.

[0009] Further, when it is determined that the passenger is about to get off, a safety reminder is triggered; the safety reminder is used to remind the passenger to pay attention to the safety of the surrounding environment.

[0010] Further, when it is determined that the passenger is getting on, the billing starts, and when it is determined that the passenger is getting off, the billing ends.

[0011] In another aspect, the present application provides a boarding and alighting identification system, comprising: a feature monitoring module configured to monitor first to twelfth features of the vehicle; a logic judgment module configured to execute the aforementioned boarding and alighting identification method according to the monitoring results of the feature monitoring module, a first set interval time, a second set interval time and a third set interval time.

[0012] In another aspect, the present application provides an electronic device comprising a processor and a memory, wherein the memory stores a computer program, and the processor executes the computer program to realize the aforementioned boarding and alighting identification method.

[0013] In another aspect, the present application provides a vehicle comprising the aforementioned boarding and alighting identification system.

[0014] The present application provides a boarding and alighting identification method, which accurately judges the boarding behavior of the driver by monitoring the specific state changes of the vehicle. First, the first feature that the driver seat is unoccupied is detected, then when at least one second feature including vehicle unlocking, driver seat door opening and vehicle air conditioning opening is monitored, it is determined that the driver will board. Finally, after the third feature that the driver seat is occupied and the door is closed is monitored within a set time interval, it is confirmed that the driver has boarded. This method realizes the automatic and intelligent identification of the driver boarding process, and improves the convenience and safety of vehicle use. The present application also provides a corresponding system, electronic device and vehicle, and the beneficial effects of the system, electronic device and vehicle are similar to those of the method, which will not be repeated here.

[0015] Other features and advantages of the present application will be set forth in the following description, and in part will become apparent to those skilled in the art from the description, or can be learned by practice of the present application. The objects and other advantages of the present application can be realized and obtained by the structure particularly pointed out in the specification, claims and drawings. BRIEF DESCRIPTION OF DRAWINGS

[0016] The accompanying drawings are included to provide a further understanding of the technical solutions of the present application, and constitute a part of the specification, and are used together with the embodiments of the present application to explain the technical solutions of the present application, and do not constitute a limitation on the technical solutions of the present application.

[0017] Figure 1 is a flowchart of the driver boarding identification step provided by the present application; Figure 2 is a flowchart of the passenger boarding identification step provided by the present application; Figure 3 is a flowchart of the passenger alighting identification step provided by the present application; Figure 4 is a flow chart of the off-vehicle identification step provided by the present application; Figure 5 is a structural diagram of the on-off vehicle identification system provided by the present application. DETAILED DESCRIPTION

[0018] In order to make the purposes, technical solutions and advantages of the present application clearer, the present application is further described in detail below in combination with the drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and do not limit the present application.

[0019] The present application is further described below in combination with the drawings and specific embodiments. The described embodiments should not be considered as limiting the present application, and all other embodiments obtained by those of ordinary skill in the art without making creative efforts fall within the scope of protection of the present application.

[0020] In the following description, "some embodiments" are described, which describe a subset of all possible embodiments, but it can be understood that "some embodiments" can be the same subset or different subsets of all possible embodiments, and can be combined with each other without conflict.

[0021] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which the present application belongs. The terms used herein are only for the purpose of describing the embodiments of the present application and are not intended to limit the present application.

[0022] During the use of the vehicle, accurately identifying the on-off behavior is of great significance. This ability not only improves the safety of passengers and drivers, avoiding accidents, such as warning passengers to ensure their safe on-off when approaching the station; but also for commercial vehicle systems, it can optimize services, provide better passenger flow management and information feedback, and thus improve the overall riding experience. By analyzing the on-off data, the operator can understand the passenger flow and peak travel period, and thus optimize the route arrangement, departure frequency and resource allocation, and improve the operation efficiency. In addition, combined with automation technology, the intelligent level of the vehicle can be improved, making the vehicle system more flexible and adaptable.

[0023] Some existing technical solutions rely on the client of a third-party platform to identify the passenger boarding behavior. For example, in the patent with publication number CN104867324A, the first client and the second client continuously detect whether the second client is located within a preset area range after accepting an order. When located within the preset area range, it is determined whether the passenger has finally boarded the vehicle according to the state of the vehicle driving. In the patent with publication number CN112714101A, the server obtains the first verification information corresponding to the passenger client after receiving the passenger has boarded the vehicle instruction sent by the passenger client, and verifies whether the first verification information and the second verification information are the same after receiving the second verification information uploaded by the driver client, thereby determining whether the passenger has boarded the vehicle.

[0024] These existing technical solutions mainly have the following shortcomings. First, they are all based on the client of a third-party platform, which means that the traditional vehicle itself does not develop scene perception function, and many technical applications completely rely on the support of external platforms. Due to the dependence on external platforms, these methods are difficult to realize real-time and accurate monitoring and response to the in-vehicle environment. Especially in dynamic environments, such as busy urban streets or rapidly changing weather conditions, this method may not be able to accurately reflect the actual situation in time. Therefore, the current method limits the intelligent development of the vehicle itself, so that the vehicle cannot independently identify the boarding and alighting behavior of the passenger, which greatly limits the flexibility and application potential of the vehicle system, and is not conducive to the development trend of intelligent vehicles.

[0025] In view of the above technical problems, the embodiments of the present application provide a boarding and alighting identification method, system, electronic device and vehicle, so that the vehicle itself has scene perception capability, can accurately identify the boarding and alighting behavior, and improve the intelligent level of the vehicle, providing a basis for enriching the application of the vehicle. Referring to Table 1, Table 1 is a feature classification provided by the embodiments of the present application. Through a series of feature classification and logical judgment, the present application can effectively overcome the shortcomings in the prior art, not only improving the safety of passengers and drivers, but also providing technical support for the optimization of commercial vehicle systems.

[0026] Table 1 Feature Classification

[0027] First, the boarding and alighting identification method provided by the embodiments of the present application will be described in detail below with reference to the accompanying drawings.

[0028] Referring to Figure 1 The implementation process of the main driver boarding identification method provided by the embodiments of the present application includes but is not limited to the following steps.

[0029] Step S110, monitoring the first feature.

[0030] The first feature is that the main driver seat is not occupied.

[0031] Step S110 is the starting point of the entire recognition process, and the main task is to monitor the first feature, i.e., the main driver seat is empty. The significance of this step is to confirm that there is currently no driver in the vehicle, providing a basic condition for subsequent judgment of whether the driver is about to get in or has already gotten in. By detecting whether the main driver seat is empty, the system can accurately identify that the vehicle is in a state of waiting for use, rather than being driven. This confirmation of the initial state is crucial to ensure the accuracy of subsequent steps, as it directly affects the judgment of the vehicle's usage.

[0032] Step S120, when the first feature is monitored, the second feature is monitored, and when at least one feature in the second feature is monitored, it is determined that the main driver is about to get in, and the third feature is monitored.

[0033] Among them, the second feature includes vehicle unlocking, main driver seat door opening and vehicle air conditioning opening. The third feature includes the main driver seat being occupied and the main driver seat door being closed.

[0034] Step S120, when the system detects that the main driver seat is empty, it can accurately identify that the vehicle is in a state of waiting for use, rather than being driven. When the system monitors at least one feature in the second feature, including but not limited to vehicle unlocking, main driver seat door opening, and vehicle air conditioning opening, it is determined that the main driver is about to get in, and the third feature is monitored. The key to this step is to use these features as signs to indicate that the driver is preparing to enter the vehicle. For example, when vehicle unlocking and main driver seat door opening are detected, it means that the driver may be approaching the vehicle and preparing to get in; while the vehicle air conditioning is turned on, it may be to adjust the temperature inside the vehicle in advance to prepare for the upcoming journey. By monitoring these behavioral features, the system can predict the driver's behavior intention, thereby preparing for the next action.

[0035] Step S130, when all features of the third feature are monitored within the first set interval time, it is determined that the main driver has gotten in.

[0036] In step S130, when the system monitors all features of the third feature, including the main driver seat being occupied and the main driver seat door being closed, within the first set interval time, it is finally determined that the main driver has gotten in. This step is one of the most critical parts of the entire recognition process, as it directly determines whether the driver has truly entered the vehicle and started a new journey. The first set interval time here is an important parameter that takes into account the habit differences of different drivers (such as immediately getting in or stopping for a while) to adapt to various actual situations. By monitoring that the main driver seat changes from empty to occupied and the door is closed, the system can be sure that the driver has successfully gotten in, which not only improves the accuracy of recognition, but also lays the foundation for subsequent operations (such as starting the vehicle).

[0037] Referring to Figure 2 The implementation process of the passenger boarding identification method provided by the embodiments of the present application includes but is not limited to the following steps. After determining that the main driver has boarded, the following steps are performed: Step S210, monitoring the fourth feature and the fifth feature.

[0038] The fourth feature includes P or N gear, vehicle parking on the roadside, and double flash light turned on, and the fifth feature includes no seat occupancy in the passenger seat and the passenger seat door being opened. The passenger seat includes the co-driver seat and the rear seat.

[0039] In step S210, on the premise that the main driver has completed the boarding operation, it is further determined whether a passenger is about to board. This step comprehensively determines whether the passenger is in a state of preparing to board by simultaneously monitoring the fourth feature (P or N gear, vehicle parking on the roadside, double flash light turned on) and the fifth feature (no seat occupancy in the passenger seat, passenger seat door opened).

[0040] Step S220, when all features of the fourth feature and at least one feature of the fifth feature are monitored, it is determined that the passenger is about to board, and the sixth feature is monitored.

[0041] The sixth feature includes seat occupancy in the passenger seat and the passenger seat door being closed.

[0042] In step S220, when all features of the fourth feature (P or N gear, vehicle parking on the roadside, double flash light turned on) and at least one feature of the fifth feature (no seat occupancy in the passenger seat, passenger seat door opened) are simultaneously monitored, it is comprehensively determined that the passenger is about to board, and the sixth feature is monitored.

[0043] Specifically, in the fourth feature, P or N gear indicates that the vehicle has stopped and entered a non-running state, which usually means that the driver has prepared for the passenger to get on and off the vehicle. The vehicle parked on the roadside indicates that the vehicle is in a safe position for boarding and alighting, which is a typical scenario for passengers to get on and off the vehicle. Double flash light turned on is usually a signal for boarding and alighting or temporary parking, indicating that the vehicle will not move temporarily, which enhances the recognition accuracy of the system for the current behavior scenario. These features together constitute an environment background that the vehicle has stopped and has the conditions for boarding and alighting, providing a basic premise for determining whether the passenger is about to board. In the fifth feature, no seat occupancy in the passenger seat indicates that the target seat is currently in an idle state, which meets the premise of the passenger about to board. The passenger seat door being opened directly reflects that a passenger is trying to enter the vehicle.

[0044] When the system detects that all of the above fourth features are met, and at least one of the fifth features is triggered, it is determined that a passenger is about to get on the vehicle. The significance of this step is to build a high-credibility passenger getting-on event triggering mechanism through multi-dimensional sensor data fusion, thereby avoiding misjudgment and improving the accuracy and intelligence level of identification.

[0045] Step S230, when all features of the sixth feature are monitored within the second set interval time, it is determined that the passenger gets on the vehicle.

[0046] In step S230, the passenger getting-on event predicted in step S220 is confirmed. In this step, the system continuously monitors all features of the sixth feature within the second set time interval, i.e. the passenger seat is occupied and the passenger seat door is closed. If both features are detected within the specified time, it is determined that the passenger has completed the boarding action.

[0047] Specifically, in the sixth feature, the passenger seat is occupied, which means that the passenger has sat in the designated seat through the seat pressure sensor or other occupancy detection device, indicating the completion of the physical meaning of getting on the vehicle. The passenger seat door is closed, indicating that the passenger has entered the vehicle and closed the door, further verifying the completion of the boarding behavior.

[0048] The design of the second set interval time takes into account the difference in the boarding speed of different passengers, such as the boarding time of the elderly, children or those carrying luggage, which may be longer. Therefore, this time window has a certain flexibility to ensure that the system does not make a false judgment too early, and also does not affect the response efficiency due to waiting too long.

[0049] The core role of this step is to realize the closed-loop identification of the passenger boarding behavior, from predicting getting on to finally confirming getting on, forming a complete logic chain, making the entire identification process more rigorous and reliable. This method not only improves the intelligent perception ability of the vehicle system, but also provides accurate data support for subsequent functions (such as automatic start of the trip, billing, voice prompts, etc.), which is an important technical foundation for realizing intelligent travel services.

[0050] Reference Figure 3 The implementation process of the passenger getting-off identification method provided by the embodiments of the present application includes but is not limited to the following steps. After determining that the passenger gets on the vehicle, the following steps are performed: Step S310, monitoring the seventh feature, the eighth feature and the ninth feature.

[0051] Among them, the seventh feature is to put the vehicle in P or N gear, the eighth feature includes the following: the safety belt of the co-driver seat is unfastened, the co-driver seat door is opened, and the navigation reaches the destination, and the ninth feature includes the opening of the rear seat door and the navigation to the destination.

[0052] In step S310, the seventh feature, the eighth feature and the ninth feature are monitored. Through the combination judgment of multiple groups of features, a high-credibility scene perception mechanism is constructed to identify whether the passenger is in a state of preparing to get off.

[0053] In step S320, when the seventh feature is monitored and at least one of the eighth feature or at least one of the ninth feature is monitored, it is determined that the passenger is about to get off, and the tenth feature is monitored.

[0054] The tenth feature includes that the passenger seat door is closed and the passenger seat is unoccupied, and the previous time state is that the passenger is about to get on or about to get off.

[0055] In step S320, when the seventh feature is monitored and at least one of the eighth feature or at least one of the ninth feature is monitored, it is determined that the passenger is about to get off, and the tenth feature is monitored.

[0056] Specifically, the seventh feature (P or N gear) is one of the basic signals that the vehicle has stopped driving and the driver is preparing to let the passenger get on and off the vehicle. When the vehicle is in P or N gear, it usually means that the vehicle has stopped stably and has the safety conditions for the passenger to get on and off the vehicle. The eighth feature is suitable for the passenger in the front passenger seat, including the front passenger seat unfastening the seat belt, the front passenger seat door opening, and the navigation reaching the destination; the ninth feature is suitable for the passenger in the rear seat, including the rear seat door opening and the navigation reaching the destination.

[0057] These features respectively reflect the possibility of the passenger's intention to leave the vehicle from multiple dimensions such as the passenger's own actions (such as unfastening the seat belt and opening the door) and the vehicle state (such as the navigation reaching the destination). The system can trigger the prediction event that the passenger is about to get off as long as the seventh feature is detected and any one of the eighth or ninth feature is selected.

[0058] Through the linkage of sensors and vehicle systems, intelligent prediction of the behavior intention of passengers in the vehicle is realized, instead of simply relying on user operation (such as manually clicking a button). This comprehensive judgment method based on physical behavior and vehicle state can effectively improve the accuracy and response speed of identification, and provide data support for subsequent more complex intelligent services (such as getting-off reminders, automatic billing ending, voice prompts after the door is closed, etc.).

[0059] In step S330, when all features of the tenth feature are monitored, it is determined that the passenger gets off.

[0060] In step S320, the prediction event that the passenger is about to get off is finally confirmed. This step requires the system to monitor all features of the tenth feature, including that the passenger seat door is closed and the passenger seat is unoccupied, and to meet the precondition that the previous time state is that the passenger is about to get on or about to get off.

[0061] The passenger seat door closing indicates that the passenger has completed getting off and closing the door, which is a clear behavior end point; the passenger seat no occupancy is confirmed by a pressure sensor or other occupancy detection technology that the seat is empty, indicating that the passenger has left in a physical sense; the previous state is "about to get on" or "about to get off": as a basis for correlation in time sequence, it ensures that the system only makes judgments in specific behavior processes, avoiding interference from isolated events.

[0062] This setting ensures that the system will not misjudge accidental empty seats or door opening and closing, but will make closed-loop verification based on existing behavior trajectories. For example, if a passenger has just been identified as "about to get off", and then the system detects that the door is closed and the seat is unoccupied, it can be highly determined that the passenger has completed the action of getting off.

[0063] The core role of this step is to achieve accurate closed-loop identification of the passenger's getting-off behavior, from the prediction of getting off to the confirmation of getting off, forming a complete getting-on and getting-off behavior link. This not only improves the environmental perception ability of the whole vehicle system, but also provides reliable data support for subsequent functions such as automatic settlement, ride record statistics, and personalized service push, and is an important technical foundation for promoting intelligent operation of vehicles.

[0064] Referring to Figure 4 The implementation process of the main driver getting-off identification method provided by the embodiments of the present application includes but is not limited to the following steps. After determining that the main driver gets on, the following steps are performed: Step S410, monitoring the eleventh feature.

[0065] The eleventh feature includes the main driver seat having an occupancy, the main driver seat door being open, the main driver seat safety belt being unfastened, and the P gear being engaged.

[0066] In step S410, the system detects all features of the eleventh feature, wherein the main driver seat having an occupancy indicates that the current driver is still sitting on the driver seat; the main driver seat door being open indicates that the driver is preparing to leave the vehicle; the main driver seat safety belt being unfastened is a typical pre-getting-off action, indicating that the driver has completed the driving task; and the P gear being engaged indicates that the vehicle has completely stopped and is in the parking state, and has the condition of safe getting off.

[0067] Step S420, when all features of the eleventh feature are monitored, it is determined that the main driver is about to get off, and the twelfth feature is monitored.

[0068] The twelfth feature includes the main driver seat door being closed, the main driver seat having no occupancy, and the door being locked.

[0069] In step S420, when all features of the eleventh feature are monitored, it is determined that the main driver is about to get off, and the twelfth feature is monitored. The four features in the eleventh feature jointly constitute a highly reliable driver preparation for getting off the scene model. Among them, the main driver seat has an occupancy, which ensures that the driver has not left the seat at this time, providing a time starting point for the subsequent getting-off action; the opening of the door and the unfastening of the safety belt are typical physical actions of the driver preparing to get off; and the P gear is put in, which provides strong evidence for the driver's intention to end driving from the vehicle control point of view.

[0070] The significance of this step is to build an intelligent recognition mechanism that can perceive the user's intention without active interaction through the linkage of multi-dimensional sensors and vehicle control systems. Compared with the traditional method of relying on manual operation of the user (such as clicking a button), this automatic recognition method based on behavior features and vehicle state has higher accuracy and intelligence level, and can provide accurate data support for subsequent functions (such as getting-off reminder, automatic locking, ride recording end, etc.).

[0071] In step S430, when all features of the twelfth feature are monitored within a third set interval of time, it is determined that the main driver gets off.

[0072] In step S430, the pre-judged main driver is about to get off the event is finally confirmed. In this step, the system continuously monitors all features of the twelfth feature within a third set time interval. Among them, the main driver seat door is closed, indicating that the driver has completed getting off and closing the door; the main driver seat has no occupancy, which means that the driver has left the seat through the seat pressure sensor or other occupancy detection device; the vehicle is locked, which means that the driver has left the vehicle and is ready to end this use. In addition, the system also requires to meet the precondition that the state at the previous moment is that the main driver is about to get off, in order to ensure the time continuity and logical consistency of the recognition process, and to avoid misjudgment caused by isolated events.

[0073] This setting fully considers the differences in the habits of different drivers getting off, for example, some drivers will lock the car immediately after getting off, and some will stay for a while before locking the car. Therefore, the system sets a reasonable time window, neither too early to make a judgment, nor too long to affect the response efficiency.

[0074] The core role of this step is to realize the closed-loop recognition of the main driver's getting-off behavior, from the pre-judgment of about to get off to the confirmation of having gotten off, forming a complete getting-on and getting-off behavior chain. This closed-loop recognition mechanism not only improves the environmental perception ability and automation level of the whole vehicle system, but also provides reliable technical support for subsequent functions such as ride settlement, driving record archiving, and personalized service pushing, and is an important foundation for promoting the intelligent management of vehicles.

[0075] In some embodiments of the present application, various sensor technologies are employed to accurately monitor the occupancy status of both the driver's seat and the passenger's seat, including cameras, pressure sensors, infrared sensors, or weight detection devices.

[0076] Cameras are used to monitor the interior space of the vehicle, particularly the seating area, to determine whether a person is occupying the seat. Through image recognition technology, cameras can capture whether there is a human silhouette on the seat and make a judgment based on this whether the seat is occupied. The advantage of this method is that it can provide intuitive visual information and has strong adaptability to complex situations such as placing objects instead of human bodies. In addition, combined with artificial intelligence algorithms, cameras can further analyze the behavior patterns of passengers, improving the accuracy of identifying getting on and off events.

[0077] Pressure sensors are installed under the seat to detect changes in pressure on the seat surface. When someone sits on the seat, the sensor will sense the continuous pressure caused by the body weight, thereby determining whether the seat is occupied. Compared with other methods, pressure sensors can directly reflect the existence of physical contact, so their results are very reliable. However, it should be noted that pressure sensors may not be able to distinguish between pressure changes caused by people or objects, which limits their application in certain special situations.

[0078] Infrared sensors use the heat emitted by the human body to detect whether the seat is occupied. They are usually installed around the seat or directly embedded in the seat, and by detecting changes in heat distribution, they can determine whether a person is sitting on the seat. This method is particularly suitable for distinguishing between living and non-living objects, as only the human body will produce heat radiation within a certain range. However, the effectiveness of infrared sensors may be affected by environmental temperature, and their performance may decline in extreme weather conditions.

[0079] Weight detection devices are usually integrated into the entire seat structure or installed as a separate module at the bottom of the seat to measure the total weight on the seat. When a person sits on the seat, the device can accurately record the weight increase and determine whether the seat is occupied. One of the significant advantages of weight detection devices is their high precision, which can provide detailed data about the load on the seat. However, similar to pressure sensors, it may be difficult to distinguish between people and other heavy objects, and it needs to be combined with other technologies to improve recognition accuracy.

[0080] In summary, these different sensors each have unique advantages and limitations. By integrating multiple sensing technologies, a more comprehensive and reliable system can be constructed to monitor the occupancy status of both the driver's seat and passenger's seat, ensuring accurate perception and response to the activities within the vehicle. This multi-level monitoring mechanism not only enhances the robustness and intelligence of the system but also lays a solid foundation for achieving higher levels of automation.

[0081] In some embodiments of the present application, in order to accurately monitor the state of the vehicle door (open, closed or locked), multiple sensor technologies and processing methods are used, including cameras, micro switches, proximity sensors, Hall switches and vehicle ECU processing door status sensor signals.

[0082] Cameras are used to directly observe the opening and closing state of the vehicle door. By installing cameras in appropriate positions inside or outside the vehicle, the system can capture real-time images of the door area and use image recognition algorithms to determine whether the door is open or closed. This method has the advantage of providing visual evidence directly, which is suitable for accurate monitoring in complex environments. In addition, cameras can also assist in higher-level functions such as passenger behavior analysis or security monitoring.

[0083] Micro switches are mechanical sensors usually installed on the edges of the vehicle door or the vehicle body frame. When the door is closed, the micro switch is triggered, sending an electrical signal to the vehicle control system. This method is simple and reliable, providing immediate feedback when the door is completely closed, making it a common method for detecting the closed state of the door. However, micro switches can only provide binary information (open / closed) and may not provide detailed status descriptions for partially open situations.

[0084] Proximity sensors are used to detect changes in distance between the vehicle door and the vehicle body to determine the opening and closing state of the door. These sensors usually use infrared or other forms of electromagnetic waves to measure distance. When the door approaches the vehicle body, the sensor detects a decrease in distance, and vice versa, indicating that the door is opening. The advantage of proximity sensors is that they can provide continuous distance data, helping to identify whether the door is completely closed or partially open, enhancing the flexibility and accuracy of the system.

[0085] Hall switches work based on magnetic field changes and are commonly used to detect the opening and closing state of the door. Specifically, a magnet and a Hall sensor are installed on the corresponding positions of the door and the vehicle body. When the door is closed, the magnet approaches the Hall sensor, causing a change in magnetic field strength, and the Hall sensor produces a signal change accordingly, indicating that the door has been closed. Hall switches have high precision and long service life, and can work stably in harsh environments, making them suitable for applications that require long-term stable operation.

[0086] The vehicle-mounted electronic control unit (ECU) is responsible for receiving signals from various sensors, processing and judging comprehensively, and finally determining the state of the vehicle door. ECU not only integrates data from different sensors, but also performs corresponding operations according to preset logic, such as issuing a warning prompt when the vehicle door is not fully closed, or automatically locking the vehicle door in combination with other vehicle states (such as driving speed). This centralized processing approach improves the integration and intelligence level of the system, enabling the vehicle to respond more accurately and timely based on actual conditions. By combining the use of these different technologies and methods, this application proposes an efficient and reliable vehicle door state monitoring solution, which not only improves the safety and user experience of the vehicle, but also provides technical support for realizing higher-level automation functions.

[0087] In some embodiments of the present application, in order to accurately obtain various state information of the vehicle, such as the unlocking state, air conditioning state, gear state, and double flash light state, a vehicle-mounted electronic control unit (ECU) is used for data acquisition and processing.

[0088] The unlocking state of the vehicle is monitored and managed by the vehicle-mounted ECU. When the driver uses the remote key or the in-vehicle start button to unlock the vehicle, the relevant signals will be sent to the vehicle-mounted ECU. The ECU receives and processes these signals to confirm whether the vehicle is currently in an unlocked state, and passes this information to other components in the system. This mechanism not only ensures the safety of the vehicle, but also provides the necessary prerequisites for subsequent operations, such as automatically identifying the driver's behavior of preparing to get in the car.

[0089] The air conditioning state in the vehicle is also monitored by the vehicle-mounted ECU. Whether it is manually adjusted or automatically set, all operation instructions related to the air conditioner will be sent to the ECU, which is responsible for adjusting the operating parameters of the air conditioning system and providing real-time feedback on the current working state. This includes temperature settings, wind speed levels, and whether the cooling / heating mode is on. Understanding the air conditioning state helps determine whether the driver has entered the vehicle, as many drivers are accustomed to starting the air conditioner to adjust the temperature inside the vehicle before getting in, thereby improving the comfort of the ride.

[0090] Gear state refers to the specific gear (such as P, R, N, D, etc.) of the vehicle transmission, and this information is also obtained and processed by the vehicle-mounted ECU. The ECU determines the current gear state based on the driver's operation input (such as the position of the shift lever) and data provided by the vehicle's speed sensor, etc. The gear state is crucial for determining whether the vehicle is ready to pick up or drop off passengers, for example, engaging P or N usually means that the vehicle has stopped and is ready to welcome passengers getting in or out of the vehicle.

[0091] The double flash light status refers to whether the vehicle hazard warning light (i.e., double flash light) is turned on. This status is directly monitored by the on-board ECU, and when the driver activates the double flash light switch, a signal is transmitted to the ECU, which then controls the opening and closing of the double flash light and records the status. The double flash light is often used to alert surrounding vehicles to safety during temporary parking or emergency situations. Therefore, in this application, monitoring the status of the double flash light helps to identify whether the vehicle is in the process of picking up or dropping off passengers, especially when temporarily parked on the roadside, it serves as an auxiliary judgment basis to increase the accuracy of identification.

[0092] In summary, through the monitoring of the vehicle unlocking status, air conditioning status, gear status and double flash light status by the on-board ECU, a comprehensive perception of the vehicle environment can be achieved, which is crucial for accurately determining the behavior of the driver and passengers getting on or off the vehicle. The ECU not only serves as a data collection center, but also plays the role of a decision engine, based on the collected data to perform corresponding logical judgments, thereby improving the intelligent level and response efficiency of the entire system.

[0093] In some embodiments of the present application, when it is determined that the passenger is about to get off the vehicle, a safety reminder is triggered to prompt the passenger to pay attention to the safety of the surrounding environment.

[0094] The core purpose of this mechanism is to enhance the safety awareness of passengers by issuing warnings in advance, avoiding potential dangers such as electric vehicles colliding with open doors, etc. Specifically, when the system monitors the seventh feature (P or N gear) and at least one of the eighth feature (passenger side seat belt is unfastened and passenger side door is opened, navigation reaches the destination) or the ninth feature (rear door is opened, navigation reaches the destination), it is determined that the passenger is about to get off the vehicle, and a safety reminder is started immediately.

[0095] The main role of the safety reminder is to timely convey to the passengers the information that the surrounding environment may have risks, prompting them to be more cautious in observing the surrounding situation before leaving the vehicle. This reminder can be achieved in various ways, such as voice prompts, visual warnings (such as icon flashing on the instrument panel) or vibration alarms (such as seat vibration). In this way, passengers can confirm whether there are pedestrians, cyclists or other vehicles approaching from behind before getting off the vehicle, so as to choose a safer time to open the door and leave the vehicle. In addition, the safety reminder is not limited to the driver's side, but also applies to all passenger seats, ensuring that each passenger can receive the corresponding warning information, further improving the overall safety. Therefore, this safety reminder mechanism based on the identification of getting on and off the vehicle significantly improves the safety of passengers during the process of getting off the vehicle, reduces the probability of accidental accidents, and embodies the great potential of intelligent automobile technology in ensuring the safety of passengers.

[0096] In some embodiments of the present application, when it is determined that the passenger is getting on the vehicle, the billing starts, and when it is determined that the passenger is getting off the vehicle, the billing ends.

[0097] The system will automatically start the billing process after determining that the passenger has completed the boarding action. This mechanism is achieved by monitoring specific features, such as in step S220, when the system detects all features of the sixth feature (occupancy of the passenger seat and closing of the passenger seat door) within the second set interval time, it is determined that the passenger has boarded and immediately triggers the billing start. The significance of this step is to provide an automated and accurate method for determining the start of billing, without the need for manual intervention to accurately record the start time of the ride service. This not only improves operational efficiency and reduces errors that may be caused by manual operation, but also enhances user experience, making the entire ride process smoother and more convenient.

[0098] Correspondingly, when the passenger is preparing to end the journey and get off, the system will determine whether the passenger has completed the getting-off action according to the pre-set logic, and terminate the billing based on this. Specifically, when the system recognizes all features of the tenth feature (closing of the passenger seat door, no occupancy of the passenger seat, and the previous state is that the passenger is about to get on or get off), it is determined that the passenger has gotten off and immediately stops billing. This step ensures the accuracy of the fee calculation, avoiding unnecessary additional charges or missed charges. In addition, through the automated billing end mechanism, the ride fee can be updated in real time, allowing passengers to clearly understand their consumption, enhancing transparency and trust. This also provides strong support for commercial ride services, helping to optimize resource management and service quality, and promoting the development of intelligent travel services.

[0099] In summary, the boarding and alighting identification method provided by the embodiments of the present application has the following technical features and technical effects.

[0100] Firstly, the embodiments of the present application adopt multi-feature identification technology, which monitors a series of specific vehicle state features to judge the boarding and alighting behavior of the driver and the passenger. For example, the first feature (empty occupancy of the driver seat), the second feature (vehicle unlocking, opening of the driver door, and turning on of the air conditioner in the vehicle) and the like jointly constitute an accurate basis for judging the driver's boarding behavior. The technical effect of this technical feature is to significantly improve the accuracy and reliability of the boarding and alighting behavior identification, so that the system can more intelligently respond to the actions of the driver and the passenger, providing a solid foundation for subsequent operations such as automatic billing, safety reminders and the like.

[0101] Secondly, the application introduces a logical judgment mechanism based on a set interval time in the identification process. For example, after determining that the driver or passenger is about to get on, the system will continue to monitor the changes of the relevant features within the first or second set interval time to finally confirm whether the getting-on action is completed. The effect of this technical feature is to enhance the flexibility and adaptability of the system, taking into account the differences in behavior habits of different users, and avoiding misjudgment caused by instantaneous state changes, ensuring the accuracy of the identification results.

[0102] Furthermore, the application emphasizes the scene perception ability of the vehicle itself, and no longer relies on third-party platforms for identification of getting-on and getting-off behaviors. By integrating various sensor technologies such as cameras, pressure sensors, and infrared sensors, the vehicle can autonomously perceive the in-vehicle environment and make corresponding logical judgments. The direct effect of this technical feature is to improve the intelligent level of the vehicle, realizing real-time monitoring and response to in-vehicle personnel activities, which not only improves safety but also provides technical support for higher-level automation functions.

[0103] In addition, when the system determines that the passenger is about to get off, it will trigger a safety reminder function to remind the passenger to pay attention to the safety of the surrounding environment. This reminder can be achieved through voice prompts, visual warnings, or seat vibration. The technical effect of this is to effectively reduce the risk of accidents caused by sudden door opening, enhancing the safety of the passenger during the getting-off process, and demonstrating the practical application value of intelligent automobile technology in ensuring passenger safety.

[0104] Further, the system can start charging when it determines that the passenger is getting on and end charging when the passenger is getting off. This not only simplifies the process of calculating the cost of riding and reduces the possibility of errors caused by manual intervention, but also improves transparency and user experience. The technical effect of the automatic charging mechanism is to optimize the operational efficiency and service quality of commercial ride services, which helps effective management and cost control, and promotes the development of intelligent travel services.

[0105] In summary, the application adopts a variety of advanced technical means to build a complete getting-on and getting-off identification method, which not only improves the convenience and safety of vehicle use, but also provides important technical support for the development of future intelligent transportation systems.

[0106] Secondly, referring to Figure 5 , the application provides a getting-on and getting-off identification system, including a feature monitoring module 510 and a logical judgment module 520.

[0107] The feature monitoring module 510 is used to monitor the first to twelfth features of the vehicle.

[0108] The logic judgment module 520 is configured to execute the aforementioned getting-on and getting-off identification method according to the monitoring result of the feature monitoring module, the first set interval time, the second set interval time and the third set interval time.

[0109] Further, an electronic device is provided in the embodiments of the present application, which includes a processor and a memory. The memory stores a computer program. The processor implements the aforementioned getting-on and getting-off identification method when executing the computer program.

[0110] In addition, a vehicle is provided in the embodiments of the present application, which includes the aforementioned getting-on and getting-off identification system.

[0111] Similarly, the technical effects of the system, the device and the vehicle provided in the embodiments of the present application are the same as those of the aforementioned method embodiments, which will not be repeated here.

[0112] It should be noted that, in each of the specific embodiments of the present application, when it is necessary to perform relevant processing according to user information, user behavior data, user historical data and user location information and other data related to the identity or characteristics of the user, the user's permission or consent will be obtained first, and the collection, use and processing of these data will comply with relevant laws, regulations and standards of the country and region. In addition, when the embodiments of the present application need to obtain sensitive personal information of the user, the separate permission or separate consent of the user will be obtained through a pop-up window or a jump to a confirmation page, and after obtaining the separate permission or separate consent of the user, the necessary user-related data for enabling the embodiments of the present application to operate normally will be obtained.

[0113] In some alternative embodiments, the functions / operations mentioned in the block diagram can not occur in the order mentioned in the operation schematic diagram. For example, depending on the functions / operations involved, two blocks shown in succession can actually be executed substantially simultaneously or the blocks can sometimes be executed in reverse order. In addition, the embodiments presented and described in the flowcharts of the present application are provided by way of example, and the purpose is to provide a more comprehensive understanding of the technology. The disclosed method is not limited to the operations and logical flows presented herein. Alternative embodiments are contemplated in which the order of various operations is changed and in which sub-operations described as part of larger operations are independently executed.

[0114] Furthermore, although the present application is described in the context of functional modules, it is understood that one or more of the functions and / or features can be integrated in a single physical device and / or software module, or one or more functions and / or features can be implemented in separate physical devices or software modules. It is also understood that a detailed discussion of the actual implementation of each module is unnecessary to an understanding of the present application. Rather, the properties, functions and internal relationships of the various functional modules disclosed in the devices shown herein are deemed to be illustrative of the principles of the present application. Accordingly, the present application is not limited to the specific embodiments described herein, but rather only by the claims that follow. It is also understood that the specific concepts disclosed herein are merely illustrative of the principles of the present application and are not intended to limit the scope of the application, which is defined solely by the claims that follow.

[0115] If the functions are implemented in software, the functions can be stored in or implemented as one or more software modules on a computer-readable storage medium. In terms of this understanding, the technical solutions of the present application, in essence, or the parts of the prior art that the present application contributes to, or parts of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes a plurality of programs for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods of the embodiments of the present application. The aforementioned storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a magnetic disk or an optical disk, and various media that can store program codes.

[0116] The logic and / or steps represented in the flowcharts or otherwise described herein, for example, can be considered as a list of executable program instructions for implementing logical functions, and can be specifically embodied in any computer-readable medium for use by a program execution system, device or equipment (such as a computer-based system, a system including a processor, or other system that can take programs from a program execution system, device or equipment and execute the programs) or in conjunction with these program execution systems, devices or equipment. For the purpose of the present specification, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transport programs for use by a program execution system, device or equipment or in conjunction with these program execution systems, devices or equipment.

[0117] More specific examples (a non-exhaustive list) of the computer-readable medium include the following: an electrical connection (electronic) having one or more wires, a portable computer diskette (magnetic), a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium can also be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, for example, via optical scanning of the paper or other medium, then compiled, interpreted, or otherwise processed in a suitable manner, if necessary, and stored in a computer memory.

[0118] It should be understood that aspects of the application can be implemented in hardware, software, firmware or combinations thereof. In the above described embodiments, various steps or methods can be implemented in software or firmware that is stored in memory and executed by a suitable

[0119] In the above description of the present application, reference has been made to descriptive terms such as "one embodiment / scheme", "another embodiment / scheme" or "some embodiments / schemes" etc. which can mean that a particular feature, structure, material or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the application. The illustrative examples described above do not necessarily all refer to the same embodiment or example of the application. Furthermore, the particular features, structures, materials, or characteristics can be combined in any suitable manner in one or more embodiments or examples.

[0120] While the embodiments of the present application have been shown and described, it is to be understood that various modifications, substitutions, combinations, and alterations can be made to the embodiments without departing from the principles and spirit of the present application, the scope of which is defined by the claims and their equivalents.

[0121] The above is a specific description of the preferred embodiments of the present application, but the present application is not limited to the embodiments, and those skilled in the art can make various equivalent modifications or replacements without departing from the spirit of the present application, and these equivalent modifications or replacements are included in the scope defined by the claims of the present application.

Claims

1. A method for identifying getting on and off a vehicle, characterized in that: The following steps are included for driver identification: Monitor a first feature; wherein the first feature is that the main driver's seat is unoccupied; When the first feature is detected, the second feature is detected, and when at least one of the second features is detected, it is determined that the driver is about to get on the vehicle, and the third feature is detected; The second feature includes the vehicle being unlocked, the main driver's door being open, and the air conditioner being turned on; the third feature includes the main driver's seat being occupied and the main driver's door being closed; When all the features of the third feature are monitored within the first set interval time, it is determined that the main driver has boarded the vehicle.

2. The vehicle getting on and off identification method according to claim 1, characterized in that: After determining that the driver has boarded the vehicle, the following passenger boarding identification steps are performed: Monitor the fourth and fifth characteristics; The fourth characteristic includes the vehicle being in P or N gear, parked at the roadside, and the hazard lights on; the fifth characteristic includes the passenger seat being empty and the passenger door being open; the passenger seats include the front passenger seat and the rear seat; When all the fourth characteristics and at least one of the fifth characteristics are detected, it is determined that a passenger is about to board the vehicle, and the sixth characteristic is detected; The sixth feature includes the passenger seat being occupied and the passenger door being closed; When all the features of the sixth feature are monitored within the second set interval time, it is determined that the passenger is boarding the vehicle.

3. The vehicle getting on and off identification method according to claim 2, characterized in that: After determining that the passenger has boarded the bus, the following passenger alighting identification steps are performed: Monitor the seventh, eighth, and ninth characteristics; The seventh feature is the shift into P or N gear, the eighth feature includes the passenger seat belt being unbuckled, the passenger door being open, and the destination being reached by navigation, and the ninth feature includes the rear door being open and the destination being reached by navigation. When the seventh feature is detected and at least one of the eighth features or at least one of the ninth features is detected, it is determined that the passenger is about to get off the bus, and the tenth feature is detected; The tenth characteristic includes the passenger door being closed and the passenger seat being unoccupied, and the state at the previous moment is that a passenger is about to board or get off the vehicle; When all the tenth features are monitored, it is determined that the passenger has gotten off the bus.

4. The vehicle getting on and off identification method according to claim 1, characterized in that: After determining that the driver has boarded the vehicle, the following steps are performed to identify the driver getting off the vehicle: Monitor the eleventh characteristic; The eleventh characteristic includes the following: the driver's seat is occupied, the driver's door is open, the driver's seat belt is unfastened, and the vehicle is in P gear; When all the features of the eleventh feature are detected, it is determined that the driver is about to get off the vehicle, and the twelfth feature is detected; The twelfth feature includes the main driver's door being closed, the main driver's seat being unoccupied, and the door being locked; When all the features of the twelfth feature are monitored within the third set interval time, it is determined that the main driver has gotten off the vehicle.

5. The vehicle getting on and off identification method according to any one of claims 1 to 4, characterized in that: The occupancy status of the main driver's seat and passenger seat is monitored by cameras, pressure sensors, infrared sensors or weight detection devices; the door status is monitored by cameras, micro switches, proximity sensors, Hall switches, or judged by the on-board ECU processing the door status sensor signal; the vehicle unlocking status, in-car air conditioning status, gear status and hazard light status are obtained through the on-board ECU.

6. The vehicle getting on and off identification method according to claim 3, characterized in that: When it is determined that a passenger is about to get off the bus, a safety reminder is triggered; the safety reminder is used to remind the passenger to pay attention to the safety of the surrounding environment.

7. The vehicle getting on and off identification method according to claim 3, characterized in that: The fare starts when the passenger gets on the bus and ends when the passenger gets off the bus.

8. A vehicle boarding and disembarking identification system, characterized in that: include: a feature monitoring module, configured to monitor first to twelfth features of the vehicle; A logic judgment module is used to execute the vehicle getting on and off identification method according to any one of claims 1 to 7 based on the monitoring result of the feature monitoring module, the first set interval time, the second set interval time and the third set interval time.

9. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores a computer program, and when the processor executes the computer program, the vehicle getting on and off identification method according to any one of claims 1 to 7 is implemented.

10. A vehicle, characterized in that: The vehicle includes the boarding and exiting identification system according to claim 8.

Images