Vehicle control methods, devices, equipment, vehicles and storage media

Abstract

This application discloses a vehicle control method, apparatus, device, vehicle, and storage medium. The solution includes: after acquiring a trigger signal indicating that a passenger has temporarily left the target vehicle, the system retains records from the Occupant Monitoring System (OMS) to form a first passenger set (initial passenger list) before the passenger disembarks; when the vehicle is ready to depart again, the system scans the occupants to generate a second passenger set (current passenger list); based on the first and second passenger sets, it determines whether any passengers have not yet returned to the target vehicle; if any passengers have not yet returned, a first notification message is generated to indicate that passengers have not yet returned. This allows for timely detection of passengers not returning, preventing passengers from being forgotten.

Description

Technical Field

[0001] This application relates to the field of automotive technology, specifically to a vehicle control method, device, equipment, vehicle, and storage medium. Background Technology

[0002] Currently, with the rapid development of the transportation industry, especially the popularization of the sharing economy and ride-hailing services, passenger safety has increasingly attracted social attention. One significant safety hazard is the unintentional forgetting of passengers outside the vehicle by the driver, particularly when the driver fails to notice the passenger's failure to return after a brief disembarkation and drives away, leaving the passenger stranded. This situation can not only cause panic and anxiety for passengers but may also pose a threat to their health and even their lives in certain environments (such as high or low temperatures). Existing vehicle safety systems do not fully cover scenarios where passengers are forgotten and lack effective means of detecting passenger presence. Summary of the Invention

[0003] In view of this, this application aims to provide a vehicle control method, device, equipment, vehicle and storage medium that can prevent passengers from being forgotten in place after briefly getting off the vehicle.

[0004] According to a first aspect of this application, a vehicle control method is provided, comprising:

[0005] Acquire a trigger signal indicating that a passenger has temporarily left the target vehicle, and a first set of passengers; the first set of passengers is determined before the passengers leave the target vehicle;

[0006] After the target vehicle starts moving, in response to the trigger signal, the passengers at the target vehicle are identified to obtain a second set of passengers;

[0007] Based on the first passenger set and the second passenger set, determine whether there are still passengers who have not returned to the target vehicle;

[0008] If there are still passengers who have not returned to the target vehicle, a first notification message is generated to indicate that there are still passengers who have not returned to the target vehicle.

[0009] Optionally, determining whether there are still passengers who have not returned to the target vehicle based on the first passenger set and the second passenger set includes:

[0010] After a first preset time has elapsed since the door of the target vehicle was opened, or after the door of the target vehicle has been closed, the passengers of the target vehicle are identified to obtain a third passenger set.

[0011] By calculating the difference between the first passenger set and the third passenger set, the first target passenger in a temporarily departed state is identified.

[0012] Based on whether the second passenger set includes all the first target passengers, it is determined whether there are still passengers who have not returned to the target vehicle.

[0013] Optionally, the method further includes:

[0014] After a second preset time has elapsed since the trigger signal was received, the temporary departure status of the first target passenger is cancelled.

[0015] Alternatively, when the time the first target passenger is in a temporary departure state reaches a second preset time, the temporary departure state of the first target passenger is cancelled.

[0016] Optionally, determining whether there are still passengers who have not returned to the target vehicle based on the first passenger set and the second passenger set includes:

[0017] Based on whether the second passenger set includes all passengers in the first passenger set, it is determined whether there are still passengers who have not returned to the target vehicle.

[0018] Optionally, determining the passengers at the target vehicle includes:

[0019] Based on the passenger monitoring system, passengers in the target vehicle are identified according to the biometric characteristics of the human body inside the target vehicle.

[0020] And / or,

[0021] The passengers at the target vehicle are determined based on the short-range wireless communication signals from the mobile terminal.

[0022] Optionally, the trigger signal may include one input via the human-machine interface of the target vehicle.

[0023] Optionally, the method further includes:

[0024] After the target vehicle starts moving, determine the passenger accessories inside the target vehicle;

[0025] Based on a predetermined affiliation relationship, a second target passenger corresponding to a passenger's accessory is determined; the affiliation relationship is used to represent the mapping relationship between a passenger and a passenger's accessory.

[0026] If the second passenger set does not include the second target passenger, a second prompt message is generated; the second prompt message is used to indicate that there are items left behind by passengers in the target vehicle when it starts moving.

[0027] According to a second aspect of this application, a vehicle control device is provided, comprising:

[0028] An acquisition module is used to acquire a trigger signal indicating that a passenger has temporarily left the target vehicle, and a first set of passengers; the first set of passengers is determined before the passengers leave the target vehicle;

[0029] The determination module is configured to determine the passengers at the target vehicle in response to the trigger signal after the target vehicle starts moving, thereby obtaining a second set of passengers;

[0030] The judgment module is used to determine, based on the first passenger set and the second passenger set, whether there are still passengers who have not returned to the target vehicle;

[0031] The prompting module is used to generate a first prompt message to indicate that there are still passengers who have not returned to the target vehicle if there are still passengers who have not returned to the target vehicle.

[0032] According to a third aspect of this application, an electronic device is provided, comprising: a processor; a memory for storing processor-executable instructions; the processor being configured to perform the method described in any of the above embodiments.

[0033] According to a fourth aspect of this application, a vehicle is provided, including the aforementioned electronic equipment.

[0034] According to a fifth aspect of this application, a computer-readable storage medium is provided, the storage medium storing a computer program for performing the methods described in any of the above embodiments.

[0035] This application provides a vehicle control method, apparatus, device, vehicle, and storage medium. The solution includes: after acquiring a trigger signal indicating that a passenger has temporarily left the target vehicle, the system retains records from the Occupant Monitoring System (OMS) to form a first passenger set (initial passenger list) before the passenger disembarks; when the vehicle is ready to depart again, the system scans the occupants to generate a second passenger set (current passenger list); based on the first and second passenger sets, it determines whether any passengers have not yet returned to the target vehicle; if any passengers have not yet returned, a first notification message is generated to indicate that passengers have not yet returned. This allows for timely detection of passengers not returning, preventing passengers from being forgotten. Attached Figure Description

[0036] Figure 1 The diagram shown is a schematic representation of an implementation environment provided in an embodiment of this application.

[0037] Figure 2The diagram shown is a flowchart of a vehicle control method provided in one embodiment of this application.

[0038] Figure 3 The diagram shown is a flowchart of another vehicle control method provided in one embodiment of this application.

[0039] Figure 4 The diagram shown is a block diagram of a vehicle control device provided in one embodiment of this application.

[0040] Figure 5 The diagram shown is a structural block diagram of an electronic device provided in one embodiment of this application. Detailed Implementation

[0041] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0042] Application Overview

[0043] During long journeys, passengers often take advantage of short stops at highway service areas, gas stations, convenience stores, or scenic viewpoints to get out and move around – whether it's rushing to the restroom, buying snacks and drinks at the convenience store, or stretching their stiff limbs. Especially when stopping at scenic spots, tourists are more likely to linger to photograph stunning sunsets or admire unique architecture.

[0044] However, when the vehicle is ready to depart again, the driver may become distracted by answering phone calls, setting navigation routes, or handling other tasks, easily neglecting to check the number of passengers inside the vehicle, potentially leaving passengers stranded. This negligence not only causes travel delays, but more seriously, if stranded passengers attempt to run after the vehicle has started moving, a collision is highly likely. Furthermore, this is especially dangerous in severe weather conditions such as scorching sun or torrential rain, where stranded passengers may face direct threats to their lives, including heatstroke and hypothermia.

[0045] To address the aforementioned issues, this embodiment of the application, after acquiring a trigger signal indicating that a passenger has temporarily left the target vehicle, retains the passenger monitoring system (OMS) records to form a first passenger set (initial passenger list) before the passenger disembarks. When the vehicle is ready to depart again, the system scans the occupants to generate a second passenger set (current passenger list). Based on the first and second passenger sets, it determines whether any passengers have not yet returned to the target vehicle. If any passengers have not yet returned, a first notification message is generated to indicate that passengers have not yet returned. This allows for timely detection of passengers not returning, preventing passengers from being forgotten.

[0046] After introducing the basic principles of this application, various non-limiting embodiments of this application will be described in detail below with reference to the accompanying drawings.

[0047] Exemplary System

[0048] Figure 1 The diagram shown is a schematic representation of an implementation environment provided in an embodiment of this application. Figure 1 This is also a system block diagram for the target vehicle.

[0049] from Figure 1 As can be seen, the OMS (Occupant Monitoring System) mainly includes a camera module and a millimeter-wave radar module, which can monitor the status of passengers inside the vehicle in real time. The camera module acquires image information from inside the vehicle through cameras, and the image is processed by the ISP (Image Signal Processor) for white balance, HDR (High Dynamic Range), and other functions to improve the quality of video signal transmission. The processed image signal is compressed and encrypted by a serializer before being sent to the deserializer of the main controller. The millimeter-wave radar module perceives all areas of the entire cabin, featuring depth perception and strong penetration, and can perform high-precision classification and biometric monitoring of detected targets, serving as a supplement to visual detection. The millimeter-wave radar module also sends the processed signal to the MCU (Microcontroller Unit) of the main controller. The main controller constantly collects the level signals from the door sensors and the temporary opening / closing. It then uses the algorithm module to analyze and process the video signal and millimeter-wave radar signal after they have been decompressed by the deserializer, extracting key features of passengers (such as their faces, handbags, backpacks, and other personal belongings) and classifying and labeling the occupants and their belongings inside the vehicle.

[0050] When passengers briefly disembark, the temporary departure mode is triggered by the physical button on each seat. The main controller records the occupant information at this time. When the vehicle starts moving, the system again monitors the status of passengers inside the vehicle using cameras and millimeter-wave radar, matching the occupant information at the time the button was triggered. If it detects that some passengers have not yet returned to the vehicle, the system renders an HMI image using the GPU and outputs graphic and text information through the display module, while simultaneously controlling the speaker module to broadcast a voice announcement reminding the driver that some passengers have not yet boarded.

[0051] Exemplary methods

[0052] Figure 2 The diagram shown is a flowchart of a vehicle control method provided in one embodiment of this application. Figure 2 The method described is executed by a computing device located at the target vehicle, or a computing device connected to the target vehicle's data, but the embodiments of this application are not limited thereto. Figure 2 As shown, the method includes the following:

[0053] Step S210: Obtain a trigger signal indicating that passengers have temporarily left the target vehicle, and a first set of passengers; the first set of passengers is determined before the passengers leave the target vehicle.

[0054] In this embodiment of the application, the trigger signal can be input by the driver or passenger through an HMI (human-machine interface); for example, when a passenger temporarily leaves the vehicle, or when the driver notices that someone has temporarily left the vehicle, the signal can be manually triggered through the vehicle's central control screen or a dedicated button.

[0055] In this embodiment of the application, if the target vehicle is in a preset location set, the system can automatically generate a trigger signal; the preset location set may include gas stations, service areas, and other locations where passengers temporarily drop off their vehicles; for example, when a vehicle enters the parking area of ​​a service area, the system determines that the vehicle has entered the service area based on satellite positioning signals, automatically identifies and generates a trigger signal, indicating that a passenger may be temporarily leaving.

[0056] In this embodiment, if the target vehicle is a passenger vehicle (such as a taxi, ride-hailing vehicle, or bus), and the current parking location is inconsistent with the destination in the passenger order, and the passenger's location is detected by the vehicle-mounted sensor or positioning system to be inconsistent with the current parking location, it can be determined that the passenger has temporarily left. A trigger signal is generated by the vehicle-mounted terminal, the customer terminal (such as the ride-hailing software on the passenger's mobile phone), the driver's terminal, or the passenger service terminal. For example, when the ride-hailing vehicle arrives at the temporary stop requested by the passenger (not the final destination), the passenger gets off to run errands, and the vehicle positioning system detects that the passenger's mobile phone location is separated from the vehicle location, the relevant terminal automatically sends a trigger signal.

[0057] In this embodiment of the application, the first passenger set may include all the occupants before the passenger (or driver) gets off the vehicle, that is, all the people inside the vehicle before the passenger or driver temporarily leaves the vehicle.

[0058] In this embodiment of the application, the first passenger set can be collected by an occupant monitoring system (OMS), for example, by using sensors such as cameras and millimeter-wave radar inside the vehicle to monitor and record the biometrics of the people in the vehicle in real time, thereby forming the first passenger set.

[0059] Step S220: After the target vehicle starts moving, in response to the trigger signal, determine the passengers at the target vehicle to obtain a second passenger set.

[0060] In this application embodiment, the determination conditions for the target vehicle to start moving include, but are not limited to, the vehicle being engaged in a forward or reverse gear, or the vehicle speed changing from zero to a state greater than zero. These situations all indicate that the vehicle is about to move or has already started moving. However, this application embodiment is not limited to these conditions. For example, for electric vehicles, the motor speed may be used to determine whether the vehicle has started moving. For gasoline vehicles with manual transmissions, the clutch pedal is depressed.

[0061] In this embodiment of the application, the second passenger set includes all persons inside the vehicle when the target vehicle begins to move. Similarly, the second passenger set can be collected by an occupant monitoring system (OMS).

[0062] Step S230: Based on the first passenger set and the second passenger set, determine whether there are still passengers who have not returned to the target vehicle;

[0063] In this embodiment of the application, the process of determining whether there are still passengers who have not returned to the target vehicle may include:

[0064] By directly comparing the first passenger set and the second passenger set, and determining whether there are still passengers who have not returned to the target vehicle based on whether the second passenger set includes all passengers in the first passenger set.

[0065] Alternatively, identify the first target passenger who is temporarily away from the first passenger set; then determine whether there are still passengers who have not returned to the target vehicle based on whether the second passenger set includes all the first target passengers.

[0066] Step S240: If there are still passengers who have not returned to the target vehicle, generate a first prompt message to indicate that there are still passengers who have not returned to the target vehicle.

[0067] In this embodiment of the application, the first prompt information is used to remind the driver and passengers that there are still passengers who have not returned to the target vehicle.

[0068] In this embodiment, the first prompt message can be issued by a human-machine interface, including but not limited to the form of an instrument panel, central control screen, head-up display (HUD), prompt sound, lights, etc., and there is no limitation on the specific form. For example, the instrument panel can flash specific warning lights to provide a prompt, the central control screen can pop up a prompt box to display information about passengers who have not returned, the head-up display can display relevant warning content in the driver's field of vision, the prompt sound can be emitted through the vehicle's audio system, and the lights can remind the driver and passengers through changes in the ambient lighting inside the vehicle.

[0069] In this embodiment, a trigger signal indicating that a passenger has temporarily left the target vehicle is acquired, along with a first set of passengers determined before the passenger leaves the target vehicle. After the target vehicle starts moving, in response to the trigger signal, the passengers at the target vehicle are identified, resulting in a second set of passengers. Based on the first and second passenger sets, it is determined whether any passengers have not yet returned to the target vehicle. If any passengers have not yet returned, a first notification message is generated to indicate that passengers have not yet returned. This significantly reduces the occurrence of drivers leaving passengers behind due to driver distraction or carelessness, thus improving the user experience.

[0070] Furthermore, the inventors' initial technical solution involved setting the comparison between the first and second passenger sets to be performed immediately after each door opening and closing. However, in practical applications, this real-time comparison mechanism revealed significant flaws: the system generated false alarms whenever passengers opened the doors to exit the vehicle after parking; and in scenarios where multiple passengers disembarked but did not return simultaneously, the system continuously generated erroneous alarms during multiple comparisons before the final door closure.

[0071] In this embodiment, the technical solution is improved as follows: after the target vehicle starts moving, it is determined whether there are still passengers who have not returned to the target vehicle based on the first passenger set and the second passenger set. By delaying the comparison timing, the false alarm rate of the first prompt information is significantly reduced, redundant prompts are avoided from interfering with the user, and ultimately the accuracy of the human-computer interaction system and user experience satisfaction are improved.

[0072] based on Figure 2 In addition to the method described in the embodiments of this specification, some specific implementation schemes of the method are also provided, which will be described below.

[0073] Optionally, determining whether there are still passengers who have not returned to the target vehicle based on the first passenger set and the second passenger set includes:

[0074] After a first preset time has elapsed since the door of the target vehicle was opened, or after the door of the target vehicle has been closed, the passengers of the target vehicle are identified to obtain a third passenger set.

[0075] By calculating the difference between the first passenger set and the third passenger set, the first target passenger in a temporarily departed state is identified.

[0076] Based on whether the second passenger set includes all the first target passengers, it is determined whether there are still passengers who have not returned to the target vehicle.

[0077] In this embodiment of the application, the first preset time is used to ensure that there is enough time for passengers to get on and off the vehicle, and can be set according to the actual situation, such as 30 seconds, 1 minute, or 2 minutes.

[0078] In this embodiment, the third passenger set refers to the set of passengers who remain inside the vehicle after some passengers have temporarily left the target vehicle. The status of the passengers in the third passenger set can be either already on the vehicle or not yet off.

[0079] Similarly, the third passenger set can be obtained by the Occupant Monitoring System (OMS). In practice, the third passenger set can be obtained multiple times by the OMS, and whenever the third passenger set changes, the first target passenger who is temporarily away can be identified again.

[0080] In this embodiment of the application, the first target passenger is a passenger who has temporarily left the target vehicle and is in a state of temporary departure.

[0081] In this embodiment of the application, the step of calculating the difference between the first passenger set and the third passenger set is to remove passengers from the third passenger set from the first passenger set, and the remaining passengers are the first target passengers who are in a temporary departure state.

[0082] In this embodiment, the first target passenger can also be determined by the environmental perception equipment of the target vehicle. For example, a surround-view camera can capture real-time images of the vehicle's surroundings and analyze passenger boarding and alighting behavior using image recognition technology to determine which passengers are temporarily away. Radar on the side of the vehicle can detect moving objects around it; when a passenger temporarily leaves the vehicle and moves around it, the radar can capture their position and movement trajectory, thus assisting in determining whether the passenger is temporarily away. The information provided by these environmental perception devices can be combined with data collected by the occupant monitoring system to more comprehensively and accurately identify the first target passenger, improving the accuracy of determining whether a passenger should return to the vehicle.

[0083] In this embodiment, if the second passenger set does not include all the first target passengers, it is determined that some passengers have not yet returned to the target vehicle. At this time, the status of the first target passengers is updated to either "boarded" or "not disembarked".

[0084] In this embodiment of the application, if the second passenger set includes all the first target passengers, it is determined that all passengers have returned to the target vehicle, and the relevant prompting process can be terminated.

[0085] In this embodiment, after passengers alight and disembark, a third passenger set is obtained by determining the number of passengers currently on the target vehicle. By comparing the first and third passenger sets, a first target passenger temporarily absent is identified. Based on whether the second passenger set includes all the first target passengers, it is determined whether any passengers have not yet returned to the target vehicle. Therefore, accurately identifying the first target passenger temporarily absent helps improve the accuracy of determining whether a passenger will return to the vehicle, avoiding safety hazards and inconvenience caused by misjudgment. In particular, in scenarios with a large number of passengers, this method can effectively reduce the possibility of misjudgment and improve the reliability of the judgment.

[0086] Optionally, the method further includes: canceling the temporary departure state of the first target passenger after a second preset time has elapsed since the trigger signal was received.

[0087] Optionally, the method further includes: canceling the temporary departure state of the first target passenger when the time during which the first target passenger is in a temporary departure state reaches a second preset time.

[0088] In this embodiment, the second preset time is used to determine whether the first target passenger is leaving temporarily or completely leaving the target vehicle. The second preset time can be set according to actual conditions, for example, 4 hours.

[0089] In this embodiment of the application, canceling the temporary departure status of the first target passenger may include: clearing passenger information from the previous trip, or updating the status of the first target passenger to "has disembarked" or "has left the vehicle".

[0090] In this embodiment, if the target vehicle resumes operation after a second preset time, changes in the number of passengers on board are normal. The correlation between the two journeys is weak, and it does not constitute a situation where a passenger is left behind midway. Therefore, the system will cancel the temporary departure status of the first target passenger. By reasonably setting the second preset time, unnecessary prompts and interference can be effectively reduced, minimizing disturbance to the user and thus improving the user experience.

[0091] Optionally, determining whether there are still passengers who have not returned to the target vehicle based on the first passenger set and the second passenger set includes:

[0092] Based on whether the second passenger set includes all passengers in the first passenger set, it is determined whether there are still passengers who have not returned to the target vehicle.

[0093] In this embodiment of the application, if the second passenger set does not include all passengers in the first passenger set, it is determined that there are still passengers who have not returned to the target vehicle, and a first prompt message is subsequently generated to indicate that there are still passengers who have not returned to the target vehicle.

[0094] If the second passenger set includes all passengers in the first passenger set, then it is determined that all passengers should return to the target vehicle, and the relevant prompting process can be terminated.

[0095] Optionally, determining the passengers at the target vehicle includes:

[0096] Based on the passenger monitoring system, passengers in the target vehicle are identified according to the biometric characteristics of the human body inside the target vehicle.

[0097] In this embodiment, the passenger monitoring system is used to monitor the situation of people inside the vehicle in real time. It may include, but is not limited to, devices such as cameras and millimeter-wave radar, as well as infrared sensors and pressure sensors. These devices can sense the presence and status of people inside the vehicle from different angles and in different ways. For example, cameras can capture visual images of people, millimeter-wave radar can detect subtle movements and positional changes of people, infrared sensors can sense the thermal radiation of the human body, and pressure sensors can detect changes in pressure on the seats, thereby comprehensively judging the situation of the people inside the vehicle.

[0098] In this embodiment, the biometrics may include, but are not limited to, facial features captured by a camera, and may also include body posture features captured by millimeter-wave radar. These features are unique and stable, and can be used to accurately identify passenger identities. For example, by matching the facial features of passengers in a first passenger set and a second passenger set, it can be determined which passengers have returned to the vehicle and which have not. By analyzing the body posture features captured by millimeter-wave radar, the identity and status of passengers can be further confirmed, improving the accuracy of the judgment. Thus, the passenger monitoring system can accurately identify, match, and record passenger identity information.

[0099] Optionally, determining the passengers at the target vehicle includes:

[0100] The passengers at the target vehicle are determined based on the short-range wireless communication signals from the mobile terminal.

[0101] In this embodiment of the application, the mobile terminal may be a passenger's smartphone, smartwatch, or other device. These devices typically have short-range wireless communication capabilities and can communicate with the vehicle's wireless signal transmitter.

[0102] In this embodiment, the short-range wireless communication signal can be used to measure the distance between a potential passenger and a vehicle using wireless ranging technology. The short-range wireless communication signal may include signals such as Bluetooth, WiFi, NFC, and UWB.

[0103] In this embodiment, determining passengers at the target vehicle based on the short-range wireless communication signal of the mobile terminal includes: determining the distance between the mobile terminal and the target vehicle based on the short-range wireless communication signal of the mobile terminal; and determining whether the user of the mobile terminal is a passenger of the target vehicle based on whether the distance is less than a threshold and / or, based on the trend of the distance change. For example, if the distance between the mobile terminal and the target vehicle is always less than a preset value (e.g., 1 meter), then the user of the mobile terminal is considered a passenger of the target vehicle. During the movement of the target vehicle, if the distance between the mobile terminal and the target vehicle is always less than the preset value, the user of the mobile terminal is highly likely to be a passenger of the target vehicle. If, when the target vehicle starts moving, the change in distance between the mobile terminal and the target vehicle per unit time is greater than the preset value, then the user of the mobile terminal is considered not a passenger of the target vehicle at this time, that is, the user of the mobile terminal has not boarded the vehicle.

[0104] In this embodiment, the distance between the mobile terminal and the vehicle is measured based on the short-range wireless communication signal of the mobile terminal, using the signal strength method and / or the time-of-flight (TOF) method. Taking Bluetooth as an example, the distance between the mobile terminal and the vehicle is measured by reading the Received Signal Strength Indicator (RSSI) value of the broadcast packets sent by the mobile terminal, even without a data connection. The RSSI value reflects the signal strength; a higher value indicates a stronger signal and a closer distance. The time-of-flight method calculates the distance between the terminal and the vehicle by measuring the time it takes for the signal to travel from the mobile terminal to the vehicle and back, combined with the signal propagation speed.

[0105] In this embodiment, determining the passenger at the target vehicle based on the short-range wireless communication signal of the mobile terminal may further include: acquiring the signal strength of the mobile terminal using wireless signal transceivers installed inside and outside the target vehicle; if the signal strength received by the mobile terminal inside the vehicle is greater than the signal strength outside the vehicle, then it is determined that the user of the mobile terminal is inside the vehicle. Alternatively, if the difference between the signal strength inside and outside the vehicle is greater than a preset threshold, then it is determined that the user of the mobile terminal is inside the vehicle.

[0106] In this embodiment of the application, the passenger at the target vehicle is determined based on the short-range wireless communication signal of the mobile terminal, which can serve as an effective supplement to the passenger monitoring system and help improve the accuracy and reliability of the passenger monitoring system.

[0107] In practical applications, scenarios such as briefly retrieving items or using the restroom are not frequent occurrences for passengers to temporarily disembark. If the system compares the number of passengers before and after each door opening and closing, it will frequently generate false initial alerts because it cannot distinguish between "temporary departure" and "permanent departure," significantly reducing the accuracy of the alerts. This redundant alert not only increases the user's workload but also interferes with normal driving decisions, lowering the level of intelligence in the human-vehicle interaction experience.

[0108] Optionally, the trigger signal may include one input via the human-machine interface of the target vehicle.

[0109] In this embodiment, the Human-Machine Interface (HMI) refers to the hardware and software interface used to enable information interaction between occupants and the target vehicle. Examples include physical buttons, virtual buttons on a touchscreen, voice interaction systems, and gesture recognition systems. Specifically, the physical buttons can be located at the vehicle's seats, doors, center console, steering wheel, etc. Occupants input trigger signals by pressing these buttons. If physical buttons are provided at each seat, their activation marks the occupant at that seat as the first target passenger temporarily absent from the vehicle.

[0110] The touchscreen can be operated via a graphical interface on the touch display screen, and may include a central control screen or a rear entertainment screen; the voice interaction system allows drivers and passengers to interact with the vehicle through voice commands, such as saying "passengers temporarily get off" to trigger a signal; the gesture recognition system can input commands by recognizing the gestures of drivers and passengers, such as triggering a signal for passengers to get off the vehicle through specific gestures.

[0111] In this embodiment, after the door of the target vehicle is opened, a prompt message can be generated to prompt the driver and passengers to input the trigger signal. Specifically, the user can be guided to input the trigger signal through a human-computer interaction interface such as voice broadcast or dynamic animation, clearly indicating the intention to temporarily leave the vehicle. In this embodiment, in the scenario of a passenger temporarily alighting, the driver and passengers can input the trigger signal through the human-computer interaction interface; during the start-up process after receiving the trigger signal, if any passenger has not yet returned to the target vehicle, a first prompt message is generated to indicate that a passenger has not yet returned. This solution facilitates the input of the trigger signal when temporarily alighting, significantly reduces the false alarm rate of the first prompt message, effectively reduces unnecessary disturbance to the user, and improves the intelligent experience of human-vehicle interaction. In this embodiment, the trigger signal can also be input by the driver and passengers through vehicle control software, navigation software, or ride-hailing software on a mobile terminal. If a short-range wireless communication connection such as Bluetooth or WIFI is established between the mobile terminal and the target vehicle, the mobile terminal can send the signal to the target vehicle. If no short-range wireless communication connection is established, the signal can be forwarded to the target vehicle through vehicle networking technology.

[0112] In this embodiment, the trigger signal can also be automatically triggered through specific passenger identification. Specifically, the system monitors the group of passengers before and after the doors open and close in real time using a biometric identification module (such as facial recognition) or preset identity tags (such as child / elderly passenger tags). If a preset "highly dependent passenger" (such as a child or elderly person without independent mobility) is detected leaving the vehicle alone, a trigger signal is automatically generated and marked as a "designated user departure event". For example, when the in-vehicle identification system determines that a guardian has not left the vehicle simultaneously and a child passenger gets off alone, a temporary departure mode will be triggered and the prompt monitoring logic will be activated. While retaining the user-initiated trigger mechanism, the system achieves accurate identification of key targets through identity correlation analysis, further reducing the frequency of unnecessary prompts. For the brief departure behavior of young and middle-aged passengers, the system defaults to a low-risk scenario that can be judged autonomously, avoiding excessive intervention.

[0113] In this embodiment of the application, the trigger signal may also be automatically generated based on the current location of the target vehicle.

[0114] Optionally, before acquiring the trigger signal indicating that a passenger has temporarily left the target vehicle, the method further includes: acquiring the current parking position of the target vehicle when the target vehicle is stopped; and generating the trigger signal if the current parking position is a temporary parking position.

[0115] Furthermore, based on whether the current parking location belongs to the target type, it is determined whether the current parking location is a temporary parking location. Specifically, the target location type may include: highway service areas, gas stations, convenience stores or viewing platforms, roads with long-term severe traffic jams (highways), etc., without specific restrictions.

[0116] The temporary parking location can be a pre-set specific geographical location. Specifically, after the target vehicle stops moving, the vehicle's positioning system (such as GPS) will obtain the current parking location and compare it with a pre-set database of temporary parking locations. If the current parking location matches a temporary parking location in the database, the system will automatically generate a trigger signal indicating that a passenger may have temporarily left the vehicle, so that it can promptly detect whether any passengers have not yet returned when the vehicle starts moving.

[0117] This method of generating trigger signals based on parking location can effectively reduce the operational burden on drivers and passengers, and improve the system's intelligence level and user experience.

[0118] Optionally, before acquiring the trigger signal indicating that a passenger has temporarily left the target vehicle, the method further includes: acquiring the current parking position of the target vehicle while it is stationary; and generating the trigger signal based on the current parking position and the destination position. For example, if the target vehicle is a passenger vehicle, and the current parking position does not match the destination position in the passenger order, and the passenger has the possibility of leaving the target vehicle, then the trigger signal is generated. Whether the passenger has the possibility of leaving the target vehicle can be determined through the location of the passenger's mobile terminal, door opening signals, seat sensor data, etc. This trigger signal generation method based on parking position and destination position can effectively improve the system's intelligence level and user experience, reduce the driver's workload, and ensure that a trigger signal can be generated in a timely manner when a passenger temporarily leaves the vehicle, so as to facilitate subsequent passenger monitoring and notification.

[0119] Optionally, the method further includes:

[0120] After the target vehicle starts moving, determine the passenger accessories inside the target vehicle;

[0121] Based on a predetermined affiliation relationship, a second target passenger corresponding to a passenger's accessory is determined; the affiliation relationship is used to represent the mapping relationship between a passenger and a passenger's accessory.

[0122] If the second passenger set does not include the second target passenger, a second prompt message is generated; the second prompt message is used to indicate that there are items left behind by passengers in the target vehicle when it starts moving.

[0123] In this embodiment of the application, the passenger accessory refers to an item associated with the passenger, such as a bag, mobile phone, luggage, etc. The passenger accessory can be determined by the passenger monitoring system, for example by capturing images with a camera, or by detecting the shape and position of the item with millimeter-wave radar.

[0124] In this embodiment of the application, the affiliation relationship refers to the mapping relationship between passengers and passenger-related items, which can be determined by the passenger monitoring system.

[0125] In this embodiment of the application, the second target passenger is the passenger to whom the passenger accessory belongs when the target vehicle starts, that is, the passenger who has an accessory relationship with the accessory.

[0126] In this embodiment of the application, the second passenger set is the set of passengers inside the target vehicle when it starts moving.

[0127] In this embodiment of the application, the second prompt information is used to indicate that there are items left behind by passengers in the vehicle when the target vehicle starts. For example, the prompt can be issued through the dashboard, central control screen, HUD, prompt sound, lights, etc., to remind the driver and passengers to pay attention to items left behind by passengers in the vehicle.

[0128] In this embodiment, after the target vehicle starts moving, a second target passenger corresponding to the passenger's belongings inside the vehicle is identified. If the second set of passengers does not include the second target passenger, a second notification message is generated to indicate that there are items left behind by a passenger inside the vehicle when the target vehicle starts moving. This design can effectively avoid the risk of passengers leaving items inside the vehicle and improve the passenger's travel experience.

[0129] Based on the same technical concept, this disclosure also provides another vehicle control method.

[0130] Figure 3 The diagram shown is a flowchart illustrating another vehicle control method provided in an embodiment of this application. As shown, the method mainly consists of three stages: passenger disembarkation, vehicle movement, and system response.

[0131] During passenger disembarkation, passengers can press the temporary exit switch located on the seat armrest as needed before exiting. If the switch is pressed, the occupant monitoring system will lock onto the passenger's facial features and mark the passenger as temporarily absent. If the switch is not pressed, the system will check for any items left behind in the vehicle. If items are found, the system will alert the driver and passengers. If no items are found, the system will mark the passenger as having disembarked and stop monitoring.

[0132] During vehicle movement, when the driver engages Drive and accelerates, the occupant monitoring system re-examines the key characteristics of the occupants to confirm whether passengers marked as temporarily absent are still in the vehicle. The system also checks for any items left behind and confirms whether the passenger to whom the items belong is still in the vehicle.

[0133] During the system response phase, if a passenger marked as temporarily absent is detected inside the vehicle, the system updates the status of all passengers to "not yet departed" and continues monitoring. If no passenger marked as temporarily absent is detected, a first notification message is generated to indicate that some passengers have not yet returned to the target vehicle. If the passenger to whom the lost item belongs is not inside the vehicle, a second notification message is generated to indicate that there were items left behind by a passenger inside the target vehicle when it started moving.

[0134] Through this series of processes, this technical solution can effectively prevent passengers from being forgotten in the same place after a short disembarkation, thereby improving driving safety and passenger experience.

[0135] Exemplary device

[0136] The apparatus embodiments of this application can be used to execute the method embodiments of this application. For details not disclosed in the apparatus embodiments of this application, please refer to the method embodiments of this application.

[0137] Figure 4 The diagram shown is a block diagram of a vehicle control device according to an embodiment of this application. Figure 4 As shown, the device 400 includes:

[0138] The acquisition module 410 is used to acquire a trigger signal indicating that a passenger has temporarily left the target vehicle, and a first passenger set; the first passenger set is determined before the passenger leaves the target vehicle;

[0139] The determination module 420 is configured to determine the passengers at the target vehicle in response to the trigger signal after the target vehicle starts moving, thereby obtaining a second set of passengers;

[0140] The judgment module 430 is used to determine, based on the first passenger set and the second passenger set, whether there are still passengers who have not returned to the target vehicle;

[0141] The prompt module 440 is used to generate a first prompt message to indicate that there are still passengers who have not returned to the target vehicle if there are still passengers who have not returned to the target vehicle.

[0142] Optionally, the determination module 430 is used for:

[0143] After a first preset time has elapsed since the door of the target vehicle was opened, or after the door of the target vehicle has been closed, the passengers of the target vehicle are identified to obtain a third passenger set.

[0144] By calculating the difference between the first passenger set and the third passenger set, the first target passenger in a temporarily departed state is identified.

[0145] Based on whether the second passenger set includes all the first target passengers, it is determined whether there are still passengers who have not returned to the target vehicle.

[0146] Optionally, the device 400 further includes:

[0147] The cancellation module is used to cancel the temporary departure state of the first target passenger after a second preset time has elapsed since the trigger signal was received;

[0148] Optionally, the device 400 further includes:

[0149] The cancellation module is used to cancel the temporary departure state of the first target passenger when the time the first target passenger is in the temporary departure state reaches a second preset time.

[0150] Optionally, the determination module 430 is used for:

[0151] Based on whether the second passenger set includes all passengers in the first passenger set, it is determined whether there are still passengers who have not returned to the target vehicle.

[0152] Optionally, the determining module 420 is used for:

[0153] Based on the passenger monitoring system, passengers in the target vehicle are identified according to the biometric characteristics of the human body inside the target vehicle.

[0154] Optionally, the determining module 420 is used for:

[0155] The passengers at the target vehicle are determined based on the short-range wireless communication signals from the mobile terminal.

[0156] Optionally, the trigger signal may include one input via the human-machine interface of the target vehicle.

[0157] Optionally, the device 400 further includes:

[0158] An item recognition module is used to identify passenger-related items inside the target vehicle after the target vehicle starts moving.

[0159] The mapping module is used to determine the second target passenger corresponding to the passenger's accessories based on a pre-determined attachment relationship; the attachment relationship is used to represent the mapping relationship between the passenger and the passenger's accessories.

[0160] The prompting module 440 is further configured to generate a second prompt message if the second passenger set does not include the second target passenger; the second prompt message is used to indicate that there are items left behind by passengers in the vehicle when the target vehicle starts.

[0161] Exemplary electronic devices

[0162] Below, for reference Figure 5 This describes an electronic device according to embodiments of the present application. Figure 5 A block diagram of an electronic device according to an embodiment of this application is illustrated.

[0163] like Figure 5 As shown, the electronic device 500 includes one or more processors 510 and memory 520.

[0164] The processor 510 may be a central processing unit (CPU) or other form of processing unit with data processing and / or instruction execution capabilities, and may control other components in the electronic device 500 to perform desired functions.

[0165] The memory 520 may include one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The volatile memory may include, for example, random access memory (RAM) and / or cache memory. The non-volatile memory may include, for example, read-only memory (ROM), hard disk, flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage medium, and the processor 510 may execute the program instructions to implement the vehicle control methods of the various embodiments of this application described above and / or other desired functions. Various contents, such as category correspondences, may also be stored in the computer-readable storage medium.

[0166] In one example, the electronic device 500 may also include an input device 530 and an output device 540, which are interconnected via a bus system and / or other forms of connection mechanism (not shown).

[0167] In addition, the input device 530 may also include, for example, a keyboard, a mouse, etc. The output device 540 can output various information to the outside. The output device 540 may include, for example, a monitor, a speaker, a printer, and a communication network and its connected remote output devices, etc.

[0168] Of course, for the sake of simplicity, Figure 5 Only some of the components of the electronic device 500 relevant to this application are shown in this illustration; components such as buses, input / output interfaces, etc., are omitted. In addition, the electronic device 500 may include any other suitable components depending on the specific application.

[0169] Exemplary vehicle

[0170] In addition to the methods and devices described above, embodiments of this application may also include a vehicle, comprising a vehicle body and the electronic equipment.

[0171] Exemplary computer program products and computer-readable storage media

[0172] In addition to the methods and devices described above, embodiments of this application may also be computer program products, which include computer program instructions that, when executed by a processor, cause the processor to perform the steps in the vehicle control methods according to various embodiments of this application as described in the "Exemplary Methods" section of this specification.

[0173] The computer program product can be written in any combination of one or more programming languages ​​to perform the operations of the embodiments of this application. The programming languages ​​include object-oriented programming languages ​​such as Java and C++, as well as conventional procedural programming languages ​​such as C or similar languages. The program code can be executed entirely on the passenger computing device, partially on the passenger device, as a standalone software package, partially on the passenger computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0174] Furthermore, embodiments of this application may also be computer-readable storage media storing computer program instructions thereon, which, when executed by a processor, cause the processor to perform the steps in the vehicle control methods according to various embodiments of this application described in the "Exemplary Methods" section above.

[0175] The computer-readable storage medium may be any combination of one or more readable media. A readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of readable storage media (a non-exhaustive list) include: an electrical connection having one or more wires, a portable disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof.

[0176] The basic principles of this application have been described above with reference to specific embodiments. However, it should be noted that the advantages, benefits, and effects mentioned in this application are merely examples and not limitations, and should not be considered as essential features of each embodiment of this application. Furthermore, the specific details disclosed above are for illustrative and facilitative purposes only, and are not limitations. These details do not limit the application to the necessity of employing the aforementioned specific details for implementation.

[0177] The block diagrams of devices, apparatuses, devices, and systems involved in this application are merely illustrative examples and are not intended to require or imply that they must be connected, arranged, or configured in the manner shown in the block diagrams. As those skilled in the art will recognize, these devices, apparatuses, devices, and systems can be connected, arranged, and configured in any manner. Words such as “comprising,” “including,” “having,” etc., are open-ended terms meaning “including but not limited to,” and are used interchangeably with them. The terms “or” and “and” as used herein refer to the terms “and / or,” and are used interchangeably with them unless the context clearly indicates otherwise. The term “such as” as used herein refers to the phrase “such as but not limited to,” and is used interchangeably with it.

[0178] It should also be noted that in the apparatus, equipment, and methods of this application, the components or steps can be disassembled and / or recombined. These disassemblies and / or recombinations should be considered as equivalent solutions of this application.

[0179] The above description of the disclosed aspects is provided to enable any person skilled in the art to make or use this application. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein can be applied to other aspects without departing from the scope of this application. Therefore, this application is not intended to be limited to the aspects shown herein, but rather to be accorded the widest scope consistent with the principles and novel features disclosed herein.

[0180] It should be understood that the qualifiers “first,” “second,” “third,” “fourth,” “fifth,” and “sixth” used in the description of the embodiments of this application are only used to more clearly illustrate the technical solutions and are not intended to limit the scope of protection of this application.

[0181] The above description has been given for purposes of illustration and description. Furthermore, this description is not intended to limit the embodiments of this application to the forms disclosed herein. Although numerous exemplary aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, alterations, additions, and sub-combinations thereof.

Claims

1. A vehicle control method, characterized in that, include: Acquire the trigger signal indicating that passengers have temporarily left the target vehicle, and the first set of passengers; The first passenger group is determined before the passengers leave the target vehicle; After the target vehicle starts moving, in response to the trigger signal, the passengers at the target vehicle are identified to obtain a second set of passengers; Based on the first passenger set and the second passenger set, determine whether there are still passengers who have not returned to the target vehicle; If there are still passengers who have not returned to the target vehicle, a first prompt message is generated to indicate that there are still passengers who have not returned to the target vehicle; After the target vehicle starts moving, determine the passenger accessories inside the target vehicle; Based on a predetermined affiliation relationship, a second target passenger corresponding to a passenger's accessory is determined; the affiliation relationship is used to represent the mapping relationship between a passenger and a passenger's accessory. If the second passenger set does not include all the second target passengers, then a second prompt message is generated; The second prompt message is used to indicate that there are items left behind by passengers in the target vehicle when it starts moving.

2. The method according to claim 1, characterized in that, The step of determining whether there are still passengers who have not returned to the target vehicle based on the first passenger set and the second passenger set includes: After a first preset time has elapsed since the door of the target vehicle was opened, or after the door of the target vehicle has been closed, the passengers of the target vehicle are identified to obtain a third passenger set. By calculating the difference between the first passenger set and the third passenger set, the first target passenger in a temporarily departed state is identified. Based on whether the second passenger set includes all the first target passengers, it is determined whether there are still passengers who have not returned to the target vehicle.

3. The method according to claim 2, characterized in that, The method further includes: After a second preset time has elapsed since the trigger signal was received, the temporary departure status of the first target passenger is cancelled. Alternatively, when the time the first target passenger is in a temporary departure state reaches a second preset time, the temporary departure state of the first target passenger is cancelled.

4. The method according to claim 1, characterized in that, The step of determining whether there are still passengers who have not returned to the target vehicle based on the first passenger set and the second passenger set includes: Based on whether the second passenger set includes all passengers in the first passenger set, it is determined whether there are still passengers who have not returned to the target vehicle.

5. The method according to claim 1, characterized in that, The process of identifying passengers at the target vehicle includes: Based on the passenger monitoring system, passengers in the target vehicle are identified according to the biometric characteristics of the human body inside the target vehicle. And / or, The passengers at the target vehicle are determined based on the short-range wireless communication signals from the mobile terminal.

6. The method according to claim 1, characterized in that, The trigger signal includes input through the human-machine interface of the target vehicle.

7. A vehicle control device, characterized in that, include: The acquisition module is used to acquire a trigger signal indicating that passengers have temporarily left the target vehicle, and a first set of passengers; The first passenger group is determined before the passengers leave the target vehicle; The determination module is configured to determine the passengers at the target vehicle in response to the trigger signal after the target vehicle starts moving, thereby obtaining a second set of passengers; The judgment module is used to determine, based on the first passenger set and the second passenger set, whether there are still passengers who have not returned to the target vehicle; The prompting module is used to generate a first prompt message to indicate that there are still passengers who have not returned to the target vehicle if there are still passengers who have not returned to the target vehicle. An item recognition module is used to identify passenger-related items inside the target vehicle after the target vehicle starts moving. The mapping module is used to determine the second target passenger corresponding to the passenger's accessories based on a pre-determined attachment relationship; the attachment relationship is used to represent the mapping relationship between the passenger and the passenger's accessories. The prompting module is further configured to generate a second prompt message if the second passenger set does not include all the second target passengers; the second prompt message is used to indicate that there are items left behind by passengers in the vehicle when the target vehicle starts.

8. An electronic device, characterized in that, include: processor; Memory used to store the processor's executable instructions; The processor is configured to perform the method according to any one of claims 1 to 6.

9. A vehicle, characterized in that, Including the electronic device as described in claim 8.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer program instructions that, when executed by a processor, cause the processor to perform the method as described in any one of claims 1 to 6.

Images