Vehicle control method, device and equipment, vehicle and storage medium

Abstract

The invention discloses a vehicle control method, device and equipment, a vehicle and a storage medium. According to the scheme, after a trigger signal used for representing temporary leaving of a passenger at a target vehicle is obtained, the system keeps a passenger monitoring system OMS record to form a first passenger set (an initial passenger list) before the passenger gets off the vehicle; when the vehicle is ready to start again, the system scans people in the vehicle again to generate a second passenger set (a current passenger list); according to the first passenger set and the second passenger set, whether there are still passengers not returning to the target vehicle or not is judged; and if the passenger does not return to the target vehicle, generating first prompt information for prompting that the passenger does not return to the target vehicle. Therefore, the situation that the passenger does not return is found in time, and the passenger is prevented from being forgotten in situ.

Description

Technical Field

[0001] The present application relates to the field of automobile technology, and in particular to a vehicle control method, device, equipment, vehicle and storage medium. Background Art

[0002] At present, with the rapid development of the transportation industry, especially the popularity of the sharing economy and online car-hailing services, passenger safety issues are increasingly receiving social attention. Among them, a potential safety hazard that cannot be ignored is that passengers are accidentally forgotten outside the vehicle by the driver, especially after the passenger gets off the vehicle for a short time, the driver fails to notice that the passenger has not returned in time and starts the vehicle to leave, resulting in the embarrassing situation of the passenger being forgotten on the spot. This situation may not only cause panic and anxiety to passengers, but may also pose a threat to the health and even life safety of passengers under certain circumstances (such as high temperature or cold weather). The existing safety system of the vehicle fails to fully cover the passenger forgetfulness scenario and lacks effective means of sensing the presence of passengers. Summary of the invention

[0003] In view of this, the present application is dedicated to providing a vehicle control method, device, equipment, vehicle and storage medium, which can avoid the situation where passengers are forgotten after getting off the vehicle for a short time.

[0004] According to a first aspect of the present application, a vehicle control method is provided, comprising:

[0005] Acquire a trigger signal for indicating that a passenger at a target vehicle temporarily leaves, and a first set of passengers; the first set of passengers is determined before the passenger leaves the target vehicle;

[0006] After the target vehicle starts to move, in response to the trigger signal, determining passengers at the target vehicle to obtain a second passenger set;

[0007] Determining whether there are any passengers who have not returned to the target vehicle according to the first passenger set and the second passenger set;

[0008] If there are still passengers who have not returned to the target vehicle, first prompt information is generated for prompting that there are still passengers who have not returned to the target vehicle.

[0009] Optionally, judging whether there are still passengers who have not returned to the target vehicle according to the first passenger set and the second passenger set includes:

[0010] After a door of the target vehicle is opened for a first preset time or after a door of the target vehicle is closed, determining passengers of the target vehicle to obtain a third passenger set;

[0011] Identifying a first target passenger who is in a temporarily leaving state by calculating a difference set between the first passenger set and the third passenger set;

[0012] According to whether the second passenger set includes all the first target passengers, it is determined whether there are still passengers who have not returned to the target vehicle.

[0013] Optionally, the method further includes:

[0014] After a second preset time has passed since the trigger signal was acquired, canceling the temporary departure status of the first target passenger;

[0015] Alternatively, when the time that the first target passenger is in the temporarily away state reaches a second preset time, the temporarily away state of the first target passenger is cancelled.

[0016] Optionally, judging whether there are still passengers who have not returned to the target vehicle according to the first passenger set and the second passenger set includes:

[0017] It is determined whether there are any passengers who have not returned to the target vehicle according to whether the first passenger set includes all the passengers in the second passenger set.

[0018] Optionally, determining the passengers at the target vehicle includes:

[0019] Based on a passenger monitoring system, determining passengers in the target vehicle according to biological characteristics of people in the target vehicle;

[0020] and / or,

[0021] The passengers at the target vehicle are determined according to the short-range wireless communication signal of the mobile terminal.

[0022] Optionally, the trigger signal includes input through a human-computer interaction interface of the target vehicle.

[0023] Optionally, the method further includes:

[0024] After the target vehicle starts to move, determining the passenger's accessories in the target vehicle;

[0025] Determine the second target passenger corresponding to the passenger's accessory items according to a predetermined accessory relationship; the accessory relationship is used to represent a mapping relationship between the passenger and the passenger's accessory items;

[0026] If the second passenger set does not include the second target passenger, a second prompt message is generated; the second prompt message is used to prompt the target vehicle that there are items left behind by passengers in the vehicle when the vehicle starts.

[0027] According to a second aspect of the present application, a vehicle control device is provided, comprising:

[0028] An acquisition module, used to acquire a trigger signal indicating that a passenger at a target vehicle temporarily leaves, and a first passenger set; the first passenger set is determined before the passenger leaves the target vehicle;

[0029] a determination module, configured to determine passengers at the target vehicle in response to the trigger signal after the target vehicle starts to move, to obtain a second passenger set;

[0030] A judging module, configured to judge whether there are still passengers who have not returned to the target vehicle according to the first passenger set and the second passenger set;

[0031] The prompt module is used to generate a first prompt message for prompting that there are still passengers who have not returned to the target vehicle if there are still passengers who have not returned to the target vehicle.

[0032] According to a third aspect of the present application, an electronic device is provided, comprising: a processor; a memory for storing instructions executable by the processor; and the processor is used to execute the method described in any one of the above embodiments.

[0033] According to a fourth aspect of the present application, a vehicle is provided, comprising the above-mentioned electronic device.

[0034] According to a fifth aspect of the present application, a computer-readable storage medium is provided, wherein the storage medium stores a computer program, and the computer program is used to execute the method described in any one of the above embodiments.

[0035] The present application provides a vehicle control method, device, equipment, vehicle and storage medium, the scheme includes: after obtaining a trigger signal for indicating that a passenger at a target vehicle temporarily leaves, the system will retain the occupant monitoring system OMS record before the passenger gets off the vehicle to form a first passenger set (initial passenger list); when the vehicle is ready to start again, the system will scan the people in the vehicle again to generate a second passenger set (current passenger list); based on the first passenger set and the second passenger set, it is determined whether there are still passengers who have not returned to the target vehicle; if there are still passengers who have not returned to the target vehicle, a first prompt message is generated to prompt that there are still passengers who have not returned to the target vehicle. In this way, the situation where the passenger has not returned can be discovered in time to avoid the passenger being forgotten at the place. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] Figure 1 Shown is a schematic diagram of an implementation environment provided by an embodiment of the present application.

[0037] Figure 2Shown is a flow chart of a vehicle control method provided by an embodiment of the present application.

[0038] Figure 3 Shown is a flow chart of another vehicle control method provided by an embodiment of the present application.

[0039] Figure 4 Shown is a block diagram of a vehicle control device provided by an embodiment of the present application.

[0040] Figure 5 Shown is a structural block diagram of an electronic device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0041] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0042] Application Overview

[0043] During long-distance driving, when passing through highway service areas, gas stations, convenience stores or viewing platforms, passengers often use the short stop time to get off the vehicle and move around - rushing to the restroom to relieve themselves, buying snacks and drinks at a convenience store, or stretching their stiff limbs. Especially when stopping at scenic spots, tourists are more likely to stay for a while to take pictures of the beautiful sunset or admire the characteristic buildings.

[0044] However, when the vehicle is ready to set off again, the driver may be distracted by answering calls, setting navigation routes or handling other matters, and may easily neglect to count the people in the car, which may cause people to be stranded. This negligence will not only cause travel delays, but more seriously, when the vehicle starts to move, if the stranded person tries to run and catch up, it is very likely to collide with the vehicle. In addition, it is particularly dangerous in bad weather such as scorching sun or heavy rain, and stranded passengers may face direct personal threats such as heat stroke and hypothermia.

[0045] In order to solve the above problems, after obtaining the trigger signal indicating that the passenger at the target vehicle has temporarily left, the embodiment of the present application will retain the record of the occupant monitoring system OMS before the passenger gets off the vehicle to form a first passenger set (initial passenger list); when the vehicle is ready to start again, the system will scan the people in the vehicle again to generate a second passenger set (current passenger list); based on the first passenger set and the second passenger set, it is determined whether there are still passengers who have not returned to the target vehicle; if there are still passengers who have not returned to the target vehicle, a first prompt message is generated to prompt that there are still passengers who have not returned to the target vehicle. In this way, the situation where the passengers have not returned can be discovered in time to avoid the passengers being forgotten at the place.

[0046] After introducing the basic principles of the present application, various non-limiting embodiments of the present application will be described in detail with reference to the accompanying drawings.

[0047] Exemplary Systems

[0048] Figure 1 Shown is a schematic diagram of an implementation environment provided by an embodiment of the present application. Figure 1 It is also a system block diagram for the target vehicle.

[0049] from Figure 1 As can be seen in the figure, the OMS (Occupant Monitoring System) system mainly includes a camera module and a millimeter-wave radar module, which can monitor the status of passengers in the car in real time. The camera module obtains the image information in the car through the camera, and performs white balance, HDR (High Dynamic Range) and other processing of the picture through the ISP (Image Signa l Processor) to improve the quality of video signal transmission. The processed image signal is compressed and encrypted by the serializer and sent to the deserializer of the main controller. The millimeter-wave radar module senses all areas of the entire cockpit through the millimeter-wave radar. It has the characteristics of depth perception and strong penetration. It can perform high-precision classification and biometric monitoring of the detection target as a supplement to visual detection. The millimeter-wave radar module also sends the processed signal to the MCU (Microcontroller Unit) of the main controller. The main controller will constantly collect the level signals of the door sensors and temporary switches, and call the algorithm module to analyze and process the video signals and millimeter-wave radar signals decompressed by the deserializer, extract the key features of the passengers (such as faces, handbags, backpacks and other personal belongings), and then classify and label the occupants and their accessories in the car.

[0050] When a passenger gets off the vehicle for a short time, the temporary departure mode is triggered by the physical button for leaving the vehicle for a short time on each seat. The main controller will record the passenger information at this time. When the vehicle starts, the system will monitor the status of the passengers in the vehicle again through the camera and millimeter-wave radar, and match the passenger information when the button is triggered. If it is found that there are still passengers who have not returned to the vehicle, the system will render the HMI image through the GPU, output the graphic information through the display module, and control the speaker module to broadcast the voice to remind the driver that there are still passengers who have not boarded the vehicle.

[0051] Exemplary Methods

[0052] Figure 2 Shown is a flow chart of a vehicle control method provided by an embodiment of the present application. Figure 2 The method described is performed by a computing device at the target vehicle, or a computing device connected to the target vehicle data, but the embodiment of the present application is not limited thereto. Figure 2 As shown, the method includes the following contents:

[0053] Step S210: Acquire a trigger signal for indicating that a passenger temporarily leaves the target vehicle, and a first set of passengers; the first set of passengers is determined before the passenger leaves the target vehicle.

[0054] In an embodiment of the present application, the trigger signal can be input by the driver or passenger through an HMI (human-machine interface); for example, when a passenger temporarily leaves the vehicle, or when the driver finds that someone has temporarily left the vehicle, the signal can be manually triggered through the vehicle's central control screen or a dedicated button.

[0055] In an embodiment of the present application, if the target vehicle is in a preset position set, the system can automatically generate a trigger signal; the preset position set can include gas stations, service areas and other passenger temporary alighting locations; for example, when the vehicle enters the parking area of ​​the service area, the vehicle is determined to have entered the service area based on the satellite positioning signal, and the system automatically identifies and generates a trigger signal to indicate that a passenger may have temporarily left.

[0056] In an embodiment of the present application, if the target vehicle is a passenger vehicle (such as a taxi, online-hailing car, bus, etc.), the current parking position is inconsistent with the destination in the passenger order, and when the vehicle-mounted sensor or positioning system detects that the passenger position is inconsistent with the current parking position, it can be determined that the passenger has temporarily left, and a trigger signal is generated by the vehicle-mounted terminal, the client terminal (such as the taxi-hailing software on the passenger’s mobile phone), the driver terminal or the passenger service terminal; for example, the online-hailing car arrives at the temporary stop requested by the passenger (not the final destination), the passenger gets off the car to do business, and the vehicle positioning system detects that the passenger’s mobile phone location is separated from the vehicle location, and the relevant terminal automatically sends a trigger signal.

[0057] In an embodiment of the present application, the first passenger set may include all passengers before the passenger (or driver) gets off the vehicle, that is, all persons inside the vehicle before the passenger or driver temporarily leaves the vehicle.

[0058] In an embodiment of the present application, the first passenger set can be collected by an occupant monitoring system (OMS), for example, by using sensors such as cameras and millimeter-wave radars inside the vehicle to monitor and record the biometric characteristics of people in the vehicle in real time, thereby forming the first passenger set.

[0059] Step S220: After the target vehicle starts to move, in response to the trigger signal, the passengers at the target vehicle are determined to obtain a second passenger set.

[0060] In the embodiment of the present application, the determination conditions for the target vehicle to start starting include but are not limited to the vehicle being engaged in a forward gear or a reverse gear, or the vehicle speed changing from zero to a state greater than zero, all of which indicate that the vehicle is about to move or has started to move; however, the embodiment of the present application is not limited thereto. For example, for an electric vehicle, it may be determined by the motor speed whether the vehicle has started starting; for a gasoline vehicle with a manual transmission, the clutch pedal is pressed.

[0061] In the embodiment of the present application, the second passenger set includes all persons inside the target vehicle when the target vehicle starts to move. Similarly, the second passenger set can be collected by an occupant monitoring system (OMS).

[0062] Step S230: judging whether there are still passengers who have not returned to the target vehicle according to the first passenger set and the second passenger set;

[0063] In the embodiment of the present application, the process of determining whether there are still passengers who have not returned to the target vehicle may include:

[0064] The first passenger set and the second passenger set are directly compared, and it is determined whether there are still passengers who have not returned to the target vehicle according to whether the second passenger set includes all the passengers in the first passenger set.

[0065] Alternatively, a first target passenger who is temporarily away is identified from the first passenger set; and then, based on whether the second passenger set includes all the first target passengers, it is determined whether there are still passengers who have not returned to the target vehicle.

[0066] Step S240: If there are still passengers who have not returned to the target vehicle, a first prompt message is generated to prompt that there are still passengers who have not returned to the target vehicle.

[0067] In the embodiment of the present application, the first prompt information is used to remind the driver and passengers that there are passengers who have not returned to the target vehicle.

[0068] In the embodiment of the present application, the first prompt information can be issued by a human-computer interaction interface, including but not limited to the instrument panel, central control screen, head-up display device (HUD), prompt sound, light, etc., and the specific form is not limited. For example, the instrument panel can prompt by flashing a specific warning light, the central control screen can pop up a prompt box to display the information of the passengers who have not returned, the head-up display device can display the relevant warning content in the driver's field of view, the prompt sound can be issued by the vehicle's audio system, and the light can remind the driver and passengers through the change of the interior ambient light.

[0069] In the embodiment of the present application, a trigger signal indicating that a passenger at the target vehicle has temporarily left is obtained, and a first passenger set is determined before the passenger leaves the target vehicle; after the target vehicle starts to move, the passengers at the target vehicle are determined in response to the trigger signal to obtain a second passenger set; based on the first passenger set and the second passenger set, it is determined whether there are still passengers who have not returned to the target vehicle; if there are still passengers who have not returned to the target vehicle, a first prompt message is generated to prompt that there are still passengers who have not returned to the target vehicle. This significantly reduces the problem of the driver driving away due to distraction or carelessness and forgetting the passengers at the place where they are, and improves the user experience.

[0070] In addition, the technical solution initially adopted by the inventor is to set the comparison timing of the first passenger set and the second passenger set to be executed immediately after each door opening and closing action. In actual application, it is found that this real-time comparison mechanism has significant defects: when the driver and passengers open the door to get off after parking, the system will generate a false judgment prompt; in the scenario where multiple people get off and do not return at the same time, the system will continue to generate false alarms during multiple comparisons before the last door is closed.

[0071] In the embodiment of the present application, the technical solution is improved as follows: after the target vehicle starts to move, it is judged whether there are still passengers who have not returned to the target vehicle based on the first passenger set and the second passenger set. By delaying the comparison timing, the false alarm rate of the first prompt information is significantly reduced, and the interference of redundant prompts to the user is avoided, which ultimately improves the accuracy of the human-computer interaction system and the user experience satisfaction.

[0072] based on Figure 2 The method in this specification also provides some specific implementation plans of the method, which are described below.

[0073] Optionally, judging whether there are still passengers who have not returned to the target vehicle according to the first passenger set and the second passenger set includes:

[0074] After a door of the target vehicle is opened for a first preset time or after a door of the target vehicle is closed, determining passengers of the target vehicle to obtain a third passenger set;

[0075] Identifying a first target passenger who is in a temporarily leaving state by calculating a difference set between the first passenger set and the third passenger set;

[0076] According to whether the second passenger set includes all the first target passengers, it is determined whether there are still passengers who have not returned to the target vehicle.

[0077] In the embodiment of the present application, the first preset time is used to ensure that there is enough time for passengers to get on and off the bus, and can be set according to actual conditions, such as 30 seconds, 1 minute, or 2 minutes.

[0078] In the embodiment of the present application, the third passenger set is a set of passengers who remain in the vehicle after some passengers temporarily leave the target vehicle. The status of the passengers in the third passenger set can be either boarded or not boarded.

[0079] Similarly, the third passenger set can be acquired by an occupant monitoring system (OMS). In practical applications, the third passenger set can be acquired multiple times by the occupant monitoring system (OMS), and whenever the third passenger set changes, the first target passenger who is temporarily leaving can be identified again.

[0080] In the embodiment of the present application, the first target passenger is a passenger who temporarily leaves the target vehicle, and the first target passenger is in a temporarily leaving state.

[0081] In the embodiment of the present application, the difference between the first passenger set and the third passenger set is calculated, that is, the passengers in the third passenger set are eliminated from the first passenger set, and the remaining passengers are the first target passengers who are in a temporarily leaving state.

[0082] In the embodiment of the present application, the first target passenger can also be determined by the environmental perception device of the target vehicle; for example, the surround camera can capture the real-time images around the vehicle, and analyze the passengers' boarding and exiting behaviors through image recognition technology to determine which passengers are temporarily away; the radar on the side of the vehicle can detect moving objects around the vehicle. When the passenger temporarily leaves the vehicle and moves around the vehicle, the radar can capture its position and movement trajectory, and then assist in determining whether the passenger is temporarily away. The information provided by these environmental perception devices can be combined with the data collected by the occupant monitoring system to more comprehensively and accurately determine the first target passenger and improve the accuracy of determining whether the passenger returns to the vehicle.

[0083] In the embodiment of the present application, if the second passenger set does not include all the first target passengers, it is determined that there are still passengers who have not returned to the target vehicle. At this time, the status of the first target passenger is updated to have boarded or not got off.

[0084] In the embodiment of the present application, if the second passenger set includes all the first target passengers, it is determined that all passengers have returned to the target vehicle, and the relevant prompt process can be ended.

[0085] In an embodiment of the present application, after the passengers get on and off the vehicle, the passengers on the target vehicle at this time are determined to obtain a third passenger set; by comparing the first passenger set and the third passenger set, the first target passengers who are temporarily away are determined; and according to whether the second passenger set includes all the first target passengers, it is determined whether there are still passengers who have not returned to the target vehicle. Thus, accurately identifying the first target passenger who is temporarily away helps to improve the accuracy of judging whether the passenger has returned to the vehicle and avoid safety hazards and inconveniences caused by misjudgment. In particular, in scenarios where there are many people on the vehicle, this method can effectively reduce the possibility of misjudgment and improve the reliability of judgment.

[0086] Optionally, the method further includes: canceling the temporary departure status of the first target passenger after a second preset time has passed since the trigger signal was acquired.

[0087] Optionally, the method further includes: when the time that the first target passenger is in the temporarily away state reaches a second preset time, canceling the temporarily away state of the first target passenger.

[0088] In the embodiment of the present application, the second preset time is used to determine whether the first target passenger has temporarily left or completely left the target vehicle. The second preset time can be set according to actual conditions, such as 4 hours.

[0089] In the embodiment of the present application, the canceling of the temporary departure status of the first target passenger may include: clearing the passenger information in the last driving process, or updating the status of the first target passenger to having gotten off the bus or having left the bus,

[0090] In the embodiment of the present application, if the target vehicle starts again after the second preset time, it is normal for the passengers on the vehicle to change. The correlation between the two driving processes is weak, and it does not belong to the situation where the passengers are left behind. Therefore, the system will cancel the temporary departure status of the first target passenger. By reasonably setting the second preset time, unnecessary prompts and interference can be effectively reduced, reducing the disturbance to the user, thereby improving the user experience.

[0091] Optionally, judging whether there are still passengers who have not returned to the target vehicle according to the first passenger set and the second passenger set includes:

[0092] Whether there are still passengers who have not returned to the target vehicle is determined according to whether the first passenger set includes all the passengers in the second passenger set.

[0093] In an embodiment of the present application, if the first passenger set does not include all passengers in the second passenger set, it is determined that there are still passengers who have not returned to the target vehicle, and a first prompt message is subsequently generated to prompt that there are still passengers who have not returned to the target vehicle.

[0094] If the first passenger set includes all passengers in the second passenger set, it is determined that all passengers have returned to the target vehicle, and the relevant prompt process can be ended.

[0095] Optionally, determining the passengers at the target vehicle includes:

[0096] Based on a passenger monitoring system, passengers in the target vehicle are determined according to biological characteristics of human bodies in the target vehicle.

[0097] In the embodiment of the present application, the passenger monitoring system is used to monitor the situation of people inside the vehicle in real time, and may include but not limited to devices such as cameras and millimeter-wave radars, and may also include infrared sensors, pressure sensors, etc. These devices can sense the presence and status of people in the vehicle from different angles and methods. For example, the camera can capture the visual image of the person, the millimeter-wave radar can detect the tiny movements and position changes of the person, the infrared sensor can sense the thermal radiation of the human body, and the pressure sensor can detect the pressure changes on the seat, so as to comprehensively judge the situation of the people in the vehicle.

[0098] In an embodiment of the present application, the biometric features may include but are not limited to facial features collected by a camera, and may also include body features collected by a millimeter-wave radar. These features are unique and stable and can be used to accurately identify the identity of passengers. For example, by matching the facial features of passengers in the first passenger set and the second passenger set, it can be determined which passengers have returned to the vehicle and which passengers have not yet returned. By analyzing the body features collected by the millimeter-wave radar, the identity and status of the passenger can be further confirmed, thereby improving the accuracy of the judgment. As a result, the passenger monitoring system can accurately identify, match and record the identity information of the passenger.

[0099] Optionally, determining the passengers at the target vehicle includes:

[0100] The passengers at the target vehicle are determined according to the short-range wireless communication signal of the mobile terminal.

[0101] In an embodiment of the present application, the mobile terminal may be a passenger's smart phone, smart watch or other device, which usually has a short-range wireless communication function and can communicate with the vehicle's wireless signal transmitting device.

[0102] In the embodiment of the present application, the short-range wireless communication signal can be used to measure the distance between the potential passenger and the vehicle through wireless ranging technology. The short-range wireless communication signal can include Bluetooth, WiFi, NFC, UWB and other signals.

[0103] In an embodiment of the present application, the passenger at the target vehicle is determined according to the short-range wireless communication signal of the mobile terminal, including: determining the distance between the mobile terminal and the target vehicle according to the short-range wireless communication signal of the mobile terminal; judging whether the user of the mobile terminal is a passenger of the target vehicle according to whether the distance is less than a threshold value, and / or, according to the change trend of the distance. For example, if the distance between the mobile terminal and the target vehicle is always less than a preset value (for example, 1 meter), it is determined that the user of the mobile terminal is a passenger of the target vehicle. During the movement of the target vehicle, if the distance between the mobile terminal and the target vehicle is always less than the preset value, the user of the mobile terminal is likely to be a passenger of the target vehicle. If the unit time change value of the distance between the mobile terminal and the target vehicle is greater than the preset value when the target vehicle starts, it is determined that the user of the mobile terminal is not a passenger of the target vehicle at this time, that is, the user of the mobile terminal has not boarded the vehicle.

[0104] In an embodiment of the present application, the distance between the terminal and the vehicle is measured based on the signal strength method and / or the time of flight (TOF) method according to the short-range wireless communication signal of the mobile terminal. Taking Bluetooth as an example, by reading the received signal strength value (RSSI) of the broadcast packet sent by the mobile terminal, the distance between the mobile terminal and the vehicle is measured when the data is not connected; the RSSI value reflects the strength of the signal, and the larger the value, the stronger the signal and the closer the distance. The time of flight rule calculates the distance between the terminal and the vehicle by measuring the time it takes for the signal to travel from the mobile terminal to the vehicle and back, combined with the signal propagation speed.

[0105] In the embodiment of the present application, the determination of the passenger at the target vehicle according to the short-range wireless communication signal of the mobile terminal may also include: obtaining the signal strength of the mobile terminal through the wireless signal transceiver provided inside and outside the target vehicle respectively; if the signal strength inside the vehicle received by the mobile terminal is greater than the signal strength outside the vehicle, it is determined that the user of the mobile terminal is inside the vehicle. Alternatively, if the difference between the signal strength inside the vehicle and the signal strength outside the vehicle is greater than a preset threshold, it is determined that the user of the mobile terminal is inside the vehicle.

[0106] In an embodiment of the present application, determining the passengers at the target vehicle based on the short-range wireless communication signal of the mobile terminal can serve as an effective supplement to the passenger monitoring system and help improve the accuracy and reliability of the passenger monitoring system.

[0107] In actual applications, passengers temporarily get off the car to pick up something or go to the toilet, which is not a frequent scenario. If the driver and passengers before and after the door is opened and closed are compared every time, the system will frequently generate false first prompt information because it cannot distinguish between "temporary leaving the car" and "permanent getting off the car", resulting in a significant decrease in prompt accuracy. This redundant prompt not only increases the user's operating burden, but also interferes with normal driving decisions and reduces the level of intelligence of the human-vehicle interaction experience.

[0108] Optionally, the trigger signal includes input through a human-computer interaction interface of the target vehicle.

[0109] In the embodiment of the present application, the human-machine interface (HMI) refers to the hardware and software interface used to realize the information exchange between the driver and the target vehicle, such as physical buttons, virtual buttons on the touch screen, voice interaction system, gesture recognition system, etc. Specifically, the physical buttons can be set at the seats, doors, center console, steering wheel and other locations of the vehicle; the driver and the passenger input the trigger signal by pressing these buttons. If each seat is provided with a physical button, after it is triggered, the driver and the passenger at the seat can be marked as the first target passenger in the temporary departure state.

[0110] The touch screen can be operated by touching the graphical interface on the display screen, which may include a central control screen or a rear entertainment screen, etc.; the voice interaction system allows the driver and passengers to interact with the vehicle through voice commands, such as saying "passengers please get off temporarily" to trigger a signal; the gesture recognition system can input commands by recognizing the gestures of the driver and passengers, such as triggering a signal for the passengers to get off through specific gestures.

[0111] In an embodiment of the present application, after the door of the target vehicle is opened, a prompt message can be generated, which is used to prompt the driver and passenger to input the trigger signal. In specific implementation, the user can be guided to input the trigger signal through a human-computer interaction interface such as voice broadcast and dynamic animation to clarify the intention of temporarily leaving the vehicle. In an embodiment of the present application, in the scenario where the passenger temporarily gets off the vehicle, the driver and passenger can input the trigger signal through the human-computer interaction interface; during the start-up process after receiving the trigger signal, if a passenger has not returned to the target vehicle, a first prompt message is generated to prompt that there are still passengers who have not returned to the target vehicle. This solution facilitates the user to input the trigger signal when temporarily getting off the vehicle, can significantly reduce the false alarm rate of the first prompt message, effectively reduce unnecessary disturbances to the user, and improve the intelligent experience of human-vehicle interaction. In an embodiment of the present application, the trigger signal can also be input by the driver and passenger through the vehicle control software, navigation software or taxi software of the mobile terminal. If a short-range wireless communication connection such as Bluetooth and WI FI is established between the mobile terminal and the target vehicle, the mobile terminal can be sent to the target vehicle. If a short-range wireless communication connection is not established, it can be forwarded to the target vehicle through the Internet of Vehicles technology.

[0112] In an embodiment of the present application, the trigger signal can also be automatically triggered by identifying a specific passenger. Specifically, the system monitors the collection of drivers and passengers before and after the door is opened and closed in real time through a biometric recognition module (such as face recognition) or a preset identity tag (such as a child / elderly passenger tag). If a preset "high-dependency passenger" (such as a child or elderly person who is unable to act independently) is detected to leave the vehicle alone, a trigger signal is automatically generated and marked as a "designated user leaving the vehicle event". For example, when the in-vehicle identity recognition system determines that the guardian does not leave the vehicle synchronously and the child passenger gets off the vehicle alone, the temporary leaving mode will be triggered and the prompt monitoring logic will be started. While retaining the user's active trigger mechanism, the accurate identification of key targets is achieved through identity correlation analysis, further reducing the triggering frequency of unnecessary prompts. For the short-term leaving behavior of young and middle-aged passengers, the system defaults to a low-risk scenario that can be judged independently to avoid excessive intervention.

[0113] In an embodiment of the present application, the trigger signal may also be automatically generated by the current position of the target vehicle.

[0114] Optionally, before obtaining the trigger signal indicating that a passenger at the target vehicle has temporarily left, the method further includes: when the target vehicle stops moving, obtaining the current parking position of the target vehicle; if the current parking position is a temporary parking position, generating the trigger signal.

[0115] Further, whether the current parking position is a temporary parking position is determined according to whether the type of the current parking position is a target type. Specifically, the target position type may include: a highway service area, a gas station, a convenience store or a viewing platform, a road with a long-term serious traffic jam (highway), etc., which is not specifically limited here.

[0116] The temporary parking location may be a specific geographic location that is preset. Specifically, after the target vehicle stops moving, the vehicle's positioning system (such as GPS) will obtain the current parking location and compare it with a preset temporary parking location database. If the current parking location matches a temporary parking location in the database, the system will automatically generate a trigger signal, indicating that the passenger may temporarily leave the vehicle, so that when the vehicle starts, it can be detected in time whether there are passengers who have not returned.

[0117] This parking position-based trigger signal generation method can effectively reduce the operating burden of drivers and passengers and improve the system's intelligence level and user experience.

[0118] Optionally, before obtaining the trigger signal indicating that the passenger at the target vehicle has temporarily left, the method further includes: obtaining the current parking position of the target vehicle when the target vehicle stops moving; and generating the trigger signal based on the current parking position and the destination position. For example, when the target vehicle is a passenger vehicle, if the current parking position is inconsistent with the destination position in the passenger order, and the passenger has the feasibility of leaving the target vehicle, the trigger signal is generated. Whether the passenger has the feasibility of leaving the target vehicle can be judged by the position of the passenger's mobile terminal, the door opening signal, the seat sensor data, etc. This method of generating trigger signals based on parking position and destination position can effectively improve the intelligence level and user experience of the system, reduce the operating burden of the driver, and ensure that the trigger signal can be generated in time when the passenger temporarily leaves the vehicle for subsequent passenger monitoring and prompting.

[0119] Optionally, the method further includes:

[0120] After the target vehicle starts to move, determining the passenger's accessories in the target vehicle;

[0121] Determine the second target passenger corresponding to the passenger's accessory items according to a predetermined accessory relationship; the accessory relationship is used to represent a mapping relationship between the passenger and the passenger's accessory items;

[0122] If the second passenger set does not include the second target passenger, a second prompt message is generated; the second prompt message is used to prompt the target vehicle that there are items left behind by passengers in the vehicle when the vehicle starts.

[0123] In an embodiment of the present application, the passenger accessories refer to items associated with the passenger, such as bags, mobile phones, luggage, etc.; the passenger accessories can be determined by an occupant monitoring system, such as by capturing images with a camera or detecting the shape and position of the item with a millimeter-wave radar.

[0124] In the embodiment of the present application, the attachment relationship refers to the mapping relationship between the passenger and the passenger's attachments, which can be determined by the passenger monitoring system.

[0125] In the embodiment of the present application, the second target passenger is the passenger to whom the passenger's attached item belongs when the target vehicle starts, that is, the passenger who has an attached relationship with the item.

[0126] In the embodiment of the present application, the second passenger set is the set of passengers in the vehicle when the target vehicle starts.

[0127] In an embodiment of the present application, the second prompt information is used to prompt the target vehicle that there are items left behind by passengers in the vehicle when the vehicle starts. For example, prompts can be issued through the instrument panel, central control screen, HUD, prompt sounds, lights, etc. to remind the driver and passengers to pay attention to the items left behind by passengers in the vehicle.

[0128] In the embodiment of the present application, after the target vehicle starts to start, the second target passenger corresponding to the passenger's accessory items in the vehicle is determined; if the second passenger set does not include the second target passenger, a second prompt message is generated to prompt that there are passenger-left items in the vehicle when the target vehicle starts. This design can effectively avoid the risk of passengers leaving items in the vehicle and improve the travel experience of passengers.

[0129] Based on the same technical concept, the present disclosure also provides another vehicle control method.

[0130] Figure 3 The figure shows a flow chart of another vehicle control method provided by an embodiment of the present application. As shown in the figure, the method mainly includes three steps: passenger getting off the vehicle, vehicle movement and system response.

[0131] When passengers get off the bus, they need to press the temporary exit switch on the seat armrest before getting off. If the switch is pressed, the passenger monitoring system will lock the passenger's facial features and mark the passenger as temporarily leaving the bus; if the switch is not pressed, the system will check whether there are any items left in the bus. If any items are found, the system will remind the driver and passengers; if not, the system will mark the passenger as having gotten off the bus and stop monitoring.

[0132] When the driver shifts into D gear and accelerates, the occupant monitoring system will recheck the key features of the occupants in the car to confirm whether the passengers marked as temporarily leaving are still in the car. The occupant monitoring system will check again whether there are any items left in the car and confirm whether the passengers to whom the items belong are in the car.

[0133] In the system response phase, if the passenger marked as temporarily leaving is detected in the vehicle, the system will update the status of all passengers to "not leaving the vehicle" and continue monitoring; if the passenger marked as temporarily leaving is not detected, a first prompt message is generated to indicate that there are still passengers who have not returned to the target vehicle. If the passenger whose item is left behind is not in the vehicle, a second prompt message is generated to indicate that there are items left behind by the passenger in the vehicle when the target vehicle starts.

[0134] Through this series of processes, this technical solution can effectively prevent passengers from being forgotten on the spot after getting off the bus for a short time, thereby improving driving safety and passenger experience.

[0135] Exemplary Devices

[0136] The device embodiments of the present application can be used to execute the method embodiments of the present application. For details not disclosed in the device embodiments of the present application, please refer to the method embodiments of the present application.

[0137] Figure 4 FIG. 1 is a block diagram of a vehicle control device provided by an embodiment of the present application. Figure 4 As shown, the device 400 includes:

[0138] The acquisition module 410 is used to acquire a trigger signal indicating that a passenger at a target vehicle temporarily leaves, and a first passenger set; the first passenger set is determined before the passenger leaves the target vehicle;

[0139] A determination module 420 is used to determine the passengers at the target vehicle in response to the trigger signal after the target vehicle starts to move, and obtain a second passenger set;

[0140] A determination module 430, configured to determine whether there are any passengers who have not returned to the target vehicle according to the first passenger set and the second passenger set;

[0141] The prompt module 440 is used to generate a first prompt message for prompting that there are still passengers who have not returned to the target vehicle if there are still passengers who have not returned to the target vehicle.

[0142] Optionally, the determining module 430 is configured to:

[0143] After a door of the target vehicle is opened for a first preset time or after a door of the target vehicle is closed, determining passengers of the target vehicle to obtain a third passenger set;

[0144] Identifying a first target passenger who is in a temporarily leaving state by calculating a difference set between the first passenger set and the third passenger set;

[0145] According to whether the second passenger set includes all the first target passengers, it is determined whether there are still passengers who have not returned to the target vehicle.

[0146] Optionally, the device 400 further includes:

[0147] A cancellation module, configured to cancel the temporary departure state of the first target passenger after a second preset time has passed since the trigger signal was acquired;

[0148] Optionally, the device 400 further includes:

[0149] The cancellation module is used to cancel the temporary absence status of the first target passenger when the time the first target passenger is in the temporary absence status reaches a second preset time.

[0150] Optionally, the determining module 430 is configured to:

[0151] Whether there are still passengers who have not returned to the target vehicle is determined according to whether the first passenger set includes all the passengers in the second passenger set.

[0152] Optionally, the determining module 420 is used to:

[0153] Based on a passenger monitoring system, determining passengers in the target vehicle according to biological characteristics of people in the target vehicle;

[0154] Optionally, the determining module 420 is used to:

[0155] The passengers at the target vehicle are determined according to the short-range wireless communication signal of the mobile terminal.

[0156] Optionally, the trigger signal includes input through a human-computer interaction interface of the target vehicle.

[0157] Optionally, the device 400 further includes:

[0158] An object identification module, used to identify passenger accessories in the target vehicle after the target vehicle starts to move;

[0159] A mapping module, used to determine the second target passenger corresponding to the passenger's accessory items according to a predetermined accessory relationship; the accessory relationship is used to represent the mapping relationship between the passenger and the passenger's accessory items;

[0160] The prompt module 440 is further used to generate a second prompt message if the second passenger set does not include the second target passenger; the second prompt message is used to prompt the target vehicle that there are items left behind by passengers in the vehicle when the target vehicle starts.

[0161] Exemplary Electronic Devices

[0162] Below, reference Figure 5 To describe an electronic device according to an embodiment of the present application. Figure 5 A block diagram of an electronic device according to an embodiment of the present application is illustrated.

[0163] like Figure 5 As shown, electronic device 500 includes one or more processors 510 and memory 520 .

[0164] The processor 510 may be a central processing unit (CPU) or other forms of processing units having data processing capabilities and / or instruction execution capabilities, and may control other components in the electronic device 500 to perform desired functions.

[0165] The memory 520 may include one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The volatile memory may include, for example, a random access memory (RAM) and / or a cache memory (cache), etc. The non-volatile memory may include, for example, a read-only memory (ROM), a hard disk, a flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage medium, and the processor 510 may run the program instructions to implement the vehicle control method of each embodiment of the present application described above and / or other desired functions. Various contents such as category correspondences may also be stored in the computer-readable storage medium.

[0166] In one example, the electronic device 500 may further include: an input device 530 and an output device 540 , and these components are interconnected via a bus system and / or other forms of connection mechanisms (not shown).

[0167] In addition, the input device 530 may also include, for example, a keyboard, a mouse, etc. The output device 540 may output various information to the outside. The output device 540 may include, for example, a display, a speaker, a printer, a communication network and a remote output device connected thereto, etc.

[0168] Of course, to simplify, Figure 5 Only some of the components related to the present application in the electronic device 500 are shown, and components such as a bus, an input / output interface, etc. are omitted. In addition, according to specific application situations, the electronic device 500 may also include any other appropriate components.

[0169] Example Vehicles

[0170] In addition to the above-mentioned method and device, an embodiment of the present application may also be a vehicle, including a vehicle body and the electronic device.

[0171] Exemplary computer program products and computer-readable storage media

[0172] In addition to the above-mentioned methods and devices, an embodiment of the present application may also be a computer program product, which includes computer program instructions, which, when executed by a processor, enable the processor to execute the steps of the vehicle control method according to various embodiments of the present application described in the above-mentioned "Exemplary Method" section of this specification.

[0173] The computer program product may be written in any combination of one or more programming languages ​​to write program codes for performing the operations of the embodiments of the present application, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program codes may be executed entirely on the passenger computing device, partially on the passenger computing device, as a separate software package, partially on the passenger computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0174] In addition, an embodiment of the present application may also be a computer-readable storage medium on which computer program instructions are stored. When the computer program instructions are executed by a processor, the processor executes the steps of the vehicle control method according to various embodiments of the present application described in the above "Exemplary Method" section of this specification.

[0175] The computer readable storage medium can adopt any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium can include, for example, but is not limited to, a system, device or device of electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0176] The basic principles of the present application are described above in conjunction with specific embodiments. However, it should be noted that the advantages, strengths, effects, etc. mentioned in the present application are only examples and not limitations, and it cannot be considered that these advantages, strengths, effects, etc. are required by each embodiment of the present application. In addition, the specific details disclosed above are only for the purpose of illustration and ease of understanding, not for limitation, and the above details do not limit the present application to being implemented by adopting the above specific details.

[0177] The block diagrams of the devices, apparatuses, equipment, and systems involved in this application are only illustrative examples and are not intended to require or imply that they must be connected, arranged, and configured in the manner shown in the block diagram. As will be appreciated by those skilled in the art, these devices, apparatuses, equipment, and systems can be connected, arranged, and configured in any manner. Words such as "including", "comprising", "having", etc. are open words, referring to "including but not limited to", and can be used interchangeably with them. The words "or" and "and" used here refer to the words "and / or" and can be used interchangeably with them, unless the context clearly indicates otherwise. The words "such as" used here refer to the phrase "such as but not limited to", and can be used interchangeably with them.

[0178] It should also be noted that in the apparatus, device and method of the present application, each component or each step can be decomposed and / or recombined. Such decomposition and / or recombination should be regarded as equivalent solutions of the present application.

[0179] The above description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present application. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects without departing from the scope of the present application. Therefore, the present application is not intended to be limited to the aspects shown herein, but rather to the widest scope consistent with the principles and novel features disclosed herein.

[0180] It should be understood that the qualifiers "first", "second", "third", "fourth", "fifth" and "sixth" used in the description of the embodiments of the present application are only used to more clearly explain the technical solutions and cannot be used to limit the scope of protection of the present application.

[0181] The above description has been given for the purpose of illustration and description. In addition, this description is not intended to limit the embodiments of the present application to the forms disclosed herein. Although multiple example aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, changes, additions and sub-combinations thereof.

Claims

1. A vehicle control method, characterized in that: include: Acquire a trigger signal for indicating that a passenger at the target vehicle temporarily leaves, and a first passenger set; The first set of passengers is determined before passengers leave the target vehicle; After the target vehicle starts to move, in response to the trigger signal, determining passengers at the target vehicle to obtain a second passenger set; Determining whether there are any passengers who have not returned to the target vehicle according to the first passenger set and the second passenger set; If there are still passengers who have not returned to the target vehicle, first prompt information is generated for prompting that there are still passengers who have not returned to the target vehicle.

2. The method according to claim 1, characterized in that The determining, based on the first passenger set and the second passenger set, whether there are still passengers who have not returned to the target vehicle comprises: After a door of the target vehicle is opened for a first preset time or after a door of the target vehicle is closed, determining passengers of the target vehicle to obtain a third passenger set; Identifying a first target passenger who is in a temporarily leaving state by calculating a difference set between the first passenger set and the third passenger set; According to whether the second passenger set includes all the first target passengers, it is determined whether there are still passengers who have not returned to the target vehicle.

3. The method according to claim 2, characterized in that The method further comprises: After a second preset time has passed since the trigger signal was acquired, canceling the temporary departure status of the first target passenger; Alternatively, when the time that the first target passenger is in the temporarily away state reaches a second preset time, the temporarily away state of the first target passenger is cancelled.

4. The method according to claim 1, characterized in that The determining, based on the first passenger set and the second passenger set, whether there are still passengers who have not returned to the target vehicle comprises: Whether there are still passengers who have not returned to the target vehicle is determined according to whether the first passenger set includes all the passengers in the second passenger set.

5. The method according to claim 1, characterized in that The determining of the passengers at the target vehicle comprises: Based on a passenger monitoring system, determining passengers in the target vehicle according to biological characteristics of people in the target vehicle; and / or, The passengers at the target vehicle are determined according to the short-range wireless communication signal of the mobile terminal.

6. The method according to claim 1, characterized in that The trigger signal includes an input through a human-computer interaction interface of the target vehicle.

7. The method according to claim 1, characterized in that The method further comprises: After the target vehicle starts to move, determining the passenger's accessories in the target vehicle; Determine the second target passenger corresponding to the passenger's accessory items according to a predetermined accessory relationship; the accessory relationship is used to represent a mapping relationship between the passenger and the passenger's accessory items; If the second passenger set does not include the second target passenger, a second prompt message is generated; the second prompt message is used to prompt the target vehicle that there are items left behind by passengers in the vehicle when the vehicle starts.

8. A vehicle control device, characterized in that: include: An acquisition module, used to acquire a trigger signal indicating that a passenger at a target vehicle temporarily leaves, and a first passenger set; The first set of passengers is determined before passengers leave the target vehicle; a determination module, configured to determine passengers at the target vehicle in response to the trigger signal after the target vehicle starts to move, to obtain a second passenger set; A judging module, configured to judge whether there are still passengers who have not returned to the target vehicle according to the first passenger set and the second passenger set; The prompt module is used to generate a first prompt message for prompting that there are still passengers who have not returned to the target vehicle if there are still passengers who have not returned to the target vehicle.

9. An electronic device, characterized in that: include: processor; a memory for storing instructions executable by the processor; The processor is used to execute the method according to any one of claims 1 to 7.

10. A vehicle, characterized in that: Comprising the electronic device as claimed in claim 9.

11. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer program instructions, which, when executed by a processor, cause the processor to perform the method according to any one of claims 1 to 7.

Images