Wake-up method and system for taking over driving by passengers in vehicle and vehicle

Abstract

The invention relates to the technical field of vehicles, and discloses an awakening method and system for passengers in a vehicle to take over driving, electronic equipment, a storage medium and the vehicle, and the method comprises the steps: recognizing the passengers, recording the sleep duration, synchronizing cloud data about the corresponding passengers, and recording the sleep duration of the corresponding passengers in the vehicle; the driver state is monitored, the takeover process is triggered, and when it is monitored that the driver state is fatigue or unsuddenly improper, the passenger takeover process is triggered; analyzing the passenger information and determining a wake-up sequence, calculating a comprehensive score of each passenger based on the passenger information, and determining a wake-up priority sequence according to the comprehensive scores; and implementing a wake-up strategy, detecting that the passenger wakes up to complete taking-over, guiding the passenger to take over the vehicle through voice and visual prompts after detecting that the passenger wakes up, and assisting the passenger to complete driving preparation. According to the invention, the appropriate passenger can be accurately selected and timely waken up to take over the vehicle, and a personalized waking-up strategy is adopted for the corresponding passenger, so that the driving safety is improved.

Description

Technical Field

[0001] The present invention relates to the field of vehicle technology, and in particular to a method, system, electronic device, storage medium and vehicle for waking up a passenger in a vehicle to take over driving. Background Art

[0002] Currently, in scenarios where the driver needs to wake up a sleeping passenger to take over the vehicle due to driver fatigue or sudden discomfort, a common way is to try to wake up the passenger through a simple voice alarm. For example, the vehicle may be equipped with a basic voice reminder system that sounds a voice alarm to try to wake up the passenger when driver fatigue or sudden discomfort is detected. Another way is to use the vibration function of the vehicle seat for reminders. The seat generates slight vibrations to attract the passenger's attention. Some vehicle systems also try to wake up passengers by flashing the lights in the car, but this method is usually simple and has limited effect.

[0003] Problems with existing technologies:

[0004] 1. Single wake-up method and poor effect: Existing sound alarms are often monotonous warning sounds, which are easily ignored or adapted by passengers, resulting in wake-up failure. The intensity and pattern of seat vibration and light flashing are also relatively fixed, making it difficult to effectively wake up passengers in deep sleep.

[0005] 2. Lack of accurate selection of passengers: The existing technology does not take into account individual differences of passengers when waking up passengers, such as age, driving experience, rest status, etc. Inappropriate passengers may be woken up randomly, resulting in reduced safety and reliability of taking over the vehicle.

[0006] Therefore, the present application provides a method for waking up a passenger in a vehicle to take over driving to solve the above technical problems. Summary of the invention

[0007] The purpose of the present invention is to provide a method, system, electronic device, storage medium and vehicle for waking up passengers in a vehicle to take over driving, so as to solve the technical problems in the prior art that it is impossible to accurately select passengers to be woken up and the waking up method is single.

[0008] In order to solve the above technical problems, the present invention provides a method for waking up a passenger in a vehicle to take over driving, comprising:

[0009] The passenger information acquisition step includes identifying the passenger and recording the sleep duration, wherein the cloud data about the corresponding passenger is synchronized and the sleep duration of the corresponding passenger in the vehicle is recorded;

[0010] The state monitoring and takeover triggering step includes monitoring the driver's state and triggering the takeover process, wherein when the driver's state is detected to be fatigued or suddenly unwell, the passenger takes over the vehicle process;

[0011] A passenger information analysis step, comprising analyzing the passenger information and determining a wake-up order, wherein a comprehensive score of each passenger is calculated based on the passenger information, and a priority order of wake-up is determined according to the comprehensive score;

[0012] The takeover prompt and execution steps include implementing a wake-up strategy and detecting that the passenger is awake to complete the takeover, wherein after detecting that the passenger is awake, the passenger is guided to take over the vehicle through voice and visual prompts and assisted in completing driving preparations.

[0013] In some specific embodiments, the passenger information acquisition step includes identifying the passenger and recording the sleep duration, wherein synchronizing cloud data about the corresponding passenger and recording the sleep duration of the corresponding passenger in the vehicle further includes:

[0014] Capturing the facial features of the passenger and comparing them with the information in the cloud to identify the passenger;

[0015] Synchronize the identified passenger information with cloud data to obtain the passenger's historical driving data and preference settings;

[0016] Monitor passengers' eye closing time and body movements, and record each passenger's sleep duration;

[0017] The recorded passenger information and sleep duration are stored in the vehicle's local database.

[0018] In some specific embodiments, the state monitoring and takeover triggering step includes monitoring the driver's state and triggering the takeover process, wherein when the driver's state is monitored to be fatigued or suddenly unwell, the passenger takeover process is triggered, further including:

[0019] Monitoring of the driver’s physiological signals, including heart rate monitoring and eye tracking;

[0020] Analyze the driver's eye movement frequency and head position to determine if the driver is showing signs of fatigue;

[0021] Monitor the stability of the vehicle's driving trajectory and identify whether there is a slight deviation from the lane;

[0022] When it is determined that the driver is fatigued or unwell, the process of taking over the vehicle is initiated to prepare to wake up the passengers.

[0023] In some specific embodiments, the passenger information analysis step includes analyzing the passenger information and determining the wake-up order, wherein, based on the passenger information, a comprehensive score of each passenger is calculated, and the priority order of the wake-up is determined according to the comprehensive score, further comprising:

[0024] Preset the weights of each passenger's driving age, safe driving mileage, number of violation records, number and severity of accidents, safe driving experience in different road conditions, and sleep duration, where the weight allocation is based on the impact on driving safety and reliability;

[0025] Calculate each passenger's score on each factor based on their actual data and preset weights;

[0026] Add up each passenger's scores on each factor to get a comprehensive score for each passenger;

[0027] The priority order for waking up the passengers is determined based on the comprehensive scores, with the passengers with the highest scores being woken up first.

[0028] In some specific embodiments, the takeover prompt and execution step includes implementing a wake-up strategy and detecting the passenger waking up to complete the takeover, wherein after detecting the passenger waking up, guiding the passenger to take over the vehicle through voice and visual prompts and assisting the passenger to complete the driving preparation, further includes:

[0029] Selecting the passenger with the highest score as the priority wake-up target according to the comprehensive score;

[0030] According to the age and sleep duration of the passenger, set the initial volume of the sound wake-up, the initial frequency of the seat vibration, the initial brightness and flashing frequency of the light wake-up;

[0031] Implementing the wake-up strategy, including gradually increasing sound wake-up, vibration wake-up and light wake-up, until the preset maximum intensity is reached or the passenger wakes up;

[0032] Monitor the passenger's wakefulness status. When the passenger is awake, assist the passenger to take over the vehicle through voice and screen prompts.

[0033] In some specific embodiments, it also includes:

[0034] Continuously monitor the passenger's facial expressions and body movements to determine whether the passenger has awakened;

[0035] When the passenger is detected to be awake, a preset voice prompt is played to inform the passenger of the current driver status and guide the passenger to take over the vehicle;

[0036] Display text prompts to guide passengers on how to adjust their seats and fasten their seat belts to ensure safe control of the vehicle;

[0037] If the passenger who is to take over is not detected to be awake within the preset time, the wake-up strategy will be executed repeatedly until the passenger wakes up and is ready to take over the vehicle.

[0038] Based on the same concept, the present invention also provides a wake-up system for a passenger in a vehicle to take over driving, comprising:

[0039] A passenger information acquisition module, configured to identify the passenger and record the sleep duration, wherein the cloud data about the corresponding passenger is synchronized and the sleep duration of the corresponding passenger in the vehicle is recorded;

[0040] A state monitoring and takeover triggering module is configured to monitor the driver's state and trigger the takeover process, wherein when the driver's state is detected to be fatigued or suddenly unwell, the passenger takes over the vehicle process;

[0041] A passenger information analysis module, configured to analyze passenger information and determine a wake-up order, wherein a comprehensive score of each passenger is calculated based on the passenger information, and a priority order of wake-up is determined according to the comprehensive score;

[0042] The takeover prompt and execution module is configured to implement the wake-up strategy and detect the passenger waking up to complete the takeover. After detecting that the passenger is awake, the passenger is guided to take over the vehicle through voice and visual prompts and assisted in completing driving preparations.

[0043] Based on the same concept, the present invention also provides an electronic device, comprising: a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other through the communication bus; a computer program is stored in the memory, and when the computer program is executed by the processor, the processor executes the steps of a wake-up method for a passenger in a vehicle to take over driving.

[0044] Based on the same concept, the present invention also provides a computer-readable storage medium storing a computer program executable by an electronic device. When the computer program runs on the electronic device, the electronic device executes the steps of a wake-up method for a passenger in a vehicle to take over driving.

[0045] Based on the same concept, the present invention also provides a vehicle, wherein the vehicle is provided with the above-mentioned wake-up system for the passengers in the vehicle to take over the driving.

[0046] Compared with the prior art, the invention has the following beneficial effects:

[0047] The present invention discloses a method, system, electronic device, storage medium and vehicle for waking up a passenger in a vehicle to take over driving. The method can accurately select and timely wake up a suitable passenger to take over the vehicle, and adopt a personalized waking up strategy for the corresponding passenger to improve driving safety. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] Figure 1 It is a flowchart of a method for waking up a passenger in a vehicle to take over driving in some specific embodiments of the present invention;

[0049] Figure 2It is a flow chart of a method for waking up a passenger in a vehicle to take over driving in some applications of the present invention;

[0050] Figure 3 It is a schematic diagram of the structure of a wake-up system for a passenger in a vehicle to take over driving in some specific embodiments of the present invention;

[0051] Figure 4 It is a schematic diagram of the structure of an electronic device in some specific embodiments of the present invention. DETAILED DESCRIPTION

[0052] In order to make the purpose, technical solutions and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present application.

[0053] The terms used in the embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to limit the present application. The singular forms "a", "said" and "the" used in the embodiments of the present application and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings, and "multiple" generally includes at least two.

[0054] It should be understood that the term "and / or" used in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.

[0055] It should be understood that although the terms first, second, third, etc. may be used to describe in the embodiments of the present application, these descriptions should not be limited to these terms. These terms are only used to distinguish the descriptions. For example, without departing from the scope of the embodiments of the present application, the first may also be referred to as the second, and similarly, the second may also be referred to as the first.

[0056] As used herein, the words "if" and "if" may be interpreted as "at the time of" or "when" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrases "if it is determined" or "if (stated condition or event) is detected" may be interpreted as "when it is determined" or "in response to determining" or "when detecting (stated condition or event)" or "in response to detecting (stated condition or event)", depending on the context.

[0057] It should also be noted that the term "includes", "comprising" or any other variation thereof is intended to cover non-exclusive inclusion, so that a commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprising a ..." do not exclude the existence of other identical elements in the commodity or device including the elements.

[0058] It should be particularly noted that any symbols and / or numbers in the specification that are not marked in the accompanying drawings are not drawing marks.

[0059] Reference Figure 1 , a method for waking up a passenger in a vehicle to take over driving, comprising:

[0060] S101, a passenger information acquisition step, including identifying a passenger and recording sleep duration, wherein cloud data about the corresponding passenger is synchronized, and the sleep duration of the corresponding passenger in the vehicle is recorded;

[0061] Understandably, this step uses in-car cameras and image processing as well as synchronization with cloud data to collect and store relevant information about passengers.

[0062] In some of these applications, passengers are identified and their sleep duration is recorded, cloud data about the corresponding passengers is synchronized, and the sleep duration of the corresponding passengers in the car is recorded; the facial features of the passengers are captured and compared with the information in the cloud to identify the passengers; the identified passenger information is synchronized with the cloud data to obtain the passenger's historical driving data and preference settings; the length of time the passengers close their eyes and their body movements are monitored, and the sleep duration of each passenger is recorded; the recorded passenger information and sleep duration are stored in the vehicle's local database.

[0063] It is understood that when a passenger enters the vehicle and sits down, the in-vehicle camera is automatically activated and begins to capture the passenger's facial features. The image captured by the camera is analyzed to extract key facial feature points. The extracted facial feature points are matched with the pre-stored passenger information database to identify the passenger. When the passenger is identified, the passenger's driving history, preference settings, and other relevant information are obtained from the cloud. All the acquired information is synchronized to the vehicle system for use in subsequent steps.

[0064] For example, passenger Mr. Zhang enters the vehicle and sits in the front passenger seat. The in-car camera captures Mr. Zhang's facial image and successfully identifies Mr. Zhang by comparing the facial feature points in the database. Mr. Zhang's driving preferences (such as seat position, music selection, etc.) and safe driving records are then downloaded from the cloud.

[0065] After the passenger is identified, the passenger's eye closure and body movement are monitored to determine whether the passenger has fallen asleep. The passenger's sleep state is determined by analyzing the passenger's eye movements and head position changes. When the passenger is determined to have fallen asleep, the sleep duration is recorded. The sleep duration data is updated in real time and stored in the vehicle's local database for subsequent analysis and use.

[0066] For example, if passenger Ms. Li starts to doze off after 30 minutes of driving, we can confirm that she has fallen asleep by analyzing her closed eyes and head position. The time when Ms. Li fell asleep is recorded and the timing is started. During the rest of the journey, we continue to monitor Ms. Li's sleep until she wakes up. If Ms. Li sleeps for 90 minutes, we record her total sleep time as 90 minutes and update the relevant information in the database.

[0067] All sleep duration data and identification information about passengers are encrypted and stored in the vehicle's local database. The data is also synchronized to the cloud to ensure data security and accessibility. The data is regularly checked for completeness and accuracy to ensure that it can be accurately called up when needed.

[0068] For example, passenger Mr. Wang sleeps for 2 hours during a long journey. His sleep duration is recorded and synchronized to the cloud after the vehicle arrives at the destination. The data can be used to analyze Mr. Wang's fatigue level and provide more personalized services in future journeys, such as adjusting the wake-up strategy or reminding him to rest.

[0069] S102, a state monitoring and takeover triggering step, including monitoring the driver's state and triggering the takeover process, wherein when the driver's state is monitored to be fatigued or suddenly unwell, the passenger takes over the vehicle process;

[0070] It can be understood that this step is used to monitor the driver's physiological signals and driving behavior, and how to trigger the process for the passenger to take over the vehicle when driver fatigue or sudden discomfort is detected.

[0071] In some of these applications, the driver's status is monitored and the takeover process is triggered. When the driver is detected to be fatigued or suddenly unwell, the process of passenger taking over the vehicle is triggered. The driver's physiological signals are monitored, including heart rate monitoring and eye tracking; the driver's eye movement frequency and head position are analyzed to determine whether the driver shows signs of fatigue; the stability of the vehicle's driving trajectory is monitored to identify whether there is a slight deviation from the lane; when it is determined that the driver is fatigued or unwell, the process of taking over the vehicle is initiated to prepare to wake up the passengers.

[0072] It is understood that physiological sensors installed inside the vehicle, such as a heart rate monitor and an eye tracking camera, are used to monitor the driver's physiological signals in real time. The heart rate monitor is wirelessly connected to the driver's smart watch or dedicated sensor to transmit heart rate data in real time. The eye tracking camera captures the driver's eye movements, including blinking frequency and eye movement.

[0073] For example, the normal range of heart rate is set to 60-100 beats / minute. When the driver's heart rate is continuously detected to exceed 100 beats / minute, it is recorded as a possible fatigue signal. The resolution of the eye tracking camera is set to 1080p and the frame rate is 30fps to ensure that clear eye movements are captured.

[0074] Analyze the driver's blinking frequency and eye movement patterns through eye tracking data. Use head position sensors to monitor the tilt angle and position changes of the driver's head. Analyze the data to determine whether the driver shows signs of fatigue, such as frequent blinking, long-term eye closure, or frequent forward head tilt.

[0075] For example, the normal blinking frequency is set to 15-20 times per minute. When the driver's blinking frequency is detected to be less than 10 times per minute and lasts for more than 2 minutes, it is judged as a sign of fatigue. If the head position sensor detects that the driver's head tilts forward at an angle of more than 15 degrees and lasts for more than 10 seconds, it is recorded as a sign of fatigue.

[0076] Use the vehicle's navigation system and lane keeping assist system to monitor the vehicle's driving trajectory and lane position. Analyze whether the vehicle frequently deviates slightly from the lane, such as swaying left and right in the lane or frequently approaching the lane line.

[0077] For example, the normal deviation range of the vehicle in the lane is set to ±0.5 meters. If the vehicle exceeds the lane line three times within 10 seconds and the deviation exceeds 0.5 meters, it is recorded as an unstable driving trajectory.

[0078] When it is determined that the driver is tired or unwell, the process of taking over the vehicle is automatically initiated. First, the display screen and voice prompts in the car warn the driver to take a rest or find a safe place to park. If the driver does not respond or cannot continue driving, prepare to wake up the passengers through the wake-up system in the car (such as sound, vibration or light).

[0079] For example, after detecting signs of driver fatigue, the driver is first given a 2-minute warning time. If the driver does not take action, the process of waking up the passengers will be started at the 3rd minute. The process of waking up the passengers includes a sound prompt that gradually increases in volume, starting at 50 decibels and increasing by 5 decibels every 10 seconds until it reaches 80 decibels or the passenger wakes up.

[0080] S103, a passenger information analysis step, including analyzing passenger information and determining a wake-up order, wherein a comprehensive score of each passenger is calculated based on the passenger information, and a priority order of wake-up is determined according to the comprehensive score;

[0081] It is understandable that when the driver is unable to continue driving due to fatigue or sudden discomfort, the most suitable passenger needs to be quickly identified to take over the vehicle. This step is used to analyze passenger information, calculate the comprehensive score of each passenger, and determine the priority order of waking up based on the score.

[0082] In some of the applications, passenger information is analyzed and the wake-up order is determined. Based on the passenger information, a comprehensive score of each passenger is calculated, and the priority order of waking up is determined according to the comprehensive score. The weights of each passenger's driving age, safe driving mileage, number of violation records, number and severity of accidents, safe driving experience in different road conditions, and sleep duration are preset, and the weight distribution is based on the impact on driving safety and reliability. The score of each passenger on each factor is calculated based on the actual data of each passenger and the preset weights; the score of each passenger on each factor is added together to obtain a comprehensive score for each passenger; based on the comprehensive score, the priority order of waking up the passengers is determined, and the passengers with the highest scores are woken up first.

[0083] Understandably, based on the impact on driving safety and reliability, weights are preset for each passenger’s driving age, safe driving mileage, number of violation records, number and severity of accidents, safe driving experience under different road conditions, and sleep duration.

[0084] The weights are distributed as follows:

[0085] Driving experience: 10%;

[0086] Safe driving mileage: 20%;

[0087] Number of violation records: 20%;

[0088] Number and severity of accidents: 25%;

[0089] Safe driving experience in different road conditions: 10%;

[0090] Sleep duration: 15%.

[0091] For example, a passenger with more than 10 years of driving experience is allocated 100 points, 5-10 years is allocated 70 points, 1-5 years is allocated 50 points, 0-1 years is allocated 20 points, and 0 years is allocated 0 points.

[0092] Based on each passenger's actual data and preset weights, each passenger's score on each factor is calculated.

[0093] The calculation method is as follows:

[0094] Driving experience score = driving experience score * weight;

[0095] Safe driving mileage score = safe driving mileage (km) * 0.01;

[0096] Violation record number score = 100-(violation record number*10);

[0097] Accident number and severity score = (100-serious accident number*30)-minor accident number*10;

[0098] Safety driving experience scores for different road conditions = assigning scores based on experience type;

[0099] Sleep duration score = (200-sleep duration (minutes))*0.5.

[0100] For example, passenger A has 10 years of driving experience, a safe driving mileage of 20,000 kilometers, no violation record, no accidents, city and highway driving experience, and a sleep time of 120 minutes.

[0101] Passenger A's driving experience score = 100*0.1 = 10 points;

[0102] Safe driving mileage score = 20000*0.01 = 200 points;

[0103] Number of violation records = 100*0.2 = 20 points;

[0104] Accident number and severity score = 100*0.25 = 25 points;

[0105] Safe driving experience score for different road conditions = 100*0.1 = 10 points;

[0106] Sleep duration score = (200-120)*0.5 = 40 points.

[0107] Add up the scores of each passenger on each factor to get the comprehensive score of each passenger. According to the comprehensive score, determine the priority of waking up passengers.

[0108] For example, passenger A's comprehensive score = 10+200+20+25+10+40=315 points;

[0109] Passenger B's comprehensive score = 85+180+20+15+5+30=335 points;

[0110] Based on the score, passenger B has a higher priority than passenger A.

[0111] According to the calculated comprehensive scores, the priority of waking up passengers is sorted from high to low. The passengers with the highest scores are woken up first to ensure the safety and reliability of driving.

[0112] For example, if passenger B's comprehensive score is 335 points, passenger A's is 315 points, and passenger C's is 280 points, the wake-up order is B>A>C.

[0113] S104, takeover prompt and execution step, including implementing the wake-up strategy and detecting the passenger waking up to complete the takeover, wherein after detecting the passenger waking up, guiding the passenger to take over the vehicle through voice and visual prompts, and assisting him to complete driving preparations.

[0114] It can be understood that this step is used to implement the wake-up strategy, detect the passenger's awakening, and guide the passenger to complete the process of taking over the vehicle.

[0115] In some of the applications, a wake-up strategy is implemented and the passenger is detected to complete the takeover. After the passenger is detected to be awake, the passenger is guided to take over the vehicle through voice and visual prompts, and is assisted in completing driving preparations. The passenger with the highest score is selected as the priority wake-up target based on the comprehensive score; the initial volume of the sound wake-up, the initial frequency of the seat vibration, and the initial brightness and flashing frequency of the light wake-up are set according to the age and sleep duration of the passenger; the wake-up strategy is implemented, including gradually increasing sound wake-up, vibration wake-up and light wake-up, until the preset maximum intensity is reached or the passenger wakes up; the passenger's wake-up status is monitored, and when the passenger is detected to be awake, voice and screen prompts are used to assist the passenger to take over the vehicle.

[0116] Understandably, based on the comprehensive score of each passenger, the passenger with the highest score is selected as the priority to be woken up. The comprehensive score takes into account factors such as the passenger's driving age, safe driving mileage, number of violation records, number and severity of accidents, safe driving experience in different road conditions, and sleep duration.

[0117] For example, the comprehensive score of passenger D is 350 points, passenger E is 300 points, and passenger F is 280 points. The system selects passenger D as the priority wake-up object.

[0118] According to the age and sleep duration of the selected passenger, set the initial volume of the sound wake-up, the initial frequency of the seat vibration, and the initial brightness and flashing frequency of the light wake-up.

[0119] The initial parameter settings are as follows:

[0120] Voice wake-up: The initial volume is 60% of the maximum volume if the passenger is between 18 and 30 years old and the sleep time is less than 2 hours.

[0121] Seat vibration: initial frequency is 50% of the maximum frequency if the passenger is between 31-50 years old and sleeps for 2-4 hours.

[0122] Light wake-up: initial brightness is 40% of the maximum brightness, flashing frequency is 30% of the maximum frequency, if the passenger is over 51 years old and sleeps for more than 4 hours.

[0123] For example, passenger D is 28 years old and sleeps for 1.5 hours. Set the initial volume to 60%, the initial seat vibration frequency to 50%, the initial light brightness to 40%, and the initial light flashing frequency to 30%.

[0124] Implement waking-up strategies, including progressively increasing sound, vibration, and light waking-ups.

[0125] The enhancement process of the wake-up strategy is as follows:

[0126] Voice wake-up: The volume increases by 5% every 10 seconds until it reaches the maximum volume or the passenger wakes up.

[0127] Seat vibration: The vibration frequency increases by 5% every 10 seconds until the maximum frequency is reached or the passenger wakes up.

[0128] Light wake-up: The brightness increases by 5% and the flashing frequency increases by 5% every 10 seconds until the maximum brightness and maximum flashing frequency are reached or the passenger wakes up.

[0129] For example, the wake-up strategy is implemented with an initial volume of 60% and an increase of 5% every 10 seconds until passenger D wakes up at 80%.

[0130] Monitor passengers' wakefulness, including facial expressions, body movements, and bio-signals.

[0131] When the system detects that the passenger is awake, it assists the passenger in taking over the vehicle through voice and screen prompts.

[0132] Voice prompts include instructing passengers to adjust seat positions, fasten seat belts, check the vehicle's surroundings, etc.

[0133] Screen prompts display the vehicle's current status, speed, navigation information, etc.

[0134] For example, passenger D wakes up when the volume reaches 75%, the seat vibration frequency reaches 55%, the light brightness reaches 45%, and the light flashing frequency reaches 35%. The voice prompts: "Hello, passenger D, you are now the driver of the vehicle, please adjust your seat and fasten your seat belt." At the same time, the screen displays: "Please check the vehicle's surroundings and prepare to take over the vehicle."

[0135] Some of these applications also include continuously monitoring passengers' facial expressions and body movements to determine whether the passengers have awakened; when a passenger is detected to be awake, a preset voice prompt is played to inform the passenger of the current driver status and guide the passenger to take over the vehicle; text prompts are displayed to guide passengers on how to adjust their seats and fasten their seat belts to ensure safe takeover of the vehicle; if the passenger is not detected to be awake within the preset time, the wake-up strategy is executed in a loop until the passenger wakes up and is ready to take over the vehicle.

[0136] It is understandable that the facial expressions and body movements of passengers are continuously monitored using in-car cameras and biometric sensors. Whether the passenger is awake is determined by analyzing the passenger's eye movements, head posture, and body movements.

[0137] For example, the threshold for eye activity monitoring is set to at least 10 blinks per minute, the threshold for head posture monitoring is set to a head position change of more than 15 degrees, and the threshold for body movement monitoring is set to a body movement of more than 5 cm.

[0138] When the driver detects signs of the passenger waking up, the preset voice prompt will be played automatically, including informing the passenger of the current driver status and guiding the passenger to prepare to take over the vehicle.

[0139] For example, after detecting that the passenger has woken up, a voice message is played: "Please note that the driver is currently unable to drive. Please prepare to take over the vehicle."

[0140] Text prompts are displayed on the vehicle's central control screen to guide passengers on how to adjust their seats and fasten their seat belts. The text prompts provide specific operating steps and a safety checklist.

[0141] For example, the screen reads: "Please adjust your seat to a comfortable position and fasten your seat belt. The seat belt indicator lights up to indicate that it is fastened."

[0142] If the passenger is not detected to be awake within the preset time, the wake-up strategy will be executed cyclically. The wake-up strategy includes gradually increasing sound, seat vibration and light flashing.

[0143] For example, the preset time is set to 5 minutes. If the passenger is not detected to be awake within 5 minutes, the wake-up strategy is restarted, including gradually increasing the volume from 50 decibels to 80 decibels, the seat vibration frequency from 5Hz to 10Hz, and the light brightness from 30% to 100%.

[0144] Continue to monitor the passenger's awakening status until the passenger is fully awake and ready to take over the vehicle. When the passenger is awake and ready to take over, provide final confirmation prompts and operational guidance.

[0145] For example, if a passenger wakes up during the third wake-up strategy execution, the system will detect that the passenger's eye activity and body movement meet the awakening criteria, and then play a voice prompt: "You are now the driver of the vehicle, please check the surrounding environment and prepare to drive." At the same time, the screen will display: "Please confirm that all instruments are normal and prepare to start the vehicle."

[0146] Combine the following Figure 2 The following are some examples of the method for waking up a passenger in a vehicle to take over driving:

[0147] like Figure 2 As shown, the camera in the car is used to identify passengers, automatically synchronize the cloud data about the passengers, and record the sleeping time of the passengers in the car; monitor the driver's status, and trigger the passenger to take over the vehicle process after detecting driver fatigue or sudden discomfort. Comprehensively analyze passenger information, on the basis of satisfying the driving experience greater than 0, calculate the score of each passenger's data according to the information and weight of each passenger, and finally add up the scores of each data to get the comprehensive score of each passenger.

[0148] For example,

[0149]

[0150] For example, passenger A has 5 years of driving experience, which is in the 70-point range, and the weight is 10%, so the score for this item is 70*0.1=7 points.

[0151] Add up the scores of each passenger's data to get a comprehensive score. Then, the priority order of waking up passengers is determined based on the comprehensive scores of each passenger. Assume that the final wake-up order is passenger A>B>C;

[0152] The positions of passengers A, B, and C are determined, and it is detected that the passengers are in a sleeping state.

[0153] Wake up passengers, personalized wake-up method:

[0154] Sound wake-up: The car's audio system pre-stores multiple types of wake-up audio, starting with soft soothing music and gradually transitioning to strong and warning sounds. The volume also increases gradually from low to high to avoid sudden loud noises from scaring passengers, while effectively waking up passengers.

[0155] Vibration wake-up: A vibration device with adjustable intensity is installed in the passenger seat. When passenger A needs to be woken up, the seat of passenger A starts with slight vibration and gradually increases the vibration intensity to stimulate the passenger to wake up through the touch of the body.

[0156] Light wake-up: Use the ambient light and reading light in the car to wake up the passenger by flashing or gradually brightening the ambient light and reading light on the passenger side A. The frequency of light changes and the speed of brightness increase are gradually increased to achieve the best wake-up effect.

[0157] According to the information of different passengers, considering that the difficulty of waking up is related to age and sleep duration, different initial volume, initial seat vibration frequency, initial light brightness and flashing frequency are set for different passengers, and the initial values ​​are obtained according to the table below. The initial values ​​here and in the following sections correspond to the percentage of the maximum value of the corresponding setting item of the vehicle.

[0158] For example,

[0159]

[0160] During the wake-up call, the volume, seat vibration frequency, light brightness and flashing frequency are gradually increased at a rate of 2% per second until reaching 100% or the passenger is detected to be awake;

[0161] Wake up A first. According to the information of passenger A, get the initial volume, initial seat vibration frequency, initial light brightness and flashing frequency, and implement according to this plan. If A is not detected to be awake within 1 minute, implement the plan to wake up passenger B according to the priority order. If passengers A / B / C are not detected to be awake within 1 minute, implement the plan to wake up passenger C. If it is detected that no passenger suitable for taking over has woken up, continue the wake-up process cycle until a passenger suitable for taking over is detected to be awake.

[0162] When it is detected that a passenger suitable for taking over has woken up, the car will remind the current passenger by voice of the current driver's status and ask him to take over the vehicle as soon as possible. At the same time, there will be a corresponding text reminder on the central control screen.

[0163] After detecting that the passenger has begun to take over the vehicle, voice reminders will assist the passenger in adjusting the seat, fastening the seat belt, and completing the takeover.

[0164] This embodiment is described below in conjunction with application scenarios.

[0165] The vehicle was driving on the highway with two passengers. After the passengers got on the vehicle, the in-vehicle camera had identified the passengers and obtained their information from the cloud, and recorded the length of time the passengers slept in the vehicle. The driver had been driving for three consecutive hours. The camera detected that the driver's blinking frequency had significantly decreased, his head had frequently nodded, and the vehicle's driving trajectory began to deviate slightly, indicating that the driver was in a fatigued state.

[0166] At this time, the camera in the car identified two passengers sleeping in the back seat. After analyzing the information obtained, it was found that passenger A was 30 years old, had five years of driving experience, had a safe driving mileage of 2,000 kilometers, had less than three violation records, had no serious accidents, one minor accident, had driving experience in cities, highways, and mountains, and had slept for 100 minutes.

[0167] Passenger B was 60 years old, had ten years of driving experience, a safe mileage of 3,000 kilometers, less than five violation records, no serious accidents, one minor accident, had experience in city and highway driving, and slept for 30 minutes.

[0168] According to the driving data analysis, the comprehensive score of passenger A is 65 points, and the comprehensive score of passenger B is 46.75 points. After comprehensive evaluation, the passengers are selected as the priority wake-up targets. According to the age and sleep duration of the passengers, the analysis shows that the initial wake-up value of passenger A is 62%, and the initial wake-up value of passenger B is 30%;

[0169] First, the car audio system starts playing soft music at 62% of the maximum volume. At the same time, the vibration device of passenger A's seat starts working at 62% of the maximum vibration intensity, and the ambient light on the passenger A side also starts flashing at 62% of the maximum flashing frequency. The brightness of the ambient light and reading light is 62% of the maximum brightness. As time goes by, the music volume, seat vibration intensity, ambient light flashing frequency, ambient light and reading light brightness gradually increase at a rate of 2% per second, up to 100%.

[0170] Within 1 minute, after passenger A is woken up, the system detects that he has woken up through facial expressions and body movements. The system reminds the current passenger of the current driver status and asks him to take over the vehicle as soon as possible, and the central control screen has a corresponding text reminder. After detecting that the passenger has begun to take over the vehicle, the system will assist him in adjusting the seat, fastening the seat belt, and completing the takeover.

[0171] If passenger A is not woken up within 1 minute, passenger B will be woken up, starting with 30% of passenger B's initial wake-up value; if A or B is detected to be awake during the wake-up process, the current passenger will be reminded by voice of the current driver status and to take over the vehicle as soon as possible, and there will be a corresponding text reminder on the central control screen. After detecting that the passenger has begun to take over the vehicle, the voice reminder will assist him to adjust the seat, fasten the seat belt, and complete the takeover. If neither A nor B is woken up, the wake-up cycle will be entered until A or B is detected to be awake.

[0172] For the method steps disclosed in the above embodiments, the method steps are described as a series of action combinations for the purpose of simple description, but those skilled in the art should know that the embodiments of the present invention are not limited by the order of the actions described, because according to the embodiments of the present invention, some steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

[0173] like Figure 3 As shown, the present invention also provides a wake-up system for a passenger in a vehicle to take over driving, comprising:

[0174] The passenger information acquisition module 201 is configured to identify the passenger and record the sleep duration, wherein the cloud data about the corresponding passenger is synchronized and the sleep duration of the corresponding passenger in the vehicle is recorded;

[0175] The state monitoring and takeover triggering module 202 is configured to monitor the driver's state and trigger the takeover process, wherein when the driver's state is monitored to be fatigued or suddenly unwell, the passenger takes over the vehicle process;

[0176] A passenger information analysis module 203 is configured to analyze passenger information and determine a wake-up order, wherein a comprehensive score of each passenger is calculated based on the passenger information, and a priority order of wake-up is determined according to the comprehensive score;

[0177] The takeover prompt and execution module 204 is configured to implement the wake-up strategy and detect the passenger waking up to complete the takeover, wherein after detecting the passenger waking up, the passenger is guided to take over the vehicle through voice and visual prompts and assisted in completing driving preparations.

[0178] It is worth noting that although only some basic functional modules are disclosed in the embodiments of the present invention, it does not mean that the composition of the present system is limited to the above basic functional modules. On the contrary, what the present embodiment wants to express is that on the basis of the above basic functional modules, those skilled in the art can arbitrarily add one or more functional modules in combination with the prior art to form an infinite number of embodiments or technical solutions. In other words, the present system is open rather than closed. Just because the present embodiment only discloses individual basic functional modules, it cannot be considered that the protection scope of the claims of the present invention is limited to the disclosed basic functional modules. At the same time, for the convenience of description, the above devices are described in terms of functions and are described separately in various units and modules. Of course, when implementing the present invention, the functions of each unit and module can be implemented in the same or one or more software and / or hardware.

[0179] like Figure 4As shown, the present invention also provides an electronic device, comprising: a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other through the communication bus; a computer program is stored in the memory, and when the computer program is executed by the processor, the processor executes the steps of the wake-up method for the passenger in the vehicle to take over the driving.

[0180] Figure 4 Schematic diagram of the structure of an electronic device provided by an embodiment of the present invention. Figure 4 The electronic device provided in the embodiment of the present invention includes: one or more processors 710 and a storage device 720; the processor 710 in the electronic device may be one or more, Figure 4 A processor 710 is taken as an example; the storage device 720 is used to store one or more programs; the one or more programs are executed by the one or more processors 710, so that the one or more processors 710 implement the wake-up method for a passenger in a vehicle to take over driving as described in any one of the embodiments of the present invention.

[0181] The electronic device may further include: an input device 730 and an output device 740 .

[0182] The processor 710, storage device 720, input device 730 and output device 740 in the electronic device can be connected via a bus or other means. Figure 4 The example of connecting through bus is taken in the following.

[0183] The storage device 720 in the electronic device is a computer-readable storage medium that can be used to store one or more programs, which can be software programs, computer executable programs and modules, such as the program instructions / modules corresponding to the vehicle passenger takeover driving wake-up method provided in the embodiment of the present invention. The processor 710 executes various functional applications and data processing of the electronic device by running the software programs, instructions and modules stored in the storage device 720, that is, the vehicle passenger takeover driving wake-up method in the above method embodiment is implemented.

[0184] The storage device 720 may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function; the data storage area may store data created according to the use of the electronic device, etc. In addition, the storage device 720 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other non-volatile solid-state storage device. In some instances, the storage device 720 may further include a memory remotely arranged relative to the processor 710, and these remote memories may be connected to the device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0185] The input device 730 may be used to receive input digital or character information and generate key signal input related to user settings and function control of the electronic device. The output device 740 may include a display device such as a display screen.

[0186] The present invention also provides a computer-readable storage medium storing a computer program executable by an electronic device. When the computer program runs on the electronic device, the electronic device executes the steps of a wake-up method for a passenger in a vehicle to take over driving.

[0187] Specifically, the computer storage medium of the embodiment of the present invention can adopt any combination of one or more computer-readable media. The computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. The computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples (non-exhaustive list) of computer-readable storage media include: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present embodiment, the computer-readable storage medium can be any tangible medium containing or storing a program, which can be used by an instruction execution system, device or device or used in combination with it.

[0188] The present invention also provides a vehicle provided with the above-mentioned wake-up system for passengers in the vehicle to take over driving.

[0189] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for waking up a passenger in a vehicle to take over driving, characterized in that: include: The passenger information acquisition step includes identifying the passenger and recording the sleep duration, wherein the cloud data about the corresponding passenger is synchronized and the sleep duration of the corresponding passenger in the vehicle is recorded; The state monitoring and takeover triggering step includes monitoring the driver's state and triggering the takeover process, wherein when the driver's state is detected to be fatigued or suddenly unwell, the passenger takes over the vehicle process; A passenger information analysis step, comprising analyzing the passenger information and determining a wake-up order, wherein a comprehensive score of each passenger is calculated based on the passenger information, and a priority order of wake-up is determined according to the comprehensive score; The takeover prompt and execution steps include implementing a wake-up strategy and detecting that the passenger is awake to complete the takeover, wherein after detecting that the passenger is awake, the passenger is guided to take over the vehicle through voice and visual prompts and assisted in completing driving preparations.

2. The method for waking up a passenger in a vehicle to take over driving according to claim 1, characterized in that: The passenger information acquisition step includes identifying the passenger and recording the sleep duration, wherein synchronizing cloud data about the corresponding passenger and recording the sleep duration of the corresponding passenger in the vehicle further includes: Capturing the facial features of the passenger and comparing them with the information in the cloud to identify the passenger; Synchronize the identified passenger information with cloud data to obtain the passenger's historical driving data and preference settings; Monitor passengers' eye closing time and body movements, and record each passenger's sleep duration; The recorded passenger information and sleep duration are stored in the vehicle's local database.

3. The method for waking up a passenger in a vehicle to take over driving according to claim 1, characterized in that: The state monitoring and takeover triggering step includes monitoring the driver's state and triggering the takeover process, wherein when the driver's state is detected to be fatigued or suddenly unwell, the passenger takeover process is triggered, further including: Monitoring of the driver’s physiological signals, including heart rate monitoring and eye tracking; Analyze the driver's eye movement frequency and head position to determine if the driver is showing signs of fatigue; Monitor the stability of the vehicle's driving trajectory and identify whether there is a slight deviation from the lane; When it is determined that the driver is fatigued or unwell, the process of taking over the vehicle is initiated to prepare to wake up the passengers.

4. The method for waking up a passenger in a vehicle to take over driving according to claim 1, characterized in that: The passenger information analysis step includes analyzing the passenger information and determining the wake-up order, wherein the comprehensive score of each passenger is calculated based on the passenger information, and the priority order of the wake-up is determined according to the comprehensive score, further including: Preset the weights of each passenger's driving age, safe driving mileage, number of violation records, number and severity of accidents, safe driving experience in different road conditions, and sleep duration, where the weight allocation is based on the impact on driving safety and reliability; Calculate each passenger's score on each factor based on their actual data and preset weights; Add up each passenger's scores on each factor to get a comprehensive score for each passenger; The priority order for waking up the passengers is determined based on the comprehensive scores, with the passengers with the highest scores being woken up first.

5. The method for waking up a passenger in a vehicle to take over driving according to claim 1, characterized in that: The takeover prompt and execution step includes implementing a wake-up strategy and detecting the passenger's awakening to complete the takeover, wherein after detecting the passenger's awakening, guiding the passenger to take over the vehicle through voice and visual prompts and assisting him to complete the driving preparation, further including: Selecting the passenger with the highest score as the priority wake-up target according to the comprehensive score; According to the age and sleep duration of the passenger, set the initial volume of the sound wake-up, the initial frequency of the seat vibration, the initial brightness and flashing frequency of the light wake-up; Implementing the wake-up strategy, including gradually increasing sound wake-up, vibration wake-up and light wake-up, until the preset maximum intensity is reached or the passenger wakes up; Monitor the passenger's wakefulness status. When the passenger is awake, assist the passenger to take over the vehicle through voice and screen prompts.

6. The method for waking up a passenger in a vehicle to take over driving according to claim 5, characterized in that: Also includes: Continuously monitor the passenger's facial expressions and body movements to determine whether the passenger has awakened; When the passenger is detected to be awake, a preset voice prompt is played to inform the passenger of the current driver status and guide the passenger to take over the vehicle; Display text prompts to guide passengers on how to adjust their seats and fasten their seat belts to ensure safe control of the vehicle; If the passenger who is to take over is not detected to be awake within the preset time, the wake-up strategy will be executed repeatedly until the passenger wakes up and is ready to take over the vehicle.

7. A wake-up system for a passenger in a vehicle to take over driving, characterized in that: include: A passenger information acquisition module, configured to identify the passenger and record the sleep duration, wherein the cloud data about the corresponding passenger is synchronized and the sleep duration of the corresponding passenger in the vehicle is recorded; A state monitoring and takeover triggering module is configured to monitor the driver's state and trigger the takeover process, wherein when the driver's state is detected to be fatigued or suddenly unwell, the passenger takes over the vehicle process; A passenger information analysis module, configured to analyze passenger information and determine a wake-up order, wherein a comprehensive score of each passenger is calculated based on the passenger information, and a priority order of wake-up is determined according to the comprehensive score; The takeover prompt and execution module is configured to implement the wake-up strategy and detect the passenger waking up to complete the takeover. After detecting that the passenger is awake, the passenger is guided to take over the vehicle through voice and visual prompts and assisted in completing driving preparations.

8. An electronic device, characterized in that: include: A processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus; a computer program is stored in the memory, and when the computer program is executed by the processor, the processor executes the steps of the method described in any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that: It stores a computer program executable by an electronic device, and when the computer program runs on the electronic device, the electronic device executes the steps of the method described in any one of claims 1 to 6.

10. A vehicle, characterized in that: The vehicle is provided with the wake-up system for the in-vehicle passenger to take over driving as claimed in claim 7.

Images