A method, system, and vehicle for waking up passengers to take over driving in a vehicle.

Abstract

This invention relates to the field of vehicle technology and discloses a method, system, electronic device, storage medium, and vehicle for waking up passengers to take over driving in a vehicle. The method includes identifying passengers and recording their sleep duration, synchronizing cloud data about the corresponding passengers, and recording the sleep duration of each passenger in the vehicle; monitoring the driver's status and triggering a takeover process, triggering a passenger takeover process when the driver is detected to be fatigued or experiencing sudden discomfort; analyzing passenger information and determining the wake-up order, calculating a comprehensive score for each passenger based on the passenger information, and determining the priority order of wake-ups according to the comprehensive score; implementing a wake-up strategy and detecting passenger awakening to complete the takeover, guiding the passenger to take over the vehicle through voice and visual cues after passenger awakening, and assisting them in completing driving preparations. This invention can accurately select and promptly wake up suitable passengers to take over the vehicle, and adopts personalized wake-up strategies for corresponding passengers, improving driving safety.

Description

Technical Field

[0001] This invention relates to the field of vehicle technology, and in particular to a method, system, electronic device, storage medium, and vehicle for waking up a passenger to take over driving in a vehicle. Background Technology

[0002] Currently, in scenarios where a sleeping passenger needs to be woken up to take over the vehicle due to driver fatigue or sudden discomfort, a common approach is to attempt to wake the passenger with a simple audible alarm. For example, the vehicle may be equipped with a basic voice alert system that sounds an alarm to try and wake the passenger when driver fatigue or sudden discomfort is detected. Another approach is to utilize the vibration function of the vehicle's seats. Slight vibrations from the seats are used to attract the passenger's attention. Some vehicle systems also attempt to wake the passenger by flashing interior lights, but this method is usually relatively simple and has limited effectiveness.

[0003] Problems with existing technology:

[0004] 1. Limited and ineffective wake-up methods: Existing audible alarms are often monotonous warning sounds, easily ignored or adapted to by passengers, leading to wake-up failures. The intensity and pattern of seat vibrations and flashing lights are also relatively fixed, making it difficult to effectively wake passengers in deep sleep.

[0005] 2. Lack of precise passenger selection: Current technology does not consider individual differences among passengers, such as age, driving experience, and rest status, when waking them up. This may result in randomly waking up unsuitable passengers, leading to reduced safety and reliability of vehicle takeover.

[0006] Therefore, this application provides a method for waking up a passenger taking over driving in a vehicle to solve the above-mentioned technical problems. Summary of the Invention

[0007] The purpose of this invention is to provide a method, system, electronic device, storage medium, and vehicle for waking up passengers who take over driving in a vehicle, in order to solve the technical problems of the inability to accurately select the passengers to be woken up and the limited number of wake-up methods in the prior art.

[0008] To address the aforementioned technical problems, the present invention provides a method for waking up a passenger taking over driving in a vehicle, comprising:

[0009] The passenger information acquisition steps include identifying passengers and recording sleep duration, wherein cloud data about the corresponding passenger is synchronized and the sleep duration of the corresponding passenger in the vehicle is recorded;

[0010] The status monitoring and takeover triggering steps include monitoring the driver's status and triggering the takeover process, wherein when the driver's status is detected as fatigued or suddenly unwell, the passenger takeover process is triggered.

[0011] The passenger information analysis step includes analyzing passenger information and determining the wake-up order, wherein, based on the passenger information, a comprehensive score is calculated for each passenger, and the priority order for waking up is determined according to the comprehensive score;

[0012] The takeover prompts and execution steps include implementing a wake-up strategy and detecting passenger awakening to complete the takeover. Specifically, after detecting passenger awakening, the passenger is guided to take over the vehicle through voice and visual cues and assisted in completing driving preparations.

[0013] In some specific embodiments, the passenger information acquisition step includes identifying passengers and recording sleep duration, wherein synchronizing cloud data about the corresponding passenger and recording the sleep duration of the corresponding passenger in the vehicle further includes:

[0014] The system captures passengers' facial features and compares them with information in the cloud to identify passengers.

[0015] The identified passenger information is synchronized with cloud data to obtain the passenger's historical driving data and preference settings;

[0016] Monitor the duration of passengers' closed eyes and body movements, and record the sleep duration of each passenger;

[0017] Recorded passenger information and sleep duration are stored in the vehicle's local database.

[0018] In some specific embodiments, the status monitoring and takeover triggering step includes monitoring the driver's status and triggering a takeover process, wherein when the driver's status is detected as fatigued or experiencing sudden discomfort, triggering a passenger takeover process further includes:

[0019] Monitor the driver's physiological signals, including heart rate monitoring and eye tracking;

[0020] Analyze the driver's eye movement frequency and head position to determine if the driver is showing signs of fatigue;

[0021] Monitor the stability of the vehicle's driving trajectory and identify any slight deviations from the lane;

[0022] When it is determined that the driver is fatigued or unwell, the process of taking over the vehicle is initiated, and preparations are made to wake up the passengers.

[0023] In some specific embodiments, the passenger information analysis step includes analyzing passenger information and determining the wake-up order, wherein, based on the passenger information, a comprehensive score is calculated for each passenger, and the priority order for waking up is determined according to the comprehensive score, further including:

[0024] The system pre-determines the weights of each passenger's driving experience, safe driving mileage, number of violations, number and severity of accidents, safe driving experience under different road conditions, and sleep duration. The weight allocation is based on the impact on driving safety and reliability.

[0025] Based on each passenger's actual data and preset weights, calculate each passenger's score on each factor;

[0026] The scores of each passenger on each factor are added together to obtain the overall score for each passenger;

[0027] Based on the overall score, the priority order for waking up passengers is determined, with the passenger with the highest score being woken up first.

[0028] In some specific embodiments, the takeover prompting and execution steps include implementing a wake-up strategy and detecting passenger awakening to complete the takeover. Upon detecting passenger awakening, the passenger is guided to take over the vehicle via voice and visual cues, and assisted in completing driving preparations. Further steps include:

[0029] The passenger with the highest overall score will be the priority to be woken up.

[0030] Based on the passenger's age and sleep duration, set the initial volume of the sound wake-up call, the initial frequency of the seat vibration, and the initial brightness and flashing frequency of the light wake-up call.

[0031] The wake-up strategy includes gradually increasing sound wake-up, vibration wake-up, and light wake-up until a preset maximum intensity is reached or the passenger wakes up.

[0032] The system monitors the passenger's awakening status and, upon detecting that the passenger is awake, assists the passenger in taking over the vehicle through voice and screen prompts.

[0033] In some specific embodiments, it also includes:

[0034] Continuously monitor passengers' facial expressions and body movements to determine whether they have regained consciousness;

[0035] When a passenger is detected to be awake, a preset voice prompt is played to inform the passenger of the current driver status and guide the passenger to take over the vehicle.

[0036] Display text prompts to guide passengers on how to adjust their seats and fasten their seat belts to ensure safe takeover of the vehicle;

[0037] If the passenger to be taken over is not detected to have woken up within the preset time, the wake-up strategy will be executed repeatedly until the passenger wakes up and is ready to take over the vehicle.

[0038] Based on the same concept, the present invention also provides a wake-up system for passenger takeover of driving in a vehicle, comprising:

[0039] The passenger information acquisition module is configured to identify passengers and record their sleep duration, wherein it synchronizes cloud data about the corresponding passenger and records the sleep duration of the corresponding passenger in the vehicle;

[0040] The status monitoring and takeover triggering module is configured to monitor the driver's status and trigger the takeover process. Specifically, when the driver's status is detected as fatigued or suddenly unwell, the passenger takeover process is triggered.

[0041] The passenger information analysis module is configured to analyze passenger information and determine the wake-up order, wherein, based on the passenger information, a comprehensive score is calculated for each passenger, and the priority order of wake-up is determined according to the comprehensive score;

[0042] The takeover prompt and execution module is configured to implement a wake-up strategy and detect when the passenger is awake to complete the takeover. Specifically, after detecting that the passenger is awake, the module guides the passenger to take over the vehicle through voice and visual prompts and assists the passenger in completing driving preparations.

[0043] Based on the same concept, the present invention also provides an electronic device, including: a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other through the communication bus; the memory stores a computer program, and when the computer program is executed by the processor, the processor performs the steps of a method for waking up a passenger taking over driving in a vehicle.

[0044] Based on the same concept, the present invention also provides a computer-readable storage medium storing a computer program executable by an electronic device, which, when run on the electronic device, causes the electronic device to perform the steps of a method for waking up a passenger to take over driving in a vehicle.

[0045] Based on the same concept, the present invention also provides a vehicle equipped with a wake-up system for passenger takeover of driving as described above.

[0046] Compared with existing technologies, its advantages are as follows:

[0047] This invention discloses a method, system, electronic device, storage medium, and vehicle for waking up passengers to take over driving in a vehicle. It can accurately select and wake up the appropriate passenger to take over the vehicle in a timely manner, and adopt a personalized wake-up strategy for the corresponding passenger to improve driving safety. Attached Figure Description

[0048] Figure 1 This is a flowchart illustrating some specific embodiments of the method for waking up a passenger taking over driving in a vehicle according to the present invention.

[0049] Figure 2This is a flowchart illustrating the method for waking up a passenger taking over driving in a vehicle according to the present invention in some applications.

[0050] Figure 3 This is a schematic diagram of the structure of a wake-up system for passenger takeover of driving in a vehicle according to some specific embodiments of the present invention;

[0051] Figure 4 This is a schematic diagram of the structure of an electronic device according to some specific embodiments of the present invention. Detailed Implementation

[0052] To make the objectives, technical solutions, and advantages of this application clearer, the application will be further described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0053] The terminology used in the embodiments of this application is for the purpose of describing particular embodiments only and is not intended to limit the application. The singular forms “a,” “said,” and “the” used in the embodiments of this application and the appended claims are also intended to include the plural forms, and “multiple” generally includes at least two unless the context clearly indicates otherwise.

[0054] It should be understood that the term "and / or" used in this article is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Additionally, the character " / " in this article generally indicates that the preceding and following related objects have an "or" relationship.

[0055] It should be understood that although the terms first, second, third, etc., may be used in the embodiments of this application, these descriptions should not be limited to these terms. These terms are only used to distinguish the descriptions. For example, first may also be referred to as second without departing from the scope of the embodiments of this application, and similarly, second may also be referred to as first.

[0056] Depending on the context, the words “if” or “suppose” as used here can be interpreted as “when” or “in response to determination” or “in response to detection.” Similarly, depending on the context, the phrases “if determination” or “if detection (of the stated condition or event)” can be interpreted as “when determination” or “in response to determination” or “when detection (of the stated condition or event)” or “in response to detection (of the stated condition or event).”

[0057] It should also be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that an article or device that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such an article or device. Without further limitation, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the article or device that includes said element.

[0058] It should be noted that any symbols and / or numbers present in the specification that are not marked in the accompanying drawings are not reference numerals.

[0059] Reference Figure 1 A method for waking up a passenger in a vehicle to take over driving includes:

[0060] S101, Passenger information acquisition step, including identifying passengers and recording sleep duration, wherein cloud data about the corresponding passenger is synchronized and the sleep duration of the corresponding passenger in the vehicle is recorded;

[0061] Understandably, this step uses in-vehicle cameras and image processing, as well as synchronization with cloud data, to collect and store relevant passenger information.

[0062] In some of these applications, passengers are identified and their sleep duration is recorded. Cloud data about the corresponding passengers is synchronized, and the passenger's sleep duration in the vehicle is recorded. The passenger's facial features are captured and compared with information in the cloud to identify the passenger. The identified passenger information is synchronized with cloud data to obtain the passenger's historical driving data and preference settings. The duration of the passenger's closed eyes and body movements are monitored, and the sleep duration of each passenger is recorded. The recorded passenger information and sleep duration are stored in the vehicle's local database.

[0063] Understandably, when a passenger enters the vehicle and sits down, the in-vehicle camera automatically activates and begins capturing the passenger's facial features. The captured images are analyzed to extract key facial feature points. These extracted feature points are then matched against a pre-stored passenger information database to identify the passenger. Once a passenger is identified, their driving history, preferences, and other relevant information are retrieved from the cloud. All acquired information is synchronized to the vehicle system for use in subsequent steps.

[0064] For example, passenger Mr. Zhang enters the vehicle and sits in the front passenger seat. The in-car camera captures Mr. Zhang's facial image, and by comparing it with facial feature points in the database, successfully identifies Mr. Zhang. Subsequently, Mr. Zhang's driving preferences (such as seat position, music selection, etc.) and safe driving records are downloaded from the cloud.

[0065] Once a passenger is identified, their eyes-closed state and body movements are monitored to determine if they are asleep. The passenger's sleep state is determined by analyzing eye movements and head position changes. Once sleep is confirmed, sleep duration is recorded. Sleep duration data is updated in real time and stored in the vehicle's local database for subsequent analysis and use.

[0066] For example, if passenger Ms. Li starts to doze off 30 minutes into the journey, her sleep status is confirmed by analyzing her closed eyes and head position. The time Ms. Li fell asleep is recorded, and a timer is started. Ms. Li's sleep status is continuously monitored throughout the journey until she wakes up. If Ms. Li sleeps for 90 minutes, her total sleep duration is recorded as 90 minutes, and the relevant information in the database is updated.

[0067] All passenger sleep duration data and identification information are encrypted and stored in the vehicle's local database. Simultaneously, the data is synchronized to the cloud to ensure security and accessibility. The integrity and accuracy of the data are regularly checked to ensure accurate retrieval when needed.

[0068] For example, passenger Mr. Wang slept for two hours during a long journey. His sleep duration was recorded, and this data was synced to the cloud after the vehicle arrived at its destination. The data can be used to analyze Mr. Wang's fatigue level and provide more personalized services for future journeys, such as adjusting wake-up strategies or reminding him to rest.

[0069] S102, Status monitoring and takeover triggering steps, including monitoring the driver's status and triggering the takeover process, wherein when the driver's status is detected as fatigued or suddenly unwell, the passenger takeover process is triggered.

[0070] Understandably, this step is used to monitor the driver's physiological signals and driving behavior, and how to trigger a passenger takeover process when driver fatigue or sudden discomfort is detected.

[0071] In some of these applications, the driver's condition is monitored and a takeover process is triggered. When the driver is detected to be fatigued or experiencing sudden discomfort, the passenger takeover process is initiated. This process involves monitoring the driver's physiological signals, including heart rate monitoring and eye tracking; analyzing the driver's eye movement frequency and head position to determine if the driver is showing signs of fatigue; monitoring the stability of the vehicle's trajectory to identify any slight deviations from the lane; and initiating the takeover process when the driver is determined to be fatigued or unwell, preparing to wake the passenger.

[0072] Understandably, physiological sensors installed inside the vehicle, such as heart rate monitors and eye-tracking cameras, are used to monitor the driver's physiological signals in real time. The heart rate monitor connects wirelessly to the driver's smartwatch or a dedicated sensor to transmit heart rate data in real time. The eye-tracking camera captures the driver's eye movements, including blink frequency and eye movements.

[0073] For example, the normal heart rate range is set to 60-100 beats per minute. When the driver's heart rate is consistently above 100 beats per minute, it is recorded as a possible sign of fatigue. The eye-tracking camera is set to 1080p resolution and 30fps to ensure clear capture of eye movements.

[0074] Eye-tracking data is used to analyze the driver's blink frequency and eye movement patterns. Head position sensors are used to monitor changes in the driver's head tilt angle and position. The data is analyzed to determine if the driver is experiencing signs of fatigue, such as frequent blinking, prolonged eye closure, or frequent forward head tilting.

[0075] For example, a normal blinking frequency is set at 15-20 times per minute. If the driver's blinking frequency drops below 10 times per minute and persists for more than 2 minutes, it is considered a sign of fatigue. Similarly, if the head position sensor detects a forward head tilt angle exceeding 15 degrees for more than 10 seconds, this is also recorded as a sign of fatigue.

[0076] Use the vehicle's navigation system and lane keeping assist system to monitor the vehicle's trajectory and lane position. Analyze whether the vehicle frequently deviates slightly from its lane, such as swaying left and right within the lane or frequently approaching the lane lines.

[0077] For example, the normal deviation range of a vehicle within the lane is set to ±0.5 meters. If a vehicle crosses the lane line 3 times within 10 seconds and the deviation exceeds 0.5 meters, it is recorded as an unstable driving trajectory.

[0078] When a comprehensive assessment determines that the driver is fatigued or unwell, the system automatically initiates a takeover process. First, the driver is warned to rest or find a safe place to park via the in-vehicle display and voice prompts. If the driver does not respond or is unable to continue driving, the system prepares to wake the passengers using the in-vehicle wake-up system (such as sound, vibration, or lights).

[0079] For example, after detecting signs of driver fatigue, the driver is first given a 2-minute warning period. If the driver does not take action, a passenger wake-up procedure will begin in the 3rd minute. The passenger wake-up procedure includes a gradually increasing volume audible prompt, starting at 50 decibels and increasing by 5 decibels every 10 seconds until it reaches 80 decibels or the passenger is awakened.

[0080] S103, Passenger information analysis step, including analyzing passenger information and determining the wake-up order, wherein, based on the passenger information, a comprehensive score is calculated for each passenger, and the priority order of wake-up is determined according to the comprehensive score;

[0081] Understandably, when a driver is unable to continue driving due to fatigue or sudden illness, it is necessary to quickly identify the most suitable passenger to take over the vehicle. This step involves analyzing passenger information, calculating a comprehensive score for each passenger, and determining the priority order for waking them up based on the score.

[0082] In some applications, passenger information is analyzed to determine the wake-up order. Based on the passenger information, a comprehensive score is calculated for each passenger, and the priority order for waking up is determined according to the comprehensive score. Preset weights are given to factors such as each passenger's driving experience, safe driving mileage, number of traffic violations, number and severity of accidents, safe driving experience under different road conditions, and sleep duration. The weight allocation is based on the impact on driving safety and reliability. Based on each passenger's actual data and the preset weights, a score for each passenger on each factor is calculated. The scores of each passenger on each factor are added together to obtain each passenger's comprehensive score. Based on the comprehensive score, the priority order for waking up passengers is determined, prioritizing the passenger with the highest score.

[0083] Understandably, based on the impact on driving safety and reliability, weights are preset for each passenger's driving experience, safe driving mileage, number of violations, number and severity of accidents, safe driving experience under different road conditions, and sleep duration.

[0084] The weights are allocated as follows:

[0085] Driving experience: 10%;

[0086] Safe driving mileage: 20%;

[0087] Number of violations: 20%;

[0088] Number and severity of accidents: 25%;

[0089] Safe driving experience under different road conditions: 10%;

[0090] Sleep duration: 15%.

[0091] For example, 100 points are allocated to passengers with more than 10 years of driving experience, 70 points to those with 5-10 years of experience, 50 points to those with 1-5 years of experience, 20 points to those with 0-1 years of experience, and 0 points to those with 0 years of experience.

[0092] Based on each passenger's actual data and preset weights, a score for each passenger on each factor is calculated.

[0093] The calculation method is as follows:

[0094] Driving experience score = Driving experience score * weight;

[0095] Safe driving mileage score = Safe driving mileage (km) * 0.01;

[0096] Score for number of violations = 100 - (number of violations * 10);

[0097] Accident frequency and severity score = (100 - number of serious accidents * 30) - number of minor accidents * 10;

[0098] Safe driving experience score for different road conditions = score allocated according to experience type;

[0099] Sleep duration score = (200 - sleep duration (minutes)) * 0.5.

[0100] For example, passenger A has 10 years of driving experience, 20,000 kilometers of safe driving mileage, no violation records, no accidents, experience in urban and highway driving, and sleeps for 120 minutes.

[0101] Passenger A's driving experience score = 100 * 0.1 = 10 points;

[0102] Safe driving mileage score = 20000 * 0.01 = 200 points;

[0103] Number of violations = 100 * 0.2 = 20 points;

[0104] Number of accidents and severity score = 100 * 0.25 = 25 points;

[0105] Score for safe driving experience under different road conditions = 100 * 0.1 = 10 points;

[0106] Sleep duration score = (200-120)*0.5 = 40 points.

[0107] Each passenger's scores on each factor are summed to obtain a comprehensive score. Based on the comprehensive score, the priority order for waking up passengers is determined.

[0108] For example, passenger A's overall score = 10 + 200 + 20 + 25 + 10 + 40 = 315 points;

[0109] Passenger B's total score = 85 + 180 + 20 + 15 + 5 + 30 = 335 points;

[0110] Based on the scores, passenger B has a higher priority than passenger A.

[0111] Based on the calculated overall score, passengers are prioritized for wake-up calls, ranked from highest to lowest. Passengers with the highest scores are given priority for waking up to ensure driving safety and reliability.

[0112] For example, if passenger B's overall score is 335, passenger A's is 315, and passenger C's is 280, then the wake-up order is B>A>C.

[0113] S104, Takeover prompts and execution steps, including implementing a wake-up strategy and detecting passenger awakening to complete the takeover, wherein, after detecting passenger awakening, the passenger is guided to take over the vehicle through voice and visual prompts and assisted in completing driving preparations.

[0114] Understandably, this step is used to implement a wake-up strategy, detect when a passenger is awake, and guide the passenger through the process of taking over the vehicle.

[0115] In some applications, a wake-up strategy is implemented and passenger awakening is detected to facilitate takeover. Upon detection, the passenger is guided to take over the vehicle via voice and visual cues, and assisted in completing driving preparations. The passenger with the highest overall score is selected as the priority wake-up target. The initial volume of the sound wake-up, the initial frequency of seat vibration, and the initial brightness and flashing frequency of the lights are set according to the passenger's age and sleep duration. The wake-up strategy is implemented, including gradually increasing sound, vibration, and light wake-up until the preset maximum intensity is reached or the passenger is awakened. The passenger's awakening status is monitored, and when awakening is detected, voice and screen prompts assist the passenger in taking over the vehicle.

[0116] Understandably, based on each passenger's overall score, the passenger with the highest score is selected as the priority for waking up. The overall score takes into account factors such as the passenger's driving experience, safe driving mileage, number of traffic violations, number and severity of accidents, safe driving experience in different road conditions, and sleep duration.

[0117] For example, passenger D has a total score of 350, passenger E has 300, and passenger F has 280. The system selects passenger D as the priority to be woken up.

[0118] Based on the selected passenger's age and sleep duration, set the initial volume of the sound wake-up call, the initial frequency of the seat vibration, and the initial brightness and flashing frequency of the light wake-up call.

[0119] The initial parameters are set as follows:

[0120] Voice wake-up: The initial volume is 60% of the maximum volume, if the passenger is between 18 and 30 years old and has been asleep for less than 2 hours.

[0121] Seat vibration: The initial frequency is 50% of the maximum frequency, if the passenger is between 31 and 50 years old and sleeps for 2-4 hours.

[0122] Light wake-up: Initial brightness is 40% of maximum brightness, and flashing frequency is 30% of maximum frequency. If the passenger is 51 years or older and has been asleep for more than 4 hours.

[0123] For example, passenger D is 28 years old and sleeps for 1.5 hours. The initial volume is set to 60%, the initial seat vibration frequency to 50%, the initial light brightness to 40%, and the initial light flashing frequency to 30%.

[0124] Implement wake-up strategies, including gradually increasing volume of sound, vibration, and light.

[0125] The enhancement process of the wake-up strategy is as follows:

[0126] Voice wake-up call: The volume increases by 5% every 10 seconds until it reaches the maximum volume or the passenger wakes up.

[0127] Seat vibration: The vibration frequency increases by 5% every 10 seconds until it reaches the maximum frequency or the passenger wakes up.

[0128] Light wake-up: Brightness increases by 5% and flashing frequency increases by 5% every 10 seconds, until maximum brightness and maximum flashing frequency are reached or the passenger wakes up.

[0129] For example, a wake-up strategy is implemented with an initial volume of 60%, increasing by 5% every 10 seconds until passenger D wakes up at 80%.

[0130] Monitor passengers' wakefulness, including facial expressions, body movements, and biosignals.

[0131] When a passenger is detected to be awake, voice and screen prompts will assist the passenger in taking over the vehicle.

[0132] Voice prompts include instructing passengers to adjust their seat positions, fasten their seat belts, and check the surrounding environment of the vehicle.

[0133] The screen displays the vehicle's current status, speed, navigation information, etc.

[0134] For example, passenger D wakes up when the volume reaches 75%, the seat vibration frequency reaches 55%, the light brightness reaches 45%, and the light flashing frequency reaches 35%. A voice prompt will say, "Hello, passenger D, you are now the driver of the vehicle. Please adjust your seat and fasten your seatbelt." Simultaneously, the screen will display, "Please check the surrounding environment and prepare to take over the vehicle."

[0135] Some of these applications also include continuously monitoring passengers' facial expressions and body movements to determine if they have woken up; when a passenger is detected to be awake, a preset voice prompt is played to inform the passenger of the current driver status and guide the passenger to take over the vehicle; text prompts are displayed to guide the passenger on how to adjust the seat and fasten the seat belt to ensure safe takeover of the vehicle; if the passenger is not detected to be awake within a preset time, the wake-up strategy is repeated until the passenger is awake and ready to take over the vehicle.

[0136] Understandably, in-vehicle cameras and biosensors are used to continuously monitor passengers' facial expressions and body movements. The system analyzes passengers' eye movements, head posture, and body movements to determine if they are awake.

[0137] For example, the threshold for eye movement monitoring can be set to at least 10 blinks per minute, the threshold for head posture monitoring can be set to a change in head position of more than 15 degrees, and the threshold for body movement monitoring can be set to a movement of more than 5 centimeters.

[0138] When signs of a passenger regaining consciousness are detected, a pre-set voice prompt will play automatically. The voice prompt includes informing the passenger of the current driver status and guiding the passenger to prepare to take over the vehicle.

[0139] For example, after detecting that a passenger has woken up, an audio message is played: "Please note that the driver is currently unable to drive. Please prepare to take over the vehicle."

[0140] The vehicle's central control screen displays text prompts instructing passengers on how to adjust their seats and fasten their seatbelts. The text prompts provide specific operating steps and a safety checklist.

[0141] For example, the screen displays: "Please adjust your seat to a comfortable position and fasten your seatbelt. The seatbelt indicator light is on to show that you are fastened."

[0142] If no passenger is detected waking up within a preset time, the wake-up strategy will be executed repeatedly. The wake-up strategy includes gradually increasing volume, seat vibration, and flashing lights.

[0143] For example, a preset time of 5 minutes can be set. If the passenger is not detected to be awake within 5 minutes, the wake-up strategy is restarted, including gradually increasing the volume from 50 decibels to 80 decibels, gradually increasing the seat vibration frequency from 5 Hz to 10 Hz, and gradually increasing the light brightness from 30% to 100%.

[0144] Continuously monitor the passenger's awakening status until the passenger is fully awake and ready to take over the vehicle. Once the passenger is awake and ready to take over, provide final confirmation and operational instructions.

[0145] For example, a passenger wakes up during the third wake-up call. The system detects that the passenger's eye movements and body movements meet the wake-up criteria, and then plays a voice prompt: "You are now the driver of the vehicle. Please check your surroundings and prepare to drive." Simultaneously, the screen displays: "Please confirm all instruments are functioning correctly and prepare to start the vehicle."

[0146] The following is combined with Figure 2 This invention illustrates embodiments of the passenger-in-vehicle takeover driving method in some applications:

[0147] like Figure 2 As shown, the system uses in-vehicle cameras to identify passengers, automatically synchronizing cloud data about each passenger and recording their sleep duration. It also monitors the driver's condition, triggering a passenger takeover process upon detecting driver fatigue or sudden discomfort. By comprehensively analyzing passenger information, and assuming a driving experience greater than 0, the system calculates a score for each passenger's data points based on their information and weights. Finally, the scores are summed to obtain a comprehensive score for each passenger.

[0148] For example,

[0149]

[0150] For example, if passenger A has 5 years of driving experience, which falls within the 70-point range and has a weight of 10%, then the score for this item would be 70 * 0.1 = 7 points.

[0151] The scores for each passenger's data points are summed to obtain a comprehensive score. Then, based on each passenger's comprehensive score, the order in which passengers are woken up is determined. Let's assume the final wake-up order is passenger A > B > C;

[0152] The locations of passengers A, B, and C were determined, and it was detected that the passengers were asleep.

[0153] Personalized wake-up methods for passengers:

[0154] Voice wake-up: The in-car audio system pre-stores various types of wake-up audio, starting with gentle, soothing music and gradually transitioning to a strong and alarming sound. The volume also gradually increases from low to high to avoid startling passengers with sudden loud noises, while effectively waking them up.

[0155] Vibration wake-up: An adjustable vibration device is installed in the passenger seat. When it is necessary to wake up passenger A, the seat of passenger A will start with a slight vibration and gradually increase the intensity of the vibration to wake up the passenger through physical stimulation.

[0156] Light-based wake-up call: Using the ambient lighting and reading lights inside the vehicle, the ambient lighting and reading lights on passenger A's side are activated by flashing or gradually increasing in brightness. The frequency and rate of increase in light intensity are gradually increased to achieve the best wake-up effect.

[0157] Considering the difficulty of waking up passengers, their age, and sleep duration, different initial wake-up volume, initial seat vibration frequency, initial light brightness, and flashing frequency are set for different passengers, as shown in the table below. These initial values, and those thereafter, correspond to a percentage of the maximum value for the respective vehicle settings.

[0158] For example,

[0159]

[0160] During the wake-up call process, the volume, seat vibration frequency, light brightness, and flashing frequency are gradually increased by 2% per second until they reach 100% or the passenger is detected to be awake.

[0161] Prioritize waking up passenger A. Based on passenger A's information, obtain the initial volume level, initial seat vibration frequency, initial light brightness, and flashing frequency, and implement this plan accordingly. If passenger A is not detected to be awake within 1 minute, then implement the plan to wake up passenger B according to priority order. If passenger A / B / C are not detected to be awake within 1 minute, then implement the plan to wake up passenger C. If no suitable passenger is detected to be awake, continue the wake-up process loop until a suitable passenger is detected to be awake.

[0162] Once a passenger deemed suitable for takeover is detected to have awakened, a voice prompt will remind the passenger of the current driver's status and to take over the vehicle as soon as possible, while a corresponding text prompt will appear on the central control screen.

[0163] Once the system detects that a passenger has begun to take over the vehicle, a voice prompt will assist them in adjusting their seat and fastening their seatbelt to complete the takeover.

[0164] The following description of this embodiment is based on an application scenario.

[0165] The vehicle was traveling on the highway with two passengers. Since the passengers boarded, the in-vehicle camera had identified them and retrieved their information from the cloud, recording their sleep duration. The driver had been driving continuously for three hours. The system detected a significant decrease in the driver's blinking frequency, frequent head nodding, and a slight deviation from the vehicle's trajectory, indicating that the driver was fatigued.

[0166] At this time, the in-car camera detected that two passengers were asleep in the back seat. Analyzing the information obtained, passenger A was 30 years old, had five years of driving experience, 2,000 kilometers of safe driving mileage, less than 3 violations, no serious accidents, 1 minor accident, and had driving experience in urban areas, highways, and mountainous areas. He had been asleep for 100 minutes.

[0167] Passenger B is 60 years old, has ten years of driving experience, 3,000 kilometers of safe driving mileage, less than 5 traffic violations, no serious accidents, 1 minor accident, and has experience driving in urban areas and on highways. He fell asleep for 30 minutes.

[0168] Based on driving data analysis, passenger A scored 65 points and passenger B scored 46.75 points. After comprehensive evaluation, these passengers were selected as priority wake-up targets. Based on the passengers' age and sleep duration, the initial wake-up value for passenger A was 62%, and for passenger B, it was 30%.

[0169] First, the car's audio system begins playing soft music at 62% of its maximum volume. Simultaneously, the vibration mechanism on passenger A's seat activates, operating at 62% of its maximum vibration intensity. The ambient light on passenger A's side also begins flashing at 62% of its maximum flashing frequency, and the brightness of both the ambient light and reading light reaches 62% of their maximum brightness. Over time, the music volume, seat vibration intensity, ambient light flashing frequency, and brightness of both the ambient light and reading light gradually increase by 2% per second, reaching a maximum of 100%.

[0170] Within one minute, passenger A was awakened and detected by the system through facial expressions and body movements. A voice prompt reminded the passenger of the current driver status and urged them to take over the vehicle as soon as possible, while a corresponding text prompt appeared on the central control screen. Once the system detected the passenger beginning to take over the vehicle, voice prompts assisted them in adjusting their seat and fastening their seatbelt to complete the takeover.

[0171] If passenger A is not woken up within 1 minute, the process begins waking passenger B, starting at 30% of passenger B's initial wake-up threshold. If either A or B is detected to be awake during the wake-up process, a voice prompt will remind the passenger of their current driver status and urge them to take over the vehicle as soon as possible, while a corresponding text prompt will appear on the central control screen. Once a passenger is detected to have taken over the vehicle, a voice prompt will assist them in adjusting their seat and fastening their seatbelt to complete the takeover. If neither A nor B is awakened, the wake-up loop continues until either A or B is detected to be awake.

[0172] For the purpose of simplicity, the method steps disclosed in the above embodiments are described as a series of actions. However, those skilled in the art should understand that the embodiments of the present invention are not limited to the described order of actions, because according to the embodiments of the present invention, some steps can be performed in other orders or simultaneously. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily essential to the embodiments of the present invention.

[0173] like Figure 3 As shown, the present invention also provides a wake-up system for passenger takeover of driving in a vehicle, comprising:

[0174] The passenger information acquisition module 201 is configured to identify passengers and record their sleep duration, wherein it synchronizes cloud data about the corresponding passenger and records the sleep duration of the corresponding passenger in the vehicle;

[0175] The status monitoring and takeover triggering module 202 is configured to monitor the driver's status and trigger the takeover process. When the driver's status is detected to be fatigued or suddenly unwell, the passenger takeover process is triggered.

[0176] The passenger information analysis module 203 is configured to analyze passenger information and determine the wake-up order, wherein, based on the passenger information, a comprehensive score is calculated for each passenger, and the priority order of wake-up is determined according to the comprehensive score;

[0177] The takeover prompt and execution module 204 is configured to implement a wake-up strategy and detect when the passenger is awake to complete the takeover. After detecting that the passenger is awake, the module guides the passenger to take over the vehicle through voice and visual prompts and assists the passenger in completing driving preparations.

[0178] It is worth noting that although only some basic functional modules are disclosed in the embodiments of this invention, it does not mean that the composition of this system is limited to the above-mentioned basic functional modules. On the contrary, what this embodiment intends to express is that, based on the above-mentioned basic functional modules, those skilled in the art can arbitrarily add one or more functional modules in combination with existing technology to form an infinite number of embodiments or technical solutions. That is to say, this system is open rather than closed. The fact that this embodiment only discloses a few basic functional modules should not be considered as the scope of protection of the claims of this invention being limited to the disclosed basic functional modules. At the same time, for the convenience of description, the above device is described separately according to its functions as various units and modules. Of course, in implementing this invention, the functions of each unit and module can be implemented in one or more software and / or hardware.

[0179] like Figure 4As shown, the present invention also provides an electronic device, including: a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other through the communication bus; the memory stores a computer program, and when the computer program is executed by the processor, the processor performs the steps of a method for waking up a passenger taking over driving in a vehicle.

[0180] Figure 4 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present invention. For example... Figure 4 The structure shown in this embodiment of the invention includes an electronic device comprising one or more processors 710 and a storage device 720; the processors 710 in this electronic device may be one or more. Figure 4 Taking a processor 710 as an example; a storage device 720 is used to store one or more programs; the one or more programs are executed by the one or more processors 710, causing the one or more processors 710 to implement the wake-up method for passenger takeover of driving in a vehicle as described in any one embodiment of the present invention.

[0181] The electronic device may also include an input device 730 and an output device 740.

[0182] The processor 710, storage device 720, input device 730, and output device 740 in this electronic device can be connected via a bus or other means. Figure 4 Taking the example of a connection between China and Israel via a bus.

[0183] The storage device 720 in this electronic device serves as a computer-readable storage medium, capable of storing one or more programs. These programs can be software programs, computer-executable programs, and modules, such as the program instructions / modules corresponding to the in-vehicle passenger takeover driving wake-up method provided in this embodiment of the invention. The processor 710 executes various functional applications and data processing of the electronic device by running the software programs, instructions, and modules stored in the storage device 720, thereby implementing the in-vehicle passenger takeover driving wake-up method in the above-described method embodiment.

[0184] Storage device 720 may include a program storage area and a data storage area. The program storage area may store the operating system and applications required for at least one function; the data storage area may store data created based on the use of the electronic device. Furthermore, storage device 720 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other non-volatile solid-state storage device. In some instances, storage device 720 may further include memory remotely located relative to processor 710, which can be connected to the device via a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

[0185] Input device 730 can be used to receive input digital or character information, and to generate key signal inputs related to user settings and function control of the electronic device. Output device 740 may include display devices such as a display screen.

[0186] The present invention also provides a computer-readable storage medium storing a computer program executable by an electronic device, which, when run on the electronic device, causes the electronic device to perform the steps of a wake-up method for a passenger taking over driving in a vehicle.

[0187] Specifically, the computer storage medium in this embodiment of the invention can be any combination of one or more computer-readable media. The computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. For example, a computer-readable storage medium can be—but is not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of computer-readable storage media (a non-exhaustive list) include: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this embodiment, the computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.

[0188] The present invention also provides a vehicle equipped with a wake-up system for passenger takeover of driving as described above.

[0189] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for waking up a passenger taking over driving in a vehicle, characterized in that, include: The passenger information acquisition steps include identifying passengers and recording sleep duration, wherein cloud data about the corresponding passenger is synchronized and the sleep duration of the corresponding passenger in the vehicle is recorded; The status monitoring and takeover triggering steps include monitoring the driver's status and triggering the takeover process, wherein when the driver's status is detected as fatigued or suddenly unwell, the passenger takeover process is triggered. The passenger information analysis step includes analyzing passenger information and determining the wake-up order, wherein, based on the passenger information, a comprehensive score is calculated for each passenger, and the priority order for waking up is determined according to the comprehensive score; The takeover prompts and execution steps include implementing a wake-up strategy and detecting passenger awakening to complete the takeover. Specifically, after detecting passenger awakening, the passenger is guided to take over the vehicle through voice and visual cues and assisted in completing driving preparations.

2. The method for waking up a passenger taking over driving in a vehicle according to claim 1, characterized in that, The passenger information acquisition step includes identifying passengers and recording their sleep duration, wherein synchronizing cloud data about the corresponding passenger and recording the corresponding passenger's sleep duration in the vehicle further includes: The system captures passengers' facial features and compares them with information in the cloud to identify passengers. The identified passenger information is synchronized with cloud data to obtain the passenger's historical driving data and preference settings; Monitor the duration of passengers' closed eyes and body movements, and record the sleep duration of each passenger; Recorded passenger information and sleep duration are stored in the vehicle's local database.

3. The method for waking up a passenger taking over driving in a vehicle according to claim 1, characterized in that, The status monitoring and takeover triggering steps include monitoring the driver's status and triggering the takeover process. Specifically, when driver fatigue or sudden discomfort is detected, a passenger takeover process is triggered, further including: Monitor the driver's physiological signals, including heart rate monitoring and eye tracking; Analyze the driver's eye movement frequency and head position to determine if the driver is showing signs of fatigue; Monitor the stability of the vehicle's driving trajectory and identify any slight deviations from the lane; When it is determined that the driver is fatigued or unwell, the process of taking over the vehicle is initiated, and preparations are made to wake up the passengers.

4. The method for waking up a passenger taking over driving in a vehicle according to claim 1, characterized in that, The passenger information analysis step includes analyzing passenger information and determining the wake-up order, wherein, based on the passenger information, a comprehensive score is calculated for each passenger, and the priority order for wake-up is determined according to the comprehensive score, further including: The system pre-determines the weights of each passenger's driving experience, safe driving mileage, number of violations, number and severity of accidents, safe driving experience under different road conditions, and sleep duration. The weight allocation is based on the impact on driving safety and reliability. Based on each passenger's actual data and preset weights, calculate each passenger's score on each factor; The scores of each passenger on each factor are added together to obtain the overall score for each passenger; Based on the overall score, the priority order for waking up passengers is determined, with the passenger with the highest score being woken up first.

5. The method for waking up a passenger taking over driving in a vehicle according to claim 1, characterized in that, Takeover prompts and execution steps include implementing a wake-up strategy and detecting passenger awakening to complete the takeover. Upon detecting passenger awakening, the system guides the passenger to take over the vehicle through voice and visual cues and assists them in preparing to drive. Further steps include: The passenger with the highest overall score will be the priority to be woken up. Based on the passenger's age and sleep duration, set the initial volume of the sound wake-up call, the initial frequency of the seat vibration, and the initial brightness and flashing frequency of the light wake-up call. The wake-up strategy includes gradually increasing sound wake-up, vibration wake-up, and light wake-up until a preset maximum intensity is reached or the passenger wakes up. The system monitors the passenger's awakening status and, upon detecting that the passenger is awake, assists the passenger in taking over the vehicle through voice and screen prompts.

6. The method for waking up a passenger taking over driving in a vehicle according to claim 5, characterized in that, Also includes: Continuously monitor passengers' facial expressions and body movements to determine whether they have regained consciousness; When a passenger is detected to be awake, a preset voice prompt is played to inform the passenger of the current driver status and guide the passenger to take over the vehicle. Display text prompts to guide passengers on how to adjust their seats and fasten their seat belts to ensure safe takeover of the vehicle; If the passenger to be taken over is not detected to have woken up within the preset time, the wake-up strategy will be executed repeatedly until the passenger wakes up and is ready to take over the vehicle.

7. A wake-up system for passenger takeover of driving in a vehicle, characterized in that, include: The passenger information acquisition module is configured to identify passengers and record their sleep duration, wherein it synchronizes cloud data about the corresponding passenger and records the sleep duration of the corresponding passenger in the vehicle; The status monitoring and takeover triggering module is configured to monitor the driver's status and trigger the takeover process. Specifically, when the driver's status is detected as fatigued or suddenly unwell, the passenger takeover process is triggered. The passenger information analysis module is configured to analyze passenger information and determine the wake-up order, wherein, based on the passenger information, a comprehensive score is calculated for each passenger, and the priority order of wake-up is determined according to the comprehensive score; The takeover prompt and execution module is configured to implement a wake-up strategy and detect when the passenger is awake to complete the takeover. Specifically, after detecting that the passenger is awake, the module guides the passenger to take over the vehicle through voice and visual prompts and assists the passenger in completing driving preparations.

8. An electronic device, characterized in that, include: The system includes a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other via the communication bus; the memory stores a computer program, which, when executed by the processor, causes the processor to perform the steps of the method according to any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that, It stores a computer program executable by an electronic device, which, when run on the electronic device, causes the electronic device to perform the steps of the method according to any one of claims 1 to 6.

10. A vehicle, characterized in that, The vehicle is equipped with a wake-up system for passenger takeover of driving as described in claim 7.

Images