Driver prompting method and vehicle control device

Abstract

The present invention relates to a driver prompting method, comprising: receiving driver status information from a driver status perception system; determining a current driving scenario; and selecting an appropriate prompting method from a plurality of candidate prompting methods based on the driver status information and the driving scenario to remind or warn the driver. The present invention also relates to a vehicle control device, a computer program product, and a vehicle.

Description

Technical Field

[0001] The present invention relates to the field of vehicle control, and more particularly, to a driver prompting method, a vehicle control device, a computer program product, and a vehicle. Background Art

[0002] Currently, the industry's solutions for reminding drivers to take over the vehicle or providing information when the vehicle is in automatic or manual driving are more likely to use simple voice reminders through the vehicle control terminal, and adopt multiple reminder methods simultaneously regardless of the scenario or driver status. These solutions either fail to effectively and directly warn or prompt the driver, or cause discomfort to the driver due to the warnings or prompts issued by multiple devices at the same time. In severe cases, it may cause panic in the driver, affecting the driver's judgment and operating ability, and even bring safety risks.

[0003] Therefore, an improved driver prompting scheme is desired. Summary of the Invention

[0004] According to one aspect of the present invention, a driver prompting method is provided, which includes: receiving driver status information from a driver status perception system; determining a current driving scenario; and selecting a suitable prompting method from a plurality of candidate prompting methods to remind or alert the driver based on the driver status information and in combination with the driving scenario.

[0005] As a supplement or alternative to the above solution, in the above method, the driver status perception system includes: a smart device interconnected with the vehicle, a camera sensor, and an odor recognition system.

[0006] As a supplement or alternative to the above-mentioned scheme, in the above-mentioned method, based on the driver status information and in combination with the driving scenario, a suitable prompt method is selected from a plurality of candidate prompt methods to remind or alert the driver, including: when it is determined that the automatic driving scenario has been entered and the driver status information indicates that the driver is unable to take over, the driver is awakened and driven to a safe place through the sound of the vehicle computer, vibration of the mobile phone and / or wearable device, and vibration of the seat.

[0007] As a supplement or replacement for the above-mentioned scheme, in the above-mentioned method, based on the driver status information and in combination with the driving scenario, a suitable prompt method is selected from a plurality of candidate prompt methods to remind or warn the driver, including: when the driver needs to take over in an automatic driving scenario or there is information to be prompted in an automatic or manual driving scenario, and the driver status information indicates that the driver is operating a mobile phone, the mobile phone vibration and sound are used to warn the driver.

[0008] As a supplement or replacement for the above-mentioned scheme, in the above-mentioned method, based on the driver status information and in combination with the driving scenario, a suitable prompt method is selected from a plurality of candidate prompt methods to remind or warn the driver, including: when the driver needs to take over in an automatic driving scenario or there is information to be prompted in an automatic or manual driving scenario, and when the driver status information indicates that the driver is concentrating, the vehicle computer sound and text are used to warn the driver.

[0009] As a supplement or alternative to the above-mentioned scheme, in the above-mentioned method, based on the driver status information and in combination with the driving scenario, a suitable prompt method is selected from a plurality of candidate prompt methods to remind or warn the driver, including: when the driver needs to take over in an automatic driving scenario or there is information to be prompted in an automatic or manual driving scenario, and the driver status information indicates that the driver is slightly inattentive, the wearable device is used to vibrate and sound to warn the driver.

[0010] As a supplement or alternative to the above-mentioned scheme, in the above-mentioned method, based on the driver status information and in combination with the driving scenario, a suitable prompt method is selected from a plurality of candidate prompt methods to remind or warn the driver, including: when the driver needs to take over in an automatic driving scenario or there is information to be prompted in an automatic or manual driving scenario, and the driver status information indicates that the driver is severely lacking in attention, the driver is warned by using the sound of the vehicle computer, vibration of the mobile phone and / or wearable device, and vibration of the seat.

[0011] According to another aspect of the present invention, a vehicle control device is provided, which includes: a receiving device for receiving driver status information from a driver status perception system; a determining device for determining a current driving scene; and a selecting device for selecting a suitable prompt method from a plurality of candidate prompt methods to remind or alert the driver based on the driver status information and in combination with the driving scene.

[0012] As a supplement or alternative to the above solution, in the above device, the driver status perception system includes: an intelligent device interconnected with the vehicle, a camera sensor, and an odor recognition system.

[0013] As a supplement or alternative to the above-mentioned solution, in the above-mentioned device, the selection device is configured to: when the determination device determines that the automatic driving scene has been entered and the driver status information indicates that the driver is unable to take over, select the vehicle computer sound, mobile phone and / or wearable device vibration and seat vibration to wake up the driver.

[0014] As a supplement or alternative to the above-mentioned solution, in the above-mentioned device, the selection device is configured to: when the determination device determines that the driver needs to take over in the automatic driving scenario, or when the determination device determines that there is information to be prompted in the automatic or manual driving scenario, and the driver status information indicates that the driver is operating the mobile phone, choose to use mobile phone vibration and sound to warn the driver.

[0015] As a supplement or alternative to the above-mentioned solution, in the above-mentioned device, the selection device is configured to: when the determination device determines that the driver needs to take over in the automatic driving scenario or when the determination device determines that there is information to be prompted in the automatic or manual driving scenario, and the driver status information indicates that the driver is concentrating, choose to use the vehicle computer sound and text to issue a warning to the driver.

[0016] As a supplement or alternative to the above-mentioned solution, in the above-mentioned device, the selection device is configured to: when the determination device determines that the driver needs to take over in the automatic driving scenario or when the determination device determines that there is information to be prompted in the automatic or manual driving scenario, and the driver status information indicates that the driver is slightly inattentive, choose to use the wearable device to vibrate and sound to warn the driver.

[0017] As a supplement or alternative to the above-mentioned solution, in the above-mentioned device, the selection device is configured to: when the determination device determines that the driver needs to take over in the automatic driving scenario or when the determination device determines that there is information to be prompted in the automatic or manual driving scenario, and the driver status information indicates that the driver is severely inattentive, choose to use the vehicle computer sound, mobile phone and / or wearable device vibration and seat vibration to issue a warning to the driver.

[0018] According to another aspect of the present invention, a computer storage medium is provided, wherein the medium includes instructions, and the instructions execute the above method when executed.

[0019] According to another aspect of the present invention, a computer program product is provided, comprising a computer program, which implements the above method when executed by a processor.

[0020] According to yet another aspect of the present invention, a vehicle is provided, comprising the device as described above.

[0021] The driver prompt scheme of an embodiment of the present invention senses the driver's status through a driver status perception system (also known as a multi-perception system, for example, including sensors such as cameras / smells, and mobile phones or wearable devices connected to the vehicle via Bluetooth), and takes corresponding appropriate warnings or prompts based on the driver's status and the current driving scenario, so that the driver can receive information in a friendly, direct, effective and safe manner, and thus take the next safe action. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] The above and other objects and advantages of the present invention will become more fully apparent from the following detailed description taken in conjunction with the accompanying drawings, wherein the same or similar elements are denoted by the same reference numerals.

[0023] Figure 1 A schematic flow chart of a driver prompting method according to an embodiment of the present invention is shown;

[0024] Figure 2 A schematic structural diagram of a vehicle control device according to an embodiment of the present invention is shown;

[0025] Figure 3 A schematic structural diagram of a driver prompting system according to an embodiment of the present invention is shown;

[0026] Figure 4 A schematic flow chart of a method for warning a driver to enter a safe place for rest under automatic driving is shown according to one embodiment of the present invention;

[0027] Figure 5 A schematic flow chart showing a method for warning a driver to take over in an automatic driving state according to an embodiment of the present invention is shown; and

[0028] Figure 6 A flow chart of an information prompt method under automatic driving or manual driving according to an embodiment of the present invention is shown. DETAILED DESCRIPTION

[0029] Hereinafter, a driver prompting scheme according to various exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0030] Figure 1 FIG. 1 is a flow chart of a driver prompting method 1000 according to an embodiment of the present invention. Figure 1 As shown, the driver prompting method 1000 includes the following steps:

[0031] In step S110 , driver status information is received from a driver status perception system;

[0032] In step S120 , the current driving scene is determined; and

[0033] In step S130 , based on the driver status information and in combination with the driving scenario, a suitable prompting method is selected from a plurality of candidate prompting methods to remind or warn the driver.

[0034] As the name suggests, "driver status information" refers to information related to the driver's state, indicating how and under what conditions the driver uses the vehicle's control components. Generally speaking, driver status can be analyzed through a comprehensive analysis of driving behavior, driving style, vehicle characteristics, and environmental conditions. It can also be inferred through physiological factors, external expressions, and emotional factors.

[0035] In the context of the present invention, driver status information is obtained by a driver status perception system, which may also be referred to as a multi-perception system. In one embodiment, the driver status perception system or multi-perception system may include: a camera, an odor perception system, and a device that is Bluetooth-connected to a vehicle control device / unit (e.g., a smart device, such as a mobile phone, and a wearable device, such as a bracelet, a watch, etc.). For example, a camera may be used to obtain an image of the driver, and based on this image, it may be used to detect distraction, fatigue, or drowsiness of the driver, or even unexpected situations where the driver is unable to drive, such as deceiving the assisted driving system by using mineral water instead of hands on the steering wheel, or arguing or fighting with passengers. As an example, the driver's physical and mental condition may be studied based on the processing of the driver's facial image, such as detecting the driver's status from eyelid closure, blinking, gaze direction, yawning, and head movement. Symptoms extracted related to fatigue, distraction, and dozing off included: 1) symptoms related to the eye region: eye closure, distance between eyelids, fast blinking rate, gaze direction, and jumping movements; 2) symptoms related to the mouth region: opening / closing; 3) symptoms related to the head: nodding, head posture, and head fixation; 4) symptoms related to the face: mainly facial expressions.

[0036] The odor perception system is used to detect the driver's odor characteristics. For example, by placing one or more odor sensors on the seat, backrest, headrest, or roof, they detect odor substances released by the human body into the ambient air, as well as the odor characteristics of the interior space, thereby determining whether the driver is driving under the influence or drunk driving.

[0037] As part of the driver status awareness system, a device (e.g., a mobile phone) connected to a vehicle control device / unit via Bluetooth can be used to provide driver status information related to whether the driver is using the mobile phone (e.g., making a call, sending a message, etc.). It is understood that in addition to Bluetooth connectivity, smart devices (e.g., mobile phones) can also use other wired or wireless connection methods, including but not limited to WiFi, RFID, etc.

[0038] In one or more embodiments, the driver status may include: the driver is unable to take over or has insufficient ability to take over (such as falling asleep or being drunk due to extreme sleepiness), the driver is operating a mobile phone (looking at or operating), the driver is focused mind on (hands on the steering wheel, eyes looking forward), mild lack of attention mind off, and severe lack of attention mind off, etc.

[0039] "Inability to take over" refers to situations where a driver is detected as drunk driving by an odor sensor or is asleep (due to extreme drowsiness, etc.) by a camera or other detection device. In these situations, the driver is not capable of taking over when the autonomous driving system requires it.

[0040] Whether the driver is operating the mobile phone (including looking at or operating it) is based on the mobile phone connected to the vehicle control device and the camera inside the vehicle sensing that the driver is operating the mobile phone.

[0041] The driver's attention (mind on) state can include hands on the steering wheel and eyes on. For example, the in-car camera can be used to identify that the driver is paying attention to the vehicle, such as keeping their hands on the steering wheel, looking forward, and not attending to anything unrelated to driving.

[0042] Severe mind-off state means that the driver is in a state that is difficult to wake up, such as sleeping state (for example, it can be sensed by systems such as cameras).

[0043] Mild inattention is between the driver's concentration and severe inattention, that is, the driver is not in a state of sleep, but may be chatting with members or reading a book, for example.

[0044] The interplay of driver attributes, vehicle design parameters and operating status, and the vehicle's driving environment creates a complex driving scenario. In the context of the present invention, accurately identifying the vehicle's current driving scenario (i.e., the current driving scenario) facilitates selecting an appropriate prompt from a variety of candidate prompts to alert or warn the driver. In one embodiment, the current driving scenario is the initial entry into autonomous driving. In another embodiment, the current driving scenario is the entry into autonomous driving mode, but requires driver control. In yet another embodiment, the current driving scenario is a prompt requiring information during either automated or manual driving.

[0045] In one embodiment, candidate prompting methods may include (but are not limited to) vibration of the seat system, sound and text of the vehicle computer, vibration, sound and text of wearable devices such as watches or bracelets, and vibration, sound and text of a mobile phone.

[0046] In one embodiment, step S130 includes: upon determining that the autonomous driving scenario has been entered and the driver status information indicates that the driver is unable to take over, waking the driver and driving to a safe location through vehicle audio, vibration of the phone and / or wearable device, and seat vibration. "Inability to take over" refers to situations where an odor sensor detects drunk driving or a camera or other detection device detects that the driver is asleep (due to extreme drowsiness, etc.). In these situations, the driver is unable to take over if the autonomous driving system requires human intervention, and is therefore warned to drive to a nearby safe location to rest.

[0047] The above embodiments relate to warning solutions for situations where the driver is unable to take over. In the following embodiments, multiple solutions are provided for situations where the driver needs to take over in autonomous driving scenarios or where information needs to be prompted in autonomous or manual driving scenarios.

[0048] Specifically, in one embodiment, step S130 includes: when driver control is required in an autonomous driving scenario, or when a prompt is required in an automated or manual driving scenario, and the driver status information indicates that the driver is operating a mobile phone, using the phone's vibration and sound to alert the driver. The "driver operating the phone" requirement is based on the phone connected to the vehicle's control equipment and the in-vehicle camera sensing that the driver is operating the phone (including looking at or operating it). In this case, the phone's vibration, sound, and text provide a direct and effective warning or prompt to the driver.

[0049] In another embodiment, step S130 includes: when the driver needs to take over in an autonomous driving scenario, or when a prompt is required in an autonomous or manual driving scenario, and the driver status information indicates that the driver is paying attention, using the vehicle computer to issue a warning to the driver using audio and text. Because the driver is paying attention and not attending to matters unrelated to driving the vehicle, the audio and text prompts from the vehicle computer are effective warnings or prompts for the driver.

[0050] In another embodiment, step S130 includes: when the driver needs to take over in an automatic driving scenario or when there is information to be prompted in an automatic or manual driving scenario, and the driver status information indicates that the driver is slightly inattentive, the wearable device is used to vibrate and sound to warn the driver. The mild inattention state means that the driver is not in a state such as sleeping, and may be chatting with members or reading a book. At this time, only sound prompts may not be able to effectively warn or prompt the driver. Therefore, when the driver wears a wearable device such as a watch or bracelet (Note: the system / vehicle control device can sense whether it is worn), the vibration, sound (and text) of the watch or bracelet are used to directly and effectively warn or prompt the driver.

[0051] In another embodiment, step S130 includes: when the driver needs to take over in an autonomous driving scenario or when there is information that needs to be prompted in an automatic or manual driving scenario, and the driver status information indicates that the driver is severely inattentive, the driver is warned by the vehicle sound, the vibration of the mobile phone and / or wearable device, and the vibration of the seat. Severe inattention means that the driver is in a state that is difficult to wake up, such as a sleeping state (for example, which can be perceived by a system such as a camera). At this time, multiple warning or prompting methods (mobile phone vibration and voice text, vehicle computer voice text, bracelet or mobile phone vibration and voice text, seat vibration) need to work simultaneously to ensure that the driver is awakened.

[0052] In one or more embodiments, the information that requires prompting may include (but is not limited to) charging reminders, upcoming destination reminders, vehicle failure reminders, and remote service reminders.

[0053] Furthermore, those skilled in the art will readily appreciate that the driver prompting method 1000 provided in one or more of the above-described embodiments of the present invention can be implemented via a computer program. For example, the computer program can be included in a computer program product, and when executed by a processor, the driver prompting method 1000 according to one or more embodiments of the present invention can be implemented. For another example, when a computer storage medium (e.g., a USB flash drive) storing the computer program is connected to a computer, running the computer program can execute the driver prompting method 1000 according to one or more embodiments of the present invention.

[0054] refer to Figure 2 , Figure 2 FIG. 2 shows a vehicle control device 2000 according to an embodiment of the present invention. Figure 2 As shown, the vehicle control device 2000 includes: a receiving device 210, a determining device 220, and a selecting device 230. The receiving device 210 is used to receive driver status information from the driver status perception system; the determining device 220 is used to determine the current driving scenario; and the selecting device 230 is used to select an appropriate prompt method from multiple candidate prompt methods based on the driver status information and the driving scenario to remind or warn the driver.

[0055] As the name suggests, "driver status information" refers to information related to the driver's state, indicating how and under what conditions the driver uses the vehicle's control components. Generally speaking, driver status can be analyzed through a comprehensive analysis of driving behavior, driving style, vehicle characteristics, and environmental conditions. It can also be inferred through physiological factors, external expressions, and emotional factors.

[0056] In the context of the present invention, driver status information is obtained by a driver status perception system, which may also be referred to as a multi-perception system. In one embodiment, the driver status perception system or multi-perception system may include: a camera, an odor perception system, and a device that is Bluetooth-connected to the vehicle control device 2000 (e.g., a smart device, such as a mobile phone, and a wearable device, such as a bracelet, a watch, etc.). For example, a camera may be used to obtain an image of the driver, which may be used to detect distraction, fatigue, or drowsiness, or even unexpected situations where the driver is unable to drive, such as deceiving the assisted driving system by replacing hands on the steering wheel with mineral water, or arguing or fighting with passengers. As an example, the driver's physical and mental condition may be studied based on facial image processing, such as detecting the driver's status from eyelid closure, blinking, gaze direction, yawning, and head movement. Symptoms extracted related to fatigue, distraction, and dozing off included: 1) symptoms related to the eye region: eye closure, distance between eyelids, fast blinking rate, gaze direction, and jumping movements; 2) symptoms related to the mouth region: opening / closing; 3) symptoms related to the head: nodding, head posture, and head fixation; 4) symptoms related to the face: mainly facial expressions.

[0057] The odor perception system is used to detect the driver's odor characteristics. For example, by placing one or more odor sensors on the seat, backrest, headrest, or roof, they detect odor substances released by the human body into the ambient air, as well as the odor characteristics of the interior space, thereby determining whether the driver is driving under the influence or drunk driving.

[0058] As part of the driver status awareness system, a device (e.g., a mobile phone) connected to vehicle control device 2000 via Bluetooth can be used to provide driver status information related to whether the driver is using the mobile phone (e.g., making a call, sending a message, etc.). It is understood that in addition to Bluetooth connectivity, smart devices (e.g., mobile phones) can also use other wired or wireless connection methods to connect to vehicle control device 2000, including but not limited to WiFi, RFID, etc.

[0059] In one or more embodiments, the driver status may include: the driver is unable to take over or has insufficient ability to take over (such as falling asleep or being drunk due to extreme sleepiness), the driver is operating a mobile phone (looking at or operating), the driver is focused mind on (hands on the steering wheel, eyes looking forward), mild lack of attention mind off, and severe lack of attention mind off, etc.

[0060] "Inability to take over" refers to situations where a driver is detected as drunk driving by an odor sensor or is asleep (due to extreme drowsiness, etc.) by a camera or other detection device. In these situations, the driver is not capable of taking over when the autonomous driving system requires it.

[0061] Whether the mobile phone is being operated (including looking at or operating) is based on the mobile phone connected to the vehicle control device 2000 and the in-vehicle camera sensing that the driver is operating the mobile phone.

[0062] The driver's attention (mind on) state can include hands on the steering wheel and eyes on. For example, the in-car camera can be used to identify that the driver is paying attention to the vehicle, such as keeping their hands on the steering wheel, looking forward, and not attending to anything unrelated to driving.

[0063] Severe mind-off state means that the driver is in a state that is difficult to wake up, such as sleeping state (for example, it can be sensed by systems such as cameras).

[0064] Mild inattention is between the driver's concentration and severe inattention, that is, the driver is not in a state of sleep, but may be chatting with members or reading a book, for example.

[0065] The interplay of driver attributes, vehicle design parameters and operating status, and the vehicle's driving environment creates a complex driving scenario. In the context of the present invention, accurately identifying the vehicle's current driving scenario (i.e., the current driving scenario) facilitates selecting an appropriate prompt from a variety of candidate prompts to alert or warn the driver. In one embodiment, the current driving scenario is the initial entry into autonomous driving. In another embodiment, the current driving scenario is the entry into autonomous driving mode, but requires driver control. In yet another embodiment, the current driving scenario is a prompt requiring information during either automated or manual driving.

[0066] In one embodiment, candidate prompting methods may include (but are not limited to) vibration of the seat system, sound and text of the vehicle computer, vibration, sound and text of wearable devices such as watches or bracelets, and vibration, sound and text of a mobile phone.

[0067] In one embodiment, the selection device 230 is configured to, when the determination device 220 determines that the autonomous driving scenario has been entered and the driver status information received by the receiving device 210 indicates that the driver is unable to take over, select the vehicle audio, mobile phone and / or wearable device vibration, and seat vibration to wake the driver and drive to a safe location. "Inability to take over" refers to situations where an odor sensor detects drunk driving or a camera or other detection device detects that the driver is asleep (due to extreme sleepiness, etc.). In these situations, the driver is unable to take over when the autonomous driving system requires human intervention, and is therefore warned to drive to a nearby safe location to rest.

[0068] In another embodiment, the selection device 230 is configured to use phone vibration and sound to alert the driver when the determination device 220 determines that driver control is required in an autonomous driving scenario, or when the determination device 220 determines that a prompt is required in an autonomous or manual driving scenario, and the driver status information received by the receiving device 210 indicates that the driver is operating a mobile phone. The so-called "driver operating a mobile phone" is based on the perception that the mobile phone connected to the vehicle control device 2000 and the in-vehicle camera are operating the mobile phone (including looking at or operating it). In this case, the phone's vibration, sound, and text provide a direct and effective warning or prompt to the driver.

[0069] In yet another embodiment, the selecting device 230 is configured to, when the determining device 220 determines that driver takeover is required in an autonomous driving scenario, or when the determining device 220 determines that a prompt is required in an autonomous or manual driving scenario, and the driver status information received by the receiving device 210 indicates that the driver is paying attention, select to use the vehicle computer's audio and text prompts to warn the driver. Because the driver is paying attention and not attending to matters unrelated to driving the vehicle, the audio and text prompts from the vehicle computer are effective warnings or prompts for the driver.

[0070] In another embodiment, the selection device 230 is configured to: when the determination device 220 determines that the driver needs to take over in the automatic driving scenario or when the determination device 220 determines that there is information that needs to be prompted in the automatic or manual driving scenario, and the driver status information received by the receiving device 210 indicates that the driver is slightly inattentive, choose to use the wearable device to vibrate and sound to warn the driver. The mild inattention state means that the driver is not in a state such as sleeping, and may be chatting with members or reading a book. At this time, only sound prompts may not be able to effectively warn or prompt the driver. Therefore, when the driver wears a wearable device such as a watch or bracelet (Note: the system / vehicle control device can sense whether it is worn), the vibration, sound (and text) of the watch or bracelet are used to directly and effectively warn or prompt the driver.

[0071] In another embodiment, the selection device 230 is configured to: when the determination device 220 determines that the driver needs to take over in the automatic driving scenario or when the determination device 220 determines that there is information that needs to be prompted in the automatic or manual driving scenario, and the driver status information received by the receiving device 210 indicates that the driver is severely inattentive, select to use the vehicle computer sound, mobile phone and / or wearable device vibration and seat vibration to warn the driver. Severe inattention means that the driver is in a state that is difficult to wake up, such as a sleeping state (for example, it can be perceived by a system such as a camera). At this time, multiple warning or prompting methods (mobile phone vibration and voice text, vehicle computer voice text, bracelet or mobile phone vibration and voice text, seat vibration) need to work simultaneously to ensure that the driver is awakened.

[0072] In one or more embodiments, the vehicle control device 2000 may be integrated into various types of vehicles, which is not limited in the present invention.

[0073] refer to Figure 3 , which shows a schematic structural diagram of a driver prompting system according to an embodiment of the present invention. Figure 3 As shown, the driver state perception system includes a mobile phone, a camera, and an odor recognition sensor, which are used to perceive the driver's state. In the driver state perception system, the mobile phone is connected to the vehicle control device through Bluetooth.

[0074] There are multiple potential alert or prompt methods, including seat system vibration, audio and text from the vehicle's computer, vibration, audio, and text from wearable devices like watches and bracelets, and vibration, audio, and text from mobile phones. Wearable devices and mobile phones can connect to the vehicle's control unit via Bluetooth. Under control of the vehicle's control unit, the alert / prompt device provides vibration, audio, and / or text to the driver, enabling the driver to take appropriate action, such as taking control of the vehicle.

[0075] Figure 4 The flowchart of the method for warning a driver to drive to a safe place to rest under automatic driving according to one embodiment of the present invention is shown. Figure 4 As shown, the entire process begins in step S410. Next, in step S415, it is determined that the autonomous driving scenario has been entered. Then, in step S420, it is determined whether the driver is capable of taking over. If so, the process proceeds to step S425; otherwise, the process returns to step S415. In step S425, a reminder is provided using the vehicle's audio, the vibration of the wristband phone, and the vibration of the seat. Finally, in step S430, the driver is awakened and the vehicle is driven to a safe location.

[0076] Figure 5FIG. 1 is a flow chart showing a method for warning a driver to take over in an automatic driving state according to an embodiment of the present invention. Figure 5 As shown, the entire process begins in step S510. Next, in step S515, it is determined whether the autonomous driving scenario has been entered. Then, in step S520, it is determined whether the driver needs to be alerted to take over. If so, the process proceeds to step S525; otherwise, the process returns to step S515. In step S525, the driver's status is identified to facilitate the selection of an appropriate alert method. In step S530, it is determined whether the driver is using a mobile phone. If so, the process proceeds to step S535; otherwise, the process proceeds to step S540. In step S535, an alert is issued using mobile phone vibration and sound. In step S540, it is determined whether the driver is paying attention. If so, the process proceeds to step S545; otherwise, the process proceeds to step S550. In step S545, an alert is issued using voice and text on the vehicle's computer. In step S550, it is determined whether the driver is experiencing mild inattention. If so, the process proceeds to step S555; otherwise, the process proceeds to step S560. In step S555, a wearable device such as a wristband or watch is used to provide a vibration and sound alert. In step S560, it is determined whether the driver is severely inattentive. If so, in step S565, a warning is issued using the vehicle's audio, the wristband phone's vibration, and the seat's vibration. Finally, in step S570, the driver receives the warning and takes control of the vehicle accordingly.

[0077] Figure 6 FIG1 shows a flow chart of an information prompt method under automatic driving or manual driving according to an embodiment of the present invention. Figure 6As shown, the entire process begins in step S610. Next, in step S615, it is determined whether the vehicle has entered the autonomous driving or manual driving scenario. Then, in step S620, it is determined whether any information needs to be prompted. If so, the process proceeds to step S625; otherwise, the process returns to step S615. In step S625, the driver's status is identified to facilitate the selection of an appropriate alert method. In step S630, it is determined whether the driver is using a mobile phone. If so, the process proceeds to step S635; otherwise, the process proceeds to step S640. In step S635, a reminder is provided using the phone's vibration and sound. In step S640, it is determined whether the driver is paying attention. If so, the process proceeds to step S645; otherwise, the process proceeds to step S650. In step S645, a reminder is provided using the vehicle's audio and text input. In step S650, it is determined whether the driver is experiencing mild inattention. If so, the process proceeds to step S655; otherwise, the process proceeds to step S660. In step S655, a wearable device such as a wristband or watch is used to provide vibration, sound, and text alerts. In step S660, it is determined whether the driver is severely inattentive. If so, in step S665, a reminder is given using the car's audio, the wristband phone's vibration, and the seat's vibration. Finally, in step S670, the driver receives the reminder and proceeds to the next step.

[0078] In summary, the driver prompt scheme of the embodiment of the present invention senses the driver's status through a driver status perception system (also known as a multi-perception system, for example, including sensors such as cameras / smells, and mobile phones or wearable devices connected to the vehicle via Bluetooth), and takes corresponding appropriate warnings or prompts based on the driver's status and the current driving scenario, so that the driver can receive information in a friendly, direct, effective and safe manner, and thus take the next step of safe operation.

[0079] Although the above description only describes some embodiments of the present invention, it should be understood by those skilled in the art that the present invention may be implemented in many other forms without departing from its spirit and scope. Therefore, the examples and embodiments shown are to be considered illustrative rather than restrictive, and the present invention may encompass various modifications and substitutions without departing from the spirit and scope of the present invention as defined in the appended claims.

Claims

1. A driver prompting method, characterized in that: The method comprises: receiving driver state information from a driver state perception system; Determine the current driving scenario; and If the current driving scenario is determined to be an autonomous driving scenario, determine whether the driver is capable of taking over based on the driver's status information; If the driver is unable to take over, the system will use the car's sound, wristband, mobile phone vibration, and seat vibration to remind the driver to wake up and drive the vehicle to a safe place. In the case where the driver has the ability to take over, and when it is necessary to warn the driver to take over or when there is information to be prompted, selecting an appropriate prompting method from a plurality of candidate prompting methods based on the driver status information and the driving scenario to remind or warn the driver; According to the driver status information and in combination with the driving scenario, a suitable prompting method is selected from a plurality of candidate prompting methods to remind or warn the driver, including: When the driver status information indicates that the driver is concentrating, the driver is warned by sound and text on the vehicle computer; When the driver status information indicates that the driver is slightly inattentive, the wearable device is used to vibrate and sound to warn the driver.

2. The method according to claim 1, wherein The driver status perception system includes: an intelligent device interconnected with the vehicle, a camera sensor, and an odor recognition system.

3. The method according to claim 1 or 2, wherein Selecting an appropriate prompting method from a plurality of candidate prompting methods based on the driver status information and in combination with the driving scenario to remind or warn the driver includes: When the driver needs to take over in an autonomous driving scenario or when there is information that needs to be prompted in an automatic or manual driving scenario, and the driver status information indicates that the driver is operating a mobile phone, the mobile phone vibration and sound are used to warn the driver.

4. The method according to claim 1 or 2, wherein Selecting an appropriate prompting method from a plurality of candidate prompting methods based on the driver status information and in combination with the driving scenario to remind or warn the driver includes: When the driver needs to take over in an autonomous driving scenario or when there is information that needs to be prompted in an automatic or manual driving scenario, and the driver status information indicates that the driver is severely inattentive, the driver will be warned by using the vehicle computer sound, vibration of the mobile phone and / or wearable device, and vibration of the seat.

5. A vehicle control device, characterized in that: The vehicle control device comprises: a receiving device for receiving driver status information from a driver status perception system; determining means for determining a current driving scenario; and Select the device, configured to: If the current driving scenario is determined to be an autonomous driving scenario, determine whether the driver is capable of taking over based on the driver's status information; If the driver is unable to take over, the system will use the car's sound, wristband, mobile phone vibration, and seat vibration to remind the driver to wake up and drive the vehicle to a safe place. In the case where the driver has the ability to take over, and when it is necessary to warn the driver to take over or when there is information to be prompted, selecting an appropriate prompting method from a plurality of candidate prompting methods based on the driver status information and the driving scenario to remind or warn the driver; Wherein, the selection device is further configured to: When the driver status information indicates that the driver is concentrating, the driver is warned by sound and text on the vehicle computer; When the driver status information indicates that the driver is slightly inattentive, the wearable device is used to vibrate and sound to warn the driver.

6. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the method according to any one of claims 1 to 4 is implemented.

7. A vehicle, characterized in that: The vehicle includes the vehicle control apparatus according to claim 5 .

Images