Driving assistance reminding control method and device and vehicle

Abstract

The embodiment of the invention provides a driving auxiliary reminding control method and device and a vehicle, and relates to the technical field of auxiliary driving. The method comprises the following steps: acquiring target wearing article information of a driver in real time, and identifying and judging the target wearing article information to obtain a corresponding judgment result; if the judgment result is that the falling event of the target wearing article occurs, vehicle driving intervention operation is executed, and the vehicle driving intervention operation is used for intervening in vehicle driving control; acquiring surrounding environment information of the vehicle in real time, and determining a temporary navigation route according to the surrounding environment information; and controlling the vehicle to automatically drive according to the temporary navigation route. By adopting the technical scheme, vehicle driving can be intervened under the condition of determining that the driver has the target wearing article falling event, so that the vehicle is automatically driven according to the temporary navigation route, the vehicle is ensured to safely drive into a safe area, and the accident risk is reduced.

Description

Technical Field

[0001] Embodiments of the present disclosure relate to the field of assisted driving technology, and in particular, to a driving assistance reminder control method, device, and vehicle. Background Art

[0002] The state of the driver is crucial for the driving safety of the vehicle. The driver's attention, mood, and physical condition directly affect driving behavior and their response to the road environment.

[0003] During the process of a driver driving a vehicle, there is an easy occurrence of bumpy phenomena, which may lead to the problem that the glasses of a myopic driver suddenly fall off, or due to non-external environmental factors, problems occur to the driver himself, resulting in the problem that the glasses of a myopic driver fall off. And a myopic driver cannot ensure safe driving of the vehicle without a safe driving vision, thus increasing the accident risk. Summary of the Invention

[0004] To solve the above technical problems or at least partially solve the above technical problems, embodiments of the present disclosure provide a driving assistance reminder control method, device, and vehicle.

[0005] A first aspect of embodiments of the present disclosure provides a driving assistance reminder control method, the method including:

[0006] Real-time obtain the target wearing item information of the driver, and perform identification and judgment processing on the target wearing item information to obtain a corresponding judgment result;

[0007] If the judgment result is that a falling event of the target wearing item occurs, perform a vehicle driving intervention operation, and the vehicle driving intervention operation is used to intervene in the vehicle for driving control;

[0008] Real-time obtain the vehicle surrounding environment information, and determine a temporary navigation route according to the surrounding environment information;

[0009] Control the vehicle to perform autonomous driving according to the temporary navigation route.

[0010] In one example, the real-time obtain the target wearing item information of the driver, and perform identification and judgment processing on the target wearing item information, including:

[0011] Real-time obtain the image information corresponding to the driver through an in-vehicle camera, and obtain the radar information corresponding to the driver through an in-vehicle radar;

[0012] Based on the image information, perform item type identification to obtain the target wearing item and judge whether the position of the target wearing item has changed;

[0013] If it is recognized that the position of the target worn item has changed, capture the displacement distance information of the target worn item through the radar information and make a judgment;

[0014] When the displacement distance information meets the preset item dropping condition, determine that the judgment result is that the target worn item has dropped;

[0015] Otherwise, determine that the judgment result is that the target worn item has not dropped.

[0016] In one example, after the judgment result is that the target worn item has dropped, the method further includes:

[0017] Send a dropping reminder to the driver through the in-vehicle multimedia device;

[0018] In response to the user's permission to intervene instruction, perform the vehicle driving intervention operation.

[0019] In one example, if the judgment result is that the target worn item has dropped, the performing the vehicle driving intervention operation includes:

[0020] If the judgment result is that the target worn item has dropped, control the vehicle to maintain its driving state.

[0021] In one example, after the judgment result is that the target worn item has dropped and before performing the vehicle driving intervention operation, the method further includes:

[0022] Real-time obtain the driver's body posture information and driving line-of-sight information;

[0023] Based on the body posture information and the driving line-of-sight information, judge whether the driver has lost the basic driving ability;

[0024] If it is determined that the driver has lost the basic driving ability, perform the high-level full takeover intervention operation of autonomous driving.

[0025] In one example, the real-time obtaining of the vehicle surrounding environment information and determining the temporary navigation route according to the surrounding environment information includes:

[0026] Real-time obtain the vehicle surrounding environment information, and modify the temporary navigation route in accordance with the preset route priority by combining the surrounding environment information and the vehicle positioning information.

[0027] In one example, after the judgment result is that the target worn item has dropped and before performing the vehicle driving intervention operation, the method further includes:

[0028] Obtain the health status data of the driver in real time, and perform a health status judgment based on the health status data to obtain a corresponding health status judgment result;

[0029] If the health status judgment result indicates that the driver has a sudden health condition, upload the health status judgment result, the health status data, and the vehicle's real-time location to the cloud.

[0030] In one example, after the judgment result is that a target wearable item has fallen, the method further includes:

[0031] Send a safety reminder to the people in the vehicle through the in-vehicle multimedia device;

[0032] Send a safety reminder to nearby vehicles through the out-of-vehicle multimedia device and the lighting device.

[0033] A second aspect of the embodiments of the present disclosure provides a driving assistance reminder control device, which includes:

[0034] A first processing module, configured to obtain the information of the target wearable item of the driver in real time, and perform identification and judgment processing on the information of the target wearable item to obtain a corresponding judgment result;

[0035] A first control module, configured to, if the judgment result is that a target wearable item has fallen, perform a vehicle driving intervention operation, and the vehicle driving intervention operation is used to intervene in the vehicle for driving control;

[0036] A second processing module, configured to obtain the information of the vehicle's surrounding environment in real time, and determine a temporary navigation route according to the surrounding environment information;

[0037] A second control module, configured to control the vehicle to perform autonomous driving according to the temporary navigation route.

[0038] A third aspect of the embodiments of the present disclosure provides a vehicle, which includes: a processor and a memory. Among them, a computer program is stored in the memory, and when the computer program is executed by the processor, the processor executes the method of the first aspect above.

[0039] A fourth aspect of the embodiments of the present disclosure provides a computer-readable storage medium, in which a computer program is stored, and when the computer program is executed by a processor, the method of the first aspect above can be implemented.

[0040] Embodiments of the present disclosure provide a driving assistance reminder control method, apparatus and vehicle. The method includes: obtaining real-time information about the target wearing item of the driver, performing identification and judgment processing on the information about the target wearing item to obtain a corresponding judgment result, and then if the judgment result indicates that a dropping event of the target wearing item occurs, performing a vehicle driving intervention operation, where the vehicle driving intervention operation is used to intervene in the vehicle for driving control, then obtaining real-time information about the surrounding environment of the vehicle, determining a temporary navigation route according to the surrounding environment information, and finally controlling the vehicle to perform autonomous driving according to the temporary navigation route. By adopting this technical solution, it is possible to intervene in driving the vehicle when it is determined that a dropping event of the target wearing item of the driver occurs, so that the vehicle performs autonomous driving according to the temporary navigation route, ensuring that the vehicle safely enters a safe area and reducing the accident risk. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] The accompanying drawings herein are incorporated into the specification and form a part of the specification, showing embodiments consistent with the present disclosure and used together with the specification to explain the principles of the present disclosure.

[0042] To more clearly illustrate the technical solutions in the embodiments of the present disclosure or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, for those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0043] Figure 1 is a flowchart of a driving assistance reminder control method provided by an embodiment of the present disclosure;

[0044] Figure 2 is a flowchart of another driving assistance reminder control method provided by an embodiment of the present disclosure;

[0045] Figure 3 is a structural schematic diagram of a driving assistance reminder control apparatus provided by an embodiment of the present disclosure;

[0046] Figure 4 is a structural schematic diagram of a vehicle in an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0047] In order to be able to more clearly understand the above-mentioned objects, features and advantages of the present disclosure, the following will further describe the solutions of the present disclosure. It should be noted that, without conflict, the embodiments of the present disclosure and the features in the embodiments can be combined with each other.

[0048] In the following description, many specific details are set forth to facilitate a full understanding of the present disclosure, but the present disclosure may also be implemented in other ways different from those described herein; it is obvious that the embodiments in the specification are only part of the embodiments of the present disclosure, rather than all of the embodiments.

[0049] Figure 1 The present invention provides a flowchart of a driving assistance reminder control method provided by an embodiment of the present invention, which can be executed by an electronic device. The electronic device may include but is not limited to devices such as vehicle-mounted devices and vehicle controllers.

[0050] like Figure 1 As shown, the method provided in this embodiment includes the following steps:

[0051] S110, acquiring target worn item information of the driver in real time, and performing identification and judgment processing on the target worn item information to obtain a corresponding judgment result.

[0052] In the disclosed embodiment, the electronic device can obtain the target worn item information of the driver in real time, and perform identification and judgment processing on the target worn item information to obtain a corresponding judgment result.

[0053] Optionally, the target worn item information may be information corresponding to a specific item. For example, the target worn item information may be information corresponding to a target worn item such as myopia glasses or sunglasses worn by the driver.

[0054] Specifically, when the driver is driving a vehicle, the electronic device can obtain in real time the information of the driver's target worn items, such as the driver's myopia glasses, sunglasses, etc., and identify and judge the information of the target worn items to obtain the corresponding judgment result, that is, to identify and judge whether the target worn items have fallen.

[0055] S120: If the judgment result is that the target worn item has fallen off, executing a vehicle driving intervention operation, wherein the vehicle driving intervention operation is used to intervene in the vehicle driving control.

[0056] In an embodiment of the present disclosure, if the judgment result is that the target worn item has fallen, the electronic device can perform a vehicle driving intervention operation.

[0057] Optionally, the vehicle driving intervention operation is used to intervene in the vehicle's driving control.

[0058] Specifically, after the electronic device judges the information of the target worn item, if the judgment result is that the target worn item has fallen, such as judging that the myopic glasses worn by the driver have fallen, the electronic device can perform a vehicle driving intervention operation, that is, intervene in the vehicle's driving control.

[0059] S130. Obtain the vehicle surrounding environment information in real time, and determine a temporary navigation route according to the surrounding environment information.

[0060] In an embodiment of the present disclosure, the electronic device may obtain the vehicle surrounding environment information in real time, and determine a temporary navigation route according to the surrounding environment information.

[0061] Optionally, the surrounding environment information may be driving environment information related to the vehicle surroundings. For example, the surrounding environment information may include lane information, other vehicle information, weather information, etc., which is not limited herein.

[0062] Optionally, the temporary navigation route may be a temporarily planned route for controlling the vehicle to automatically navigate to a safe area.

[0063] Specifically, after the electronic device intervenes in the vehicle for driving control, it may obtain the vehicle surrounding environment information in real time, such as lane information, other vehicle information, weather information, etc., and determine a temporary navigation route according to the surrounding environment information.

[0064] S140. Control the vehicle to perform automatic driving according to the temporary navigation route.

[0065] In an embodiment of the present disclosure, the electronic device may control the vehicle to perform automatic driving according to the temporary navigation route.

[0066] Thus, in an embodiment of the present disclosure, the target wearing item information of the driver is obtained in real time, and the target wearing item information is identified and judged to obtain a corresponding judgment result. Then, if the judgment result is that a dropping event of the target wearing item occurs, a vehicle driving intervention operation is executed. The vehicle driving intervention operation is used to intervene in the vehicle for driving control. Then, the vehicle surrounding environment information is obtained in real time, and a temporary navigation route is determined according to the surrounding environment information. Finally, the vehicle is controlled to perform automatic driving according to the temporary navigation route. By adopting this technical solution, it is possible to intervene in driving the vehicle when it is determined that the driver has a dropping event of the target wearing item, so that the vehicle performs automatic driving according to the temporary navigation route, ensuring that the vehicle safely enters the safe area and reducing the accident risk.

[0067] Optionally, S110 may specifically include: obtaining the image information corresponding to the driver in real time through an in-vehicle camera, and obtaining the radar information corresponding to the driver through an in-vehicle radar; performing item type recognition based on the image information to obtain the target worn item and determining whether the position of the target worn item has changed; if it is recognized that the position of the target worn item has changed, capturing the displacement distance information of the target worn item through the radar information and making a judgment; in the case where the displacement distance information meets the preset item dropping condition, determining the judgment result as that the target worn item has dropped; otherwise, determining the judgment result as that the target worn item has not dropped.

[0068] In the embodiments of the present disclosure, the electronic device may obtain the image information corresponding to the driver in real time through an in-vehicle camera, and obtain the radar information corresponding to the driver through an in-vehicle radar.

[0069] Among them, the in-vehicle camera may be installed directly above the driver's seat. The in-vehicle camera may be used to collect and obtain the image information of the driver's front. The in-vehicle radar may be installed directly above and directly below the driver's seat. The in-vehicle radar may be used to collect and obtain the radar data corresponding to each item around the driver.

[0070] Specifically, the electronic device may obtain the image information corresponding to the driver in real time through an in-vehicle camera, such as collecting multiple picture data corresponding to the driver through the in-vehicle camera in real time, and obtain the radar information corresponding to the driver through an in-vehicle radar, such as collecting multiple radar data corresponding to the driver through the in-vehicle radar.

[0071] Furthermore, the electronic device may perform item type recognition based on the image information to obtain the target worn item, such as performing image recognition through the collected multiple picture data to recognize myopia glasses, sunglasses, etc. in the pictures, and determining whether the position of the target worn item has changed, such as performing recognition and comparison on the obtained multiple picture data to determine whether the position of the target worn item in the pictures has changed.

[0072] If it is recognized that the position of the target worn item has changed, the electronic device may capture the displacement distance information of the target worn item through the radar information and make a judgment. For example, if it is recognized that the glasses are no longer worn on the driver's eyes, the electronic device continues to capture the displacement distance information of the target worn item through the obtained radar information and make a judgment.

[0073] In some examples, when the displacement distance information meets the preset item dropping condition, the electronic device can determine that the judgment result is that the target worn item has dropped. The preset item dropping condition can be that the object has a long - distance displacement. When the displacement distance of the captured glasses is long, such as when it is detected that the glasses have displaced from the position in front of the driver's eyes to under the seat, it may be that the glasses worn by the driver have dropped. Therefore, since the displacement distance information meets the preset item dropping condition, it can be determined that the judgment result is that the target worn item has dropped.

[0074] In other examples, when the displacement distance of the captured glasses is short, it may be that the driver has actively removed the glasses and placed them on the armrest box, and the glasses have not dropped. Therefore, since the displacement distance information does not meet the preset item dropping condition, it can be determined that the judgment result is that the target worn item has not dropped.

[0075] Optionally, after the judgment result is that the target worn item has dropped, the driving - assistance reminder control method may further include: sending a dropping reminder to the driver through the in - vehicle multimedia device; and executing the vehicle driving intervention operation in response to the user's permission - to - intervene instruction.

[0076] In the embodiments of the present disclosure, the electronic device can send a dropping reminder to the driver through the in - vehicle multimedia device.

[0077] Specifically, after the electronic device determines that the target worn item has dropped, it can send a dropping reminder to the driver through the in - vehicle multimedia device. For example, it can send a dropping reminder of "It is detected that an item has dropped. Do you need intelligent driving intervention?" to the driver through the in - vehicle voice device and the display device.

[0078] Further, the electronic device can execute the vehicle driving intervention operation in response to the user's permission - to - intervene instruction.

[0079] For example, after the electronic device sends a dropping reminder to the driver, it can receive the user's permission - to - intervene instruction. The permission - to - intervene instruction can be a control instruction issued by the user through voice (such as "Enable intelligent driving intervention") or a control instruction issued by the user through a click operation on the in - vehicle physical control. After receiving the user's permission - to - intervene instruction, the electronic device executes the vehicle driving intervention operation in response to this permission - to - intervene instruction.

[0080] Optionally, S120 may specifically include: if the judgment result is that the target worn item has dropped, controlling the vehicle to maintain its driving state.

[0081] In the embodiments of the present disclosure, after the electronic device makes a judgment, if the judgment result is that a target worn item has fallen, such as detecting that the glasses worn by the driver have fallen, at this time, the electronic device can control the vehicle to maintain its driving state. For example, the electronic device can intervene in the vehicle to control the vehicle to maintain the lane, the steering wheel, etc., which is not limited here.

[0082] Optionally, after the judgment result is that a target worn item has fallen, before performing the vehicle driving intervention operation, the driving assistance reminder control method may further include: obtaining the body posture information and driving sight information of the driver in real time; based on the body posture information and the driving sight information, judging whether the driver has lost the basic driving ability; if it is determined that the driver has lost the basic driving ability, perform the high-level full takeover intervention operation of autonomous driving.

[0083] In the embodiments of the present disclosure, the electronic device can obtain the body posture information and driving sight information of the driver in real time.

[0084] Optionally, the body posture information may be information about various body limb postures corresponding to the driver.

[0085] Optionally, the driving sight information may be the visual field range that the driver can observe during driving.

[0086] Specifically, the electronic device can obtain the body posture information and driving sight information of the driver in real time. For example, it can obtain the images, radar and other data related to the driver through in-vehicle cameras, radars, etc., and analyze and process the relevant data to obtain the body posture information and driving sight information of the driver.

[0087] Furthermore, the electronic device can judge whether the driver has lost the basic driving ability based on the body posture information and the driving sight information.

[0088] Specifically, the electronic device can judge whether the driver has lost the basic driving ability through the obtained body posture information and the driving sight information. For example, it can judge whether there are drastic changes in various body limb postures of the driver through the body posture information, and judge whether the driver has lost the safe driving visual field through the driving sight information, so as to judge whether the driver has lost the basic driving ability.

[0089] Furthermore, if it is determined that the driver has lost the basic driving ability, perform the high-level full takeover intervention operation of autonomous driving. This high-level full takeover intervention operation of autonomous driving can be that the electronic device completely takes over the vehicle driving operation and does not require the driver to control.

[0090] Thus, when it is determined that the driver has lost the basic driving ability, perform the high-level full takeover intervention operation of autonomous driving, so as to ensure that the vehicle safely enters the safe area and reduce the accident risk.

[0091] Optionally, S130 may specifically include: obtaining real-time information on the vehicle's surrounding environment, and modifying the temporary navigation route in accordance with the preset route priority by combining the surrounding environment information and the vehicle positioning information.

[0092] In an embodiment of the present disclosure, the electronic device may obtain real-time information on the vehicle's surrounding environment, and modify the temporary navigation route in accordance with the preset route priority by combining the surrounding environment information and the vehicle positioning information.

[0093] Specifically, the electronic device may collect real-time information on the vehicle's surrounding environment through an external lidar of the vehicle, and modify the temporary navigation route in accordance with the preset route priority by combining the surrounding environment information and the vehicle positioning information. For example, before the glasses fall, the vehicle travels according to the navigation route. After the glasses fall, the electronic device combines the surrounding environment information and the vehicle positioning information to modify the temporary navigation route. The preset route priority includes: safe lane (no space for extension), getting off the highway at the nearest highway exit (farther than the server for extension), and the nearest service area (the above three have priority in sequence, and the second and third items take the nearest distance).

[0094] Optionally, after the determination result indicates that a dropping event of the target wearable item has occurred and before performing the vehicle driving intervention operation, the driving assistance reminder control method may further include: obtaining real-time health status data of the driver, and performing a health status determination based on the health status data to obtain a corresponding health status determination result; if the health status determination result indicates that the driver has a sudden health condition, uploading the health status determination result, the health status data, and the vehicle's real-time positioning to the cloud.

[0095] In an embodiment of the present disclosure, the electronic device may obtain real-time health status data of the driver, and perform a health status determination based on the health status data to obtain a corresponding health status determination result.

[0096] Specifically, the electronic device may obtain real-time health status data of the driver through an in-vehicle health monitoring device, and perform a health status determination based on the health status data. If the data is 0, subsequent functions are abandoned. If the data is 1, it is determined that a sudden health condition has occurred, and a corresponding health status determination result is obtained.

[0097] Further, if the health status determination result indicates that the driver has a sudden health condition, the electronic device may upload the health status determination result, the health status data, and the vehicle's real-time positioning to the cloud, classify the data (pupil, respiration, heart rate, blood pressure, blood oxygen data), and may also send the health status data and the health status determination result to the nearest ambulance.

[0098] Thus, it is possible to determine whether the drop is accidental or an incidental effect caused by a health problem, ensuring accurate determination in both scenarios and the accuracy of subsequent rescue and takeover services.

[0099] Optionally, the driving assistance reminder control method may further include: performing safety reminders for the occupants inside the vehicle through in-vehicle multimedia devices; performing safety reminders for nearby vehicles through out-vehicle multimedia devices and lighting devices.

[0100] In an embodiment of the present disclosure, the electronic device may perform safety reminders for the occupants inside the vehicle through in-vehicle multimedia devices.

[0101] Specifically, after determining that a drop event of the target worn item has occurred, the electronic device may perform safety reminders for the occupants inside the vehicle through in-vehicle multimedia devices, such as through the in-vehicle screen and speakers, to perform safety reminders for the driver in the form of sound and text. The reminder content may be "Glasses drop detected, safety protection for driving has been activated", etc., which is not limited herein.

[0102] Furthermore, the electronic device may perform safety reminders for nearby vehicles through out-vehicle multimedia devices and lighting devices.

[0103] Specifically, after determining that a drop event of the target worn item has occurred, the electronic device may perform safety reminders for nearby vehicles through out-vehicle multimedia devices and lighting devices, such as immediately turning on the hazard lights outside the vehicle and increasing the notification intensity for nearby vehicles by increasing the frequency of the hazard lights and the loudness of the out-vehicle speakers.

[0104] Figure 2 It is a schematic flowchart of another driving assistance reminder control method provided by an embodiment of the present disclosure.

[0105] As Figure 2 shown, when the driver is driving the vehicle (with the assistance function enabled by default), the electronic device may continuously obtain the image information corresponding to the driver through the in-vehicle camera, such as continuously collecting multiple picture data corresponding to the driver through the in-vehicle camera, and obtain the radar information corresponding to the driver through the in-vehicle radar, such as collecting multiple radar data corresponding to the driver through the in-vehicle radar. The target worn item is obtained through identification processing of the image information, such as performing image recognition through the collected multiple picture data to identify myopia glasses, sunglasses, etc. in the pictures, and then the position of the target worn item is obtained through capture processing of the radar information, such as obtaining the position information of myopia glasses, sunglasses and other target worn items through multiple radar data.

[0106] Further, the vehicle body processor identifies whether the target worn item has been displaced based on the image information and radar information; if it is identified that the target worn item has been displaced, it is determined that the judgment result is that the target worn item has fallen, such as the driver's myopia glasses, sunglasses, etc. have fallen; otherwise, it is determined that the judgment result is that the target worn item has not fallen.

[0107] Further, after the electronic device determines that the target worn item has fallen, it can give a safety reminder to the vehicle occupants through the in-vehicle multimedia device, such as through the in-vehicle screen and speakers, to give the driver a safety reminder to the vehicle occupants in the form of sound and text. The reminder content can be "Glasses drop detected, safety protection for driving has been activated", etc., which is not limited here. It can give a safety reminder to nearby vehicles through the out-vehicle multimedia device and lighting device, such as turning on the out-vehicle hazard lights immediately, and increasing the notification intensity to nearby vehicles by increasing the frequency of the hazard lights and the loudness of the out-vehicle speakers.

[0108] Further, after the electronic device makes a judgment, if the judgment result is that the target worn item has fallen, such as detecting that the glasses worn by the driver have fallen, at this time the electronic device can control the vehicle to maintain its driving state. For example, the electronic device can intervene in the vehicle and control the vehicle to maintain lane keeping, steering wheel keeping, etc., which is not limited here.

[0109] Further, the electronic device can obtain the driver's body posture information and driving line of sight information in real time. For example, it obtains relevant image, radar and other data related to the driver through in-vehicle cameras, radars, etc., and analyzes and processes the relevant data to obtain the driver's body posture information and driving line of sight information. Based on the obtained body posture information and the driving line of sight information, it is judged whether the driver has lost the basic driving ability. For example, it is judged whether there are drastic changes in the various limb postures of the driver through the body posture information, and it is judged whether the driver has lost the safe driving field of view through the driving line of sight information, so as to judge whether the driver has lost the basic driving ability. If it is determined that the driver has lost the basic driving ability, an advanced full takeover intervention operation for autonomous driving is executed. This advanced full takeover intervention operation for autonomous driving can be that the electronic device completely takes over the vehicle driving operation and does not require the driver to control.

[0110] Furthermore, the electronic device can collect the vehicle's surrounding environment information in real time through an external laser radar, and modify the temporary navigation route according to the preset route priority in combination with the surrounding environment information and the vehicle positioning information. For example, before the glasses fall off, the vehicle travels according to the navigation route. After the glasses fall off, the electronic device modifies the temporary navigation route in combination with the surrounding environment information and the vehicle positioning information. The preset route priorities include: safe lane (no space extension), the nearest highway exit (farther than the server extension), and the nearest service area (the above three have a priority order, the second and third items take the closest distance).

[0111] Furthermore, the electronic device can obtain the driver's health status data in real time through the in-vehicle health monitoring device, and make a health status judgment based on the health status data. If the data is 0, the subsequent functions are abandoned. If the data is 1, it is judged as a health emergency and the corresponding health status judgment result is obtained. If the health status judgment result is that the driver has a health emergency, the electronic device can upload the health status judgment result, the health status data and the real-time positioning of the vehicle to the cloud, and classify the data (pupil, respiration, heart rate, blood pressure, blood oxygen data), and can also send the health status data and health status judgment result to the nearest ambulance.

[0112] Figure 3 is a schematic diagram of the structure of a driving assistance reminder control device provided by an embodiment of the present disclosure, and the driving assistance reminder control device can be understood as the above-mentioned vehicle or a part of the functional modules in the above-mentioned vehicle. Figure 3 As shown, the driving assistance reminder control device 300 includes:

[0113] The first processing module 310 is used to obtain the target worn item information of the driver in real time, and perform identification and judgment processing on the target worn item information to obtain a corresponding judgment result.

[0114] The first control module 320 is used to execute a vehicle driving intervention operation if the judgment result is that the target worn article has fallen off, and the vehicle driving intervention operation is used to intervene in the vehicle driving control.

[0115] The second processing module 330 is used to obtain the vehicle's surrounding environment information in real time and determine a temporary navigation route according to the surrounding environment information.

[0116] The second control module 340 is used to control the vehicle to perform automatic driving according to the temporary navigation route.

[0117] In an example, the first processing module 310 may specifically include:

[0118] A first acquisition unit is configured to acquire, in real time through an in-vehicle camera, image information corresponding to the driver, and acquire, through an in-vehicle radar, radar information corresponding to the driver.

[0119] A first processing unit is configured to perform item type recognition based on the image information to obtain the target worn item and determine whether the position of the target worn item has changed.

[0120] A second processing unit is configured to, if it is recognized that the position of the target worn item has changed, capture displacement distance information of the target worn item through the radar information and make a judgment.

[0121] A first determination unit is configured to, when the displacement distance information meets a preset item dropping condition, determine that the judgment result is that the target worn item has dropped.

[0122] A second determination unit is configured to, otherwise, determine that the judgment result is that the target worn item has not dropped.

[0123] In one example, the first processing module 310 may specifically include:

[0124] A reminder sending unit is configured to send a dropping reminder to the driver through an in-vehicle multimedia device;

[0125] An operation execution unit is configured to execute the vehicle driving intervention operation in response to a user's permission intervention instruction.

[0126] In one example, the first control module 320 may specifically include:

[0127] A vehicle control unit is configured to, if the judgment result is that the target worn item has dropped, control the vehicle to maintain its driving state.

[0128] In one example, the driving assistance reminder control device 300 may further include:

[0129] A first acquisition module is configured to acquire, in real time, the driver's body posture information and driving line-of-sight information.

[0130] An information judgment module is configured to judge, based on the body posture information and the driving line-of-sight information, whether the driver has lost basic driving ability.

[0131] A third control module is configured to, if it is determined that the driver has lost basic driving ability, execute a high-level full takeover intervention operation for autonomous driving.

[0132] In one example, the second processing module 330 may specifically include:

[0133] A second acquisition unit, configured to acquire vehicle surrounding environment information in real time, and modify a temporary navigation route according to a preset route priority by combining the surrounding environment information and vehicle positioning information.

[0134] In one example, the driving assistance reminder control device 300 may further include:

[0135] A second acquisition module, configured to acquire the health status data of the driver in real time, and perform a health status judgment based on the health status data to obtain a corresponding health status judgment result.

[0136] A data upload module, configured to upload the health status judgment result, the health status data, and the vehicle's real-time positioning to the cloud if the health status judgment result indicates that the driver has a health emergency.

[0137] In one example, the driving assistance reminder control device 300 may further include:

[0138] A first reminder module, configured to perform in-vehicle personnel safety reminders through in-vehicle multimedia devices.

[0139] A second reminder module, configured to perform nearby vehicle safety reminders through out-of-vehicle multimedia devices and lighting devices.

[0140] The device provided in this embodiment can execute the method of any of the above embodiments, and its execution manner and beneficial effects are similar, which will not be elaborated here.

[0141] This disclosure embodiment also provides a vehicle, which includes: a memory storing a computer program; a processor configured to execute the computer program, and when the computer program is executed by the processor, the method of any of the above embodiments can be implemented.

[0142] Exemplarily, Figure 4 is a schematic structural diagram of a vehicle in this disclosure embodiment. The following specifically refers to Figure 4 , which shows a schematic structural diagram suitable for implementing the vehicle 1000 in this disclosure embodiment. The vehicle 1000 in this disclosure embodiment may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Tablet Computers), PMPs (Portable Multimedia Players), vehicle terminals (such as vehicle navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 4 The vehicle shown is only an example and should not impose any limitation on the functions and usage scope of this disclosure embodiment.

[0143] Such as Figure 4As shown, the vehicle 1000 may include a processing device (such as a central processing unit, a graphics processing unit, etc.) 1001, which may perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1002 or a program loaded from a storage device 1008 into a random access memory (RAM) 1003. In the RAM 1003, various programs and data required for the operation of the vehicle 1000 are also stored. The processing device 1001, the ROM 1002, and the RAM 1003 are connected to each other via a bus 1004. An input / output (I / O) interface 1005 is also connected to the bus 1004.

[0144] Generally, the following devices may be connected to the I / O interface 1005: an input device 1006 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 1007 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 1008 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1009. The communication device 1009 may allow the vehicle 1000 to communicate with other devices wirelessly or wirelessly to exchange data. Although Figure 4 a vehicle 1000 with various devices is shown, it should be understood that it is not required to implement or have all the shown devices. Instead, more or fewer devices may be implemented or had.

[0145] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart may be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program includes program codes for performing the method shown in the flowchart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication device 1009, or installed from the storage device 1008, or installed from the ROM 1002. When the computer program is executed by the processing device 1001, the above functions defined in the method of the embodiment of the present disclosure are executed.

[0146] It should be noted that the above-mentioned computer-readable medium in the present disclosure can be a computer-readable signal medium, a computer-readable storage medium, or any combination of the two. A computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples of the computer-readable storage medium can include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium can be any tangible medium that contains or stores a program, and this program can be used by or in combination with an instruction execution system, apparatus, or device. In the present disclosure, a computer-readable signal medium can include a data signal propagated in a baseband or as part of a carrier wave, in which computer-readable program code is carried. Such a propagated data signal can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium can also be any computer-readable medium other than a computer-readable storage medium, and this computer-readable signal medium can send, propagate, or transmit a program for use by or in combination with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0147] In some embodiments, the client and the server can communicate using any currently known or future-developed network protocol such as HTTP (HyperText Transfer Protocol), and can be interconnected with digital data communication in any form or medium (e.g., a communication network). Examples of communication networks include local area networks (“LAN”), wide area networks (“WAN”), the Internet (e.g., the Internet), and end-to-end networks (e.g., ad hoc end-to-end networks), as well as any currently known or future-developed networks.

[0148] The above-mentioned computer-readable medium can be included in the above vehicle; it can also exist separately and not be assembled into the vehicle.

[0149] The above computer-readable medium carries one or more programs, which, when executed by the vehicle, cause the vehicle to: calculate the average power consumption corresponding to the distance to the nearest driving target of the vehicle itself; within a pre-defined area, receive the regional reference power consumption and the upper and lower floating ranges sent by the cloud; calculate the estimated dynamic energy consumption based on the average power consumption and the regional reference power consumption, and calculate the estimated driving range based on the remaining available electric energy and the estimated dynamic energy consumption, where the estimated dynamic energy consumption conforms to the upper and lower floating ranges; and update the displayed cruising range value based on the estimated driving range.

[0150] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages or combinations thereof. The programming languages include, but are not limited to, object-oriented programming languages such as Java, Smalltalk, C++, and also include conventional procedural programming languages such as the "C" language or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, executed as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., by connecting through an Internet service provider using the Internet).

[0151] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, a program segment, or a part of code that contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than marked in the accompanying drawings. For example, two consecutive blocks shown may actually be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and / or flowchart, and combinations of blocks in the block diagram and / or flowchart, may be implemented by a dedicated hardware-based system for performing the specified functions or operations, or may be implemented by a combination of dedicated hardware and computer instructions.

[0152] The units described in the embodiments of the present disclosure may be implemented in software or in hardware. Among them, the name of the unit does not, in some cases, constitute a limitation on the unit itself.

[0153] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0154] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0155] The embodiments of the present disclosure also provide a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a processor, the method of any of the above embodiments can be implemented. The execution method and beneficial effects are similar and will not be repeated here.

[0156] It should be noted that, in this article, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0157] The above are only specific embodiments of the present disclosure, enabling those skilled in the art to understand or implement the present disclosure. Various modifications to these embodiments will be obvious to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure will not be limited to these embodiments described herein, but rather will be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A driving assistance reminder control method, characterized in that, Including: Obtain the target wearing item information of the driver in real time, and perform identification and judgment processing on the target wearing item information to obtain a corresponding judgment result; If the judgment result is that a falling event of the target wearing item occurs, perform a vehicle driving intervention operation, and the vehicle driving intervention operation is used to intervene in the vehicle for driving control; Obtain the vehicle surrounding environment information in real time, and determine a temporary navigation route according to the surrounding environment information; Control the vehicle to perform autonomous driving according to the temporary navigation route.

2. The method according to claim 1, wherein The obtaining the target wearing item information of the driver in real time and performing identification and judgment processing on the target wearing item information includes: Obtain the corresponding image information of the driver in real time through an in-vehicle camera, and obtain the corresponding radar information of the driver through an in-vehicle radar; Perform item type recognition based on the image information to obtain the target wearing item and judge whether the position of the target wearing item has changed; If it is recognized that the position of the target wearing item has changed, capture the displacement distance information of the target wearing item through the radar information and judge; When the displacement distance information meets the preset item falling condition, determine that the judgment result is that a falling event of the target wearing item occurs; Otherwise, determine that the judgment result is that the target wearing item has not had a falling event.

3. The method according to claim 2, characterized in that, After the judgment result is that a falling event of the target wearing item occurs, the method further includes: Send a falling reminder to the driver through an in-vehicle multimedia device; In response to the user's permission intervention instruction, perform the vehicle driving intervention operation.

4. The method according to claim 1, characterized in that If the judgment result is that a falling event of the target wearing item occurs, performing a vehicle driving intervention operation includes: If the judgment result is that a falling event of the target wearing item occurs, control the vehicle to maintain its driving state.

5. The method according to claim 1, wherein After the judgment result is that a falling event of the target wearing item occurs and before performing the vehicle driving intervention operation, the method further includes: Obtain the driver's body posture information and driving line-of-sight information in real time; Based on the body posture information and the driving line-of-sight information, judge whether the driver has lost basic driving ability; If it is determined that the driver has lost basic driving ability, perform an autonomous driving high-level full takeover intervention operation.

6. The method according to claim 1, wherein The obtaining the vehicle surrounding environment information in real time and determining a temporary navigation route according to the surrounding environment information includes: Obtain the vehicle surrounding environment information in real time, and modify the temporary navigation route according to the surrounding environment information and the vehicle positioning information according to the preset route priority.

7. The method according to claim 1, wherein After the judgment result is that a falling event of the target wearing item occurs and before performing the vehicle driving intervention operation, the method further includes: Obtain the driver's health status data in real time, and perform a health status judgment based on the health status data to obtain a corresponding health status judgment result; If the health status judgment result is that the driver has a sudden health condition, upload the health status judgment result, the health status data, and the vehicle's real-time positioning to the cloud.

8. The method according to any one of claims 1 to 7, characterized in that The method further includes: Perform safety reminders for the vehicle occupants through an in-vehicle multimedia device; Perform safety reminders for nearby vehicles through an out-of-vehicle multimedia device and lighting devices.

9. A driving assistance reminder control device, characterized in that, The device includes: A first processing module, configured to obtain the target wearing item information of the driver in real time, and perform identification and judgment processing on the target wearing item information to obtain a corresponding judgment result; A first control module, configured to perform a vehicle driving intervention operation if the judgment result is that a target wearing item dropping event occurs, and the vehicle driving intervention operation is used to intervene in the vehicle for driving control; A second processing module, configured to obtain the vehicle surrounding environment information in real time, and determine a temporary navigation route according to the surrounding environment information; A second control module, configured to control the vehicle to perform autonomous driving according to the temporary navigation route.

10. A vehicle, characterized in that, It includes: A processor and a memory, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the processor executes the method according to any one of claims 1-8.

Images