Anti-fatigue driving reminding method and system and electronic equipment

Abstract

The invention provides an anti-fatigue driving reminding method and system and electronic equipment, and belongs to the technical field of automobile anti-fatigue driving. The method comprises the steps that face information of a driver is acquired; judging whether the driver has a fatigue driving behavior or not according to the facial information; when it is judged that the driver is in fatigue driving, calling interaction reminding is conducted on the driver; and when an interactive response of the driver is not received within a first preset duration after calling interactive reminding is carried out on the driver, automatic driving is started to take over the vehicle. Whether the driver has the fatigue driving behavior or not can be detected, interesting interaction operation such as call reminding can be carried out through the voice assistant, the driving experience of the driver is not affected, the driver can be helped to improve attention, and traffic accidents are reduced. According to the invention, after the interaction function of the intelligent AI voice assistant is used for reminding, the automatic driving mode is entered when the user fails to correctly interact, so that the accident risk is reduced.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of anti-fatigue driving of automobile, and particularly relates to an anti-fatigue driving reminding method and system and an electronic device. BACKGROUND

[0002] With the development of intelligent automobile, the anti-fatigue function is more and more popular due to the beneficial effects of effectively reducing the accident rate and ensuring the safety of personnel. However, the current anti-fatigue function design mainly includes two parts: one is anti-fatigue detection; the other is fatigue reminding when detecting fatigue driving of the driver.

[0003] The current fatigue reminding is mostly concentrated on the one-way output of the reminding module, such as playing preset voice reminding information through the vehicle-mounted audio, vibrating the steering wheel to remind, and reminding through the light in the vehicle. However, it is found in actual application that the driver cannot respond well after the one-way output of the reminding module, which leads to the fact that the reminding effect is not obvious, and further leads to the fact that the driver still has a high risk of accidents. SUMMARY

[0004] The present application aims to solve at least one of the technical problems in the prior art, and provides an anti-fatigue driving reminding method and system and an electronic device, which solves the problem that the prior art only performs one-way output of the reminding module and ignores the interactive response of the driver when the driver is fatigue driving.

[0005] In a first aspect, an anti-fatigue driving reminding method is provided, which comprises:

[0006] obtaining face information of the driver;

[0007] judging whether the driver has fatigue driving behavior according to the face information;

[0008] calling the driver for interactive reminding when it is judged that the driver is fatigue driving;

[0009] starting automatic driving to take over the vehicle when no interactive response of the driver is received within a first preset time period after calling the driver for interactive reminding.

[0010] In a preferred embodiment, it further comprises:

[0011] obtaining at least one modal data of the target vehicle;

[0012] adjusting the execution frequency of obtaining the face information of the driver and judging whether the driver has fatigue driving behavior according to the face information according to the at least one modal data.

[0013] In a preferred embodiment, the at least one modal data comprises at least one of vehicle driving information, temperature inside the vehicle, light intensity inside the vehicle, and sound inside the vehicle.

[0014] In a preferred embodiment, the step of adjusting the execution frequency of acquiring the facial information of the driver and determining whether the driver has the fatigue driving behavior according to the facial information according to the at least one modal data comprises:

[0015] increasing the execution frequency in response to the vehicle speed and / or the steering wheel angle recorded in the vehicle driving information not changing for a second preset time duration; and / or,

[0016] increasing the execution frequency in response to the temperature inside the vehicle being higher than a preset temperature threshold; and / or,

[0017] increasing the execution frequency in response to the light intensity inside the vehicle being lower than a preset light intensity threshold; and / or,

[0018] increasing the execution frequency in response to the sound inside the vehicle being lower than a preset sound intensity threshold for a third preset time duration.

[0019] In a preferred embodiment, the step of determining whether the driver has the fatigue driving behavior according to the facial information comprises:

[0020] determining that the driver has the fatigue driving behavior in response to the facial information of the driver not being acquired for a fourth preset time duration; and / or,

[0021] when the facial information of the driver is acquired and the facial information comprises eye information of the driver, determining whether the driver has the fatigue driving behavior according to the eye information;

[0022] wherein the eye information comprises a blink frequency and an eye size, and when the blink frequency is less than a preset frequency threshold and the eye size is less than a preset size threshold, it is determined that the driver has the fatigue driving behavior.

[0023] In a preferred embodiment, after the driver is called for interactive reminder, a wake-up interactive test is performed on the driver in response to an interactive response of the driver being received within a first preset time duration after the driver is called for interactive reminder;

[0024] when the driver fails the wake-up interactive test, the step of starting the automatic driving to take over the vehicle is performed;

[0025] when the driver passes the wake-up interactive test, the step of acquiring the facial information of the driver is performed again.

[0026] In a preferred embodiment, after the step of starting the automatic driving to take over the vehicle, further comprising:

[0027] performing an alarm prompt;

[0028] in response to not receiving a feedback response of the driver within a fifth preset time period after performing the alarm prompt, performing an alarm operation, and / or contacting a pre-stored emergency contact and authorizing the emergency contact to take over the vehicle.

[0029] In a preferred embodiment, before obtaining the facial information of the driver, further comprising:

[0030] At the start of the vehicle, adjusting the working angle of the face collection module for obtaining the facial information of the driver, and keeping the working angle of the face collection module fixed after adjustment.

[0031] In a preferred embodiment, the present application provides a fatigue driving prevention reminding system, which is configured to implement any of the methods of the first aspect, and the fatigue driving prevention reminding system comprises:

[0032] a face collection module for obtaining the facial information of the driver;

[0033] a fatigue driving detection module for judging whether the driver has a fatigue driving behavior according to the facial information;

[0034] a voice assistant module for calling and interacting with the driver to remind when the driver has a fatigue driving behavior;

[0035] an automatic driving module for starting the automatic driving to take over the vehicle when no interaction response of the driver is received within a first preset time period after calling and interacting with the driver to remind.

[0036] In a preferred embodiment, the present application provides an electronic device, which comprises:

[0037] one or more processors;

[0038] a memory for storing one or more programs;

[0039] when the one or more programs are executed by the one or more processors, the one or more processors implement any of the methods of the first aspect.

[0040] The present application can update the monitoring frequency of fatigue driving according to the current environment in the vehicle, improve the accuracy of monitoring, and detect whether the driver has a fatigue driving behavior. The voice assistant can call and remind through interesting interactive operations. The appropriate reminder of the voice assistant will not affect the driving experience of the driver, and can help the driver improve attention and reduce traffic accidents.

[0041] The present application enters an automatic driving mode after a reminder using an interaction function of an intelligent AI voice assistant and when the user fails to interact correctly, reducing the risk of accidents. BRIEF DESCRIPTION OF DRAWINGS

[0042] Figure 1 A fatigue driving prevention reminding method flowchart provided for an embodiment of the present application;

[0043] Figure 2 A flowchart of an optional specific implementation method of the step of adjusting the execution frequency in the embodiment of the present application;

[0044] Figure 3 A structure block diagram of a fatigue driving prevention reminding system provided for an embodiment of the present application;

[0045] Figure 4 A fatigue driving prevention reminding method flowchart provided for an embodiment of the present application;

[0046] Figure 5 A structure block diagram of an electronic device provided for an embodiment of the present application. DETAILED DESCRIPTION

[0047] To make the skilled in the art better understand the technical solutions of the present application, the following describes exemplary embodiments of the present application in conjunction with the drawings, including various details of the embodiments of the present application to help understanding, which should be considered only as exemplary. Therefore, those of ordinary skill in the art should realize that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of the present application. Also, for the sake of clarity and conciseness, the description below omits the description of well-known functions and structures.

[0048] In the case of no conflict, the embodiments of the present application and the features in the embodiments can be combined with each other.

[0049] As used herein, the term "and / or" includes any and all combinations of one or more of the associated listed items.

[0050] The terms used herein are only used to describe specific embodiments and are not intended to limit the present application. As used herein, the singular forms "a" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that the terms "comprise" and / or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and / or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof. The terms "connected" or "coupled" and / or like terms are not limited to a direct connection or coupling, but also include an indirect connection or coupling, whether or not it is physical, mechanical, electrical, and / or the like.

[0051] Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and the present disclosure and will not be interpreted in an overly literal or overly formal sense unless expressly so defined herein.

[0052] In the technical solutions of the present application, the collection, storage, use, processing, transmission, provision and disclosure of user personal information comply with relevant laws and regulations and do not violate public order and good customs. The use of user data in the technical solutions complies with relevant national laws and regulations (for example, "Information Security Technology Personal Information Security Specification" and the like). For example, appropriate measures are taken for personal information access control; the display of personal information is limited by regulations; the use purpose of personal information does not exceed the direct or reasonably related range; and the use of personal information eliminates explicit identity pointing and avoids precise positioning to a specific individual.

[0053] With the gradual application of intelligent AI voice assistants on car machines, people use voice assistants more and more frequently during driving. The interaction between drivers and voice assistants undoubtedly improves the driving experience of drivers, and the response processing of voice assistants enables drivers to focus on driving and reduces safety risks during driving.

[0054] The reminding module in the prior art does not explicitly indicate how to release the reminding module after reminding. If manual release is required, it will increase the safety risk during driving. If automatic release is required, the length of the reminding duration will affect the driving experience. If the reminding time is too long, it will affect the driving mood of the driver and cause safety risks. If the reminding time is too short, it will not achieve the effect of eliminating fatigue, and the driver will easily enter the fatigue driving state again, and the scene factors of the driver are ignored.

[0055] To solve at least one of the technical problems in the related art, the present application provides a fatigue driving prevention reminding method. Figure 1 A flowchart of a fatigue driving prevention reminding method provided by an embodiment of the present application is shown in FIG. Figure 1 As shown in the figure, the method comprises the following steps.

[0056] Obtaining facial information of the driver;

[0057] Determining whether the driver has fatigue driving behavior according to the facial information;

[0058] Calling the driver for interactive reminding when it is determined that the driver has fatigue driving behavior;

[0059] In a first preset time period after the driver is called for interactive reminder, if no interactive response of the driver is received, the automatic driving is started to take over the vehicle.

[0060] In some embodiments, further comprising:

[0061] Obtaining at least one modal data of the target vehicle;

[0062] Adjusting the execution frequency of obtaining the facial information of the driver and judging whether the driver has fatigue driving behavior according to the facial information according to the at least one modal data.

[0063] In some embodiments, the at least one modal data comprises at least one of vehicle driving information, temperature in the vehicle, light intensity in the vehicle, and sound in the vehicle.

[0064] In some embodiments, as Figure 2 shown, the step of adjusting the execution frequency of obtaining the facial information of the driver and judging whether the driver has fatigue driving behavior according to the facial information according to the at least one modal data comprises:

[0065] in response to the vehicle speed and / or the steering wheel angle recorded in the vehicle driving information not changing for a second preset time period, increasing the execution frequency; and / or,

[0066] in response to the temperature in the vehicle being higher than a preset temperature threshold, increasing the execution frequency; and / or,

[0067] in response to the light intensity in the vehicle being lower than a preset light intensity threshold, increasing the execution frequency; and / or,

[0068] in response to the sound in the vehicle being lower than a preset sound intensity threshold for a third preset time period, increasing the execution frequency.

[0069] The basis for increasing the fatigue driving monitoring execution frequency is:

[0070] 1. The current temperature in the vehicle: especially in winter when the heater is turned on, it is more likely to cause fatigue, and it is easy to make the driver lose concentration and fall into a state of drowsiness;

[0071] 2. The current light in the vehicle: in the case of dim light in the vehicle, such as driving in a long tunnel or driving at night, the driver is more likely to feel tired and cause traffic accidents;

[0072] 3. The current sound in the vehicle: if there is no sound in the vehicle for a long time, the driver is more likely to lose concentration and more likely to have fatigue driving in the case of long-term silence;

[0073] 4. Current vehicle driving information: long time driving, especially long distance driving, long time without speed or steering wheel change, etc. can be used as a reference condition for fatigue driving. In this scenario, the risk of driver fatigue driving is relatively high.

[0074] In some embodiments, the step of determining whether the driver has fatigue driving behavior according to the face information comprises:

[0075] In response to not collecting the face of the driver for a fourth preset time period, it is determined that the driver has fatigue driving behavior; and / or,

[0076] When the face of the driver is detected and the face information includes eye information of the driver, it is determined whether the driver has fatigue driving behavior according to the eye information.

[0077] The eye information includes blink frequency and eye size. When the blink frequency is less than a preset frequency threshold and the eye size is less than a preset size threshold, it is determined that the driver has fatigue driving behavior.

[0078] When there is fatigue driving, the driver's posture will change, which will cause the face collection system to fail to collect the face for a long time. Therefore, not collecting the face of the driver within the preset time period can be used as a fatigue driving detection condition.

[0079] When there is fatigue driving, the eye state of the driver will change, and inattention will cause the eyes to be unable to open continuously. Therefore, the change of the blink frequency and the eye size of the driver can be used as a fatigue driving detection condition.

[0080] In some embodiments, after calling the driver for interaction reminder, in response to receiving an interaction response of the driver within a first preset time period, a clear interaction test is performed on the driver.

[0081] When the driver fails the clear interaction test, the step of starting the automatic driving to take over the vehicle is performed.

[0082] When the driver passes the clear interaction test, the step of obtaining the face information of the driver is performed again.

[0083] In some embodiments, after the step of starting the automatic driving to take over the vehicle, the method further comprises:

[0084] Performing an alarm reminder.

[0085] In response to not receiving a feedback response of the driver within a fifth preset time period after the alarm reminder is performed, performing an alarm operation, and / or contacting a pre-stored emergency contact and authorizing the emergency contact to take over the vehicle.

[0086] In some embodiments, before acquiring the facial information of the driver, further comprising:

[0087] When the vehicle starts, the working angle of the face collection module for acquiring the facial information of the driver is adjusted, and the working angle of the face collection module is kept fixed after the adjustment.

[0088] Based on the same inventive concept, the embodiments of the present application also provide a fatigue driving prevention reminding system configured to implement the method of any of the above embodiments, the fatigue driving prevention reminding system comprising:

[0089] a face collection module for acquiring facial information of the driver;

[0090] a fatigue driving detection module for judging whether the driver has fatigue driving behavior according to the facial information;

[0091] a voice assistant module for calling and interacting with the driver to remind when it is judged that the driver has fatigue driving;

[0092] an automatic driving module for starting automatic driving to take over the vehicle when no interaction response of the driver is received within a first preset time period after calling and interacting with the driver to remind.

[0093] Figure 3 A structural block diagram of a fatigue driving prevention reminding system provided by the embodiments of the present application.

[0094] As an embodiment of the present application, as shown in the figure, the system comprises a data collection module, a data storage module, a fatigue driving detection module, a voice assistant module, an automatic driving module and an alarm module. Figure 3

[0095] The data collection module comprises a vehicle driving information collection module, a temperature collection module, a light collection module, a sound collection module and a face collection module. The vehicle driving information collection module collects current vehicle driving information, the temperature collection module collects the temperature in the current vehicle, the light collection module collects the light intensity in the current vehicle, and the sound collection module collects the sound in the current vehicle. The face collection module collects the facial information of the driver and adjusts the angle according to the height of the driver and the driving environment. The facial information of the driver is displayed through a screen display module. When the same driver drives continuously, secondary adjustment is generally not needed; if a different driver is replaced, the screen display and the reminder are checked in detail. Different historical collection databases are established for different drivers, and if the driver has enabled fatigue driving prevention, the facial recognition model trained from the historical data is searched to promote the facial recognition of the model to be more accurate for different drivers.

[0096] ​The data collection module sends the temperature in the vehicle, the light intensity, the sound in the vehicle, the vehicle driving information and the facial information of the driver to the data storage module for storage.

[0097] The fatigue driving prevention detection module adjusts the frequency of the information obtained by the data collection module according to the temperature in the vehicle, the light intensity, the sound in the vehicle and the vehicle driving information stored in the data storage module, and judges whether the driver has the fatigue driving behavior or encounters the sudden situation according to the facial information of the driver stored in the data storage module.

[0098] The voice assistant module includes a call reminding module and an active interaction module; when the fatigue driving prevention detection module detects and judges that the driver has the fatigue driving behavior, the driver is reminded to call and has a language interaction with the driver to have an interesting chat.

[0099] The automatic driving module takes over the vehicle and automatically drives when the fatigue driving prevention detection module detects and judges that the driver encounters the sudden situation, and activates the alarm module to contact the traffic police and / or the set emergency contact person.

[0100] Figure 4 A fatigue driving prevention reminding method flowchart provided by the embodiment of the application.

[0101] As one embodiment of the application, as shown in the figure, the method includes the following steps: Figure 4

[0102] The facial collection module is actively started when the vehicle is started; the mental state of the driver is monitored through the facial collection module, and the monitoring data is stored in the data storage module; wherein the mental state includes the sitting posture of the driver and the facial information of the driver, such as the driver's humpback, low head and the like, or the frequency of blinking and the change of the size of the eye opening and closing.

[0103] The vehicle driving information collection module, the temperature collection module, the light collection module and the sound collection module in the data collection module obtain the temperature in the vehicle, the light intensity, the sound in the vehicle and the vehicle driving information, and send the collected information to the data storage module for storage.

[0104] ​The anti-fatigue driving detection module adjusts the frequency of information acquisition of the data acquisition module through the in-vehicle temperature, light intensity, in-vehicle sound and vehicle driving information stored in the data storage module. The vehicle driving information includes: speed change and steering wheel change. At the same time, whether the driver has fatigue driving behavior or encounters a sudden situation is judged according to the driver's face information stored in the data storage module; whether the driver is in a fatigue state includes: the data storage module stores the initial video and the updated video of the driver, and the anti-fatigue driving detection module collects the initial video and the updated video, compares the eye opening range, the blinking frequency and the sitting position of the driver; when the eye opening range, the blinking frequency and the sitting position of the driver exceed the set threshold value, it is judged that the driver is in a fatigue state.

[0105] Specifically, according to face recognition, if there is corresponding driver blinking frequency historical data H, initialize H. Calculate the blinking frequency mean value according to the preset time interval , if the difference value is greater than 30%, update the H value to . The preset time interval can be 5 minutes, 15 minutes, 30 minutes, etc. If the blinking frequency of the last 3 times is lower than 70% of H, fatigue monitoring condition 1 is met.

[0106] The E value is updated when the eyelid is normally opened. According to the latest generated eye key points, the E value of the eyelid opening in the normal state of the eye is calculated. The upper and lower distances of the left and right eyelids are , , then When the eye is closed, the vertical distance will decrease significantly, while the horizontal distance changes little. According to face recognition, if there is corresponding driver eyelid movement opening maximum E value, initialize E, calculate the eyelid movement maximum value according to the preset time interval , if the difference value is greater than 30%, update the E value to . The preset time interval can be 5 minutes, 15 minutes, 30 minutes, etc. If the real-time monitoring EAR maximum value of the eyelid movement is continuously reduced, and the EAR maximum value in 3 minutes is lower than 80% of the E value, fatigue monitoring condition 2 is met.

[0107] At the same time, fatigue monitoring conditions 1 and 2 are met, and it is judged that the driver is in a fatigue state.

[0108] When it is judged that the driver is in a fatigue state, the voice assistant module is started; first, activate the call reminder module to call the driver for a reminder, "Hello, car owner! I am xxx (voice assistant nickname), I detect that you may have fatigue driving, please answer when you receive it". Repeat 3 times, if the answer is detected, stop in time and start the active interaction module, generate ten questions for interaction, if the answer is correct, turn off the voice assistant module in time.

[0109] If the driver does not answer or does not correctly answer ten questions, the automatic driving module is started, and the alarm module is activated; the alarm module realizes that the vehicle-mounted app contacts the emergency contact person and dials the alarm phone.

[0110] Based on the same inventive concept, the embodiment of the present application also provides an electronic device. Figure 5 The structure block diagram of an electronic device provided by the embodiment of the present application is shown in the figure. Figure 5 As shown in the figure, the electronic device provided by the embodiment of the present application includes one or more processors 101, a memory 102, and one or more I / O interfaces 103. The memory 102 stores one or more programs, and when the one or more programs are executed by the one or more processors, the one or more processors implement the method in any of the above embodiments; the one or more I / O interfaces 103 are connected between the processor and the memory, and are configured to realize the information interaction between the processor and the memory.

[0111] Among them, the processor 101 is a device with data processing capability, including but not limited to central processing unit (CPU) and the like; the memory 102 is a device with data storage capability, including but not limited to random access memory (RAM, more specifically SDRAM, DDR, etc.), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory (FLASH); the I / O interface (read-write interface) 103 is connected between the processor 101 and the memory 102, and can realize the information interaction between the processor 101 and the memory 102, including but not limited to data bus (Bus) and the like.

[0112] In some embodiments, the processor 101, the memory 102 and the I / O interface 103 are connected with each other through the bus 104, and further connected with other components of the computing device.

[0113] In some embodiments, the one or more processors 101 include a field programmable gate array.

[0114] Those of ordinary skill in the art will realize and understand that all or some of the steps in the methods disclosed above and the functional modules / units in the systems and devices can be implemented as software, firmware, hardware, and appropriate combinations thereof. In hardware implementation, the division between the functional modules / units referred to in the above description does not necessarily correspond to the division of physical components; for example, one physical component can have multiple functions, or one function or step can be performed by several physical components in cooperation. Some or all of the physical components can be implemented as software executed by a processor, such as a central processing unit, a digital signal processor, or a microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit. Such software can be distributed on computer readable storage media, which can include computer storage media (or non-transitory media) and communication media (or transitory media).

[0115] As is well known to those of ordinary skill in the art, the term computer storage media includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable program instructions, data structures, program modules or other data. Computer storage media includes, but is not limited to, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM), static random access memory (SRAM), flash memory or other memory technology, portable compact disc read only memory (CD-ROM), digital versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store the desired information and that can be accessed by a computer. Further, it is well known to those of ordinary skill in the art that communication media typically embodies computer readable program instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media. As used herein, the term "modulated data signal" means a signal that has one or more of its characteristics changed or set in a manner so as to encode information in the signal. By way of example, and not limitation, communication media includes wired media such as a wired network or direct-wired connection, and wireless media such as wireless networks, cellular telephone networks, code division multiple access (CDMA) networks, and other terrestrial and satellite radio frequency communication networks or frequency (RF) media. Further, as used herein, the term "computer readable storage medium" includes one or more of volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable program instructions, data structures, program modules or other data. Computer readable storage media includes, but is not limited to, RAM, ROM, EPROM, EEPROM, flash memory or other memory technology, portable or fixed storage devices, optical storage, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by a computer.

[0116] Computer readable program instructions described herein can be downloaded to respective computing / processing devices from a computer readable storage medium or to an external computer or external storage device via a network, for example, the Internet, a local area network, a wide area network and / or a wireless network. The network can comprise copper transmission cables, optical transmission fibers, wireless transmission, routers, firewalls, switches, gateway computers and / or edge servers. A network adapter card or network interface in each computing / processing device receives computer readable program instructions from the network and forwards the computer readable program instructions for storage in a computer readable storage medium within the respective computing / processing device.

[0117] Computer readable program instructions for carrying out operations of the present application can be assembler instructions, instruction-set-architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state-setting data, or either source code or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C++ or the like, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The computer readable program instructions can execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection can be made to an external computer (for example, through the Internet using an Internet Service Provider). In some embodiments, electronic circuitry including, for example, programmable logic circuitry, field-programmable gate array (FPGA), or programmable logic array (PLA) can execute the computer readable program instructions by utilizing state information of the computer readable program instructions to personalize the electronic circuitry, in order to perform aspects of the present application.

[0118] The computer program product described herein can be embodied in a specific manner by hardware, software, or a combination thereof. In an optional embodiment, the computer program product is embodied as a computer storage medium. In another optional embodiment, the computer program product is embodied as a software product, such as a software development kit (SDK), and the like.

[0119] The computer program product described herein can be embodied in a specific manner by hardware, software, or a combination thereof. In an optional embodiment, the computer program product is embodied as a computer storage medium. In another optional embodiment, the computer program product is embodied as a software product, such as a software development kit (SDK), and the like.

[0120] These computer readable program instructions can be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks. These computer readable program instructions can also be stored in a computer readable storage medium that can include a non-transitory computer readable storage medium that can be a computer- readable storage medium having no data storage cycles that change state. The instructions can be executed by one or more processors of a computer, other programmable data processing apparatus, or other devices to produce a computer-implemented process such that the instructions which execute via the one or more processors of the computer or other programmable data processing devices create means for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks. The computer program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0121] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0122] The flow and block diagrams in the drawings show the architectural, functional, and operational views of possible implementations of systems, methods, and computer program products according to the present application. In this regard, each block in the flow and block diagrams can represent a module, a segment, or a portion of instructions which contain one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the blocks can occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently or the blocks may

[0123] Example embodiments have been disclosed and, although a specific terminology is employed, it is merely for the convenience of the reader and is not intended to be limiting. In some instances, specific details have been included for the purpose of providing a thorough understanding of the embodiments presented, but it will be apparent to those skilled in the art that embodiments of the application can be practiced without these specific details. In some instances, features, characteristics and / or elements described in connection with a particular embodiment can be used in conjunction with, or switched to, features, characteristics and / or elements described in connection with other embodiments, unless otherwise explicitly stated. Accordingly, it will be understood that various changes in form and details can be made without departing from the scope of the present application as set forth in the appended claims.

Claims

1. A method of drowsiness prevention reminding, characterized by, The method comprises: acquiring facial information of a driver; judging whether the driver has fatigue driving behavior according to the facial information; when it is judged that the driver has fatigue driving behavior, calling the driver for interactive reminding; when no interactive response of the driver is received within a first preset time period after the calling for interactive reminding, starting automatic driving to take over the vehicle.

2. The method of claim 1, wherein, The method further comprises: acquiring at least one modal data of the vehicle; adjusting the execution frequency of acquiring facial information of the driver and judging whether the driver has fatigue driving behavior according to the facial information according to the at least one modal data.

3. The method of claim 2, wherein, The at least one modal data comprises at least one of vehicle driving information, temperature in the vehicle, light intensity in the vehicle, and sound in the vehicle.

4. The method of claim 3, wherein, The step of adjusting the execution frequency of acquiring facial information of the driver and judging whether the driver has fatigue driving behavior according to the facial information according to the at least one modal data comprises: when a vehicle speed and / or a steering wheel angle recorded in the vehicle driving information do not change for a second preset time period, increasing the execution frequency; and / or, when the temperature in the vehicle is higher than a preset temperature threshold, increasing the execution frequency; and / or, when the light intensity in the vehicle is lower than a preset light intensity threshold, increasing the execution frequency; and / or, when the sound in the vehicle is lower than a preset sound intensity threshold for a third preset time period, increasing the execution frequency.

5. The method of claim 1, wherein, The step of judging whether the driver has fatigue driving behavior according to the facial information comprises: when no facial information of the driver is acquired for a fourth preset time period, judging that the driver has fatigue driving behavior; and / or, when facial information of the driver is detected and the facial information comprises eye information of the driver, judging whether the driver has fatigue driving behavior according to the eye information; wherein the eye information comprises a blink frequency and an eye size, and when the blink frequency is lower than a preset frequency threshold and the eye size is smaller than a preset size threshold, it is judged that the driver has fatigue driving behavior.

6. The method of claim 1, wherein, after the calling for interactive reminding, when an interactive response of the driver is received within the first preset time period, performing a sober interactive test on the driver; when the driver fails in the sober interactive test, the step of starting automatic driving to take over the vehicle is performed; when the driver passes the sober interactive test, the step of acquiring facial information of the driver is performed again.

7. The method of claim 1, wherein, after the step of starting automatic driving to take over the vehicle, the method further comprises: performing alarm reminding; when no feedback response of the driver is received within a fifth preset time period after the alarm reminding is performed, performing alarm operation and / or contacting a preset emergency contact person and authorizing the emergency contact person to take over the vehicle.

8. The method according to any one of claims 1 to 7, characterized in that, Before the step of acquiring facial information of the driver, the method further comprises: when the vehicle is started, adjusting a working angle of a facial acquisition module used for acquiring facial information of the driver, and keeping the working angle of the facial acquisition module fixed after the adjustment.

9. A drowsiness prevention reminding system characterized by comprising: The anti-fatigue driving reminding system is configured to implement the method according to any one of claims 1 to 8. a face collection module, configured to acquire face information of the driver; a fatigue driving detection module, configured to determine whether the driver has fatigue driving behavior according to the face information; a voice assistant module, configured to call and interact with the driver to remind the driver when it is determined that the driver has fatigue driving behavior; an automatic driving module, configured to start automatic driving to take over the vehicle when no interaction response of the driver is received within a first preset time length after the driver is called and interacted with to remind the driver.

10. An electronic device, comprising: comprising: one or more processors; a memory configured to store one or more programs; when the one or more programs are executed by the one or more processors, the one or more processors implement the method of any one of claims 1 to 8.

Images