An in-vehicle safety comprehensive monitoring method, system and computer device

Abstract

The application discloses the safety monitoring field, and proposes a kind of in-car safety comprehensive monitoring method, system and computer equipment, is monitored to the driving state of driver by collecting multiple information and making comprehensive judgment, to ensure that driver is in safe driving state, to improve the safety of whole vehicle driving, and then the riding behavior monitoring is carried out to the passenger, the non-safe riding behavior of passenger is identified, to avoid the situation that affects driving safety appears, and also by detecting the forgotten critical target after leaving the car, to avoid the non-safe problem after leaving the car appears, the effectiveness and practicality of in-car safety monitoring are greatly improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of safety monitoring, in particular to a kind of in-vehicle safety comprehensive monitoring method, system and computer equipment. BACKGROUND

[0002] With the rapid development of automobile industry, the safety performance requirement of vehicle is gradually improved, and the safety monitoring in vehicle is naturally the key to improve the safety performance of vehicle as an important part of the safety guarantee of vehicle and driver.

[0003] In the prior art, in-vehicle safety monitoring is usually realized by multiple monitoring cameras operating independently, but the system of the prior art has high complexity and many parts, which leads to very dispersed overall system and great arrangement difficulty, thereby causing high development cost and manufacturing cost, and when the camera operating independently carries out in-vehicle safety monitoring, it is easy to cause misjudgment or omission, resulting in low practicality and effectiveness.

[0004] Therefore, how to design an in-vehicle safety comprehensive monitoring method to improve the practicality and effectiveness of in-vehicle safety monitoring has become a problem to be solved. SUMMARY

[0005] Therefore, the purpose of the present application is to provide an in-vehicle safety comprehensive monitoring method, system and computer equipment, which comprehensively judges by collecting various information, monitors the driving state of the driver to ensure that the driver is in a safe driving state, improves the safety of the whole vehicle, and further monitors the riding behavior of the passenger, identifies the non-safe riding behavior of the passenger, avoids the impact on the safety of driving and riding, and detects the forgotten critical target after leaving the vehicle to avoid non-safe problems after leaving the vehicle. The present application greatly improves the effectiveness and practicality of in-vehicle safety monitoring.

[0006] The present application provides an in-vehicle safety comprehensive monitoring method, which comprises:

[0007] When detecting that the whole vehicle is powered on, identify the in-vehicle safety monitoring target;

[0008] According to the preset safe driving standard, judge whether the driver is in a safe driving state, if the driver is in the safe driving state, carry out comprehensive safe driving detection to send a safe driving prompt, if the driver is not in the safe driving state, carry out safe driving warning;

[0009] According to the preset safe riding standard, judge whether the passenger has non-safe riding behavior, if the passenger has the non-safe riding behavior, according to the type of non-safe riding behavior, carry out non-safe riding warning;

[0010] When it is detected that the whole vehicle is in the parking lock state, off-vehicle safety detection is performed, it is judged whether there is a critical target in the vehicle, if it is determined that there is the critical target in the vehicle, remote off-vehicle warning is performed.

[0011] In summary, according to the above-mentioned vehicle safety comprehensive monitoring method, the driving state of the driver is monitored through comprehensive judgment by collecting various information, so as to ensure that the driver is in a safe driving state and improve the safety of the whole vehicle driving. Through the monitoring of the riding behavior of the passenger, the non-safe riding behavior of the passenger is identified to avoid the impact on the driving safety. In addition, the forgotten critical target is detected after off-vehicle to avoid non-safe problems after off-vehicle. The effectiveness and practicality of the vehicle safety monitoring are greatly improved. Specifically, when it is detected that the whole vehicle is powered on, the vehicle safety monitoring target is identified to accurately focus on important targets and improve the practicality of the overall safety monitoring. According to the preset safe driving standard, it is judged whether the driver is in a safe driving state. If it is determined that the driver is in the safe driving state, comprehensive safe driving detection is performed to send a safe driving prompt. If it is determined that the driver is not in the safe driving state, safe driving warning is performed to improve the accuracy of the driving state judgment of the driver and avoid dangerous accidents caused by unsafe driving state. According to the preset safe riding standard, it is judged whether the passenger has a non-safe riding behavior. If it is determined that the passenger has the non-safe riding behavior, non-safe riding warning is performed according to the type of the non-safe riding behavior to improve the accuracy of the non-safe riding behavior judgment of the passenger and avoid dangerous accidents caused by non-safe riding behavior. When it is detected that the whole vehicle is in the parking lock state, off-vehicle safety detection is performed, it is judged whether there is a critical target in the vehicle, if it is determined that there is the critical target in the vehicle, remote off-vehicle warning is performed, which avoids major problems caused by forgetting or unsafe off-vehicle. The effectiveness and practicality of the vehicle safety monitoring are greatly improved.

[0012] Further, the step of identifying the vehicle safety monitoring target when it is detected that the whole vehicle is powered on specifically includes:

[0013] When it is detected that the whole vehicle is powered on, it is judged whether the door of the vehicle is in a closed state. If it is determined that the door of the vehicle is in the closed state, the rearview mirror image collector is started to identify the person in the vehicle.

[0014] The person in the driving position is labeled as a driver and face recognition is performed to obtain driver face information, which includes driver eye state information and driver face state information.

[0015] The passenger is marked for non-driving position tasks, and key target person identification is performed, the key target person including children and the elderly, the key target person identification first acquiring a body feature of the passenger, performing child target determination according to the body feature, then acquiring a face feature of the passenger, and performing old target determination according to the face feature.

[0016] Further, the step of judging whether the driver is in a safe driving state according to a preset safe driving standard, and if it is determined that the driver is in the safe driving state, performing comprehensive safe driving detection to send a safe driving prompt, specifically includes:

[0017] After the driver target is recognized, eye feature information of the driver target is acquired, and a driver blinking state is judged, if the driver blinking frequency duration is less than the fatigue driving blinking frequency duration in the preset safe driving standard, it is determined that the driver target is not in an eye fatigue state;

[0018] Map positioning information and driving duration information are acquired to perform comprehensive safe driving detection;

[0019] According to the map positioning information, it is judged whether the driving mileage is greater than or equal to the driving mileage threshold in the safe driving standard, if the driving mileage is greater than or equal to the driving mileage threshold in the safe driving standard, it is determined that there is a fatigue driving risk;

[0020] Or according to the driving duration information, it is judged whether the driving duration is greater than or equal to the driving duration threshold in the safe driving standard, if the driving duration is greater than or equal to the driving duration threshold in the safe driving standard, it is determined that there is a fatigue driving risk;

[0021] According to the vehicle driving route, the nearest rest area or parking area on the vehicle driving route is searched, and a safe driving prompt is given.

[0022] Further, the step of if it is determined that the driver is not in the safe driving state, performing a safe driving warning, specifically includes:

[0023] After the driver target is recognized, eye feature information of the driver target is acquired, and a driver blinking state is judged, if the driver blinking frequency duration is greater than or equal to the fatigue driving blinking frequency duration in the preset safe driving standard, it is determined that the driver target is in an eye fatigue state;

[0024] Further, the step of if it is determined that the driver is not in the safe driving state, performing a safe driving warning, specifically includes:

[0025] Obtain map positioning information, find the nearest rest area or parking area on the vehicle driving route according to the vehicle driving route, and give a safe driving warning.

[0026] Further, the step of judging whether the passenger has a non-safe riding behavior according to the preset safe riding standard, if it is determined that the passenger has the non-safe riding behavior, performing a non-safe riding warning according to the non-safe riding behavior type, specifically includes:

[0027] After recognizing the passenger target, obtain the vehicle speed information, and judge whether the current vehicle speed is greater than the idle speed threshold;

[0028] If it is determined that the current vehicle speed is greater than the idle speed threshold, obtain the limb feature information of the passenger target, and perform a dangerous touch behavior judgment of the passenger;

[0029] Judge whether the limb region of the passenger target contacts the dangerous touch region in the preset safe riding standard, the type of the dangerous touch region includes the door opening region, the door locking contact region and the vehicle gear adjustment region, if it is determined that the limb region of the passenger target contacts the dangerous touch region in the preset safe riding standard, determine the type of the non-safe riding behavior according to the type of the dangerous touch region, and perform a non-safe riding warning according to the non-safe riding behavior type.

[0030] Further, the step of obtaining the vehicle speed information after recognizing the passenger target, and judging whether the current vehicle speed is greater than the idle speed threshold, further includes:

[0031] After recognizing the passenger target, determine whether the passenger target belongs to a child target, if the passenger target belongs to a child target, perform a safe riding monitoring of the child target;

[0032] Obtain the limb feature information of the child target, and perform a dangerous touch behavior judgment of the child;

[0033] Judge whether the limb region of the child target contacts the child dangerous touch region in the preset safe riding standard, the type of the child dangerous touch region includes the door opening region, the door locking contact region, the vehicle gear adjustment region, the safety protection device unlocking region and the in-vehicle closed outer contour gap region, if it is determined that the limb region of the child target contacts the child dangerous touch region in the preset safe riding standard, perform a child non-safe riding warning according to the type of the child dangerous touch region;

[0034] Further obtain the face feature information of the child target, and perform a suffocation possibility state judgment;

[0035] Judge whether the eye feature and the mouth feature of the child target conform to the child suffocation feature information in the preset safe riding standard;

[0036] If the eye feature and the mouth feature of the child target meet the child suffocation feature information in the preset safety riding standard, sound information of the child target position is collected;

[0037] It is judged whether the sound information of the child target position meets the child suffocation feature information in the preset safety riding standard;

[0038] If the sound information of the child target position meets the child suffocation feature information in the preset safety riding standard, it is judged whether the limb feature information of the child target meets the child suffocation feature information in the preset safety riding standard;

[0039] If the limb feature information of the child target meets the child suffocation feature information in the preset safety riding standard, it is confirmed that the child target is in a suffocation possible state, a child suffocation possible alarm is performed, map positioning information is acquired, and a nearest rescue area is prompted according to a vehicle driving route.

[0040] Further, the step of detecting the whole vehicle in the parking lock state, performing off-vehicle safety detection, judging whether there is a critical target in the vehicle, and if it is determined that the critical target exists in the vehicle, performing remote off-vehicle alarm, specifically comprises:

[0041] When detecting that the whole vehicle is in the parking lock state, off-vehicle safety detection is performed.

[0042] Acquiring seat pressure information and vehicle monitoring image information, judging whether there is a valuable article, the valuable article including an authenticated mobile device, a vehicle key and a controller, if it is determined that the valuable article exists, performing a valuable article forgotten alarm, and performing a flash light and siren reminding;

[0043] Judging whether there is an infant or child target, if it is determined that the infant or child target exists, sending an infant or child target forgotten alarm information to a user, and performing a flash light and siren reminding, detecting a vehicle temperature state and an air state again, and if the vehicle temperature state and the air state are in a dangerous state, sending an emergency aid request to the user and a rescue department.

[0044] The application provides a vehicle safety comprehensive monitoring system, which comprises:

[0045] A detection module is used for identifying a vehicle safety monitoring target when detecting that the whole vehicle is powered on.

[0046] The driving safety monitoring module is used for judging whether the driver is in a safe driving state according to a preset safe driving standard, if the driver is in the safe driving state, comprehensive safe driving detection is carried out to send a safe driving prompt, if the driver is not in the safe driving state, a safe driving warning is carried out.

[0047] The riding safety monitoring module is used for judging whether the passenger has a non-safe riding behavior according to a preset safe riding standard, if the passenger has the non-safe riding behavior, a non-safe riding warning is carried out according to the non-safe riding behavior type.

[0048] The off-vehicle warning module is used for carrying out off-vehicle safety detection when detecting that the whole vehicle is in a parking lock state, judging whether there is a critical target in the vehicle, if there is the critical target in the vehicle, a remote off-vehicle warning is carried out.

[0049] The application further provides a storage medium, which stores one or more programs, and the programs are executed by a processor to realize the in-vehicle safety comprehensive monitoring method.

[0050] The application further provides a computer device, which comprises a memory and a processor.

[0051] The memory is used for storing a computer program.

[0052] The processor is used for executing the computer program stored in the memory to realize the in-vehicle safety comprehensive monitoring method. BRIEF DESCRIPTION OF DRAWINGS

[0053] Figure 1 The flow chart of the in-vehicle safety comprehensive monitoring method for the first embodiment of the application;

[0054] Figure 2 The flow chart of the in-vehicle safety comprehensive monitoring method for the second embodiment of the application;

[0055] Figure 3 The structural schematic diagram of the in-vehicle safety comprehensive monitoring method for the third embodiment of the application.

[0056] The following specific embodiments will further illustrate the application in combination with the above drawings. DETAILED DESCRIPTION

[0057] In order to facilitate the understanding of the application, the application will be described more fully below with reference to the accompanying drawings. The application is shown in several embodiments in the drawings. However, the application can be realized in many different forms and is not limited to the embodiments described herein. On the contrary, the purpose of providing these embodiments is to make the disclosure of the application more thorough and comprehensive.

[0058] It should be noted that when a component is said to be "fixed to" another component, it can be directly on the other component or there may be an intervening component. When a component is said to be "connected to" another component, it can be directly connected to the other component or there may be an intervening component. The terms "vertical," "horizontal," "left," "right," and similar expressions used in this document are for illustrative purposes only.

[0059] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention pertains. The terminology used herein in the description of the invention is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. The term "and / or" as used herein includes any and all combinations of one or more of the associated listed items.

[0060] Please see Figure 1 The diagram shows a flowchart of the in-vehicle safety comprehensive monitoring method proposed in the first embodiment of the present invention. This in-vehicle safety comprehensive monitoring method includes steps S01 to S04, wherein:

[0061] Step S01: After detecting that the vehicle is powered on, identify the security monitoring target inside the vehicle;

[0062] It should be noted that in this embodiment, when the vehicle is powered on, it is determined whether the vehicle door is closed. If the vehicle door is determined to be closed, the rearview mirror image acquisition device is activated to identify people inside the vehicle.

[0063] The person in the driver's seat is labeled as a driver and their face is recognized to obtain the driver's facial information, which includes the driver's eye state information and the driver's mouth state information.

[0064] For tasks outside the driver's seat, passengers are labeled and key target persons are identified. The key target persons include children and the elderly. The key target person identification first obtains the body features of the passengers, and then determines the children based on the body features. Next, the facial features of the passengers are obtained, and then the elderly are determined based on the facial features.

[0065] Step S02: Based on the preset safe driving standards, determine whether the driver is in a safe driving state. If the driver is determined to be in a safe driving state, a comprehensive safe driving test is performed to send a safe driving reminder. If the driver is determined not to be in a safe driving state, a safe driving alarm is issued.

[0066] It should be noted that the preset safe driving standard in the present application is set by the manufacturer according to the vehicle model, including the driving state and driving behavior of the driver and the passenger, and different restricted areas set for different targets in the vehicle. In the embodiment, after the driver target is recognized, the eye feature information of the driver target is obtained, the blinking state of the driver is judged, and if the blinking frequency duration of the driver is less than the fatigue driving blinking frequency duration in the preset safe driving standard, it is determined that the driver target is not in the eye fatigue state.

[0067] The map positioning information and the driving duration information are obtained for comprehensive safe driving detection.

[0068] According to the map positioning information, it is judged whether the driving mileage is greater than or equal to the driving mileage threshold in the safe driving standard, and if the driving mileage is greater than or equal to the driving mileage threshold in the safe driving standard, it is determined that there is a fatigue driving risk.

[0069] Or according to the driving duration information, it is judged whether the driving duration is greater than or equal to the driving duration threshold in the safe driving standard, and if the driving duration is greater than or equal to the driving duration threshold in the safe driving standard, it is determined that there is a fatigue driving risk.

[0070] According to the vehicle driving route, the nearest rest area or parking area on the vehicle driving route is searched, and a safe driving prompt is given.

[0071] In the embodiment, after the driver target is recognized, the eye feature information of the driver target is obtained, the blinking state of the driver is judged, and if the blinking frequency duration of the driver is greater than or equal to the fatigue driving blinking frequency duration in the preset safe driving standard, it is determined that the driver target is in the eye fatigue state.

[0072] The mouth feature information of the driver target is further obtained, a yawning joint judgment is performed, it is judged whether the driver target has a yawning behavior, and if the driver target has a yawning behavior, it is determined that the driver target is in a fatigue driving state.

[0073] The map positioning information is obtained, the nearest rest area or parking area on the vehicle driving route is searched according to the vehicle driving route, and a safe driving warning is given.

[0074] Step S03: According to the preset safe riding standard, it is judged whether the passenger has a non-safe riding behavior, and if it is determined that the passenger has a non-safe riding behavior, a non-safe riding warning is given according to the type of the non-safe riding behavior.

[0075] It should be noted that in the embodiment, after the passenger target is recognized, the vehicle speed information of the vehicle is obtained, and it is judged whether the current vehicle speed is greater than the idle speed threshold.

[0076] If it is determined that the vehicle speed of the current vehicle is greater than the idle speed threshold, limb feature information of the passenger target is acquired, and a dangerous touch behavior of the passenger is determined;

[0077] It is determined whether the limb region of the passenger target contacts a dangerous touch region in the preset safe riding standard, and the type of the dangerous touch region includes a vehicle door opening region, a vehicle door locking contact region, and a vehicle gear adjustment region. If it is determined that the limb region of the passenger target contacts a dangerous touch region in the preset safe riding standard, the type of the non-safe riding behavior is determined according to the type of the dangerous touch region, and a non-safe riding warning is given according to the type of the non-safe riding behavior.

[0078] In the embodiment, after the passenger target is recognized, it is determined whether the passenger target belongs to a child target. If the passenger target belongs to a child target, safe riding monitoring of the child target is performed.

[0079] Limb feature information of the child target is acquired, and a dangerous touch behavior of the child is determined.

[0080] It is determined whether the limb region of the child target contacts a dangerous touch region in the preset safe riding standard, and the type of the dangerous touch region includes a vehicle door opening region, a vehicle door locking contact region, a vehicle gear adjustment region, a safety protection device unlocking region, and an in-vehicle enclosed outer contour gap region. If it is determined that the limb region of the child target contacts a dangerous touch region in the preset safe riding standard, a child non-safe riding warning is given according to the type of the dangerous touch region.

[0081] Face feature information of the child target is further acquired, and a possible suffocation state of the child target is determined.

[0082] It is determined whether the eye feature and the mouth feature of the child target conform to child suffocation feature information in the preset safe riding standard.

[0083] If the eye feature and the mouth feature of the child target conform to child suffocation feature information in the preset safe riding standard, sound information at the position of the child target is collected.

[0084] It is determined whether the sound information at the position of the child target conforms to child suffocation feature information in the preset safe riding standard.

[0085] If the sound information at the position of the child target conforms to child suffocation feature information in the preset safe riding standard, it is determined whether the limb feature information of the child target conforms to child suffocation feature information in the preset safe riding standard.

[0086] If the limb feature information of the child target meets the child suffocation feature information in the preset safe riding standard, it is confirmed that the child target is in a suffocation possible state, a child suffocation possible alarm is performed, map positioning information is acquired, and a nearest rescue area is prompted according to a vehicle driving route.

[0087] Step S04: When it is detected that the whole vehicle is in the parking lock state, off-vehicle safety detection is performed, it is judged whether there is a critical target in the vehicle, if it is determined that there is a critical target in the vehicle, remote off-vehicle alarm is performed;

[0088] It should be noted that in the embodiment, when it is detected that the whole vehicle is in the parking lock state, off-vehicle safety detection is performed;

[0089] Seat pressure information and in-vehicle monitoring image information are acquired, it is judged whether there is a valuable article, the valuable article includes an authenticated mobile device, a vehicle key and a controller, if it is determined that there is a valuable article, a valuable article forgotten alarm is performed, and a flash light and siren are reminded;

[0090] It is judged whether there is a baby or child target, if it is determined that there is a baby or child target, baby or child target forgotten alarm information is sent to the user, a flash light and siren are reminded, the in-vehicle temperature state and air state are detected again, if the in-vehicle temperature state and air state are in a dangerous state, an emergency aid request is sent to the user and the rescue department.

[0091] In summary, according to the above-mentioned comprehensive monitoring method for in-vehicle safety, the driving state of the driver is monitored through comprehensive judgment of multiple information collected to ensure that the driver is in a safe driving state and to improve the safety of the whole vehicle. The non-safe riding behavior of the passenger is identified through monitoring the riding behavior of the passenger to avoid affecting the safety of driving and riding. The forgotten critical target is detected after leaving the vehicle to avoid non-safe problems after leaving the vehicle. The effectiveness and practicality of in-vehicle safety monitoring are greatly improved. Specifically, when it is detected that the whole vehicle is powered on, the in-vehicle safety monitoring target is identified to accurately focus on important targets and improve the practicality of overall safety monitoring. Whether the driver is in a safe driving state is judged according to the preset safe driving standard. If it is determined that the driver is in the safe driving state, comprehensive safe driving detection is performed to send a safe driving prompt. If it is determined that the driver is not in the safe driving state, a safe driving warning is performed to improve the accuracy of the judgment of the driving state of the driver and avoid dangerous accidents caused by unsafe driving state. Whether the passenger has a non-safe riding behavior is judged according to the preset safe riding standard. If it is determined that the passenger has the non-safe riding behavior, a non-safe riding warning is performed according to the type of non-safe riding behavior to improve the accuracy of the judgment of the non-safe riding behavior of the passenger and avoid dangerous accidents caused by non-safe riding behavior. When it is detected that the whole vehicle is in a parking lock state, off-vehicle safety detection is performed to determine whether there is a critical target in the vehicle. If it is determined that there is the critical target in the vehicle, a remote off-vehicle warning is performed to avoid major problems caused by forgetting or unsafe off-vehicle. The effectiveness and practicality of in-vehicle safety monitoring are greatly improved.

[0092] Referring to Figure 2 , it is a flow chart of the comprehensive monitoring method for in-vehicle safety according to the second embodiment of the present application. The comprehensive monitoring method for in-vehicle safety includes steps S11 to S15.

[0093] Step S11: When it is detected that the whole vehicle is powered on, whether the door of the vehicle is in a closed state is judged. If it is determined that the door of the vehicle is in a closed state, a rearview mirror image collector is started to identify the person in the vehicle. The person in the driving position is labeled as a driver and face recognition is performed to obtain the face information of the driver. The face information of the driver includes the eye state information and the face state information of the driver. The person in the non-driving position is labeled as a passenger and key target person recognition is performed. The key target person includes children and the elderly. The key target person recognition first obtains the body characteristics of the passenger, judges the child target according to the body characteristics, and then obtains the face characteristics of the passenger, judges the elderly target according to the face characteristics.

[0094] Step S12: After recognizing the driver target, the eye feature information of the driver target is acquired, the blinking state of the driver is judged, and if the blinking frequency duration of the driver is less than the fatigue driving blinking frequency duration in the preset safe driving standard, it is determined that the driver target is not in the eye fatigue state. The map positioning information and the driving duration information are acquired for comprehensive safe driving detection. According to the map positioning information, it is judged whether the driving mileage is greater than or equal to the driving mileage threshold in the preset safe driving standard. If the driving mileage is greater than or equal to the driving mileage threshold in the preset safe driving standard, it is determined that there is a fatigue driving risk. Or according to the driving duration information, it is judged whether the driving duration is greater than or equal to the driving duration threshold in the preset safe driving standard. If the driving duration is greater than or equal to the driving duration threshold in the preset safe driving standard, it is determined that there is a fatigue driving risk. The nearest rest area or parking area on the vehicle driving route is searched according to the vehicle driving route, and a safe driving prompt is given.

[0095] Step S13: After recognizing the driver target, the eye feature information of the driver target is acquired, the blinking state of the driver is judged, and if the blinking frequency duration of the driver is greater than or equal to the fatigue driving blinking frequency duration in the preset safe driving standard, it is determined that the driver target is in the eye fatigue state. The mouth feature information of the driver target is further acquired, a yawning joint judgment of the mouth is performed, it is judged whether the driver target has a yawning behavior, and if the driver target has a yawning behavior, it is determined that the driver target is in a fatigue driving state. The map positioning information is acquired, the nearest rest area or parking area on the vehicle driving route is searched according to the vehicle driving route, and a safe driving warning is given.

[0096] Step S14: After recognizing the passenger target, the vehicle speed information of the vehicle is acquired, it is judged whether the current vehicle speed is greater than the idle speed threshold, and if it is determined that the current vehicle speed is greater than the idle speed threshold, the limb feature information of the passenger target is acquired, a dangerous touch behavior of the passenger is judged, and it is judged whether the limb region of the passenger target contacts the dangerous touch region in the preset safe riding standard. The type of the dangerous touch region includes a vehicle door opening region, a vehicle door closing contact region and a vehicle gear adjustment region. If it is determined that the limb region of the passenger target contacts the dangerous touch region in the preset safe riding standard, the type of the non-safe riding behavior is determined according to the type of the dangerous touch region, and a non-safe riding warning is given according to the type of the non-safe riding behavior.

[0097] Step S15: When detecting that the whole vehicle is in the parking lock state, off-vehicle safety detection is performed, seat pressure information and in-vehicle monitoring image information are acquired, it is judged whether there is a valuable object, the valuable object includes an authenticated mobile device and a vehicle key and a controller, if it is judged that there is a valuable object, a valuable object forgetting warning is performed, and flashing light and horn reminding are performed, it is judged whether there is an infant or child target, if it is judged that there is an infant or child target, infant or child target forgetting warning information is sent to the user, and flashing light and horn reminding are performed, and then the in-vehicle temperature state and air state are detected, if the in-vehicle temperature state and air state are in a dangerous state, an emergency aid request is sent to the user and the rescue department.

[0098] In summary, according to the above-mentioned in-vehicle safety comprehensive monitoring method, a variety of information is collected for comprehensive judgment, the driving state of the driver is monitored to ensure that the driver is in a safe driving state, and the safety of the whole vehicle is improved, the sitting behavior of the passenger is monitored to identify the non-safe sitting behavior of the passenger, and the influence on the driving safety is avoided, and the forgotten critical target is detected after off-vehicle to avoid non-safe problems after off-vehicle, and the effectiveness and practicality of the in-vehicle safety monitoring are greatly improved. Specifically, when detecting that the whole vehicle is powered on, the in-vehicle safety monitoring target is identified to accurately focus on important targets and improve the practicality of the overall safety monitoring, whether the driver is in a safe driving state is judged according to the preset safe driving standard, if it is judged that the driver is in the safe driving state, comprehensive safe driving detection is performed to send a safe driving prompt, if it is judged that the driver is not in the safe driving state, a safe driving warning is performed, the accuracy of the driving state judgment of the driver is improved, and dangerous accidents caused by unsafe driving state are avoided, whether the passenger has a non-safe sitting behavior is judged according to the preset safe sitting standard, if it is judged that the passenger has the non-safe sitting behavior, a non-safe sitting warning is performed according to the non-safe sitting behavior type, the accuracy of the non-safe sitting behavior judgment of the passenger is improved, and dangerous accidents caused by non-safe sitting behavior are avoided, when detecting that the whole vehicle is in the parking lock state, off-vehicle safety detection is performed, whether there is a critical target in the vehicle is judged, if it is judged that there is the critical target in the vehicle, a remote off-vehicle warning is performed, and major problems caused by forgetting or unsafe off-vehicle are avoided, and the effectiveness and practicality of the in-vehicle safety monitoring are greatly improved.

[0099] Referring to Figure 3 , a structure schematic diagram of an in-vehicle safety comprehensive monitoring system according to a third embodiment of the present application is shown, the system comprises:

[0100] The detection module 10 is used for identifying the in-vehicle safety monitoring target when detecting that the whole vehicle is powered on.

[0101] The driving safety monitoring module 20 is used for judging whether the driver is in a safe driving state according to a preset safe driving standard, if the driver is in the safe driving state, comprehensive safe driving detection is performed to send a safe driving prompt, if the driver is not in the safe driving state, safe driving warning is performed.

[0102] The riding safety monitoring module 30 is used for judging whether the passenger has a non-safe riding behavior according to a preset safe riding standard, if the passenger has the non-safe riding behavior, non-safe riding warning is performed according to the non-safe riding behavior type.

[0103] The leaving vehicle warning module 40 is used for performing leaving vehicle safety detection when detecting that the whole vehicle is in a parking lock state, judging whether there is a critical target in the vehicle, if there is the critical target in the vehicle, remote leaving vehicle warning is performed.

[0104] The application further provides a computer storage medium, which stores one or more programs, and the programs are executed by a processor to realize the in-vehicle safety comprehensive monitoring method.

[0105] The application further provides a computer device, which comprises a memory and a processor, wherein the memory is used for storing a computer program, and the processor is used for executing the computer program stored in the memory to realize the in-vehicle safety comprehensive monitoring method.

[0106] Those skilled in the art can understand that the logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a list of executable instructions for realizing the logic function, which can be specifically realized in any computer readable medium for use by or in combination with an instruction execution system, device or equipment, such as a computer-based system, a system including a processor or other system that can fetch and execute instructions from the instruction execution system, device or equipment. For the present specification, the "computer readable medium" can be any device that can contain, store, communicate, propagate or transport programs for use by or in combination with the instruction execution system, device or equipment.

[0107] More specific examples (a non-exhaustive list) of the computer-readable medium include the following: a portable computer diskette (magnetic device); a random access memory (RAM); a read-only memory (ROM); an erasable programmable read-only memory (EPROM or Flash memory); an optical fiber device; and a portable compact disc read-only memory (CDROM). Additionally, the computer readable medium can be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via, for example, optical scanning of the paper or other medium, then compiled, interpreted, or otherwise processed in a suitable manner, if necessary, and then stored in a computer memory.

[0108] It should be understood that aspects of the application can be implemented in hardware, software, firmware or combinations thereof. In the embodiments described above, various steps or methods can be implemented in software or firmware that is stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, and in another embodiment, any of the following techniques, which are well known in the art, can be used to implement the application: a hybrid of the techniques mentioned above; a combination of one or more of the techniques mentioned above; or one or more other techniques suitable for use in the computer hardware devices described above.

[0109] In the description of the specification, the description of the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" and the like means that the specific features, structures, materials or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of the application. In the specification, the illustrative description of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described can be combined in any appropriate manner in one or more embodiments or examples.

[0110] The above-described embodiments only express several implementation manners of the present application, and the description is more specific and detailed, but it should not be understood as a limitation on the patent scope of the present application. It should be noted that for those skilled in the art, without departing from the concept of the present application, a number of modifications and improvements can be made, which are all within the protection scope of the present application. Therefore, the patent protection scope of the present application should be subject to the appended claims.

Claims

1. A comprehensive in-vehicle safety monitoring method, characterized in that, include: Once the vehicle is powered on, identify the security monitoring targets inside the vehicle; Based on preset safe driving standards, determine whether the driver is in a safe driving state. If the driver is determined to be in the safe driving state, perform a comprehensive safe driving test and send a safe driving reminder. If the driver is determined not to be in the safe driving state, issue a safe driving alarm. Based on preset safe riding standards, determine whether the passenger has engaged in unsafe riding behavior. If the passenger is found to have engaged in such unsafe riding behavior, then issue an unsafe riding alarm based on the type of unsafe riding behavior. After identifying the passenger target, the vehicle speed information is obtained to determine whether the current vehicle speed is greater than the idle speed threshold. The step of identifying the passenger target, obtaining the vehicle speed information, and determining whether the current vehicle speed is greater than the idle speed threshold further includes: After identifying the passenger target, it is determined whether the passenger target is a child target. If the passenger target is a child target, the safety monitoring of the child target's ride is carried out. Obtain information on the physical characteristics of children to assess dangerous touching behaviors. Determine whether the child's limbs are in contact with the child's dangerous contact area in the preset safe riding standard. The types of child dangerous contact areas include the door opening area, the door locking contact area, the vehicle gear adjustment area, the safety protection device unlocking area, and the closed outer contour gap area inside the vehicle. If it is determined that the child's limbs are in contact with the child's dangerous contact area in the preset safe riding standard, then a child unsafe riding alarm is issued according to the type of child dangerous contact area. Next, obtain the facial feature information of the child target to determine the possible state of suffocation; Determine whether the eye and mouth features of the child target meet the child suffocation feature information in the preset safe riding standards; If the child's eye and mouth features match the child suffocation features in the preset safe riding standards, then the sound information of the child's location is collected. Determine whether the sound information at the child's target location matches the child suffocation characteristics information in the preset safe riding standards; If the sound information of the child's target location matches the child suffocation characteristic information in the preset safe riding standard, then determine whether the limb characteristic information of the child target matches the child suffocation characteristic information in the preset safe riding standard; If the limb characteristics of the child target match the child suffocation characteristics in the preset safe riding standards, then the child target is confirmed to be in a state of possible suffocation, a child suffocation warning is issued, and map positioning information is obtained to indicate the nearest rescue area based on the vehicle's driving route. When the vehicle is detected to be in a parked and locked state, an off-vehicle safety check is performed to determine whether there is a critical target inside the vehicle. If the critical target is determined to be inside the vehicle, a remote off-vehicle alarm is triggered.

2. The in-vehicle safety integrated monitoring method according to claim 1, characterized in that, The step of identifying in-vehicle security monitoring targets after detecting that the vehicle is powered on specifically includes: Once the vehicle is powered on, it is determined whether the vehicle doors are closed. If the vehicle doors are determined to be closed, the rearview mirror image acquisition device is activated to identify people inside the vehicle. The person in the driver's seat is labeled as a driver and their face is recognized to obtain the driver's facial information, which includes the driver's eye state information and the driver's mouth state information. For tasks outside the driver's seat, passengers are labeled and key target persons are identified. The key target persons include children and the elderly. The key target person identification first obtains the body features of the passengers, and then determines the children based on the body features. Next, the facial features of the passengers are obtained, and then the elderly are determined based on the facial features.

3. The in-vehicle safety integrated monitoring method according to claim 1, characterized in that, The step of determining whether the driver is in a safe driving state based on preset safe driving standards, and if the driver is determined to be in the safe driving state, performing a comprehensive safe driving detection to send a safe driving reminder, specifically includes: After identifying the driver target, the eye feature information of the driver target is obtained, and the driver's blinking status is judged. If the driver's blinking frequency and duration are less than the fatigued driving blinking frequency and duration in the preset safe driving standard, it is determined that the driver target is not in a state of eye fatigue. Obtain map location information and driving time information to conduct comprehensive safe driving detection; Based on map location information, determine whether the driving mileage is greater than or equal to the driving mileage threshold in the safe driving standard. If the driving mileage is greater than or equal to the driving mileage threshold in the safe driving standard, it is determined that there is a risk of fatigue driving. Alternatively, based on driving time information, determine whether the driving time is greater than or equal to the driving time threshold in the safe driving standard. If the driving time is greater than or equal to the driving time threshold in the safe driving standard, it is determined that there is a risk of fatigue driving. Locate the nearest rest area or parking area along the vehicle's route and provide safe driving tips.

4. The in-vehicle safety integrated monitoring method according to claim 1, characterized in that, The step of issuing a safe driving warning if it is determined that the driver is not in the safe driving state specifically includes: After identifying the driver target, the eye feature information of the driver target is obtained, and the driver's blinking state is judged. If the driver's blinking frequency and duration are greater than or equal to the fatigued driving blinking frequency and duration in the preset safe driving standard, the driver target is determined to be in a state of eye fatigue. Next, obtain the mouth feature information of the driver target, perform joint judgment of mouth yawning, and determine whether the driver target has yawning behavior. If the driver target has yawning behavior, it is determined that the driver target is in a state of fatigued driving. Obtain map location information, locate the nearest rest area or parking area along the vehicle's route, and issue a safe driving warning.

5. The in-vehicle safety integrated monitoring method according to claim 1, characterized in that, The step of determining whether a passenger is engaging in unsafe riding behavior based on preset safe riding standards, and issuing an unsafe riding alarm according to the type of unsafe riding behavior if the passenger is found to be engaging in such behavior, specifically includes: After identifying the passenger target, the vehicle speed information is obtained to determine whether the current vehicle speed is greater than the idle speed threshold. If it is determined that the current vehicle speed is greater than the idle speed threshold, the limb feature information of the passenger target is obtained to judge the passenger's dangerous contact behavior. It determines whether the limb area of ​​the passenger target is in contact with the dangerous touch area in the preset safe riding standard. The types of dangerous touch areas include the door opening area, the door locking contact area, and the vehicle gear adjustment area. If it is determined that the limb area of ​​the passenger target is in contact with the dangerous touch area in the preset safe riding standard, the type of unsafe riding behavior is determined according to the type of dangerous touch area, and an unsafe riding alarm is issued according to the type of unsafe riding behavior.

6. The in-vehicle safety integrated monitoring method according to claim 1, characterized in that, The step of performing an off-vehicle safety check when the vehicle is detected to be in a parked and locked state, determining whether there is a dangerous target inside the vehicle, and issuing a remote off-vehicle alarm if a dangerous target is determined to be inside the vehicle, specifically includes: When the vehicle is detected to be in the parking lock state, a vehicle departure safety check is performed; The system acquires seat pressure information and in-vehicle monitoring image information to determine if there are any valuables. These valuables include authenticated mobile devices, vehicle keys, and controllers. If valuables are identified, a valuables-forgotten alarm is triggered, and the system flashes lights and sounds the horn as a reminder. The system determines whether an infant or child is present. If so, it sends an alert message to the user indicating that the infant or child has been forgotten, and flashes the lights and sounds the horn to remind the user. It then checks the temperature and air quality inside the vehicle. If the temperature and air quality inside the vehicle are in a dangerous state, it sends an emergency assistance request to the user and the emergency medical services.

7. A comprehensive in-vehicle safety monitoring system, characterized in that, include: The detection module is used to identify in-vehicle safety monitoring targets when the vehicle is powered on. The driving safety monitoring module is used to determine whether the driver is in a safe driving state according to the preset safe driving standards. If the driver is determined to be in the safe driving state, a comprehensive safe driving detection is performed to send a safe driving prompt. If the driver is determined not to be in the safe driving state, a safe driving alarm is issued. The passenger safety monitoring module is used to determine whether a passenger has engaged in unsafe riding behavior based on preset safe riding standards. If the unsafe riding behavior is determined, an unsafe riding alarm is issued according to the type of unsafe riding behavior. After identifying the passenger target, the vehicle speed information is obtained to determine whether the current vehicle speed is greater than the idle speed threshold. The step of identifying the passenger target, obtaining the vehicle speed information, and determining whether the current vehicle speed is greater than the idle speed threshold further includes: After identifying the passenger target, it is determined whether the passenger target is a child target. If the passenger target is a child target, the safety monitoring of the child target's ride is carried out. Obtain information on the physical characteristics of children to assess dangerous touching behaviors. Determine whether the child's limbs are in contact with the child's dangerous contact area in the preset safe riding standard. The types of child dangerous contact areas include the door opening area, the door locking contact area, the vehicle gear adjustment area, the safety protection device unlocking area, and the closed outer contour gap area inside the vehicle. If it is determined that the child's limbs are in contact with the child's dangerous contact area in the preset safe riding standard, then a child unsafe riding alarm is issued according to the type of child dangerous contact area. Next, obtain the facial feature information of the child target to determine the possible state of suffocation; Determine whether the eye and mouth features of the child target meet the child suffocation feature information in the preset safe riding standards; If the child's eye and mouth features match the child suffocation features in the preset safe riding standards, then the sound information of the child's location is collected. Determine whether the sound information at the child's target location matches the child suffocation characteristics information in the preset safe riding standards; If the sound information of the child's target location matches the child suffocation characteristic information in the preset safe riding standard, then determine whether the limb characteristic information of the child target matches the child suffocation characteristic information in the preset safe riding standard; If the limb characteristics of the child target match the child suffocation characteristics in the preset safe riding standards, then the child target is confirmed to be in a state of possible suffocation, a child suffocation warning is issued, and map positioning information is obtained to indicate the nearest rescue area based on the vehicle's driving route. The vehicle departure alarm module is used to perform a vehicle departure safety check when the vehicle is detected to be in a parked and locked state, to determine whether there is a dangerous target inside the vehicle, and if the dangerous target is determined to be inside the vehicle, a remote vehicle departure alarm is issued.

8. A storage medium, characterized in that, The storage medium stores one or more programs, which, when executed by a processor, implement the in-vehicle safety integrated monitoring method as described in any one of claims 1-6.

9. A computer device, characterized in that, The computer device includes a memory and a processor, wherein: The memory is used to store computer programs; When the processor executes the computer program stored in the memory, it implements the in-vehicle safety integrated monitoring method according to any one of claims 1-6.

Images