Passenger makeup warning method, system, medium, equipment and program product

Abstract

The present application provides a passenger makeup warning method, system, medium, device and program product. The method provided in the embodiment of the present application obtains the expected motion state parameters of the vehicle in at least one motion direction when determining that the passenger is putting on makeup in the vehicle, wherein the expected motion state parameters are used to characterize the motion state of the vehicle after a preset time, and then determines the corresponding warning prompt information according to the expected motion state parameters of each motion direction and the preset prompt conditions, and the preset prompt conditions are set according to the target factors that affect the quality of the makeup in the car, and finally, pushes the warning prompt information to warn the passenger before the target factor is triggered, so that when the passenger puts on makeup in the moving vehicle, the passenger can predict the changes in the vehicle's driving state and external road conditions, effectively avoiding the danger caused by the change of the vehicle's motion state.

Description

Technical Field

[0001] The present application relates to the field of vehicle electronic technology, and in particular to a passenger makeup warning method, system, medium, device and program product. Background Art

[0002] At present, with the accelerated pace of people's lives, female passengers sometimes need to put on makeup in the car when traveling by car. However, they may encounter bumpy roads, sudden deceleration or turns during driving, which may cause violent movement of the vehicle and affect the quality of female passengers' makeup.

[0003] Among them, if a passenger in the vehicle is using a makeup mirror to put on makeup, if the vehicle suddenly accelerates or decelerates or experiences severe bumps, at this time, in addition to affecting the passenger's makeup experience, it may even cause personal injury to the passenger, such as an eyebrow pencil poking the eye.

[0004] It can be seen that when passengers currently put on makeup in a moving vehicle, since they cannot predict the vehicle's driving status and changes in external road conditions, sudden acceleration or deceleration or severe bumps of the vehicle may easily lead to a poor makeup experience or even danger. Summary of the invention

[0005] The embodiments of the present application provide a passenger makeup warning method, system, medium, device and program product to ensure the makeup experience of passengers when putting on makeup in a moving vehicle and effectively avoid possible makeup dangers.

[0006] In a first aspect, an embodiment of the present application provides a passenger makeup warning method, comprising:

[0007] When it is determined that the passenger is putting on makeup in the vehicle, obtaining an expected motion state parameter of the vehicle in at least one motion direction, the expected motion state parameter being used to characterize the motion state of the vehicle after a preset time period;

[0008] Determine corresponding early warning prompt information according to the expected motion state parameters of each motion direction and preset prompt conditions, wherein the preset prompt conditions are set according to target factors affecting the quality of in-car makeup;

[0009] The warning prompt information is pushed to warn the passenger before the target factor is triggered.

[0010] In a possible design, the obtaining of the expected motion state parameter of the vehicle in at least one motion direction includes:

[0011] A first expected lateral motion state parameter, a second expected longitudinal motion state parameter, and a third expected vertical motion state parameter of the vehicle are obtained, wherein the lateral direction is the turning direction of the vehicle, the longitudinal direction is the driving direction of the vehicle, and the vertical direction is the bouncing direction of the vehicle.

[0012] In a possible design, the determining of corresponding warning prompt information according to the expected motion state parameters of each motion direction and preset prompt conditions includes:

[0013] determining a first warning level according to the first expected motion state parameter and at least one first preset prompt threshold, and determining first warning prompt information according to the first warning level; and / or,

[0014] determining a second warning level according to the second expected motion state parameter and at least one second preset prompt threshold, and determining second warning prompt information according to the second warning level; and / or,

[0015] A third warning level is determined according to the third expected motion state parameter and at least one third preset prompt threshold, and third warning prompt information is determined according to the third warning level.

[0016] In a possible design, the determining corresponding warning prompt information according to the expected motion state parameters of each motion direction and the preset prompt conditions further includes:

[0017] The warning level is determined according to the first warning level, the second warning level and the third warning level, and the warning prompt information is determined according to the warning level, and the warning level is the highest warning level among the first warning level, the second warning level and the third warning level.

[0018] In a possible design, the obtaining of the first expected lateral motion state parameter, the second expected longitudinal motion state parameter, and the third expected vertical motion state parameter of the vehicle includes:

[0019] Determine the current driving mode of the vehicle;

[0020] If the driving mode is a manual driving mode, the first expected motion state parameter is determined according to the turn signal on state of the vehicle, the second expected motion state parameter is determined according to the longitudinal collision time of the vehicle, and the third expected motion state parameter is determined according to the drop height of the road surface in the driving direction of the vehicle;

[0021] If the driving mode is an intelligent driving mode, the first expected motion state parameter is determined according to the yaw angular velocity of the vehicle, the second expected motion state parameter is determined according to the pitch angular rate of the vehicle, and the third expected motion state parameter is determined according to the height difference of the road surface in the driving direction of the vehicle.

[0022] In a possible design, before acquiring the expected motion state parameter of the vehicle in at least one motion direction, the method further includes:

[0023] The on state of the makeup mirror in the vehicle is obtained, and when the on state meets a preset on condition, a facial image of the passenger in the vehicle is obtained to determine that the passenger is applying makeup in the vehicle according to the facial image.

[0024] In a second aspect, the embodiment of the present application further provides a passenger makeup warning system, comprising:

[0025] a sensor input fusion module, configured to obtain expected motion state parameters of the vehicle in at least one motion direction when it is determined that a passenger is putting on makeup in the vehicle, wherein the expected motion state parameters are used to characterize the motion state of the vehicle after a preset time period;

[0026] A makeup warning control module is configured to determine corresponding warning prompt information according to the expected motion state parameters of each motion direction and preset prompt conditions, wherein the preset prompt conditions are set according to target factors affecting the quality of in-car makeup;

[0027] The graded warning module is configured to push the warning prompt information to warn the passenger before the target factor is triggered.

[0028] In a possible design, the sensor input fusion module is specifically configured to:

[0029] A first expected lateral motion state parameter, a second expected longitudinal motion state parameter, and a third expected vertical motion state parameter of the vehicle are obtained, wherein the lateral direction is the turning direction of the vehicle, the longitudinal direction is the driving direction of the vehicle, and the vertical direction is the bouncing direction of the vehicle.

[0030] In a possible design, the makeup warning control module is specifically configured to:

[0031] determining a first warning level according to the first expected motion state parameter and at least one first preset prompt threshold, and determining first warning prompt information according to the first warning level; and / or,

[0032] determining a second warning level according to the second expected motion state parameter and at least one second preset prompt threshold, and determining second warning prompt information according to the second warning level; and / or,

[0033] A third warning level is determined according to the third expected motion state parameter and at least one third preset prompt threshold, and third warning prompt information is determined according to the third warning level.

[0034] In a possible design, the makeup warning control module is further configured to:

[0035] The warning level is determined according to the first warning level, the second warning level and the third warning level, and the warning prompt information is determined according to the warning level, and the warning level is the highest warning level among the first warning level, the second warning level and the third warning level.

[0036] In a possible design, the makeup warning control module is specifically configured to:

[0037] Determine the current driving mode of the vehicle;

[0038] If the driving mode is a manual driving mode, the first expected motion state parameter is determined according to the turn signal on state of the vehicle, the second expected motion state parameter is determined according to the longitudinal collision time of the vehicle, and the third expected motion state parameter is determined according to the drop height of the road surface in the driving direction of the vehicle;

[0039] If the driving mode is an intelligent driving mode, the first expected motion state parameter is determined according to the yaw angular velocity of the vehicle, the second expected motion state parameter is determined according to the pitch angular rate of the vehicle, and the third expected motion state parameter is determined according to the height difference of the road surface in the driving direction of the vehicle.

[0040] In a possible design, the sensor input fusion module is further configured to: obtain the opening state of the makeup mirror in the vehicle, and when the opening state meets a preset opening condition, obtain the facial image of the passenger in the vehicle to determine that the passenger is putting on makeup in the vehicle based on the facial image.

[0041] In a third aspect, an embodiment of the present application further provides an electronic device, including:

[0042] Processor; and

[0043] a memory for storing a computer program for the processor;

[0044] Wherein, the processor is configured to implement any one of the passenger makeup warning methods in the first aspect by executing the computer program.

[0045] In a fourth aspect, an embodiment of the present application further provides a storage medium having a computer program stored thereon, which, when executed by a processor, implements any one of the passenger makeup warning methods in the first aspect.

[0046] In a fifth aspect, an embodiment of the present application further provides a computer program product, comprising a computer program, which, when executed by a processor, implements any one of the passenger makeup warning methods in the first aspect.

[0047] The embodiments of the present application provide a passenger makeup warning method, system, medium, device and program product, which obtains the expected motion state parameters of the vehicle in at least one motion direction when determining that the passenger is putting on makeup in the vehicle, wherein the expected motion state parameters are used to characterize the motion state of the vehicle after a preset time, and then determines the corresponding warning prompt information according to the expected motion state parameters of each motion direction and the preset prompt conditions, and the preset prompt conditions are set according to the target factors that affect the quality of makeup in the vehicle, and finally, pushes the warning prompt information to warn the passenger before the target factor is triggered, so that when the passenger puts on makeup in the moving vehicle, the vehicle driving state and the changes in the external road conditions can be predicted, effectively avoiding the danger caused by the change of the vehicle motion state. And through the warning method, the passenger is prompted to stop putting on makeup before the target factor that affects the quality of makeup is triggered, so as to ensure the quality of the passenger's makeup and improve the passenger's makeup experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following is a brief introduction to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0049] Figure 1 is a schematic diagram of an application scenario of a passenger makeup warning method according to an exemplary embodiment of the present application;

[0050] Figure 2 is an application system architecture diagram of a passenger makeup warning method according to an exemplary embodiment of the present application;

[0051] Figure 3 is a flow chart of a passenger makeup warning method according to an exemplary embodiment of the present application;

[0052] Figure 4is a flow chart of a passenger makeup warning method according to another exemplary embodiment of the present application;

[0053] Figure 5 is a flow chart of a passenger makeup warning method according to another exemplary embodiment of the present application;

[0054] Figure 6 is a structural schematic diagram of a passenger makeup warning system according to an exemplary embodiment of the present application;

[0055] Figure 7 It is a schematic diagram of the structure of an electronic device according to an exemplary embodiment of the present application. DETAILED DESCRIPTION

[0056] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0057] The terms "first", "second", "third", "fourth", etc. (if any) in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0058] At present, as people's pace of life accelerates, female passengers sometimes need to put on makeup in the car when traveling by car. However, they may encounter bumpy roads, sudden deceleration or turns during driving, which will cause the vehicle to move violently, thus affecting the quality of female passengers' makeup. When female passengers are putting on makeup while the vehicle is driving, if they encounter bumpy roads, speed bumps, sudden acceleration, sudden deceleration or emergency lane changes, the vehicle will move violently, which will not only affect the quality of makeup, but may even cause personal injury to passengers, for example, eyebrow pencils will poke their eyes.

[0059] The embodiment provided in the present application monitors the vehicle's motion state in real time and issues graded warnings based on the vehicle's motion state, thereby preventing the quality of makeup from being affected by changes in the vehicle's motion state and ensuring the safety of passengers wearing makeup.

[0060] Specifically, when determining that a passenger is putting on makeup in a vehicle, the expected motion state parameters of the vehicle in at least one motion direction are obtained, wherein the expected motion state parameters are used to characterize the motion state of the vehicle after a preset time, and then the corresponding warning prompt information is determined according to the expected motion state parameters of each motion direction and the preset prompt conditions, and the preset prompt conditions are set according to the target factors that affect the quality of makeup in the vehicle, and finally, the warning prompt information is pushed to warn the passenger before the target factor is triggered, so that when the passenger is putting on makeup in a moving vehicle, the vehicle driving state and the changes in the external road conditions can be predicted, effectively avoiding the danger caused by the change of the vehicle motion state. And by means of early warning, the passenger is prompted to stop putting on makeup before the target factor that affects the quality of makeup is triggered, so as to ensure the quality of the passenger's makeup and improve the passenger's makeup experience.

[0061] Figure 1 : is a schematic diagram of an application scenario of a passenger makeup warning method according to an exemplary embodiment of the present application. Figure 1-Figure 2 As shown, the passenger makeup warning method provided in this embodiment can be applied to a vehicle 100, in which a makeup mirror 110 is configured. The makeup mirror 110 can be set at the co-pilot position of the vehicle to provide makeup convenience for the female passenger in the co-pilot position.

[0062] In this embodiment, when it is necessary to warn a passenger who is wearing makeup, feedback can be provided to the passenger through voice announcements, light changes, text displays, seat vibrations, etc., or a combination of the above methods can be used to provide warning feedback for different warning levels.

[0063] In addition, vehicle 100 may also provide passengers with setting options so that passengers can set the trigger time of the warning prompt according to their own needs and habits. For example, it may be set to warn passengers 5 seconds before the target factor is triggered, thereby providing passengers with enough time to pause their makeup actions.

[0064] Figure 2 : is an application system architecture diagram of a passenger makeup warning method according to an exemplary embodiment of the present application. Figure 2As shown, the passenger makeup warning system used by the passenger makeup warning method provided in this embodiment may include: a sensor input fusion module, a makeup warning control module, and a graded warning module. Specifically, the sensor input fusion module can be connected to the vehicle speed sensor, angular velocity sensor, in-vehicle camera, radar and CAN data collector on the vehicle to obtain the vehicle's external environmental parameters, in-vehicle passenger facial data, vehicle motion parameters, etc. during the vehicle's driving process. Then, the acquired data is transmitted to the makeup warning control module (which can be a separate processor or a processor in the vehicle computer) through the CAN network transmission method, so that the makeup warning control module analyzes the data and determines the warning level. Finally, the passengers are warned through the graded warning module, for example, the current warning level is broadcast as the first warning level, the second warning level or the third warning level through voice broadcast.

[0065] Figure 3 FIG. 1 is a flow chart of a passenger makeup warning method according to an exemplary embodiment of the present application. Figure 3 As shown, the passenger makeup warning method provided in this embodiment includes:

[0066] Step 101: When it is determined that a passenger is putting on makeup in a vehicle, an expected motion state parameter of the vehicle in at least one motion direction is obtained.

[0067] In this step, when it is determined that the passenger is putting on makeup in the vehicle, the sensor input fusion module of the vehicle is started to obtain the expected motion state parameters of the vehicle in at least one motion direction.

[0068] Optionally, the determination of whether the passenger is putting on makeup in the vehicle may be made by combining the flip state of the vehicle-mounted makeup mirror. Specifically, the flip state of the vehicle-mounted makeup mirror may be obtained first, and when the flip state meets a preset opening condition, it is determined that the passenger has started putting on makeup, and when the flip condition meets a preset closing condition, it is determined that the passenger has stopped putting on makeup.

[0069] Alternatively, the on state of the makeup mirror in the vehicle may be first obtained, and when the on state meets the preset on condition, the facial image of the passenger in the vehicle may be continuously obtained to determine whether the passenger is putting on makeup in the vehicle based on the facial image. More specifically, the on state of the makeup mirror may be determined by an angle sensor provided on the makeup mirror, and when the on angle of the smart makeup mirror ω>ω1 (ω1 is a threshold, such as 60°), the camera in the vehicle is turned on to confirm that the passenger is putting on makeup.

[0070] In addition, it is worth understanding that the above-mentioned expected motion state parameters can be a prediction of the vehicle's motion state in a short period of time in the future. For example, the corresponding expected motion state can be determined as turning in a specific direction by obtaining the state parameters of the turn signal. The corresponding expected motion state can also be determined as braking by obtaining the distance and relative speed between the vehicle and the front vehicle. The expected motion state can also be determined as vertical bumps of the vehicle by obtaining the height of bumps or depressions on the road ahead by a radar installed on the outside of the vehicle.

[0071] Step 102: Determine corresponding warning prompt information according to the expected motion state parameters of each motion direction and preset prompt conditions.

[0072] In this step, the corresponding early warning prompt information can be determined according to the expected motion state parameters of each motion direction and the preset prompt conditions, and the preset prompt conditions are set according to the target factors affecting the quality of the interior makeup. It can be understood that the target factors affecting the quality of the interior makeup can be the steering of the vehicle, the jumping of the vehicle, and the acceleration and deceleration of the vehicle. The preset prompt conditions corresponding to each target factor can be set as the height threshold of the road surface bump or depression that causes the vehicle to jump, and the expected collision time threshold with the obstacle in front.

[0073] Optionally, the first warning level may be determined according to the first expected motion state parameter and at least one first preset prompt threshold, and the first warning prompt information may be determined according to the first warning level, the second warning level may be determined according to the second expected motion state parameter and at least one second preset prompt threshold, and the second warning prompt information may be determined according to the second warning level, the third warning level may be determined according to the third expected motion state parameter and at least one third preset prompt threshold, and the third warning prompt information may be determined according to the third warning level. It is worth noting that in the present embodiment, the first expected motion state parameter, the second expected motion state parameter, and the third expected motion state parameter may be independently judged, or the above three state parameters may be comprehensively judged.

[0074] In addition, if a comprehensive judgment is made on the above three status parameters, the warning level can be determined according to the first warning level, the second warning level and the third warning level, and the warning prompt information can be determined according to the warning level. The warning level is the highest warning level among the first warning level, the second warning level and the third warning level.

[0075] Step 103: Push warning information to warn passengers before the target factor is triggered.

[0076] If the expected motion state parameters meet the preset prompt conditions, the corresponding early warning prompt information is determined and pushed to warn passengers before the target factors are triggered.

[0077] For example, when the vehicle's steering, vehicle's bouncing, vehicle's acceleration and deceleration meet preset prompt conditions, early warning information may be pushed; for example, feedback may be given to passengers through voice broadcasts, light changes, text displays, seat vibrations, etc.; or a combination of the above methods may be used to provide early warning feedback for different warning levels.

[0078] In this embodiment, when determining that the passenger is putting on makeup in the vehicle, the expected motion state parameters of the vehicle in at least one motion direction are obtained, wherein the expected motion state parameters are used to characterize the motion state of the vehicle after a preset time, and then the corresponding warning prompt information is determined according to the expected motion state parameters of each motion direction and the preset prompt conditions, and the preset prompt conditions are set according to the target factors that affect the quality of makeup in the vehicle, and finally, the warning prompt information is pushed to warn the passenger before the target factor is triggered, so that when the passenger puts on makeup in the moving vehicle, the vehicle driving state and the changes in the external road conditions can be predicted, and the danger caused by the change of the vehicle motion state can be effectively avoided. And by means of early warning, the passenger is prompted to stop putting on makeup before the target factor that affects the quality of makeup is triggered, so as to ensure the quality of the passenger's makeup and improve the passenger's makeup experience.

[0079] Figure 4 FIG. 1 is a flow chart of a passenger makeup warning method according to another exemplary embodiment of the present application. Figure 4 As shown, in the passenger makeup warning method provided by this embodiment, it is determined that the current driving mode of the vehicle is in the manual driving mode, then the first expected motion state parameter is determined according to the vehicle's turn signal on state, the second expected motion state parameter is determined according to the longitudinal collision time of the vehicle, and the third expected motion state parameter is determined according to the height difference of the road surface in the driving direction of the vehicle. Among them, the lateral direction corresponding to the first expected motion state parameter is the steering direction of the vehicle, the longitudinal direction corresponding to the second expected motion state parameter is the driving direction of the vehicle, and the vertical direction corresponding to the third expected motion state parameter is the bouncing direction of the vehicle.

[0080] Specifically, when the speed V monitored by the vehicle speed sensor is greater than 0, the angle sensor information on the vehicle makeup mirror is collected. When the smart makeup mirror is opened at an angle ω>ω1 (ω1 is a threshold, such as 60°), the in-car camera is turned on to confirm that the passenger is putting on makeup. Then, the vehicle operation information is collected, which is divided into three ways:

[0081] 1) Lateral: When the turn signal is on, the vehicle is considered to have the intention to turn or change lanes.

[0082] 2) Longitudinal direction: Collect the Time to Collision (TTC) signal. When TTC < t0, the vehicle enters the makeup warning state, where t0 is the collision time threshold.

[0083] 3) Vertical direction: Collect radar information and calculate the unevenness h of the road surface ahead. When h > h0 (h0 is a threshold, such as 2 cm), it is determined that the road ahead is an uneven road surface.

[0084] Then, input the expected motion state information in the lateral, longitudinal, and vertical directions into the vehicle control module, and correspond different warning levels according to the degree of change in the expected state. The warning levels are divided into three levels: the first warning level Level1, the second warning level Level2, and the third warning level Level13.

[0085] To illustrate the corresponding relationship between each expected motion state parameter and the warning level in more detail, the following can be elaborated through an exemplary corresponding relationship, specifically as follows:

[0086] 1) The corresponding relationship between the lateral motion state parameter and the lateral warning level is as follows:

[0087] Turn signal Level 1 Open

[0088] It can be seen that as long as the vehicle's turn signal is turned on, it is considered that the vehicle is about to turn, and the warning level corresponds to Level1.

[0089] 2) The corresponding relationship between the longitudinal motion state parameter and the longitudinal warning level is as follows:

[0090] TTC Level 1 t0>TTC>t1 Level2 t1>TTC>t2 Level3 TTC<t2

[0091] When t0 > TTC > t1, it indicates that the distance between the vehicle and the vehicle ahead is relatively far, and the warning level corresponds to Level1; when t1 > TTC > t2, it indicates that the distance between the vehicle and the vehicle ahead is medium, and the warning level corresponds to Level2; when TTC < t2, the distance between the host vehicle and the vehicle ahead is small, and the warning level corresponds to Level3.

[0092] 3) The corresponding relationship between the vertical motion state parameter and the vertical warning level is as follows:

[0093] Roughness of the road ahead h Level 1 <h2 style=";text-align:left;direction:ltr">h0 <h<h1 style=";text-align:left;direction:ltr"> ​ Level2 h1 <h<h2 Level3 h>h2

[0094] When h0 < h < h1, it indicates that the unevenness of the road ahead is relatively small, and the warning level corresponds to Level1; when h1 < h < h2, it indicates that the unevenness of the road ahead is medium, and the warning level corresponds to Level2; when h > h2, it indicates that the unevenness of the road ahead is large, and the warning level corresponds to Level3.

[0095] In addition, it is worth mentioning that the above-mentioned TTC signal needs to be collected a period of time (such as 5 seconds) in advance, that is, the TTC signal 5 seconds after the vehicle control system is calculated is currently collected, so that there is enough warning time for passengers who are wearing makeup.

[0096] The radar detection distance for detecting the roughness h of the road ahead needs to be far enough (such as 100m) to provide sufficient warning time for passengers wearing makeup.

[0097] Finally, considering the lateral, longitudinal and vertical vehicle motion states, the final warning level Level implements the highest warning level in the three directions, that is, Level = max (lateral warning level, longitudinal warning level, vertical warning level).

[0098] It is worth noting that the above example is only used as an illustrative embodiment to facilitate understanding of the specific logic of the embodiment of the present application. The embodiment of the present application can set adaptive conditions according to the engineering requirements of actual working conditions. As long as the adaptive settings comply with the setting logic in the above embodiment of the present application, they are within the protection scope of the present application.

[0099] Figure 5 FIG. 1 is a flow chart of a passenger makeup warning method according to another exemplary embodiment of the present application. Figure 5 As shown, in the passenger makeup warning method provided by this embodiment, it is determined that the current driving mode of the vehicle is in the intelligent driving mode, then the first expected motion state parameter is determined according to the yaw angular velocity of the vehicle, the second expected motion state parameter is determined according to the pitch angular rate of the vehicle, and the third expected motion state parameter is determined according to the drop height of the road surface in the driving direction of the vehicle. Among them, the lateral direction corresponding to the first expected motion state parameter is the steering direction of the vehicle, the longitudinal direction corresponding to the second expected motion state parameter is the driving direction of the vehicle, and the vertical direction corresponding to the third expected motion state parameter is the bouncing direction of the vehicle.

[0100] Specifically, when the speed V monitored by the vehicle speed sensor is greater than 0, the angle sensor information on the vehicle makeup mirror is collected. When the smart makeup mirror is opened at an angle ω>ω1 (ω1 is a threshold, such as 60°), the in-car camera is turned on to confirm that the passenger is putting on makeup. Then, the vehicle operation information is collected, which is divided into three ways:

[0101] 1) Lateral: collect the vehicle’s yaw rate information (represented by α) in real time. When α>α0, the vehicle enters the makeup warning state, where α0 is the yaw rate threshold.

[0102] 2) Longitudinal direction: collect the vehicle pitch rate information (represented by β) in real time. When β>β0, the vehicle enters the makeup warning state, where β0 is the pitch rate threshold.

[0103] 3) Vertically: Collect radar information, calculate the unevenness h of the road surface ahead. When h > h0 (h0 is a threshold, such as 2 cm), it is determined that the road ahead is an uneven road surface.

[0104] Then, input the information on the changes in the lateral, longitudinal, and vertical vehicle motion states into the vehicle control module, and correspond different warning levels according to the degree of change. The warning levels are divided into three levels: the first warning level Level1, the second warning level Level2, and the third warning level Level13.

[0105] To illustrate the corresponding relationship between each expected motion state parameter and the warning level in more detail, the following can be elaborated through an exemplary corresponding relationship, specifically as follows:

[0106] 1) The corresponding relationship between the lateral motion state parameter and the lateral warning level is as follows:

[0107] yaw rateα Level 1 α0<α<α1 Level2 α1<α<α2 Level3 α>α2

[0108] When α0 < α < α1, it indicates that the yaw rate value is small, and the warning level corresponds to Level1; when α1 < α < α2, it indicates that the yaw rate value is medium, and the warning level corresponds to Level2; when α > α2, it indicates that the yaw rate value is large, and the warning level corresponds to Level3.

[0109] 2) The corresponding relationship between the longitudinal motion state parameter and the longitudinal warning level is as follows:

[0110] pitch rate Level 1 β0<β<β1 Level2 β1<β<β2 Level3 β>β2

[0111] When β0 < β < β1, it indicates that the pitch rate value is small, and the warning level corresponds to Level1; when β1 < β < β2, it indicates that the pitch rate value is medium, and the warning level corresponds to Level2; when β > β2, it indicates that the pitch rate value is large, and the warning level corresponds to Level3.

[0112] 3) The corresponding relationship between the vertical motion state parameter and the vertical warning level is as follows:

[0113] Roughness of the road ahead h Level 1 <h2 style=";text-align:left;direction:ltr">h0 <h<h1 style=";text-align:left;direction:ltr"> ​ Level2 h1 <h<h2 Level3 h>h2

[0114] When h0 < h < h1, it indicates that the unevenness of the road ahead is small, and the warning level corresponds to Level1; when h1 < h < h2, it indicates that the unevenness of the road ahead is medium, and the warning level corresponds to Level2; when h > h2, it indicates that the unevenness of the road ahead is large, and the warning level corresponds to Level3.

[0115] In addition, it is worth mentioning that the above-mentioned TTC signal needs to be collected a period of time (such as 5 seconds) in advance, that is, the TTC signal 5 seconds after the vehicle control system is calculated is currently collected, so that there is enough warning time for passengers who are wearing makeup.

[0116] The radar detection distance for detecting the roughness h of the road ahead needs to be far enough (such as 100m) to provide sufficient warning time for passengers wearing makeup.

[0117] Finally, considering the lateral, longitudinal and vertical vehicle motion states, the final warning level Level implements the highest warning level in the three directions, that is, Level = max (lateral warning level, longitudinal warning level, vertical warning level).

[0118] It is worth noting that the above example is only used as an illustrative embodiment to facilitate understanding of the specific logic of the embodiment of the present application. The embodiment of the present application can set adaptive conditions according to the engineering requirements of actual working conditions. As long as the adaptive settings comply with the setting logic in the above embodiment of the present application, they are within the protection scope of the present application.

[0119] exist Figure 4-Figure 5 In the embodiment shown, two driving types, manual driving and intelligent driving, are comprehensively considered, and graded warning rules are set for parameters under different driving modes. Then, during the driving process, the vehicle is monitored in real time through the motion state in the three directions of lateral, longitudinal and vertical directions to determine whether the vehicle is in an unfavorable working condition. If it is in an unfavorable working condition, a graded warning can be issued during the passenger's makeup process according to the degree of the unfavorable working condition to remind the passenger whether to suspend makeup. As a result, when the passenger is putting on makeup in a moving vehicle, the vehicle's driving state and external road conditions can be predicted, effectively avoiding dangers caused by changes in the vehicle's motion state. And through the method of graded warning, the passenger is prompted to stop putting on makeup before the target factor affecting the quality of makeup is triggered, so as to ensure the quality of the passenger's makeup and improve the passenger's makeup experience.

[0120] Figure 6 1 is a schematic diagram of the structure of a passenger makeup warning device according to an exemplary embodiment of the present application. Figure 6 As shown, this embodiment provides a passenger makeup warning device 200, including:

[0121] The sensor input fusion module 201 is configured to obtain expected motion state parameters of the vehicle in at least one motion direction when it is determined that a passenger is putting on makeup in the vehicle, wherein the expected motion state parameters are used to characterize the motion state of the vehicle after a preset time period;

[0122] The makeup warning control module 202 is configured to determine corresponding warning prompt information according to the expected motion state parameters of each motion direction and preset prompt conditions, wherein the preset prompt conditions are set according to target factors affecting the quality of in-vehicle makeup;

[0123] The graded warning module 203 is configured to push the warning prompt information to warn the passenger before the target factor is triggered.

[0124] In a possible design, the sensor input fusion module 201 is specifically configured to:

[0125] A first expected lateral motion state parameter, a second expected longitudinal motion state parameter, and a third expected vertical motion state parameter of the vehicle are obtained, wherein the lateral direction is the turning direction of the vehicle, the longitudinal direction is the driving direction of the vehicle, and the vertical direction is the bouncing direction of the vehicle.

[0126] In a possible design, the makeup warning control module 202 is specifically configured to:

[0127] determining a first warning level according to the first expected motion state parameter and at least one first preset prompt threshold, and determining first warning prompt information according to the first warning level; and / or,

[0128] determining a second warning level according to the second expected motion state parameter and at least one second preset prompt threshold, and determining second warning prompt information according to the second warning level; and / or,

[0129] A third warning level is determined according to the third expected motion state parameter and at least one third preset prompt threshold, and third warning prompt information is determined according to the third warning level.

[0130] In a possible design, the makeup warning control module 202 is further configured to:

[0131] The warning level is determined according to the first warning level, the second warning level and the third warning level, and the warning prompt information is determined according to the warning level, and the warning level is the highest warning level among the first warning level, the second warning level and the third warning level.

[0132] In a possible design, the makeup warning control module 202 is specifically configured to:

[0133] Determine the current driving mode of the vehicle;

[0134] If the driving mode is a manual driving mode, the first expected motion state parameter is determined according to the turn signal on state of the vehicle, the second expected motion state parameter is determined according to the longitudinal collision time of the vehicle, and the third expected motion state parameter is determined according to the drop height of the road surface in the driving direction of the vehicle;

[0135] If the driving mode is an intelligent driving mode, the first expected motion state parameter is determined according to the yaw angular velocity of the vehicle, the second expected motion state parameter is determined according to the pitch angular rate of the vehicle, and the third expected motion state parameter is determined according to the height difference of the road surface in the driving direction of the vehicle.

[0136] In a possible design, the sensor input fusion module 201 is further configured to: obtain the opening state of the makeup mirror in the vehicle, and when the opening state meets a preset opening condition, obtain the facial image of the passenger in the vehicle to determine that the passenger is putting on makeup in the vehicle based on the facial image.

[0137] The device provided in this embodiment can be used to execute the steps in the above method embodiment. For details not disclosed in the device embodiment of this application, please refer to the method embodiment of this application.

[0138] Figure 7 is a schematic diagram of the structure of an electronic device according to an exemplary embodiment of the present application. Figure 7 As shown, this embodiment provides an electronic device 300, including:

[0139] processor 301; and,

[0140] A memory 302, used to store executable instructions of the processor, and the memory may also be a flash memory;

[0141] The processor 301 is configured to execute each step in the above method by executing the executable instructions.

[0142] Optionally, the memory 302 may be independent or integrated with the processor 301 .

[0143] When the memory 302 is a device independent of the processor 301, the electronic device 300 may further include:

[0144] The bus 303 is used to connect the processor 301 and the memory 302 .

[0145] This embodiment further provides a readable storage medium, in which a computer program is stored. When at least one processor of an electronic device executes the computer program, the electronic device executes each step in the above method.

[0146] This embodiment also provides a program product, which includes a computer program stored in a readable storage medium. At least one processor of the electronic device can read the computer program from the readable storage medium, and at least one processor executes the computer program so that the electronic device implements each step in the above method.

[0147] Those skilled in the art can understand that all or part of the steps of implementing the above-mentioned method embodiments can be completed by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When the program is executed, the steps of the above-mentioned method embodiments are executed; and the aforementioned storage medium includes: ROM, RAM, disk or optical disk and other media that can store program codes.

[0148] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A passenger makeup warning method, characterized in that: include: When it is determined that the passenger is putting on makeup in the vehicle, obtaining an expected motion state parameter of the vehicle in at least one motion direction, the expected motion state parameter being used to characterize the motion state of the vehicle after a preset time period; Determine corresponding warning prompt information according to the expected motion state parameters of each motion direction and preset prompt conditions, wherein the preset prompt conditions are set according to target factors affecting the quality of in-vehicle makeup, wherein the warning prompt information is determined by the highest warning level among the warning levels corresponding to each motion direction, and the warning level corresponding to each motion direction is determined by the degree of change of the expected motion state parameters of each motion direction, and different degrees of change correspond to different warning levels, and different warning levels correspond to different warning prompt information; Pushing the warning prompt information to warn the passenger before the target factor is triggered; The obtaining of the expected motion state parameter of the vehicle in at least one motion direction includes: A first expected lateral motion state parameter, a second expected longitudinal motion state parameter, and a third expected vertical motion state parameter of the vehicle are obtained, wherein the lateral direction is the turning direction of the vehicle, the longitudinal direction is the driving direction of the vehicle, and the vertical direction is the bouncing direction of the vehicle.

2. The passenger makeup warning method according to claim 1, characterized in that: The determining of corresponding early warning prompt information according to the expected motion state parameters of each motion direction and preset prompt conditions includes: determining a first warning level according to the first expected motion state parameter and at least one first preset prompt threshold, and determining first warning prompt information according to the first warning level; and / or, determining a second warning level according to the second expected motion state parameter and at least one second preset prompt threshold, and determining second warning prompt information according to the second warning level; and / or, A third warning level is determined according to the third expected motion state parameter and at least one third preset prompt threshold, and third warning prompt information is determined according to the third warning level.

3. The passenger makeup warning method according to claim 2, characterized in that: The method of determining corresponding early warning prompt information according to the expected motion state parameters of each motion direction and preset prompt conditions also includes: The warning level is determined according to the first warning level, the second warning level and the third warning level, and the warning prompt information is determined according to the warning level, and the warning level is the highest warning level among the first warning level, the second warning level and the third warning level.

4. The passenger makeup warning method according to any one of claims 1 to 3, characterized in that: The obtaining of the first expected lateral motion state parameter, the second expected longitudinal motion state parameter, and the third expected vertical motion state parameter of the vehicle includes: Determine the current driving mode of the vehicle; If the driving mode is a manual driving mode, the first expected motion state parameter is determined according to the turn signal on state of the vehicle, the second expected motion state parameter is determined according to the longitudinal collision time of the vehicle, and the third expected motion state parameter is determined according to the drop height of the road surface in the driving direction of the vehicle; If the driving mode is an intelligent driving mode, the first expected motion state parameter is determined according to the yaw angular velocity of the vehicle, the second expected motion state parameter is determined according to the pitch angular rate of the vehicle, and the third expected motion state parameter is determined according to the height difference of the road surface in the driving direction of the vehicle.

5. The passenger makeup warning method according to any one of claims 1 to 3, characterized in that: Before acquiring the expected motion state parameter of the vehicle in at least one motion direction, the method further includes: The on state of the makeup mirror in the vehicle is obtained, and when the on state meets a preset on condition, a facial image of the passenger in the vehicle is obtained to determine that the passenger is applying makeup in the vehicle according to the facial image.

6. A passenger makeup warning system, characterized in that: include: a sensor input fusion module, configured to obtain expected motion state parameters of the vehicle in at least one motion direction when it is determined that a passenger is putting on makeup in the vehicle, wherein the expected motion state parameters are used to characterize the motion state of the vehicle after a preset time period; A makeup warning control module is configured to determine corresponding warning prompt information according to the expected motion state parameters of each motion direction and preset prompt conditions, wherein the preset prompt conditions are set according to target factors affecting the quality of in-vehicle makeup, wherein the warning prompt information is determined by the highest warning level among the warning levels corresponding to each motion direction, and the warning level corresponding to each motion direction is determined by the degree of change of the expected motion state parameters of each motion direction, and different degrees of change correspond to different warning levels, and different warning levels correspond to different warning prompt information; A graded warning module is configured to push the warning prompt information to warn the passenger before the target factor is triggered; The sensor input fusion module is specifically configured to: A first expected lateral motion state parameter, a second expected longitudinal motion state parameter, and a third expected vertical motion state parameter of the vehicle are obtained, wherein the lateral direction is the turning direction of the vehicle, the longitudinal direction is the driving direction of the vehicle, and the vertical direction is the bouncing direction of the vehicle.

7. An electronic device comprising: A processor, and a memory communicatively connected to the processor; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory to implement the method according to any one of claims 1 to 5.

8. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, which are used to implement the method according to any one of claims 1 to 5 when executed by a processor.

9. A computer program product, comprising a computer program, wherein when the computer program is executed by a processor, the method according to any one of claims 1 to 5 is implemented.

Images