Careless judgment method according to driver's biological condition analysis and hud control system for using thereof
By analyzing a driver's gaze and pupil size relative to vehicle speed and environment, the method addresses the inaccuracies of conventional systems by providing adaptive and accurate inattention warnings on a head-up display.
Patent Information
- Application Number
- KR1020210158885
- Authority / Receiving Office
- KR · KR
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-11-17
- Publication Date
- 2026-11-10
- Estimated Expiration
- 2041-11-17
AI Technical Summary
Conventional inattention warning systems use uniform judgment parameters that fail to accurately detect driver inattention or generate false warnings due to incorrect judgments, as they are not tailored to individual drivers or environmental conditions.
A method that determines driver inattention based on the analysis of a driver's biological state, including gaze and pupil size changes relative to vehicle speed and external environmental information, with a head-up display (HUD) outputting a warning signal at an optimal position based on the driver's gaze.
This approach provides reliable inattention warnings by adapting judgment parameters to individual drivers and environmental conditions, improving the accuracy and timing of inattention detection and warning.
Smart Images

Figure 112021132878556-PAT00001_ABST
Abstract
Description
Technology Field
[0001] The present invention relates to a method for determining driver inattention based on the analysis of a driver's biological state, a head-up display control system utilizing the same, and a method for determining driver inattention based on the analysis of a driver's biological state and a head-up display control method utilizing the same. More specifically, the invention relates to a method for determining driver inattention based on the analysis of a driver's biological state and a head-up display control system utilizing the same, and a method for determining driver inattention based on the analysis of a driver's biological state and a head-up display control method utilizing the same, wherein driver inattention is not determined according to uniform driver inattention judgment parameter standards, but rather by determining the state of driver inattention using the driver's gaze, changes in the driver's pupil size according to vehicle speed, and external environmental information, and when driver inattention is determined, a signal warning of driver inattention is output on a head-up display (HUD) installed in the vehicle, and at this time, the optimal output position is determined and reflected based on the driver's gaze position. Background Technology
[0002] Conventional inattention warning systems based on driver state analysis utilize a method of using a camera to determine and warn of driver inattention situations based on predetermined judgment rules, such as specific driver behaviors (e.g., not looking ahead, closing eyes) or departure from the vehicle's front area.
[0003] For example, the forward area departure detection is a method that issues a warning if the forward area, vehicle speed, and departure time predefined by the vehicle manufacturer are exceeded, and the eye-closing detection is a method that issues a warning based on whether the eye-closing time predefined by the manufacturer is exceeded.
[0004] These conventional inattention warning systems arbitrarily defined driver inattention judgment parameters by the manufacturer to determine the level change and warning timing of driver inattention situations. However, since these judgments were determined based on generalized parameters applied to all drivers, they had problems such as failing to properly issue inattention warnings because the conditions for warning and level change were not met, or generating false warnings due to incorrect judgments. Prior art literature
[0006] Korean Registered Patent No. 10-2020-0108196 The problem to be solved
[0007] The present invention was developed to solve the aforementioned problems and aims to provide a driver inattention judgment method based on the analysis of a driver's biological state, a head-up display control system utilizing the same, and a head-up display control method utilizing the same, wherein the driver inattention is determined not by uniform driver inattention judgment parameter criteria, but by utilizing the driver's gaze, changes in the driver's pupil size according to vehicle speed, and external environmental information, and when driver inattention is determined, a signal warning of driver inattention is output on a head-up display (HUD) installed in the vehicle, and at this time, the optimal output position is determined and reflected based on the driver's gaze position. means of solving the problem
[0008] A method for determining inattention based on the analysis of a driver's biological state and a head-up display control system utilizing the same according to an embodiment of the present invention may include: a vehicle state information acquisition unit that acquires vehicle state information including vehicle speed information and GPS location information from a plurality of sensors installed in a vehicle; a driver gaze camera unit that monitors and tracks the driver's gaze in real time and identifies the driver's pupil state; a front camera unit that captures the front of the vehicle to acquire a front-capturing image; a gaze position mapping unit that maps the driver's gaze position acquired through the driver gaze camera unit onto the front-capturing image acquired through the front camera unit to determine the distance to the gaze position; an inattention situation determination unit that determines the focal distance for the driver's gaze position based on the change in the driver's pupil size according to the vehicle speed, compares the driver's focal distance for the gaze position with the distance to the gaze position identified through the front camera unit, and determines a driver inattention situation if the result exceeds a preset value; and a head-up display control unit that determines the output position of a head-up display (HUD) installed in the vehicle based on the driver inattention situation determination result of the inattention situation determination unit and outputs a driver inattention warning signal.
[0009] In one embodiment, the driver-focused camera unit can determine whether the driver is aware of the driver inattention warning signal by measuring the time the driver gazes at the driver inattention warning signal while the driver inattention warning signal is output on the head-up display.
[0010] In one embodiment, the head-up display control unit can determine the output location of the driver inattention warning signal to be output on the head-up display based on the change in the driver's pupil size according to the vehicle speed.
[0011] In one embodiment, the head-up display control unit determines the output location of the driver inattention warning signal to be displayed on the head-up display based on the change in the driver's pupil size according to the vehicle speed, and can individually store the output location of the driver inattention warning signal for each driver.
[0012] In one embodiment, the inattention situation determination unit can determine the degree of change in the driver's field of vision based on the change in the driver's pupil size according to the vehicle speed and reflect this in determining the focal length.
[0013] In one embodiment, the inattention situation determination unit determines the degree of change in the driver's field of vision based on the change in the driver's pupil size according to the vehicle speed, and can individually store the amount of change in pupil size for each driver.
[0014] In one embodiment, the vehicle status information acquisition unit further acquires real-time weather information and real-time time information from the vehicle, and the inattention situation determination unit can reflect the vehicle's road, tunnel entry status, and entry time identified based on the GPS location information, and the real-time weather information and real-time time information, in the change in pupil size according to the driver's vehicle speed.
[0015] In one embodiment, the gaze position mapping unit divides the obtained forward-capturing image into a sky area and a plurality of ground areas, maps the driver's gaze position onto the divided forward-capturing image to obtain a position value for the driver's gaze position, and the inattention situation determination unit can determine the focal distance for the driver's corresponding gaze position using the obtained position value.
[0016] In one embodiment, the driver-focused camera unit can determine the driver's pupil state based on the light intensity information around the vehicle obtained through the vehicle state information acquisition unit.
[0017] In one embodiment, the driver-watching camera unit can generate and transmit a signal to the driver-watching situation determination unit for determining a driver-watching situation if, as a result of watching and tracking the driver's gaze in real time, the driver's gaze is not confirmed for a certain period of time or longer.
[0018] A driver inattention judgment method based on the analysis of a driver's biological state and a head-up display control system utilizing the same, according to another embodiment of the present invention, comprises: a vehicle state information acquisition unit including a plurality of sensors that acquire vehicle state information including vehicle speed information and GPS location information according to the vehicle's driving; a driver gaze camera unit that monitors and tracks the driver's gaze in real time and identifies the driver's pupil state; a front camera unit that photographs the front of the vehicle to acquire a front-viewing image; a gaze position mapping unit that maps the driver's gaze position acquired through the driver gaze camera unit onto the front-viewing image acquired through the front camera unit to determine the distance to the gaze position; an inattention situation judgment unit that determines the focal distance for the driver's gaze position based on the change in the driver's pupil size according to the vehicle speed, compares the driver's focal distance for the gaze position with the distance to the gaze position identified through the front camera unit, and if it deviates from a preset value, determines a driver inattention situation and generates and outputs a warning signal; and a head-up display control unit that determines the output position of a head-up display (HUD) installed in the vehicle based on the driver inattention situation judgment result of the inattention situation judgment unit and outputs a driver inattention warning signal. It is possible.
[0019] In one embodiment, the head-up display control unit determines the output location of the driver inattention warning signal to be displayed on the head-up display based on the change in the driver's pupil size according to the vehicle speed, and can individually store the output location of the driver inattention warning signal for each driver.
[0020] A method for determining inattention based on the analysis of a driver's biological state according to another embodiment of the present invention and a head-up display control method utilizing the same comprises: a step of obtaining vehicle state information including vehicle speed information and GPS location information from a plurality of sensors installed in the vehicle through a vehicle state information acquisition unit; a step of observing and tracking the driver's gaze in real time and determining the driver's pupil state through a driver-observing camera unit; a step of capturing the front of the vehicle and obtaining a front-capturing image through a front-capturing camera unit; a step of mapping the driver's gaze position obtained through the driver-observing camera unit onto the front-capturing image obtained through the front-capturing camera unit through a gaze position mapping unit to determine the distance to the gaze position; a step of determining the focal distance for the driver's gaze position based on the change in the driver's pupil size according to the vehicle speed through an inattention situation determination unit, and comparing the driver's focal distance for the gaze position with the distance to the gaze position determined through the front-capturing camera unit to determine a driver inattention situation if it exceeds a preset value; and a step of determining the output position of a head-up display (HUD) installed in the vehicle and then signaling a driver inattention warning signal through a head-up display control unit based on the driver inattention situation determination result of the inattention situation determination unit. It may include a step for outputting. Effects of the invention
[0021] According to one aspect of the present invention, a state of driver inattention is determined by utilizing the driver's gaze, changes in the driver's pupil size according to vehicle speed, and external environment information. When driver inattention is determined, a signal warning of driver inattention is output on a head-up display (HUD) installed in a vehicle. At this time, by determining and reflecting an optimal output position based on the driver's gaze position, the invention has the advantage of reliably warning the driver of the state of inattention.
[0022] In addition, according to one aspect of the present invention, it has the advantage of improving convenience by enabling automatic tuning of driver adaptive judgment parameters for inattention judgment.
[0023] In addition, according to one aspect of the present invention, there is an advantage of being able to improve the performance of the judgment logic by determining the timing of the driver adaptive inattention warning and the timing of the level change.
[0024] In addition, according to one aspect of the present invention, it has the advantage of enabling optimal tuning of judgment parameters by analyzing the driver state more closely compared to conventional predetermined inattention judgment parameters. Brief explanation of the drawing
[0025] FIG. 1 is a diagram illustrating the configuration of a head-up display control system (100) utilizing an inattention judgment method based on the biological state analysis of a driver according to one embodiment of the present invention. Figure 2 is a diagram showing the driver's focal length and field of view according to the vehicle speed when driving. FIG. 3 is a diagram showing the process of determining the driver's gaze area using an inattention judgment method based on the analysis of the driver's biological state shown in FIG. 1 and a head-up display control system (100) utilizing the same. FIG. 4 is a diagram showing the entire process of determining driver inattention using an inattention determination method based on the biological state analysis of the driver shown in FIG. 1 and a head-up display control system (100) utilizing the same. FIG. 5 is a diagram showing the entire process of controlling a head-up display using an inattention judgment method based on the biological state analysis of the driver shown in FIG. 4 and a head-up display control system (100) utilizing the same. Specific details for implementing the invention
[0026] The present invention is capable of various modifications and may have various embodiments; specific embodiments are illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the present invention to specific embodiments, and it should be understood that it includes all modifications, equivalents, and substitutions that fall within the spirit and scope of the present invention. In describing the present invention, detailed descriptions of related prior art are omitted if it is determined that such detailed descriptions may obscure the essence of the present invention.
[0027] Terms such as "first," "second," etc., may be used to describe various components, but said components should not be limited by said terms. These terms are used solely for the purpose of distinguishing one component from another.
[0028] The terms used in this application are used merely to describe specific embodiments and are not intended to limit the invention. The singular expression includes the plural expression unless the context clearly indicates otherwise. In this application, terms such as "comprising" or "having" are intended to specify the existence of the features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, and should be understood as not precluding the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof. Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.
[0030] FIG. 1 is a diagram illustrating the configuration of a driver's inattention judgment method based on the analysis of the driver's biological state and a head-up display control system (100) utilizing the same according to an embodiment of the present invention, FIG. 2 is a diagram showing the driver's focal length and field of view according to the vehicle speed when driving a vehicle, and FIG. 3 is a diagram showing the process of determining the driver's gaze area using the driver's inattention judgment method based on the analysis of the driver's biological state and the head-up display control system (100) utilizing the same shown in FIG. 1.
[0032] Referring to FIGS. 1 to 3, an inattention judgment method based on the biological state analysis of a driver according to one embodiment of the present invention and a head-up display control system (100) utilizing the same may be configured to include a vehicle state information acquisition unit (110), a driver gaze camera unit (120), a front camera unit (130), a gaze position mapping unit (140), an inattention situation judgment unit (150), and a head-up display (HUD) control unit (160).
[0033] The vehicle status information acquisition unit (110) acquires vehicle status information including vehicle speed information, steering wheel operation information, turn signal operation information, GPS location information, etc. from a plurality of various sensors installed in the vehicle. The acquired vehicle status information can be used for vehicle behavior information analysis and external environment analysis. In addition, the vehicle status information acquisition unit (110) can additionally acquire real-time weather information and real-time time information from sensors installed in the vehicle.
[0035] The driver-focused camera unit (120) monitors and tracks the gaze of the driver seated in the driver's seat in real time and determines the driver's pupil state. Here, the pupil state may refer to changes in the driver's pupil state, and the driver's visual field may consist of central vision and peripheral vision. Central vision refers to the field of vision where the image of an object is formed at the center of the retina, allowing the object to be seen most clearly and accurately, while peripheral vision refers to the outer range of the field of vision, which receives visual information in the part that is not focused.
[0036] Looking at Fig. 2, the focal length and field of view of the driver's vision change depending on the driving of the vehicle. For example, at a speed of 40 km / h, the driver's field of view is about 100°, at 70 km / h, the driver's field of view is about 65°, and at 100 km / h, the driver's field of view is about 40°.
[0037] In other words, the faster the vehicle speed, the longer the driver's focal distance becomes, while the field of view narrows.
[0038] This is related to changes in focal length due to changes in the driver's pupil size; when the driver's pupil size narrows, the focal length increases and the central vision narrows, while when the driver's pupil size widens, the focal length shortens and the central vision widens. In particular, during night driving, as the driver's pupils enlarge and a large amount of light enters, glare occurs, and the focusing distance range becomes more limited than during daytime driving.
[0039] Therefore, the present invention aims to determine driver inattention based on the correlation between the driver's pupil size, field of view (central vision, peripheral vision), and focal length.
[0040] The driver-observing camera unit (120) can be installed to face the driver's eyeball inside the vehicle, thereby allowing the driver's gaze to be monitored and tracked in real time while observing the user's eye movements, and changes in the driver's pupil size can be identified. In particular, the driver-observing camera unit (120) can identify changes in the driver's pupil size according to the vehicle speed and transmit this to the inattention situation judgment unit (150).
[0042] The front camera unit (130) can capture the front of the vehicle to obtain a front-capturing image and transmit it to the gaze position mapping unit (130) so that the distance to the driver's gaze position can be determined. The distance to the gaze position can be determined by mapping the driver's gaze position obtained through the driver gaze camera unit (120) in the gaze position mapping unit (140) using the front-capturing image captured by the front camera unit (130).
[0044] The gaze position mapping unit (140) can determine the distance to the gaze position obtained by the driver's gaze position obtained through the driver gaze camera unit (120) by mapping it onto the front-facing image obtained through the front camera unit (130). To this end, the front-facing image obtained through the front camera unit (130) is divided into a sky area, a number of ground areas, and a road, and the driver's gaze position is mapped onto the divided front-facing image to obtain a position value for the driver's gaze position. The gaze position mapping unit (140) may include a distance measuring sensor (not shown), and can determine the actual distance to the driver's gaze position mapped onto the front-facing image through the distance measuring sensor.
[0045] Meanwhile, the position value for the acquired gaze position is transmitted to the inattention situation judgment unit (150), and the inattention situation judgment unit (150) can determine the focal distance for the driver's gaze position using the acquired position value.
[0047] The inattention situation determination unit (150) obtains vehicle speed information from the vehicle status information acquisition unit (110), determines the focal distance of the driver's gaze position based on the change in the driver's pupil size according to the vehicle speed while driving, compares the driver's focal distance to the gaze position with the distance to the gaze position determined through the front camera unit (130), and if it exceeds a preset value, determines it as a driver inattention situation and transmits the determination result to the head-up display control unit (160).
[0048] For example, when a vehicle is traveling at a specific speed and the driver is looking at a specific location, the driver's pupil state (pupil size) is automatically adjusted to match the vehicle speed by a biological response. That is, the driver gaze camera unit (120) detects this change in the driver's pupil size, and the inattention situation judgment unit (150) compares the focal distance based on the change in the driver's pupil size according to the vehicle speed with the actual distance to the corresponding gaze location identified through the front camera unit (130) and the gaze location mapping unit (140). If the focal distance calculated based on the driver's pupil size according to the specific vehicle speed matches the actual distance to the corresponding gaze location, the inattention situation judgment unit (150) determines that the driver is currently paying attention to driving.
[0049] If the focal distance calculated according to the driver's pupil size according to a specific vehicle speed and the actual distance to the corresponding gaze position do not match, and the difference in distance is greater than a certain distance (e.g., 10m), the inattention situation judgment unit (150) calculates the front area parameter setting for inattention judgment and determines the driver as being in an inattention situation. In addition, the inattention situation judgment unit (150) calculates the level change time parameter according to the warning time for inattention judgment and the difference in distance, and transmits the calculated result value to the head-up display control unit (160), thereby causing the head-up display control unit (160) to output a driver inattention warning signal based on this.
[0050] In addition, the inattention situation judgment unit (150) may determine the degree of change in the driver's field of vision based on the change in the driver's pupil size according to the vehicle speed and reflect this in determining the focal distance. Since the amount of change in pupil size varies for each driver, the inattention situation judgment unit (150) individually stores the amount of change in pupil size for each driver, thereby personalizing the driver inattention judgment for each driver.
[0051] In addition, the inattention situation determination unit (150) reflects the vehicle's road and tunnel entry status and entry time, real-time weather information, and real-time time information, which are identified based on the GPS location information obtained from the vehicle status information acquisition unit (110) described above, into the change in pupil size according to the driver's vehicle speed, thereby enabling more accurate identification of the driver's pupil size change using environmental analysis based on changes in external conditions.
[0052] In particular, as shown in FIG. 3, the inattention situation determination unit (150) can determine the gaze area currently being looked at by the driver based on vehicle speed information obtained through the vehicle state information acquisition unit (110), the driver's pupil state (pupil size) identified through the driver gaze camera unit (120), the distance to the driver's gaze position identified through the front camera unit (130) and the gaze position mapping unit (140), and the focal distance to the driver's gaze position.
[0054] FIG. 4 is a diagram showing the entire process of determining driver inattention using an inattention determination method based on the biological state analysis of the driver shown in FIG. 1 and a head-up display control system (100) utilizing the same.
[0055] Looking at FIG. 4, the vehicle status information acquisition unit (110) acquires vehicle status information from a plurality of sensors installed in the vehicle and transmits it to the inattention situation determination unit (150), and the driver gaze camera unit (120) identifies the pupil state of each driver and monitors and tracks the driver's gaze in real time, and maps the driver's gaze position acquired at this time to a front-facing image captured through the front camera unit (130).
[0056] The inattention situation determination unit (150) determines the focal distance for the gaze position based on the driver's pupil size according to the vehicle speed and calculates the parameter setting for the driver's gaze area for inattention determination by comparing it with the actual distance to the gaze position identified through the front camera unit. If the comparison result deviates from a preset value, the inattention situation determination unit (150) determines that the driver is in an inattention situation and calculates the warning time and the corresponding level change time parameter.
[0058] Meanwhile, in one embodiment, the head-up display control unit (160) outputs a driver inattention warning signal through a head-up display (HUD) installed in a vehicle based on the driver inattention situation determination result of the inattention situation determination unit (150) mentioned above, and also determines and reflects the optimal output position of the warning signal according to the driver's gaze position. This will be examined through FIG. 5.
[0059] FIG. 5 is a diagram showing the entire process of controlling a head-up display using an inattention judgment method based on the biological state analysis of the driver shown in FIG. 4 and a head-up display control system (100) utilizing the same. FIG. 5 begins with the result of determining driver inattention in the inattention situation judgment unit (150) of FIG. 4.
[0060] The head-up display control unit (160) determines the output position of the head-up display installed in the vehicle based on the driver inattention judgment result of the inattention situation judgment unit (150) mentioned earlier, and then outputs a driver inattention warning signal to notify the driver that inattention is currently occurring.
[0061] At this time, the head-up display control unit (160) determines the optimal position for outputting a driver inattention warning signal on the head-up display based on the driver's gaze and the driver's looking position tracked through the driver-focused camera unit (120). For example, if the driver's looking position on the head-up display screen remains fixed for a certain period of time, that position can be determined as the optimal position for outputting a driver inattention warning signal.
[0062] Additionally, while a driver inattention warning signal is output on the head-up display through the head-up display control unit (160), the inattention situation determination unit (150) repeats the process described above to continuously determine the degree of driver inattention, and if it is determined that the driver is paying attention to driving, the head-up display control unit (160) stops the output of the driver inattention warning signal through the head-up display.
[0064] Although the present invention has been described above with reference to preferred embodiments, those skilled in the art will understand that various modifications and changes can be made to the invention without departing from the spirit and scope of the invention as described in the following claims. Explanation of the symbols
[0066] 100: Inattention judgment method based on analysis of driver's biological state and head-up display control system utilizing the same 110: Vehicle status information acquisition unit 120: Driver-focused camera unit 130: Front camera unit 140: Examination Location Mapping Section 150: Negligence Situation Judgment Unit 160: Head-up display control unit
Claims
Claim 1 A vehicle status information acquisition unit that acquires vehicle status information including vehicle speed information and GPS location information from a plurality of sensors installed in the vehicle; a driver gaze camera unit that monitors and tracks the driver's gaze in real time and identifies the driver's pupil state; a front camera unit that photographs the front of the vehicle to acquire a front-capturing image; a gaze position mapping unit that maps the driver's gaze position acquired through the driver gaze camera unit onto the front-capturing image acquired through the front camera unit, acquires a position value for the driver's gaze position, and determines the actual distance to the gaze position using the position value; and a driver inattention situation determination unit that determines the focal distance for the driver's gaze position using the acquired position value, judges the degree of change in the driver's field of view based on the change in the driver's pupil size according to the vehicle speed and reflects it in determining the focal distance, and compares the driver's focal distance for the gaze position with the actual distance to the gaze position identified through the front camera unit, and determines a driver inattention situation if the difference exceeds a preset value. A head-up display control system utilizing an inattention judgment method based on the analysis of a driver's biological state, comprising: a head-up display control unit that determines the output position of a head-up display (HUD) installed in a vehicle based on the driver inattention judgment result of the inattention judgment unit; wherein the focal distance and the actual distance are identified using the same position value, and the inattention judgment unit determines that the driver is paying attention to driving when the focal distance and the actual distance match each other. Claim 2 A head-up display control system utilizing an inattention determination method based on the biological state analysis of a driver, wherein, in claim 1, the driver-focused camera unit measures the time the driver gazes at the driver inattention warning signal while the driver inattention warning signal is output on the head-up display and determines whether the driver is aware of the driver inattention warning signal. Claim 3 A head-up display control system utilizing an inattention judgment method based on the biological state analysis of a driver, wherein, in claim 1, the head-up display control unit determines the output position of the driver inattention warning signal to be output on the head-up display based on the change in the driver's pupil size according to the vehicle speed. Claim 4 In paragraph 3, the head-up display control unit determines the output location of the driver inattention warning signal to be output on the head-up display based on the change in the driver's pupil size according to the vehicle speed, and individually stores the output location of the driver inattention warning signal for each driver, thereby utilizing a head-up display control system utilizing an inattention judgment method based on the analysis of the driver's biological state. Claim 5 delete Claim 6 A head-up display control system utilizing a method for determining inattention based on the biological state analysis of a driver, wherein, in claim 1, the vehicle state information acquisition unit further acquires real-time weather information and real-time time information from the vehicle, and the inattention situation determination unit reflects the vehicle's road, tunnel entry status and entry time identified based on the GPS location information, and the real-time weather information and real-time time information, in the change in pupil size according to the driver's vehicle speed. Claim 7 delete Claim 8 A head-up display control system utilizing an inattention judgment method based on the biological state analysis of a driver, wherein, in claim 1, the driver-focused camera unit identifies the driver's pupil state according to light intensity information around the vehicle obtained through the vehicle state information acquisition unit. Claim 9 A head-up display control system utilizing an inattention judgment method based on the biological state analysis of a driver, wherein, in claim 1, the driver-focused camera unit generates and transmits a signal to the inattention situation judgment unit for determining a driver inattention situation when the driver's gaze is not confirmed for a certain period of time or longer as a result of real-time focusing and tracking of the driver's gaze. Claim 10 A vehicle status information acquisition unit including a plurality of sensors installed in a vehicle and acquiring vehicle status information including vehicle speed information and GPS location information according to the vehicle's driving; a driver gaze camera unit that monitors and tracks the driver's gaze in real time and identifies the driver's pupil state; a front camera unit that photographs the front of the vehicle to acquire a front-capturing image; a gaze position mapping unit that maps the driver's gaze position acquired through the driver gaze camera unit onto the front-capturing image acquired through the front camera unit to acquire a position value for the driver's gaze position and determines the actual distance to the gaze position using the position value; and a carelessness situation determination unit that determines the focal distance for the driver's gaze position using the acquired position value, judges the degree of change in the driver's field of view based on the change in the driver's pupil size according to the vehicle speed and reflects it in determining the focal distance, and compares the driver's focal distance for the gaze position with the actual distance to the gaze position identified through the front camera unit, and if it deviates from a preset value, determines it as a driver carelessness situation and generates and outputs a warning signal. A head-up display control system utilizing an inattention judgment method based on the analysis of a driver's biological state, comprising: a head-up display control unit that determines the output position of a head-up display (HUD) installed in a vehicle based on the driver inattention judgment result of the inattention judgment unit; wherein the focal distance and the actual distance are identified using the same position value, and the inattention judgment unit determines that the driver is paying attention to driving when the focal distance and the actual distance match each other. Claim 11 A head-up display control system utilizing an inattention judgment method based on the biological state analysis of a driver, characterized in that, in claim 10, the head-up display control unit determines the output location of the driver inattention warning signal to be output on the head-up display based on the change in the driver's pupil size according to the vehicle speed, and individually stores the output location of the driver inattention warning signal for each driver. Claim 12 A step of acquiring vehicle status information including vehicle speed information and GPS location information from a plurality of sensors installed in the vehicle through a vehicle status information acquisition unit; a step of observing and tracking the driver's gaze in real time and determining the driver's pupil state through a driver gaze camera unit; a step of capturing the front of the vehicle through a front camera unit to acquire a front-capturing image; a step of mapping the driver's gaze position obtained through the driver gaze camera unit onto the front-capturing image obtained through the front camera unit through a gaze position mapping unit to obtain a position value for the driver's gaze position and determining the actual distance to the gaze position using the position value; a step of determining the focal distance for the driver's gaze position using the acquired position value through an inattention situation determination unit, wherein the degree of change in the driver's field of view is determined based on the change in the driver's pupil size according to vehicle speed and reflected in the determination of the focal distance, and a step of comparing the driver's focal distance for the gaze position with the actual distance to the gaze position determined through the front camera unit and determining a driver inattention situation if the difference exceeds a preset value. A head-up display control method utilizing an inattention judgment method based on the analysis of a driver's biological state, comprising: a step of determining the output position of a head-up display (HUD) installed in a vehicle based on the driver inattention situation judgment result of the inattention situation judgment unit through a head-up display control unit, and then outputting a driver inattention warning signal, wherein the focal distance and the actual distance are determined using the same position value, and the inattention situation judgment unit determines that the driver is paying attention to driving when the focal distance and the actual distance match each other.
Citation Information
Patent Citations
Display visibility based on eye convergence
KR1020170058395A
Headset display control based upon a user's pupil state
US20180365875A1
Apparatus for detecting driver's condition and method for detecting state of consciousness
JP2009232945A
Information display device
JP4935387B2
Warning system and method based on analysis integrating internal and external situation in vehicle
KR101914362B1
