Mirror assembly with a driver modeling system
The mirror assembly with a driver modeling system addresses the challenge of accurately obtaining driver size and position information by using a camera unit and processor to assign model profiles based on physical characteristics, thereby enhancing driver behavior monitoring and safety features.
Patent Information
- Application Number
- JP2024575754
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2022-06-24
- Filing Date
- 2023-06-23
- Publication Date
- 2025-06-26
- Estimated Expiration
- 2043-06-23
AI Technical Summary
Existing rearview mirror systems lack the capability to accurately obtain driver size and position information, which is crucial for monitoring driver behavior and detecting potentially dangerous driving actions.
A mirror assembly with a driver modeling system that includes a camera unit, user interface, processor, and memory, which requests or extrapolates physical characteristics from the driver to assign a model profile for accurate head size and position determination.
The system effectively monitors driver behavior by accurately determining the driver's head size and position, enabling timely notifications for dangerous driving behaviors and improving the accuracy of airbag settings.
Smart Images

Figure 2025519952000001_ABST
Abstract
Description
Technical Field
[0001] The present disclosure generally relates to a rearview mirror device system, and more specifically, to a mirror assembly having a driver modeling system that accurately obtains driver size and position information.
Summary of the Invention
[0002] According to one aspect of the present disclosure, a mirror assembly having a driver modeling system for a vehicle is provided. The driver modeling system includes a camera unit for imaging image data, a user interface, a processor, and a memory. When executed by the processor, the memory causes the processor to have an instruction to request at least one physical characteristic from the driver on the user interface or extrapolate it from the image data. In response to the input or extrapolation of the at least one physical characteristic, one of a plurality of model profiles of the driver's head is assigned based on the at least one physical characteristic.
[0003] According to another aspect of the present disclosure, a mirror assembly having a driver modeling system for a vehicle is provided. The driver modeling system includes a camera unit for imaging image data, a user interface, a processor, and a memory. When executed by the processor, the memory causes the processor to request at least one physical characteristic from the driver via the user interface, and has an instruction to assign one of a plurality of model profiles of the driver's head based on the at least one physical characteristic in response to the input of the at least one physical characteristic. The processor is further configured to extrapolate the size of the driver's head from the image data and assign the extrapolated model profile in response to the absence of the input of the at least one physical characteristic even after a predetermined time has elapsed.
[0004] According to yet another aspect of the present disclosure, a mirror assembly with a driver modeling system for a vehicle is provided. The driver modeling system includes a camera unit for imaging image data, a user interface, a processor, and a memory. When executed by the processor, the memory causes the processor to request at least one physical characteristic from the driver via the user interface, and has a command to assign one of a plurality of model profiles of the driver's head based on the at least one physical characteristic in response to an input of the at least one physical characteristic. The processor is further configured to obtain a relative position between the camera unit and the vehicle, and to obtain a relative position between the camera unit and the driver. The processor is further configured to perform coordinate transformation on each relative position in response to an input of each relative position to obtain a driver position with respect to the vehicle. The processor is further configured to monitor a relative position between the driver and the vehicle using the assigned model profile, and to generate a notification if there is behavior consistent with dangerous driving behavior.
[0005] These and other features, advantages, and objects of the present disclosure will be further understood and recognized by those skilled in the art by reference to the following specification, claims, and accompanying drawings.
Brief Description of the Drawings
[0006]
Figure 1
[0007]
Figure 2
[0008]
Figure 3
[0009]
Figure 4
DETAILED DESCRIPTION OF THE INVENTION
[0010] The illustrated embodiments of the present invention mainly relate to a combination of method steps and apparatus components of a mirror assembly with a driver modeling system that accurately obtains driver size and position information. Accordingly, the components of the apparatus and the steps of the method are represented by conventional symbols in the drawings showing only the specific details relevant to the understanding of the embodiments of the present disclosure so as not to obscure the present disclosure with details that would be readily apparent to those of ordinary skill in the art who would benefit from the description herein when appropriate. Further, in the description and the drawings, like numerals represent like elements.
[0011] For the purposes of the description herein, the terms "upper", "lower", "right", "left", "rearward", "forward", "vertical", "horizontal", and derivatives thereof shall relate to the orientation disclosed in FIG. 1. Unless stated otherwise, the term "forward" refers to the surface of an element closer to the intended observer of the display mirror, and the term "rearward" refers to the surface of an element farther from the intended observer of the display mirror. However, it should be understood that the present invention may take various alternative orientations, unless specifically specified to the contrary. It should also be understood that the specific devices and processes illustrated in the accompanying drawings and described in the following specification are merely exemplary embodiments of the inventive concepts defined in the appended claims. Accordingly, the specific dimensions and other physical characteristics related to the embodiments disclosed herein should not be considered limiting unless the claims expressly state otherwise.
[0012] The terms "including", "comprises", "comprising", or any other variation is intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Elements starting with "comprises a..." are not subject to further restrictions and do not preclude the presence of additional identical elements in a process, method, article, or apparatus that comprises that element.
[0013] First, referring to FIGS. 1 and 2, reference numeral 10 generally indicates a mirror assembly for a vehicle. In some embodiments, the mirror assembly 10 is a full display mirror having a reflective state and a display state. In the reflective state, the mirror assembly 10 operates as a mirror and reflects light of various wavelengths toward an intended observer. In the display state, the mirror assembly 10 transmits image data information (e.g., an image, a message, or a proposal) based on one or more images captured (acquired) by one or more image sensors. According to some embodiments, the mirror assembly 10 includes a partially reflective and partially transmissive element 12 (also referred to herein as a "glass element") and a display module 14 (FIG. 2) viewable through the partially reflective and partially transmissive element 12 to achieve this function. The partially reflective and partially transmissive element 12 may be an electro-optical element, such as an electrochromic element, and changes state when a voltage is applied. As will be described in more detail below, the mirror assembly 10 includes a driver monitoring function. The driver monitoring function monitors a driver (e.g., a vehicle driver) and obtains data for determining a pattern of the driver's behavior. For example, the direction the driver is looking, the blink rate that may indicate fatigue, head movement or tilt, etc. Based on these behaviors, the mirror assembly 10 generates a notification when the driver exhibits behaviors consistent with dangerous driver actions (e.g., inattentiveness or drowsiness).
[0014] The mirror assembly 10 further includes a housing 16 that protects and supports the partially reflective and partially transmissive element 12 and the display module 14. The housing 16 is attached to an associated vehicle via an attachment member 18. The housing 16 is movable relative to the attachment member 18 and can direct the partially transmissive element 12 at various angles to the vehicle driver to obtain different surrounding fields of view and / or different orientations with respect to the vehicle driver.
[0015] Referring particularly to FIG. 1 here, the mirror assembly 10 further includes a camera unit 20 for imaging image data. As will be understood, in some embodiments, the camera unit 20 may be relatively stationary with respect to the movement of the partially transmissive element 12, the display module 14, and / or the housing 16. In other embodiments, the camera unit 20 moves in conjunction with the movement of the partially transmissive element 12, the display module 14, and / or the housing 16. More specifically, the camera unit 20 may be directly connected within the housing 16 so as to move as the housing 16 is adjusted, or the camera unit 20 may be connected to a portion of the vehicle that is at least partially outside the housing 16 so that the orientation of the camera does not change during adjustment of the housing 16. The display module 14 may be sized to span substantially the entire viewing area 15 (FIG. 1) or may be located at one or more individual locations (FIG. 2) within the viewing area 15.
[0016] Continuing to refer to FIG. 1, the mirror assembly 10 is shown inside the passenger compartment 22 of the vehicle. The camera unit 20 may be disposed on or within the mirror assembly 10, or may be disposed at other portions of the passenger compartment 22. For example, the camera unit 20 may be disposed on or around the instrument panel 24, the steering wheel 26, or the mounting member 18. The steering wheel 26 may have an airbag 27 having a plurality of settings related to the deployment direction or size. It should also be understood that the camera unit 20 may include a plurality of camera units 20 located at any of the above positions. The camera unit 20 may be a component of a two-dimensional imaging system that further includes at least one lighting element 28 (e.g., one, two, three, four, or more lighting elements 28). In some embodiments, the at least one lighting element 28 may have one or more infrared emitters (or near-infrared emitters) for transmitting light at infrared wavelengths. In some embodiments, the camera unit 20 and the at least one lighting element 28 may utilize the same control system (e.g., a PCB, an ECU, and / or a processor) as other components of the mirror assembly 10. In other embodiments, the camera unit 20 and the at least one lighting element 28 may utilize a control system different from other components of the mirror assembly 10 and communicate with it wired or wirelessly. The camera unit 20 may have various imaging technologies such as night mode, image enhancement, thermal sensing, recording ability, wide-angle lens, and other types of technologies, and may image an image, for example, in the infrared spectrum.
[0017] The driver's seat 30 is disposed immediately behind the steering wheel 26 within the passenger compartment 22 and is adjustable in both the linear and angular directions. More specifically, the driver's seat 30 may be adjusted substantially linearly in the vertical direction (along the axis Y) and in the front-rear direction (along the axis Z). The driver's seat 30 has a seat cushion 32, a backrest 34, and a headrest 36 (FIG. 2). The backrest 34 and the headrest 36 may pivot in the front-rear direction relative to the seat cushion 32 to change the angle at which the driver leans. The position of the driver's seat 30 may be stored within the control system of the vehicle 31 (the "VCS") or may be otherwise obtainable. In some embodiments, a biometric scanner 38 may be disposed within the passenger compartment 22 or external to the vehicle (not shown). For example, the biometric scanner 38 may comprise one or more of an iris imaging device or scanner, a fingerprint scanner, a face imaging device or scanner, a voice scanner / recorder, or various other scanning devices. The biometric scanner 38 may obtain scan data that is stored in a biometric data memory 40, such as a remote cloud server that is accessible via, for example, a local memory or a wireless communication interface. Accordingly, the local memory or the remote server may be accessed to search for and compare scan data or biometric data against an identification profile to identify the driver and, for example, automatically adjust the orientation of the driver's seat 30 and the housing 16.
[0018] Referring now to FIGS. 2 and 3, the mirror assembly 10 includes a driver monitoring system 42 that provides one or more of the aforementioned driver monitoring functions. The driver monitoring system 42 includes a driver modeling system 44. The driver modeling system 44 may cooperate with one or more of the camera unit 20, the control system of the vehicle 31 (e.g., seat position), the biometric scanner 38, and the biometric data memory 40 to determine the size, shape, and position of the driver in order to more accurately identify when the driver exhibits behavior consistent with dangerous driver behavior. Thus, the driver modeling system 44 may include multiple model profiles rather than relying on a single driver model to determine the driver's behavior. When the size, shape, and position of the driver change, it may become difficult to accurately determine the behavior using the driver monitoring system 42. For example, when applying a common head shape to all drivers, inaccuracies occur because differences in a predetermined head shape (e.g., size, eye position, etc.) are not adjusted to fit a particular driver. Selecting a model profile that more accurately represents the physical characteristics of the driver's head may be useful for improving the accuracy of the driver monitoring system ("DMS"), such as the accuracy with which the location of the driver's physical characteristics (e.g., eyes) can be determined in three-dimensional space. As a result, the accuracy with which the system can determine whether a certain behavior is consistent with dangerous driver behavior can be improved, such as by improving the accuracy with which the DMS can determine whether the driver's line of sight is directed towards an area relevant to the driving task. By improving the accuracy, the driver monitoring system 42 improves performance and regulatory compliance.
[0019] Taller drivers direct their line of sight (e.g., point of fixation) to different positions than shorter drivers, so the relative position between the driver and the camera unit 20 can also be an important factor when determining the driver's behavior. Similarly, the size and position of the driver may appear different when based only on the position of the camera unit 20. For example, if the camera unit 20 is configured to move with the housing 16, the movement of the housing 16 (e.g., adjustment in the vehicle width direction, tilt, etc.) affects the orientation of the camera unit 20 and thus the image data captured by the camera unit 20. In some embodiments, the mirror assembly 10 (e.g., housing 16) includes a position detector 29 and / or a control system 100 capable of extrapolating the position of the mirror assembly 10 based on the image data. More specifically, the camera unit 20 can be a component of a three-dimensional imaging system instead of or in addition to two-dimensional imaging. The three-dimensional imaging system can operate under the principles of structured light, stereoscopy, optical detection and ranging (LIDAR), radar, or any other three-dimensional imaging system / sensor. In this way, the control system 100 can be configured to extrapolate three-dimensional information from the image data captured by the camera unit 20.
[0020] Continuing to refer to FIGS. 2 and 3, the driver modeling system 44 can be configured to obtain information from the driver based on several elements. For example, the driver modeling system 44 may obtain the position of the driver's seat 30, and the position of the driver's seat 30 in the vertical and longitudinal directions may be associated with the driver's height. The driver's height may be associated with an average head shape (e.g., size, eye position, etc.) corresponding to a specific height (e.g., in increments of 1 inch, 2 inches or less, 4 inches or less, or 6 inches or less). The driver modeling system 44 can further be configured to obtain reference points (e.g., via a coordinate system based on the vehicle) from within and around the passenger compartment 22 to better determine the size, shape, and position of the head. For example, the camera unit 20 can be configured to compare the head size with the width "W" and height "H" of the headrest 36. The W and H of the headrest 36 may be stored at an initial stage, or otherwise determined by extrapolating the image data captured by the camera unit 20 to the position of the driver's seat 30. In some embodiments, the camera unit 20 can be configured to compare the head size with the width of a seat belt (not shown). The width of the seat belt may be stored at an initial stage, or otherwise determined by extrapolating the image data captured by the camera unit 20 to the position of the driver's seat 30. Also, the position of the driver's head can be determined via the image data captured by the camera unit 20 and the position of the driver's seat 30. For example, the vertical head position can be determined by comparing and extrapolating the position of the driver's seat 30 with the relative position between the head and the headrest 36 and / or the backrest 34. Also, the shape of the head can be determined via the image data captured by the camera unit 20 and the relative dimensions of the position of the driver's seat 30.For example, after determining the head shape (e.g., size, eye position, etc.), the vertical and horizontal positions of the driver's eyes can likewise be determined by profiling physical characteristics of the driver's head such as the area 35 around the driver's head, jawline, nose, ears, and / or other face / head features in the image data captured by the camera unit 20. The physical characteristics (features) of the driver's head can be used to assist in determining the driver's line of sight. In some embodiments, the eye position is independently determined by a driver monitoring system 42 that processes image coordinates, along with other head and / or face features, and is compared to a head model to determine the actual head position and rotation in three-dimensional space.
[0021] Referring further to FIGS. 2 and 3, the driver modeling system 44 can obtain the position of the driver within the vehicle via detection and / or extrapolation (e.g., using the position detector 29) and / or via the control system 100. More specifically, the driver modeling system 44 can first determine the relative position of the camera unit 20 within the vehicle (e.g., via a reference point or the position detector 29) and the relative position of the camera with respect to the driver (e.g., via a reference point or the position detector 29). Once these two relative positions are determined, the control system 100 can determine the position of the driver with respect to the vehicle by coordinate transformation. For example, the image data related to the width W and / or height H of the headrest 36 can change as the camera unit 20 is adjusted. By extrapolating the geometric relationship between the camera unit 20 and the reference point or via the position detector 29, the position and size of the driver's head can be more accurately represented. The adjustment process is not used to directly manipulate the image data, but rather can be used to transform the DMS output (e.g., via coordinate transformation).
[0022] In some embodiments, the driver modeling system 44 may request information from the driver, such as at least one physical characteristic, such as height classification, gender classification, head size, etc. This information can be directly input from the driver via a user interface 46 located, for example, in the housing 16, the viewing area 15, a mobile device, or other locations within the passenger compartment 22. The user interface 46 can be configured to receive physical input (e.g., pressing a button) or voice input (e.g., from a microphone). For example, the driver modeling system 44 may have a general height model profile including average head shapes (e.g., size, eye position, etc.) of both genders corresponding to heights that vary in steps (e.g., in increments of 1 to 6 inches or less), a male height model profile including the average head shape of males corresponding to heights that vary in steps (e.g., in increments of 1 to 6 inches or less), and a female height model profile including the average head shape of females corresponding to heights that vary in steps (e.g., in increments of 1 to 6 inches or less). The driver modeling system 44 may have model profiles based on gender rather than height (e.g., a general female gender model profile and a general male gender model profile). Thus, when the driver provides height, gender, or both, the driver modeling system 44 can be configured to select the most accurate model profile to avoid de - genericizing the driver's head size using as many available elements as possible (e.g., gender, height, the position of the driver's seat 30, the relative size of the driver with respect to the driver's seat 30, the position of the steering wheel, etc.). In some embodiments, the user interface 46 may prompt the driver to turn the head to multiple positions (e.g., front profile and side profile) with respect to the camera unit 20 so that a three - dimensional head shape can be extrapolated (e.g., using a three - dimensional imaging system). In some embodiments, the driver may be prompted via the user interface 46 to provide other types of physical characteristics, such as head size (e.g., width, length, perimeter), distance between eyes, etc.Each or a selected one of the foregoing physical characteristics can be used to select or develop an accurate model profile and head position, thereby improving the accuracy of the readings and outputs of the DMS system.
[0023] The present disclosure can be used with a biometric scanner 38 and an authentication system such as that described in U.S. Patent No. 10,616,218, which is hereby incorporated by reference in its entirety. Further, the present disclosure can be used with a back mirror package assembly such as that described in U.S. Patent Nos. 8,814,373, 8,646,924, 8,643,931, 8,264,761, and 8,885,240, which are hereby incorporated by reference in their entirety.
[0024] Referring now to FIG. 3, a control system 100 for the mirror assembly 10 is illustrated. The control system 100 may include an electronic control unit (ECU) 102 configured to perform the functions and method steps described herein. The ECU 102 may include a processor 104 and a memory 106. The processor 104 may include any suitable processor 104. Additionally or alternatively, the ECU 102 may include any suitable number of processors in addition to or other than the processor 104. The memory 106 may include a single disk or multiple disks (e.g., a hard drive) and may include a storage management module that manages one or more partitions within the memory 106. In some embodiments, the memory 106 may include flash memory, semiconductor (solid state) memory, and the like. The memory 106 may include random access memory (RAM), read only memory (ROM), or a combination thereof. The memory 106 may include instructions that, when executed by the processor 104, cause the processor 104 to perform at least the functions and method steps described herein. Accordingly, the semi-transmissive element 12, the display module 14, the camera unit 20, the lighting element 28, the control system of the vehicle 31, the biometric scanner 38, the driver monitoring system 42, and the driver modeling system 44 may be controlled, receive inputs, and / or transmit inputs to and from the ECU 102. The ECU 102 may receive inputs of software 108, pre-stored model profile data 110 (e.g., related to height and gender classification), image data 112, driver position data 114 (e.g., driver seat position and steering wheel position), camera unit position data 116 (e.g., extrapolated or from the position detector 29), acquired model profile data 118 (e.g., acquired from the user interface 46), and extrapolated model profile data 120, and / or the memory 106 may store these.
[0025] Figure 4 shows a method 200 for modeling a driver of a vehicle. In step 202, method 200 includes generating a plurality of head shape model profiles (e.g., head size, eye position, etc.) related to at least one of gender and height. In some embodiments, the plurality of head shape model profiles related to at least one of gender and height may be pre-generated and tabulated in a memory. Step 202 may include obtaining the position of the camera unit relative to the driver, the position of the camera unit relative to the vehicle, and / or the position of the driver relative to the vehicle, and developing a coordinate system based on the vehicle (e.g., using a position detector and / or a control system). In step 204, method 200 includes requesting information related to the classification of the driver's gender and height from the driver (e.g., the obtained model profile data 118). In step 206, method 200 includes assigning a model profile to the driver if the requested information is provided by the driver (e.g., the pre-stored model profile data 110). In step 208, method 200 includes extrapolating information about the driver's head shape from the driver if the requested information is not provided by the driver (e.g., the extrapolated model profile data 120). Step 208 may include, in step 210, obtaining a reference point from the interior of the vehicle and around it, and comparing the reference point with the image data of the driver's head obtained by the camera unit. Step 208 may further include, in step 211, obtaining information about the driver's seat position. After step 208, method 200 may proceed to step 206 of assigning a model profile (e.g., the extrapolated model profile). After step 206, in step 212, method 200 may include determining the position of the eyes, head and / or face features using the image data, and comparing the determined features with the assigned model profile or the extrapolated model profile to determine the position and rotation of the head in three-dimensional space. In step 214, the method includes extrapolating the position of the driver.In operation 216, method 200 may include monitoring the driver using the assigned model profile or the extrapolated model profile. Operation 216 may include, in operation 218, generating a notification if the behavior matches a dangerous driver behavior. In operation 220, method 200 may further include assigning an airbag setting according to the driver's position and size.
[0026] The invention disclosed herein is further summarized in the following paragraphs and is further characterized by any and all combinations of the various aspects described therein.
[0027] According to one aspect of the present disclosure, a mirror assembly with a driver modeling system for a vehicle is provided. The driver modeling system includes a camera unit for imaging image data, a user interface, a processor, and a memory. When executed by the processor, the memory causes the processor to have instructions to request or extrapolate at least one physical characteristic from the image data from the driver on the user interface. In response to the input or extrapolation of the at least one physical characteristic, one of a plurality of model profiles of the driver's head is assigned based on the at least one physical characteristic.
[0028] According to another aspect of the present disclosure, the processor is further configured to obtain information about the driver's seat position and extrapolate the position of the driver's head with the driver's seat position and the image data.
[0029] According to yet another aspect of the present disclosure, the processor is further configured to obtain a reference point from inside and around the vehicle interior and extrapolate the position of the driver's head with the reference point and the image data.
[0030] According to yet another aspect of the present disclosure, the processor is further configured to obtain a reference point from inside and around the passenger compartment of the vehicle, and extrapolate the at least one physical characteristic including the size of the driver's head using the reference point and the image data.
[0031] According to another aspect of the present disclosure, the reference point includes the height and width of the headrest.
[0032] According to yet another aspect of the present disclosure, the reference point includes the width of the seat belt.
[0033] According to yet another aspect of the present disclosure, the at least one physical characteristic includes the gender or height of the driver.
[0034] According to another aspect of the present disclosure, the processor is further configured to compare the size of the driver's head with the height and width of the headrest.
[0035] According to yet another aspect of the present disclosure, the processor is further configured to determine the size of the driver's head by extrapolating three-dimensional information from the image data using a three-dimensional imaging system.
[0036] According to yet another aspect of the present disclosure, the mirror assembly is configured as a rearview mirror and includes a housing and a mounting member for connecting the housing to the vehicle.
[0037] According to another aspect of the present disclosure, the mirror assembly includes a partially reflective and partially transmissive element having a reflective state and a display state.
[0038] According to yet another aspect of the present disclosure, the mirror assembly includes a display for notifying the driver.
[0039] According to yet another aspect of the present disclosure, the processor is further configured to monitor the driver using the assigned model profile and generate a notification if there is behavior consistent with dangerous driving behavior.
[0040] According to another aspect of the present disclosure, the processor is further configured to adjust the airbag setting based on the assigned model profile.
[0041] According to another aspect of the present disclosure, a mirror assembly including a driver modeling system for a vehicle is provided. The driver modeling system includes a camera unit for imaging image data, a user interface, a processor, and a memory. When executed by the processor, the memory causes the processor to request at least one physical characteristic from the driver via the user interface, and has a command to assign one of a plurality of model profiles of the driver's head based on the at least one physical characteristic in response to the input of the at least one physical characteristic. The processor is further configured to extrapolate the size of the driver's head from the image data and assign an extrapolated model profile in response to the absence of the input of the at least one physical characteristic even after a predetermined time has elapsed.
[0042] According to another aspect of the present disclosure, the processor is further configured to obtain information about the driver's seat position and extrapolate the position of the driver's head using the driver's seat position and the image data.
[0043] According to another aspect of the present disclosure, the processor is further configured to monitor the driver using at least one of the assigned model profile and the assigned extrapolated model profile and generate a notification if there is behavior consistent with dangerous driving behavior.
[0044] According to yet another aspect of the present disclosure, the processor is further configured to adjust the airbag setting based on the assigned model profile or the assigned extrapolated model profile.
[0045] According to yet another aspect of the present disclosure, the processor is further configured to determine at least one of an eye position, a head position, and a facial feature using the image data, and determine the position and rotation of the head in a three-dimensional space by comparing the determined feature with the assigned model profile or the extrapolated model profile.
[0046] According to yet another aspect of the present disclosure, a mirror assembly including a driver modeling system for a vehicle is provided. The driver modeling system includes a camera unit for capturing image data, a user interface, a processor, and a memory. When executed by the processor, the memory causes the processor to request at least one physical characteristic from the driver via the user interface, and has an instruction to assign one of a plurality of model profiles of the driver's head based on the at least one physical characteristic in response to an input of the at least one physical characteristic. The processor is further configured to obtain a relative position between the camera unit and the vehicle, and obtain a relative position between the camera unit and the driver. The processor is further configured to perform a coordinate transformation on each relative position in response to an input of each relative position to obtain a driver position with respect to the vehicle. The processor is further configured to monitor a relative position between the driver and the vehicle using the assigned model profile, and generate a notification if there is behavior consistent with a dangerous driving behavior.
[0047] Those skilled in the art will understand that the disclosed disclosure and the construction of other components are not limited to any particular materials (except where otherwise noted). Other exemplary embodiments of the invention disclosed herein may be formed from a wide variety of materials, except where otherwise noted herein.
[0048] As used herein, the term "coupled" (in all its forms such as couple, coupling, coupled, etc.) generally means that two components (electrical or mechanical) are joined to each other, either directly or indirectly. Such a joining may be essentially stationary or essentially movable. Such a joining may be achieved with two components (electrical or mechanical), as well as additional intermediate members integrally formed with each other or with one of the two components as a single unit. Such a joining may be essentially permanent or, unless otherwise noted, essentially removable or detachable.
[0049] It is also important to note that the construction and arrangement of the elements of the present disclosure as shown in the exemplary embodiments are merely illustrative. Although only a few embodiments of the present invention are described in detail in the present disclosure, those skilled in the art who consider the present disclosure will be able to make many modifications (for example, the size, dimensions, structure, shape and ratio of various elements, parameter values, attachment methods, use of materials, color, orientation, etc.) without departing from the novel teachings and advantages of the recited subject matter. For example, elements shown to be integrally formed may be composed of multiple parts, and elements shown as multiple parts may be integrally formed. The operation of the interface may be reversed or changed in other ways, the structure of the system and / or the length or width of the members or connectors or other elements may be changed, and the nature or number of adjustment positions provided between the elements may be changed. The elements and / or assemblies of the system may be composed of any wide range of materials that provide sufficient strength or durability in any wide range of colors, textures, and combinations. As a result, all such modifications are intended to be included within the scope of the present invention. Other substitutions, modifications, changes, and omissions may be made in the design, operating conditions, and arrangement of other desired exemplary embodiments without departing from the spirit of the present invention.
[0050] It will be understood that any of the described processes or steps within the described processes may be combined with other disclosed processes or steps to form a structure within the scope of the present disclosure. The exemplary structures and processes disclosed herein are for illustrative purposes and should not be construed as limiting.
[0051] It should also be understood that variations and modifications can be made in the foregoing structures and methods without departing from the concepts of the present disclosure, and further, such concepts are to be considered as included in the following claims unless the claims specifically state otherwise in those words.
Claims
1. A mirror assembly comprising a driver modeling system for a vehicle, wherein the driver modeling system comprises a camera unit for capturing image data, a user interface, a processor, and a memory containing instructions, and when the instructions are executed by the processor, cause the processor to request at least one physical characteristic from the driver on the user interface or extrapolate it from the image data, and in response to the input or extrapolation of the at least one physical characteristic, assign one of a plurality of model profiles of the driver's head based on the at least one physical characteristic characterizing the mirror assembly.
2. The processor is further configured to acquire information about the driver's seat position, and extrapolate the position of the driver's head based on the driver's seat position and the image data as described in Claim 1. characterizing the driver modeling system according to Claim 1.
3. The processor is further configured to acquire a reference point from within and around the vehicle cabin, and extrapolate the position of the driver's head based on the reference point and the image data as described in Claim 1 or 2. characterizing the driver modeling system according to Claim 1 or 2.
4. The processor is further configured to acquire a reference point from within and around the vehicle cabin, and extrapolate the at least one physical characteristic including the size of the driver's head based on the reference point and the image data as described in Claim 1 or 2. characterizing the driver modeling system according to Claim 1 or 2.
5. The reference point includes the height and width of a headrest characterizing the driver modeling system according to Claim 4.
6. The reference point includes the width of a seat belt characterizing the driver modeling system according to Claim 4.
7. The at least one physical characteristic includes the gender or height of the driver characterizing the driver modeling system according to Claim 1.
8. The processor is further configured to compare the size of the driver's head with the height and width of a headrest as described in Claim 7. characterizing the driver modeling system according to Claim 7.
9. The processor is further configured to Determining the size of the driver's head by extrapolating three-dimensional information from the image data using a three-dimensional imaging system configured as such The driver modeling system according to claim 7 or 8, characterized by the above
10. The mirror assembly is configured as a rearview mirror and includes a housing and a mounting member for connecting the housing to the vehicle The driver modeling system according to claim 1 or 2, characterized by the above
11. The mirror assembly includes a partially reflective and partially transmissive element having a reflective state and a display state The driver modeling system according to claim 10, characterized by the above
12. The mirror assembly includes a display for notifying the driver The driver modeling system according to claim 11, characterized by the above
13. The processor further Monitors the driver using the assigned model profile and generates a notification if there is behavior consistent with dangerous driving behavior configured as such The driver modeling system according to claim 1, characterized by the above
14. The processor further Adjusts the airbag settings based on the assigned model profile configured as such The driver modeling system according to claim 1, characterized by the above
15. A mirror assembly equipped with a driver modeling system for a vehicle, wherein The driver modeling system A camera unit for imaging image data A user interface A processor A memory containing instructions has, and When the instructions are executed by the processor, the processor causes To request at least one physical characteristic from the driver via the user interface In response to the input of the at least one physical characteristic, assign one of a plurality of model profiles of the driver's head based on the at least one physical characteristic In response to the absence of input of the at least one physical characteristic even after a predetermined time has elapsed, extrapolate the size of the driver's head from the image data and assign the extrapolated model profile The mirror assembly is characterized by the above
16. The processor further Obtains information about the driver's seat position extrapolate the position of the driver's head using the driver's seat position and the image data configured to The driver modeling system according to claim 15, characterized in that.
17. The processor further monitor the driver using at least one of the assigned model profile and the assigned extrapolated model profile, and generate a notification if there is behavior consistent with dangerous driving behavior configured to The driver modeling system according to claim 15 or 16, characterized in that.
18. The processor further adjust the airbag settings based on the assigned model profile or the assigned extrapolated model profile configured to The driver modeling system according to claim 17, characterized in that.
19. The processor further use the image data to determine at least one of the position of the eyes, the position of the head, and the facial features, compare the determined features with the assigned model profile or the extrapolated model profile to determine the position and rotation of the head in three-dimensional space configured to The driver modeling system according to claim 15, characterized in that.
20. A mirror assembly comprising a driver modeling system for a vehicle, The driver modeling system a camera unit for capturing image data, a user interface, a processor, a memory containing instructions, having When the instructions are executed by the processor, the processor is caused to request at least one physical characteristic from the driver on the user interface or extrapolate it from the image data, in response to the input or extrapolation of the at least one physical characteristic, assign one of a plurality of model profiles of the driver's head based on the at least one physical characteristic, acquire the relative position between the camera unit and the vehicle, acquire the relative position between the camera unit and the driver, in response to the input of each relative position, perform coordinate transformation on each relative position to acquire the driver position relative to the vehicle Using the assigned model profile, monitor the relative position between the driver and the vehicle, and generate a notification if there is behavior consistent with dangerous driving behavior. A mirror assembly characterized by the above.
Citation Information
Patent Citations
JP1988104145U
Head-up display device
JP2003063275A
Device for detecting condition of driver
JP2003233803A
Application of Human Facial Feature Recognition to Automobile Safety and Convenience
JP2004517512A
Abnormality detection device and abnormality detection program
JP2019105872A