Mirror assembly with driver modeling system
By integrating the camera unit and processor in the mirror assembly, using image data to infer the driver's body characteristics and assigning model profiles, the problem of difficulty in accurately obtaining the driver's size and position in the prior art is solved, and higher monitoring is achieved Accuracy and security.
Patent Information
- Application Number
- CN202380048334.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-06-24
- Filing Date
- 2023-06-23
- Publication Date
- 2025-02-11
AI Technical Summary
It is difficult for the prior art to accurately obtain driver size and positioning information, which affects the accuracy and safety of the driver monitoring system.
By integrating camera units, user interfaces, processors and memory in the mirror assembly, the driver's physical characteristics are inferred using image data and assigning appropriate model profiles based on these features to monitor the relative position between the driver and the vehicle, And a notification will be generated when dangerous operation occurs.
It realizes accurate acquisition of driver size and position information, improves the accuracy and safety of the driver monitoring system, and can promptly warn of dangerous operation behaviors.
Smart Images

Figure CN119421832A_ABST
Abstract
Description
Background Art
[0001] The present disclosure relates generally to a rearview device system, and more particularly, to a mirror assembly having a driver modeling system that accurately obtains driver size and positioning information. Summary of the invention
[0002] According to one aspect of the present disclosure, a mirror assembly with a driver modeling system for a vehicle is provided. The driver modeling system includes a camera unit for capturing image data, a user interface, a processor, and a memory. The memory contains instructions that, when executed by the processor, cause the processor to request or infer at least one physical feature from the driver on the user interface. In response to receiving or inferring the at least one physical feature, one of a plurality of model profiles of the driver's head is assigned based on the at least one physical feature.
[0003] According to another aspect of the present disclosure, a mirror assembly with a driver modeling system for a vehicle is provided. The driver modeling system includes a camera unit for capturing image data, a user interface, a processor, and a memory. The memory contains instructions that, when executed by the processor, cause the processor to request at least one physical feature from the driver via the user interface, and in response to receiving the at least one physical feature, assign one of a plurality of model profiles of the driver's head based on the at least one physical feature. The processor is further configured to, in response to not receiving the at least one physical feature after a predetermined amount of time, infer the size of the driver's head from the image data and assign the inferred model profile.
[0004] According to another aspect of the present disclosure, a mirror assembly with a driver modeling system for a vehicle is provided. The driver modeling system includes a camera unit for capturing image data, a user interface, a processor and a memory. The memory contains instructions, which, when executed by the processor, cause the processor to request at least one physical feature from the driver via the user interface, and in response to receiving the at least one physical feature, assign one of a plurality of model profiles of the driver's head based on the at least one physical feature. The processor is further configured to obtain a relative position between the camera unit and the vehicle, and to obtain a relative position between the camera unit and the driver. In response to receiving the relative position, the processor is further configured to coordinate transform the relative position to obtain a driver position relative to the vehicle. The processor is further configured to monitor the relative position between the driver and the vehicle using the assigned model profile, and to generate a notification when behavior coincides with dangerous operating behavior.
[0005] These and other features, advantages and objects of the present disclosure will be further understood and appreciated by those skilled in the art with reference to the following description, claims and drawings. BRIEF DESCRIPTION OF THE DRAWINGS
[0006] Figure 1 is a perspective view of a cabin interior in a vehicle having a mirror assembly according to the present disclosure;
[0007] Figure 2 is a front perspective view of a mirror assembly with a driver modeling system according to the present disclosure;
[0008] Figure 3 is a schematic diagram of a control system for a mirror assembly according to the present disclosure; and
[0009] Figure 4 A method of modeling a driver for a driver monitoring system according to the present disclosure. DETAILED DESCRIPTION
[0010] The embodiment shown in the present invention mainly lies in the combination of the method steps and equipment parts related to the mirror assembly and the driver modeling system that accurately obtains the driver size and positioning information. Therefore, the equipment parts and method steps have been represented by the conventional symbols in the figures in appropriate places, and only those specific details related to understanding the embodiments of the present disclosure are shown to avoid confusing the present disclosure, and the present disclosure has the details that will be obvious to those skilled in the art and have the benefits of the description herein. In addition, the same numbers in the description and the figures represent the same elements.
[0011] For the purposes of the description herein, the terms "upper", "lower", "right", "left", "rear", "front", "vertical", "horizontal" and their derivatives shall be used in the same manner as described herein. Figure 1 Unless otherwise specified, the term "front" shall refer to the surface of the element closer to the intended observer of the display mirror, and the term "rear" shall refer to the surface of the element farther from the intended observer of the display mirror. However, it should be understood that the present disclosure may adopt various alternative orientations, except where expressly specified to the contrary. It should also be understood that the specific devices and processes shown in the drawings and described in the following description are merely exemplary embodiments of the inventive concepts defined in the appended claims. Therefore, unless the claims expressly state otherwise, specific dimensions and other physical characteristics related to the embodiments disclosed herein should not be considered limiting.
[0012] The terms "including," "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion such that a process, method, article, or apparatus that includes a list of elements includes not only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. An element with "comprising..." does not, without more limitations, exclude the presence of additional identical elements in the process, method, article, or apparatus that includes the element.
[0013] First reference Figure 1-2 , reference numeral 10 generally designates a mirror assembly of a vehicle. In some embodiments, the mirror assembly 10 is a full display mirror including a reflective state and a display state. In the reflective state, the mirror assembly 10 acts as a mirror, reflecting various wavelengths of light back toward an intended observer. In the display state, the mirror assembly 10 relays image data information (e.g., an image, a message, or a recommendation) based on one or more images captured from one or more image capture components. According to some embodiments, to achieve this functionality, the mirror assembly 10 includes a partially reflective, partially transmissive element 12 (also referred to herein as a "glass element") and a display module 14 ( Figure 2 ). The partially reflective, partially transmissive element 12 may be electro-optical, such as electrochromic, and change state when an applied voltage is introduced. As will be described in more detail below, the mirror assembly 10 includes a driver monitoring function. The driver monitoring function monitors the driver (e.g., the vehicle operator) and obtains data to determine the driver's behavior patterns. For example, in the case where the driver is looking, blink rate, head movement or tilt, etc. that may indicate fatigue. Based on these behaviors, the mirror assembly 10 generates a notification if the driver exhibits behaviors that coincide with dangerous operator behavior (e.g., distraction or drowsiness).
[0014] Mirror assembly 10A further includes a housing 16 that shields and supports partially reflective, partially transmissive element 12 and display module 14. Housing 16 is attached to an associated vehicle via mounting member 18. Housing 16 is movable relative to mounting member 18 to orient partially transmissive element 12 at various angles relative to a vehicle operator to obtain different views and / or orientations of the environment relative to the vehicle operator.
[0015] Now special reference Figure 1, the mirror assembly 10 further includes a camera unit 20 for capturing image data. As will be appreciated, in some embodiments, the camera unit 20 may be stationary relative to the movement of the partially transmissive element 12, the display module 14, and / or the housing 16. In other embodiments, the camera unit 20 moves in conjunction with the movement of the partially transmissive element 12, the display module 14, and / or the housing 16. More specifically, the camera unit 20 may be directly coupled within the housing 16 to move when the housing 16 is adjusted, or the camera unit 20 may be connected to a portion of the vehicle that is at least partially outside of the housing 16 so that the camera orientation remains unchanged during adjustment of the housing 16. The display module 14 may be sized to substantially span the entire viewing area 15 ( Figure 1 ) or at one or more discrete locations within the observation area 15 ( Figure 2 )extend.
[0016] Continue to refer Figure 1 , the mirror assembly 10 is shown inside a vehicle compartment 22. The camera unit 20 may be located on or inside the mirror assembly 10, or in other parts of the compartment 22. For example, the camera unit 20 may be located on or around the dashboard 24, the steering wheel 26, or the mounting member 18. The steering wheel 26 may include an airbag 27 having a plurality of settings related to the direction or magnitude of deployment. It should also be understood that the camera unit 20 may include a plurality of camera units 20 located in any of the above-mentioned positions. The camera unit 20 may be a component of a 2D imaging system, which further includes at least one lighting element 28 (e.g., a plurality of one, two, three, four or more lighting elements 28). In some embodiments, the at least one lighting element 28 may include one or more infrared emitters (or near infrared emitters) for transmitting infrared wavelengths of light. In some embodiments, the camera unit 20 and the at least one lighting element 28 may utilize the same control system (e.g., PCB, ECU and / or processor) as the other components of the mirror assembly 10. In other embodiments, the camera unit 20 and at least one lighting element 28 may utilize a different control system than the other components of the mirror assembly 10 and communicate therewith in a wired or wireless manner. The camera unit 20 may include various image capture technologies, such as night mode, image enhancement, thermal recognition, recording capabilities, wide angle lenses, and other types of technologies to, for example, capture images in the infrared spectrum.
[0017] The driver's seat 30 is located in the vehicle cabin 22, directly behind the steering wheel 26, and is adjustable in both linear and angular directions. More specifically, the driver's seat 30 is substantially linearly adjustable in the vertical direction (along the axis Y) and the fore-aft direction (along the axis Z). The driver's seat 30 includes a seat cushion 32, a backrest 34, and a headrest 36 ( Figure 2). The backrest 34 and the headrest 36 can pivot in the front-to-rear direction relative to the seat cushion 32 to change the angle at which the driver leans. The position of the driver's seat 30 can be saved in the vehicle's control system ("VCS") 31 or otherwise available. In some embodiments, the biometric scanner 38 can be located in the vehicle compartment 22 or outside the vehicle (not shown). For example, the biometric scanner 38 may include one or more of an iris imager or scanner, a fingerprint scanner, a facial imager or scanner, a voice scanner / recorder, or a variety of other scanning devices. The biometric scanner 38 obtains scan data that can be saved in a biometric data storage 40 (e.g., a local storage or a remote cloud server accessible via a wireless communication interface). Therefore, the local storage or remote server can be accessed to search for scan data or biometric data and match it with an identification profile to identify the driver and, for example, automatically adjust the orientation of the driver's seat 30 and the housing 16.
[0018] Reference now Figure 2 and 3 , mirror assembly 10 includes driver monitoring system 42, and described driver monitoring system provides one or more of driver monitoring functions as discussed above.Driver monitoring system 42 includes driver modeling system 44.Driver modeling system 44 can determine the size, shape and position of driver in conjunction with one or more of camera unit 20, control system 31 (for example, seat position) of vehicle, biometric scanner 38 and biometric data storage 40, to more accurately identify when driver shows the demeanor that overlaps with dangerous operator behavior.Thus, rather than relying on a single driver model to determine driver demeanor, driver modeling system 44 can include multiple model profiles.The different sizes, shapes and positions of driver may make it difficult to utilize driver monitoring system 42 to accurately determine demeanor.For example, inaccuracy may occur when using a universal head shape for each driver, because the predetermined variation of head shape (for example, size, eye position, etc.) will not be scaled for a specific driver. Selecting a model profile that more accurately represents the physical features of the driver's head may be useful for improving the accuracy of a driver monitoring system ("DMS"), including the accuracy with which the location of the driver's physical features (e.g., eyes) can be determined in 3D space. This in turn may improve the accuracy with which the DMS may determine whether behavior coincides with dangerous operator behavior, such as by improving the accuracy with which the system may determine whether the driver's gaze is directed to an area relevant to the driving task. By improving accuracy, the driver monitoring system 42 provides improved performance and regulatory compliance.
[0019] When determining the behavior of the driver, the relative position between the driver and the camera unit 20 can also play an important role, wherein the tall driver directs the gaze (e.g., gaze) at a different position than the short driver. Similarly, the size and position of the driver may be different based only on the positioning of the camera unit 20. For example, when the camera unit 20 is configured to move with the housing 16, the movement of the housing 16 (e.g., cross-car adjustment, tilt and / or the like) will affect the orientation, and thus affect the image data captured by the camera unit 20. In some embodiments, the mirror assembly 10 (e.g., the housing 16) includes a position detector 29 and / or includes a control system 100, which can infer the position of the mirror assembly 10 based on the image data. More specifically, the camera unit 20 can be a component of a 3D imaging system that replaces or supplements 2D imaging. The 3D imaging system can operate according to the principles of structured light, stereoscopic vision, light detection and ranging ("LIDAR"), RADAR or any other 3D imaging system / sensor. In this way, the control system 100 can be configured to infer 3D information from the image data captured by the camera unit 20.
[0020] Continue to refer Figure 2 and 3, the driver modeling system 44 may be configured to obtain information from the driver based on several factors. For example, the driver modeling system 44 may obtain the position of the driver's seat 30, wherein the position of the driver's seat 30 relative to the vertical direction and the front-to-back direction may be associated with the height of the driver. The height of the driver may be associated with the average head shape (e.g., size, eye position, etc.) of a specific height (e.g., in 1 inch increments, 2 inch increments or less, 4 inch increments or less, or 6 inch increments or less). The driver modeling system 44 may be further configured to obtain reference points from within and around the vehicle compartment 22 to better determine the head size, shape, and position (e.g., via a vehicle-based coordinate system). For example, the camera unit 20 may be configured to compare the head size with the width "W" and height "H" of the headrest 36. The W and H of the headrest 36 may be initially saved, or may be determined by inferring the image data captured by the camera unit 20 for the position of the driver's seat 30. In some embodiments, the camera unit 20 may be configured to compare the head size with the width of the seat belt (not shown). The width of the safety belt can be initially saved, or can be determined by inferring the image data captured by the camera unit 20 for the position of the driver's seat 30. The position of the driver's head can also be determined via the image data captured by the camera unit 20 and the position of the driver's seat 30. For example, the vertical head position can be determined by comparing and inferring the relative positioning between the position of the driver's seat 30 and the head and the headrest 36 and / or the backrest 34. The shape of the head can also be determined by the image data captured by the camera unit 20 and the relative size of the position of the driver's seat 30. For example, after determining the head shape (for example, size, eye position, etc.), the vertical and horizontal positioning of the driver's eyes can be determined similarly by analyzing the physical features of the driver's head (for example, the periphery 35 of the driver's head, the chin line, the nose, the ear and / or other facial / head features in the image data captured by the camera unit 20). The physical features of the driver's head can be used to help determine the driver's gaze. In certain embodiments, the eye position is independently determined by the driver monitoring system 42 together with other heads and / or facial features, and the driver monitoring system processes the image coordinates, and then compares the image coordinates with the head model to derive the position and rotation of the actual head in 3D space.
[0021] Further references Figure 2 and 3, the driver modeling system 44 can obtain the position of the driver in the vehicle via detection (e.g., using the position detector 29) and / or inference (e.g., the control system 100). More specifically, the driver modeling system 44 can initially determine the relative position of the camera unit 20 in the vehicle (e.g., via a reference point or position detector 29) and the relative position of the camera relative to the driver (e.g., via a reference point or position detector 29). Once these two relative positions are determined, the control system 100 can determine the position of the driver relative to the vehicle via a coordinate transformation. For example, image data related to the width W and / or height H of the headrest 36 may change with the adjustment of the camera unit 20. By inferring the geometric relationship between the camera unit 20 and the reference point or via the position detector 29, a more accurate representation of the driver's head positioning and size can be obtained. The adjustment process may not be used to directly manipulate the image data, but to transform the DMS output (e.g., via a coordinate transformation).
[0022] In some embodiments, the driver modeling system 44 may request information from the driver, such as at least one physical feature, such as height classification, gender classification, head size and / or the like. This information may be directly input from the driver, for example, via a user interface 46 on the housing 16, the viewing area 15, a mobile device, or other places in the car 22. The user interface 46 may be configured to receive physical input (e.g., button presses) or verbal input (e.g., from a microphone). For example, the driver modeling system 44 may include: a general height model profile, which includes the average head shape (e.g., size, eye position, etc.) of both sexes when the height sequence changes (e.g., every 1-6 inches or less); a male height model profile, which includes the average head shape of males when the height sequence changes (e.g., every 1-6 inches or less); and a female height model profile, which includes the average head shape of females when the height sequence changes (e.g., every 1-6 inches or less). The driver modeling system 44 may include a model profile based on gender rather than height (e.g., a general female model profile and a general male model profile). Thus, if the driver provides height, gender or both, the driver modeling system 44 can be configured to utilize as many factors as possible (e.g., gender, height, driver seat 30 position, relative size design about driver seat 30, steering wheel positioning, etc.) to select the model profile that most accurately de-generalizes the driver's head size. In some embodiments, the driver can be prompted via the user interface 46 to orient his head relative to the camera unit 20 in multiple positions (e.g., front and side profiles) so that the 3D head shape can be inferred (e.g., using a 3D imaging system). In some embodiments, the driver can be prompted via the user interface 46 to provide other types of physical features, such as head size (e.g., width, length, head circumference), distance between eyes and / or the like. Each or selection in the physical features described above can be used to select or develop accurate model profiles and head positions, which improves the accuracy of DMS system readings and outputs.
[0023] The present disclosure may be used with a biometric scanner 38 and an authentication system such as described in U.S. Pat. No. 10,616,218, which is incorporated herein by reference in its entirety. In addition, the present disclosure may be used with a rear-view package assembly such as described in U.S. Pat. Nos. 8,814,373, 8,646,924, 8,643,931, 8,264,761, and 8,885,240, which are incorporated herein by reference in their entirety.
[0024] Reference Figure 3, showing a control system 100 of a mirror assembly 10. The control system 100 may include an electronic control unit (ECU) 102 configured to perform the functions and method steps described herein. The ECU 102 may include a processor 104 and a memory 106. The processor 104 may include any suitable processor 104. Additionally or alternatively, the ECU 102 may include any suitable number of processors in addition to (or in addition to) the processor 104. The memory 106 may include a single disk or multiple disks (e.g., a hard disk drive) and include a storage management module that manages one or more partitions within the memory 106. In some embodiments, the memory 106 may include a flash memory, a semiconductor (solid-state) memory, etc. The memory 106 may include a random access memory (RAM), a read-only memory (ROM), or a combination thereof. The memory 106 may include instructions that, when executed by the processor 104, cause the processor 104 to perform at least the functions and method steps described herein. Thus, the partially transmissive element 12 and display module 14, camera unit 20, lighting element 28, control system 31 of the vehicle, biometric scanner 38, driver monitoring system 42 and driver modeling system 44 may be controlled, receive input and / or transmit input to and from ECU 102. ECU 102 may receive and / or memory 106 may store software 108, pre-stored model profile data 110 (e.g., relating to height and gender classification), image data 112, driver position data 114 (e.g., driver seat position and steering wheel position), camera unit position data 116 (e.g., inferred or utilizing position detector 29), model profile data 118 obtained (e.g., from user interface 46), and inferred model profile data 120.
[0025] Figure 4A method 200 for modeling a driver of a vehicle is shown. At 202, the method 200 includes generating a plurality of head shape model profiles (e.g., head size, eye position, etc.) associated with at least one of gender and height. In some embodiments, a plurality of head shape model profiles associated with at least one of gender and height may be pre-generated and tabulated in a memory. Step 202 may include obtaining the position of a camera unit relative to a driver, a camera unit relative to a vehicle, and / or a driver relative to a vehicle to develop a vehicle-based coordinate system (e.g., using a position detector and / or a control system). At 204, the method 200 includes requesting information (e.g., the model profile data 118 obtained) associated with the driver's gender and height classification. At 206, if the driver provides the requested information, the method 200 includes assigning a model profile (e.g., the model profile data 110 saved in advance) to the driver. At 208, if the driver does not provide the requested information, the method 200 includes inferring information (e.g., the inferred model profile data 120) about the driver's head shape from the driver. Step 208 may include obtaining reference points from within and around the vehicle compartment at 210, and comparing the reference points with image data obtained by the camera unit of the driver's head. Step 208 may also include obtaining information about the driver's seat position at 211. After step 208, method 200 may continue to step 206, wherein a model profile (e.g., an inferred model profile) is assigned. From step 206, at 212, method 200 may include determining eye position, head and / or facial features using image data, and comparing the determined features with the assigned model profile or the inferred model profile to determine the position and rotation of the head in 3D space. At 214, the method includes inferring the position of the driver. At 216, method 200 may include monitoring the driver using the assigned model profile or the inferred model profile. Step 216 may include generating a notification when the behavior coincides with dangerous operator behavior at 218. At 220, method 200 may also include assigning airbag settings according to the driver's position and size.
[0026] The invention disclosed herein is further summarized in the following paragraphs and is further characterized as any and all combinations of the various aspects described therein.
[0027] According to one aspect of the present disclosure, a mirror assembly with a driver modeling system for a vehicle is provided. The driver modeling system includes a camera unit for capturing image data, a user interface, a processor, and a memory. The memory contains instructions that, when executed by the processor, cause the processor to request or infer at least one physical feature from the driver on the user interface. In response to receiving or inferring the at least one physical feature, one of a plurality of model profiles of the driver's head is assigned based on the at least one physical feature.
[0028] According to another aspect of the present disclosure, the processor is further configured to obtain information about a position of a driver's seat, and infer a position of the driver's head using the position of the driver's seat and the image data.
[0029] According to yet another aspect of the present disclosure, the processor is further configured to obtain reference points from within and around a cabin of the vehicle and to infer the position of the driver's head using the reference points and the image data.
[0030] According to yet another aspect of the present disclosure, the processor is further configured to obtain reference points from within and around a cabin of the vehicle and utilize the reference points and the image data to infer at least one body feature including the size of the driver's head.
[0031] According to another aspect of the present disclosure, the reference point includes a height and a width of the headrest.
[0032] According to yet another aspect of the present disclosure, the reference point includes a width of the seat belt.
[0033] According to yet another aspect of the present disclosure, the at least one physical characteristic includes gender or height of the driver.
[0034] According to another aspect of the present disclosure, the processor is further configured to compare the size of the driver's head with the height and width of the headrest.
[0035] According to yet another aspect of the present disclosure, the processor is further configured to determine the size of the driver's head by inferring 3D information from the image data using a 3D imaging system.
[0036] According to yet another aspect of the present disclosure, a mirror assembly is configured as a rearview mirror and includes a housing and a mounting member connecting the housing to a vehicle.
[0037] According to another aspect of the present disclosure, a mirror assembly includes a partially reflective, partially transmissive element including a reflective state and a display state.
[0038] According to yet another aspect of the present disclosure, a mirror assembly includes a display for communicating with a driver.
[0039] According to yet another aspect of the present disclosure, the processor is further configured to monitor the driver using the assigned model profile and generate a notification when behavior coincides with a dangerous operating behavior.
[0040] According to another aspect of the present disclosure, the processor is further configured to adjust airbag settings based on the assigned model profile.
[0041] According to another aspect of the present disclosure, a mirror assembly with a driver modeling system for a vehicle is provided. The driver modeling system includes a camera unit for capturing image data, a user interface, a processor, and a memory. The memory contains instructions that, when executed by the processor, cause the processor to request at least one physical feature from the driver via the user interface, and in response to receiving the at least one physical feature, assign one of a plurality of model profiles of the driver's head based on the at least one physical feature. The processor is further configured to, in response to not receiving the at least one physical feature after a predetermined amount of time, infer the size of the driver's head from the image data and assign the inferred model profile.
[0042] According to another aspect of the present disclosure, the processor is further configured to obtain information about a position of a driver's seat, and infer a position of the driver's head using the position of the driver's seat and the image data.
[0043] According to another aspect of the present disclosure, the processor is further configured to monitor the driver using at least one of the assigned model profile and the assigned inferred model profile and generate a notification when the behavior coincides with a dangerous operating behavior.
[0044] According to yet another aspect of the present disclosure, the processor is further configured to adjust the airbag setting based on the assigned model profile or the assigned inferred model profile.
[0045] According to another aspect of the present disclosure, the processor is further configured to determine at least one of eye position, head position, and facial features using the image data, and compare the determined features with the assigned model profile or the inferred model profile to determine the position and rotation of the head in 3D space.
[0046] According to another aspect of the present disclosure, a mirror assembly with a driver modeling system for a vehicle is provided. The driver modeling system includes a camera unit for capturing image data, a user interface, a processor and a memory. The memory contains instructions, which, when executed by the processor, cause the processor to request at least one physical feature from the driver via the user interface, and in response to receiving the at least one physical feature, assign one of a plurality of model profiles of the driver's head based on the at least one physical feature. The processor is further configured to obtain a relative position between the camera unit and the vehicle, and to obtain a relative position between the camera unit and the driver. In response to receiving the relative position, the processor is further configured to coordinate transform the relative position to obtain a driver position relative to the vehicle. The processor is further configured to monitor the relative position between the driver and the vehicle using the assigned model profile, and to generate a notification when behavior coincides with dangerous operating behavior.
[0047] One of ordinary skill in the art will appreciate that the disclosed and other component constructions (unless otherwise noted) are not limited to any particular material. Unless otherwise described herein, other exemplary embodiments of the disclosed disclosed herein may be formed from a variety of materials.
[0048] For purposes of this disclosure, the term "coupled" (in all its forms, coupling, coupled, etc.) generally means the joining of two (electrical or mechanical) components to one another, directly or indirectly. Such joining may be stationary in nature or movable in nature. Such joining may be achieved using the two (electrical or mechanical) components and any additional intermediate members that are integrally formed as a single unitary body with one another or with the two components. Unless otherwise specified, such joining may be permanent in nature or removable or releasable in nature.
[0049] It is also worth noting that the construction and arrangement of the elements of the present disclosure shown in the exemplary embodiment are only illustrative. Although only a few embodiments of this innovation are described in detail in the present disclosure, it should be easily understood by those skilled in the art who review the present disclosure that many modifications are possible (for example, the size, size, structure, shape and ratio, parameter value, installation arrangement, use of materials, color, orientation, etc. of various elements) without substantially departing from the novel teachings and advantages of the stated subject. For example, the element shown as being integrally formed can be constructed of multiple parts, or the element shown as multiple parts can be integrally formed, the operation of the interface can be reversed or otherwise changed, the length or width of the structure and / or the member or connector or other element of the system can be changed, and the nature or number of the adjustment position between the elements can be changed. It should be noted that the elements and / or components of the system can be composed of any of a wide variety of materials that provide sufficient strength or durability, and can be in any of a wide variety of colors, textures and combinations. Therefore, all such modifications are intended to be included in the scope of this innovation. Other substitutions, modifications, changes and omissions can be made in the design, operating conditions and arrangement of required and other exemplary embodiments without departing from the spirit of this innovation.
[0050] It should be understood that any described process or steps within a described process can be combined with other disclosed processes or steps to form structures within the scope of the present disclosure. The exemplary structures and processes disclosed herein are for illustrative purposes and should not be construed as limiting.
[0051] It will be further understood that changes and modifications may be made to the structures and methods described above without departing from the concepts of the present disclosure and it will be further understood that such concepts are intended to be covered by the appended claims unless the language of such claims expressly states otherwise.
Claims
1. A mirror assembly for a vehicle having a driver modeling system, the driver modeling system comprising: a camera unit for capturing image data; User interface; processor; as well as a memory comprising instructions that, when executed by the processor, cause the processor to: requesting at least one physical characteristic from the driver on the user interface or inferring from the image data; as well as In response to receiving or inferring the at least one physical characteristic, a model profile of a plurality of model profiles of the driver's head is assigned based on the at least one physical characteristic.
2. The driver modeling system of claim 1 , wherein the processor is further configured to: obtaining information about the position of the driver's seat; and The position of the driver's head is inferred using the driver's seat position and the image data.
3. The driver modeling system of claim 1 or claim 2, wherein the processor is further configured to: Obtaining reference points from within and around a cabin of the vehicle; and The position of the driver's head is inferred using the reference points and the image data.
4. The driver modeling system of claim 1 or claim 2, wherein the processor is further configured to: Obtaining reference points from within and around a cabin of the vehicle; and The at least one physical feature including the size of the driver's head is inferred using the reference points and the image data. The driver modeling system of claim 4 , wherein the reference points include a height and a width of a headrest. The driver modeling system of claim 4 , wherein the reference point comprises a width of a seat belt. 7 . The driver modeling system of claim 1 , wherein the at least one physical characteristic comprises a gender or a height of the driver.
8. The driver modeling system of claim 7, wherein the processor is further configured to: The dimensions of the driver's head are compared to the height and width of a headrest.
9. A driver modeling system according to claim 7 or claim 8, wherein the processor is further configured to: The dimensions of the driver's head are determined by inferring 3D information from the image data using a 3D imaging system.
10. The driver modeling system of claim 1 or claim 2, wherein the mirror assembly is configured as a rearview mirror and comprises a housing and a mounting member connecting the housing to the vehicle.
11. The driver modeling system of claim 10, wherein the mirror assembly comprises a partially reflective, partially transmissive element, the partially reflective, partially transmissive element comprising a reflective state and a display state.
12. The driver modeling system of claim 11, wherein the mirror assembly includes a display for communicating with the driver.
13. The driver modeling system of claim 1 , wherein the processor is further configured to: The driver is monitored using the assigned model profile and a notification is generated when behavior coincides with hazardous operating behavior.
14. The driver modeling system of claim 1 , wherein the processor is further configured to: Airbag settings are adjusted based on the assigned model profile.
15. A mirror assembly for a vehicle having a driver modeling system, the driver modeling system comprising: a camera unit for capturing image data; User interface; processor; as well as a memory comprising instructions that, when executed by the processor, cause the processor to: requesting at least one physical characteristic from a driver via the user interface; In response to receiving the at least one physical characteristic, assigning a model profile from a plurality of model profiles of the driver's head based on the at least one physical characteristic; as well as In response to not receiving the at least one physical characteristic after a predetermined amount of time, a size of the driver's head is inferred from the image data and an inferred model profile is assigned.
16. The driver modeling system of claim 15, wherein the processor is further configured to: obtaining information about the position of the driver's seat; and The position of the driver's head is inferred using the driver's seat position and the image data.
17. A driver modeling system according to claim 15 or claim 16, wherein the processor is further configured to: The driver is monitored using at least one of an assigned model profile and an assigned inferred model profile, and a notification is generated when behavior coincides with a risky operating behavior.
18. The driver modeling system of claim 17, wherein the processor is further configured to: Airbag settings are adjusted based on the assigned model profile or the assigned inferred model profile.
19. The driver modeling system of claim 15, wherein the processor is further configured to determine at least one of eye position, head position, and facial features using the image data, and compare the determined features with an assigned model profile or an inferred model profile to determine a position and rotation of the head in 3D space.
20. A mirror assembly for a vehicle having a driver modeling system, the driver modeling system comprising: a camera unit for capturing image data; User interface; processor; as well as a memory comprising instructions that, when executed by the processor, cause the processor to: requesting at least one physical characteristic from the driver on the user interface or inferring from the image data; In response to receiving or inferring the at least one physical characteristic, assigning a model profile from a plurality of model profiles of the driver's head based on the at least one physical characteristic; obtaining a relative position between the camera unit and the vehicle; obtaining a relative position between the camera unit and the driver; In response to receiving the relative position, coordinate transforming the relative position to obtain a driver position relative to the vehicle; as well as The relative position between the driver and the vehicle is monitored using an assigned model profile and a notification is generated when behavior coincides with hazardous operating behavior.
Citation Information
Patent Citations
Driver identification and authentication systems and methods
US10616218B2
Vehicle rearview mirror with spotter mirror
US8264761B2
Vehicle rearview mirror with spotter mirror
US8643931B2
Rearview device mounting assembly with rotatable support
US8646924B2
Rearview device support assembly
US8814373B2