Driver and passenger aware content projection

Abstract

The invention relates to driver and passenger perceived content projection. A vehicle system of a vehicle includes a view tracking system configured to monitor a driver view direction of a driver of the vehicle and generate driver view direction information indicative of the driver view direction of the driver of the vehicle; and an image projection system configured to receive driver viewing direction information and project an image into a driver viewing direction of a driver of the vehicle based on the driver viewing direction information. An image projection direction in which an image of the image projection system is projected changes based on a change in a driver viewing direction of a driver of the vehicle.

Description

Background Art

[0001] Vehicle safety is designed to protect individuals and other objects inside and outside the vehicle. Some rules focus on ensuring that the driver and passengers are always aware of their surroundings and are alerted when certain unsafe conditions occur. For example, some rules are designed to monitor driver awareness, including driver drowsiness. Other rules are designed to monitor objects located outside the vehicle. Unsafe conditions may exist based on certain factors that may occur inside and / or outside the vehicle. The driver should be alerted to unsafe conditions. Summary of the invention

[0002] In some implementations, a vehicle system of a vehicle includes: a viewing tracking system configured to monitor a driver viewing direction of a vehicle driver and generate driver viewing direction information indicating the driver viewing direction of the vehicle driver; and an image projection system configured to receive the driver viewing direction information and project an image into the driver viewing direction of the vehicle driver based on the driver viewing direction information, wherein an image projection direction in which an image of the image projection system is projected changes based on a change in the driver viewing direction of the vehicle driver.

[0003] In some implementations, a method for displaying information during operation of a vehicle includes: monitoring a driver viewing direction of a vehicle driver; generating driver viewing direction information indicating a driver viewing direction of the vehicle driver; and projecting an image into a driver viewing direction of the vehicle driver based on the driver viewing direction information, wherein an image projection direction in which the image is projected changes based on a change in the driver viewing direction of the vehicle driver. BRIEF DESCRIPTION OF THE DRAWINGS

[0004] Implementations are described herein with reference to the accompanying drawings.

[0005] Figure 1 is a schematic block diagram of a vehicle system according to one or more implementations.

[0006] Figure 2 is a diagram of a vehicle according to one or more implementations. DETAILED DESCRIPTION

[0007] In the following, the details are set forth to provide a more comprehensive explanation of the example implementations. However, it will be clear to those skilled in the art that these implementations can be practiced without these specific details. In other cases, well-known structures and devices are shown in block diagram form or schematic form rather than in detail to avoid confusing the implementations. In addition, unless otherwise specifically stated, the features of the different implementations described below can be combined with each other.

[0008] In addition, equivalent or similar elements or elements having equivalent or similar functions are indicated by equivalent or similar reference numerals in the following description. Since identical or functionally equivalent elements are given the same reference numerals in the drawings, repeated descriptions of elements having the same reference numerals may be omitted. Therefore, the descriptions provided for elements having the same or similar reference numerals are mutually interchangeable.

[0009] Each of the x-axis, y-axis, and z-axis is shown to be substantially perpendicular to the other two axes. In other words, the x-axis is substantially perpendicular to the y-axis and the z-axis, the y-axis is substantially perpendicular to the x-axis and the z-axis, and the z-axis is substantially perpendicular to the x-axis and the y-axis. In some cases, a single reference numeral is shown to refer to a surface, or less than all instances of a part may be labeled using all surfaces of the part. All instances of a part may include relevant surfaces of the part, although not every surface is labeled.

[0010] The orientation of various elements in the figure is shown as an example, and the example shown can be rotated relative to the orientation shown. The description provided herein and the subsequent claims relate to any structure having the described relationship between various features, regardless of whether these structures are in a specific orientation of the accompanying drawings, or rotated relative to this orientation. Similarly, for ease of description, spatial relative terms (such as "top", "bottom", "below", "below", "lower", "above", "upper", "middle", "left side" and "right side") are used herein to describe the relationship between an element shown in the figure and one or more other elements. Spatial relative terms are intended to cover different orientations of elements, structures and / or components in use or operation except for the orientation shown in the figure. Structures and / or components can be oriented in other ways (rotated 90 degrees or in other orientations), and the spatial relative descriptors used in this article can be interpreted accordingly. In addition, in order to simplify the accompanying drawings, unless otherwise stated, the cross-sectional views in the figures only show the features in the cross-sectional plane, without showing the material behind the cross-sectional plane.

[0011] It is understood that when an element is referred to as being "connected" or "coupled" to another element, it may be directly connected or coupled to the other element, or there may be intervening elements. Conversely, when an element is referred to as being "directly connected" or "directly coupled" to another element, there are no intervening elements. Other words used to describe the relationship between elements should be interpreted in a similar manner (e.g., "between" versus "directly between," "adjacent" versus "directly adjacent," etc.).

[0012] In the implementations described herein or shown in the drawings, any direct electrical connection or coupling (e.g., any connection or coupling without additional intermediate elements) may also be implemented through an indirect connection or coupling (e.g., a connection or coupling with one or more additional intermediate elements, and vice versa), as long as the general purpose of the connection or coupling (e.g., transmitting a certain signal or transmitting certain information) is substantially maintained. Features from different implementations may be combined to form additional implementations. For example, changes or modifications described with respect to one implementation may also apply to other implementations, unless otherwise stated.

[0013] As used herein, the terms "substantially" and "approximately" mean "within reasonable manufacturing and measurement tolerances." For example, the term "substantially" and the term "approximately" may be used to illustrate smaller manufacturing tolerances or other factors (e.g., within 5%) that are considered acceptable in the industry without departing from the implementations described herein. For example, a resistor having an approximate resistance value may actually have a resistance within 5% of the approximate resistance value. As another example, a signal having an approximate signal value may actually have a signal value within 5% of the approximate signal value.

[0014] In the present disclosure, expressions including ordinal numbers such as "first", "second", etc. can modify various elements. However, such elements are not limited by such expressions. For example, such expressions do not limit the order and / or importance of elements. On the contrary, such expressions are only used for the purpose of distinguishing one element from other elements. For example, a first box and a second box represent different boxes, although both are boxes. For example, without departing from the scope of the present disclosure, a first element may be referred to as a second element, and similarly, a second element may also be referred to as a first element.

[0015] Upcoming rules may require monitoring of the perception and / or alertness of the driver of a vehicle. For example, the driver may be monitored for drowsiness. A drowsy driver is a potential safety hazard that may lead to an accident. Additionally, unsafe conditions may occur outside the vehicle (e.g., in the environment external to the vehicle). For example, a person, animal, or other object may be moving close to or within the vehicle's intended driving path. Alternatively, the vehicle may be moving too close to an object in the environment. Effective methods of improving driver perception and / or alerting the driver to unsafe conditions may improve vehicle safety and reduce the number of accidents.

[0016] Some implementations disclosed herein relate to a vehicle system of a vehicle, comprising a viewing tracking system and an image projection system. The viewing tracking system may be configured to monitor a driver viewing direction of a vehicle driver and generate driver viewing direction information indicating a driver viewing direction of the vehicle driver. The image projection system may be configured to receive the driver viewing direction information and project an image into a driver viewing direction of the vehicle driver based on the driver viewing direction information. The image projection direction in which an image of the image projection system is projected may change based on a change in the driver viewing direction of the vehicle driver.

[0017] The vehicle system may include one or more cameras for monitoring the vehicle driver to detect the driver's viewing direction and / or monitoring the vehicle passenger to detect the passenger's viewing direction. For example, the camera may be configured to track at least one of the vehicle driver's head position (e.g., head movement) or the vehicle driver's eye position (e.g., eye tracking) to generate the driver's viewing direction information. Additionally or alternatively, the camera may be configured to track at least one of the vehicle passenger's head position or the vehicle passenger's eye position to generate the passenger's viewing direction information.

[0018] The image projection system may include a head-up display (HUD) configured to project an image onto an image display area of ​​a windshield or side window of the vehicle based on the driver's viewing direction information. Additionally or alternatively, the image projection system may include a headlight including a pixel-based bulb capable of projecting black / white content such as a black / white image or video onto an image display area of ​​the environment based on the driver's viewing direction information. The image display area may be a road surface in front of the vehicle, or may be a detected object in the environment.

[0019] Additionally or alternatively, the vehicle system may include an audio system including a plurality of speakers including at least one first speaker located on the driver's side of the vehicle and at least one second speaker located on the passenger side of the vehicle. The audio system may be configured to output an alarm sound in response to a safety hazard being detected.

[0020] Additionally or alternatively, the viewing tracking system may be configured to monitor the passenger viewing direction of the vehicle passenger and generate passenger viewing direction information indicating the passenger viewing direction of the vehicle passenger. In this case, the image projection system may be configured to receive the passenger viewing direction information and project additional images into the passenger viewing direction of the vehicle passenger based on the passenger viewing direction information. The passenger image projection direction of the image projection system in which the additional image is projected may change based on changes in the passenger viewing direction of the vehicle passenger. The image projection system may include a HUD for the vehicle passenger, which is configured to project additional images onto an image display area of ​​a windshield or side window of the vehicle based on the passenger viewing direction. The vehicle passenger may then alert the vehicle driver to the safety hazard indicated by the additional image.

[0021] Therefore, a system-level combination of driver monitoring and image projection can be used to improve driver alertness.

[0022] Figure 1 1 is a schematic block diagram of a vehicle system 100 according to one or more implementations. In particular, the vehicle system 100 includes an object detection system 102 , a view tracking system 104 , a controller 106 , an image projection system 108 , an auxiliary content system 110 , and an audio system 112 .

[0023] The object detection system 102 may include one or more sensors 114 and one or more object detection processors 116. The one or more sensors 114 may be configured to monitor and sense objects located in the environment. For example, the one or more sensors 114 may include one or more radar sensors, light detection and ranging (LIDAR) sensors, and / or one or more cameras. The one or more sensors 114 may provide sensor signals to one or more object detection processors 116 for processing and object detection. For example, the one or more object detection processors 116 may be configured to process sensor signals, detect objects in the environment based on the sensor signals, and detect safety hazards based on the position of the objects relative to the vehicle. The one or more object detection processors 116 may generate an alarm signal in response to detecting safety hazards. Therefore, the object detection system 102 may be configured to detect objects outside the vehicle and detect safety hazards based on the position of the objects relative to the vehicle. The object may be a vulnerable object that is determined by the object detection system 102 to be susceptible to collision with the vehicle. In addition, the one or more object detection processors 116 may be configured to generate position information corresponding to the position of the object relative to the vehicle. Image projection system 108 may be configured to generate an image as a warning pattern in response to detection of a safety hazard by object detection system 102 .

[0024] The viewing tracking system 104 may include a driver monitoring device 118 configured to monitor or sense a driver viewing direction of a vehicle driver. The viewing tracking system 104 may also include one or more driver viewing detection processors 120, which are configured to generate driver viewing direction information indicating a driver viewing direction of a vehicle driver based on information provided by the driver monitoring device 118. In some implementations, the driver monitoring device 118 may be a camera that tracks at least one of a head position of the vehicle driver or an eye position of the vehicle driver to generate the driver viewing direction information. The driver viewing direction information changes in real time, for example, as the driver viewing direction changes.

[0025] The viewing tracking system 104 may also include a passenger monitoring device 122 configured to monitor or sense a passenger viewing direction of a vehicle passenger. The viewing tracking system 104 may also include one or more passenger viewing detection processors 124 configured to generate passenger viewing direction information indicating a passenger viewing direction of a vehicle passenger based on information provided by the passenger monitoring device 122. In some implementations, the passenger monitoring device 122 may be a camera that tracks at least one of a vehicle passenger's head position or a vehicle passenger's eye position to generate the passenger viewing direction information. The passenger viewing direction information changes in real time, for example, as the passenger viewing direction changes.

[0026] The controller 106 may be configured to receive an alarm signal from the object detection system 102, location information from the object detection system 102, driver viewing direction information from the viewing tracking system 104, and passenger viewing direction information from the viewing tracking system 104 as inputs, and may control the operation of one or more components of the image projection system 108, the auxiliary content system 110, and / or the audio system 112 based on one or more of these inputs. In some implementations, the controller 106 may be part of the image projection system 108, part of the auxiliary content system 110, and / or part of the audio system 112. For example, the controller 106 may be configured to receive driver viewing direction information and control one or more components of the image projection system 108 to project an image into the driver viewing direction of the vehicle driver based on the driver viewing direction information. The image projection direction in which the image of the image projection system 108 is projected may change based on a change in the driver viewing direction of the vehicle driver. Therefore, the image projection direction may change in real time as the driver viewing direction information changes, so that the image projection system 108 projects the image into the line of sight of the vehicle driver to improve the driver's perception. As a result, the vehicle driver may be alerted to safety hazards and / or the driver's awareness may be enhanced.

[0027] The image projection system 108 may include an alarm content generator 126 (e.g., an image generator) configured to generate an image based on a control signal provided by the controller 106. The image may be an alarm pattern generated in response to a safety hazard being detected. The alarm content generator 126 may be configured to generate one or more different alarm patterns, and to generate an alarm pattern among different alarm patterns based on the type of safety hazard detected by one or more object detection processors 116. In addition, the alarm content generator 126 may be configured to provide an image to one or more display drivers based on the control signal. The display driver may be configured to drive an image projector for projecting an image in an image projection direction. Therefore, the display driver may provide an image or an electrical signal corresponding to the image and a control signal for controlling the image projection direction to the image projector.

[0028] For example, the image projection system 108 may include a first image driver 128, a second image driver 130, and / or a third image driver 132. The first image driver 128 may be electrically coupled to a first vehicle headlight 134 and a second vehicle headlight 136 of the vehicle. The first vehicle headlight 134 and the second vehicle headlight 136 may be matrix headlights capable of generating an image or a portion of an image (such as a warning pattern or a warning symbol). The first image driver 128 may be configured to control the first vehicle headlight 134 and the second vehicle headlight 136 to project an image onto an object located in a driver's viewing direction. In some implementations, the object may correspond to a safety hazard detected by the object detection system 102. Therefore, the image projection system 108 includes a first vehicle headlight 134 and a second vehicle headlight 136 configured to project an image onto an image display area of ​​an environment located outside the vehicle (e.g., onto an object). The image display area of ​​the environment may correspond to a driver's viewing direction of a vehicle driver. In addition, the image display area of ​​the environment may change based on a change in the driver's viewing direction of the vehicle driver.

[0029] The second image driver 130 can be electrically coupled to the first vehicle headlight 134 and the second vehicle headlight 136 of the vehicle. The second image driver 130 can be configured to control the first vehicle headlight 134 and the second vehicle headlight 136 to project an image onto a road surface in the driver's viewing direction and in front of the vehicle. Therefore, the image projection system 108 includes the first vehicle headlight 134 and the second vehicle headlight 136 configured to project an image onto an image display area of ​​an environment located outside the vehicle (e.g., projected onto a road). The image display area of ​​the environment can correspond to the driver's viewing direction of the vehicle driver. In addition, the image display area of ​​the environment can change based on changes in the driver's viewing direction of the vehicle driver.

[0030] The controller 106 may be configured to determine whether the driver's viewing direction of the vehicle driver corresponds to the first angle area of ​​the environment, the second angle area of ​​the environment, or the third angle area of ​​the environment based on the driver's viewing direction information. The second angle area of ​​the environment is arranged between the first angle area and the third angle area of ​​the environment. For example, the first angle area of ​​the environment may correspond to the driver's side of the environment, the third angle area of ​​the environment may correspond to the passenger side of the environment, and the second angle area of ​​the environment may correspond to the central area of ​​the environment located in front of the center of the vehicle. The controller 106 may control the first image driver 128 and / or the second image driver 130 to activate or drive one or two vehicle headlights based on the driver's viewing direction. For example, if the driver's viewing direction of the vehicle driver corresponds to the first angle area, the first vehicle headlight 134 may be configured by the first image driver 128 or the second image driver 130 to project the entire image. Therefore, when the vehicle driver is observing the first angle area, the image may be projected into the vehicle driver's line of sight. If the driver's viewing direction of the vehicle driver corresponds to the third angle area, the second vehicle headlight 136 may be configured by the first image driver 128 or the second image driver 130 to project the entire image. Thus, when the vehicle driver is observing the third angular region, the image can be projected into the vehicle driver's line of sight. If the vehicle driver's driver viewing direction corresponds to the second angular region, the first vehicle headlight 134 can be configured by the first image driver 128 or the second image driver 130 to project a first portion of the image, and the second vehicle headlight 136 can be configured by the first image driver 128 or the second image driver 130 to project a second portion of the image. Thus, when the vehicle driver is observing the second angular region, the image can be projected into the vehicle driver's line of sight.

[0031] The third image driver 132 can be electrically coupled to the HUD system 138 of the vehicle. The HUD system 138 can be configured to project an image onto an image display area of ​​a windshield or side window of the vehicle based on the driver's viewing direction. The image display area of ​​the windshield or side window can correspond to the driver's viewing direction of the vehicle driver. Therefore, the image display area of ​​the windshield or side window can be changed based on a change in the driver's viewing direction of the vehicle driver. The HUD system 138 may include HUD hardware, which includes an image projector and one or more optical components (e.g., lenses) configured to project an image onto the windshield or side window. The HUD hardware may include one or more micro-electromechanical systems (MEMS) mirrors, which are configured to turn the image display area and thereby turn the image into the driver's viewing direction. Therefore, the image can be projected onto the windshield or side window to enter the driver's line of sight.

[0032] The HUD system 138 may also include additional HUD hardware configured to project images for vehicle passengers (e.g., project images into the line of sight of vehicle passengers). For example, the HUD hardware may include an additional image projector and one or more optical components (e.g., lenses) configured to project images onto a windshield or side windows for vehicle passengers. The HUD hardware may include one or more MEMS mirrors configured to steer the image display area for vehicle passengers and thereby steer the image for vehicle passengers into the passenger's viewing direction. Thus, images may be projected onto the windshield or side windows to enter the line of sight of vehicle passengers.

[0033] The controller 106 may be configured to receive the passenger viewing direction information and control the third image driver 132 to generate an additional image (e.g., an alert content provided by the alert content generator 126) for the vehicle passenger based on the driver viewing direction information. The passenger image projection direction of the additional image in which the additional image is projected may change based on a change in the passenger viewing direction of the vehicle passenger. Thus, the passenger image projection direction may change in real time as the passenger viewing direction information changes. As a result, the HUD system 138 may project an additional image into the line of sight of the vehicle passenger to improve passenger perception, for example, by using a warning pattern or warning symbol to alert the vehicle passenger to a safety hazard.

[0034] The audio system 112 may include an audio driver 140 and a plurality of speakers 142, the plurality of speakers 142 including at least one first speaker located on the driver's side of the vehicle and at least one second speaker located on the passenger side of the vehicle. In some implementations, the plurality of speakers 142 may include a front speaker and a rear speaker located on each of the driver's side and the passenger side of the vehicle. The alarm content generator 126 may provide sound content to the audio driver 140 in response to a safety hazard being detected, and the audio driver 140 may generate an electrical signal for generating an alarm sound corresponding to the sound content. Thus, the audio system 112 may be configured to output an alarm sound by activating one or more speakers in response to a safety hazard being detected by the object detection system 102.

[0035] In some implementations, the controller 106 and / or the alarm content generator 126 may control the audio driver 140 to activate all of the multiple speakers in response to a safety hazard being detected. In some implementations, the controller 106 and / or the alarm content generator 126 may control the audio driver 140 to activate only a portion of the multiple speakers 142 in response to a safety hazard being detected. For example, the controller 106 may use the position information provided by the object detection system 102 to determine which speakers 142 are to be activated, and the alarm content generator 126 may generate sound content corresponding to which speakers are to be activated. The audio driver 140 may be configured to activate at least one first speaker located on the driver's side or activate at least one second speaker located on the passenger side based on the position information received by the controller 106. For example, if the position information indicates that the position of the vulnerable object corresponds to the driver's side of the vehicle, the audio driver 140 may be configured to activate at least one first speaker located on the driver's side. Alternatively, if the position information indicates that the position of the vulnerable object corresponds to the passenger side of the vehicle, the audio driver 140 may be configured to activate at least one second speaker located on the passenger side. Therefore, the vehicle driver's attention can be directed to the direction in which the sound is generated so as to enhance the vehicle driver's awareness of safety hazards.

[0036] The auxiliary content system 110 can provide additional image or sound content to other auxiliary components in response to a safety hazard being detected. For example, the auxiliary content system 110 can include an auxiliary warning content generator 144 and a navigation display 146. The auxiliary warning content generator 144 can be configured to generate an image for display on the navigation display 146 in response to a safety hazard being detected so as to enhance the vehicle driver's awareness of the safety hazard.

[0037] As mentioned above, Figure 1 Provided as an example. Other examples can be found with Figure 1 In practice, Figure 1 The vehicle system 100 may include more components, fewer components, different components, or differently arranged components than shown without departing from the above disclosure.

[0038] Figure 2 is a diagram of a vehicle 200 according to one or more implementations. The vehicle 200 may include a combination of Figure 1The vehicle system 100 described. For example, the vehicle 200 may include one or more sensors 114, a driver monitoring device 118, a passenger monitoring device 122, a first vehicle headlight 134, a second vehicle headlight 136, a first HUD 138a for a vehicle driver, a second HUD 138b for a vehicle passenger, and a speaker 142. One or more images may be projected into one or more display areas by the first vehicle headlight 134, the second vehicle headlight 136, and / or the first HUD 138a based on the driver viewing direction information generated by the viewing tracking system 104, so that the one or more images are projected into the driver viewing direction. In addition, one or more images may be projected into one or more display areas by the second HUD 138b based on the passenger viewing direction information generated by the viewing tracking system 104, so that the one or more images are projected into the passenger viewing direction. In addition, one or more speakers in the speaker 142 may be activated in response to a safety hazard being detected by the object detection system 102.

[0039] As mentioned above, Figure 2 Provided as an example. Other examples can be found with Figure 2 In practice, Figure 2 The vehicle 200 may include more components, fewer components, different components, or differently arranged components than shown without departing from the above disclosure.

[0040] The following provides an overview of some aspects of the disclosure:

[0041] Aspect 1: A vehicle system of a vehicle, comprising: a viewing tracking system configured to monitor a driver viewing direction of a vehicle driver and generate driver viewing direction information indicating the driver viewing direction of the vehicle driver; and an image projection system configured to receive the driver viewing direction information and project an image into the driver viewing direction of the vehicle driver based on the driver viewing direction information, wherein an image projection direction in which an image of the image projection system is projected changes based on a change in the driver viewing direction of the vehicle driver.

[0042] Aspect 2. A vehicle system according to Aspect 1, wherein the image projection system includes a head-up display configured to project an image onto an image display area of ​​a windshield or a side window of the vehicle, wherein the image display area of ​​the windshield or the side window corresponds to a driver's viewing direction of a driver of the vehicle, and wherein the image display area of ​​the windshield or the side window changes based on a change in the driver's viewing direction of the driver of the vehicle.

[0043] Aspect 3. A vehicle system according to Aspect 2, wherein the image projection system includes a first vehicle headlight and a second vehicle headlight configured to project an image onto an image display area of ​​an environment located outside the vehicle, wherein the image display area of ​​the environment corresponds to a driver viewing direction of a vehicle driver, and wherein the image display area of ​​the environment changes based on a change in the driver viewing direction of the vehicle driver.

[0044] Aspect 4. The vehicle system according to Aspect 3 further includes: an object detection system configured to detect an object outside the vehicle and detect a safety hazard based on a position of the object relative to the vehicle, wherein the image is an alarm pattern in response to the safety hazard being detected.

[0045] Aspect 5. The vehicle system according to Aspect 4 further includes: an audio system including a plurality of speakers, including at least one first speaker located on the driver's side of the vehicle and at least one second speaker located on the passenger side of the vehicle, wherein the audio system is configured to output an alarm sound in response to a safety hazard being detected.

[0046] Aspect 6. The vehicle system of aspect 5, wherein the audio system is configured to activate the plurality of speakers in response to a safety hazard being detected.

[0047] Aspect 7. A vehicle system according to Aspect 5, wherein the object detection system is configured to generate position information corresponding to the position of the object relative to the vehicle, wherein the audio system is configured to receive the position information and activate at least one first speaker or activate at least one second speaker based on the position information, wherein the audio system is configured to activate at least one first speaker if the position information indicates that the position of the object corresponds to the driver's side of the vehicle, and wherein the audio system is configured to activate at least one second speaker if the position information indicates that the position of the object corresponds to the passenger side of the vehicle.

[0048] Aspect 8. A vehicle system according to any one of Aspects 1 to 7, wherein the image projection system includes a first vehicle headlight and a second vehicle headlight configured to project an image onto an image display area of ​​an environment located outside the vehicle, wherein the image display area of ​​the environment corresponds to a driver's viewing direction of a vehicle driver, and wherein the image display area of ​​the environment changes based on a change in the driver's viewing direction of the vehicle driver.

[0049] Aspect 9. A vehicle system according to Aspect 8, wherein the image projection system is configured to determine, based on driver viewing direction information, whether a driver viewing direction of a vehicle driver corresponds to a first angular area of ​​the environment, a second angular area of ​​the environment, or a third angular area of ​​the environment, wherein the second angular area of ​​the environment is arranged between the first angular area and the third angular area of ​​the environment, wherein if the driver viewing direction of the vehicle driver corresponds to the first angular area, the first vehicle headlight is configured to project an image, wherein if the driver viewing direction of the vehicle driver corresponds to the third angular area, the second vehicle headlight is configured to project an image, and wherein if the driver viewing direction of the vehicle driver corresponds to the second angular area, the first vehicle headlight is configured to project a first part of the image, and the second vehicle headlight is configured to project a second part of the image.

[0050] Aspect 10. The vehicle system of aspect 8, wherein the first vehicle headlight and the second vehicle headlight are matrix headlights.

[0051] Aspect 11. The vehicle system according to Aspect 8 further includes: an object detection system configured to detect objects in the environment and detect safety hazards based on the position of the objects relative to the vehicle, wherein the image is an alarm pattern in response to the safety hazard being detected.

[0052] Aspect 12. The vehicle system according to aspect 11, wherein the image projection system is configured to project an image of the warning pattern onto a road surface in front of the vehicle.

[0053] Aspect 13. The vehicle system according to aspect 11, wherein the image projection system is configured to project an image of the warning pattern onto the object.

[0054] Aspect 14. The vehicle system of aspect 11, wherein the object detection system comprises at least one of a radar sensor, a LIDAR sensor, or a camera sensor.

[0055] Aspect 15. A vehicle system according to any one of Aspects 1 to 14, wherein the viewing tracking system includes a camera that tracks at least one of a head position of a vehicle driver or an eye position of the vehicle driver to generate driver viewing direction information.

[0056] Aspect 16. A vehicle system according to any one of Aspects 1 to 15, wherein a viewing tracking system is configured to monitor a passenger viewing direction of a vehicle passenger and generate passenger viewing direction information indicating the passenger viewing direction of the vehicle passenger, wherein an image projection system is configured to receive the passenger viewing direction information and project an additional image into the passenger viewing direction of the vehicle passenger based on the passenger viewing direction information, wherein a passenger image projection direction in which an additional image of the image projection system is projected changes based on a change in the passenger viewing direction of the vehicle passenger.

[0057] Aspect 17. A vehicle system according to Aspect 16, wherein the image projection system includes a head-up display, the head-up display being configured to project additional images onto an image display area of ​​a windshield or side window of the vehicle, wherein the image display area of ​​the windshield or side window corresponds to a passenger viewing direction of a vehicle passenger, and wherein the image display area of ​​the windshield or side window changes based on a change in the passenger viewing direction of the vehicle passenger.

[0058] Aspect 18. The vehicle system according to Aspect 17 further includes: an object detection system configured to detect an object located outside the vehicle and detect a safety hazard based on the position of the object relative to the vehicle, wherein the additional image is an alarm pattern in response to the safety hazard being detected.

[0059] Aspect 19. A method for displaying information during operation of a vehicle, the method comprising: monitoring a driver viewing direction of a vehicle driver; generating driver viewing direction information indicating a driver viewing direction of the vehicle driver; and projecting an image into the driver viewing direction of the vehicle driver based on the driver viewing direction information, wherein an image projection direction in which the image is projected changes based on a change in the driver viewing direction of the vehicle driver.

[0060] Aspect 20. The method according to Aspect 19 further includes: detecting an object located in an environment outside the vehicle; detecting a safety hazard based on a position of the object relative to the vehicle; and generating an image as a warning pattern in response to the safety hazard being detected.

[0061] Aspect 21: A system configured to perform one or more operations according to one or more of aspects 1 to 20.

[0062] Aspect 22: An apparatus comprising means for performing one or more operations according to one or more of aspects 1 to 20.

[0063] Aspect 23: A non-transitory computer-readable medium storing an instruction set, the instruction set comprising one or more instructions, which, when executed by a device, causes the device to perform one or more operations according to one or more of aspects 1 to 20.

[0064] Aspect 24: A computer program product comprising instructions or codes for performing one or more operations according to one or more of aspects 1 to 20.

[0065] The above disclosure provides illustration and description, but is not intended to be exhaustive or to limit the implementation to the precise form disclosed. Modifications and variations are possible in light of the above disclosure or may be acquired from practice of implementation.

[0066] Some implementations may be described herein in conjunction with a threshold value. As used herein, "satisfying" a threshold value may refer to a value being greater than a threshold value, more than a threshold value, higher than a threshold value, greater than or equal to a threshold value, less than a threshold value, less than a threshold value, less than or equal to a threshold value, equal to a threshold value, etc.

[0067] As used herein, the term "component" is intended to be broadly interpreted as hardware, firmware, or a combination of hardware and software. The systems and / or methods described herein can be implemented in different forms of hardware, firmware, or a combination of hardware and software. The actual dedicated control hardware or software code used to implement these systems and / or methods does not limit these implementations. Therefore, the operation and behavior of these systems and / or methods are described herein without reference to specific software codes, and it should be understood that software and hardware can be designed to implement these systems and / or methods based on the description herein.

[0068] Any processing component can be implemented as a central processing unit (CPU) or other processor that reads and executes a software program from a non-transient computer-readable recording medium such as a hard disk or a semiconductor memory device. For example, instructions can be executed by one or more processors, such as one or more CPUs, digital signal processors (DSPs), general-purpose microprocessors, application-specific integrated circuits (ASICs), field programmable logic arrays (FPLAs), programmable logic controllers (PLCs), or other equivalent integrated or discrete logic circuit systems. Therefore, the term "processor" used in this article refers to any of the aforementioned structures or any other structure suitable for implementing the technology described herein. The software can be stored on a non-transient computer-readable medium, so that the non-transient computer-readable medium includes a program code or a program algorithm stored thereon, which causes the processor to perform the steps of the method via a computer program when executed.

[0069] A controller including hardware may also perform one or more techniques of the present disclosure. A controller including one or more processors may use electrical signals and digital algorithms to perform its reception, analysis, and control functions, which may also include correction functions. Such hardware, software, and firmware may be implemented within the same device or within separate devices to support the various techniques described in the present disclosure.

[0070] Signal processing circuitry and / or signal conditioning circuitry can receive one or more signals (e.g., measurement signals) in the form of raw measurement data from one or more components, and can derive additional information from the measurement signals. "Signal conditioning" as used herein refers to manipulating an analog signal in some way so that the signal meets further processing requirements at the next stage. Signal conditioning can include conversion from analog to digital (e.g., via an analog-to-digital converter), amplification, filtering, conversion, biasing, range matching, isolation, and any other process required to make the signal suitable for processing after conditioning.

[0071] Even if specific feature combinations are listed in the claims and / or disclosed in the specification, these combinations are not intended to limit the disclosure of the implementation described herein. Many of these features can be combined in a manner not specifically listed in the claims and / or not disclosed in the specification. For example, the present disclosure includes each dependent claim in the claim set combined with each other individual claim in the claim set and each combination of multiple claims in the claim. As used herein, the phrase "at least one" in the list of items refers to any combination of these items, including single members. For example, "at least one of a, b or c" is intended to cover any combination of a, b, c, a and b, a and c, b and c, and a, b and c, and multiples of the same elements (e.g., a+a, a+a+a, a+a+b, a+a+c, a+b+b, a+c+c, b+b, b+b+b, b+b+c, c+c and c+c+c, or any other ordering of a, b and c).

[0072] In addition, it should be understood that the disclosure of multiple actions or functions disclosed in the specification or claims should not be interpreted as being in a specific order. Therefore, the disclosure of multiple actions or functions does not limit them to a specific order unless these actions or functions are not interchangeable for technical reasons. In addition, in some implementations, a single action may include multiple sub-actions, or may be decomposed into multiple sub-actions. Unless explicitly excluded, such sub-actions may be included and become part of the disclosure of the single action.

[0073] Unless explicitly stated, any element, action or instruction used in this article should not be interpreted as critical or necessary. In addition, as used in this article, the articles "one" and "an" are intended to include one or more items, and can be used interchangeably with "one or more". In addition, as used in this article, "said", "the" are intended to include one or more items related to the articles "said", "the", and can be used interchangeably with "one or more". If only one project is intended to be used, the phrases "only one", "single" or similar language are used. In addition, as used in this article "have (have)", the term "has (has)", "having (having)" etc. are intended to be open terms (for example, element "has" A can also have B) that do not limit the elements modified by it. In addition, unless explicitly stated otherwise, the word "based on" means "based on at least in part". As used in this article, the term "multiple (multiple)" can be replaced with "multiple (a plurality of)", and vice versa. Furthermore, as used herein, the term "or" when used in a series is inclusive and can be used interchangeably with "and / or" unless expressly stated otherwise (for example, if used in conjunction with "either of two" or "only one of...").

Claims

1. A vehicle system for a vehicle, comprising: a look tracking system configured to monitor a driver look direction of a vehicle driver and generate driver look direction information indicative of the driver look direction of the vehicle driver; as well as An image projection system is configured to receive the driver viewing direction information and project an image into the driver viewing direction of the vehicle driver based on the driver viewing direction information, wherein the image projection direction in which the image of the image projection system is projected changes based on a change in the driver viewing direction of the vehicle driver.

2. The vehicle system of claim 1 , wherein the image projection system comprises a head-up display configured to project the image onto an image display area of ​​a windshield or a side window of the vehicle, wherein the image display area of ​​the windshield or the side window corresponds to the driver viewing direction of the vehicle driver, and The image display area of ​​the windshield or the side window changes based on a change in the driver's viewing direction of the vehicle driver.

3. The vehicle system of claim 2, wherein the image projection system comprises a first vehicle headlight and a second vehicle headlight configured to project the image onto an image display area located in an environment external to the vehicle, wherein the image display area of ​​the environment corresponds to the driver viewing direction of the vehicle driver, and Wherein the image display area of ​​the environment changes based on a change in the driver viewing direction of the vehicle driver.

4. The vehicle system according to claim 3, further comprising: an object detection system configured to detect objects external to the vehicle and to detect safety hazards based on the position of the objects relative to the vehicle, The image is an alarm pattern in response to the safety hazard being detected.

5. The vehicle system according to claim 4, further comprising: an audio system comprising a plurality of speakers, the plurality of speakers including at least one first speaker located on a driver's side of the vehicle and at least one second speaker located on a passenger side of the vehicle, The audio system is configured to output an alarm sound in response to the safety hazard being detected. 6 . The vehicle system of claim 5 , wherein the audio system is configured to activate the plurality of speakers in response to the safety hazard being detected.

7. The vehicle system of claim 5, wherein the object detection system is configured to generate position information corresponding to the position of the object relative to the vehicle, wherein the audio system is configured to receive the position information and activate the at least one first speaker or activate the at least one second speaker based on the position information, wherein if the position information indicates that the position of the object corresponds to the driver's side of the vehicle, the audio system is configured to activate the at least one first speaker, and Wherein if the position information indicates that the position of the object corresponds to the passenger side of the vehicle, the audio system is configured to activate the at least one second speaker.

8. The vehicle system of claim 1 , wherein the image projection system comprises a first vehicle headlight and a second vehicle headlight configured to project the image onto an image display area located in an environment external to the vehicle, wherein the image display area of ​​the environment corresponds to the driver viewing direction of the vehicle driver, and Wherein the image display area of ​​the environment changes based on a change in the driver viewing direction of the vehicle driver.

9. The vehicle system according to claim 8, wherein the image projection system is configured to determine, based on the driver viewing direction information, whether the driver viewing direction of the vehicle driver corresponds to a first angular region of the environment, a second angular region of the environment, or a third angular region of the environment, wherein the second angular region of the environment is arranged between the first angular region and the third angular region of the environment, wherein the first vehicle headlight is configured to project the image if the driver viewing direction of the vehicle driver corresponds to the first angular region, wherein if the driver viewing direction of the vehicle driver corresponds to the third angular region, the second vehicle headlight is configured to project the image, and Wherein if the driver viewing direction of the vehicle driver corresponds to the second angular region, the first vehicle headlight is configured to project a first portion of the image and the second vehicle headlight is configured to project a second portion of the image.

10. The vehicle system of claim 8, wherein the first vehicle headlight and the second vehicle headlight are matrix headlights.

11. The vehicle system according to claim 8, further comprising: an object detection system configured to detect objects in the environment and detect safety hazards based on the positions of the objects relative to the vehicle, The image is an alarm pattern in response to the safety hazard being detected. 12 . The vehicle system of claim 11 , wherein the image projection system is configured to project the image of the warning pattern onto a road surface in front of the vehicle.

13. The vehicle system of claim 11, wherein the image projection system is configured to project the image of the warning pattern onto the object.

14. The vehicle system of claim 11, wherein the object detection system comprises at least one of a radar sensor, a LIDAR sensor, or a camera sensor.

15. The vehicle system of claim 1, wherein the viewing tracking system comprises a camera that tracks at least one of a head position of the vehicle driver or an eye position of the vehicle driver to generate the driver viewing direction information.

16. The vehicle system of claim 1, wherein the viewing tracking system is configured to monitor a passenger viewing direction of a vehicle passenger and generate passenger viewing direction information indicative of the passenger viewing direction of the vehicle passenger, The image projection system is configured to receive the passenger viewing direction information and project an additional image into the passenger viewing direction of the vehicle passenger based on the passenger viewing direction information, wherein the passenger image projection direction in which the additional image of the image projection system is projected changes based on a change in the passenger viewing direction of the vehicle passenger.

17. The vehicle system of claim 16, wherein the image projection system comprises a head-up display configured to project the further image onto an image display area of ​​a windshield or side window of the vehicle, wherein the image display area of ​​the windshield or the side window corresponds to the passenger viewing direction of the vehicle passenger, and The image display area of ​​the windshield or the side window changes based on a change in the passenger viewing direction of the vehicle passenger.

18. The vehicle system of claim 17, further comprising: an object detection system configured to detect an object located outside the vehicle and to detect a safety hazard based on a position of the object relative to the vehicle, The additional image is an alarm pattern in response to the safety hazard being detected.

19. A method of displaying information during operation of a vehicle, the method comprising: monitoring the driver viewing direction of the vehicle operator; generating driver viewing direction information indicating the driver viewing direction of the vehicle driver; as well as An image is projected into the driver viewing direction of the vehicle driver based on the driver viewing direction information, wherein an image projection direction in which the image is projected changes based on a change in the driver viewing direction of the vehicle driver.

20. The method according to claim 19, further comprising: detecting an object in an environment external to the vehicle; detecting a safety hazard based on a position of the object relative to the vehicle; as well as In response to the safety hazard being detected, the image is generated as an alarm pattern.

Images