Traffic signal change visualization system and method
The virtual visual indicators of traffic signal changes are displayed through the vehicle head-up display system, which solves the problem that traditional drivers find it difficult to deal with traffic signal changes in time through windows, and improves driving efficiency and traffic mobility.
Patent Information
- Application Number
- CN202111533408.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2021-01-26
- Filing Date
- 2021-12-15
- Publication Date
- 2024-11-08
- Estimated Expiration
- 2041-12-15
AI Technical Summary
Traditional vehicle drivers observe the surrounding environment through windows and windshields to control the vehicle, lacking effective visual indicators to facilitate drivers to accelerate, decelerate and turn in time when traffic signals change, resulting in low vehicle efficiency, heavy wear and traffic congestion.
The vehicle head-up display system receives traffic signal status changes through the communication module, the distance module calculates the position in front of the vehicle, the light source module displays a virtual visual indicator on the windshield, and the display control module adjusts the indicator position and color according to the distance and color, so as to facilitate the The driver understands where the traffic signal is about to change.
It improves the driver's driving efficiency, reduces vehicle wear and traffic congestion, and helps the driver adjust the vehicle status in time by displaying the changing position and color of traffic signals in front of the vehicle, and improves traffic mobility.
Smart Images

Figure CN114792474B_ABST
Abstract
Description
[0001] introduction
[0002] The information provided in this section is for the purpose of generally presenting the context of this disclosure. To the extent described in this section, the works of the currently attributed inventors and aspects of the description that may not constitute prior art at the time of filing are neither explicitly nor implicitly considered to be prior art of this disclosure. Technical Field
[0003] This disclosure relates to a head-up display system for a vehicle, and more specifically to a visual indicator displayed via the vehicle's head-up display system at the location where a traffic signal will change. Background Technology
[0004] Traditionally, drivers observe their surroundings through windows, the windshield, and other glass surfaces. Drivers can then use this visual observation to control the vehicle's acceleration, deceleration, and steering.
[0005] Vehicles may include one or more displays that show various information. For example, some vehicles include an infotainment system that includes displays showing various infotainment and other vehicle information. Vehicles may also include a head-up display (HUD) that displays information on the vehicle's windshield. For example, a HUD may display vehicle speed and other vehicle information. Summary of the Invention
[0006] In one feature, the vehicle's head-up display (HUD) system includes: a communication module configured to receive a time period up to the intersection of roads until a traffic signal changes from a first state to a second state; a distance module configured to determine, based on the time period and the vehicle's current speed, the distance in front of the vehicle at which the vehicle will be positioned when the traffic signal changes from the first state to the second state; a light source configured to generate a virtual display visible within the vehicle's cabin via the vehicle's windshield; and a display control module configured to control the light source based on the distance to include in the virtual display a visual indicator of the location in the vehicle's path where the traffic signal will change from the first state to the second state.
[0007] In another feature, the display control module is configured to control the light source, such that the visual indicator includes a color corresponding to the second state.
[0008] Another characteristic is that the color is one of red, yellow, and green.
[0009] Among other features: the communication module is also configured to receive a second time period up to the intersection of the road when the traffic signal will change from the second state to the third state; the distance module is also configured to determine a second distance in front of the vehicle when the traffic signal changes from the second state to the third state based on the second time period and the vehicle's current speed; and the display control module is also configured to control the light source based on the second distance to include in the virtual display a second visual indicator of the second location in the vehicle's path where the traffic signal will change from the second state to the third state.
[0010] In another feature, the display control module is configured to control the light source such that the visual indicator includes a first color corresponding to the second state, and the second visual indicator includes a second color corresponding to the third state.
[0011] In another feature, the visual indicator extends horizontally at this location toward the boundary of the vehicle's current lane.
[0012] In another feature, the visual indicator extends both horizontally and vertically at this location.
[0013] In another feature, the visual indicators extend deep into the intersection.
[0014] Among other features, the visual indicators extend vertically and in depth.
[0015] In another feature, the communication module is configured to wirelessly receive the time period from a signal control module configured to control traffic signals.
[0016] In another feature, the communication module is configured to receive the time period via the Internet from a signal control module configured to control traffic signals.
[0017] In another feature, the disable module is configured to selectively disable the display of visual indicators when the driver's gaze is not directed toward the road ahead of the vehicle.
[0018] Among the additional features: the eye position module is configured to determine the position of the driver's eyes in the vehicle, and the display control module is configured to adjust the position of the visual indicator in the virtual display based on the position of the driver's eyes.
[0019] In other features, the first state includes a green traffic signal indicator and the second state includes a yellow traffic signal indicator.
[0020] In other features, the first state includes a yellow traffic signal indicator and the second state includes a red traffic signal indicator.
[0021] In other features, the first state includes a red traffic signal indicator and the second state includes a green traffic signal indicator.
[0022] In one feature, a head-up display (HUD) method for a vehicle includes: receiving a time period up to an intersection of roads from which a traffic signal will change from a first state to a second state; determining, based on the time period and the vehicle's current speed, the distance in front of the vehicle at which the vehicle will be positioned when the traffic signal changes from the first state to the second state; generating a virtual display visible within the vehicle's cabin via the vehicle's windshield; and controlling a light source based on the distance to include in the virtual display a visual indicator of the location in the vehicle's path where the traffic signal will change from the first state to the second state.
[0023] In another feature, the control includes controlling the light source such that the visual indicator includes a color corresponding to the second state.
[0024] Another characteristic is that the color is one of red, yellow, and green.
[0025] Among other features, the HUD method also includes: receiving a second time period up to the intersection of the road until the traffic signal will change from a second state to a third state; determining a second distance in front of the vehicle where the vehicle will be when the traffic signal changes from the second state to the third state based on the second time period and the vehicle's current speed; and controlling the light source based on the second distance to include in the virtual display a second visual indicator of the second location in the vehicle's path where the traffic signal will change from the second state to the third state.
[0026] The present invention provides the following technical solutions.
[0027] Technical Solution 1. A head-up display (HUD) system for a vehicle, comprising:
[0028] A communication module configured to receive the time period up to the intersection of roads until the traffic signal changes from a first state to a second state;
[0029] A distance module is configured to determine, based on the time period and the vehicle's current speed, the distance in front of the vehicle from where the traffic signal will be when it transitions from the first state to the second state;
[0030] A light source configured to generate a virtual display visible within the vehicle's cabin via the vehicle's windshield; and
[0031] A display control module is configured to control the light source based on the distance to include in the virtual display a visual indicator of the location in the vehicle's path where the traffic signal will transition from the first state to the second state.
[0032] Technical Solution 2. The HUD system according to Technical Solution 1, wherein the display control module is configured to control the light source such that the visual indicator includes a color corresponding to the second state.
[0033] Technical Solution 3. The HUD system according to Technical Solution 2, wherein the color is one of red, yellow and green.
[0034] Technical Solution 4. The HUD system according to Technical Solution 1, wherein:
[0035] The communication module is also configured to receive a second time period until the traffic signal at the intersection of the road changes from the second state to the third state;
[0036] The distance module is also configured to determine, based on the second time period and the vehicle's current speed, a second distance in front of the vehicle when the traffic signal transitions from the second state to the third state; and
[0037] The display control module is also configured to control the light source based on the second distance to include in the virtual display a second visual indicator of the second location where the traffic signal in the vehicle's path will transition from the second state to the third state.
[0038] Technical Solution 5. The HUD system according to Technical Solution 4, wherein the display control module is configured to control the light source such that the visual indicator includes a first color corresponding to the second state, and the second visual indicator includes a second color corresponding to the third state.
[0039] Technical Solution 6. The HUD system according to Technical Solution 1, wherein the visual indicator extends horizontally at the location toward the boundary of the vehicle's current lane.
[0040] Technical Solution 7. The HUD system according to Technical Solution 1, wherein the visual indicator extends horizontally and vertically at the location.
[0041] Technical Solution 8. The HUD system according to Technical Solution 1, wherein the visual indicator extends longitudinally toward the intersection.
[0042] Technical Solution 9. The HUD system according to Technical Solution 1, wherein the visual indicator extends vertically and in depth.
[0043] Technical Solution 10. The HUD system according to Technical Solution 1, wherein the communication module is configured to wirelessly receive the time period from a signal control module configured to control the traffic signal.
[0044] Technical Solution 11. The HUD system according to Technical Solution 1, wherein the communication module is configured to receive the time period from a signal control module configured to control the traffic signal via the Internet.
[0045] Technical Solution 12. The HUD system according to Technical Solution 1 further includes:
[0046] A disabling module is configured to selectively disable the display of the visual indicator when the driver's gaze is not directed toward the road ahead of the vehicle.
[0047] Technical Solution 13. The HUD system according to Technical Solution 1 further includes:
[0048] An eye position module is configured to determine the position of the driver's eyes in the vehicle.
[0049] The display control module is configured to adjust the position of the visual indicator in the virtual display based on the position of the driver's eyes.
[0050] Technical Solution 14. The HUD system according to Technical Solution 1, wherein the first state includes the traffic signal illuminating a green indicator, and the second state includes the traffic signal illuminating a yellow indicator.
[0051] Technical Solution 15. The HUD system according to Technical Solution 1, wherein the first state includes the traffic signal illuminating a yellow indicator, and the second state includes the traffic signal illuminating a red indicator.
[0052] Technical Solution 16. The HUD system according to Technical Solution 1, wherein the first state includes the traffic signal illuminating a red indicator, and the second state includes the traffic signal illuminating a green indicator.
[0053] Technical Solution 17. A method for a vehicle's head-up display (HUD), comprising:
[0054] Receive the time period from when the traffic signal at the road intersection will change from the first state to the second state;
[0055] Based on the time period and the vehicle's current speed, determine the distance in front of the vehicle from where the traffic signal will be when it transitions from the first state to the second state;
[0056] A virtual display visible within the passenger cabin of the vehicle is generated via the vehicle's windshield; and
[0057] The light source is controlled based on the distance to include in the virtual display a visual indicator of the location where the traffic signal will transition from the first state to the second state along the vehicle's path.
[0058] Technical Solution 18. The HUD method according to Technical Solution 17, wherein the control includes controlling the light source such that the visual indicator includes a color corresponding to the second state.
[0059] Technical Solution 19. The HUD method according to Technical Solution 18, wherein the color is one of red, yellow and green.
[0060] Technical Solution 20. The HUD method according to Technical Solution 17 further includes:
[0061] Receive the second time period until the traffic signal at the intersection of the road changes from the second state to the third state;
[0062] Based on the second time period and the vehicle's current speed, determine the second distance in front of the vehicle when the traffic signal transitions from the second state to the third state; and
[0063] The light source is controlled based on the second distance to include in the virtual display a second visual indicator of the second location where the traffic signal will transition from the second state to the third state along the vehicle's path.
[0064] Further applications of this disclosure will become apparent from the detailed description, claims, and drawings. The detailed description and specific examples are intended for illustrative purposes only and are not intended to limit the scope of this disclosure. Attached Figure Description
[0065] This disclosure will be understood more fully from the detailed description and accompanying drawings, in which:
[0066] Figure 1 This is a functional block diagram of an example vehicle system;
[0067] Figure 2 This is a top view of the example vehicle;
[0068] Figure 3 This is an example perspective view of the driver's seat inside the passenger cabin of a vehicle;
[0069] Figure 4 Functional block diagram of an example implementation of a head-up display (HUD) system;
[0070] Figure 5 This is a functional block diagram of an example traffic light control and communication system;
[0071] Figure 6 This is a functional block diagram of an example HUD control system;
[0072] Figures 7 to 12 Includes illustrations of example visual indicators generated using the HUD system; and
[0073] Figure 13 This is a flowchart illustrating an example method of visually displaying, via a HUD system, the location of a vehicle when one or more changes in the state of a traffic signal are about to occur.
[0074] In the accompanying drawings, reference numerals may be used repeatedly to identify similar and / or identical elements. Detailed Implementation
[0075] The vehicle may include a head-up display (HUD) that displays virtual images via the vehicle's windshield. A light source may project the virtual image onto a reflector, and the reflector may reflect the virtual image onto the windshield. Alternatively, the light source may project the virtual image directly onto the windshield. In various embodiments, the HUD system may include two or more light sources to project light onto two or more different vertical planes.
[0076] Traffic signals are used at some intersections to regulate traffic flow through the intersection. When a vehicle is approaching the intersection, the traffic signal may be in one state (e.g., green). However, as the vehicle gets closer to the intersection, the traffic signal may change (e.g., from green to yellow, from yellow to red, or from red to green).
[0077] This application includes a HUD system that projects one or more visual indicators of a vehicle's position on the road when the traffic signal at an intersection changes state once or multiple times. For example, if the traffic signal is currently green, the HUD system can display an indicator of the vehicle's position on the road when the traffic signal changes to yellow. These visual indicators can assist the driver in making appropriate braking, acceleration, and speed adjustments. This can improve vehicle efficiency, reduce vehicle wear, and reduce traffic congestion.
[0078] Now for reference Figure 1A functional block diagram of an example vehicle system is presented. While a vehicle system for hybrid vehicles is shown and described, this application is also applicable to non-hybrid vehicles, electric vehicles, fuel cell vehicles, and other types of vehicles. This application applies to autonomous vehicles, semi-autonomous vehicles, non-autonomous vehicles, shared vehicles, non-shared vehicles, and other types of vehicles.
[0079] Engine 102 can combust an air / fuel mixture to generate drive torque. Engine control module (ECM) 106 controls engine 102. For example, ECM 106 can control the actuation of engine actuators, such as throttle valves, one or more spark plugs, one or more fuel injectors, valve actuators, camshaft phasers, exhaust gas recirculation (EGR) valves, one or more turbochargers, and other suitable engine actuators, based on one or more driver inputs. In some types of vehicles (e.g., electric vehicles), engine 102 can be omitted.
[0080] Engine 102 can output torque to transmission 110. Transmission control module (TCM) 114 controls the operation of transmission 110. For example, TCM 114 can control gear selection within transmission 110 and one or more torque transmission devices (e.g., torque converter, one or more clutches, etc.).
[0081] A vehicle system may include one or more electric motors. For example, such as Figure 1 As shown in the example, electric motor 118 can be implemented within transmission 110. The electric motor can act as either a generator or a motor at a given time. When acting as a generator, the electric motor converts mechanical energy into electrical energy. This electrical energy can be used, for example, to charge battery 126 via power control device (PCD) 130. When acting as a motor, the electric motor generates torque, which can be used, for example, to supplement or replace the torque output by engine 102. While an example of an electric motor is provided, a vehicle may include zero or more electric motors. Alternatively, one or more electric motors can be implemented without transmission 110.
[0082] The power inverter module (PIM) 134 can control the electric motor 118 and the PCD 130, for example, based on one or more driver inputs. Based on signals from the PIM 134, the PCD 130 applies power from the battery 126 to the electric motor 118, and the PCD 130 provides power output from the electric motor 118 to, for example, the battery 126. The PIM 134 may include, for example, an inverter.
[0083] Steering control module 140 controls the steering / turning of the vehicle's wheels, for example, based on the driver's rotation of the steering wheel within the vehicle and / or steering commands from one or more vehicle control modules. A steering wheel angle (SWA) sensor (not shown) monitors the rotational position of the steering wheel and generates SWA 142 based on the steering wheel's position. As an example, steering control module 140 may control vehicle steering via electronic power steering (EPS) motor 144 based on SWA 142. However, the vehicle may include another type of steering system. Electronic brake control module (EBCM) 150 may selectively control (e.g., rub) the vehicle's brakes 154 based on one or more driver inputs such as brake pedal position (BPP) 170.
[0084] Vehicle modules can share parameters via a network 162, such as a Controller Area Network (CAN). CAN can also be called an automotive local area network. For example, network 162 may include one or more data buses. Various parameters can be provided by a given module to other modules via network 162.
[0085] Driver input may include, for example, accelerator pedal position (APP) 166, which may be provided to ECM 106. Propulsion torque generation (e.g., via engine 102 and / or electric motor 118) may be controlled based on driver input. BPP 170 may be provided to EBCM 150. Park, reverse, neutral, and forward lever (PRNDL) positions 174 may be provided to TCM 114. Ignition state 178 may be provided to Body Control Module (BCM) 180. For example, ignition state 178 may be input by the driver via ignition key, button, or switch. At a given time, ignition state 178 may be one of off, assisted, running, or started.
[0086] In various embodiments, wheel speeds 190, each measured by a wheel speed sensor, can be input to the BCM 180. Each wheel speed sensor measures the rotational speed of one of the wheels. A vehicle speed module (e.g., in TCM 114) can determine the vehicle speed (vehicle speed) based on one or more of the wheel speeds 190. By way of example only, the vehicle speed module can be set to a vehicle speed based on or equal to the average of all wheel speeds 190 or the average of the wheel speeds 190 of the vehicle's driven wheels. Driven wheels can be wheels capable of transmitting torque between the ground and one or more torque-generating devices (e.g., engine 102 and / or electric motor 118).
[0087] The infotainment module 183 can output various information via one or more output devices 184. The output devices 184 may include, for example, one or more displays, one or more other suitable types of video output devices, one or more speakers, one or more haptic devices and / or one or more other suitable types of output devices.
[0088] The infotainment module 183 may output video via one or more displays. The infotainment module 183 may output audio via one or more speakers. The infotainment module 183 may output other feedback via one or more haptic devices. For example, haptic devices may be included in one or more seats, one or more seatbelts, a steering wheel, etc. Examples of displays may include one or more displays of the vehicle (e.g., on the front console) and / or one or more other suitable displays.
[0089] The vehicle may include multiple external sensors and cameras, in Figure 1 The central part is generally illustrated by 186. One or more actions can be taken based on input from external sensors and cameras 186. For example, the infotainment module 183 can display video, various views, and / or alarms on the display during driving via input from external sensors and cameras 186.
[0090] As another example, based on input from external sensors and camera 186, perception module 187 perceives objects around the vehicle and their positions relative to the vehicle. ECM 106 can adjust the torque output of engine 102 based on input from perception module 187. Additionally or alternatively, PIM 134 can control the power flow to and / or from electric motor 118 based on input from perception module 187. Additionally or alternatively, EBCM 150 can adjust braking based on input from perception module 187. Additionally or alternatively, steering control module 140 can adjust steering based on input from perception module 187. For example, one or more actions can be taken to avoid perceived objects.
[0091] The communication module 190 communicates wirelessly using one or more wireless communication protocols. The vehicle may include one or more additional control modules, such as a chassis control module, a battery pack control module, etc., which are not shown. One or more of the control modules shown and discussed may be omitted from the vehicle.
[0092] Figure 2 This is a top view of the example vehicle. Figure 3 Includes an example perspective view from the driver's seat of the vehicle. The vehicle includes a windshield 204 located in the front opening of the vehicle. Passengers inside the passenger compartment 208 of the vehicle can see forward through the windshield 204.
[0093] like Figure 3 As shown, the windshield 204 is vertically positioned above the vehicle's dashboard 206. The driver can turn and steer the vehicle from within the passenger cabin 208 by rotating the steering wheel 210, such as changing lanes, merging, and parking. The vehicle can be autonomous, semi-autonomous, or non-autonomous. In various embodiments, the steering wheel 210 may be retractable or omitted.
[0094] Head-up Display (HUD) System 400 (see...) Figure 4 Information 212 (e.g., a virtual image) is projected onto a portion of the windshield 204 through one or more openings (such as opening 216) in the dashboard 206. While an example size of information 212 is provided, information 212 can be presented over a larger or smaller area. Examples of information 212 include various vehicle information such as current vehicle speed, the current gear of the vehicle's transmission, engine speed, vehicle heading, current infotainment system settings, and / or other vehicle information. The HUD system 400 presents information to the vehicle's driver without requiring the driver to take their eyes off objects in front of the vehicle. Another example of information 212 includes a visual indication of the vehicle's position on the road when traffic signals are about to change, as discussed further below.
[0095] Figure 4 An example implementation of the HUD system 400 is included. A light source 404 outputs (projects) light (e.g., light for a virtual image) for display on the windshield 204 based on a signal 412 from the HUD control module 416. By way of example only, the light source 404 may include one or more lasers and output red, green, and blue light. While an example of a light source is provided, the HUD system 400 may include multiple light sources, for example, to project light onto two or more different vertical planes. The HUD control module 416 generates the signal 412 based on vehicle data 420 and traffic signal data 424, as described below.
[0096] HUD control module 416 may obtain vehicle data 420 and traffic signal data 424, for example, from network 162. Vehicle data 420 may include, for example, the vehicle's current speed, the vehicle's target speed, the vehicle's current gear, the current engine speed, the vehicle's current heading, current infotainment system settings, and / or other vehicle information. Traffic signal data 424 may include, for example, one or more time periods until the state (e.g., color) of a traffic signal will change, and / or other traffic signal information.
[0097] Reflector 426 can reflect the output of light source 404 onto windshield 204 through aperture 216. A viewer (e.g., a driver) can view information 212 in the area where it is projected onto windshield 204. In various embodiments, reflector 426 may be omitted, and light source 404 may project information 212 directly onto windshield 204.
[0098] Figure 5 This is a functional block diagram of an example traffic light control and communication system. The signal control module 504 controls the state of the traffic signal 508 at the intersection. The traffic signal 508 regulates traffic flow in one or more directions through the intersection. Figure 5 The document also provides an illustration of an example of traffic signal 508.
[0099] Traffic signal 508 may include a red indicator (e.g., a light) 512, a yellow indicator (e.g., a light) 516, and a green indicator (e.g., a light) 520. Signal control module 504 selectively switches from illuminating the green indicator 520 to illuminating the yellow indicator 516. Signal control module 504 selectively switches from illuminating the yellow indicator 516 to illuminating the red indicator 512. Signal control module 504 selectively switches from illuminating the red indicator 512 to illuminating the green indicator 520. While an example implementation of traffic signal 508 has been provided, this application is also applicable to other configurations of traffic signals that include more, fewer, and different indicators.
[0100] Communication module 524 communicates with signal control module 504. Communication module 524 receives time periods until signal control module 504 changes the state of traffic signal 508 from one indicator to another. For example, communication module 524 may receive a first time period (e.g., relative to the current time) until signal control module 504 next changes from green indicator 520 to yellow indicator 516, a second time period (e.g., relative to the current time) until signal control module 504 next changes from yellow indicator 516 to red indicator 512, and a third time period (e.g., relative to the current time) until signal control module 504 next changes from red indicator 512 to green indicator 520.
[0101] Communication module 524 transmits the first, second, and third time periods to a vehicle, such as the vehicle described above. Communication module 524 may transmit the first, second, and third time periods via a network such as the Internet. Alternatively or additionally, communication module 524 may wirelessly transmit the first, second, and third time periods to the vehicle, such as via vehicle-to-infrastructure (V2I) communication, dedicated short-range communication (DSRC) communication, radio frequency (RF) communication, WiFi (based on IEEE 802.11) communication, Bluetooth (based on IEEE 802.15) communication, or another suitable type of wireless communication. Communication module 524 may wirelessly communicate with the vehicle via one or more antennas, such as antenna 528. In various embodiments, communication module 524 may transmit only some of the first, second, and third time periods shorter than a predetermined time period (e.g., 20 seconds or 30 seconds).
[0102] The vehicle includes a communication module 190 that can receive first, second, and third time periods wirelessly or via a network. The communication module 190 can wirelessly receive data via one or more antennas, such as antenna 532. The communication module 190 provides the received time periods in the first, second, and third time periods to a HUD control module 416. The HUD control module 416 visually indicates the vehicle's position on the road when a change in traffic signal 508 is about to occur.
[0103] Figure 6 This is a functional block diagram of an example HUD control system. As described above, the communication module 190 provides reception periods in the first, second, and third time periods. The first, second, and third time periods can be collectively referred to as the change period 604.
[0104] Distance module 608 determines one or more variable distances 612 based on the change period 604 and the (current) vehicle speed 616. The vehicle speed 616 can be determined based on one or more wheel speeds 190, as described above. For example, vehicle speed module 620 can set a vehicle speed 616 based on or equal to the average of two or more wheel speeds 190 (such as the wheel speeds 190 of the vehicle's driven wheels). Distance module 608 can set each variable distance using one of an equation and a lookup table that associates the change period and vehicle speed with the variable distance.
[0105] For example, distance module 608 can be set to a changing distance based on or equal to vehicle speed 616 multiplied by a corresponding changing time period. As an example, distance module 608 can be set to a first changing distance based on or equal to vehicle speed 616 multiplied by a first time period, a second changing distance based on or equal to vehicle speed 616 multiplied by a second time period, and a third changing distance based on or equal to vehicle speed 616 multiplied by a third time period. The first changing distance corresponds to the distance at which signal control module 504 will next change from illuminating a green indicator 520 to illuminating a yellow indicator 516 (e.g., in front of the vehicle). The second changing distance corresponds to the distance at which signal control module 504 will next change from illuminating a yellow indicator 516 to illuminating a red indicator 512 (e.g., in front of the vehicle). The third changing distance corresponds to the distance at which signal control module 504 will next change from illuminating a red indicator 512 to illuminating a green indicator 520 (e.g., in front of the vehicle). Therefore, each of the varying distances 612 indicates the distance of the vehicle's current position on the road when the state of traffic signal 508 changes (e.g., in front of the vehicle relative to its current position).
[0106] The display control module 624 controls the light source 404 (or light source) to control the displayed information 212. More specifically, the display control module 624 controls the light source 404 to display one or more visual indicators via the HUD system 400, which visually indicate the changing distance 612 on the road ahead of the vehicle. The display control module 624 may display visual indicators between, above, or defining the boundaries 628 of the current lane in which the vehicle is located. The perception module 187 may use images from external sensors and one or more cameras (such as one or more forward-facing cameras) of camera 186 to identify the boundaries 628.
[0107] Figure 7 This includes an example illustration of a traffic signal 508 where the green indicator 520 is currently illuminated as a vehicle approaches the intersection. In this example, the display control module 624 displays a first visual indicator 704 at a first changing distance in front of the vehicle, where the signal control module 504 then transitions from illuminating the green indicator 520 to illuminating the yellow indicator 516. The display control module 624 can display the first visual indicator 704 in yellow to indicate the vehicle's position when the transition to illuminating the yellow indicator 516 occurs.
[0108] The display control module 624 can also display a second visual indicator 708 at a second changing distance in front of the vehicle, where the signal control module 504 will then switch from illuminating a yellow indicator 516 to illuminating a red indicator 512. The display control module 624 can display the second visual indicator 708 in red to indicate the position the vehicle will be at when the switch to illuminating the red indicator 512 occurs.
[0109] Although Figure 7 Not shown in the example, but the display control module 624 can also simultaneously display a third visual indicator at a third changing distance in front of the vehicle, where the signal control module 504 will then switch from illuminating the red indicator 512 to illuminating the green indicator 520. The display control module 624 can display the third visual indicator in green to indicate the position the vehicle will be at when the switch to illuminating the green indicator 520 occurs.
[0110] Figure 8 This includes an example illustration of a traffic signal 508 where the red indicator 512 is currently illuminated when a vehicle approaches the intersection. In this example, the display control module 624 displays a third visual indicator 804 at a third changing distance in front of the vehicle, where the signal control module 504 then transitions from illuminating the red indicator 512 to illuminating the green indicator 520. The display control module 624 can display the third visual indicator 804 in green to indicate the vehicle's position when the transition to the green indicator 520 occurs. Although in Figure 8 The example is not shown, but the display control module 624 can also display the first and second indicators simultaneously.
[0111] like Figure 7 and Figure 8 As shown, the display control module 624 can display the first, second, and third visual indicators as horizontal bars. However, the display control module 624 can also display the first, second, and third visual indicators in another suitable manner. For example, the display control module 624 can display the first, second, and third visual indicators as planes extending horizontally and vertically at first, second, and third varying distances, respectively. Figure 10 Show Figure 7 In the example, the first visual indicator 704 and the second visual indicator 708 are displayed as planes extending horizontally and vertically.
[0112] As another example, the display control module 624 can display the first, second, and third visual indicators as walls extending vertically along or beside the boundary of the vehicle's current lane. These walls can be positioned on either side of the current lane and can extend in depth to where the next transition in the traffic signal 508's indicators will occur. For example, Figure 11 Show Figure 7 In the example, the first visual indicator 704 and the second visual indicator 708 are displayed as a wall.
[0113] In this example, the nearest (depth) vertical edge 1004 of the wall of the first visual indicator 704 can be located at a first variation distance. The farthest (depth) vertical edge 1008 of the wall of the first visual indicator 704 can be located at a second variation distance. Thus, the wall of the first visual indicator 704 extends from the first variation distance to the second variation distance in front of the vehicle.
[0114] The nearest (depth) vertical edge 1012 of the wall of the second visual indicator 708 can be located at a second variation distance and adjacent to the farthest vertical edge of the wall of the first visual indicator 704. The farthest (depth) vertical edge 1016 of the wall of the second visual indicator 708 can be located at an intersection or a third variation distance, whichever is closer. Thus, the wall of the second visual indicator 708 extends from the second variation distance to the third variation distance or the intersection in front of the vehicle.
[0115] As another example, the display control module 624 can display first, second, and third visual indicators as doors extending horizontally between the boundaries of the vehicle's current lane and vertically on or beside the boundaries of the vehicle's current lane. The doors can be positioned on either side of the current lane. For example, Figure 10 Show Figure 7 In the example, the first visual indicator 704 and the second visual indicator 708 are displayed as a wall.
[0116] As another example, the display control module 624 can display the first, second, and third visual indicators as a carpet on the road, extending horizontally toward the boundary of the current lane and vertically toward the intersection within the boundary of the vehicle's current lane. The carpet can extend vertically to where the next transition in the traffic signal 508's indicators will occur. For example, Figure 12 Show Figure 7 An example is shown where the first visual indicator 704 and the second visual indicator 708 are displayed as carpet on the road.
[0117] In this example, the nearest (depth) horizontal edge 1204 of the carpet of the first visual indicator 704 can be located at a first variation distance. The farthest (depth) horizontal edge 1208 of the carpet of the first visual indicator 704 can be located at a second variation distance. Thus, the carpet of the first visual indicator 704 extends from the first variation distance to the second variation distance in front of the vehicle.
[0118] The nearest (depth) horizontal edge 1212 of the wall of the second visual indicator 708 can be located at a second variation distance and adjacent to the farthest horizontal edge of the carpet of the first visual indicator 704. The farthest (depth) horizontal edge 1216 of the carpet of the second visual indicator 708 can be located at an intersection or a third variation distance, whichever is closer. Thus, the carpet of the second visual indicator 708 extends from the second variation distance to the third variation distance or the intersection in front of the vehicle.
[0119] Re-reference Figure 6 In various embodiments, the display control module 624 can adjust the positions of the first, second, and / or third visual indicators based on the driver's current eye position (e.g., line of sight) 636. For example, when the driver's eye position 636 moves vertically upward, the display control module 624 can move the visual indicators vertically upward, and vice versa. Additionally or alternatively, when the driver's eye position 636 moves horizontally to the left, the display control module 624 can display the visual indicators horizontally to the left, and vice versa.
[0120] The eye position module 640 can track the driver's eye position (e.g., pupil position) and determine eye position 636 based on the driver's eye position. The eye position module 640 can track the position of the driver's eyes (e.g., using a camera facing the driver's seat and configured to capture images including the driver's eyes).
[0121] In various implementations, the disable module 644 can selectively enable and disable the display of visual indicators based on the driver's gaze 648. For example, the disable module 644 can disable the display of visual indicators when the gaze 648 is off the road for at least a predetermined period of time (e.g., during autonomous or semi-autonomous driving). This prevents the visual indicators from distracting the driver. When the gaze 648 is directed toward the road ahead of the vehicle, the disable module 644 can enable the display of visual indicators. For example, the disable module 644 can disable the distance module 608 to disable the display of visual indicators. Alternatively, the disable module 644 can disable the display control module 624. The gaze module (e.g., of the eye position module 640) can determine the gaze 648 based, for example, using a camera facing the driver's seat and configured to capture images including the driver's face.
[0122] Figure 13 This is a flowchart illustrating an example method of visually displaying, via HUD system 400, the location of a vehicle when one or more changes in the state of traffic signal 508 are about to occur.
[0123] Control begins at 1304, where the vehicle's communication module 190 receives one or more change periods 604 of the traffic signal 508. Each of the change periods 604 corresponds to the period until the signal control module 504 will transition the traffic signal 508 from one state to the next. At 1308, the vehicle speed module 620 determines the (current) vehicle speed 616.
[0124] At 1312, distance module 608 determines one or more variable distances 612 based on one or more change periods 604 and vehicle speed 616, respectively. For example, distance module 608 may set a variable distance based on or equal to the corresponding change period multiplied by vehicle speed 616. Each of the variable distances 612 corresponds to the distance in front of the vehicle when signal control module 504 will transition traffic signal 508 from one state to the next.
[0125] At 1316, the display control module 624 displays one or more visual indicators with varying distances 612 via the HUD system 400. As discussed above, the visual indicators can be, for example, horizontal bars, horizontally and vertically extending planes, vertically and deeply extending walls, horizontally and vertically extending doors, or horizontally and deeply extending carpets. While these examples of visual indicators have been provided, this application is also applicable to other types of visual indicators. Control then returns to 1304, causing the visual indicators to update as the vehicle moves and as the vehicle speed 616 changes.
[0126] The preceding description is illustrative in nature and is in no way intended to limit this disclosure, its application, or use. The broad teachings of this disclosure can be implemented in many forms. Therefore, while this disclosure includes specific examples, its true scope should not be so limited, as other modifications will become apparent upon examination of the drawings, specification, and appended claims. It should be understood that one or more steps in the method may be performed in a different order (or simultaneously) without altering the principles of this disclosure. Furthermore, although each embodiment is described above as having certain features, any one or more of those features described with respect to any embodiment of this disclosure may be implemented in any other embodiment and / or combined with features of any other embodiment, even if such combination is not explicitly described. In other words, the described embodiments are not mutually exclusive, and the arrangement of one or more embodiments with respect to each other remains within the scope of this disclosure.
[0127] Spatial and functional relationships between components (e.g., between modules, circuit elements, semiconductor layers, etc.) are described using various terms, including “connected,” “joined,” “linked,” “adjacent,” “right next to,” “on top of,” “above,” “below,” and “set on.” Unless explicitly described as “direct,” when describing the relationship between the first and second components in the foregoing disclosure, the relationship can be a direct relationship in which no other intermediate components exist between the first and second components, or an indirect relationship (spatially or functionally) in which one or more intermediate components exist between the first and second components. As used herein, the phrase “at least one of A, B, and C” should be interpreted as using the non-exclusive logic “OR” to represent logic (A or B or C) and should not be interpreted as representing “at least one of A, at least one of B, and at least one of C.”
[0128] In the accompanying drawings, the direction of the arrows typically indicates the flow of information of interest (such as data or instructions). For example, when components A and B exchange various types of information, but the information transmitted from component A to component B is relevant to the illustration, the arrow may point from component A to component B. This unidirectional arrow does not imply that no other information is transmitted from component B to component A. Furthermore, for information transmitted from component A to component B, component B may send a request for the information to component A or receive an acknowledgment.
[0129] In this application, including the following definitions, the term "module" or "controller" may be replaced by the term "circuit". The term "module" may refer to, be a part of, or include: application-specific integrated circuit (ASIC); digital, analog, or mixed-signal analog / digital discrete circuit; digital, analog, or mixed-signal analog / digital integrated circuit; combinational logic circuit; field-programmable gate array (FPGA); processor circuitry (shared, dedicated, or grouped) that executes code; memory circuitry (shared, dedicated, or grouped) that stores code executed by the processor circuitry; other suitable hardware components that provide the described functionality; or some or all of the foregoing, such as in a system-on-a-chip.
[0130] A module may include one or more interface circuits. In some examples, the interface circuits may include wired or wireless interfaces that connect to a local area network (LAN), the Internet, a wide area network (WAN), or a combination thereof. The functionality of any given module disclosed herein may be distributed across multiple modules connected via the interface circuits. For example, multiple modules may allow for load balancing. In another example, a server (also referred to as a remote or cloud) module may perform some functions on behalf of a client module.
[0131] As used above, the term "code" can include software, firmware, and / or microcode, and can refer to programs, routines, functions, classes, data structures, and / or objects. The term "shared processor circuitry" covers a single processor circuitry that executes some or all of the code from multiple modules. The term "group processor circuitry" covers a processor circuitry that, in conjunction with additional processor circuitry, executes some or all of the code from one or more modules. References to multiple processor circuitry cover multiple processor circuitry on a discrete die, multiple processor circuitry on a single die, multiple cores of a single processor circuitry, multiple threads of a single processor circuitry, or a combination thereof. The term "shared memory circuitry" covers a single memory circuitry that stores some or all of the code from multiple modules. The term "group processor circuitry" covers a memory circuitry that, in conjunction with additional memory, stores some or all of the code from one or more modules.
[0132] The term "memory circuit" is a subset of the term "computer-readable medium." As used herein, the term "computer-readable medium" does not cover transient electrical or electromagnetic signals propagated through a medium (such as a carrier wave); therefore, the term "computer-readable medium" can be considered tangible and non-transient. Non-limiting examples of non-transient tangible computer-readable media are non-volatile memory circuits (such as flash memory circuits, erasable programmable read-only memory circuits, or mask read-only memory circuits), volatile memory circuits (such as static random access memory circuits or dynamic random access memory circuits), magnetic storage media (such as analog or digital magnetic tape or hard disk drives), and optical storage media (such as CDs, DVDs, or Blu-ray discs).
[0133] The apparatus and methods described in this application can be implemented, in part or in whole, by a special-purpose computer created by configuring a general-purpose computer to perform one or more specific functions embodied in a computer program. The function blocks, flowchart components, and other elements described above serve as software specifications that can be translated into computer programs through the routine work of a skilled technician or programmer.
[0134] A computer program includes processor-executable instructions stored on at least one non-transitory, tangible, computer-readable medium. A computer program may also include or depend on stored data. A computer program may encompass a basic input / output system (BIOS) that interacts with the hardware of a special-purpose computer, device drivers that interact with specific devices of the special-purpose computer, one or more operating systems, user applications, background services, background applications, etc.
[0135] Computer programs may include: (i) descriptive text to be parsed, such as HTML (Hypertext Markup Language), XML (Extensible Markup Language), or JSON (JS Object Notation), (ii) assembly code, (iii) object code generated from source code by a compiler, (iv) source code executed by an interpreter, (v) source code compiled and executed by a just-in-time (JIT) compiler, and so on. As an example only, source code may be written using the syntax of languages including: C, C++, C#, Objective-C, Swift, Haskell, Go, SQL, R, Lisp, Java®, Fortran, Perl, Pascal, Curl, OCaml, Javascript®, HTML5 (Hypertext Markup Language version 5), Ada, ASP (Active Server Pages), PHP (PHP: Hypertext Preprocessor), Scala, Eiffel, Smalltalk, Erlang, Ruby, Flash®, Visual Basic®, Lua, MATLAB, SIMULINK, and Python®.
Claims
1. A head-up display (HUD) system for a vehicle, comprising: a communication module configured to communicate with the signal control module and receive a period until a traffic signal at an intersection of roads will change from a first state to a second state; a distance module configured to determine, based on the time period and a current speed of the vehicle, a distance ahead of the vehicle at which the vehicle will be located when the traffic signal transitions from the first state to the second state; a light source configured to generate a virtual display visible within a passenger cabin of the vehicle via a windshield of the vehicle; as well as a display control module configured to control the light source based on the distance to include in the virtual display a visual indicator of a location in a path of the vehicle at which the traffic signal will transition from the first state to the second state; The first state includes the traffic signal lighting a red indicator, and the second state includes the traffic signal lighting a green indicator.
2. The HUD system according to claim 1, wherein: The display control module is configured to control the light source such that the visual indicator comprises a color corresponding to the second state.
3. The HUD system according to claim 2, wherein: The color is one of red, yellow and green.
4. The HUD system of claim 1, wherein: The communication module is further configured to receive a second period of time until the traffic signal at the intersection of roads will change from the second state to a third state; The distance module is further configured to determine a second distance ahead of the vehicle at which the vehicle will be located when the traffic signal transitions from the second state to the third state based on the second time period and the current speed of the vehicle; and The display control module is further configured to control the light source based on the second distance to include in the virtual display a second visual indicator of a second location in the path of the vehicle where the traffic signal will transition from the second state to the third state.
5. The HUD system according to claim 4, wherein: The display control module is configured to control the light source such that the visual indicator includes a first color corresponding to the second state and the second visual indicator includes a second color corresponding to the third state.
6. The HUD system according to claim 1, wherein: The visual indicator extends horizontally at the location toward a boundary of a current lane of the vehicle.
7. The HUD system according to claim 1, wherein: The visual indicator extends horizontally and vertically at the location.
8. The HUD system according to claim 1, wherein: The visual indicator extends depthwise toward the intersection.
9. The HUD system according to claim 1, wherein: The visual indicator extends vertically and depthwise.
10. The HUD system according to claim 1, wherein: The communication module is configured to wirelessly receive the time period from a signal control module configured to control the traffic signal.
11. The HUD system according to claim 1, wherein: The communication module is configured to receive the time period via the Internet from a signal control module configured to control the traffic signal.
12. The HUD system according to claim 1, further comprising: A disabling module is configured to selectively disable the display of the visual indicator when a driver's gaze is not directed toward a road ahead of the vehicle.
13. The HUD system of claim 1 , further comprising: an eye position module configured to determine a position of an eye of a driver of the vehicle, Wherein the display control module is configured to adjust a position of the visual indicator in the virtual display based on the position of the eyes of the driver.
14. A head-up display (HUD) method for a vehicle, using the head-up display (HUD) system for a vehicle according to any one of claims 1 to 13, comprising: receiving a time period until a traffic signal at an intersection of roads will change from a first state to a second state; determining a distance ahead of the vehicle at which the vehicle will be located when the traffic signal transitions from the first state to the second state based on the time period and the current speed of the vehicle; generating a virtual display visible within a passenger cabin of the vehicle via a windshield of the vehicle; as well as The light source is controlled based on the distance to include in the virtual display a visual indicator of a location in the path of the vehicle at which the traffic signal will transition from the first state to the second state.
15. The HUD method according to claim 14, wherein: The controlling includes controlling the light source such that the visual indicator includes a color corresponding to the second state.
16. The HUD method according to claim 15, wherein: The color is one of red, yellow and green.
17. The HUD method according to claim 14, further comprising: receiving a second period until when the traffic signal at the intersection of roads will change from the second state to a third state; determining a second distance ahead of the vehicle at which the vehicle will be located when the traffic signal transitions from the second state to the third state based on the second time period and the current speed of the vehicle; and The light source is controlled based on the second distance to include in the virtual display a second visual indicator of a second location in the path of the vehicle at which the traffic signal will transition from the second state to the third state.
