METHOD FOR PROJECTING AT LEAST ONE LIGHT PATTERN INTO A VEHICLE ENVIRONMENT AND VEHICLE WITH AT LEAST ONE PROJECTOR
Patent Information
- Application Number
- DE502022006402
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2021-07-12
- Filing Date
- 2022-06-08
- Publication Date
- 2025-12-24
- Estimated Expiration
- 2042-06-08
AI Technical Summary
Existing navigation systems fail to provide reliable and efficient guidance to a destination after parking, requiring drivers to manually re-enter navigation instructions on their smartphones, which is time-consuming and inconvenient, especially in challenging parking scenarios.
A method using a projector integrated into a vehicle's exterior mirror to project a light pattern aligned with the surroundings, considering the door opening angle, which includes navigation cues such as maps or arrows, animated elements, and text, ensuring accurate orientation and intuitive route guidance post-parking.
Enables drivers to reach their destination quickly and easily without using smartphones, by providing aligned and animated navigation cues that adapt to the vehicle's surroundings, ensuring reliable route selection even when parked away from the destination.
Description
[0001] The invention relates to a method for projecting at least one light pattern into a vehicle environment with at least one projector encompassed by a vehicle according to the type defined in more detail in the preamble of claim 1, and to a vehicle according to the type defined in more detail in the preamble of claim 6.
[0002] Modern navigation systems allow people to find their way around comfortably and easily. Using route guidance, a person can reliably reach an unfamiliar location by car without having to manually plan a route, for example, using a map. Furthermore, the person doesn't need to memorize the route. These navigation systems can be permanently integrated into a vehicle or used as a mobile device.
[0003] Often, a car journey doesn't end in the immediate vicinity of the destination, but rather some distance away. One possible reason is a lack of available parking spaces near the destination. Therefore, a driver, especially in cities with limited parking, must either find an available parking space before reaching the destination or drive past it and look for a parking space beyond it.
[0004] Once the driver has found a suitable parking space and exits the vehicle to walk to their destination, they must reorient themselves to find their way from where they parked. The longer they had to search for a parking space and the further it was from their actual destination, the more complicated it becomes to navigate the subsequent walking route.
[0005] Especially when using a vehicle-integrated navigation system, navigation instructions are no longer available after leaving the vehicle, making it difficult to find the fastest route to the destination. The driver can then use their smartphone to continue navigation. However, the driver then has to re-enter the destination into the smartphone, which is time-consuming. If the driver is in a time-critical situation, such as on the way to an appointment, this results in a loss of valuable time.
[0006] Methods and devices for projecting light patterns into a vehicle's surroundings are known from the general state of the art. For example, DE 10 2018 120 330 A1 discloses a method for image projection in vehicles. In this method, a vehicle equipped with appropriate projectors projects symbols into its surroundings, depending on the vehicle's trajectory. Such a symbol can, for example, indicate whether the vehicle is being controlled autonomously or manually. The symbol can also include environmental features such as a current signal from a traffic light system, for example, to indicate to a person looking down at their smartphone that the light is red and that the vehicle projecting the light pattern is turning in front of them. The symbols projected into the surroundings by the vehicle are oriented according to the target objects for which they apply.
[0007] Furthermore, an assistance system for a vehicle is known from DE 10 2018 000 275 A1. This assistance system enables the vehicle's headlights to be controlled to illuminate a navigation destination, thus making it easier for the driver to locate the object on their route. This eliminates the need for the driver to, for example, check the house numbers of different buildings to find their destination. However, illuminating the navigation destination requires that the vehicle be within sight of the destination.
[0008] Furthermore, DE 10 2017 210 801 A1 discloses a projection orientation correction system for a vehicle using a projection device. The vehicle can use the projection device to project an image of a route from the vehicle's location to a pre-programmed destination into its surroundings. The image is specifically aligned with the surroundings.
[0009] The projection of navigation instructions into the surroundings by a vehicle is also disclosed in US 2021 / 140781 A1, CN 110 260 878 A and DE 10 2013 012 891 A1. DE 10 2013 012 891 A1 shows the use of a projector installed in a side mirror of the vehicle.
[0010] Furthermore, US 2008 / 198372 A1 discloses the projection of light patterns into the surroundings of a vehicle using a headlight of the vehicle.
[0011] The present invention is based on the objective of providing an improved method for projecting at least one light pattern into a vehicle environment with at least one projector encompassed by a vehicle, with the aid of which a vehicle driver is guided to a navigation destination in a particularly reliable and comfortable manner after parking their vehicle.
[0012] According to the invention, this problem is solved by a method for projecting at least one light pattern into a vehicle environment, comprising at least one projector encompassed by a vehicle and having the features of claim 1, and a vehicle having the features of claim 6. Advantageous embodiments and further developments are described in the dependent claims.
[0013] In a method for projecting at least one light pattern into a vehicle's surroundings using at least one projector encompassed by a vehicle, the light pattern includes a navigation cue for continuing navigation in the form of a route to be selected to reach a navigation destination, in order to guide a driver in the direction of the navigation destination after the vehicle has been parked. The light pattern is specifically aligned with the vehicle's surroundings so that it is projected with a defined orientation. According to the invention, when using at least one projector integrated into an exterior mirror for projecting the light pattern, the opening angle of a vehicle door to which the exterior mirror is connected is taken into account when specifically aligning the light pattern with the vehicle's surroundings.
[0014] The inventive method enables a person to reliably reach the navigation destination, determined during vehicle use, even after parking the vehicle, with exceptional ease. Thanks to the navigation instructions, the person can quickly and easily select the most suitable route to reach the destination on foot. "Suitable" in this context means that the walking route is, for example, particularly short and / or can be covered very quickly. It is irrelevant whether the vehicle is within sight of the destination. This ensures reliable route finding for the person, even if they park their vehicle before reaching the destination, within sight of the destination, or even after passing it.Furthermore, the person no longer needs to use their smartphone or similar mobile device to find their way, thus saving time.
[0015] By precisely aligning the light pattern with the vehicle's surroundings, orientation for the occupant is improved. For example, with a light pattern in the form of a map, the map can be oriented so that its cardinal directions correspond to the actual cardinal directions. This ensures that the elements depicted on the map, such as roads, also correspond to a realistic orientation.
[0016] If the door opening angle were disregarded, the orientation of the light pattern relative to the surroundings would change when the vehicle door opened and closed. This would make it difficult for the person to intuitively determine the path to take. However, by compensating for the door opening angle, the light pattern is projected into the vehicle's surroundings according to the defined orientation, regardless of whether the door is open, closed, or moving.
[0017] A further advantageous development of the method involves projecting text, at least one symbol, and / or at least one map into the vehicle's surroundings along with the light pattern. Using text, symbols, and / or a map, the route to reach the navigation destination can be grasped particularly intuitively and thus easily understood by the user. For example, textual instructions can be displayed, such as directions like "left," "straight ahead," "around the corner," distance information like "in 100 meters," or similar, or instructions like "start," "destination," "cross the intersection," street names, house numbers, or the like.
[0018] The symbol can be a directional symbol such as an arrow, or a pictogram, for example in the form of a house, a factory, a road, a finish marker, a start marker, a finish flag or the like.
[0019] A map projected onto the vehicle's surroundings is particularly advantageous. Using a map, the person can quickly grasp the route needed to reach their destination. The map can be as abstract as desired. It can be detailed, including all relevant streets, buildings with street names and house numbers, or it can simply show the route the person needs to take. Ideally, the map should be limited to the smallest possible area, with the (parked) vehicle and the destination located at its edges. This avoids displaying irrelevant information, making it easier for the person to intuitively determine the route.
[0020] According to a further advantageous embodiment of the method, the light pattern is projected onto a surface. Projecting the light pattern onto a surface such as the ground on which the vehicle is parked ensures that the light pattern can be projected into the vehicle's surroundings in various situations. Even if no vertical projection surfaces such as building walls are available, and / or the vehicle is parked in a parking space with other vehicles directly in front of and behind it, an undisturbed projection of the light pattern onto the surface is still possible. The surface can have any type of structure. For example, it could be asphalt, curbs, gravel, or the like. Furthermore, the person also moves across the surface, which makes it particularly easy for them to, for example, visualize a map within a light pattern.
[0021] A further advantageous embodiment of the method provides that at least part of a light pattern is animated. For example, individual light pattern segments, such as text elements, individual symbols, and / or map sections, can blink, move, or change any dynamics, such as brightness, contrast, and / or color. Individual parts of the light pattern can also change their size. For example, a map of the immediate surroundings of the vehicle can be projected onto the vehicle's environment, the route from the person to the navigation destination can be highlighted more brightly, and a particularly bright and / or flashing arrow can move along this route. Potential hazards can also be highlighted, such as a point where the person has to cross a road, for example, at a traffic light or pedestrian crossing. In this case, a corresponding area of the map can, for example, flash red.
[0022] With the help of projectors integrated into the vehicle's side mirrors, a perceptible light pattern can be projected into the vehicle's surroundings, even in challenging parking situations. The projectors can be integrated at any point within a suitable side mirror. For example, they can be integrated into the underside of a side mirror and directed towards the ground.
[0023] Various technologies can be used to project the light pattern. For example, the vehicle headlights and / or projectors can include lasers or other light sources such as LEDs, fluorescent tubes, halogen lamps, or the like. Besides at least one light source, a suitable projector typically includes other components such as mirrors, lenses, filters, actuators, and the like.
[0024] Preferably, the door opening angle is detected using an angle sensor and / or by evaluating camera images generated by a camera integrated into the exterior mirror. Various technologies can be used to implement the angle sensor, such as magnets and / or potentiometers. A suitable angle sensor can be connected to the door at any point between the vehicle and the door. However, using cameras eliminates the need for moving parts or sensors, enabling reliable detection of the door opening angle. For example, angle sensors using a potentiometer can wear out over their lifespan, leading to inaccurate angle detection. This can be avoided by using cameras to detect the door opening angle.Images generated by appropriate cameras can be evaluated on any computing unit in the vehicle.
[0025] According to the invention, in a vehicle equipped with at least one projector, a navigation system, and a processing unit, the projector, navigation system, and processing unit are configured to carry out the method described above. The vehicle can be any type of vehicle, such as a car, truck, van, bus, or the like. The navigation system calculates a route that a person drives in the vehicle to reach a navigation destination from a starting point. If the person then parks their vehicle at a certain distance from the actual navigation destination, they are able, with the aid of the inventive method and vehicle, to quickly, easily, and intuitively reach the navigation destination on foot.
[0026] The navigation system detects the location where the vehicle is parked and, using navigation instructions projected onto the vehicle's surroundings, shows the person the remaining walking distance to reach their destination. The navigation system can be a permanently integrated system or a mobile device such as a smartphone or a portable navigation device, often referred to as a "GPS." A global satellite navigation system such as GPS, BeiDou, Galileo, or similar can be used to determine the vehicle's or navigation system's geolocation. The processing unit can be integrated into the navigation system, the projector, or the vehicle itself. For example, the processing unit could be a central on-board computer, a telematics unit, or another control unit of a vehicle subsystem.Control commands for controlling at least one projector are generated using the computing unit or a separate computing unit.
[0027] Further advantageous embodiments of the method and the vehicle according to the invention also result from the exemplary embodiments, which are described in more detail below with reference to the figures.
[0028] This shows: Fig. 1 a top view of a parked vehicle according to the invention, which projects a navigation instruction into the vehicle's surroundings for navigation continuation; Fig. 2 a detail view of a simple navigation instruction; and Fig. 3 a detail view of a complex navigation instruction.
[0029] Figure 1Figure 1 shows a top view of a vehicle 2 according to the invention, which has been parked in a free parking space 11. This parking space 11 is located in a city. Specifically, the parking space 11 is situated on a sidewalk 12 between a street 13 and a building wall 14.
[0030] A driver of vehicle 2 travels with vehicle 2 from a starting point to a navigation destination 4, which is symbolically represented in Figure 2 and 3The map shows that there is no free parking space available in the immediate vicinity of navigation destination 4, so the driver has parked their vehicle 2 in the available parking space 11. To reach navigation destination 4, the driver must now cover the remaining distance on foot. The further away the available parking space 11 is from navigation destination 4, and the more winding the city, the more difficult it is for the driver to find their way. Furthermore, after parking vehicle 2 in the available parking space 11, they must first orient themselves to determine the direction in which navigation destination 4 is located.
[0031] To make it easier for the person to reach the navigation destination 4 after parking the vehicle 2, the vehicle 2 according to the invention comprises at least one projector 3 for projecting navigation instructions into the vehicle's surroundings, as well as a navigation device 9 for route finding and a computing unit 10 for evaluating sensor signals, calculating routes and / or controlling the at least one projector 3. The computing unit 10 can also be integrated into the navigation device 9.
[0032] A projector 3 is integrated into an exterior mirror 7 of the vehicle 2 or, according to an embodiment not covered by the scope of the invention, can be formed by a headlight 3.1 of the vehicle 2. With the aid of such a projector, a light pattern 1 is projected into the vehicle's surroundings, the light pattern 1 comprising the navigation instruction for continuing the navigation. The navigation instruction itself comprises a route to be selected by the person to reach the navigation destination 4.
[0033] Light pattern 1 can be projected onto a surface in front of, beside, and / or behind the vehicle. It is also generally possible for light pattern 1 to be projected onto vertical surfaces such as the house wall 14. In the example in Figure 1Vehicle 2 projects the light pattern 1 in front of it using only its right headlight 3.1. However, it is also generally possible for both headlights 3.1 to be used to project the light pattern 1. This allows for the creation of a particularly large light pattern 1. If, however, another vehicle (not shown here) is parked in front of vehicle 2, a perceptible light pattern 1 cannot be projected into the surroundings. However, with the help of a projector 3 integrated into an exterior mirror 7, the perceptibility of the light pattern 1 to the person can be ensured even in such a situation. Figure 1 A light pattern 1 is generated using only a projector 3 integrated into the right exterior mirror 7 of the vehicle 2. Generally, such a light pattern 1 can also be generated using a projector 3 integrated into the left exterior mirror 7. In the example in Figure 1However, this would be projected onto Street 13, requiring the person to stand in the area of Street 13 to view the corresponding light pattern 1 (not shown). This would interfere with traffic or even put them at risk of being involved in an accident. Therefore, projecting the light pattern 1 towards the sidewalk 12 or the building wall 14 is preferable. Generally, the vehicle 2 can also have projectors 3 in other locations. For example, a projector 3 can also be integrated into a bumper, a door, a tailgate, or the like.
[0034] With the aid of light pattern 1, or rather the navigation cue encompassed by light pattern 1, the person is directed towards the navigation destination 4, which was originally to be reached by vehicle 2. This allows the person to easily and quickly grasp the direction in which navigation destination 4 lies and to move towards it on foot.
[0035] Figure 2Figure 1 shows a detailed view of a light pattern 1. A section of the vehicle 2 with a corresponding exterior mirror 7 is depicted. The projector 3 is integrated into the underside of the exterior mirror 7. In addition to the projector 3, the exterior mirror 7 also includes a camera 8. The camera 8 captures a surface and a section of the vehicle 2. By analyzing the orientation of the vehicle 2 and the surface in the camera images generated by the camera 8, it is possible to determine the opening angle of a vehicle door encompassing the exterior mirror 7. This information is used to adjust the orientation of the light pattern 1 relative to the vehicle's surroundings. This ensures that the light pattern 1 is always projected into the environment in such a way that the navigation message encompassed by the light pattern 1 actually points towards the navigation destination 4.
[0036] In Figure 2 Light pattern 1 includes a symbol 5 in the form of an arrow. The arrow points in the direction of navigation destination 4, allowing the person to quickly and easily perceive the direction in which they need to move to reach navigation destination 4. Navigation destination 4 is located in the Figure 2 and 3 symbolized by a finish line flag.
[0037] According to an advantageous embodiment of the method according to the invention, the light pattern 1, or a part of the light pattern 1, can also be animated. For example, the light pattern shown in Figure 2The arrow shown can also move in the direction of navigation destination 4. This is symbolized by an arrow with a solid line and an arrow with a dashed line. The arrow with the solid line can thus move to the position of the arrow with the dashed line. Animations help the user understand even more quickly and intuitively in which direction they need to move to reach navigation destination 4.
[0038] However, if the person does not simply park their vehicle 2 "down the street" but has to drive into one or more cross streets to find a free parking space 11, then a navigation instruction in the form of a simple arrow is no longer sufficient to tell the person how to reach the navigation destination 4 on foot.
[0039] With the help of a Figure 3However, even in complex parking situations, the person shown in Kate 6 can be given a hint on how to reach navigation destination 4. This is shown in Figure 3 The map shown (6) depicts only a relatively small section of the map, which is nevertheless sufficient for the person to understand which route (15) they must take to reach the navigation destination (4). Map 6 can be arbitrarily abstracted. For example, map 6 can only include streets (13), the vehicle (2), and the navigation destination (4). Street names can also be displayed as text.
[0040] Map 6 can also include additional information, such as the fact that route 15 crosses road 13 at two points. This is symbolized by two hatched areas 16. These hatched areas 16 could, for example, represent the area of a traffic light or a pedestrian crossing. The light pattern 1 can also display animations. For instance, the hatched areas 16 could flash and / or the individual lines that make up route 15 could move in the direction of the navigation destination 4.
[0041] Information can also be displayed showing how far the navigation destination 4 is currently from vehicle 2. This information can include a time estimate, such as "3 minutes on foot," and / or a distance, such as "500 meters." If the person is in a hurry, this allows them to estimate whether they can still make an appointment on time or if they will be late.
[0042] To further improve user comfort, points of interest (POIs) can also be marked on map 6. For example, if there is a café on route 15 to navigation destination 4, the user can buy a coffee there.
[0043] When initially programming the navigation route into the vehicle's navigation system 9, the user can specify the level of abstraction at which the light pattern 1 should display the navigation instructions. This allows the user to tailor the display of navigation instructions to their own requirements after the vehicle 2 has been parked. For example, the route might involve a traffic light or a pedestrian crossing. The light pattern 1 can also display animations in these situations. For instance, the hatched areas 16 can flash and / or the individual lines that make up the route 15 can move towards the navigation destination 4.
[0044] Information can also be displayed showing how far the navigation destination 4 is currently from vehicle 2. This information can include a time estimate, such as "3 minutes on foot," and / or a distance, such as "500 meters." If the person is in a hurry, this allows them to estimate whether they can still make an appointment on time or if they will be late.
[0045] To further improve user comfort, points of interest (POIs) can also be marked on map 6. For example, if there is a café on route 15 to navigation destination 4, the user can buy a coffee there.
[0046] During the initial programming of the navigation route into the navigation system 9 of vehicle 2, the user can specify the level of abstraction at which the light pattern 1 should display the navigation instructions. This allows the user to customize the display of navigation instructions to their own requirements after the vehicle 2 has been switched off.
Claims
1. Method for projecting at least one light pattern (1) into a vehicle environment using at least one projector (3) encompassed by a vehicle (2), wherein the light pattern (1) has a navigation instruction for continuing navigation in the form of a route to be selected to reach a navigation destination (4) in order to point a person in the direction of the navigation destination (4) after parking the vehicle (2), and wherein the light pattern (1) is specifically aligned with respect to the vehicle environment so that the light pattern (1) is projected into the vehicle environment at a fixed orientation, characterized in that at least one projector (3) integrated into an exterior mirror (7) is used to project the light pattern and a door opening angle of a vehicle door to which the exterior mirror (7) is connected is taken into account when specifically aligning the light pattern (1) with respect to the vehicle environment.
2. Method according to claim 1, characterized in that text, at least one symbol (5) and / or at least one map (6) is projected into the vehicle environment by the light pattern (1).
3. Method according to claim 1 or claim 2, characterized in that the light pattern (1) is projected onto a background.
4. Method according to any of claims 1 to 3, characterized in that at least part of a light pattern (1) is animated.
5. Method according to any of claims 1 to 4, characterized in that the door opening angle is detected by means of an angle sensor and / or by evaluating camera images generated by a camera (8) integrated into the exterior mirror (7).
6. Vehicle (2) comprising at least one projector (3), a navigation unit (9) and a computing unit (10), characterized in that the projector (3), the navigation unit (9) and the computing unit (10) are configured to carry out a method according to any of claims 1 to 5.