Augmented reality display system for parking spaces for people with reduced mobility

Abstract

A method for assisting the driving of a motor vehicle, comprising the following steps: - detecting an available accessible parking space (20) in the environment of the motor vehicle, - superimposing onto the environment of the motor vehicle a virtual gantry (10) under which the motor vehicle should pass, upstream of the detected accessible parking space (20). Figure for the abstract: Fig. 1

Description

Title of the invention: Augmented reality display system for parking spaces for people with reduced mobility Technical field of the invention

[0001] The present invention relates generally to driver assistance methods and driver assistance systems, particularly for motor vehicles, such as cars, trucks, or motorcycles. The present invention thus relates generally to driver assistance systems, also known as ADAS (Advanced Driver-Assistance System), fitted to certain motor vehicles. More particularly, it relates to a motor vehicle comprising an ADAS system coupled with an augmented reality display system for said vehicle. Prior art

[0002] It is known in the prior art to display points of interest such as parking spaces on the screen of a navigation or driver assistance system. However, it is desirable to facilitate driving and navigation for persons with reduced mobility, in particular to enable easy parking, while also improving safety, comfort, and navigation. Statement of the invention

[0003] One object of the present invention is to address the disadvantages of the prior art mentioned above and in particular, first of all, to propose a method of driving assistance, a driving assistance system and a vehicle equipped with such a driving assistance system in order to facilitate driving and parking for persons with reduced mobility, while improving safety and comfort.

[0004] To this end, a first aspect of the invention relates to a driving assistance method for a motor vehicle, comprising the following steps: - to detect an available accessible parking space within the environment of a motor vehicle, - superimpose on the environment of the motor vehicle a virtual gantry under which the motor vehicle should pass, upstream of the available disabled parking space detected.

[0005] This makes it possible to offer a smoother, more user-friendly driving assistance system for motor vehicle users, enabling the detection of available accessible parking spaces and indicating them to the user immediately, clearly, and precisely, thereby improving safety and comfort. In particular, this prevents the user from having to receive a message or take an action to confirm, especially just before having to perform a maneuver requiring their attention. Furthermore, this helps the user, who no longer has to manually search through long and voluminous databases for accessible parking spaces, thus saving them significant and tedious effort and improving safety and user comfort. The invention's main advantage is that it facilitates the search for accessible parking spaces by offering drivers an augmented reality service that optimally manages the information displayed in their field of vision, keeping it only as necessary as possible to minimize mental strain and visual impact.

[0006] The term "upstream" refers to a localized positioning before the accessible parking space in the direction of vehicle traffic. The virtual gantry can thus be displayed, for example, 5 meters before the accessible parking space, or at other distances such as 10 meters, 20 meters, 30 meters, 40 meters, 50 meters, 75 meters, 100 meters, 150 meters, or more than 150 meters. The user can preferably select this distance in the user interface of the driver assistance system, for example, in their user profile.It is also possible to adapt this distance according to the speed of the vehicle (for example a greater value if the vehicle is traveling faster, for example 30 meters if the vehicle is traveling at 30 km / h + / - 10 km / h, for example 50 meters if the vehicle is traveling at 50 km / h + / - 10 km / h, and for example 150 meters if the vehicle is traveling at 80 km / h + / - 10 km / h), or according to traffic in town or in the countryside, or according to the density of car traffic.

[0007] ADAS systems are generally associated with visual information display systems on a display medium located within the driver's field of vision, particularly on the vehicle's windshield. This information is intended to help the driver navigate the vehicle within its road environment.

[0008] Augmented reality refers to a situation where information displayed by the system is superimposed on the driver's actual view of the vehicle and its surroundings. It is a visualization of the scene where the vehicle is located, filmed directly, for example, by the vehicle's front camera, and enhanced by the driver assistance system.

[0009] This information is complementary to the basic information presented in particular on the dashboard or on a screen in the vehicle's cockpit, in order to improve safety, comfort or navigation.

[0010] In particular, augmented reality can display on the windshield, which serves as a support or screen for information, safety information such as reminders of road signs, improved visibility of the road at night, and road markings indicating routes to follow, particularly to guide the vehicle towards parking spaces.

[0011] Most current and prior art display systems, known as HV, an acronym for "Head Up Vision" or HUD in Anglo-Saxon terminology for "Head Up Display", do not allow augmented reality display but simply allow driving information to be given to the driver without the latter diverting his attention from the road.

[0012] The new generations of VTH known as "long distance", according to the present invention, make it possible to project images further onto the road scene extending in front of the vehicle (5 meters, up to 10 meters or even more as needed) in order to "superimpose" "virtual" graphic elements onto the "real" road scene and to offer an augmented reality service.

[0013] The advantage of augmented reality is the ability to overlay virtual "floating" arrows, a road marking, a compass bearing, or any other guidance information indicating the route to follow and / or pointing in the direction of travel onto the road scene unfolding in front of the vehicle. Furthermore, it is particularly possible to overlay a virtual gantry as explained above and as will be described in more detail below, notably with reference to the accompanying figures.

[0014] In order to guide the vehicle in its road environment, an augmented reality display system generally cooperates with an on-board AD AS system which uses maps, including high-definition maps associated with a navigation system, and data delivered by sensors on-board in the vehicle, including a multifunction camera which can be positioned against the windshield of the vehicle, preferably at the level of the interior rearview mirror.

[0015] In the vehicle, the main source of data (database) on mapped parking lots comes from the navigation system. They can be displayed at the user's request via the vehicle's navigation HMI (Human-Machine Interface), which offers a menu of display options to the vehicle's passengers, or permanently on the displayed navigation map, on a screen on the dashboard or other screen in the vehicle's cockpit.

[0016] This database lists, in particular, a number of parking spaces, the updates to which are sporadic. Furthermore, the database does not list parking spaces that are not in parking lots or identified as such. Thus, parking spaces found on the street are not included.

[0017] On the one hand, it is desirable to do without databases listing parking spaces for people with reduced mobility in order to be more efficient in searching for them, for example by ensuring their real-time availability, which is particularly difficult with a database. On the other hand, it is desirable to optimally adapt the graphical representation of the displayed information (for example on the windshield), in particular depending on the actual distance of the parking space for a person with reduced mobility from the vehicle.

[0018] The present invention thus proposes a solution embedded in the vehicle, allowing to display in augmented reality information of parking spaces for reduced mobility which is scalable / adaptive and intuitive for the driver of the vehicle, and which has been effectively detected in the environment of the vehicle.

[0019] Advantageously, the process comprises the following step: - detect an available accessible parking space in the immediate vicinity of the motor vehicle.

[0020] Advantageously, the process comprises the following step: - to indicate a preference (for example general or prior) of a user for a parking space for reduced mobility.

[0021] This makes it possible to better assist the user and in particular to manage their preferences through, for example, a user profile or possibly on a case-by-case basis.

[0022] Advantageously, the process further comprises the following step: - no longer display the virtual gantry after the motor vehicle has passed through or overtaken the virtual gantry.

[0023] This allows the driver to continue driving without being distracted by the virtual gantry display, while still receiving information that the gantry has been crossed or passed. In particular, this improves understanding of the road situation. Furthermore, this prevents the user from having to confirm a message or action, thus making the user experience smoother.

[0024] Advantageously, the process further comprises the following step: - modify the appearance of the virtual gantry when the motor vehicle passes through or overtakes the virtual gantry.

[0025] This makes it easy to inform the user that the virtual gantry has been crossed or passed. In particular, this improves understanding of the road situation and indicates to the user that they can now maneuver to park in the accessible parking space.

[0026] Advantageously, the overlay step is performed in real time, dynamically or immediately after the detection step.

[0027] This allows the user to be informed as quickly as possible that the accessible parking space is available, while clearly indicating that they need to continue driving a little further to reach it. This provides dynamic information that is particularly useful to the user.

[0028] Advantageously, the overlay step is carried out in augmented reality.

[0029] This allows for the seamless integration of the detection of the availability of the parking space adapts to the environment of the motor vehicle for people with reduced mobility, and improves user safety and comfort.

[0030] Advantageously, the driver assistance method further comprises the following step: - overlay or display a guidance for maneuvering to be carried out in order to park the motor vehicle in the available disabled parking space detected.

[0031] This makes it easier for the user to maneuver while having detected the parking space for people with reduced mobility.

[0032] Advantageously, the driver assistance method further comprises the following step: - modify a dimension of the virtual gantry as a function of a virtual distance between the motor vehicle and the virtual gantry, such as increasing the dimension of the virtual gantry as the motor vehicle moves towards the virtual gantry.

[0033] This allows the user to optimize their understanding of the road situation by having reliable, precise and intuitive information, without having to physically interact with the driving assistance system, by acknowledging a message, touching the screen with a finger or giving verbal confirmation for example.

[0034] Advantageously, the driver assistance method further comprises the following step: - adapt a color of the virtual gantry if the motor vehicle is travelling in a lane suitable for parking in the available disabled parking space detected, for example if the vehicle is travelling in a lane on the same side as the available disabled parking space detected.

[0035] Advantageously, the driver assistance method further comprises the following step: - adapt a color of the virtual gantry if the motor vehicle is travelling in a lane that is not suitable for parking in the available disabled parking space detected, for example if the vehicle is travelling in a lane on the opposite side of the available disabled parking space detected, or a lane far from the available disabled parking space detected.

[0036] This allows the user to optimize their understanding of the road situation by having reliable, precise and intuitive information, without having to physically interact with the driving assistance system, by acknowledging a message, touching the screen with a finger or giving verbal confirmation for example.

[0037] Advantageously, the step of superimposing the virtual gantry onto the environment of the motor vehicle is carried out on a screen of the motor vehicle or on a head-up display, and preferably the virtual gantry is superimposed on the environment of the motor vehicle reproduced on the screen of the motor vehicle or on the head-up display.

[0038] This allows the detection to be integrated into the vehicle environment (or into the real scene).

[0039] Advantageously, the process comprises the following step: - display a real-time image of the vehicle's surroundings and, simultaneously, a virtual gantry upstream of the detected available accessible parking space, as well as guidance on how to maneuver the vehicle into the detected available accessible parking space.

[0040] Advantageously, the driving assistance system includes at least one camera arranged to deliver real information on the vehicle's environment and / or the location (or detection) of a disabled parking space.

[0041] Advantageously, a vehicle navigation system is arranged to deliver map information on the disabled parking space; said information being correlated and synchronized with each other to be displayed by the augmented reality display system.

[0042] In a second aspect, the invention relates to a driving assistance system for a motor vehicle arranged to implement the method according to the first aspect.

[0043] This makes it possible to offer a smoother, more user-friendly driver assistance system that detects available accessible parking spaces and indicates them to the user immediately, clearly, and precisely, thereby improving safety and comfort. In particular, this eliminates the need for the user to receive a message or take any action to confirm.

[0044] In a second aspect, the invention relates to a motor vehicle comprising a driving assistance system according to the previous aspect.

[0045] This makes it possible to offer a motor vehicle with a smoother, more user-friendly driver assistance system that can detect available accessible parking spaces and indicate them to the user immediately, clearly, and precisely, thereby improving safety and comfort. In particular, this eliminates the need for the user to receive a message or take any action to confirm. Description of the figures

[0046] Other features and advantages of the present invention will become more apparent upon reading the following detailed description of an embodiment of The invention given by way of non-limiting example and illustrated by the attached drawings, in which:

[0047] [Fig. 1] represents an augmented reality view of an environment of a motor vehicle according to the present invention, having a driving assistance system or using the driving assistance method according to the present invention.

[0048] [Fig.2] represents another augmented reality view of another environment of the vehicle.

[0049] Detailed description of embodiment(s)

[0050] Fig. 1 represents an augmented reality view of an environment of a motor vehicle according to the present invention, having a driving assistance system or using the driving assistance method according to the present invention.

[0051] Thus, when the user or driver is in the vehicle, they enter their desired destination or can simply drive without navigation assistance. In both cases, they can benefit from the driving assistance of the present invention.

[0052] He may have previously indicated his preference for a parking space for people with reduced mobility, by a case-by-case action or by a preference in a user profile for example.

[0053] The vehicle includes the driver assistance system. The vehicle also preferably includes a navigation system and communication means. The communication means are, for example, an antenna connected to the GPS and / or a geolocation system (Global Positioning System or global navigation system, guided by satellites). The driver assistance system (or the vehicle) also preferably includes a display system (such as one or more screens, or a head-up display) and a human-machine interface such as a keyboard or a touchscreen. The vehicle also preferably includes an on-board computer. The vehicle further includes an on-board camera for capturing images of the environment external to the vehicle.

[0054] The view of [Fig. 1] is thus the view from the vehicle being driven.

[0055] The driver assistance system detected an available accessible parking space 20 on the left of [Fig. 1], via the camera or another optical or radar system. The space is considered available because there is no vehicle already parked in it and / or there are no obstacles obstructing or blocking access.

[0056] The driver assistance system thus allows a virtual gantry 10, under which the vehicle should pass, to be superimposed on the vehicle's surroundings. The virtual gantry is positioned upstream of the available accessible parking space 20 so that the user can immediately understand the procedure to follow to reach the available accessible parking space 20. The gantry Virtual barrier 10 is thus displayed on a screen, or on the vehicle's windshield acting as a screen, or on any other device, superimposed or overlaid on the surrounding environment. The user can then easily understand that they must pass under the virtual barrier 10 to reach the available accessible parking space 20.

[0057] It is thus possible to display in an augmented reality window, in the field of vision of the vehicle driver, a graphic representation of the virtual gantry 10.

[0058] The virtual gantry 10 can also be equipped with a virtual sign 11 indicating the presence of a parking space for people with reduced mobility and an arrow 12 (possibly flashing) indicating the side of the road on which the parking space for people with reduced mobility 20 is located.

[0059] It is also possible to provide a virtual display on the ground (such as a square, a rectangle, a flat area, a space outline or any other shape) on the very location of the disabled parking space 20, and / or guidance arrows 30 to guide and reach the disabled parking space 20.

[0060] The virtual gantry 10 can also have its size modified (for example increased or decreased) as it approaches the disabled parking space 20.

[0061] Furthermore, it is possible to provide for a modification or adaptation of the virtual gantry 10 at the moment of crossing, such as a flashing light or a green color. It is also possible to provide for a flashing light or an orange or red color if the virtual gantry 10 is passed over without being crossed (i.e., without the vehicle passing under the virtual gantry 10, but for example beside it).

[0062] It is possible to detect the disabled parking space 20 by the marking on the ground physically present on the disabled parking space 20, or indicated by a physical sign 40 in the environment of the vehicle (here in the street).

[0063] Fig. 2 represents another augmented reality view of another environment of the vehicle.

[0064] The vehicle is moving, in [Fig.2], in a different place than that of [Fig.1].

[0065] The driver assistance system detected a mobility parking space reduced 20. In this case, the space is considered available because there is a physical sign 40 in the street indicating the presence of the reduced mobility parking space 20, and the vehicle placed in the reduced mobility parking space 20 is leaving, for example because it is maneuvering to leave or because it has put on its indicator to indicate that it wants to leave.

[0066] The virtual gantry 10 is a different color than that of [Fig.1] because on [Fig.1] , the vehicle is located on a lane or a lane suitable for parking (almost directly) in the disabled parking space 20, whereas in [Fig.2], the vehicle is not in the right lane and must move to another, more suitable lane in order to then be able to park safely in the disabled parking space 20.

[0067] The virtual gantry 10 is equipped with a virtual sign 11 indicating the presence of the disabled parking space 20 and an arrow to the side of the road where the disabled parking space 20 is located.

[0068] Parking space 21 is considered unavailable because the vehicle parked on it shows no intention of leaving the space, for example because the door is open and a passenger is getting out of the vehicle.

[0069] It should also be noted that, in navigation mode, it is possible to filter the points of interest (POIs) to display only accessible parking spaces closest to the user's programmed route and / or near the destination or programmed stops. For example, this could be an accessible parking space on a road perpendicular to the one the vehicle is traveling on, and not on the vehicle's main route: in this case, it is possible to choose whether or not to display the virtual gantry 10, so as not to overwhelm the user with unwanted information. The user can also access all accessible parking spaces by navigating the navigation system's map.

[0070] In addition, it is possible to offer the user several parking spaces for people with reduced mobility 20 if they are detected, preferably in a short list, and if possible with selection criteria such as the distance between the parking spaces for people with reduced mobility and the desired destination, the presence of stairs, elevators, etc., and preferably with an environmental map of the area between the parking space for people with reduced mobility and the final destination.

[0071] It is also possible to create a "person with reduced mobility" mode when calculating a route directly via the on-board navigation system, but also via a technical device allowing subscription to a dedicated connected service providing access to a database of photos displaying the environment related to the parking space, dedicated for person with reduced mobility. Industrial application

[0072] A driving assistance method, a driving assistance system and a motor vehicle equipped with the driving assistance system according to the present invention, and their manufacture and use, are capable of industrial application.

[0073] It will be understood that various modifications and / or improvements are obvious for The skills of a person skilled in the art can be applied to the various embodiments of the invention described in this description without going outside the scope of the invention.

Claims

Claims

1. Driving assistance method for a motor vehicle, comprising the following steps: - detecting an available reduced mobility parking space (20) in an environment of the motor vehicle, - superimposing on the environment of the motor vehicle a virtual gantry (10) under which the motor vehicle should pass, upstream of the detected available reduced mobility parking space (20).

2. Driving assistance method according to the preceding claim, further comprising the following step: - no longer displaying the virtual gantry (10) after the motor vehicle has crossed or passed the virtual gantry (10).

3. Driving assistance method according to one of the preceding claims, in which the superposition step is carried out in real time or immediately after the detection step.

4. Driving assistance method according to one of the preceding claims, in which the superposition step is carried out in augmented reality.

5. Driving assistance method according to one of the preceding claims, further comprising the following step: - superimposing or displaying a maneuver guidance (30) to be carried out in order to park the motor vehicle in the available reduced mobility parking space (20) detected.

6. Driving assistance method according to one of the preceding claims, further comprising the following step: - modifying a dimension of the virtual gantry (10) as a function of a virtual distance between the motor vehicle and the virtual gantry (10), such as increasing the dimension of the virtual gantry (10) as the motor vehicle advances towards the virtual gantry (10).

7. Driving assistance method according to one of the preceding claims, further comprising the following step: - adapting a color of the virtual gantry (10) if the motor vehicle is traveling in a lane suitable for parking in the available reduced mobility parking space (20) detected, for example if the vehicle is traveling in a lane on the same side as the available reduced mobility parking space (20) detected.

8. Driving assistance method according to one of the preceding claims, wherein the step of superimposing the virtual gantry (10) on the environment of the motor vehicle is carried out on a screen of the motor vehicle or on a head-up display, and preferably the virtual gantry (10) is superimposed on the environment of the motor vehicle reproduced on the screen of the motor vehicle or on the head-up display.

9. Driving assistance system for a motor vehicle arranged to implement the method according to any one of the preceding steps.

10. Motor vehicle comprising a driving assistance system according to the preceding claim.

Images