Management of the operation of a motor vehicle navigation system for broadcasting in augmented reality the risk of aircraft overflying the vehicle

The navigation system method overlays visual content onto an augmented reality scene to inform drivers about aircraft overflight risks near aerodromes or airports, addressing the deficiency in existing systems and enhancing driving safety.

FR3155489A1Pending Publication Date: 2025-05-23STELLANTIS AUTO SAS +1
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
FR2023012870
Authority / Receiving Office
FR · FR
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-11-22
Publication Date
2025-05-23

AI Technical Summary

Technical Problem

Existing motor vehicle navigation systems lack the capability to effectively inform drivers about the risk of aircraft overflying their vehicle, particularly near aerodromes, airports, or heliports.

Method used

A method for managing the operation of a navigation system that uses a camera to capture the vehicle's environment and overlays visual content, such as geometric shapes and pictograms, onto an augmented reality scene on the navigation system's screen to indicate sections of road near aerodromes or airports that may be overflown by low-flying aircraft.

Benefits of technology

This solution enhances the ergonomics of navigation systems by providing drivers with relevant and timely information about potential aircraft overflights, thereby promoting driving safety.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

The invention relates to a method for managing the operation of a navigation system (2) of a motor vehicle (1) which allows the restitution of augmented reality scenes of the environment of the vehicle, in particular when the vehicle (1) is traveling near a section of road at risk of being overflown by aircraft. The invention also relates to a computer device (100) implementing such a method, as well as a motor vehicle (1) comprising such a device. Figure for the abstract: 1
Need to check novelty before this filing date? Find Prior Art

Description

Title of the invention: Management of the operation of a navigation system of a motor vehicle for broadcasting in augmented reality the risk of aircraft overflying the vehicle Technical field of the invention

[0001] The present invention relates to the field of motor vehicle navigation systems. The invention relates in particular to a method for managing the operation of a motor vehicle navigation system, the navigation system comprising a camera arranged to take pictures of the environment of the vehicle so as to enable the real-time broadcasting of an augmented reality scene of said environment on a screen of the navigation system. The invention also relates to a device implementing such a method, as well as a motor vehicle comprising such a device. The invention applies to motor vehicles such as land motor vehicles, in particular cars. State of the prior art

[0002] It is known that the navigation system of certain modern motor vehicles allows the real-time broadcasting of an augmented reality scene of the vehicle's environment. To do this, a camera is used to take shots of the driving environment and the scene of the driving environment is rendered in real time on the screen of the navigation system. In addition, in order to enhance the informative content thus provided to the driver, indicative arrows are generally embedded in the scene to indicate a direction to follow. However, these are the only informative elements that have been considered to date. Consequently, such navigation systems still remain deficient in terms of ergonomics given their limited capacity to be able to effectively assist a driver in the driving activity, in particular by providing him with relevant information relating to the risk of aircraft overflying the vehicle. Summary of the invention

[0003] The invention aims to fill this gap. In particular, it aims to provide a solution for easily and ergonomically informing the driver of a motor vehicle about sections of road located near an aerodrome, an airport or a heliport which may be overflown by a low-flying aircraft, in particular by means of a navigation system on board the vehicle. In this way, the invention aims to maximize the ergonomics of vehicles, in particular in terms of their ability to provide drivers with information relevant training that can promote driving safety.

[0004] In order to achieve these aims, the invention relates, according to a first aspect, to a method for managing, by a computer device on board a motor vehicle, the operation of a navigation system of the vehicle, the navigation system comprising a camera arranged to take pictures of the environment of the vehicle so as to allow the broadcasting in real time of a scene in augmented reality of said environment on a screen of the navigation system, the method comprising the steps of: • determine whether the vehicle will enter or leave a section of a road located near an aerodrome, airport or heliport and which may therefore be overflown by a low-flying aircraft; and, where it is established that this is the case, • cause the insertion into said scene of visual content established according to whether the vehicle is going to take or leave said section.

[0005] According to a variant, said visual content can be embedded in said scene according to a location corresponding to the beginning or the end of said section.

[0006] According to another variant, said visual content may contain a geometric shape.

[0007] According to yet another variant, said shape can be displayed in different way depending on the current time.

[0008] According to yet another variant, said visual content may contain at least one pictogram.

[0009] According to yet another variant, said pictogram can be established according to the current time.

[0010] According to a second aspect, the invention relates to a device for managing the operation of a navigation system of a motor vehicle, the navigation system comprising a camera arranged to take pictures of the environment of the vehicle so as to allow the real-time broadcasting of a scene in augmented reality of said environment on a screen of the navigation system, the device comprising an information processing unit, with one or more processors, and a data storage medium, which are configured to implement a method as described above.

[0011] According to a third aspect, the invention relates to a computer program comprising program code instructions for executing the steps of a method as described above when said program is executed by at least one processor.

[0012] According to a fourth aspect, the invention relates to a computer-readable medium on which a program as described above is recorded.

[0013] According to a fifth aspect, the invention relates to a motor vehicle comprising an on-board navigation system and which incorporates a device as described above. Brief description of the figures

[0014] Other characteristics and advantages of the invention will appear on examining the detailed description below, and the appended figures, in which:

[0015] [Fig-1] is a schematic illustration of a motor vehicle according to the invention;

[0016] [Fig.2] is a functional diagram of a device according to the invention;

[0017] [Fig.3] is a flowchart of the steps of a method according to the invention;

[0018] [Fig.4] illustrates the implementation of at least one step of the method according to the invention; and

[0019] [Fig.5] illustrates the implementation of at least one step of the method according to the invention. Detailed description of the invention

[0020] [Fig.l] shows a schematic illustration of a vehicle 1 according to the invention. This comprises an on-board navigation system 2, which conventionally interacts with a satellite positioning system (e.g. GPS, Galileo, Beidou) and which comprises a camera 3 arranged to take pictures of the environment of the vehicle 1 so as to allow the real-time broadcasting of an augmented reality scene of the environment of the vehicle on a screen 4 of the navigation system 2. Preferably, the navigation system 2 is of the connected type, that is to say that it regularly receives data (e.g. mapping, real-time traffic, etc.) by means of a radiofrequency signal communication system 5.

[0021] Advantageously, the vehicle 1 according to the invention also carries a device 100 for managing the operation of a navigation system of a motor vehicle within the meaning of the present invention, as described below, which implements a method for managing the operation of a navigation system of a motor vehicle within the meaning of the present invention, as briefly summarized below and described in detail below.

[0022] When implementing the method according to the invention, the device 100 according to the invention determines whether the vehicle 1 is going to take or leave a section of a road located near an aerodrome, an airport or a heliport, and which can therefore be overflown by an aircraft flying at low altitude. And if it establishes that this is the case, it then causes the incrustation of visual contents within an augmented reality scene which is broadcast in real time on the screen 4 of the navigation system 2. Advantageously, these visual contents are established according to whether the vehicle is going to take or leave the section. If it establishes in particular that the vehicle 1 is going to take the section, it is a visual content which informs the beginning of the section which is incrusted in the scene. Conversely, if the vehicle 1 is going to leave the section, It is a visual content that informs the end of the section that is embedded in the scene. This is how the navigation system 2 is more ergonomic, particularly in terms of its capacity to provide relevant information about certain dangerous areas.

[0023] In [Fig. 2] is illustrated in more detail the device 100 for managing the operation of a navigation system of a motor vehicle according to the invention. It is essentially a computer device, which comprises at least one information processing unit 101, comprising one or more processors, a data storage medium 102, on which is recorded in particular a program which comprises program code instructions for the execution of the steps of the method according to the invention described below, and an input and output interface 103 allowing the reception and transmission of data.

[0024] Preferably, the device 100 according to the invention is integrated into an independent computer and it interacts via its input and output interface 103 and by means of a wired communication network of the vehicle (e.g. CAN, Ethernet, MOST) - shown in [Fig.l] by the arrows - with the navigation system 2, in particular with its screen 4. Alternatively, the device 100 according to the invention is partially or fully part of the navigation system 2.Thanks to these means, the device 100 according to the invention is advantageously capable, in particular, of determining whether the vehicle 1 is going to take or leave a section of a road located near an aerodrome, an airport or a heliport and which can therefore be overflown by an aircraft flying at low altitude, and it can cause the overlaying of visual content established according to whether the vehicle is going to take or leave the section in an augmented reality scene broadcast in real time on the screen 4 of the navigation system 2.

[0025] According to the invention, all the elements described above contribute to enabling the implementation of a method for managing the operation of a navigation system of a motor vehicle, the navigation system comprising a camera arranged to take views of the vehicle's environment so as to allow the real-time dissemination of an augmented reality scene of said environment on a screen of the navigation system, as described below in connection with Figures 3-5.

[0026] [Fig.3] illustrates, by means of a flowchart, the steps of the method according to the invention.

[0027] According to a first step 301 of the method according to the invention, the device 100 according the invention determines whether the vehicle will take or leave a section of a road located near an aerodrome, an airport or a heliport and which may therefore be overflown by an aircraft flying at low altitude. To do this, it preferentially uses the mapping of the navigation system 2, the latter having data relating to airports as well as their opening hours which it has preferably received by means of the radiofrequency signal communication system 5. Thus, at the end of this first step of the method, the device 100 according to the invention advantageously seeks to establish these particular situations in which a driver approaches an area potentially overflown by aircraft. And if it establishes that the vehicle is going to take or leave such a section of road likely to be overflown by aircraft, the device 100 according to the invention carries out the following step of the method according to the invention described below.

[0028] According to a second step 302 of the method according to the invention, the device 100 according to the invention causes the incrustation in the augmented reality scene which is broadcast in real time on the screen 4 of the navigation system 2 of a visual content established according to whether the vehicle is going to take or leave the section. Preferably, the visual content which is thus incrusted contains a geometric shape. Alternatively or cumulatively it contains at least one pictogram. According to an exemplary embodiment the pictogram is established according to the current time. Alternatively or cumulatively, it is the shape which is displayed in different ways according to the current time.

[0029] Advantageously, the visual content is embedded in the scene at a location corresponding to the beginning or the end of the section. Indeed, when the device 100 according to the invention has established during the previous step that the vehicle will take the section of a road potentially affected by the overflight of low-altitude aircraft, the visual content contains a geometric shape and a first pictogram, the shape and / or the first pictogram being embedded in the scene according to a location corresponding to the beginning of the section. Conversely, when it has established that the vehicle 1 will leave such a risky section, the visual content contains the shape and at least one second pictogram, the shape and / or said second pictogram being embedded in the scene according to a location corresponding to the end of the section. For greater clarity, these two situations are illustrated in Figures 4 and 5.

[0030] [Fig. 4] shows, which corresponds to a situation in which the vehicle 1 is about to take a section of a road located near an aerodrome, an airport or a heliport, and which can therefore be overflown by an aircraft flying at low altitude, a scene 401 in augmented reality of the environment of the vehicle 1 as it is displayed on the screen 4 of the navigation system 2. Embedded in the scene 401 by the device 100 according to the invention are the geometric shape 402, in an inverted U in order to visually materialize a gantry, a first and a second pictogram of a first type 403, which reproduce a sign warning of danger of overflight by aircraft, and a third pictogram and a fourth pictogram of a second type 404, which reproduce a light, preferably red, possibly flashing depending on the current time and an opening time of a given airport.

[0031] Advantageously, the shape 402 is arranged at a location in the scene 401 which corresponds to the start of the section. Preferably, when the device 100 according to the invention establishes that the airport in question is open at the current time, the shape 402 is displayed in a first color, for example red, and the red lights flash. Conversely, when it establishes that the airport in question is closed, the shape is displayed in a second color, for example green, and the red lights are off. The driver is thus informed in the most ergonomic manner, in particular without resorting to intrusive pop-ups, not only about the fact that he is going to take a section likely to be overflown by aircraft, but also whether the airport located nearby is open or closed. He can thus better understand a level of risk linked to this particular driving environment.

[0032] Conversely, we see in [Fig. 5], which corresponds to a situation in which the vehicle 1 is going to leave a section of a road located near an aerodrome, an airport or a heliport, and which can therefore be overflown by an aircraft flying at low altitude, a scene 501 in augmented reality of the environment of the vehicle 1 as it is displayed on the screen 4 of the navigation system 2. We can see, embedded in the scene 501 by the device 100 according to the invention, the same geometric shape 502 in an inverted U to visually materialize a gantry and two pictograms of a third type 503, which intuitively indicates the end of a risk of overflight by aircraft.

[0033] Advantageously, the shape 502 is arranged at a location in the scene 501 which corresponds to the end of the section. Preferably, when the device 100 according to the invention establishes that the airport in question is open at the current time, the shape 502 is displayed in a first color, for example red. Conversely, when it establishes that the airport in question is closed, the shape is displayed in a second color, for example green. The driver is thus informed in the most ergonomic manner about the fact that he is leaving a driving zone subject to a risk of overflight by aircraft, as well as the opening or closing of an airport concerned.

[0034] Therefore, by means of the method and device according to the invention described above, a solution is provided for easily and ergonomically informing the driver of a motor vehicle about sections of roads located near an aerodrome, an airport or a heliport and which can therefore be flown over by a low-flying aircraft, in particular by means of a navigation system on board the vehicle. In this way, the invention maximizes the ergonomics of vehicles, in particular in terms of their ability to provide drivers with relevant information which promotes driving safety.

Claims

Claims

1. Method for managing, by a computer device (100) on board a motor vehicle (1), the operation of a navigation system (2) of the vehicle (1), the navigation system (2) comprising a camera (3) arranged to take pictures of the environment of the vehicle so as to allow the real-time broadcasting of an augmented reality scene (401, 501) of said environment on a screen (4) of the navigation system (2), characterized in that the method comprises the steps of: • determining whether the vehicle (1) will take or leave a section of a road located near an aerodrome, an airport or a heliport and which can therefore be overflown by an aircraft flying at low altitude; and, when it is established that this is the case, • causing the incrustation in said scene (401, 501) of a visual content established according to whether the vehicle (1) will take or leave said section.

2. The method according to claim 1, characterized in that said visual content is embedded in said scene (401, 501) according to a location corresponding to the start or end of said segment.

3. The method according to any one of the preceding claims, characterized in that said visual content contains a geometric shape (402, 502).

4. The method according to claim 3, characterized in that said shape is displayed in different ways according to the current time.

5. The method according to any one of the preceding claims, characterized in that said visual content contains at least one pictogram (403, 404, 503).

6. The method according to claim 5, characterized in that said pictogram is established according to the current time.

7. Device (100) for managing the operation of a navigation system (2) of a motor vehicle (1), the navigation system (2) comprising a camera (3) arranged to take pictures of the environment of the vehicle so as to allow the real-time broadcasting of an augmented reality scene (401, 501) of said environment on a screen (4) of the navigation system (2), characterized in that said device comprises an information processing unit (101), with one or more processors, and a data storage medium (102), which are configured to implement a method according to any one of the preceding claims.

8. A computer program comprising program code instructions for executing the steps of a method according to any one of claims 1 to 6 when said program is executed by at least one processor.

9. Computer-readable medium, characterized in that a program according to claim 8 is recorded therein.

10. Motor vehicle (1) comprising a navigation system (2) which comprises a camera (3) arranged to take pictures of the environment of the vehicle so as to allow the real-time broadcasting of an augmented reality scene (401, 501) of said environment on a screen of the navigation system, characterized in that said vehicle (1) has on board a device (100) according to claim 7.

Citation Information

Patent Citations

  • Display device and display method

    EP2793193B1

  • Method and apparatus for contextual notifications and user interface

    US20160018969A1