IMPROVED METHOD FOR ASSISTING WITH THE LANDING OF AN AIRCRAFT AND SYSTEM CONFIGURED TO EXECUTE THE METHOD.

The method and system utilize dual algorithms to confirm accurate aircraft positioning on runways using onboard camera images, addressing alignment challenges and enhancing safety through precise alignment confirmation.

FR3149415A1Pending Publication Date: 2024-12-06AIRBUS OPERATIONS (SAS)
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
FR2023005453
Authority / Receiving Office
FR · FR
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-31
Publication Date
2024-12-06

AI Technical Summary

Technical Problem

Current aircraft landing systems face challenges in accurately positioning the aircraft relative to multiple runways, especially in degraded visibility conditions or without instrument landing systems, leading to potential confusion and the need for confirming correct runway alignment.

Method used

A method and system using dual algorithms to determine the aircraft's position relative to a runway from onboard camera images, comparing the positions using a Perspective-n-Point algorithm and an inertial unit, and providing consistent confirmation without GPS, ensuring accurate alignment by identifying and correcting inconsistencies.

Benefits of technology

Ensures precise aircraft positioning by confirming alignment with the intended runway, reducing confusion and enhancing safety by providing visual and auditory alerts for inconsistent positions, even in challenging conditions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

The invention relates to a method for assisting the landing of an aircraft (1) on a runway (100a) of a destination airport facility (100), said method comprising two successive determinations (S31, S32) of the position (POS1, POS2) of the aircraft (1) relative to said runway (100a) and from a shot (F) taken from the aircraft (1), according respectively to two different algorithms (PnP, A2) for determining the position of the aircraft (1), as well as the provision of at least one piece of information (G, B) representative of a difference between the two positions (POS1, POS2) determined.It is thus advantageously possible to verify whether the destination runway (100a) observed from the image (F1) taken from the aircraft (1) is indeed the target destination runway on which a landing of the aircraft (1) is planned, or whether there is a positioning error of the aircraft (1) relative to the destination runway. Fig. 3.
Need to check novelty before this filing date? Find Prior Art

Description

Title of the invention: IMPROVED METHOD FOR ASSISTING WITH THE LANDING OF AN AIRCRAFT AND SYSTEM CONFIGURED TO EXECUTE THE METHOD. technical field

[0001] The present invention relates to a method for assisting the landing of an aircraft on a runway at an airport facility. More particularly, the invention relates to a method for determining the aircraft's position relative to one or more runways at an airport facility, based on a photograph taken from the aircraft, and then verifying the accuracy of the determined position. The invention further relates to a system configured to perform the aforementioned landing assistance method. STATE OF THE PRIOR ART

[0002] Current aircraft include numerous flight assistance devices or systems, including, for example, systems to assist in achieving an optimized descent to a destination airport or systems designed to prevent confusion upon arrival at the destination between a destination runway and a taxiway parallel to that runway. Furthermore, some airports are not equipped with instrument landing systems (e.g., an Instrument Landing System or ILS) enabling an aircraft to land automatically.

[0003] Many airport facilities include several runways, sometimes arranged parallel to one another, and a risk of confusion can arise in degraded visibility conditions, or in the absence of available positioning systems to automatically position an aircraft relative to a runway. There is therefore a need to confirm the correct positioning of an arriving aircraft, operating a final approach to a destination runway at an airport facility.

[0004] The situation can be improved. Description of the invention

[0005] An object of the present invention is to provide a method for assisting the landing of an aircraft to confirm a correct positioning of the aircraft relative to a destination runway of an airport facility, particularly when the latter includes a plurality of runways, as well as an automated landing assistance system configured to perform such a method.

[0006] To this end, a method is proposed for assisting the landing of an aircraft on a predefined runway at a destination airport facility, the method comprising determining a first position of the aircraft relative to the predefined runway, from a photograph taken from the aircraft, coordinates of the runway in a database, and a first algorithm for determining a position of the aircraft relative to said runway from the photograph, the method being such that it further comprises:

[0007] - a determination of a second position of the aircraft relative to the runway destination landing runway, from a photograph taken from the aircraft, the coordinates of said destination landing runway in the database, and a second algorithm for determining a position of the aircraft relative to said runway from said photograph, different from the first algorithm for determining a position of the aircraft relative to the runway from said photograph, then,

[0008] - provide information representative of the difference between the first position determined and the second position determined.

[0009] It is thus advantageously possible to verify the consistency of the runway observed from the aircraft on arrival at destination with the planned landing runway as it appears in a database of landing runways, without using any other means of geolocation (such as a GPS system, for example).

[0010] According to one embodiment, the airport facility comprises a plurality of runways and the aircraft landing assistance method is designed and adapted so that it comprises, for each of the landing runways of the destination airport facility, considered successively:

[0011] - a determination of a first position of the aircraft relative to the runway landing considered, from a photograph taken from the aircraft, of the coordinates of the landing runway of all the airport's runways in a database, and of the first algorithm for determining a position of the aircraft relative to said runway from the photograph,

[0012] - a determination of a second position of the aircraft relative to the runway destination landing runway, from a photograph taken from the aircraft, the coordinates of said destination landing runway in the database, and the second algorithm for determining a position of the aircraft relative to said runway from said photograph, different from the first algorithm for determining a position of the aircraft relative to said runway from said photograph, then,

[0013] - record information representative of the difference between the first determined position and the second determined position, in association with a identifier of the landing runway in question, then,

[0014] compare the two recorded pieces of information representing the two smallest differences in position between the first determined position and the second determined position from the list of recorded pieces of information representing the differences in position between said first position and the second position in association with the runways, and, if the difference between said two pieces of information representing the two smallest differences in position exceeds a predetermined threshold value:

[0015] provide, information representative of the difference between the first determined position and the second determined position for the track for which said difference is the smallest among the list of recorded information representative of the differences, in association with an identifier of said track for which said difference is the smallest,

[0016] and otherwise:

[0017] provide information representative of the difference between the first determined position and the second determined position for the track for which said difference is the smallest among the list of recorded information representative of the differences.

[0018] According to one embodiment, the method for assisting the landing of an aircraft on a runway at a destination airport facility executes algorithms for determining the aircraft's position, comprising at least:

[0019] - said first algorithm which is a so-called "Perspective-n-Point" type algorithm comprising a method for determining a translation between a runway and a current position of the aircraft, as well as a method for determining a rotation between said runway and said current position of the aircraft, and,

[0020] - said second algorithm which includes a method for determining a translation between a landing runway and a current position of the aircraft as well as obtaining a position of the aircraft from information provided by an inertial navigation system of said aircraft.

[0021] Another object of the invention is a landing assistance device for an aircraft on a predefined runway at a destination airport facility, the device comprising electronic circuitry configured to determine a first position of the aircraft relative to the predefined runway, from a photograph taken from the aircraft, coordinates of said runway in a database, and a first algorithm for determining a position of the aircraft relative to said runway from said photograph, the assistance device further comprising electronic circuitry configured to operate:

[0022] - a determination of a second position of the aircraft relative to the runway landing, from a photograph taken from the aircraft, of the coordinates of the landing runway in said database, and of a second algorithm for determining a position of the aircraft relative to said runway from said photograph, different from the first reprojection algorithm, and for,

[0023] - provide information representative of the difference between the first position determined and the second position determined.

[0024] According to one embodiment, the aircraft landing assistance system comprises electronic circuitry configured to operate, when the airport facility comprises a plurality of runways, for each of the runways of the destination airport facility, considered successively:

[0025] - a determination of a first position of the aircraft relative to the runway landing considered, from a photograph taken from the aircraft, of the coordinates of the landing runway in a database, and of the first algorithm for determining a position of the aircraft relative to said runway from said photograph,

[0026] - a determination of a second position of the aircraft relative to the runway landing, from a photograph taken from the aircraft, the coordinates of said runway in the database, and the second algorithm for determining the aircraft's position relative to said runway from said photograph, different from the first algorithm for determining the aircraft's position relative to said runway from said photograph, then,

[0027] - record information representative of the difference between the first position and the second position determined, in association with an identifier of the landing runway in question, then for

[0028] compare the two recorded pieces of information representing the two smallest position differences between said first determined position and the second determined position from the list of recorded pieces of information representing the position differences between the first determined position and the second determined position, in association with the runways, and, if said difference between the two pieces of information representing the two smallest position differences exceeds a predetermined threshold value:

[0029] provide information representative of the difference between the first determined position and the second determined position for the track for which the difference is the smallest from the list of recorded information representative of the differences,

[0030] and otherwise:

[0031] provide information representative of the difference between the first determined position and the second determined position for the track for which the difference is the smallest among the list of recorded information representative of the differences.

[0032] According to one embodiment, the assistance device further comprises electronic circuitry configured to:

[0033] - execute a first algorithm of the so-called "Perspective-n-Point" type comprising a a method for determining a translation between a runway and a current aircraft position, as well as a method for determining a rotation between said runway and said current aircraft position, and,

[0034] - execute a second algorithm comprising a method for determining a translation between a landing strip and a current position of the aircraft as well as obtaining an aircraft position from information provided by an aircraft inertial navigation system.

[0035] The invention also relates to an aircraft comprising a landing assistance device as previously described.

[0036] The invention finally relates to a computer program product comprising program code instructions for executing the steps of a landing assistance method as previously described, and a storage medium comprising a computer program product as above. Brief description of the drawings

[0037] The features of the invention mentioned above, as well as others, will become clearer upon reading the following description of an exemplary embodiment, said description being made in relation to the accompanying drawings:

[0038] [Fig.l] schematically and symbolically illustrates an aircraft comprising a landing assistance system according to an embodiment facing a destination landing runway;

[0039] [Fig.2] schematically illustrates a projection of the landing strip of the destination already represented on [Fig.1] in an image plane of a front camera of an aircraft allowing to determine a position of the aircraft in relation to this runway;

[0040] [Fig.3] schematically illustrates a landing assistance method according to a method of implementation;

[0041] [Fig.4] schematically and symbolically illustrates an aircraft comprising an landing assistance system according to an embodiment, presented in front of a destination airport facility comprising a plurality of landing runways;

[0042] [Fig. 5] schematically illustrates a landing assistance method according to a another embodiment; and,

[0043] [Fig.6] schematically illustrates an internal architecture of a landing assistance device according to one embodiment.

[0044] DETAILED STATEMENT OF IMPROVEMENTS

[0045] Figure 1 schematically and symbolically represents an aircraft 1 comprising a landing assistance system 10 configured to perform a landing assistance procedure according to an embodiment of the invention. The system 10 is specifically configured to determine the position of the aircraft 1 relative to a destination runway 100a on which the aircraft 1 is expected to land imminently. The destination runway 100a is a runway at an airport facility 100. The runway 100a of the airport facility 100 is elongated and extends along a central axis 100a'. Advantageously, the destination runway 100a is referenced in an RWYDB database directly or indirectly accessible by the aircraft 1's landing assistance system 10.According to one embodiment, the RWYDB database is downloaded into the aircraft 1's assistance system 10, for example, prior to a flight. According to one embodiment, the RWYDB database includes, for each of the airport facility runways listed therein, coordinates of characteristic runway points (corners and midpoints of runway thresholds, for example) in a WGS84 global geodetic format (World Geodesy System). According to one embodiment, the landing assistance system 10 is configured to communicate with a remote server, for example, a database server installed in a ground station, which includes the RWYDB database of airport facility runways. Advantageously, the aircraft 1 is equipped with at least one front-facing camera 10c (shown in [Fig.2]), which is configured to capture images of a sector called the "forward sector," towards which the aircraft is heading when in flight. Preferably, the forward camera 10c is arranged in the radome of aircraft 1. According to variants, the forward camera 10c is arranged on any part of the aircraft fuselage provided that its position is compatible with capturing images of the forward sector, which sector is also generally visible from the cockpit of aircraft 1. The forward camera 10c operates as a conventional image capture device, that is to say, it is configured to capture successive images and provide successive F images, each representative of a view of the environment in front of aircraft 1, from aircraft 1, at the time of capture.According to one embodiment, the front camera 10c is, for example, configured to operate 30 shots per second and to provide 30 F frames per second to the landing assistance device 10. Advantageously, the camera 10c or the landing assistance system. The landing system 10 includes a region of interest detection module configured to detect one or more apparent regions of interest during image acquisition from one of the corresponding F images. In other words, the region of interest detection module is a module comprising electronic circuitry configured to detect one or more objects (regions of interest) of a given type in an F image obtained from the front camera 10c. In the example described, the detected object(s) are landing strips. In one embodiment, the object detection module includes a software or hardware implementation of a deep convolutional neural network (DCNN). Such a DCNN module can consist of a set of numerous artificial neurons, of convolutional or perceptron type, organized in successive interconnected layers.Such a DCNN module is classically inspired by a simplistic model of the functioning of a human brain where many biological neurons are connected to each other by axons. For example, a module called YOLOv4 (from the English acronym "You Only Look Once version 4") is a DCNN type module that allows for object detection in images, and which is said to be "one-stage", that is to say, whose architecture is composed of a single module of combined propositions of rectangles framing objects ("bounding boxes") and classes of objects in the image.In addition to the artificial neurons described above, the YOLOv4 module uses functions known to people skilled in the art such as batch normalization, dropblock regularization, weighted residual connections, and a non-maximal suppression step that eliminates redundant proposals of detected objects.In one embodiment, the object detection module can predict a list of objects present in one or more images of one or more video clips by providing, for each object, a rectangle enclosing the object in the form of point coordinates defining the rectangle in the image, the type or class of the object from a predefined list of classes defined during a training phase, and a detection score representing a degree of confidence in the detection thus performed. Advantageously, the object detection module operating from an image F is configured to extract characteristic point coordinates of each of the landing strips detected in an image F, with reference to the image plane (or image frame) of the image F.For example, the object detection module of aircraft 1 is capable of providing coordinates for the four corners of a runway detected in an F-image, as well as for two points defining a longitudinal centerline of the runway in question. The image plane of the front camera 10c. is defined here as a plane perpendicular to the optical axis of the front camera 10c and an image provided by the camera 10c therefore includes a projection of all the elements seen by the camera into this reference image plane.

[0046] Cleverly and advantageously, it is then possible, for any runway whose characteristic points are referenced in a runway geolocation database, to use the coordinates present in the database or even coordinates of points determined from the coordinates present in the database, as well as the coordinates of the same points of the runway as detected in an image F obtained from the front camera taking a picture to provide this image F, to define a position POS1 of the aircraft at the time of the picture from which the image F originates, thanks to the use of a position determination algorithm of the type "Perspective-n-Point" (from English), also commonly called an algorithm "PnP" is an algorithm designed to determine the relative position, with six degrees of freedom, of a camera (or more precisely, its optical center), positioned on its optical axis of vision, with respect to an object considered in space, and vice versa. This is achieved using a set of correspondences between points Mi referenced in a spatial frame of reference X, Y, Z and their respective projections mi onto an image plane obtained from the camera. For example, an algorithm for determining the position of an aircraft relative to an object in space, such as a runway, can determine the position of camera 10c from the geodetic coordinates of corners A, B, C, D of runway 100a and the coordinates in image F (and therefore in the graphical frame of reference of image F) of points a, b, c, d, which represent points A, B, C, and D in image F provided by the front-facing camera 10c.

[0047] The [Fig.2] illustrates a relative position of aircraft 1 in flight facing the runway. landing runway 100a of destination whose four corners are identified and referenced A, B, C, D. Figure 2 further illustrates an image F as provided by the forward camera 10c of aircraft 1 and in which appears a representation of runway 100a, detected by the object detection module of aircraft 1 configured to detect one or more landing runways in the image F provided by the forward camera 10c. The image F includes a representation a, b, c, d in the coordinate system u, v of the points of the image F, of the characteristic points A, B, C and D which are the corners of the landing runway 100a in the real world. In one embodiment, geodetic coordinates xA, yA, zA; xB, yB, zB; xC, yC, zC and xD, yD, zD respectively associated with points A, B, C, D are known and recorded in the RWYDB database of landing strips with reference to a spatial reference X, Y, Z.

[0048] According to one embodiment, the aircraft landing assistance system 10. 1 is configured to determine and determines, for at least one image F, a first position POS1 of the optical center lOf of the camera 10c, and therefore consequently of the aircraft 1 relative to the runway 100a thanks to a first algorithm, of the type PnP algorithm. The PnP algorithm executed according to the invention, also called the algorithm for determining a relative position between two objects, and which proceeds by operating in particular here a projection or "reprojection" of a destination runway (here the runway 100a) in an image plane of the front camera 10c (here, for example, the image plane of the image F), is not detailed further in the present description since the numerous calculation operations carried out according to such an algorithm are known and its detailed description is not useful for understanding the invention.

[0049] Furthermore, the landing assistance system 10 of aircraft 1 is configured to determine and does determine, for at least image F, a second position POS2 of the optical center lOf of the camera 10c, and therefore consequently of aircraft 1 relative to the runway 100a, by means of a second algorithm, different from the first algorithm, which also determines a position of aircraft 1 relative to the destination runway (here again, runway 100a), for example by taking into account the attitude of aircraft 1 at the time of determining this second position POS2. The attitude of aircraft 1 here refers to the position of the axes of aircraft 1 with respect to a reference trihedron, such as, for example, the X, Y, Z coordinate system shown in [Fig. 2].Advantageously and cleverly, the landing assistance system 10 of aircraft 1 is configured to calculate a position difference APOsi,pos2 between the two determined positions POS1 and POS2, and then to provide information representative of this position difference APOsi,pos2. For example, if the position difference APOsi,pos2 is less than a predetermined threshold 1, this means that the two positions POS1 and POS2 are consistent with each other and that the position of aircraft 1 is correct with respect to the destination runway 100a on which a landing is imminently planned. In this case, the landing assistance system provides information G indicating that the aircraft's position is satisfactory for a landing on the destination runway 100a.Conversely, if the difference APOsi,pos2 between the two determined positions POS1 and POS2 exceeds the threshold SI, this means that there is an inconsistency between positions POS1 and POS2 and the landing aid system provides information B indicating that an inconsistency exists and must be considered for subsequent landing operations.

[0050] Information G and B can take various forms, for example, a term displayed on a control screen, a pictogram, an audible or haptic signal. Obviously, information G and B take sufficiently different forms to be easily distinguishable. According to one embodiment, information G is a green light activated in reference to a runway identifier on an approach chart and information B is a flashing red light accompanied by an audible warning signal, doubled by a haptic signal.

[0051] According to one embodiment, each of the information G and B can initiate subsequent processing such as, for example, a final approach flight assistance process to the destination runway 100a, with regard to information G, or a landing procedure interruption process (go-around) with regard to information B.

[0052] The [Fig.3] is a flowchart illustrating steps of a landing assistance process for aircraft 1 carried out by the landing assistance system 10.

[0053] An S30 step is an initial step at the end of which the assistance system 10 is normally operational, the front camera 10c performs successive image acquisitions, and the aircraft object detection module 1 identifies at least one representation of a landing runway in an image F provided by the front camera 10c. In particular, at the end of step S0, the landing assistance system 10 has representations of feature points in the feature point image F of the destination runway 100a as referenced in the RWYDB database of aircraft landing runways.

[0054] A first position POS1 of aircraft 1 with respect to the destination landing runway 100a is then determined in step S31, via the execution of the first algorithm for determining a position of aircraft 1, of type PnP, then a second position POS2 of aircraft 1 with respect to the destination landing runway 100a is then determined in step S32, via the execution of the second algorithm for determining a position of aircraft 1, different from the first algorithm for determining a position of aircraft 1.

[0055] According to one embodiment, the first algorithm, of the PnP type, includes a method for determining a translation T between a destination runway and a current position of the aircraft 1 as well as a method for determining a rotation R between the destination runway and the current position of the aircraft 1, and the second algorithm includes a method for determining a translation T between a landing runway and a current position of the aircraft 1 as well as obtaining a more precise position of the aircraft 1 from information provided by an inertial measurement unit of the aircraft (successive information of movements of the aircraft along a roll axis, a pitch axis and a yaw axis, as well as the related accelerations).Such an inertial navigation system, also commonly called an inertial navigation system, or INS (acronym for the English "Inertial Navigation System") is an instrument used in navigation, configured to measure the movements of the aircraft and in particular to determine (or estimate) values. acceleration and velocity are measured to successively estimate the aircraft's orientation in space (roll, pitch, and heading angles relative to a spatial reference frame, also known as "aircraft attitude"), as well as its linear velocity and position. The position estimate is relative to the aircraft's starting point or an intermediate reference point. Such an inertial navigation system (INS) can provide air navigation data such as heading, track, drift, speed, and position.Cleverly, the second algorithm for determining the position of aircraft 1 relative to its destination runway is sufficiently different from the first algorithm for determining the aircraft's position relative to its destination runway to detect an inconsistency in the determined position of aircraft 1. This could occur, for example, if confusion arises due to degraded shooting conditions from camera 10c (due to weather conditions, for instance), or if a runway close to the destination runway is detected but the aircraft is not correctly positioned facing the destination runway on which an imminent landing is planned. A position difference APOsi,pos2=I POS1 - POS2I is then determined by the landing assistance system 10 in step S33 and subsequently stored in aircraft 1's memory during step S34.Representative information of the position difference Aposi,pos2=I POS1 - POS2I is therefore provided for subsequent processing. It should be noted that steps S31, S32, S33 and S35 constitute a sequence or step S51 as described later in the description in relation to [Fig.5], in an example embodiment adapted to the case where the destination airport facility comprises a plurality of runways, among which is the destination runway.

[0056] Fig. 4 schematically illustrates the existence of a plurality of landing strips 100a, 100b and 100c of the airport facility 100 which includes the destination landing strip 100a towards which aircraft 1 moves and on which aircraft 1 is expected to land.

[0057] Figure 5 is a flowchart illustrating a landing assistance method according to an advantageous embodiment where the destination airport facility 100 comprises a plurality of runways such as, for example, runways 100a, 100b, and 100c already described in relation to Figure 4. According to one embodiment, the landing assistance method described herein operates the method previously described in Figure 3 for each of the existing runways 100a, 100b, and 100c in the airport and detected by the forward camera 10c of the aircraft 1, then considers the two runways for which the determined position difference relative to that runway is the smallest, and then performs a filtering process to eliminate a "false positive" type error before providing a final information.

[0058] To this end, an initialization step S50 constitutes an initial step at the end of which the assistance system 10 is normally operational, the front camera 10c performs successive image acquisitions, and the aircraft object detection module 1 identifies a plurality of runway representations in an image F provided by the front camera 10c. In particular, at the end of step S50, the landing assistance system 10 has feature point representations in the image F of the destination runways 100a, 100b, and 100c as referenced in the RWYDB aircraft runway database.

[0059] An S51 step is then performed as many times as there are landing strips detected in image F provided by the front camera 10c. Step S51 aims to record information representative of a position difference relative to the considered runway (among runways 100a, 100b, and 100c detected in image F) obtained by comparing two positions of aircraft 1 using two algorithms for determining an aircraft's position relative to a given runway and from an image provided by the front camera 10c. Step S51 is a sequence composed of steps S31, S32, S33, and S34 previously described in relation to [Fig. 3]. After each iteration of step S51, step S52 verifies whether all the runways detected in image F have been processed by step S51. If so, the process continues sequentially to step S53, and otherwise, the process loops back to step S51 to process one of the detected landing strips not yet processed by step S51.Thus, if n runways are detected in the image F, or more precisely three representations of runways are detected in the image F, the process iteratively executes step S51 three times and it is possible to write that n = 3 is the number of runways to be processed, and step S51 is carried out iteratively with a repetition index i going from 1 to n, so as to define for each of the detected runways, a first position determined POSli using a first algorithm for determining the position of an aircraft such as "A2" and a second position determined POS2i using a second algorithm for determining the position of an aircraft such as "A2" (Attitude), different from the first algorithm for determining the position of an aircraft.According to the example described, when the three landing runways detected in image F have been processed, the landing assistance system 10 therefore has six determined positions, with two determined positions for each of the three landing runways detected in image F: .

[0060] TRACK POSITION according to "PnP" POSITION according to "A2"

[0061] TRACK 100a POS11 (xll, y 11, zl 1) POS21 (x21, y21, z21)

[0062] TRACK 100b POS12 (xl2, yl2, zl2) POS22 (x22, y22, z22)

[0063] TRACK 100c POS13 (xl3, y 13, zl3) POS23 (x23, y23, z23)

[0064] The position differences successively determined during the iterations of step S51 are:

[0065] Rank i DIFFERENCE TRACK IPOS1 - POS2I

[0066] 1 TRACK 100a Alrosn, pos2i

[0067] 2 TRACK 100b A2POSi2, pos22

[0068] 3 TRACK 100c A3POsi3,pos23

[0069] It is then determined in step S53 which track has the smallest (least) difference in position between positions POS1 and POS2i. Then it is determined in step S54 which track has the second smallest difference in position between positions POS1 and POS2i.

[0070] The track for which the position difference IPOS1 - POS21 is the smallest is here named Amin1POs1,pos21,

[0071] and the track for which the position difference IPOS li - POS2il is the second smallest is named Amin2POsii,pos2i-

[0072] According to an example embodiment, the smallest difference is:

[0073] AminlPosiii,pos2i — A2Posi2jpos22,

[0074] and the second smallest difference among A1POsh,pos2i, A2POsi2,pos22 and A3Posi3,pos23 is:

[0075] Amin2POs imposes=A1POS11,POS21.

[0076] A filtering process is then carried out in step S55 to detect whether the differences Amin1Posii,posa = A2Posi2,pos22 and Amin2Posii,posa = A1Posii,pos2i are sufficiently numerically distinct from each other to avoid any risk of confusion between the two runways for which the level of consistency of the determined position of aircraft 1 is highest. In other words, it is determined here whether it is possible to discriminate, without risk of error, the runway for which the difference between positions POS1 and POS2 is the smallest, compared to the other runways detected and considered successively in step S51.

[0077] In the case where the difference between Amin1POsii,pos2i and Amin2POsii,pos2i is greater than a predetermined threshold value S2, there is good discrimination and the landing assistance system 10 provides the flight crew of aircraft 1 and / or a system of aircraft 1 with information representative of this difference in association with an identifier of the runway in question, intended to indicate that there is a good correlation (or consistency) between the position of aircraft 1 and the runway in question, which is equivalent to saying that the runway in question is the one facing aircraft 1. Thus, if it is the destination runway, the provision of the information representative of The association of Aminlposii,pos2i with a runway identifier confirms the correct positioning of aircraft 1 heading towards that destination runway. In one embodiment, the information representing the difference AminlPOsii,pos2i is the difference Aminlposii,pos2i itself. If the difference between AminlPOsii,pos2i and Amin2POsii,pos2i is not greater than the predetermined threshold value S2, the landing assistance system 10 provides the flight crew of aircraft 1 and / or a system of aircraft 1, during a step S57, with information indicating that it is not possible to distinguish between the two landing runways for which the respective determined position differences of aircraft 1 relative to the runway in question are the smallest among all those determined for the detected runways.According to one embodiment, when it is not possible to discriminate between the two landing runways for which the respective differences in determined position of aircraft 1 relative to the runway in question are the smallest, the landing aid system 10 provides no information, which then amounts to considering that the system is unable to confirm a correct positioning of aircraft 1 relative to the intended destination runway.

[0078] According to one embodiment, representative information of the position difference between positions POS1 and POS2i is provided by the landing assistance system for each of the runways detected in the image F obtained from the front camera 10c. For example, an indicator associated with an identifier for each of the detected runways illustrates a level of difference between the positions respectively determined via the two runway reprojection algorithms in the image plane of the image F. The indicator can be a displayed rate, a bar graph, or the color of an indicator light, by way of example.

[0079] Figure 6 is a schematic representation of an example of the internal architecture of the landing assistance system 10, also referred to herein as the landing assistance device 10. For illustrative purposes, Figure 6 illustrates an internal arrangement of the landing assistance system 10 as installed in the aircraft 1. It should be noted that Figure 6 could also schematically illustrate an example of the hardware architecture of the landing assistance system 10 in a configuration where the landing assistance system 10 is external to the aircraft 1 and communicates with the latter via one or more wireless communication links.

[0080] According to the hardware architecture example shown in [Fig. 6], the landing assistance system 10 then comprises, connected by a communication bus 19: a processor or CPU (Central Processing Unit) 11; a RAM (Random Access Memory) 12; a ROM (Read Only Memory) 13; a storage unit such as a hard drive (or a storage media reader, such as an SD card reader) (Secure Digital). English) 14; a communication interface module 15 enabling the landing assistance system 10 to communicate with remote devices, such as other onboard systems of the aircraft 1 including the front camera 10c, a database server, or such as the aircraft 1, as appropriate.

[0081] The processor 11 of the landing assistance system 10 is capable of executing instructions loaded into RAM 12 from ROM 13, external memory (not shown), storage media (such as an SD card), or a communication network. When the landing assistance system 10 is powered on, the processor 11 is capable of reading instructions from RAM 12 and executing them. These instructions form a computer program causing the processor 11 to implement all or part of a landing assistance method described in relation to [Fig. 3] or all or part of a landing assistance method described in relation to [Fig. 5], or described variants of these methods.

[0082] All or part of the methods described in relation to [Fig. 3] and [Fig. 5] or their described variants can be implemented in software form by executing a set of instructions by a programmable machine, for example a DSP (Digital Signal Processor) or a microcontroller, or be implemented in hardware form by a dedicated machine or component, for example a FPGA (Field-Programmable Gate Array) or an ASIC (Application-Specific Integrated Circuit). In general, the landing assistance system 10 comprises electronic circuitry configured to implement the described methods in relation to itself.Of course, the landing assistance system 10 also includes all the elements usually present in a system comprising a control unit and its peripherals, such as a power supply circuit, a power supply monitoring circuit, one or more clock circuits, a reset circuit, input / output ports, interrupt inputs, bus drivers, this list being non-exhaustive.

[0083] The invention is not limited to the examples and embodiments described above but relates more broadly to any landing assistance method and any system performing this method which compares two determined positions of the aircraft with respect to a predefined destination runway, from a shot taken from a front camera of the aircraft, from information extracted from a shared database of landing runway characteristics and from at least two different algorithms for reprojecting a destination runway into an image plane of said front camera.

Claims

Claims

1. Method for assisting the landing of an aircraft (1) on a runway landing strip (100a) of a destination airport facility (100), said method comprising a determination (S31) of a first position (POS1) of said aircraft (1) relative to said predefined landing strip (100a), from a shot (F) taken from said aircraft (1), coordinates of said runway (100a) in a database (RWYDB), and a first algorithm (PnP) for determining a position of the aircraft relative to said runway (100a) from said shot (F), the method being characterized in that it further comprises: a determination (S32) of a second position (POS2) of said aircraft (1) relative to said landing runway (100a), from said shot (F) taken from the aircraft (1), said coordinates of said runway in said database (RWYDB), and a second algorithm (A2) for determining a position of the aircraft relative to said runway (100a) from said shot (F), different from said first algorithm (PnP), then, providing (S33) information representative of the difference (Aposi,pos2) between the first position (POS1) determined and the second position (POS2) determined.

2. Method for assisting the landing of an aircraft according to claim 1, wherein the airport facility (100) comprises a plurality of landing runways (100a, 100b, 100c), the method comprising, for each of the landing runways (100a, 100b, 100c) of said destination airport facility (100), considered successively: a determination (S51, S31) of a first position (POSli) of said aircraft (1) relative to the ith landing runway considered (100a, 100b, 100c), from a shot (F) taken from the aircraft (1), of coordinates of said ith runway (100a, 100b, 100c) in a database, and of said first algorithm (PnP), a determination (S51, S32) of a second position

3. (POS2i) of said aircraft (1) relative to said ith landing runway (100a, 100b, 100c), from a shot (F) taken from the aircraft (1), of said coordinates of said ith runway (100a, 100b, 100c) in said database, and of said second algorithm (A2), different from said first algorithm (PnP), then, - record information representative of the difference (Ai posii,pos2i) between said first position (POSli) and the second position (POS2i) determined, in association with an identifier of said ith track considered (100a, 100b, 100c), then comparing the two recorded information representative of the two smallest differences (AminlPOsi.pos2, Amin2POsi,pos2) of position between said first position (POSli) and the second position (POS2i) among the list of recorded information representative of the differences of position (AiPOsii,pos2i) between said first position (POSli) and the second position (POS2i) in association with said landing strips (100a, 100b, 100c), and, if the difference between said two information representative of the two smallest differences of position exceeds a predetermined threshold value: providing information (G) representative of the difference (AminlPOsii, posa) between the first position (POSli) determined and the second position (POS2i) determined for the track (100a, 100b, 100c) for which said difference is the smallest among the list of recorded information representative of the position differences (AiPOsii,pos2i), and otherwise: provide information (B) according to which it is not possible to discriminate the two landing runways associated with the two pieces of information representing the two smallest position differences (A1POsi,pos2, A2POS1,POS2)- Method for assisting the landing of an aircraft on a runway of a destination airport facility according to one of claims 1 and 2, in which: - said first algorithm (PnP) is an algorithm of the so-called “Perspective-n-Point” type comprising a method for determining a translation between a landing runway and a current position of the aircraft as well as a method for determining a rotation between said landing strip and said current position of the aircraft, and, - said second algorithm (A2) comprises a method for determining a translation between a landing strip and a current position of the aircraft as well as obtaining the position of the aircraft from information provided by an inertial unit of said aircraft.

4. Landing assistance device (10) for an aircraft (1) on a predefined landing runway (100a) of a destination airport facility (100), said device (10) comprising electronic circuitry configured to perform a determination (S31) of a first position (PO1) of said aircraft relative to said predefined landing runway (100a), from a shot (F) taken from the aircraft (1), coordinates of said runway (100a) in a database, and a first algorithm (PnP) for determining a position of the aircraft relative to said runway (100a) from said shot (F), the assistance device (10) being characterized in that it further comprises electronic circuitry configured to perform: - a determination (S32) of a second position (POS2) of said aircraft (1) relative to said landing strip (100a), from a shot (F) taken from the aircraft (1),of said coordinates of said runway (100a) in said database, and of a second algorithm (A2) for determining a position of the aircraft relative to said runway (100a) from said shot (F), different from said first reprojection algorithm (PnP), and for, - providing (S33) information representative of the difference between the first determined position (POS1) and the second determined position (POS2).,

5. Landing assistance device (10) for an aircraft (1) according to claim 4, comprising electronic circuitry configured to, when the airport facility comprises a plurality of landing runways, operate for each of the landing runways of

6. said destination airport facility, considered successively: - a determination of a first position of said aircraft relative to the landing runway in question, from a shot taken from the aircraft, coordinates of said runway in a database, and said first algorithm, - a determination of a second position of said aircraft relative to said landing runway, from a shot taken from the aircraft, of said coordinates of said runway in said database, and of said second algorithm different from said first algorithm, then, - record information representative of the difference between said first position and the second position determined, in association with an identifier of said track considered, then to comparing the two recorded information representative of the two smallest position differences between said first position and the second position from the list of recorded information representative of the position differences between said first position and the second position in association with said landing strips, and, if said difference between said two information representative of the two smallest position differences exceeds a predetermined threshold value: provide information representative of said difference between the first determined position and the second determined position for the track for which said difference is the smallest among the list of recorded information representative of the differences, in association with an identifier of said track for which said difference is the smallest, and otherwise: provide information that it is not possible to discriminate between the two landing runways associated with the two pieces of information representing the two smallest position differences. Landing assistance device (10) according to one of claims 4 and 5, further comprising electronic circuitry configured to: - execute a first algorithm of the so-called “Perspective-n-Point” type comprising a method for determining a translation between a landing runway and a current position of the aircraft as well as a method for determining a rotation between said landing runway and said current position of the aircraft, and, - execute a second algorithm comprising a method for determining a translation between a landing runway and a current position of the aircraft as well as obtaining an altitude of the aircraft at said current position of the aircraft from information provided by an inertial unit of said aircraft.

7. Aircraft (1) comprising a landing assistance device (10) according to one of claims 4 to 6.

8. Computer program product comprising program code instructions for executing the steps of a method according to one of claims 1 to 3 when said instructions are executed by a processor of an aircraft landing assistance device.

9. A storage medium comprising a computer program product according to claim 8.

Citation Information

Patent Citations

  • Determining a current pose estimate of an aircraft relative to a runway to support the aircraft on approach

    US20220198703A1