Method for controlling a plurality of control stations of an aircraft and associated control system
The method and system for controlling aircraft control stations using a portable electro-terminal address the limitations of existing methods by providing an intuitive and ergonomic solution for visual inspection and real-time validation, thereby improving the reliability and efficiency of aircraft control processes.
Patent Information
- Application Number
- FR2021006987
- Authority / Receiving Office
- FR · FR
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-06-29
- Publication Date
- 2025-06-27
- Estimated Expiration
- 2041-06-29
AI Technical Summary
Existing methods for controlling aircraft control stations lack intuitiveness and ergonomics, particularly in visual inspection and component identification, and are not suitable for real-time validation of inspection results.
A method and system utilizing a portable electro-terminal that determines the current position relative to the aircraft, identifies and displays images of control stations, superimposes graphical interface components for inspection, and allows for real-time validation and storage of inspection results.
The solution enhances the reliability and intuitiveness of visual control processes, improves ergonomics, and facilitates operator training by providing a user-friendly interface for inspecting aircraft components and validating inspection results in real-time.
Smart Images

Figure 00000023_0000 
Figure 00000023_0001 
Figure 00000024_0000
Abstract
Description
Title of the invention: Method for controlling a plurality of control stations of an aircraft and associated control system
[0001] The present invention relates to a method and a system for controlling a plurality of control stations of an aircraft. Such a control station may for example consist of an area or a part of the aircraft comprising at least one component to be inspected by an operator.
[0002] Such a control method must in fact be regularly carried out on the ground on an aircraft, for example every ten hours of flight, in order to maintain an optimal level of safety during the flight phases. Such a control method can be carried out for example by a technician or even by a pilot of the aircraft and consists of inspecting various areas of the aircraft such as, for example, a part of the fuselage, aerodynamic members forming a fixed wing or empennages, a rotorcraft rotor, landing gear, a propeller, an engine, etc.
[0003] Each of these areas of the aircraft then forms a control station which can have one or more components to be controlled.
[0004] Generally speaking, the known inspection methods consist of using an aircraft manual showing the different inspection stations and the components to be inspected. The operator then takes a tour of the aircraft with this manual and possibly searches in the pages of this manual for problems that he might encounter and the different components to be checked.
[0005] Document US 2018 / 232132A1 describes a three-dimensional visualization system for different parts of an aircraft for training a technician in a control process.
[0006] However, such a system is virtual and does not directly use the aircraft. Thus, such a system may have limited intuitiveness for enabling inspection of aircraft components.
[0007] Alternatively, document US 2018 / 118376A1 describes a method for carrying out a rapid check prior to each flight phase of an aircraft using portable electrical equipment. Such portable electrical equipment can then communicate remotely with a plurality of sensors to verify that the aircraft can carry out this flight phase.
[0008] Furthermore, such a method is not suitable for allowing visual inspection by an operator of parts of the aircraft to be inspected.
[0009] The present invention therefore aims to propose an alternative control method making it possible to overcome the limitations mentioned above. Furthermore, such a The control process is very intuitive to implement and the control system therefore has optimal ergonomics.
[0010] The invention therefore relates to a method for controlling a plurality of control stations of an aircraft, each control station comprising at least one component to be inspected by an operator.
[0011] According to the invention, such a control method is remarkable in that it comprises the following steps: - determination of a current position of a portable electro-terminal relative to the aircraft, the portable electro-terminal being carried by the operator, - identification with the portable electro-terminal of a current control station among the plurality of control stations, - determination of at least one current image of the aircraft representative of the current control station, - display on a screen of the portable electro-terminal of the current image(s) of the aircraft, - display on the screen of at least one graphical interface component corresponding to said at least one organ to be inspected of the current control station, the graphical interface component(s) being displayed superimposed on the current image(s), and - selection on the portable electroportable terminal and storage in a memory of a result relating to an inspection of the organ(s), the result corresponding to a validated state or an unvalidated state of the organ(s) inspected.
[0012] In other words, such a control method is implemented by the operator using the portable electro-terminal and moving around the aircraft from control station to control station. Preferably, the operator can follow a predefined path by following, for example, a numerical order of the different control stations.
[0013] This control method thus makes it possible to improve the reliability of the visual control of the components of an aircraft to be inspected; it can be used directly by a trained operator or even be used for operator training.
[0014] Such a method thus makes it possible to identify, from a current position of the portable electro-terminal relative to the aircraft, a current control station. The current control station can be chosen, for example, as a function of the distance separating the portable electro-terminal from this control station.
[0015] Furthermore, zones can also be delimited all around the aircraft and each zone can then correspond to at least one control station.
[0016] Once the current control station has been identified, the method makes it possible to display one or more current images of the aircraft corresponding to this control station. current. Such current images can, for example, be acquired in advance and stored or acquired in real time.
[0017] The graphical interface component(s) are then superimposed on the current image(s) in order to indicate to the operator directly on at least one image of the current image(s) the component(s) to be inspected. Such a superposition thus makes it possible to make the control of the aircraft components intuitive and to facilitate the identification of the component(s) to be inspected from the current control station. The operator sees on the screen a three-dimensional or perspective representation of the component that he must inspect on the aircraft with, for example, a particular outline color delimiting this component on the current image(s).
[0018] A three-dimensional model of the aircraft is thus previously generated and stored. This three-dimensional model then includes a set of graphical interface components such as contours delimiting, for example, a shape, an area, a volume, etc.
[0019] Such graphical interface components are then displayed in a particular color visible superimposed on a current image. The graphical interface components can also be displayed, for example, by generating a flashing effect or any other effect making it possible to highlight an area of the image comprising the organ to be inspected.
[0020] Furthermore, the portable electro-terminal carried by the operator may be of the monolithic type and is for example formed by a computer, a tablet having a touch screen, a headset or an equivalent or even a “smartphone”.
[0021] According to an alternative of the invention, the portable electro-terminal worn by the operator can also be formed by several separate parts. Thus, such a portable electro-terminal can comprise, for example, a screen located at the level of the operator's eyes, for example on a helmet, a visor or even a pair of glasses, and a central unit worn, for example, in the operator's hand or in a pocket of clothing.
[0022] Advantageously, the control method can comprise the following steps:
[0023] • determination and display on the screen of at least one instruction corresponding to said at least one component to be inspected of the current control station, another memory storing for each component one or more instructions, and • selection by means of the portable electro-terminal of the instruction(s) by the operator.
[0024] In other words, the control method makes it possible to remind the operator of all the inspection instructions corresponding to the inspected organ. The portable electroportable terminal is then used to view a list corresponding to the different instructions on the screen and to choose from this list one of the instructions to display in detail, for example next to the current image.
[0025] Optionally, the memory storing the result of each inspection and the other memory storing the inspection instructions may form a monolithic set and correspond to different storage areas of this monolithic set.
[0026] In practice, for each of the instructions, the control method may comprise the following steps:
[0027] • determination of a state datum representative of a current state of each instruction of said at least one inspected member, the current state being chosen from the group comprising a validated instruction state, a non-validated instruction state, a forgotten instruction state and a non-performed instruction state, • storage of state data, and • display of status data on the screen.
[0028] For example, such status data may be displayed using a predetermined color code. According to an exemplary embodiment, the color of a background displayed at each of the instructions may vary depending on the status data.
[0029] Thus, when the current state of an instruction is the validated instruction state, the background color of this instruction may be green. When the current state of an instruction is the unvalidated instruction state, the background color of this instruction may be red.
[0030] When the current state of an instruction is the forgotten instruction state, the background color of that instruction may be orange. Such a current state may be displayed when the operator passes an instruction without validating it or declaring it invalid.
[0031] When the current state of an instruction is the instruction not executed state, the background color of this instruction can be blue.
[0032] When the current state of an instruction is the unvalidated instruction state, the operator may possibly have to fill out a form with the name of the unvalidated organ(s). Once the form is filled out, the control method can automatically move on to the next instruction having a state of unperformed instruction or a state of forgotten instruction of an organ to be inspected.
[0033] As long as the current state of at least one instruction of a member to be inspected is in the state of unvalidated instruction, the state of unperformed instruction or the state of forgotten instruction, then the result relating to the inspection of this member corresponds to an unvalidated state.
[0034] On the other hand, when all the instructions of a member to be inspected are in the validated instruction state then the result relating to the inspection of this member corresponds to a validated state.
[0035] Thus, the selection of the result corresponding to a validated state of the inspected organ can implemented automatically when all instructions of this body are in the validated instruction state.
[0036] According to a first mode of operation, the control method may comprise a selection of a mode of operation in virtual reality, the determination of the current image(s) of the aircraft being carried out by selection of the current image(s) from a plurality of stored images of the aircraft.
[0037] In other words, the current images displayed on the portable electro-terminal are images previously acquired from the aircraft then stored in a memory which can advantageously be fully or partially embedded in the portable electro-terminal.
[0038] According to a second operating mode implemented in a complementary or alternative manner, the control method may comprise a selection of an operating mode in augmented reality, the determination of at least one current image of the aircraft being carried out by means of a camera integrated into the portable electro-terminal.
[0039] In this case, the current images displayed on the portable electro-terminal are acquired by the camera and then directly displayed on the screen. Storing of the images may be carried out if necessary but is not obligatory in this augmented reality operating mode.
[0040] Furthermore, the graphical interface component(s) are then calculated in real time from a predetermined model and to be able to be displayed superimposed on the current image(s). For example, the graphical interface component(s) of the model can undergo geometric transformations allowing them to be perfectly adapted in the current image displayed on the screen so as to correspond with an organ to be inspected as faithfully as possible.
[0041] In practice, the control method may comprise an acquisition of at least one image of the organ(s) to be inspected carried out by means of a camera integrated into the portable electro-terminal and a transmission of the image(s) from the portable electro-terminal to an external server.
[0042] The operator can thus film or photograph an aircraft component using the portable electro-terminal. The image(s) thus acquired can then be transmitted via, for example, a wireless communication protocol to the external server in order to be able to carry out analyses from these images.
[0043] According to an exemplary embodiment of the invention compatible with the previous ones, the control method may comprise a recalibration of the graphical interface component(s) with respect to the at least one current image, the recalibration being carried out by means of at least two electromagnetic signal transmitters arranged on the aircraft, the transmitters making it possible to emit electromagnetic signals at 360 degrees around the aircraft.
[0044] Such electromagnetic signal transmitters thus make it possible to identify accurately the position of the portable electric terminal relative to the aircraft.
[0045] Such transmitters can for example be arranged at or near the different stations to be inspected and for example near a door pillar, a tail boom, a nose or even an engine hood.
[0046] These transmitters can be powered by electricity using a power line or a dedicated rechargeable battery. Furthermore, such transmitters can be advantageously positioned inside the aircraft.
[0047] The transmitters can also use a low-frequency wireless communication protocol such as that deployed for example on the network of the company “Sigfox” or even a radio-identification protocol of the RFID type, acronym for the English expression “Radio Frequency Identification”, using a radio-tag arranged for example on the portable electro-terminal.
[0048] Alternatively or in a complementary manner, the recalibration can also be carried out by means of other recognition systems arranged on the aircraft. Such other systems can also be used in addition to improve the measurement accuracy of the relative position of the portable electro-terminal with respect to the aircraft or in the event of failure of one of the electromagnetic signal transmitters. Furthermore, the measurement accuracy can be improved by combining the position information from the at least two electromagnetic signal transmitters and the position information from another complementary system.
[0049] Advantageously, the control method may comprise an additional acquisition of images of said at least one member to be inspected, the additional acquisition being carried out by means of a remote camera arranged on another aircraft in flight, the additional acquisition of images making it possible to carry out a recalibration of the graphical interface component(s) with respect to said at least one current image.
[0050] Such another aircraft may be pilotless and for example be a multirotor type drone. This drone can then perform a flight phase around the aircraft and communicate with the portable electro-terminal to transmit the images from the remote camera.
[0051] Such additional image acquisition can then allow the pilot to remain seated in the cockpit of the aircraft, or elsewhere, and then display these real images of the aircraft on the screen of the portable electro-terminal. Furthermore, one or more aircraft can be used simultaneously to perform image acquisitions, for example at several control stations at the same time. Optionally, thanks to these images displayed on the screen, the operator can choose, in case of doubt, to visually check one or more components to be inspected at one or more control stations.
[0052] According to another exemplary embodiment of the invention compatible with the previous ones, for each of the control stations of the plurality of control stations, the control method may comprise the following steps:
[0053] • determination of status data representative of a current status of said at least one control station, the current status being chosen from the group comprising the fully validated status corresponding to the validated state of each of the inspected members, the non-validated status corresponding to the non-validated state of at least one of the inspected members, a status in progress of inspection of a control station and a status of inspection not carried out of a control station, • storage of status data, and • display of status data on the screen.
[0054] By analogy with the status data of an instruction, such status data can also be displayed using a predetermined color code. According to an exemplary embodiment, the color materializing the control station on the screen can vary depending on the status data of each station.
[0055] Thus, when the current status of a control station is the fully validated status, the color of the station can be green. When the current status of a control station is the non-validated status, the color of this station can be red.
[0056] When the current status of a control station is the status in progress of inspection, the color of the station may be orange. When the current status of a control station is the status of inspection not performed, the color of this station may be blue.
[0057] When the current state of an instruction is the inspection not performed state, the background color of this instruction can be blue.
[0058] According to an advantageous example, the control method may comprise a display on the screen of position data representative of the current control station.
[0059] Such position data may for example comprise a circular dial provided with several points equally distributed in azimuth around an aircraft represented in a top or bottom view on the screen. One of the points corresponding to the current control station may then for example be displayed with a color distinct from that corresponding to the other points.
[0060] The present invention also relates to a system for controlling a plurality of control stations of an aircraft, each control station comprising at least one component to be inspected by an operator.
[0061] According to the invention, such a control system is remarkable in that it comprises: - a portable electro-terminal carried by the operator, the portable electro-terminal comprising a screen and a selection interface, - a sensor for determining a current position of the portable electric terminal by report to the aircraft, - a unit for identifying a current control station among the plurality of control stations, - a device for determining at least one current image of the aircraft representative of the current control station, the determination device being configured to display the current image(s) of the aircraft on the screen, - a storage unit for storing a three-dimensional model of the aircraft, the model comprising at least one graphical interface component corresponding to said at least one organ to be inspected of the current control station, and - a processing unit configured to display the graphical interface component(s) superimposed on the current image on the screen, and in that the selection interface makes it possible to select a result relating to an inspection of said at least one organ, the result corresponding to a validated state or an unvalidated state of said at least one inspected organ, this result being stored in a memory.
[0062] In other words, such a system for controlling a plurality of control stations makes it possible to identify, by means of the sensor, the current position of the portable electro-terminal relative to the aircraft.
[0063] Depending on this current position of the portable electro-terminal, the identification unit deduces which is the current control station. Such a current control station may for example be the control station having the smallest distance from the portable electro-terminal.
[0064] Optionally, when the operator selects the validated state of the single organ of a control station, or of all the organs of a control station, the identification unit can automatically identify the next control station according to a predefined order and stored as being the new current control station.
[0065] The body for determining at least one current image can then choose and display a current image of the aircraft on the screen corresponding to this current control station.
[0066] Furthermore, the three-dimensional model of the aircraft may in particular be chosen as being a virtual reality or even augmented reality model.
[0067] The processing unit is further configured to display the graphical interface component(s) by possibly performing a cropping to match this or these graphical interface components with the current image displayed.
[0068] The control system can, for example, serve as a tool facilitating the training of operators by improving the ergonomics of the control of the various parts to be inspected.
[0069] According to an advantageous embodiment, the identification unit, the member for determining at least one current image and the processing unit can be also arranged on the portable electro-terminal. In addition, the identification unit, the member for determining at least one current image and the processing unit can be formed by the same computer or by several computers connected together to communicate.
[0070] Furthermore, the identification unit, the member for determining at least one current image and the processing unit may for example each comprise respectively at least one processor and at least one memory, at least one integrated circuit, at least one programmable system, at least one logic circuit, these examples not limiting the scope given to the expressions “identification unit”, “member for determining at least one current image” and “processing unit”. The term processor may designate a central processing unit known by the acronym CPU, a graphics processing unit GPU, a digital unit known by the acronym DSP, a microcontroller, etc.
[0071] Furthermore, the selection interface of the portable electro-terminal may be, for example, a pointing device, a keyboard or even a touch screen superimposed on the screen. The portable electro-terminal may, for its part, be formed by, for example, a computer, a tablet, a “smartphone”.
[0072] Advantageously, such a control system may comprise a device for determining and displaying on the screen at least one instruction corresponding to said at least one member to be inspected of the current control station, the instruction(s) being stored in another memory, the screen being configured to display the instruction(s), the selection device of the portable electro-terminal allowing the operator to select the instruction(s).
[0073] Such a device for determining and displaying at least one instruction thus makes it possible to list, for example, in a table or a column all the instructions corresponding to the organs to be inspected for a given control station.
[0074] In practice, the portable electroportable terminal may comprise the memory, the other memory and the storage unit.
[0075] As a result, the portable electro-terminal makes it possible to store both the result corresponding to a validated state or a non-validated state of said at least one inspected member, the instruction(s) to be carried out to inspect the member(s) and the three-dimensional model of the aircraft.
[0076] Optionally, the portable electroportable terminal can also make it possible to store the state data(s) representative of the current state of each instruction, the status data(s) representative of a current status of each control station.
[0077] According to another advantageous embodiment, the sensor for determining a current position may comprise at least two electromagnetic signal transmitters arranged on the aircraft, the transmitters making it possible to transmit the electromagnetic signals. 360-degree magnetic fields around the aircraft.
[0078] Such electromagnetic signal transmitters may be arranged for example at or near each of the control stations and / or be distributed over the aircraft to cover all the control stations.
[0079] In practice, the sensor for determining a current position may comprise a receiving antenna capturing the electromagnetic signals, the receiving antenna being arranged on the portable electro-terminal, the identification unit being configured to analyze the electromagnetic signals and identify the current control station.
[0080] As a result, the electromagnetic signals emitted by the transmitters are picked up by the receiving antenna, then possibly transmitted to the identification unit which can deduce which is the current control station.
[0081] According to another exemplary embodiment of the invention compatible with the previous ones, the processing unit may comprise a recalibration unit configured to carry out a recalibration of the graphical interface component(s) with respect to said at least one current image.
[0082] Such a recalibration unit is thus interfaced with the processing unit configured to display the graphical interface component(s). Optionally, the processing unit configured to display the graphical interface component(s) and the recalibration unit may each comprise one or more computers in common or even be formed by a single multitask computer.
[0083] According to an advantageous embodiment compatible with the previous ones, the processing unit can be arranged in whole or in part in the portable electric terminal.
[0084] The invention and its advantages will appear in more detail in the context of the description which follows with examples given for illustrative purposes with reference to the appended figures which represent:
[0085] [Fig.l], a block diagram illustrating a control system according to the invention,
[0086] [Fig.2], a first current image of an aircraft,
[0087] [Fig.3], a perspective view of a first variant of portable electric terminal,
[0088] [Fig.4], a perspective view of a second variant of portable electric terminal,
[0089] [Fig.5], a second current image of an aircraft,
[0090] [Fig.6], said second current image of an aircraft supplemented with instructions,
[0091] [Fig.7], a first portion of screen displayed on a portable electro-terminal,
[0092] [Fig.8], a second portion of screen displayed on a portable electro-terminal,
[0093] [Fig.9], a third portion of screen displayed on a portable electro-terminal at a first moment of a control process,
[0094] [Fig.10], a third portion of screen displayed on a portable electro-terminal at a second moment of a control process,
[0095] [Fig.l 1], a third screen portion displayed on a portable electro-terminal at a third instant of a control method, and
[0096] [Fig. 12], a flowchart illustrating the steps of a control method according to the invention.
[0097] Elements present in several distinct figures are assigned a single reference.
[0098] As already mentioned, the invention relates to a method and a system for controlling a plurality of control stations of an aircraft.
[0099] As shown in [Fig.l], the control system 50 comprises a portable electro-terminal 8, 9 carried or held in the hands of an operator such as a pilot of the aircraft or a technician. In addition, such a portable electro-terminal 8, 9 comprises a screen 10 and a selection interface 51 having, for example, a pointing device, a keyboard or a touch screen superimposed on the screen 10.
[0100] According to a first variant as shown in [Fig.3], the portable electroportable terminal 8 can thus be formed by a touch pad.
[0101] According to a second variant as shown in [Fig.4], the portable electroportable terminal 9 can also be formed by a smartphone.
[0102] Furthermore, as shown in [Fig.2], an aircraft 1 may have a plurality of control stations 2, 3, 4, 5, 12, 13 each comprising at least one member 6, 7 to be inspected by an operator.
[0103] The control system 50 then comprises a sensor 52 for determining a current position of the portable electro-terminal 8, 9 relative to the aircraft 1.
[0104] Such a sensor 52 for determining a current position may, for example, comprise at least two transmitters 58, 59 of electromagnetic signals positioned on the aircraft 1. Such transmitters 58, 59 then make it possible to transmit electromagnetic signals all around the aircraft 1 to cover all the movements of the operator and his portable electro-terminal 8, 9.
[0105] Furthermore, the sensor 52 may also comprise a receiving antenna 60 adapted to receive the electromagnetic signals emitted by the transmitters 58, 59. The receiving antenna 60 is then advantageously integrated or integral with the portable electro-terminal 8, 9.
[0106] In addition, the control system 50 comprises an identification unit 53 configured to identify a current control station 12, 22 among the plurality of control stations 2, 3, 4, 5, 12, 13.
[0107] Such an identification unit 53 can thus be connected or integrated into the portable electro-terminal 8, 9. The identification unit 53 can thus be configured to analyze the electromagnetic signals received by the antenna 60 and identify the control station. current 12, 22.
[0108] Furthermore, the control system 50 also comprises a member 54 for determining at least one current image 11, 21 of the aircraft 1 representative of the current control station 12, 22. Such a determination member 54 then makes it possible to display the current image(s) 11, 21 of the aircraft 1 on the screen 10. The determination member 54 can thus be connected by wire or wireless means to the portable electro-terminal 8, 9. Alternatively, the determination member 54 can also be integrated into the portable electro-terminal 8, 9.
[0109] In addition, the control system 50 comprises a storage unit 55 making it possible to store a three-dimensional model of the aircraft 1. Such a model has at least one graphical interface component 13, 23 corresponding to the member 6, 7 to be inspected of the current control station 12, 22. The storage unit 55 can thus be connected by wire or wireless means to the portable electro-terminal 8, 9. Alternatively, the storage unit 55 can also be integrated into the portable electro-terminal 8, 9.
[0110] In addition, the control system 50 comprises a processing unit 56 configured to display the graphical interface component(s) 13, 23 superimposed on the current image(s) 12, 22 on the screen 10. The processing unit 56 can thus be connected by wire or wireless means to the portable electro-terminal 8, 9. Alternatively, the processing unit 56 can also be integrated into the portable electro-terminal 8, 9.
[0111] Furthermore, the identification unit 53, the determination member 54 of at least one current image and the processing unit 56 may for example each comprise at least one calculator respectively.
[0112] As shown in Figures 2 to 4, a wireframe graphical interface component 13 is then superimposed on a landing gear of the aircraft 1 that the current image 11 comprises.
[0113] As shown in [Fig.5], a rectangular graphical interface component 23 is then superimposed on a door of the aircraft 1 that the current image 21 comprises.
[0114] Furthermore, as shown in [Fig.7], the selection interface 51 of the portable electro-terminal 8, 9 allows the operator to select a result relating to an inspection of the member(s) 6, 7.
[0115] Such a result can then correspond to a state of validated instruction for example if the operator slides a finger over a selection zone 511 from left to right.
[0116] Alternatively, the result may correspond to a state of unvalidated instruction, for example if the operator slides a finger over the selection zone 511 from right to left.
[0117] Once the result is selected with the selection interface 51, the result is then stored in a memory 14 of the control system 50.
[0118] Furthermore, the control system 50 may comprise a device 57 for determining and displaying on the screen 10 at least one instruction 571, 572 corresponding to a member 6, 7 to be inspected at the current control station 12, 22. The device for determining and displaying 57 may thus be connected by wire or wireless means to the portable electro-terminal 8, 9. Alternatively, the device for determining and displaying 57 may also be integrated into the portable electro-terminal 8, 9.
[0119] As shown in [Fig.6], such an instruction 571, 572 can in fact be displayed on the screen 10 and superimposed on the current image 21 comprising a door of the aircraft 1 corresponding in this example to the member 7 to be inspected. The selection device 51 of the portable electro-terminal 8, 9 then allows the operator to select one of the instructions displayed.
[0120] This or these instructions 571, 572 can be stored in another memory 16. Such another memory can be distinct or alternatively merged with the memory 14. Advantageously, the memory 14, the other memory 16 and the storage unit 55 can be integrated into the portable electro-terminal 8, 9.
[0121] As shown in Figures 3, 4 and 8, the device 57 for determining and displaying at least one instruction 571, 572 can in particular make it possible to classify and list, for example in a table or a column 573, all the instructions corresponding to the members 6, 7 to be inspected for a given control station.
[0122] Furthermore, a current state 151 of the instruction(s) 571, 572 may be chosen from the group comprising a validated instruction state, a non-validated instruction state, a forgotten instruction state and a non-performed instruction state.
[0123] A background or a type of filling of each box of column 573 then makes it possible to visually identify the current state 151 of each of the instructions 571, 572.
[0124] As shown in Figures 9 to 11, the screen 10 can also display position data 121 representative of the current control station 12, 22.
[0125] Such position data 121 may, for example, comprise a circular dial 122 provided with several points 123 equally distributed in azimuth around an aircraft represented in a top or bottom view on the screen 10. One of the points 123 corresponding to the current control station 12, 22 may then, for example, be displayed with a color distinct from that corresponding to the other points 123.
[0126] In addition, Figures 9 to 11 also make it possible to illustrate status data representative of a current status 421 of each control station 2, 3, 4, 5, 112, 113. Such a current status 421 is then chosen from the group comprising a fully validated status corresponding to the validated state of the control station 2, 3, 4, 5, 112, 113, a non-validated status corresponding to the non-validated state of the control station 2, 3, 4, 5, 112, 113, a status in the process of being inspected of the control station 2, 3, 4, 5, 112, 113 and an inspection status not carried out from control station 2, 3, 4, 5, 112, 113.
[0127] For example in [Fig.9], not all control stations 2, 3, 4, 5, 112, 113 have yet been inspected. Thus, the type or color of the lines, representative of the different control stations 2, 3, 4, 5, 112, 113 and surrounding the aircraft shown in top view, are identical. These lines may be blue in color and are then represented for example by mixed lines in [Fig.9].
[0128] On the other hand, in [Fig. 10], the current status of the control stations 2, 3, 4, 5 is the fully validated status, the color of these lines can be, for example, green and represented by thick continuous lines in [Fig. 10]. The current status of the control station 112 is the status currently being inspected, the color of this line can be, for example, orange and represented by a thin continuous line in [Fig. 10]. The control station 112 then corresponds to the current control station 12, 22.
[0129] According to [Fig.l 1], the current status of control stations 2, 4, 5 is the fully validated status. The current status of control station 3 is the non-validated status, the color of this station can be red and represented by a dotted line on [Fig. 11].
[0130] The current status of the control station 11 is the status currently being inspected, the color of this line may be, for example, orange and represented by a thin continuous line in [Fig. 10]. The control station 112 then corresponds to the current control station 12.
[0131] As shown in [Fig. 12], the invention also relates to a control method 30 comprising a determination 31 of a current position of the portable electro-terminal 8, 9 relative to the aircraft 1, an identification 32 with the portable electro-terminal 8, 9 of a current control station 12, 22 among the different control stations 2, 3, 4, 5, 112, 113 and a determination 33 of at least one current image 11, 21 of the aircraft 1 representative of the current control station 12, 22.
[0132] Furthermore, such a determination 33 of at least one current image 11, 21 can be conditioned as a function of a selection 28 of a virtual reality operating mode or a selection 29 of an augmented reality operating mode.
[0133] When the selection 28 of the virtual reality operating mode is implemented, the determination 33 of at least one current image 11, 21 of the aircraft 1 is then generated by selecting the current image 11, 21 from a plurality of stored images of the aircraft 1.
[0134] On the other hand, when the selection 29 of an operating mode in augmented reality is implemented, the determination 33 of at least one current image 11, 21 of the aircraft 1 is obtained by means of a camera 17 integrated into the portable electro-terminal 8, 9 carrying out in real time an acquisition of images of the aircraft 1.
[0135] Furthermore, such a control method 30 then comprises a display 34 on the screen 10 of the portable electro-terminal 8, 9 of this or these current images 11, 21 of the aircraft 1 and a display 35 on the screen 10 of at least one graphical interface component 13, 23 corresponding to a member 6, 7 to be inspected of the current control station 12, 22. Such a display 34 is produced by superimposing the graphical interface component(s) 13, 23 on a current image 11, 21.
[0136] For example and as shown in Figures 2 to 4, a graphical interface component 13 can be superimposed on the landing gear forming a member 6 of the aircraft 1. According to another example shown in [Fig.5], a graphical interface component 23 can be superimposed on the door of the aircraft forming another member 7 of the aircraft 1.
[0137] The control method 30 then comprises a selection 46 on the portable electro-terminal 8, 9 and a storage 47 in the memory 14 of the result relating to the inspection of the member 6, 7, this result corresponding to a validated state or a non-validated state of the inspected member 6, 7.
[0138] The method 30 may also comprise a determination and a display 36 on the screen 10 of at least one instruction 571, 572 corresponding to the member 6, 7 to be inspected of the current control station 12, 22 and a selection 37 by means of the portable electro-terminal 8, 9 of the instruction(s) 571, 572 by the operator.
[0139] Optionally, for each of the instructions 571, 572, the control method 30 may comprise a determination 371 of a state data item representative of the current state 151 of the instructions 571, 572 as previously represented in [Fig.8]. The control method may then comprise a storage 372 of the state data item and a display 373 on the screen 10 of this state data item.
[0140] Advantageously, the control method 30 can also comprise an acquisition 38 of at least one image of the organ 6, 7 to be inspected carried out by means of a camera 17 integrated into the portable electro-terminal 8, 9 and a transmission 39 of the image(s) from the portable electro-terminal 8, 9 to an external server 18 shown in [Fig.l].
[0141] Furthermore, the control method 30 may comprise a resetting 40 of the graphical interface component(s) 13, 23 relative to the current image 11, 21. Such a resetting 40 may be carried out by means of the two transmitters 58, 59 of electromagnetic signals arranged on the aircraft 1.
[0142] According to another variant of the control method 30, such a control method 30 may also comprise an additional acquisition 41 of images of the organ 6, 7 to be inspected. In this case, the control system 50 may comprise another aircraft 24, such as a drone, equipped with a remote camera 20 making it possible to acquire the additional images of the organ 6, 7 to be inspected.
[0143] This additional acquisition 41 can be carried out by means of the remote camera 20 arranged on the other aircraft 24. Such an additional acquisition 41 of images can in particular make it possible to carry out a recalibration of the graphical interface component 13, 23 in relation to the current image 11, 21.
[0144] According to an exemplary embodiment compatible with the previous ones, for each of the control stations 2, 3, 4, 5, 112, 113, the control method 30 can comprise a determination 42 of a status data item representative of the current status 421 of the control station 2, 3, 4, 5, 112, 113, a storage 43 of the status data item and a display 44 on the screen 10 of the status data item.
[0145] Similarly, as already mentioned in FIGS. 9 to 11, the control method 30 may include a display 45 on the screen 10 of position data 121 representative of said current control station 12, 22.
[0146] Naturally, the present invention is subject to numerous variations as to its implementation. Although several embodiments have been described, it is understood that it is not conceivable to exhaustively identify all possible modes. It is of course conceivable to replace a means described by an equivalent means without departing from the scope of the present invention.
Claims
Claims
1. Method for controlling (30) a plurality of control stations (2, 3, 4, 5, 12, 22, 112, 113) of an aircraft (1), each control station (2, 3, 4, 5, 12, 22, 112, 113) comprising at least one member (6, 7) to be inspected by an operator, characterized in that said control method (30) comprises the following steps: • determination (31) of a current position of an electroportable terminal (8, 9) relative to said aircraft (1), said electroportable terminal (8, 9) being carried by said operator, • identification (32) with said electroportable terminal (8, 9) of a current control station (12, 22) among said plurality of control stations (2, 3, 4, 5, 12, 22, 112, 113), said identification (32) being a function of said current position of said portable electro-terminal (8, 9) relative to said aircraft (1), • determination (33) of at least one current image (11,21) of said aircraft (1) representative of said current control station (12, 22), • display (34) on a screen (10) of said portable electro-terminal (8, 9) of said at least one current image (11, 21) of said aircraft (1), • display (35) on said screen (10) of at least one graphical interface component (13, 23) corresponding to said at least one organ (6, 7) to be inspected of said current control station (12, 22), said at least one graphical interface component (13, 23) being displayed superimposed on said at least one current image (11, 21), and • selection (46) on said portable electro-terminal (8, 9) and storage (47) in a memory (14) of a result relating to an inspection of said at least one organ (6, 7), said result corresponding to a validated state or a non-validated state of said at least one organ (6, 7) inspected.,
2. Method according to claim 1, characterized in that said method (30) comprises the following steps: • determination and display (36) on said screen (10) of at least one instruction (571, 572) corresponding to said at least one member (6, 7) to be inspected of said current control station (12, 22), another memory (16) storing for each member (6, 7) at least one said instruction (571, 572), and • selection (37) by means of said portable electro-terminal (8, 9) of said at least one instruction (571, 572) by said operator.
3. Method according to claim 2, characterized in that, for each of said at least one instruction (571, 572), said control method (30) comprises the following steps: • determination (371) of a state datum representative of a current state (151) of said at least one instruction (571, 572) of said at least one member (6, 7) inspected, said current state (151) being chosen from the group comprising a validated instruction state, a non-validated instruction state, a forgotten instruction state and a non-performed instruction state, • storage (372) of said state datum, and • display (373) on said screen (10) of said state datum.
4. Method according to any one of claims 1 to 3, characterized in that said control method (30) comprises a selection (28) of a virtual reality operating mode, said determination (33) of at least one current image (11, 21) of said aircraft (1) being carried out by selecting said at least one current image (11, 21) from a plurality of stored images of said aircraft (1).
5. Method according to any one of claims 1 to 4, characterized in that said control method (30) comprises a selection (29) of an operating mode in augmented reality, said determination (33) of at least one current image (11, 21) of said aircraft (1) being carried out by means of a camera (17) integrated into said portable electro-terminal (8, 9).
6. Method according to any one of claims 1 to 5, characterized in that said control method (30) comprises an ac- acquisition (38) of at least one image of said at least one organ (6, 7) to be inspected carried out by means of a camera (17) integrated into said portable electro-terminal (8, 9) and a transmission (39) of said at least one image from said portable electro-terminal (8, 9) to an external server (18).
7. Method according to any one of claims 1 to 6, characterized in that said control method (30) comprises a recalibration (40) of said at least one graphical interface component (13, 23) with respect to said at least one current image (11, 21), said recalibration (40) being carried out by means of at least two transmitters (58, 59) of electromagnetic signals arranged on said aircraft (1), said at least two transmitters (58, 59) making it possible to emit said electromagnetic signals at 360 degrees around said aircraft (1).
8. Method according to any one of claims 1 to 7, characterized in that said control method (30) comprises an additional acquisition (41) of images of said at least one member (6, 7) to be inspected, said additional acquisition (41) being carried out by means of a remote camera (20) arranged on another aircraft (24) in flight, said additional acquisition (41) of images making it possible to carry out a recalibration of said at least one graphical interface component (13, 23) with respect to said at least one current image (11, 21).
9. Method according to any one of claims 1 to 8, characterized in that, for each of the control stations (2, 3, 4, 5, 12, 22, 112, 113) of said plurality of control stations (2, 3, 4, 5, 12, 22, 112, 113), said control method (30) comprises the following steps: • determination (42) of a status datum representative of a current status (421) of said at least one control station (2, 3, 4, 5, 12, 22, 112, 113), said current status (421) being chosen from the group comprising said fully validated status corresponding to the validated state of each of said inspected members (6, 7), said non-validated status corresponding to the non-validated state of at least one of said inspected members (6, 7), a status being inspected said at least one control station (2, 3, 4, 5, 12, 22, 112, 113) and an inspection status not carried out said at least one control station (2, 3, 4, 5, 12, 22, 112, 113), • storage (43) of said status data, and • display (44) on said screen (10) of said status data.
10. Method according to any one of claims 1 to 9, characterized in that said control method (30) comprises a display (45) on said screen (10) of position data (121) representative of said current control station (12, 22).
11. Control system (50) of a plurality of control stations (2, 3, 4, 5, 12, 22, 112, 113) of an aircraft (1), each control station (2, 3, 4, 5, 12, 22, 112, 113) comprising at least one member (6, 7) to be inspected by an operator, characterized in that said control system (50) comprises: • a portable electric terminal (8, 9) carried by said operator, said portable electric terminal (8, 9) comprising a screen (10) and a selection interface (51), • a sensor (52) for determining a current position of said portable electro-terminal (8, 9) relative to said aircraft (1), • an identification unit (53) of a current control station (12, 22) among said plurality of control stations (2, 3, 4, 5, 12, 22, 112, 113), said current control station (12, 22) being identified as a function of said current position of said portable electro-terminal (8, 9) relative to said aircraft (1), • a determination member (54) of at least one current image (11, 21) of said aircraft (1) representative of said current control station (12, 22), said determination member (54) being configured to display said at least one current image (11, 21) of said aircraft (1) on said screen (10), and • a storage unit (55) for storing a three-dimensional model of said aircraft (1), said model comprising at least one graphical interface component (13, 23) corresponding to said at least one member (6, 7) to be inspected of said current control station (12, 22), • a processing unit (56) configured to display said at least one graphical interface component (13, 23) superimposed on said at least one current image (11, 21) on said screen (10), and in that said selection interface (51) makes it possible to select a result relating to an inspection of said at least one organ (6, 7), said result corresponding to a validated state or a non-validated state of said at least one organ (6, 7) inspected, said result being stored in a memory (14).
12. System according to claim 11, characterized in that said control system (50) comprises a device for determining and displaying (57) on said screen (10) at least one instruction (571, 572) corresponding to said at least one member (6, 7) to be inspected of said current control station (12, 22), said at least one instruction (571, 572) being stored in another memory (16), said screen (10) being configured to display said at least one instruction (571, 572), said selection device (51) of said portable electro-terminal (8, 9) allowing said operator to select said at least one instruction (571, 572).
13. System according to claim 12, characterized in that said portable electro-terminal (8, 9) comprises said memory (14), said other memory (16) and said storage unit (55).
14. System according to any one of claims 11 to 13, characterized in that said sensor (52) for determining a current position comprises at least two transmitters (58, 59) of electromagnetic signals arranged on said aircraft (1), said at least two transmitters (58, 59) making it possible to transmit said electromagnetic signals at 360 degrees around said aircraft (1).
15. System according to claim 14, characterized in that said sensor (52) for determining a current position comprises a receiving antenna (60) capturing said electromagnetic signals, said receiving antenna (60) being arranged on said portable electro-terminal (8, 9), said identification unit (53) being configured to analyze said electromagnetic signals and identify said current control station (12, 22).
16. System according to any one of claims 11 to 15, characterized in that said processing unit (56) comprises a resetting unit (61) configured to carry out a resetting of said at least one graphical interface component (13, 23) with respect to said at least a current image (11, 21).