Electronic control device for an avionics system to implement a critical avionics function, associated method and computer program

The electronic device for avionics systems validates voice commands for syntax, semantics, and context to ensure safe execution of critical functions, addressing vulnerabilities in existing systems and enhancing operator safety.

FR3123326B1Active Publication Date: 2024-11-08THALES SA
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
FR2021005401
Authority / Receiving Office
FR · FR
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-05-25
Publication Date
2024-11-08
Estimated Expiration
2041-05-25

AI Technical Summary

Technical Problem

Existing voice command assistance systems for avionics functions, which are critical for aircraft safety, suffer from vulnerabilities such as adversarial examples and database limitations, leading to potential errors that can have severe consequences.

Method used

An electronic device for controlling avionics systems that includes a reception module, voice recognition module, processing module, and monitoring device to ensure coherence of voice commands with syntactic, lexical, and contextual rules before execution, featuring modules for validation and alert generation to prevent unsafe commands.

Benefits of technology

Ensures safe and secure execution of critical avionics functions by validating voice commands for syntax, semantics, and context, reducing the risk of errors and enhancing operator safety and comfort by preventing unsafe commands.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000021_0000
    Figure 00000021_0000
  • Figure 00000022_0000
    Figure 00000022_0000
  • Figure 00000023_0000
    Figure 00000023_0000
Patent Text Reader

Abstract

Electronic control device for an avionics system for implementing a critical avionics function, method and associated computer program. The invention relates to an electronic control device (24) for an avionics system for implementing a critical avionics function, comprising: - a module for receiving a voice instruction signal; - a speech recognition module configured to transform the voice signal into a text transcription; - a processing module configured to associate the text transcription with at least one action to be performed;- a monitoring device comprising: + a control module configured to check if the text transcription and / or the action to be performed is consistent if and only if: a) the text transcription and / or the action to be performed is consistent with the expected syntax, b) the text transcription and / or the action to be performed is consistent with the expected lexical field, and c) the text transcription and / or the action to be performed is consistent with the current context, + a module for generating an associated command only if no inconsistency is detected. Figure for the abbreviation: Figure 1;
Need to check novelty before this filing date? Find Prior Art

Description

Title of the invention: Electronic device for controlling an avionics system for implementing a critical avionics function, associated method and computer program

[0001] The present invention relates to an electronic device for controlling an avionics system for implementing a critical avionics function.

[0002] The invention also relates to a method for controlling an avionics system for implementing a critical avionics function.

[0003] The invention also relates to a computer program comprising software instructions which, when executed by a computer, implement such a method.

[0004] The avionics system is in particular on board an aircraft or in a remote control station of an aircraft or even in a control station of the aircraft.

[0005] The invention relates to the implementation of critical avionics functions, i.e. which are critical for the safety of the associated aircraft, the operators, the passengers and / or the environment of the aircraft.

[0006] Flight controls or communication with the exterior of the aircraft are examples of such critical functions.

[0007] In particular, in the avionics field, a critical function is for example defined by the ARP-4754A standard (Aerospace Recommended Practice in English).

[0008] By implementation of a critical function, we mean the performance of one or more calculations making it possible to generate at least one output data item associated with this critical function, from at least one input data item.

[0009] The invention relates in particular to assistance to an operator of the critical avionics system making it possible to facilitate the interfacing and communication between said avionics system and the operator via voice commands from the operator to the avionics system.

[0010] Voice-controlled assistance systems are known for domestic applications, assistance services for smart equipment, particularly for smartphones, or car assistance systems for call management, for example. These systems are based in particular on artificial intelligence-type algorithms that make it possible to obtain interesting levels of performance, although with an error rate of 5 to 10%.

[0011] In addition, these algorithms have numerous vulnerabilities such as, for example, so-called adversarial examples for neural network type algorithms, guarantee problems when the current input of the system is not in the learning database for all machine learning-based components, or limitations in modeling or vocabulary definition for semantic engines. These various vulnerabilities can lead to errors in voice command processing. In the examples cited above, a voice command processing error has a non-critical impact, such as calling the wrong person.

[0012] However, in the context of assistance to avionics systems implementing a critical avionics function, sending an erroneous command can have serious consequences on the safety of the aircraft. For example, a change of direction of the aircraft that is not desired by the pilot can have significant consequences on the safety of the aircraft and its environment.

[0013] There is therefore a need to obtain an electronic device for controlling an avionics system that makes it possible to facilitate the interactions of an operator with this avionics system while being sufficiently safe for the implementation of a critical avionics function.

[0014] For this purpose, the invention relates to an electronic device for controlling an avionics system for implementing a critical avionics function, the critical avionics function being chosen from the group comprising: flight control of the aircraft, calculation of the aircraft trajectory, communication of the aircraft with the control station, a change in the aircraft communication frequency and an air traffic regulation order; the avionics system being capable of operating according to a current context defined by at least one operating parameter associated with the avionics system, the electronic control device comprising:

[0015] - a receiving module configured to receive a captured instruction voice signal by a microphone and to receive the current context;

[0016] - a voice recognition module configured to transform the voice signal into a text transcription of said voice signal;

[0017] - a processing module configured to perform transcription processing textual in order to associate the textual transcription with at least one action to be carried out intended for the avionics system;

[0018] - a monitoring device configured to receive the text transcription and / or the action to be carried out, the monitoring device comprising:

[0019] + a control module configured to check whether the textual transcription and / or the action to be carried out is consistent according to at least one predetermined consistency rule, the textual transcription and / or the action to be carried out being considered consistent according to the consistency rule if and only if:

[0020] a) the textual transcription and / or the action to be carried out is consistent with the expected syntax according to a predetermined database of syntactic rules,

[0021] b) the textual transcription and / or the action to be carried out is consistent with the expected lexical field according to a predetermined database of the expected lexical field in the current context of the avionics system, and

[0022] c) the textual transcription and / or the action to be carried out is consistent with the current context of the avionics system,

[0023] + a generation module configured to generate a command associated with the action to be carried out only if no inconsistency is detected by the control module.

[0024] According to other advantageous aspects of the invention, the electronic device comprises one or more of the following characteristics, taken in isolation or in all technically possible combinations: - the electronic device comprises a transmission module configured to transmit the command to the avionics system for the implementation of the critical avionics function; - the electronic device further comprises a validation module configured to display the command to an operator of the avionics system before transmitting the command to the avionics system, the validation module being configured to receive a validation of the command from the operator and to send the command to the transmission module only after receiving the validation of the command by the operator; - the monitoring device further comprises an alert module configured to generate an alert signal when an inconsistency is detected by the control module; - each operating parameter associated with the avionics system is selected from the group consisting of: a flight parameter of an aircraft associated with the avionics system; a flight plan associated with the aircraft; a mission assigned to the aircraft; a parameter from at least one avionics sensor; a meteorological parameter associated with the environment of the aircraft; and a physiological parameter of an operator of the avionics system; - the processing module comprises an automatic language processing module configured to carry out at least one processing operation chosen from: a lemmatization of the textual transcription; a stemming of the textual transcription; a recognition of keywords and / or named entities in the textual transcription; - the processing module comprises a natural language understanding module configured to carry out at least one processing chosen from: recognition of textual patterns in the textual transcription; association of the text transcription with at least one concept stored in a database; use of a semantic engine to link word sequences of the text transcription to at least one concept; and application of a neural network to detect sentiments and / or intentions in the text transcription; - the monitoring device further comprises an activation module configured to: activate the automatic language processing module; analyze whether the action to be performed obtained by the processing carried out by the automatic language processing module allows the generation of a command by the generation module; activate the natural language understanding module only if the action to be performed does not allow the generation of a command by the generation module.

[0025] The invention also relates to a method for controlling an avionics system for implementing a critical avionics function, the critical avionics function being chosen from the group comprising: flight control of the aircraft, calculation of the aircraft trajectory, communication of the aircraft with the control station, a change in the aircraft communication frequency and an air traffic regulation order; the avionics system being able to operate according to a current context defined by at least one operating parameter associated with the avionics system, the method being implemented by an electronic control device and comprising the following steps:

[0026] - receiving an instruction voice signal acquired by a microphone and receiving the local context;

[0027] - transformation of the voice signal into a textual transcription of said voice signal;

[0028] - processing of the text transcription in order to associate the text transcription with at least one action to be performed intended for the avionics system;

[0029] - verification whether the text transcription and / or the action to be carried out is coherent according to at least one predetermined consistency rule, the textual transcription and / or the action to be carried out being considered consistent according to the consistency rule if and only if:

[0030] a) the textual transcription and / or the action to be carried out is consistent with the expected syntax according to a predetermined database of syntactic rules,

[0031] b) the textual transcription and / or the action to be carried out is consistent with the expected lexical field according to a predetermined database of the expected lexical field in the current context of the avionics system, and

[0032] c) the textual transcription and / or the action to be carried out is consistent with the current context of the avionics system,

[0033] - generation of a control signal associated with the action to be carried out only if no inconsistencies are detected.

[0034] The invention also relates to a computer program comprising software instructions which, when executed by a computer, implement a method as defined above.

[0035] These characteristics and advantages of the invention will appear more clearly on reading the description which follows, given solely by way of non-limiting example, and made with reference to the appended drawings, in which:

[0036] [Fig-1] [Fig.l] is a schematic representation of an aircraft and a control station control each comprising an electronic device according to the invention,

[0037] [Fig.2] [Fig.2] is a schematic representation of the electronic device according to the invention,

[0038] [Fig.3] [Fig.3] is a flowchart of a method, according to the invention, for controlling an avionics system for the implementation of a critical avionics function by the electronic device.

[0039] A plurality of avionics electronic systems 10 are shown in [Fig.l].

[0040] The avionics system 10 is notably on board an aircraft 12. The aircraft is typically an airplane, a helicopter, or even a drone. In other words, the aircraft 12 is a flying machine that can be piloted by an operator 14, here a pilot, via a control station 16. The control station 16 is arranged inside the aircraft 12 or at a distance from the aircraft 12, in particular in the case of a drone.

[0041] Alternatively, as also shown in [Fig.l], the avionics system 10 is mounted in a control station 18 on the ground, such as a control tower in an aerodrome for example. The operator 14 controls the air traffic and in particular the aircraft 12 via the control station 16 arranged in the control station 18.

[0042] As visible in [Fig.l], the control station 16 notably comprises a microphone 20 arranged opposite the operator 14. The microphone 20 is configured to pick up a voice signal emitted by the operator 14.

[0043] The control station 16 further comprises a display screen 22. The display screen 22 is for example a head-down display screen. The screen is then a surface configured to display at least one image. Advantageously, the head-down display screen is configured to display information relating to the aircraft 12, such as the speed, altitude, orientation of the aircraft 12 and / or information relating to the external environment of the aircraft 12, such as air traffic information and weather conditions in the vicinity of the aircraft 12.

[0044] Alternatively, the display screen 22 is a head-up display screen. The screen is then at least partially transparent. Advantageously, the head-up display screen is a visor integrated into a helmet suitable for being worn by the operator 14. Alternatively, the head-up display screen is a transparent surface fixed in the control station 16 and placed in front of the operator 14. Alternatively, the head-up display screen is a windshield of the aircraft 12.

[0045] Each avionics system 10 is in particular configured to implement a critical avionics function. The critical avionics function is typically chosen from the group consisting of: a flight control of the aircraft 12, a trajectory calculation of the aircraft 12, a communication of the aircraft 12 with the control station 18, a change in communication frequency of the aircraft 12, an air traffic regulation order, etc.

[0046] However, those skilled in the art will understand that the invention is also adaptable to other critical functions, such as a control process of a nuclear reactor, temperature control in a furnace of a factory, navigation control of an autonomous motor vehicle, speed control of a railway vehicle, etc.

[0047] Each avionics system 10 is capable of operating according to a current context defined by at least one operating parameter associated with said avionics system 10.

[0048] Each operating parameter is a piece of data characteristic of the current context. The current context corresponds to all the circumstances in which the avionics system 10 operates.

[0049] In particular, each operating parameter associated with the avionics system 10 is chosen from the group consisting of: - a flight parameter of the aircraft 12 associated with the avionics system 10; - a flight plan associated with aircraft 12; - a mission assigned to aircraft 12; - a parameter from at least one avionics sensor; - a meteorological parameter associated with the environment of the aircraft 12; and - a physiological parameter of the operator 14.

[0050] The flight parameter is in particular the geographical position of the aircraft 12, the altitude of the aircraft 12, the speed of the aircraft 12 or the heading of the aircraft 12.

[0051] The flight plan of the aircraft 12 notably includes a set of waypoints planned for the aircraft 12 between the departure and destination aerodromes.

[0052] The mission of the aircraft 12 is the objective of the flight of the aircraft 12, such as transporting passengers and / or goods to a certain destination, reconnaissance or surveillance of an area of ​​interest, etc.

[0053] The meteorological parameter is for example the wind speed, the presence of bad weather, the visibility of the environment for the pilot, etc.

[0054] The physiological parameter is for example the heart rate of the operator 14 or a parameter representative of the state of consciousness of the operator 14.

[0055] An electronic control device 24 of the avionics system(s) 10 for implementing the critical avionics function associated with each avionics system 10 is also shown in [Fig.l].

[0056] With reference to [Fig.2], the electronic device 24 comprises a reception module 26, a voice recognition module 28, a processing module 30 and a monitoring device 32.

[0057] Advantageously, the electronic device 24 further comprises a transmission module 34 and a validation module 36.

[0058] The receiving module 26 is configured to receive a voice instruction signal picked up by the microphone 20. The voice instruction signal comes in particular from the operator 14 in the control station 16. The voice instruction signal is an analog or digital signal.

[0059] The voice instruction signal is in particular a command issued by the operator 14 based on keywords or a request expressed in natural language, for example during a dialogue between air traffic control and the pilot.

[0060] The reception module 26 is further configured to receive the current context. In particular, the reception module 26 is configured to receive the operating parameter(s) associated with the avionics system 10 and making it possible to characterize the current context. The reception module 26 is capable of receiving, for example, the flight parameters via the flight control system or the flight plan via the FMS (Flight Management System).

[0061] The voice recognition module 28 is configured to receive the instruction voice signal from the receiving module 26 and to transform the voice signal into a text transcription of the voice signal.

[0062] In particular, the voice recognition module 28 is configured to process the voice signal in order to recognize the different words constituting it. The voice recognition module 28 is capable of providing as output the text transcribed into a text or sequence of words.

[0063] Voice recognition is for example implemented by digitizing and parameterizing the voice signal by a frequency analysis technique using the Fourier transform. Alternatively, a machine learning algorithm takes the voice signal directly as input without preprocessing. The machine learning algorithm performs an association between elementary segments of the voice signal and lexical elements. This association uses statistical modeling, among other things, by hidden Markov models and / or artificial neural networks. Finally, decoding is carried out by concatenating the previously learned elementary models in order to reconstruct the textual transcription.

[0064] The processing module 30 is configured to receive the text transcription from the voice recognition module 28 and to process the text transcription in order to associate the text transcription with at least one action to be performed intended for the avionics system 10.

[0065] The action to be performed includes in particular an action that can be performed by the avionics system 10 and advantageously a value and one or more criteria. For example, when the avionics system 10 is a flight control system, the action to be performed can be represented in the form {action = change the altitude of the aircraft, value = 10,000 m above the ground, criterion = respect a safe rate of climb}. As another example, when the avionics system 10 is a communication system, the action to be performed can be represented in the form {action = change frequency, value = 118,100}. As yet another example, when the avionics system 10 is a trajectory calculation system, the action to be performed can be represented in the form {action = calculate current position-airport distance, criterion = minimize the distance}.

[0066] The processing module 30 advantageously comprises an automatic language processing module 40 and a natural language understanding module 42.

[0067] The automatic language processing module 40 is in particular a component called “NLP” (for “Natural language processing” in English or “Natural language processing” in French).

[0068] The automatic language processing module 40 is configured to carry out at least one processing chosen from:

[0069] - a lemmatization of the textual transcription;

[0070] - a rooting of the textual transcription;

[0071] - recognition of keywords and / or named entities in the transcription textual.

[0072] For example, if the voice command is “Change frequency to 118.100”, the automatic language processing module 40 is able to root the word “change” into “change”, to recognize the keywords “frequency” and “change” and to recognize the entity “frequency number 118.100”. Thus, the automatic language processing module 40 transforms the voice command “Change frequency to 118.100” into the action to be performed {action = change frequency, value = 118.100}.

[0073] Advantageously, the automatic language processing module 40 is capable of detecting a predetermined keyword that the operator 14 indicates at the start of his command. voice in order to indicate to the electronic device 24 that the rest of the voice signal is indeed a voice command intended for the avionics system 10.

[0074] As will be explained later, the natural language understanding module 42 is capable of operating in addition to the automatic language processing module 40 when the processing carried out by the automatic language processing module 40 is insufficient to produce an action to be carried out.

[0075] The natural language understanding module 42 is in particular a so-called “NLU” component (for “Natural language understanding” in English or “Natural language understanding” in French).

[0076] The natural language understanding module 42 is configured to carry out at least one processing chosen from:

[0077] - recognition of textual patterns in the textual transcription;

[0078] - an association of the textual transcription with at least one concept stored in a database 56;

[0079] - a use of a semantic engine to link sequences of words of the textual transcription to at least one concept; and

[0080] - an application of a neural network to detect feelings and / or intentions in the textual transcription.

[0081] For example, if the voice command is “Find me the nearest airport”, the automatic language processing module 40 performs a rooting of “find” into “find” and detects the keywords “find” and “airport”. This processing is insufficient here to obtain an action to be performed. The natural language understanding module 42 then retrieves the keywords “find” and “airport” and then extracts from the words “find airport” the concept of “calculate distance current position to an airport” using a table containing this association. Then, it extracts from the words “nearest” the concept of “minimize the distance”. Thus, the natural language understanding module 42 is able to provide the following action to be performed: {action = calculate distance current position-airport, criterion = minimize the distance}.

[0082] When, following processing by the natural language understanding module 42, there remains uncertainty about the action to be performed, the processing module 30 is able to generate several associated actions to be performed. As will be described later, the operator 14 can then choose the command corresponding to his voice command.

[0083] The monitoring device 32 is configured to receive the text transcription and / or the action to be performed.

[0084] Thus, in one embodiment, the monitoring device 32 is configured to receive only the text transcription.

[0085] Alternatively, the monitoring device 32 is configured to receive only the action to be performed.

[0086] As a further variant, the monitoring device 32 is configured to receive the text transcription and the action to be performed.

[0087] The monitoring device 32 is configured to verify that the action to be performed is valid. For this purpose, the monitoring device 32 comprises a control module 44, a generation module 46 and advantageously an alert module 48 and an activation module 50.

[0088] The control module 44 is configured to check whether the textual transcription and / or the action to be carried out is consistent according to at least one predetermined consistency rule.

[0089] Thus, when the monitoring device 32 receives only the text transcription, the control module 44 verifies only the text transcription. When the monitoring device 32 receives only the action to be performed, the control module 44 verifies only the action to be performed. When the monitoring device 32 receives the text transcription and the action to be performed, the control module 44 verifies both the text transcription and the action to be performed.

[0090] The textual transcription and / or the action to be carried out is considered coherent according to the coherence rule if and only if:

[0091] a) the textual transcription and / or the action to be carried out is consistent with the expected syntax according to a predetermined database 52 of syntactic rules,

[0092] b) the textual transcription and / or the action to be carried out is consistent with the expected lexical field according to a predetermined database 54 of the expected lexical field in the current context of the avionics system 10, and

[0093] c) the textual transcription and / or the action to be carried out is consistent with the current context of the avionics system 10,

[0094] The predetermined database 52 of syntactic rules includes in particular spelling and grammar rules relating to the language used by the operator 14 making it possible to define whether a sentence is correct from a syntactic point of view.

[0095] The monitoring device 32 advantageously comprises a language module configured to detect in which language the operator is communicating and activate the corresponding database of syntactic rules. Alternatively, the operator 14 indicates in which language he is communicating with the electronic device 24. Alternatively, the language is predetermined.

[0096] The predetermined database 54 of the expected lexical field includes, for the different current contexts encountered by the avionics system 10, an associated lexical field. For example, this database 54 includes a lexical field associated with the takeoff, a lexical field associated with flight, a lexical field associated with tactical missions, etc.

[0097] The control module 44 is capable of verifying whether the textual transcription and / or the action to be performed is consistent with the current context of the avionics system 10, by comparing the operating parameters of the current context with the operating parameters that the command would cause. In particular, a difference greater than a predetermined threshold indicates an inconsistency. For example, a flight command causing a very significant drop in altitude is inconsistent with a local cruising flight context.

[0098] The control module 44 is configured to verify that the action to be carried out is realistic, feasible and consistent with the context.

[0099] For example, in the context of the flight of an aircraft 12 flying over the Atlantic Ocean, the textual transcription “New York to Navigate” is not valid from the point of view of syntactic rules. Still in this same context, the textual transcription “Roll to flight level FL300” is not valid from the point of view of the lexical field of the flight. Indeed, the term “roll” is not part of the lexical field of the flight. Still in this same context, the action to be carried out {action = change destination, value = Tokyo] is not consistent with the context of a flight over the Atlantic Ocean. In particular, the control module 44 detects that the distance between the aircraft 12 and the new destination is too great.

[0100] The generation module 46 is configured to generate a command associated with the action to be performed only if no inconsistency is detected by the control module 44. In other words, the generation module 46 is configured to generate the command for the action to be performed only if the three conditions according to the consistency rule a), b) and c) are respected.

[0101] The alert module 48 is configured to generate an alert signal when an inconsistency is detected by the control module 44.

[0102] Advantageously, the alert module 48 is configured to send the alert signal to the display screen 22 so that the operator 14 can be informed of the alert and transmit a new corrected control signal to the avionics system 10.

[0103] The activation module 50 is configured to activate the automatic language processing module 40.

[0104] In particular, the activation module 50 is configured to activate the automatic language processing module 40 when the reception module 26 receives a voice signal or the processing module 30 receives the text transcription.

[0105] The activation module 50 is further configured to analyze whether the action to be performed obtained by the processing carried out by the automatic language processing module 40 allows the generation of a command by the generation module 46.

[0106] In particular, the activation module 50 analyzes whether the generation module 46 is capable of generating an action, a value and / or a criterion in order to completely define the command intended for the avionics system 10.

[0107] Taking the examples above, if the voice command is “Change frequency to 118.100”, the automatic language processing module 40 transforms this voice command into the action to be carried out {action = change frequency, value = 118.100}. The generation module 46 is then able to generate the associated command in a clear and complete manner.

[0108] Conversely, if the voice command is “Find me the nearest airport”, the automatic language processing module 40 detects the keywords “find” and “airport”. However, this processing is insufficient here to obtain an action to be carried out because the generation module 46 is incapable of defining the criterion associated with the search for the airport.

[0109] For this purpose, the activation module 50 is configured to activate the natural language understanding module 42 only if the action to be performed does not allow the generation of a command by the generation module 46.

[0110] In the example above, the activation of the natural language understanding module 42 makes it possible to detect the concept of “calculate current position distance to an airport”. Thus, the natural language understanding module 42 is able to provide the following action to be carried out: {action = calculate current position-airport distance, criterion = minimize the distance] and the generation module 46 is able to generate

[0111] The transmission module 34 is configured to transmit the command to the corresponding avionics system 10 for the implementation of the critical avionics function.

[0112] The transmission module 34 is thus configured to analyze the command and send it to the avionics system 10 corresponding to said command.

[0113] The validation module 36 is configured to display the command to the operator 14 of the avionics system 10 before the transmission of the command to the avionics system. In particular, the validation module 36 is configured to display the command on the display screen 22 in front of the operator 14.

[0114] When several commands are generated by the generation module 48, the validation module 36 is configured to display the different commands.

[0115] The validation module 36 is configured to receive a validation of each command from the operator 14 and to send the command to the validation module 36. transmission 34 only after receipt of validation of the order by operator 14.

[0116] For example, when the command is displayed on the display screen 22, the validation module 36 is capable of displaying a validation button and / or a button for refusing transmission of the command to the avionics system 10.

[0117] When several commands are displayed, the validation module 36 is able to display a validation button next to each command in order to validate it or not.

[0118] In the example of [Fig.2], the electronic device 24 comprises an information processing unit formed for example by a memory and a processor associated with the memory. The reception module 26, the voice recognition module 28, the processing module 30, the monitoring device 32 and, as an optional addition, the transmission module 34 and the validation module 36 are each produced in the form of software, or a software brick, executable by the processor. The memory is then capable of storing reception software, voice recognition software, processing software, monitoring software and, as an optional addition, transmission software and validation software. The processor is then capable of executing each of these software programs.

[0119] In a variant not shown, the reception module 26, the voice recognition module 28, the processing module 30, the monitoring device 32 and, as an optional addition, the transmission module 34 and the validation module 36, are each produced in the form of a programmable logic component, such as an FPGA (Field Programmable Gate Array), or in the form of a dedicated integrated circuit, such as an ASIC (Application Specific Integrated Circuit).

[0120] When the electronic device 24 is produced in the form of one or more software programs, that is to say in the form of a computer program, it is furthermore capable of being recorded on a medium, not shown, readable by a computer. The computer-readable medium is, for example, a medium capable of storing electronic instructions and of being coupled to a bus of a computer system. By way of example, the readable medium is an optical disk, a magneto-optical disk, a ROM memory, a RAM memory, any type of non-volatile memory (for example EPROM, EEPROM, FLASH, NVRAM), a magnetic card or an optical card. A computer program comprising software instructions is then stored on the readable medium.

[0121] The operation of the electronic control device 24 according to the invention will now be explained with the aid of [Fig. 3] representing a flowchart of the method, according to the invention, for controlling an avionics system 10 for the implementation of a critical avionics function.

[0122] Initially, an operator 14 is installed in the control station 16.

[0123] The control station 16 is installed in an aircraft 12 or on the ground, for example in a control post 18, as shown in [Fig.l].

[0124] The operator 14 then issues a voice instruction to an avionics system 10 for the implementation of a critical avionics function.

[0125] As an example which will be developed later, the voice instruction issued by the operator 14 in the aircraft 12, for example the pilot, is for example “Assistant, can you set VHF1 to one hundred and twenty-six?”.

[0126] During an initial step 100, the reception module 26 receives the voice instruction signal acquired by the microphone 20 arranged in the control station 16 opposite the operator.

[0127] The receiving module 26 also receives the local context. For example, the receiving module 26 receives the geographical position and speed of the aircraft 12, the weather conditions of the environment of the aircraft 12, the state of consciousness of the operator 14, etc.

[0128] Then, during a step 110, the voice recognition module 28 receives the instruction voice signal from the reception module 26 and transforms the voice signal into a text transcription of the voice signal.

[0129] During an optional step 120, the activation module 50 then activates the processing module 30 and in particular the automatic language processing module 40 after the reception module 26 has received the voice signal or the processing module 30 has received the text transcription.

[0130] Then, during a step 130, the processing module 30 receives the text transcription from the voice recognition module 28 and processes the text transcription in order to associate the text transcription with at least one action to be carried out intended for the avionics system 10.

[0131] In particular, the automatic language processing module 40 carries out at least one processing chosen from:

[0132] - a lemmatization of the textual transcription;

[0133] - a rooting of the textual transcription;

[0134] - recognition of keywords and / or named entities in the transcription textual.

[0135] In the case of the example cited above, the automatic language processing module 40 processes the command “Assistant, can you set VHF1 to one hundred and twenty-six?” and detects the keywords “assistant”, “VHF1” “set” “one hundred and twenty-six”. However, this processing is insufficient to obtain an action to be performed. The automatic language processing module 40 thus detects the keyword “assistant” and understands that the rest of the voice command is a command to be processed.

[0136] During an optional step 140, the activation module 50 activates the natural language understanding module 42 only if the action to be performed does not allow the generation of a command by the generation module 46.

[0137] Still in the same example, the natural language understanding module 42 detects the action “set” and detects that “VHF1” is a radio among a list of radios available for the action “set”. The natural language understanding module 42 interrogates the associated avionics system 10, here the RMS (for “Radio Management System” in English or “Système de Gestion Radio” in French), the frequencies available from “one hundred and twenty six”. The RMS responds with the frequencies that it knows in particular with regard to what the operator 14 has stated, depending on the current and envisaged position of the aircraft 12, the possible range of the radio frequency, etc. The natural language understanding module 42 then detects that the frequencies “126.0 MHz” and “120.6 MHz” are possible. The processing module 30 then associates the two actions to be carried out with the text transcription {action=set frequency of VHF1 radio, value=126.0] and {action=set frequency of VHF1 radio, value=120.6}. .

[0138] Then, during step 150, the control module 44 checks whether the textual transcription and / or the action to be carried out is consistent according to at least one consistency rule, in particular whether the three conditions according to the consistency rule a), b) and c) listed above are respected.

[0139] In the example, the control module 44 checks the consistency of the text transcription “Assistant, can you set VHF1 to one hundred and twenty-six?” and / or the actions to be performed {action=set frequency of radio VHF1, value=126.0] and {action=set frequency of radio VHF1, value=120.6}. Here, the control module 44 does not detect any inconsistency.

[0140] If no inconsistency is detected, the module 48 then generates a control signal associated with the action to be carried out during a step 160.

[0141] When an inconsistency is detected by the control module 44, the alert module 48 generates an alert signal during a step 170. In particular, the alert module 48 sends the alert signal to the display screen 22 so that the operator 14 can be informed of the alert.

[0142] After step 160, during a step 180, the validation module 36 receives each command before transmission to the transmission module 34.

[0143] The validation module 36 then displays the command on the display screen 22 in front of the operator 14. When several commands are generated by the generation module 48, the validation module 36 displays the different commands.

[0144] In the example, the validation module 36 displays for example on the display screen 22 “Set VHF1 to 126.0 MHz” and “Set VHF1 to 120.6 MHz”. The operator 14 can then validate the command he desires, namely here “Set VHF1 to 120.6 MHz”.

[0145] During a step 190, the validation module 36 receives the validation of each command from the operator 14 and sends the command to the transmission module 34 only after receiving the validation of the command by the operator 14.

[0146] Then during a step 200, the transmission module 34 transmits the command to the corresponding avionics system 10 for the implementation of the critical avionics function. In particular, the transmission module 34 analyzes the command and sends it to the avionics system 10 corresponding to said command.

[0147] In the context of the example, the transmission module 34 detects that the commands associated with the actions to be performed {action=set frequency of VHF1 radio, value=126.0] and {action=set frequency of VHF1 radio, value=120.6] are intended for the RMS.

[0148] The avionics system 10 then receives the command and implements the critical avionics function.

[0149] For example, the RMS changes the frequency of the VHF1 radio to the frequency 120.6 Mhz.

[0150] It is therefore understood that the present invention has a certain number of advantages.

[0151] Indeed, the monitoring device 32 makes it possible to verify that the command generated by the processing module 30 is coherent from a syntactic point of view, from a semantic point of view and in view of the current context, that is to say that the command is realistic and achievable by the avionics system 10 in the current context.

[0152] The invention makes it possible to alert the operator 14 in the event of detection of an incoherent command and thus the critical avionics system 10 does not carry out the incoherent command which could have possible serious consequences on the safety of the aircraft 12 and its environment.

[0153] Thus, the invention makes it possible to simplify the communication of the operator 14 with the different avionics systems 10 while allowing significant security for the implementation of a critical avionics function.

[0154] This simplification and validation of the commands makes it possible to reduce the mental load of the operator 14 who is then better able to manage the different complex situations that he encounters during the flight or control of the aircraft 12.

[0155] Thus, the invention allows an improvement in both the comfort of the operator 14 and safety, particularly with regard to the significant safety requirements in the avionics field.

Claims

1. Claims Electronic control device (24) of an avionics system (10) of an aircraft (12) for implementing a critical avionics function, the critical avionics function being chosen from the group comprising: flight control of the aircraft (12), trajectory calculation of the aircraft (12), communication of the aircraft (12) with the control station (18), a change in communication frequency of the aircraft (12) and an air traffic control order; the avionics system (10) being able to operate according to a current context defined by at least one operating parameter associated with the avionics system (10), the electronic control device (24) comprising: - a reception module (26) configured to receive a voice instruction signal picked up by a microphone (20) and to receive the current context; - a voice recognition module (28) configured to transform the voice signal into a text transcription of said voice signal; - a processing module (30) configured to process the text transcription in order to associate the text transcription with at least one action to be carried out intended for the avionics system; - a monitoring device (32) configured to receive the text transcription and / or the action to be performed, the monitoring device (32) comprising: + a control module (44) configured to verify whether the textual transcription and / or the action to be performed is consistent according to at least one predetermined consistency rule, the textual transcription and / or the action to be performed being considered consistent according to the consistency rule if and only if: a) the textual transcription and / or the action to be carried out is consistent with the expected syntax according to a predetermined database of syntactic rules (52), b) the textual transcription and / or the action to be carried out is consistent with the expected lexical field according to a predetermined database of the lexical field (54) expected in the current context of the avionics system (10), and c) the textual transcription and / or the action to be performed is consistent with the current context of the avionics system (10), + a generation module (48) configured to generate a command associated with the action to be performed only if no inconsistency is detected by the control module (44).

2. The electronic device (24) of claim 1, wherein the electronic device (24) comprises a transmission module (34) configured to transmit the command to the avionics system (10) for implementing the critical avionics function.

3. The electronic device (24) of claim 2, wherein the electronic device (24) further comprises a validation module (36) configured to display the command to an operator (14) of the avionics system (10) before transmitting the command to the avionics system (10), the validation module (36) being configured to receive a validation of the command from the operator (14) and to send the command to the transmission module (36) only after receiving the validation of the command from the operator (14).

4. An electronic device (24) according to any preceding claim, wherein the monitoring device (32) further comprises an alert module (48) configured to generate an alert signal when an inconsistency is detected by the control module (44).

5. An electronic device (24) according to any preceding claim, wherein each operating parameter associated with the avionics system (10) is selected from the group consisting of: - a flight parameter of an aircraft (12) associated with the avionics system (10); - a flight plan associated with the aircraft (12); - a mission assigned to the aircraft (12); - a parameter from at least one avionics sensor; - a meteorological parameter associated with the environment of the aircraft (12); and - a physiological parameter of an operator (14) of the avionics system (10).

6. Electronic device (24) according to any one of the preceding claims, in which the processing module (30) comprises an automatic language processing module (40) configured to carry out at least one processing chosen from: - a lemmatization of the textual transcription; - a stemming of the textual transcription; - a recognition of keywords and / or named entities in the textual transcription.

7. Electronic device (24) according to any one of the preceding claims, wherein the processing module (30) comprises a natural language understanding module (42) configured to perform at least one processing chosen from: - a recognition of textual patterns in the textual transcription; - an association of the textual transcription with at least one concept stored in a database (56); - a use of a semantic engine to link sequences of words of the textual transcription to at least one concept; and - an application of a neural network to detect feelings and / or intentions in the textual transcription.

8. Electronic device (24) according to claims 5 and 6, wherein the monitoring device (32) further comprises an activation module (50) configured to: - activate the automatic language processing module (40); - analyze whether the action to be performed obtained by the processing performed by the automatic language processing module (40) allows the generation of a command by the generation module (46); - activate the natural language understanding module (42) only if the action to be performed does not allow the generation of a command by the generation module (46).

9. Method for controlling an avionics system (10) of an aircraft (12) for implementing a critical avionics function, the critical avionics function being chosen from the group comprising: flight control of the aircraft (12), trajectory calculation of the aircraft (12), communication of the aircraft (12) with the control station (18), a change in communication frequency of the aircraft (12) and an air traffic regulation order; the avionics system (10) being capable of operating according to a

10. current context defined by at least one operating parameter associated with the avionics system (10), the method being implemented by an electronic control device (24) and comprising the following steps - receiving (100) an instruction voice signal acquired by a microphone and receiving the local context; - transformation (110) of the voice signal into a textual transcription of said voice signal; - processing (130) of the textual transcription in order to associate the textual transcription with at least one action to be carried out intended for the avionics system; - verification (150) whether the textual transcription and / or the action to be carried out is consistent according to at least one predetermined consistency rule, the textual transcription and / or the action to be carried out being considered consistent according to the consistency rule if and only if: a) the textual transcription and / or the action to be performed is consistent with the expected syntax according to a predetermined database of syntactic rules, b) the textual transcription and / or the action to be carried out is consistent with the expected lexical field according to a predetermined database of the expected lexical field in the current context of the avionics system, and c) the textual transcription and / or the action to be carried out is consistent with the current context of the avionics system, - generation (160) of a control signal associated with the action to be carried out only if no inconsistency is detected. A computer program comprising software instructions which, when executed by a computer, implement a method according to the preceding claim.