Display method for an electronic display system intended to be integrated into a cockpit of an aircraft, associated computer program product and arrangement module

Abstract

Display method for an electronic display system intended to be integrated into a cockpit of an aircraft, computer program product and associated arrangement module The present invention relates to a display method for an electronic display system intended to be integrated into a cockpit of an aircraft, the method being implemented by an arrangement module capable of being connected to a set of graphic computers and to a set of displays. Each display defines at least one display surface. The method comprises a step of receiving (110), from each graphic computer, at least one calculated stream. The method comprises a step of generating (120), for each calculated stream received, at least one Human-System Interface layer. The method comprises, for each display or for each display surface, a step of forming (130) a distributed video stream from the Human-System Interface layers.The method comprises a step of sending (140), to the set of displays, distributed video streams comprising the Human-System Interface layers, with a view to their display on each display or each display surface. Figure for the abstract: Figure 6.

Description

Title of the invention: Display method for an electronic display system intended to be integrated into a cockpit of an aircraft, associated computer program product and arrangement module

[0001] The present invention relates to an electronic display system intended to be integrated into a cockpit of an aircraft.

[0002] The present invention relates to the field of display systems in aircraft.

[0003] It is known in aircraft that the cockpit comprises an electronic display system comprising: displays for providing information to the pilot, and graphic calculators.

[0004] Different types of displays are generally present in cockpits: head-down displays, head-up displays, also called HUD displays (from the English Heads Up Display) including windshield projection solutions, and possibly displays included in the pilots' helmets, also called HWD displays (from the English Head Worn Display).

[0005] It is known that head-down displays are display screens, positioned in a lower part of the cockpit relative to the head-up display(s).

[0006] The head-up display(s) and the displays included in the helmets generally comprise at least partially transparent surfaces positioned between the pilot and a cockpit window, and onto which a video stream is projected. Projection directly onto the windshield is also possible. Thus, the pilot observes the superposition of the external environment of the aircraft, via a cockpit window, and the video stream projected onto the surface.

[0007] It is known that the display device comprises, for each display, one or more video sources from one or more respective computers capable of determining the video stream to be displayed on the display.

[0008] However, such an architecture of the electronic display system is substantially rigid since the content displayed on each display depends solely on the associated computer.

[0009] The present invention relates to a display method for an electronic display system intended to be integrated into a cockpit of an aircraft, the method being implemented by an arrangement module capable of being connected to a set of graphic computers and to a set of displays, each display defining at least one display surface;

[0010] the method comprising the following steps: - reception, from each graphic calculator, of at least one calculated flow, - generation, for each calculated flow received, of at least one Interface layer Man-System, - for each display or for each display surface, formation of a distributed video stream from the Human-System Interface layers, - sending, to the set of displays, distributed video streams including the Human-System Interface layers, for display on each display or each display surface.

[0011] According to particular embodiments of the invention, the display method comprises one or more of the following characteristics, taken in isolation, or in all technically possible combinations. - during the training step, at least one distributed video stream includes Human-System Interface layers generated from calculated streams from several distinct graphics calculators; - during the training step, at least two distinct distributed video streams are formed by dividing a Human-System Interface layer geometrically, each of said two distributed video streams comprising a portion of the Human-System Interface layer resulting from the division; - the method further comprises further comprising the following steps: • receiving an instruction to modify the display of a distributed video stream, sent from a user of the display system, • forming a new distributed video stream in place of the distributed video stream targeted by the instruction, based on the received instruction, and • sending, to the corresponding display, or to the corresponding display surface, the new distributed video stream for display on the display or display surface; - the modification instruction is chosen from: • an instruction to move a Human-System Interface layer in a distributed video stream, • an instruction to enlarge or shrink the display of a Human-System Interface layer in a video stream, and • a Human System Interface layer deletion instruction in a distributed video stream; • during the generation step, each Human-System Interface layer is associated with at least one attribute indicating the graphic calculator from which the calculated flow from which the Human-System Interface layer is generated comes, during the training step, each distributed video flow is formed according to of predetermined rules depending on the graphic calculator indicated in each attribute of each Human-System Interface layer; • the set of calculators includes critical calculators and non-critical calculators, the predetermined rules being a function of the criticality of the calculators; • the method comprises, in parallel with these steps, a monitoring phase, during which the execution of each step is monitored by a monitoring module,

[0012] in the event of detection of a malfunction by the monitoring module, the monitoring module commanding at least one action from among the following actions: • display of a warning message on one of the displays, • reconfiguration of a distribution of the Human-System Interface layers in the distributed flows, and • inhibition of the flow calculated by one of the calculators; and • during the training step (130), at least one formed distributed video stream comprises several Human-Machine Interface layers (56).

[0013] The present invention also relates to a computer program product comprising software instructions which, when executed by a computer, implement such a method.

[0014] The present invention also relates to an arrangement module for an electronic display system intended to be integrated into a cockpit of an aircraft,

[0015] the arrangement module being capable of being connected to a set of graphic computers and to a set of displays, each display defining at least one display surface;

[0016] the arrangement module comprising at least one generation unit configured to receive from each graphic calculator a calculated flow and to generate at least one Human-System Interface layer from this calculated flow,

[0017] the arrangement module further comprising a merging and distribution unit configured to form, for each display or for each display surface, a video stream distributed from the Human-System Interface layers,

[0018] the fusion-distribution unit being further configured to send, to the set of displays, the distributed video streams formed for display on each display or each display surface.

[0019] Other characteristics and advantages of the invention will appear on reading the following description of embodiments of the invention, given by way of example only and with reference to the drawings which are: - [Fig.l] [Fig.l] is a schematic representation of a cockpit of an aircraft comprising an electronic display system according to the invention; - [Fig.2] [Fig.2] is a schematic representation of a set display(s) included in the electronic display system according to the invention; - [Fig.3] [Fig.3] is a schematic representation of the electronic display system according to the invention; - [Fig.4] [Fig.4] is a schematic representation of the whole display(s) of [Fig.2] showing an example of video stream display distribution; - [Fig.5] [Fig.5] is a detailed schematic representation of an arrangement module included in the electronic display system of [Fig.3], - [Fig.6] [Fig.6] is a flowchart of a display method implemented by the display system according to [Fig.3].

[0020] In [Fig. 1] a cockpit 9 of an aircraft is shown. In the cockpit 9 an electronic display system 10 is installed.

[0021] The electronic display system 10 comprises a set of displays 15, a set of graphic calculators 20, an arrangement module 25, and optionally a set of instruction sensor(s) 26 and a decision module 27.

[0022] The set of displays 15 preferably comprises at least one head-up display 15A, at least one head-down display 15B.

[0023] Each display comprises at least one display panel 30, also called panel 30. The term “display panel” means a display module comprising display means such as liquid crystal, plasma, LED, microLED or OLED means, and an electronic resource suitable for receiving images to be displayed and suitable for controlling the display means to display said images to be displayed, and optionally a frame delimiting the outline of the display means.

[0024] For example, each panel 30 is of the “borderless” type, also called extra-thin edge. In other words, each panel 30 does not include any frame, or a frame whose thickness is less than 5 mm. Thus, the frame, if it is present, is not distinguishable for a pilot in the cockpit 9.

[0025] The display panels 30 of each display 15A, 15B define at least one display surface 32. At least one display surface 32 is formed by several contiguous panels 30.

[0026] With reference to [Fig.2], such a surface is defined by the lowest display tiles 30 of the lowest head-down display.

[0027] In the example of [Fig.2], the display assembly 15 comprises a head-up display 15A and a head-down display 15B. The head-up display 15A comprises a single display panel 30 defining a single display surface 32. The head-down display 15B comprises four display panels 30 defining two surfaces separate display areas.

[0028] As visible in [Fig.2], each display panel 30 preferably has a substantially rectangular shape, extending between edges. The edges are for example formed by the frame of the panel 30 when it comprises such a frame. If the panel 30 does not comprise a frame, then the edges are formed by the ends of the display means. According to a variant not shown, at least one of the panels 30 has a non-rectangular shape, such as a curved or conical shape, for example matching the shape of the cockpit 9.

[0029] The slabs 30 comprise edges, or edge portions, delimiting a perimeter of the corresponding display 15A, 15B. These edges are called external edges 35. The external edges 35 are shown in solid lines in [Fig.2].

[0030] At least two slabs 30 of one of the displays 15A, 15B are contiguous. By "contiguous" is meant that the slabs 30 join at at least one edge, without showing any visible space between the slabs 30. Advantageously, the transition zone between each pair of contiguous slabs 30 of the same display 15A, 15B is substantially flat and devoid of roughness.

[0031] The contiguous slabs 30 comprise at least one edge, or part of an edge, contiguous to one another, called contiguous edge 40.

[0032] In [Fig.2], only the head-down display 15B comprises such contiguous panels 30. It is clear that such a configuration is also possible for the 15A head-up display.

[0033] In the example of [Fig.2], the contiguous edges 40 are represented by a dashed line. The contiguous tiles 30 are such that, when the electronic display system is integrated into the cockpit 9 of an aircraft, the contiguous edges 40 of the contiguous tiles are indistinguishable for a pilot of the aircraft.

[0034] With reference to [Fig. 3], the graphic calculators 20 are each capable of calculating a calculated stream. The calculated stream is one of: a video stream, a graphic command stream, or an aeronautical command stream, to be displayed on the set of displays 15. Each calculated stream comprises informational content to be displayed.

[0035] The video stream(s) preferably conform to any video protocol implementing a level of service required by the stream. Thus, each stream has characteristics conforming to a predefined criterion in terms of integrity, availability depending on attacks in the aeronautical environment and flow rate.

[0036] For example, the video stream(s) comply with the ARINC 818 protocol, the DVI protocol or the SMPTE protocol. Each video stream preferably comprises periodically refreshed sub-images 37.

[0037] The graphical command flow(s) are for example command flows in a graphics language, such as OpenGL, Vulkan, or any other graphics API.

[0038] The aeronautical command flow(s) are command flows preferably complying with the ARINC 661 protocol.

[0039] For example and as shown in [Fig. 3], the electronic display system 10 comprises at least one graphics computer 20 capable of calculating a video stream conforming to the ARINC 818 protocol, at least one graphics computer 20 capable of calculating aeronautical commands conforming to the ARINC 661 protocol, and at least one graphics computer 20 capable of calculating graphics commands in a graphics language such as the OpenGL language.

[0040] Each graphic calculator 20 comprises for example a calculation unit 45 capable of generating graphic commands and / or aeronautical commands as described previously.

[0041] At least one graphics calculator 20 further comprises a graphics unit 50 connected to the calculation unit 45 and capable of generating one or more video streams from the generated graphics and / or aeronautical commands.

[0042] In the example of [Fig.3], two of the three graphic calculators 20 shown comprise a respective graphic unit 50.

[0043] At least one graphics computer 20 comprising a graphics unit 50 further comprises a video unit 55. Preferably, the graphics computer(s) 50 comprising a video unit 55 are connected to external equipment not shown. Said external equipment comprises for example a flight computer of the aircraft as well as databases. Thus, said graphics computer 20 is configured to receive, from this external system, information to be represented in the calculated stream(s) to be displayed on the set of display(s) 15. The information to be represented received is for example in a video format conforming to the ARINC A818 or SMTPE protocol. Said information is for example symbological content. Each video stream comprises for example, at least for the symbological content, a transparency level, also called alpha level.

[0044] In this case, the video unit 55 is capable of processing this information and combining it with the video stream from the graphics unit 50 to form the calculated video stream.

[0045] Optionally, the video unit 55 is further capable of receiving an external video stream 73 and combining it with the other streams.

[0046] If the graphic calculator 20 comprises only one respective calculation unit 45, the flow calculated by this calculator 20 is the flow of graphic or aeronautical commands generated by said calculation unit 45. This is notably the case of the calculator represented at the top in [Fig.3].

[0047] If a graphics calculator 20 comprises only a calculation unit 45 and a respective graphics unit 50, the flow calculated by this calculator 20 is the video flow generated by said graphics unit 50 and / or the flow calculated by the calculation unit 45. This is notably the case of the calculator 20 represented in the middle in [Fig.3].

[0048] If a graphics calculator 20 comprises a calculation unit 45, a graphics unit 50 and a video unit 55 respectively, the flow calculated by this calculator 20 is the video flow from said video unit 55, and / or the flow calculated by the graphics unit 50, and / or the flow calculated by the calculation unit 45. This is notably the case of the calculator 20 shown at the bottom in [Fig.3].

[0049] It is clear that all these types of graphic calculator 20 are not necessarily included in the system 10. It is also clear that several graphic calculators 20 are likely to be of the same type, i.e. comprising the same units 45, 50, 55.

[0050] According to a non-represented example, the system comprises: - at least one graphic calculator 20 comprising only one calculation unit 45 and generating one or more flows specific to it., - at least one graphics calculator 20 comprising only a calculation unit 45 and a graphics unit 50 and generating one or more flows specific to it, and - at least one graphics calculator 20 comprising a calculation unit 45, a graphics unit 50 and a video unit 55 and generating one or more streams specific to it.

[0051] In a variant not shown, even if one of the graphics calculators 20 comprises a graphics unit 50 and possibly a video unit 55, it is still capable of sending a calculated stream comprising only graphics or aeronautical commands from the calculation unit 45.

[0052] Furthermore, the graphics computers 20 are of two types: critical graphics computers 20C and non-critical graphics computers 20NC.

[0053] Each critical 20C computer is capable of calculating at least one video or graphic / aeronautical command stream(s) comprising more important information for successfully carrying out the flight of the aircraft than the video or graphic / aeronautical command stream(s) calculated by each non-critical 20NC computer.

[0054] Preferably, each critical computer 20C is capable of receiving, from the arrangement module 25, a working frequency of said arrangement module, as will be described later. Each critical computer 20C is then adapted to send the calculated flow corresponding to the received working frequency. For example, the non-critical computers 20NC are adapted to send the corresponding calculated flow according to a frequency specific to said computer 20NC and independent of the working frequency of the arrangement module 25.

[0055] In the remainder of the description, the reference 20 is indicated when a characteristic applies to both critical 20C and non-critical 20NC computers. Conversely, when the characteristic applies only to one of these types of computer, the reference 20C or 20NC is chosen.

[0056] Furthermore, independently of the critical or non-critical aspects, the graphic calculators 20 are, according to one embodiment, distinct from one another and are capable of providing the calculated flows in distinct formats from one graphic calculator 20 to another.

[0057] The arrangement module 25 is connected to each graphics calculator 20 and to each display 15A, 15B or display surface 32. The arrangement module 25 is configured to form, from the calculated streams, a distributed video stream for each display 15A, 15B or for each display surface 32. The distributed video streams are also called distributed streams.

[0058] The or at least one of the distributed video streams comprises informational contents from streams calculated by different graphic calculators 20.

[0059] For this purpose, the arrangement module 25 is configured to receive the calculated flows from each graphics calculator 20.

[0060] According to the embodiment in which the graphic calculators 20 are of distinct types, the arrangement module 25 comprises means suitable for acquiring the calculated flows according to the different formats of the graphic calculators 20. For example, the formats may be compliant with the aeronautical graphics protocol of the ARINC 661 type, compliant with the graphic APIs (from the English, Application Programming Interface) of the OpenGL, Vulkan type, or any other graphic API, compliant with all video standards (compressed or not), or compliant with any other type.

[0061] With reference to [Fig.5], the arrangement module 25 comprises a plurality of generation units 60. Preferably, the arrangement module 25 comprises at least one generation unit 60 for each graphics calculator 20.

[0062] Each generation unit 60 is configured to receive a calculated flow and to generate from this calculated flow, at least one Human-System Interface layer 56, also called IHS layer 56.

[0063] The term “IHS layer” means a video-type format comprising informational content intended for the user and preferably with which said user is able to interact when it is displayed.

[0064] Preferably, each generation unit 60 is configured to, if the calculated stream received is a video stream, separate the sub-images 37 of said video stream and generate for each sub-image 37, a respective IHS layer 56.

[0065] Preferably, each generation unit 60 is configured for, if the calculated flow received is a flow of graphics commands or a flow of aero commands nautical, generate one or more IHS 56 layers from said command(s) contained in the received calculated stream.

[0066] Optionally, each IHS layer 56 comprises at least one attribute indicating the graphics computer 20 from which the calculated flow from which the IHS layer 56 is generated originates. Thus, the IHS layers 56 originating from critical graphics computer(s) 20C are identifiable.

[0067] Preferably, each generation unit 60 associated with a respective critical computer 20C is capable of sending the working frequency to said critical computer 20C.

[0068] Optionally, each generation unit 60 is for example capable of associating a transparency level with each IHS layer 56.

[0069] In particular, each computer 20 is configured to define the superposition of the future IHS 56 layers and the generation unit 60 is configured to deduce therefrom a transparency level of each IHS 56 layer. Alternatively, the transparency level is determined by the generation unit 60 according to predetermined rules defining a mixture and a superposition of the IHS 56 layers in the distributed streams, as described below. For example, in an IHS 56 layer intended to be placed below another, a background color is detected and a transparency level is associated with the pixels of this color so that it can be covered by another IHS 56 layer. For example, additional filtering is carried out on the pixels of the two IHS 56 layers to ensure a color transition allowing good visibility of each IHS 56 layer in the distributed stream.

[0070] The arrangement module 25 further comprises a merging and distribution unit 65.

[0071] The merging and distribution unit 65 is configured to receive each IHS layer 56 generated by the generation units 60.

[0072] The merging and distribution unit 65 is configured to distribute the IHS layers 56 among the displays 15A, 15B or among the display surfaces 32 by forming the distributed video streams. The merging and distribution unit 65 is then configured to form one video stream per display 15A, 15B or per display surface 32. Each distributed video stream comprises all or part of one or more IHS layers 56, possibly processed.

[0073] Preferably, at least one distributed video stream comprises several Human-Machine Interface layers 56.

[0074] For example, a distributed stream comprises IHS 56 layers generated from computed streams from multiple separate graphics calculators 20.

[0075] The distribution fusion unit 65 is for example further configured to form each distributed stream so that it is adapted to the display 15A, 15B, or to the display surface 32 on which it is intended to be displayed. For example, if the head-up display 15A is a transparent surface onto which video streams are projected, the arrangement module 25 is configured to adapt the distributed stream to be displayed on said head-up display 15A, so that the projected stream is consistent with the real world for the pilot of the aircraft. By "consistent with the real world" is meant the fact that a graphic object belonging to the distributed stream is perceived as superimposed on the corresponding real object. For example, if the distributed stream considered is a pointer relating to the position of a building, said distributed stream must superimpose the pointer and the real building targeted. For example also, if the distributed video stream is the horizon line, said line is superimposed on the real horizon.

[0076] Furthermore, the merging and distribution unit 65 is configured to distribute the IHS layers 56 in the distributed streams so that there is no contradiction between the head-up displays 15A and head-down displays 15B.

[0077] As an optional addition, the merging and distribution unit 65 is capable of forming each distributed flow by applying predetermined rules, also called predefined rules, depending on the graphics calculator 20 indicated in each attribute of each IHS layer 56.

[0078] Preferably, the arrangement module 25 is capable of receiving these predetermined rules from the decision module 27, also called Windows manager 27, as described below. For example, the predetermined rules are selected by the decision module 27 in a static manner.

[0079] For example, the predetermined rules define, as a function of the graphics computer 20 from which the video stream originates, the processing to be applied to the generated IHS layers 56, and the displays 15A, 15B, or display surface(s) 32 on which the distributed streams formed from said layers 56 must be displayed.

[0080] For example, the predetermined rules define the position of each IHS 56 layer when it will be displayed on the display, as well as the superposition of the IHS 56 layers.

[0081] For example, the predetermined rules are such that the arrangement module 25, and in particular the distribution unit 65, preserves the integrity, priority and visibility of the IHS layers 56 originating from flows calculated by the critical graphics computers 20C. In other words, from the attribute(s) present in the IHS layers 56, the arrangement module 25 ensures that the IHS layers 56 originating from the critical computers 20C are always the upper layers in the event of superposition and that the information they contain is always accessible in the distributed flows formed. For this purpose, the predetermined rules are such that a priority level is associated with each IHS layer 56 depending on the computer 20C, 20NC from which it originates.

[0082] The arrangement module 25, and in particular the merging and distribution unit 65, is preferably agnostic of the composition of each display 15A, 15B and of the display surfaces 32. In other words, for the distribution of the IHS layers 56 in the distributed streams, the arrangement module 25 preferably only has knowledge of the dimensions of the display 15A, 15B, or of the display surface 32, for example in terms of pixels, and of their geometry. The arrangement module 25, and the computers 20 are then ignorant of the number of tiles 30 making up each display 15A, 15B and / or display surface 32 and of the limits of each tile 30.

[0083] As an optional addition, the arrangement module 25, for example via its merging and distribution unit 65, is configured to display, in a superimposed manner, on the same area of ​​the tiles 30, several IHS layers 56 originating from distinct calculated flows. For this purpose, the merging and distribution unit 65 is in particular configured to use the transparency level of the IHS layers 56 when forming the distributed flow and configured to use mixing laws to be applied to the IHS layers 56 to be superimposed totally or partially. Thus, according to this optional addition, at least two IHS 56 layers are partially superimposed on the set of displays 15. Preferably, the fusion and distribution unit 65 is configured to first superimpose the lowest priority IHS 56 layers (from non-critical computers), then the highest priority IHS 56 layers (from critical computers), to preserve their integrity.

[0084] The arrangement module 25 is for example agnostic of the contiguous edges 40 of the tiles 30. Thus, the arrangement module 25 is for example configured to distribute the display of at least one distributed stream distributed between several tiles 30. In other words, the arrangement module 25 is for example configured to distribute the display of the distributed streams so that an IHS layer 56 included in a distributed stream is partially displayed on a first display tile 30 of the set of displays 15 and partially displayed on a second display tile 30 of the set of displays 15, the first and second display tiles 30 being contiguous.

[0085] Optionally, the arrangement module 25 is configured to, when forming the distributed streams, divide an IHS layer 56 geometrically. Each of said distributed video streams is then intended to be displayed on a separate display 15A, 15B or on a separate display surface 32. Preferably, the arrangement module 25 is configured to guarantee, in the distribution of said distributed streams, continuity between the displays 15A, 15B and display surfaces 32. By way of example, the arrangement module 25 is configured to distribute said distributed streams so as to align the display of the IHS layer(s) 56 divided between the head-up display 15A and the head-down display 15B.

[0086] According to a variant not shown, the arrangement module 25 further comprises an output intended to be connected to a recorder not shown and included in the system 10. According to this variant, the arrangement module 25 is configured to send, to said recorder, distributed video streams for subsequent post-processing. Optionally, the copy is in a format other than that of the distributed video streams. For example, the copy is compressed, resized or composed. For example, the copy is suitable for being sent to the recorder via an Ethernet cable.

[0087] As an optional addition, the arrangement module 25 is configured to, if a received stream is not valid, for example a noisy or empty signal due to a non-functional cable, transmit this information to the decision module 27 so that the decision module 27 determines new predefined rules to be transmitted to the arrangement module 25.

[0088] The working frequency of the arrangement module 25 preferably has a value taking into account the latencies linked to: the processing by the generation units 60 and by the merging and distribution unit 65, the sending of the distributed flows to the displays and the display by the displays. Also, it is understood that the arrangement module 25 makes it possible to process synchronously the calculated flows from the critical computers 20C. Thus, a time between the calculation of the calculated flows from the critical computers 20C and their display is minimized. This time is for example less than 1 ms.

[0089] Since the working frequency is not dedicated to the non-critical computers 20NC, the arrangement module 25 is preferably configured to process the calculated flows of these non-critical computers 20NC asynchronously. Optionally, the arrangement module comprises an image rate conversion unit (not shown), called FRC unit (from the English Frame Rate Covered f) suitable for processing potential conflicts between the synchronous and asynchronous processing of the calculated flows. Preferably then, the working frequency then further depends on the latency linked to the FRC unit.

[0090] According to a non-represented example, the electronic display system 10 comprises several arrangement modules 25. In operation, each graphic calculator 20 is configured to send the calculated flow(s) to the same arrangement module 25, called the master module. If said master module 25 is unavailable, each calculated flow is redirected to another arrangement module 25, which then becomes the master module.

[0091] Again with reference to [Fig.3], each display is configured to distribute the display of the associated distributed stream on its display panel 30 or among its display panels 30 if it comprises several display panels 30.

[0092] [Fig.4] represents an example of a display distribution of distributed flows from calculated flows, carried out by the arrangement module 25. In particular, [Fig.4] represents the same set of display(s) as that represented in [Fig.2]. The contiguous edges 40 of the tiles 30 are not represented in [Fig.4] for reasons of li- sibility.

[0093] In [Fig.4], the IHS 56 layers of the distributed flows are represented by rectangles with rounded corners.

[0094] In the example illustrated in [Fig. 4], the electronic display system comprises three graphics computers 20. Each graphics computer 20 calculates calculated flows specific to it. A first graphics computer 20 calculates the video flows corresponding to IHS layers 56 whose filling is dotted in [Fig. 4]. A second graphics computer 20 calculates a flow of graphics commands corresponding to IHS layers 56 whose filling is hatched from bottom left to top right in [Fig. 4]. A third graphics computer 20 calculates video flows corresponding to IHS layers 56 whose filling is hatched from bottom right to top left in [Fig. 4]. Finally, a fourth graphics computer 20 calculates aeronautical command flows corresponding to IHS layers 56 whose filling is hatched in crosshatches in [Fig. 4].

[0095] It is visible in [Fig.4] that the IHS 56 layers resulting from the flows calculated by the same graphic calculator 20 are for example displayed on several displays 15A, 15B.

[0096] Furthermore, as visible in [Fig.4], the IHS layers 56 from the calculated flows coming from the second and fourth graphic calculators 20 are displayed on several tiles 30. These IHS layers bear the reference 561 in [Fig.4].

[0097] Thus, it is clear that the arrangement module 25 considers all of the tiles 30 of the same display 15 as a single display surface 32 without prejudging the limits of the tiles 30.

[0098] Again with reference to [Fig. 3], the sensor assembly 26 is configured to acquire an instruction from a user of the electronic display system 10. The user of the electronic display system 10 is preferably the pilot of the aircraft. More particularly, the sensor assembly 26 is configured to acquire data resulting from an instruction from the user.

[0099] A user instruction is for example: the selection of a displayed IHS 56 layer to obtain more information on the content of said layer, the selection of an interactive object of a layer to change its state, enter information, an instruction to enlarge or shrink a displayed IHS 56 layer, an instruction to move an IHS 56 layer displayed on the set of displays 15, or an instruction to delete a displayed layer, or any other possible types of actions.

[0100] The set of sensors 26 preferably comprises a tactile, force or haptic sensor 261 integrated into the set of displays 15. For example, each display 15A, 15B is a tactile display capable of receiving a tactile press from the the user and to provide data resulting from this support. In particular, each panel 30 is a touch panel.

[0101] The set of sensors 26 further optionally comprises one or more multimodal sensors 262. The term “multimodal sensors” means sensors capable of acquiring instructions from the user without support. Such sensors are, for example, sensors for tracking the user's gaze, voice sensors or motion sensors. The multimodal sensor(s) are also capable of providing data resulting from an instruction from the user.

[0102] The decision module 27 is connected to the set of sensors 26, to each graphic calculator 20 and to the arrangement module 25.

[0103] The decision module 27 is configured to provide the arrangement module 25 with the predetermined rules.

[0104] The decision module 27 is aware of the architecture of the system 10. Thus, the decision module 27 knows the arrangement of the displays 15 and the panels 30 as well as the number of computers 20. In particular, the decision module 27 knows whether each computer 20 is a critical computer 20C or not 20NC, preferably by the information received from the arrangement module 25. The decision module 27 is configured to develop the predefined rules and transmit them to the arrangement module 25.

[0105] The decision module 27 is configured to receive, from the set of sensors 26, the data resulting from the user's instruction. The decision module 27 is further configured to identify, from the acquired data, the user's instruction, and to send, according to the identified instruction, a predefined instruction to at least one of: at least one of the graphic calculators 20, and the arrangement module 25. The predefined instruction depends on the identified instruction.

[0106] In particular, the decision module 27 is configured to identify, based on the received data, the IHS layer 56 concerned by the user's instruction. The decision module 27 is configured to then identify the instruction, for example from among the aforementioned examples of instructions.

[0107] The decision module 27 is configured to, based on the identified IHS 56 layer and the identified instruction, determine whether the instruction can be processed by the arrangement module 25, for example via a modification of the rules predefined by the decision module 27. In this case, the decision module 27 is configured to transmit the instruction to the arrangement module 25 to implement a corrective action on the distribution of the IHS 56 layers on the set of display(s) 15 during the formation of the distributed flows, for example by updating the predetermined rules. This is particularly the case when the instruction is an instruction to enlarge or shrink a displayed IHS 56 layer, an instruction to move an IHS 56 layer displayed on the display assembly(s) 15, or an instruction to delete a displayed IHS 56 layer.

[0108] When the instruction cannot be processed by the arrangement module 25, the decision module 27 is configured to transmit the instruction to the graphics computer 20 having calculated the calculated flow corresponding to the identified IHS layer 56, so that the graphics computer 20 implements the appropriate corrective action. In particular, the corresponding graphics computer 20 is configured to receive the instruction and the identified IHS layer 56 via its processing unit 45 previously described.

[0109] Optionally, the system 10 further comprises a monitoring module 28 configured to monitor that the actions of the arrangement module 25 are properly executed.

[0110] The monitoring module 28 is for example configured to monitor that no additional latency is added in the processing of the calculated flows. For example, the monitoring module 28 checks the frequency of reception of the flows by the generation units 60 and the crossing time of the arrangement module 25.

[0111] The monitoring module 28 is for example further configured to monitor that the extraction of the IHS layers 56 is correct. To this end, for the IHS layers 56 originating from calculated flows comprising graphic or aeronautical commands, the monitoring module 28 is for example configured to monitor that the pixels generated in the IHS layers 56 are compliant with the calculated flow.

[0112] Preferably, the monitoring module 28 is configured to, if it detects a malfunction in the previously mentioned functions that it monitors, command an action from among the following actions: - display of a warning message on one of the displays 15 for the pilot, - reconfiguration of the distribution of IHS 56 layers in distributed flows, and - inhibition of the flow calculated by one of the calculators 20.

[0113] In particular, to control the display of the warning message, the monitoring module 28 is preferably configured to send such a command to the decision module 27 which is then configured to transmit this command to a computer 20, preferably a critical computer 20C, more preferably the critical computer 20C concerned by the detected malfunction. In a variant not shown, the monitoring model 28 is configured to send said command directly to said computer 20.

[0114] To control the reconfiguration of the distribution of the IHS 56 layers, the monitoring module 28 is preferably configured to communicate the detected malfunction to the decision module 27 so that it adapts the predefined rules.

[0115] To command the inhibition of the flow calculated by one of the computers 20, the monitoring module 28 is preferably configured to send such a command to the decision module 27 which is then configured to transmit this command to a computer 20 so that it inhibits the output of its calculated flow.

[0116] Furthermore, the monitoring module 28 is for example configured to monitor the mixing of the IHS layers 56 by the merging and distribution unit 25 and the display position of each IHS layer 56. For this purpose, for example, the monitoring module 28 is configured to add pixels in the IHS layers 56, in the form of a pattern, and to verify that the pattern evolves over time on the displays. Preferably, the monitoring module 28 is configured to perform a polynomial sum of the pattern, for example from a hash or CRC function, and to verify that this signature on the displays.

[0117] As shown in [Fig. 3], the arrangement module 25 is also optionally connected to an external sensor (not shown) providing a respective external video stream 74, such as a camera. The arrangement module 25 is then configured to process this respective external stream 74 as if it came from a non-critical computer 20NC or a critical computer 20C.

[0118] For example, each graphics calculator 20, the arrangement module 25 and the decision module 27 are calculators comprising respectively a memory, at least one calculation processor, at least one graphics processor, at least one video processor. The functionalities of these modules 25, 27 and graphics calculators 20 are then implemented in the form of software, or a software brick, executable by the associated processor. In particular, each processing unit 45, graphics unit 50, video unit 55, generation unit 60 and fusion and distribution unit 65 is software or software brick.

[0119] Each memory is then capable of storing such software. Each processor is then capable of executing each of the software.

[0120] In a variant not shown, each graphic calculator 20, the arrangement module 25 and the decision module 27, are each produced in the form of a programmable logic component, such as an FPGA (Field Programmable Gate Array) or an integrated circuit, such as an ASIC (Application Specific Integrated Circuit).

[0121] When each graphic calculator 20, arrangement module 25 and decision module 27 is a calculator implementing software functionalities, i.e. computer programs, also called computer program products, said computer programs are furthermore capable of being recorded on a medium, not shown, readable by a computer. The computer-readable medium is for example a medium capable of storing electronic instructions and of being coupled to a bus of a computer system. For example, the readable medium is an optical disc, a magneto-optical disc, a ROM memory, a RAM memory, any type of non-volatile memory (for example FLASH or NVRAM) or a magnetic card. A computer program including software instructions is then stored on the readable medium.

[0122] The operation of the electronic display system 10 will now be described, via a display method, implemented by the arrangement module 25 and of which a flowchart is shown in [Fig.6].

[0123] Initially, each graphics calculator 20 calculates one or more calculated streams, for example from video content(s), and / or information to be displayed, received from the external equipment and / or calculated by the graphics calculator 20 itself. Also initially, the arrangement module 25 has for example sent the information on the criticality of the calculators, to the decision module 27 which then determines the predetermined rules.

[0124] Alternatively, the criticality information is known by the decision module 27 in a manner predefined by an operator having carried out the configurations of the cockpit considered.

[0125] The calculated flows are then sent to the arrangement module 25.

[0126] The display method comprises a reception step 110, during which the arrangement module 25 receives from each graphics calculator 20, at least one calculated stream.

[0127] The method then comprises a generation step 120, during which the arrangement module 25 generates, via its generation units 60 and for each calculated flow received, at least one IHS layer 56.

[0128] The method then comprises a formation step 130, during which the arrangement module 25 forms for each display 15A, 15B, or for each display surface 32, a video stream distributed from the IHS layers 56.

[0129] For this purpose, the arrangement module 25 determines, via its merging and distribution unit 65, a distribution of the IHS layers 56 by forming the distributed streams as explained previously, preferably by applying the rules predefined by the decision module 27. The method then comprises a sending step 140 during which the arrangement module 25 sends, for example via its merging and distribution unit 65, to the set of display(s) 15, the distributed video streams comprising the Human-System Interface layers (56) for display on each display 15A, 15B or each display surface 32.

[0130] Each display 15A, 15B receives the corresponding distributed video stream and distributes the display of the distributed stream on its panel 30 or between its panels 30.

[0131] Then, at a time, the driver optionally issues the display modification instruction.

[0132] This instruction is for example a tactile press on one of the set of display(s) 15, a voice instruction, an eye instruction or a movement instruction.

[0133] The set of sensors 26 then acquires data corresponding to the instruction issued by the pilot.

[0134] The set of sensors 26 transmits this data to the decision module 27. The decision module 27 then identifies the instruction issued by the pilot and the IHS layer 56 concerned.

[0135] The decision module 27 then determines whether the instruction can be processed by the arrangement module 25.

[0136] If yes, the decision module 27 transmits the instruction to the arrangement module 25, for example by establishing new predefined rules and transmitting them to the arrangement module 25.

[0137] The method then comprises a new reception step 150, during which the arrangement module 25 receives the instruction to modify the display of a distributed video stream, sent from a user of the display system 10, for example the pilot.

[0138] The method then comprises a step 160 of forming a new distributed video stream in place of the distributed video stream targeted by the instruction, as a function of the instruction received.

[0139] For this purpose, the arrangement module 25 forms the new distributed flow by adapting for example the distribution of the IHS layers 56 on the set of displays 15, according to the instruction received.

[0140] In particular, if the instruction is an instruction to move an IHS layer 56, the arrangement module 25 reorganizes the spatial distribution of the IHS layers 56 on the set of display(s) 15.

[0141] If the instruction is an instruction to enlarge or shrink the display of an IHS layer 56, the arrangement module 25 modifies the size of the display of said IHS layer 56 on the set of displays 15. If this size modification involves a partial superposition of said IHS layer 56 with another IHS layer 56, the arrangement module 25 optionally reorganizes the distribution of the other IHS layers 56 on the set of display(s) 15 accordingly.

[0142] If the instruction is an instruction to delete a displayed IHS layer 56, the arrangement module 25 then deletes this IHS layer 56 from the display of the IHS layers 56. Optionally, the arrangement module 25 reorganizes the display of the IHS layers 56 on the set of displays 15 to better occupy the display space on the set of display(s) 15.

[0143] The method then comprises a new sending step 170, during which the arrangement module 25 sends to the corresponding display 15A, 15B, the new distributed video stream with a view to its display on the display 15A, 15B or the corresponding display surface 32.

[0144] If the decision module 27 determines that the instruction cannot be processed by the arrangement module 25, it transmits it to the graphics calculator 20 having calculated the calculated flow from which the identified IHS layer 56 originates.

[0145] The graphics computer concerned 20 then modifies the corresponding calculated flow. For example, if the instruction is a request for additions to information included in one of the IHS layers 56 or the selection of an interactive object of an IHS layer to change its state, the graphics computer 20 communicates for example with the external system to obtain these additions or the result of this change of state. The graphics computer 20 then calculates a new calculated IHS layer 56 flow comprising the completed information or the state to be changed and transmits it to the arrangement module 25. The arrangement module 25 then generates a new IHS layer 56 and includes it in its distribution of IHS layers 56 on the set of display(s) 15 when forming new distributed flows.

[0146] If the instruction is the entry of information, the graphics computer 20 communicates for example with the external system so that it processes the information entered and adapts the content to be displayed which it transmits to the graphics computer 20. Similar to previously, the graphics computer 20 calculates a new calculated flow and the arrangement module 25 generates a new IHS layer 56 and includes it in the flows distributed during the formation of said new flows.

[0147] Preferably, the method comprises, in parallel with these steps, a monitoring phase, not shown, during which the monitoring module 28 monitors all or part of the execution of the steps, and in particular the actions of the arrangement module 25, to verify that they are properly executed.

[0148] If at any time during the monitoring phase, the monitoring module 28 detects a malfunction as described previously, the monitoring module 28 commands one of the following actions: - display of a warning message on one of the displays 15 for the pilot, - reconfiguration of the distribution of IHS 56 layers in distributed flows, and - inhibition of the flow calculated by one of the computers 20,

[0149] preferably as described previously.

[0150] It is clear that the electronic display system 10 according to the invention allows greater flexibility for the pilot of the aircraft, in particular thanks to the module arrangement 25 making it possible to no longer match the IHS layers 56 from flows calculated by the graphic calculators 20 to a display 15A, 15B, or to a display panel 30.

[0151] Thus, it is possible for an IHS layer 56 to be partially displayed on several panels 30. In this, the electronic display system 10 according to the invention overcomes the limits of the set of displays 15 by considering the set of displays as a single display zone not segregated into several distinct and independent displays.

[0152] Furthermore, thanks to the arrangement module 25, it is possible to keep the graphic calculators 20 of the state of the art since the arrangement module 25 is compatible with these graphic calculators 20.

[0153] Furthermore, the fact that the display 15B comprises several contiguous tiles 30 allows the arrangement module 25 to form distributed video streams comprising IHS layers 56 extending over all or part of the display surface, and to reconfigure the distribution of the IHS layers 56 in the distributed streams while being agnostic of the distribution of the tiles 30.

[0154] Furthermore, the arrangement module 25 makes it possible to avoid integrating a unit for managing the display of the IHS layers 56 in each graphics computer 20, thus simplifying each graphics computer 20.

[0155] In addition, the arrangement module 25 makes it possible to mix information of different criticalities from different computers 20 while retaining the spatial and temporal segregation properties. Thus, the arrangement module 25 makes it possible to ensure that a flow from a non-critical computer 20NC does not impact a flow from a critical computer 20C. The arrangement module 25 is designed to implement robust partitioning between the different information flows received from the computers 20 and the control module 27.

[0156] The fact that the identified instruction is transmitted, by the decision module 27, directly to the arrangement module 25 when possible, makes it possible to accelerate the processing of the instruction by bypassing the graphics calculators 20. Thus, the interaction between a user and the system 10 is more fluid.

[0157] The arrangement module 25 guarantees the openness and robustness of the system 10 with respect to the graphics computers 20 by decoupling the graphics computers 20 and the set of displays 15 at the level of the video interfaces and the interfaces for transmitting the instructions issued for the set of display(s) 15 to the graphics computers 20.

[0158] The arrangement module 25 allows for optimizing the wiring in the electronic display system 10 with direct and unique connections between the graphics computers 20 and the arrangement module 25, and between the arrangement module 25 and the set of displays 15.

[0159] The arrangement module 25 guarantees the openness and robustness of the system 10 with respect to the graphics computers 20 that it comprises by ensuring the segregation properties between the video streams coming from possibly heterogeneous graphics computers 20, and between the IHS layers 56 that make up the video streams.

Claims

Claims

1. Display method for an electronic display system (10) intended to be integrated into a cockpit (9) of an aircraft, the method being implemented by an arrangement module (25) capable of being connected to a set of graphic computers (20) and to a set of displays (15), each display (15) defining at least one display surface (32);the method comprising the following steps: - receiving (110), from each graphics calculator (20), at least one calculated stream, - generating (120), for each calculated stream received, at least one Human-System Interface layer (56), - for each display (15A, 15B) or for each display surface (32), forming (130) a distributed video stream from the Human-System Interface layers (56), - sending (140), to the set of displays (15), the distributed video streams comprising the Human-System Interface layers (56), for their display on each display (15A, 15B) or each display surface (32).;

2. Method according to claim 1, in which, during the training step (130), at least one distributed video stream comprises Human-System Interface layers (56) generated from calculated streams from several distinct graphics calculators (20).

3. The method of claim 1 or 2, wherein, in the forming step (130), at least two distinct distributed video streams are formed by dividing a Human-System Interface layer (56) geometrically, each of said two distributed video streams comprising a portion of the Human-System Interface layer (56) resulting from the division.

4. Method according to any one of the preceding claims, further comprising the following steps: - receiving (150) an instruction to modify the display of a distributed video stream, sent from a user of the display system (10), - forming (160) a new distributed video stream in place of the distributed video stream targeted by the instruction, as a function of the instruction received, and - sending (170), to the corresponding display (15A, 15B), or to the corresponding display surface (32) of the new distributed video stream for display on the display (15A, 15B) or the display surface (32).

5. The method of claim 4, wherein the modification instruction is selected from: - an instruction to move a Human-System Interface layer (56) in a distributed video stream, - an instruction to enlarge or shrink the display of a Human-System Interface layer (56) in a video stream, and - an instruction to delete a Human-System Interface layer (56) in a distributed video stream.

6. Method according to any one of the preceding claims, in which during the generation step (120), each Human-System Interface layer (56) is associated with at least one attribute indicating the graphics calculator (20) from which the calculated stream from which the Human-System Interface layer (56) is generated, during the formation step (130), each distributed video stream is formed according to predetermined rules depending on the graphics calculator (20) indicated in each attribute of each Human-System Interface layer (56).

7. The method of claim 6, wherein the set of computers (20) comprises critical computers (20C) and non-critical computers (20NC), the predetermined rules being a function of the criticality of the computers (20C, 20NC).

8. Method according to any one of the preceding claims, in which the method comprises, in parallel with these steps (110, 120, 130, 140), a monitoring phase, during which the execution of each step is monitored by a monitoring module (28), in the event of detection of a malfunction by the monitoring module (28), the monitoring module commanding at least one action from among the following actions: - displaying a warning message on one of the displays (15), - reconfiguring a distribution of the Human-System Interface layers (56) in the distributed flows, and - inhibiting the flow calculated by one of the calculators (20).

9. A computer program product comprising software instructions which, when executed by a computer, implement a method according to any one of the claims.

10. Arrangement module for an electronic display system (10) intended to be integrated into a cockpit (9) of an aircraft, the arrangement module (25) being suitable for being connected to a set of graphic computers (20) and to a set of displays (15), each display (15) defining at least one display surface (32);the arrangement module (25) comprising at least one generation unit (60) configured to receive from each graphics calculator (20) a calculated stream and to generate at least one Human-System Interface layer (56) from this calculated stream, the arrangement module (25) further comprising a merging and distribution unit (65) configured to form, for each display (15A, 15B) or for each display surface (32), a distributed video stream from the Human-System Interface layers (56), the merging-distribution unit (65) being further configured to send, to the set of displays (15), the distributed video streams formed for display on each display (15A, 15B) or each display surface (32).;

Images