Electronic display system designed to be integrated into an aircraft cockpit
The electronic display system addresses the rigidity of cockpit displays by distributing video streams across multiple displays, enhancing flexibility and adaptability, and ensuring seamless integration with heterogeneous graphics computers.
Patent Information
- Authority / Receiving Office
- FR · FR
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2023-12-22
- Publication Date
- 2026-03-13
AI Technical Summary
Existing aircraft cockpit display systems are rigid and inflexible, with content displayed on each display solely dependent on its associated computer, limiting adaptability and user interaction.
An electronic display system with an arrangement module that distributes video streams across multiple displays, allowing flexible content presentation and user interaction, utilizing a set of graphical calculators and sensors to form distributed video streams and Human-System Interface layers, and ensuring seamless integration with heterogeneous graphics computers.
Enhances flexibility and adaptability of cockpit displays, enabling smoother user interactions and optimized wiring, while maintaining critical information integrity and visibility, and supporting diverse graphics computer types.
Smart Images

Figure 00000022_0000 
Figure 00000023_0000 
Figure 00000024_0000
Abstract
Description
Title of the invention: Electronic display system intended to be integrated into an aircraft cockpit
[0001] The present invention relates to an electronic display system intended to be integrated into an aircraft cockpit.
[0002] The present invention relates to the field of display systems in aircraft.
[0003] It is known in aircraft that the cockpit includes an electronic display system comprising: displays to provide information to the pilot, and graphic computers.
[0004] Different types of displays are generally present in cockpits: head-down displays, head-up displays, also called HUDs (Heads Up Display) including windshield projection solutions, and possibly displays included in pilots' helmets, also called HWDs (Head Wom Display).
[0005] It is known that head-down displays are display screens, positioned in a lower part of the cockpit relative to the head-up display(s).
[0006] The head-up display(s) and the displays integrated into the helmets generally include at least partially transparent surfaces positioned between the pilot and a cockpit window, onto which a video feed is projected. Direct projection onto the windshield is also possible. Thus, the pilot observes the superimposition of the aircraft's external environment, via a cockpit window, and the video feed projected onto the surface.
[0007] It is known that the display device includes, for each display, one or more respective computers capable of determining the video stream to be displayed on the display.
[0008] However, such an architecture of the electronic display system is substantially rigid since the content displayed on each display depends solely on the associated computer.
[0009] The present invention relates to an electronic display system intended to be integrated into an aircraft cockpit, the electronic display system comprising: - a set of display(s) comprising respectively at least one display panel, each display defining at least one display surface; - a set of graphical calculators, each graphical calculator being capable of calculating at least one calculated flow to be displayed on the set of display(s), each calculated stream being one of a video stream, a graphic command stream(s), or an aeronautical command stream(s),
[0010] each calculated stream comprising informational content; and - an arrangement module connected to each graphics computer and each display in the display set(s), and configured to form, from the calculated streams, a distributed video stream for each display or for each display surface, the or at least one of the distributed video streams comprising informational content from streams calculated by different graphics computers,
[0011] the arrangement module being further configured to send each distributed video stream to the corresponding display or to the display whose display panel(s) define the associated display area,
[0012] each display being further configured to distribute the display of the associated distributed video stream on its display panel or among its display panels.
[0013] According to particular embodiments of the invention, the system comprises one or more of the following features, taken individually, or in all technically possible combinations: - the system also including: • a set of instruction sensor(s) from a user of the electronic display system, the sensor set(s) being configured to acquire data resulting from a user instruction, • a decision module configured to identify, from the acquired data, the user's instruction, and to send, according to the identified instruction, a predefined instruction to at least one of the following: • at least one of the graphing calculators, and • the arrangement module;
[0014] the predefined instruction depending on the identified instruction. - at least one display in the set of display(s) comprises at least two contiguous display panels defining a single display surface; - the arrangement module is configured to form at least one distributed video stream such that the or at least one of the distributed video streams is partially displayed on a first display panel of the display set(s) and partially displayed on a second display panel of the display set(s), the first and second display panels being contiguous; - each contiguous display tile has at least one edge that is contiguous with an edge of another contiguous display tile,
[0015] the contiguous display panels being such that, when the electronic display system is integrated into an aircraft cockpit, the contiguous edges of the contiguous panels are indistinguishable to a pilot of the aircraft; - the display assembly includes a head-up display and a head-down display, the head-down display comprising at least two contiguous display panels; - the arrangement module is configured to form the distributed stream(s) so that the informational content included in at least two calculated streams is partially superimposed on one display of the set of display(s); - The arrangement module is configured to generate, from each calculated flow, at least one Human-System Interface layer,
[0016] the arrangement module being further configured to form the distributed video stream or streams by distributing the Human-System Interface layers in the distributed video stream or streams; - The set of graphical computers includes at least one critical computer and at least one non-critical computer,
[0017] each critical computer being capable of calculating a calculated flow comprising a greater informational content to successfully conduct the flight of the aircraft than the calculated flow by each non-critical computer; - at least one of the graphics computers is capable of being connected to external equipment and of receiving, from said external equipment, information to be represented in the data stream calculated by said graphics computer; and - The electronic display system comprises several arrangement modules,
[0018] in operation, each graphics computer being configured to send the calculated stream to the same arrangement module, called the master module,
[0019] if said arrangement module is unavailable, each calculated stream is redirected to another arrangement module which becomes the master module.
[0020] Other features and advantages of the invention will become apparent from the following description of embodiments of the invention, given by way of example only and with reference to the drawings which are: - [Fig.1] [Fig.1] is a schematic representation of an aircraft cockpit comprising an electronic display system according to the invention; - [Fig.2] [Fig.2] is a schematic representation of a set display(s) included in the electronic display system according to the invention; - [Fig.3] [Fig.3] is a schematic representation of the electronic display system according to the invention; - [Fig.4] [Fig.4] is a schematic representation of the set of display(s) in [Fig.2] showing an example of video stream display distribution; - [Fig. 5] [Fig. 5] is a detailed schematic representation of an arrangement module included in the electronic display system of [Fig. 3]; and - [Fig.6] [Fig.6] is a flowchart of a display process implemented by the display system according to [Fig.3].
[0021] Figure 1 shows a cockpit 9 of an aircraft. An electronic display system 10 is installed in the cockpit 9.
[0022] The electronic display system 10 includes a set of displays 15, a set of graphic computers 20, an arrangement module 25, and optionally a set of instruction sensor(s) 26 and a decision module 27.
[0023] The display assembly 15 preferably comprises at least one head-up display 15A, at least one head-down display 15B.
[0024] Each display includes at least one display panel 30, also called panel 30. The term "display panel" means a display module comprising display means such as liquid crystal, plasma, LED, microled or OLED means, and an electronic resource suitable for receiving images to be displayed and suitable for controlling the display means to display said images to be displayed, and optionally a frame delimiting the outline of the display means.
[0025] By way of example, each slab 30 is of the "borderless" type, also called extra-thin edge. In other words, each slab 30 has no frame, or a frame less than 5 mm thick. Thus, the frame, if present, is not distinguishable to a pilot in the cockpit 9.
[0026] The display tiles 30 of each display 15A, 15B define at least one display area 32. At least one display area 32 is formed by several contiguous tiles 30.
[0027] With reference to [Fig.2], such a surface is defined by the lowest 30 display slabs of the lowest head-down display.
[0028] In the example of [Fig. 2], the display assembly 15 comprises a head-up display 15A and a head-down display 15B. The head-up display 15A comprises a single display panel 30 defining a single display surface 32. The head-down display 15B comprises four display panels 30 defining two separate display surfaces.
[0029] As can be seen in [Fig. 2], each display panel 30 preferably has a substantially rectangular shape, extending between edges. The edges are formed, for example, by the frame of the panel 30 when it includes such a frame. If the panel 30 does not include a frame, then the edges are formed by the ends of the display means. According to an alternative embodiment not shown, at least one of the panels 30 has a non-rectangular shape, such as a curved or conical shape, for example, conforming to the shape of the cockpit 9.
[0030] The panels 30 include edges, or parts of edges, delimiting a perimeter of the corresponding display 15A, 15B. These edges are called external edges 35. The external edges 35 are shown in solid lines on [Fig.2].
[0031] At least two panels 30 of one of the displays 15A, 15B are contiguous. By "contiguous" it is understood that the panels 30 join at least one edge, without leaving any visible space between the panels 30. Advantageously, the transition zone between each pair of contiguous panels 30 of the same display 15A, 15B is substantially flat and free of roughness.
[0032] The contiguous slabs 30 comprise at least one edge, or part of an edge, contiguous to each other, called contiguous edge 40.
[0033] In [Fig. 2], only the head-down display 15B includes such contiguous panels 30. It is clear that such a configuration is also possible for the head-up display 15A.
[0034] In the example of [Fig.2], the contiguous edges 40 are represented by a dashed line. The contiguous tiles 30 are such that, when the electronic display system is integrated into the cockpit 9 of an aircraft, the contiguous edges 40 of the contiguous tiles are indistinguishable to a pilot of the aircraft.
[0035] With reference to [Fig. 3], the graphics computers 20 are each designed to calculate a computed stream. The computed stream is one of the following: a video stream, a graphic command stream, or an aeronautical command stream, to be displayed on the set of displays 15. Each computed stream includes informational content to be displayed.
[0036] The video stream(s) preferably conform to any video protocol implementing a level of service required by the stream. Thus, each stream exhibits characteristics conforming to a predefined criterion in terms of integrity, availability in relation to aeronautical environmental stresses, and throughput.
[0037] For example, the video stream(s) conform to the ARINC 818 protocol, the DVI protocol, or the SMPTE protocol. Each video stream preferably comprises periodically refreshed sub-images 37.
[0038] The graphical command flow(s) are, for example, command flows in a graphical language, such as OpenGL, Vulkan, or any other graphical API.
[0039] The aeronautical order flow(s) are order flows preferably complying with the ARINC 661 protocol.
[0040] For example, and as shown in [Fig.3], the electronic display system 10 includes at least one graphics computer 20 suitable for calculating a video stream conforming to the ARINC 818 protocol, at least one graphics computer 20 suitable for calculating aeronautical commands conforming to the ARINC 661 protocol, and at least one graphics computer 20 suitable for calculating graphic commands in a graphics language such as the OpenGL language.
[0041] Each graphics computer 20 includes, for example, a computing unit 45 suitable for generating graphics commands and / or aeronautical commands as described above.
[0042] At least one graphics computer 20 further comprises a graphics unit 50 connected to the computing unit 45 and capable of generating one or more video streams from the generated graphics and / or aeronautical commands.
[0043] In the example of [Fig.3], two of the three graphic calculators 20 shown include a respective graphic unit 50.
[0044] The set of computers 20 may include one or more computers performing a function. By architecture, the graphical representation of a function implemented by a set 20 may itself be implemented by the composition of several video streams or commands.
[0045] At least one graphics computer 20 comprising a graphics unit 50 further comprises a video unit 55. Preferably, the graphics computer(s) 50 comprising a video unit 55 are connected to external equipment not shown. This external equipment includes, for example, an aircraft flight computer and databases. Thus, the graphics computer 20 is configured to receive, from this external system, information to be displayed in the calculated stream(s) to be shown on the display assembly(ies) 15. The received information to be displayed is, for example, in a video format conforming to the ARINC A818 or SMTPE protocol.
[0046] Such information is, for example, symbological content.
[0047] In this case, the video unit 55 is suitable for processing this information and combining it with the video stream from the graphics unit 50 to form the calculated video stream. Optionally, the video unit 55 is also capable of receiving an external video stream 73 and combining it with other streams.
[0048] If the graphic computer 20 comprises only a respective computing unit 45, the flow calculated by this computer 20 is the flow of graphic or aeronautical commands generated by said computing unit 45. This is notably the case for the computer shown at the top in [Fig.3].
[0049] If a graphics computer 20 comprises only a respective calculation unit 45 and a respective graphics unit 50, the stream calculated by this computer 20 is the video stream generated by said graphics unit 50 and / or the stream calculated by the calculation unit 45. This is notably the case for the computer 20 shown in the middle of [Fig.3].
[0050] If a graphics processing unit 20 comprises a processing unit 45, a graphics processing unit 50, and a video processing unit 55, the stream calculated by this processing unit 20 is the video stream from said video processing unit 55, and / or the stream calculated by the graphics processing unit 50, and / or the stream calculated by the processing unit 45, possibly a combination of these streams. This is notably the case for the processing unit 20 shown at the bottom of [Fig. 3].
[0051] It is clear that not all of these types of graphic calculator 20 are necessarily included in the system 10. It is also clear that several graphic calculators 20 are likely to be of the same type, i.e. including the same units 45, 50, 55.
[0052] According to an example not shown, the system comprises: - at least one graphics computer 20 comprising only one computing unit 45 and generating one or more data streams specific to it, - at least one graphics computer 20 comprising only a calculation unit 45 and a graphics unit 50 and generating one or more data streams specific to it, and - at least one graphics computer 20 comprising a computing unit 45, a graphics unit 50 and a video unit 55 and generating one or more streams of its own.
[0053] In an unrepresented variant, even if one of the graphics computers 20 includes a graphics unit 50 and possibly a video unit 55, it is still suitable for sending a calculated stream comprising only graphics or aeronautical commands from the computing unit 45.
[0054] In addition, the graphics computers 20 are of two types: critical graphics computers 20 and non-critical graphics computers 20.
[0055] Each critical computer 20 is capable of calculating at least one video or graphical / aeronautical control stream(s) containing more important information for carrying out the flight of the aircraft than the video or graphical / aeronautical control stream(s) calculated by each non-critical computer 20.
[0056] Furthermore, regardless of critical or non-critical aspects, the graphics computers 20 are, according to one embodiment, distinct from one another and are suitable for providing the calculated flows in formats distinct from one graphics computer 20 to another.
[0057] The arrangement module 25 is connected to each graphics computer 20 and to each display 15A, 15B or display surface 32. The arrangement module 25 is configured to form, from the calculated streams, a distributed video stream for each display 15A, 15B or for each display surface 32. The distributed video streams are also called distributed streams.
[0058] As shown in [Fig.3], the arrangement module 25 is also optionally connected to an external sensor (not shown) providing a respective external video stream 74, such as a camera.
[0059] The or at least one of the distributed video streams includes informational content from streams calculated by different graphics computers 20.
[0060] For this purpose, the arrangement module 25 is configured to receive the calculated flows from each graphic calculator 20.
[0061] According to the embodiment in which the graphics computers 20 are of distinct types, the arrangement module 25 includes means for acquiring the streams calculated according to the different formats of the graphics computers 20. For example, the formats may conform to the aeronautical graphics protocol of type ARINC 661, conform to graphics APIs (Application Programming Interface) of type OpenGL, Vulkan, or any other graphics API, conform to all video standards (compressed or uncompressed), or conform to any other type.
[0062] With reference to [Fig.5], the arrangement module 25 comprises a plurality of generation units 60. Preferably, the arrangement module 25 comprises at least one generation unit 60 for each graphics computer 20.
[0063] Each generation unit 60 is configured to receive a computed stream and to generate from this computed stream, at least one Human-System Interface layer 56, also called an HSI layer 56.
[0064] The term "IHS overlay" means a video-type format comprising informational content intended for the user and preferably with which the user is likely to interact when it is displayed.
[0065] Preferably, each generation unit 60 is configured to, if the received computed stream is a video stream, extract the sub-images 37 from said video stream and generate for each sub-image 37, a respective IHS layer 56.
[0066] Preferably, each generation unit 60 is configured to, if the received computed stream is a graphical command stream or a command stream aeronautical, generate one or more IHS 56 layers from said command(s) contained in the received calculated flow.
[0067] Optionally, each IHS 56 layer includes at least one attribute indicating the graphics computer 20 from which the computed stream originates, from which the IHS 56 layer is generated. Thus, IHS 56 layers originating from critical graphics computer(s) 20 are identifiable.
[0068] The arrangement module 25 further includes a merge and distribution unit 65.
[0069] The merge and distribution unit 65 is configured to receive each IHS layer 56 generated by the generation units 60.
[0070] The fusion and distribution unit 65 is configured to distribute the IHS 56 layers among the displays 15A, 15B or among the display surfaces 32 by forming distributed video streams. The fusion and distribution unit 65 is then configured to form one video stream per display 15A, 15B or per display surface 32. Each distributed video stream comprises all or part of one or more IHS 56 layers, optionally processed.
[0071] Preferably, at least one distributed video stream comprises several Human-Machine Interface layers 56.
[0072] For example, a distributed stream includes IHS 56 layers generated from computed streams from several separate graphics computers 20.
[0073] The distribution fusion unit 65 is further configured, for example, to shape each distributed stream so that it is adapted to the display 15A, 15B, or to the display surface 32 on which it is intended to be displayed. For example, if the head-up display 15A is a transparent surface onto which video streams are projected, the arrangement module 25 is configured to adapt the distributed stream to be displayed on said head-up display 15A so that the projected stream conforms to the real world for the aircraft pilot. "Conforms to the real world" means that a graphic object belonging to the distributed stream is perceived as superimposed on the corresponding real object. For example, if the distributed stream in question is a pointer relative to the position of a building, said distributed stream must superimpose the pointer and the actual building in question.For example, if the distributed video stream is the horizon line, then that line will overlap with the actual horizon.
[0074] In addition, the fusion and distribution unit 65 is configured to distribute the layers of IHS 56 in the distributed streams so that there is no contradiction between the head-up displays 15A and head-down displays 15B.
[0075] As an optional addition, the merge and distribution unit 65 is used to form each distributed stream by applying predetermined rules, also called predefined rules, for example defined by the decision module 27, also called Windows manager 27, as will be described below. For example, predetermined rules are selected statically by decision module 27.
[0076] Preferably, the predefined rules depend on the graphics computer 20 indicated in each attribute of each layer of IHS 56. For example, the predefined rules define, according to the graphics computer 20 from which the video stream originates, the processing to be applied to the generated layers of IHS 56, and the displays 15A, 15B, or display surface(s) 32 on which the distributed streams formed from said layers 56 should be displayed.
[0077] For example, the predetermined rules are such that the arrangement module 25, and in particular the distribution unit 65, preserves the integrity, priority, and visibility of the IHS layers 56 resulting from streams computed by the critical graphics computers 20. In other words, based on the attribute(s) present in the IHS layers 56, the arrangement module 25 ensures that the IHS layers 56 resulting from the critical computers 20 are always the top layers in case of overlap and that the information they contain is always accessible in the resulting distributed streams.
[0078] The arrangement module 25, and in particular the merging and distribution unit 65, is preferentially agnostic to the composition of each display 15A, 15B and the display surfaces 32. In other words, for the distribution of the IHS layers 56 in the distributed streams, the arrangement module 25 preferentially only knows the dimensions of the display 15A, 15B, or the display surface 32, for example in terms of pixels, and their geometry. The arrangement module 25, and the computers 20, are therefore unaware of the number of tiles 30 composing each display 15A, 15B and / or display surface 32 and of the boundaries of each tile 30.
[0079] As an optional addition, the arrangement module 25, for example via its merging and distribution unit 65, is configured to display, in a superimposed manner, on the same area of the panels 30, several layers of IHS 56 resulting from distinct calculated flows. To this end, the merging and distribution unit 65 is specifically configured to use the information from the IHS 56 layers during the formation of the distributed flow and configured to use mixing rules to be applied to the IHS 56 layers to be totally or partially superimposed. Thus, according to this optional addition, at least two IHS 56 layers are partially superimposed on the display assembly 15.
[0080] The arrangement module 25 is, for example, agnostic to the contiguous edges 40 of the tiles 30. Thus, the arrangement module 25 is, for example, configured to distribute the display of at least one distributed stream spread across several tiles 30. In other words, the arrangement module 25 is, for example, configured to distribute the display of the distributed streams so that an IHS layer 56 included in a distributed stream is partially displayed on a first display tile 30 of the display set. 15 and partially displayed on a second display panel 30 of the display assembly 15, the first and second display panels 30 being contiguous.
[0081] Optionally, the arrangement module 25 is configured to geometrically divide an IHS 56 layer during the formation of the distributed streams. Each of said distributed video streams is then intended to be displayed on a separate display 15A, 15B or on a separate display surface 32. Preferably, the arrangement module 25 is configured to ensure continuity between the displays 15A, 15B and display surfaces 32 in the distribution of said distributed streams. By way of example, the arrangement module 25 is configured to distribute said distributed streams so as to align the display of the divided IHS 56 layer(s) between the head-up display 15A and the head-down display 15B.
[0082] According to an unshown embodiment, the arrangement module 25 further includes an output for connection to an unshown recorder included in the system 10. According to this embodiment, the arrangement module 25 is configured to send a copy of the distributed video streams to said recorder for subsequent post-processing. Optionally, the copy is in a different format than the distributed video streams. For example, the copy is compressed, resized, or composited. For example, the copy is suitable for sending to the recorder via an Ethernet cable.
[0083] As an optional feature, the arrangement module 25 is configured to transmit this information to the decision module 27 if a received stream is invalid, for example, a noisy or empty signal due to a non-functional cable. This information is then transmitted so that the decision module 27 can determine new predefined rules to be sent to the arrangement module 25. In an example not shown, the electronic display system 10 comprises several arrangement modules 25. During operation, each graphics computer 20 is configured to send the calculated stream(s) to the same arrangement module 25, referred to as the master module. If the master module is unavailable, each calculated stream is redirected to another arrangement module 25, which then becomes the master module.
[0084] Again with reference to [Fig.3], each display is configured to distribute the display of the associated distributed stream on its display panel 30 or among its display panels 30 if it includes several display panels 30.
[0085] Figure 4 shows an example of a distributed display of streams from calculated streams, implemented by the arrangement module 25. In particular, Figure 4 shows the same set of display(s) as that shown in Figure 2. The contiguous edges 40 of the tiles 30 are not shown in Figure 4 for readability.
[0086] In [Fig.4], the IHS 56 layers of the distributed flows are represented by rectangles with rounded corners.
[0087] In the example illustrated in [Fig. 4], the electronic display system comprises three graphics processing units 20. Each graphics processing unit 20 calculates its own specific data streams. A first graphics processing unit 20 calculates the video streams corresponding to IHS 56 layers whose fill is shown as a dashed line in [Fig. 4]. A second graphics processing unit 20 calculates a stream of graphic commands corresponding to IHS 56 layers whose fill is hatched from bottom left to top right in [Fig. 4]. A third graphics processing unit 20 calculates video streams corresponding to IHS 56 layers whose fill is hatched from bottom right to top left in [Fig. 4]. Finally, a fourth graphics processing unit 20 calculates aeronautical command streams corresponding to IHS 56 layers whose fill is shown as a crosshatch pattern in [Fig. 4].
[0088] It is visible on [Fig.4] that the layers of IHS 56 from the flows calculated by the same graphic computer 20 are for example displayed on several displays 15A, 15B.
[0089] In addition, as can be seen in [Fig.4], the IHS 56 layers from the calculated flows from the second and fourth graphics computers 20 are displayed on several tiles 30. These IHS layers bear the reference 561 in [Fig.4].
[0090] Thus, it is clear that the arrangement module 25 considers the set of tiles 30 of the same display 15 as a single display surface 32 without prejudice to the limits of the tiles 30.
[0091] Again with reference to [Fig. 3], the sensor assembly 26 is configured to acquire an instruction from a user of the electronic display system 10. The user of the electronic display system 10 is preferably the aircraft pilot. More specifically, the sensor assembly 26 is configured to acquire data resulting from an instruction from the user.
[0092] A user instruction is, for example: selecting a layer of IHS 56 displayed to obtain more information about the content of said layer, selecting an interactive object of a layer to change its state, enter information, an instruction to enlarge or shrink a layer of IHS 56 displayed, an instruction to move a layer of IHS 56 displayed over the set of displays 15, or an instruction to delete a layer displayed, or any other possible types of actions.
[0093] The sensor assembly 26 preferably includes a touch, force, or haptic sensor 261 integrated into the display assembly 15. For example, each display 15A, 15B is a touch display designed to receive touch input from the user and to provide data resulting from that input. In particular, each panel 30 is a touch panel.
[0094] The sensor assembly 26 optionally includes one or more multimodal sensors 262. "Multimodal sensors" are sensors capable of acquiring user instructions without physical input. Examples of such sensors include user gaze tracking sensors, voice sensors, or motion sensors. The multimodal sensor(s) are also capable of providing data resulting from a user instruction.
[0095] The decision module 27 is connected to the sensor set 26, to each graphic calculator 20 and to the arrangement module 25.
[0096] The decision module 27 is aware of the system architecture 10. Thus, the decision module 27 knows the layout of the displays 15 and the panels 30, as well as the number of computers 20. In particular, the decision module 27 knows whether each computer 20 is a critical computer or not. The decision module 27 is configured to generate predefined rules and transmit them to the arrangement module 25.
[0097] The decision module 27 is configured to receive, from the sensor set 26, the data resulting from the user's instruction. The decision module 27 is further configured to identify, from the acquired data, the user's instruction, and to send, according to the identified instruction, a predefined setpoint to at least one of the following: at least one of the graphic computers 20, and the arrangement module 25. The predefined setpoint depends on the identified instruction.
[0098] In particular, the decision module 27 is configured to identify, based on the received data, the IHS 56 layer relevant to the user's instruction. The decision module 27 is then configured to identify the instruction, for example, from among the aforementioned example instructions.
[0099] The decision module 27 is configured to determine, based on the identified IHS 56 layer and the identified instruction, whether the instruction can be processed by the arrangement module 25, for example, by modifying the rules predefined by the decision module 27. In this case, the decision module 27 is configured to transmit the instruction to the arrangement module 25 to implement corrective action on the distribution of the IHS 56 layers across the display set(s) 15 during the formation of the distributed streams. This is particularly the case when the instruction is an instruction to enlarge or shrink a displayed IHS 56 layer, an instruction to move a displayed IHS 56 layer across the display set(s) 15, or an instruction to delete a displayed IHS 56 layer.
[0100] When the instruction cannot be processed by the arrangement module 25, the decision module 27 is configured to transmit the instruction to the graphics computer 20 that calculated the flow corresponding to the identified IHS layer 56, so that the graphics computer 20 can implement the appropriate corrective action. In particular, The corresponding graphics computer 20 is configured to receive the instruction and layer of IHS 56 identified via its processing unit 45 previously described.
[0101] For example, each graphics processing unit 20, the arrangement module 25, and the decision module 27 are processing units comprising, respectively, a memory, at least one processing unit, at least one graphics processing unit, and at least one video processing unit. The functionalities of these modules 25, 27, and graphics processing units 20 are then implemented in the form of software, or a software component, executable by the associated processor. In particular, each processing unit 45, graphics unit 50, video unit 55, generation unit 60, and fusion and distribution unit 65 is software or a software component.
[0102] Each memory is then capable of storing such software. Each processor is then capable of executing each of the software programs.
[0103] In an alternative not shown, each graphics computer 20, the arrangement module 25 and the decision module 27 are each implemented as a programmable logic component, such as an FPGA (Field Programmable Gate Array), or as an integrated circuit, such as an ASIC (Application-Specific Integrated Circuit).
[0104] When each graphics computer 20, arrangement module 25, and decision module 27 is a computer implementing software functionalities, i.e., computer programs, also called computer program products, said computer programs are further capable of being stored on a computer-readable medium, not shown. The computer-readable medium is, for example, a medium capable of storing electronic instructions and being connected to a bus of a computer system. By way of example, the readable medium is an optical disc, a magneto-optical disc, ROM, RAM, any type of non-volatile memory (e.g., FLASH or NVRAM), or a magnetic card. A computer program comprising software instructions is then stored on the readable medium.
[0105] The operation of the electronic display system 10 will now be described, via a display method, implemented by the arrangement module 25 and whose flowchart is shown in [Fig.6].
[0106] Initially, each graphics computer 20 calculates one or more calculated streams, for example from video content(s), and / or information to be displayed, received from the external equipment and / or calculated by the graphics computer 20 itself.
[0107] The calculated flows are then sent to arrangement module 25.
[0108] The display method includes a reception step 110, during which the arrangement module 25 receives from each graphics computer 20, at least one calculated stream.
[0109] The process then includes a generation step 120, during which the arrangement module 25 generates, via its generation units 60 and for each computed stream received, at least one IHS layer 56.
[0110] The method then includes a training step 130, during which the arrangement module 25 forms for each display 15A, 15B, or for each display surface 32, a distributed video stream from the layers of IHS 56.
[0111] To this end, the arrangement module 25 determines, via its merging and distribution unit 65, a distribution of the IHS layers 56 by forming the distributed flows as explained previously, preferentially by applying the rules predefined by the decision module 27.
[0112] The method then includes a sending step 140 in which the arrangement module 25 sends, for example via its fusion and distribution unit 65, to the set of display(s) 15, the distributed video streams comprising the Human-System Interface layers (56) for display on each display 15A, 15B or each display surface 32.
[0113] Each display 15A, 15B receives the corresponding distributed video stream and distributes the display of the distributed stream on its panel 30 or between its panels 30.
[0114] Then, at some point, the pilot optionally issues the instruction to modify the display.
[0115] This instruction is, for example, a touch on one of the display(s) 15, a voice instruction, an eye instruction, or a movement instruction.
[0116] The sensor set 26 then acquires data corresponding to the instruction issued by the pilot.
[0117] The sensor set 26 transmits this data to the decision module 27. The decision module 27 then identifies the instruction issued by the pilot and the relevant IHS 56 layer.
[0118] Decision module 27 then determines whether the instruction is processable by arrangement module 25.
[0119] If so, the decision module 27 transmits the instruction to the arrangement module 25, for example by establishing new predefined rules and transmitting them to the arrangement module 25.
[0120] The method then includes a new reception step 150, during which the arrangement module 25 receives the instruction to modify the display of a distributed video stream, issued from a user of the display system 10, for example the driver.
[0121] The method then includes a step 160 of forming a new distributed video stream in place of the distributed video stream targeted by the instruction, according to the instruction received.
[0122] For this purpose, the arrangement module 25 forms the new distributed stream by adapting, for example, the distribution of the layers of IHS 56 on the set of displays 15, according to the instruction received.
[0123] In particular, if the instruction is an instruction to move an IHS 56 layer, the arrangement module 25 reorganizes the spatial distribution of the IHS 56 layers on the display set(s) 15.
[0124] If the instruction is an instruction to enlarge or shrink the display of an IHS 56 layer, the arrangement module 25 performs the change in size of the display of said IHS 56 layer on the display set 15. If this change in size involves a partial overlap of said IHS 56 layer with another IHS 56 layer, the arrangement module 25 optionally reorganizes the distribution of the other IHS 56 layers on the display set(s) 15 accordingly.
[0125] If the instruction is an instruction to delete a displayed IHS 56 layer, the arrangement module 25 then removes that IHS 56 layer from the display of IHS 56 layers. Optionally, the arrangement module 25 reorganizes the display of IHS 56 layers on the set of displays 15 to better occupy the display space on the set of displays 15.
[0126] The process then includes a new sending step 170, during which the arrangement module 25 sends to the corresponding display 15A, 15B, the new distributed video stream for display on the display 15A, 15B or the corresponding display surface 32.
[0127] If the decision module 27 determines that the instruction is not processable by the arrangement module 25, it transmits it to the graphic computer 20 which has calculated the calculated flow from which the identified IHS 56 layer is derived.
[0128] The relevant graphics processing unit 20 then modifies the corresponding computed stream. For example, if the instruction is a request for additional information contained in one of the IHS layers 56, or the selection of an interactive object from an IHS layer to change its state, the graphics processing unit 20 communicates, for example, with the external system to obtain this additional information or the result of this state change. The graphics processing unit 20 then calculates a new computed stream for the IHS layer 56, including the information to be completed or whose state is to be changed, and transmits it to the arrangement module 25. The arrangement module 25 then generates a new IHS layer 56 and includes it in its distribution of IHS layers 56 on the display set(s) 15 when new distributed streams are formed.
[0129] If the instruction is the input of information, the graphics computer 20 communicates for example with the external system so that it processes the input information and adapts the content to be displayed which it transmits to the graphics computer 20. Similar to before, the graphics computer 20 calculates a new calculated flow and the arrangement module 25 generates a new layer of IHS 56 and includes it in the distributed flows during the formation of said new flows.
[0130] It is clear that the electronic display system 10 according to the invention allows greater flexibility for the aircraft pilot, in particular thanks to the arrangement module 25 which makes it possible to no longer match the layers of IHS 56 from streams calculated by the graphics computers 20 to a display 15A, 15B, or to a display panel 30.
[0131] Thus, it is possible that an IHS 56 overlay may be partially displayed on several panels 30. In this respect, the electronic display system 10 according to the invention overcomes the limitations of the display set 15 by considering the display set as a single display area not segregated into several distinct and independent displays.
[0132] Furthermore, thanks to the arrangement module 25, it is possible to retain the prior art graphic calculators 20 since the arrangement module 25 is compatible with these graphic calculators 20.
[0133] Furthermore, the fact that the display 15B comprises several contiguous slabs 30 allows the arrangement module 25 to form distributed video streams comprising IHS 56 layers extending over all or part of the display surface, and to reconfigure the distribution of the IHS 56 layers in the distributed streams.
[0134] In addition, the arrangement module 25 makes it possible to avoid integrating an IHS 56 layer display management unit into each graphics computer 20, thus simplifying each graphics computer 20.
[0135] Furthermore, the arrangement module 25 allows for the mixing of information of varying criticality from different computers 20 while preserving the spatial and temporal segregation properties. Thus, the arrangement module 25 ensures that a non-critical flow does not impact a more critical flow. The arrangement module 25 is designed to implement robust partitioning between the different information flows received by the computers 20 and the control module 27.
[0136] The fact that the identified instruction is transmitted, by the decision module 27, directly to the arrangement module 25 when possible, makes it possible to speed up the processing of the instruction by bypassing the graphic computers 20. Thus, the interaction between a user and the system 10 is smoother.
[0137] The arrangement module 25 guarantees the openness and robustness of the system 10 with respect to the graphics computers 20 by decoupling the graphics computers 20 and the set of displays 15 at the level of the video interfaces and the interfaces for transmitting instructions issued for the set of displays 15 to the graphics computers 20.
[0138] The arrangement module 25 allows for optimized wiring in the electronic display system 10 with direct and unique connections between the graphics computers 20 and the arrangement module 25, and between the arrangement module 25 and the display assembly 15.
[0139] The arrangement module 25 ensures the openness and robustness of the system 10 with respect to the graphics computers 20 which it includes by ensuring the segregation properties between the video streams from possibly heterogeneous graphics computers 20, and between the layers of IHS 56 which make up the video streams.
Claims
1.
2. Demands Electronic display system (10) intended to be integrated into an aircraft cockpit (9), the electronic display system (10) comprising: - a set of display(s) (15) comprising respectively at least one display panel (30), each display defining at least one display surface (32); - a set of graphic computers (20), each graphic computer (20) being capable of calculating at least one calculated stream to be displayed on the set of display(s) (15), each calculated stream being one of a video stream, a graphic command stream(s), or an aeronautical command stream(s), each calculated stream including informational content; and - an arrangement module (25) connected to each graphics computer (20) and to each display of the display set(s) (15), and configured to form, from the calculated streams, a distributed video stream for each display (15A, 15B) or for each display surface (32), the or at least one of the distributed video streams comprising informational content from streams calculated by different graphics computers (20), the arrangement module (25) being further configured to send each distributed video stream to the corresponding display (15A, 15B) or to the display (15A, 15B) whose display panel(s) (30) define the associated display area (32), each display (15A, 15B) being further configured to distribute the display of the associated distributed video stream on its display panel (30) or among its display panels (30), in which at least one display of the set of display(s) (15) comprises at least two contiguous display panels (30) defining a single display area (32). System (10) according to claim 1, further comprising: - a set of instruction sensor(s) (26) from a user of the electronic display system (10), the set of sensor(s) (26) being configured to acquire data resulting from a user instruction, - a decision module (27) configured to identify, from the acquired data, the user instruction, and to send, according to the identified instruction, a predefined setpoint to at least one of: • at least one of the graphic computers (20), and • the arrangement module (25), the predefined setpoint depending on the identified instruction.
3. System (10) according to claim 1 or 2, wherein the arrangement module (25) is configured to form at least one distributed video stream such that the or at least one of the distributed video streams is partially displayed on a first display panel (30) of the display assembly(ies) (15) and partially displayed on a second display panel (30) of the display assembly(ies) (15), the first and second display panels (30) being contiguous.
4. System (10) according to any one of the preceding claims, wherein each contiguous display panel (30) has at least one edge (40) which is contiguous with an edge (40) of another contiguous display panel (30), the contiguous display panels (30) being such that, when the electronic display system (10) is integrated into an aircraft cockpit (9), the contiguous edges (40) of the contiguous panels (30) are indistinguishable to an aircraft pilot.
5. System (10) according to any one of the preceding claims, wherein the display assembly(ies) (15) comprises a head-up display (15A) and a head-down display (15B), the head-down display (15B) comprising at least two contiguous display panels (30).
6. System (10) according to any one of the preceding claims, wherein the arrangement module (25) is configured to form the distributed stream(s) such that the informational content included in at least two calculated streams is partially superimposed on a display (15A, 15B) of the display assembly (15).
7. System (10) according to any one of the preceding claims, wherein the arrangement module (25) is configured to generate, from each calculated stream, at least one Human-System Interface layer (56), the arrangement module (25) being further configured to form the distributed video stream or streams by distributing the Human-System Interface layers (56) in the distributed video stream or streams.
8. System (10) according to any one of the preceding claims, wherein the set of graphics computers (20) comprises at least one critical computer and at least one non-critical computer, each critical computer being capable of calculating a computed stream comprising a greater informational content to successfully conduct the flight of the aircraft than the stream calculated by each non-critical computer.
9. System (10) according to any one of the preceding claims, wherein at least one of the graphics computers (20) is capable of being connected to external equipment and of receiving, from said external equipment, information to be represented in the stream calculated by said graphics computer (20).