Electronic display system intended to be integrated into an aircraft cockpit
The electronic display system for aircraft cockpits addresses the rigidity of existing systems by using an arrangement module to combine content from multiple graphic calculators into distributed video streams, enhancing flexibility and integration of informational content.
Patent Information
- Application Number
- FR2023015186
- Authority / Receiving Office
- FR · FR
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-12-22
- Publication Date
- 2025-06-27
- Estimated Expiration
- 2043-12-22
AI Technical Summary
Existing electronic display systems in aircraft cockpits are rigid, with content display dependent solely on associated computers, limiting flexibility and integration of diverse informational content.
An electronic display system comprising a set of displays, graphic calculators, and an arrangement module that forms distributed video streams by combining informational content from multiple calculators, allowing flexible display configuration and integration of various data streams.
The system enhances flexibility and integration of diverse informational content, allowing partial display of video streams across multiple panels and ensuring critical information visibility, while maintaining compatibility with existing graphic calculators.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
Title of the invention: Electronic display system intended to be integrated into an aircraft cockpit
[0001] The present invention relates to an electronic display system intended to be integrated into a cockpit of an aircraft.
[0002] The present invention relates to the field of display systems in aircraft.
[0003] It is known in aircraft that the cockpit comprises an electronic display system comprising: displays for providing information to the pilot, and graphic calculators.
[0004] Different types of displays are generally present in cockpits: head-down displays, head-up displays, also called HUD displays (from the English Heads Up Display) including windshield projection solutions, and possibly displays included in the pilots' helmets, also called HWD displays (from the English Head Worn Display).
[0005] It is known that head-down displays are display screens, positioned in a lower part of the cockpit relative to the head-up display(s).
[0006] The head-up display(s) and the displays included in the helmets generally comprise at least partially transparent surfaces positioned between the pilot and a cockpit window, and onto which a video stream is projected. Projection directly onto the windshield is also possible. Thus, the pilot observes the superposition of the external environment of the aircraft, via a cockpit window, and the video stream projected onto the surface.
[0007] It is known that the display device comprises, for each display, one or more respective calculators capable of determining the video stream to be displayed on the display.
[0008] However, such an architecture of the electronic display system is substantially rigid since the content displayed on each display depends solely on the associated computer.
[0009] The present invention relates to an electronic display system intended to be integrated into a cockpit of an aircraft, the electronic display system comprising: - a set of display(s) respectively comprising at least one display panel, each display defining at least one display surface; - a set of graphic calculators, each graphic calculator being capable of calculating at least one calculated stream to be displayed on the set of display(s), each calculated stream being one of a video stream, a data stream, a video ... graphical command(s), or an aeronautical command flow(s),
[0010] each calculated flow comprising informational content; and - an arrangement module connected to each graphics calculator and to each display of the set of displays, and configured to form, from the calculated streams, a distributed video stream for each display or for each display surface, the or at least one of the distributed video streams comprising informational contents from streams calculated by different graphics calculators,
[0011] the arrangement module being further configured to send each distributed video stream to the corresponding display or to the display whose display panel(s) define the associated display surface,
[0012] each display being further configured to distribute the display of the associated distributed video stream on its display panel or among its display panels.
[0013] According to particular embodiments of the invention, the system comprises one or more of the following characteristics, taken in isolation, or in all technically possible combinations: - the system further comprising: • a set of instruction sensor(s) from a user of the electronic display system, the set of sensor(s) being configured to acquire data resulting from an instruction from the user, • a decision module configured to identify, from the acquired data, the user's instruction, and to send, according to the identified instruction, a predefined instruction to at least one of: • at least one of the graphic calculators, and • the arrangement module;
[0014] the predefined instruction depending on the identified instruction. - at least one display of the set of display(s) comprises at least two contiguous display tiles defining a single display surface; - the arrangement module is configured to form the at least one distributed video stream such that the or at least one of the distributed video streams is partially displayed on a first display panel of the set of display(s) and partially displayed on a second display panel of the set of display(s), the first and second display panels being contiguous; - each contiguous display tile has at least one edge which is contiguous with an edge of another contiguous display tile,
[0015] the contiguous display panels being such that, when the electronic display system is integrated into a cockpit of an aircraft, the contiguous edges of the contiguous panels are indistinguishable for a pilot of the aircraft; - the display assembly(s) comprises a head-up display and a head-down display, the head-down display comprising the at least two contiguous display panels; - the arrangement module is configured to form the distributed stream(s) such that the information content included in at least two calculated streams is partially superimposed on a display of the set of display(s); - the arrangement module is configured to generate, from each calculated flow, at least one Human-System Interface layer,
[0016] the arrangement module being further configured to form the or each distributed video stream by distributing the Human-System Interface layers in the or each distributed video stream; - the set of graphical calculators comprises at least one critical calculator and at least one non-critical calculator,
[0017] each critical computer being capable of calculating a calculated flow comprising a greater informational content to successfully carry out the flight of the aircraft than the flow calculated by each non-critical computer; - at least one of the graphic calculators is capable of being connected to external equipment and of receiving, from said external equipment, information to be represented in the flow calculated by said graphic calculator; and - the electronic display system includes several arrangement modules,
[0018] in operation, each graphic calculator being configured to send the calculated flow to the same arrangement module, called master module,
[0019] if said arrangement module is unavailable, each calculated flow being redirected to another arrangement module which becomes the master module.
[0020] Other characteristics and advantages of the invention will appear on reading the following description of embodiments of the invention, given by way of example only and with reference to the drawings which are: - [Fig.l] [Fig.l] is a schematic representation of a cockpit of an aircraft comprising an electronic display system according to the invention; - [Fig.2] [Fig.2] is a schematic representation of a set display(s) included in the electronic display system according to the invention; - [Fig.3] [Fig.3] is a schematic representation of the electronic system display according to the invention; - [Fig.4] [Fig.4] is a schematic representation of the whole display(s) of [Fig.2] showing an example of video stream display distribution; - [Fig.5] [Fig.5] is a detailed schematic representation of an arrangement module included in the electronic display system of [Fig.3]; and - [Fig.6] [Fig.6] is a flowchart of a display method implemented by the display system according to [Fig.3].
[0021] In [Fig. 1] a cockpit 9 of an aircraft is shown. In the cockpit 9 an electronic display system 10 is installed.
[0022] The electronic display system 10 comprises a set of displays 15, a set of graphic calculators 20, an arrangement module 25, and optionally a set of instruction sensor(s) 26 and a decision module 27.
[0023] The set of displays 15 preferably comprises at least one head-up display 15A, at least one head-down display 15B.
[0024] Each display comprises at least one display panel 30, also called panel 30. The term “display panel” means a display module comprising display means such as liquid crystal, plasma, LED, microLED or OLED means, and an electronic resource suitable for receiving images to be displayed and suitable for controlling the display means to display said images to be displayed, and optionally a frame delimiting the outline of the display means.
[0025] For example, each panel 30 is of the “borderless” type, also called extra-thin edge. In other words, each panel 30 does not include any frame, or a frame whose thickness is less than 5 mm. Thus, the frame, if it is present, is not distinguishable for a pilot in the cockpit 9.
[0026] The display panels 30 of each display 15A, 15B define at least one display surface 32. At least one display surface 32 is formed by several contiguous panels 30.
[0027] With reference to [Fig.2], such a surface is defined by the lowest display tiles 30 of the lowest head-down display.
[0028] In the example of [Fig.2], the display assembly 15 comprises a head-up display 15A and a head-down display 15B. The head-up display 15A comprises a single display panel 30 defining a single display surface 32. The head-down display 15B comprises four display panels 30 defining two separate display surfaces.
[0029] As seen in [Fig.2], each display panel 30 preferably has a substantially rectangular shape, extending between edges. The edges are by example formed by the frame of the slab 30 when it comprises such a frame. If the slab 30 does not comprise a frame, then the edges are formed by the ends of the display means. According to a variant not shown, at least one of the slabs 30 has a non-rectangular shape, such as a curved or conical shape, for example matching the shape of the cockpit 9.
[0030] The slabs 30 comprise edges, or edge portions, delimiting a perimeter of the corresponding display 15A, 15B. These edges are called external edges 35. The external edges 35 are shown in solid lines in [Fig.2].
[0031] At least two slabs 30 of one of the displays 15A, 15B are contiguous. By "contiguous" is meant that the slabs 30 join at at least one edge, without showing any visible space between the slabs 30. Advantageously, the transition zone between each pair of contiguous slabs 30 of the same display 15A, 15B is substantially flat and devoid of roughness.
[0032] The contiguous slabs 30 comprise at least one edge, or part of an edge, contiguous to one another, called contiguous edge 40.
[0033] In [Fig.2], only the head-down display 15B comprises such contiguous panels 30. It is clear that such a configuration is also possible for the head-up display 15A.
[0034] In the example of [Fig.2], the contiguous edges 40 are represented by a dashed line. The contiguous slabs 30 are such that, when the electronic display system is integrated into the cockpit 9 of an aircraft, the contiguous edges 40 of the contiguous slabs are indistinguishable for a pilot of the aircraft.
[0035] With reference to [Fig. 3], the graphic calculators 20 are each capable of calculating a calculated stream. The calculated stream is one of: a video stream, a graphic command stream, or an aeronautical command stream, to be displayed on the set of displays 15. Each calculated stream comprises informational content to be displayed.
[0036] The video stream(s) preferably conform to any video protocol implementing a level of service required by the stream. Thus, each stream has characteristics conforming to a predefined criterion in terms of integrity, availability depending on aeronautical environmental aggressions and flow rate.
[0037] For example, the video stream(s) comply with the ARINC 818 protocol, the DVI protocol or the SMPTE protocol. Each video stream preferably comprises periodically refreshed sub-images 37.
[0038] The graphics command stream(s) are, for example, command streams in a graphics language, such as OpenGL, Vulkan, or any other graphics API.
[0039] The aeronautical command flow(s) are command flows respecting preferably the ARINC 661 protocol.
[0040] For example and as shown in [Fig. 3], the electronic display system 10 comprises at least one graphics computer 20 capable of calculating a video stream conforming to the ARINC 818 protocol, at least one graphics computer 20 capable of calculating aeronautical commands conforming to the ARINC 661 protocol, and at least one graphics computer 20 capable of calculating graphics commands in a graphics language such as the OpenGL language.
[0041] Each graphic calculator 20 comprises for example a calculation unit 45 capable of generating graphic commands and / or aeronautical commands as described previously.
[0042] At least one graphics calculator 20 further comprises a graphics unit 50 connected to the calculation unit 45 and capable of generating one or more video streams from the generated graphics and / or aeronautical commands.
[0043] In the example of [Fig.3], two of the three graphic calculators 20 shown comprise a respective graphic unit 50.
[0044] The set of computers 20 may comprise one or more computers performing a function. By architecture, the graphical representation of a function implemented by a set 20 may itself be implemented by the composition of several video streams or commands.
[0045] At least one graphics computer 20 comprising a graphics unit 50 further comprises a video unit 55. Preferably, the graphics computer(s) 50 comprising a video unit 55 are connected to external equipment not shown. Said external equipment comprises for example a flight computer of the aircraft as well as databases. Thus, said graphics computer 20 is configured to receive, from this external system, information to be represented in the calculated stream(s) to be displayed on the display assembly(s) 15. The information to be represented received is for example in a video format conforming to the ARINC A818 or SMTPE protocol.
[0046] Said information is for example symbolological content.
[0047] In this case, the video unit 55 is capable of processing this information and combining it with the video stream from the graphics unit 50 to form the calculated video stream. Optionally, the video unit 55 is also capable of receiving an external video stream 73 and combining it with the other streams.
[0048] If the graphic calculator 20 comprises only one respective calculation unit 45, the flow calculated by this calculator 20 is the flow of graphic or aeronautical commands generated by said calculation unit 45. This is notably the case of the calculator represented at the top in [Fig.3].
[0049] If a graphics calculator 20 comprises only a calculation unit 45 and a respective graphics unit 50, the flow calculated by this calculator 20 is the video flow generated by said graphics unit 50 and / or the flow calculated by the calculation unit 45. This is notably the case of the calculator 20 represented in the middle in [Fig.3].
[0050] If a graphics calculator 20 comprises a calculation unit 45, a graphics unit 50 and a video unit 55 respectively, the stream calculated by this calculator 20 is the video stream from said video unit 55, and / or the stream calculated by the graphics unit 50, and / or the stream calculated by the calculation unit 45, possibly a combination of these streams. This is notably the case of the calculator 20 shown at the bottom in [Fig.3].
[0051] It is clear that all these types of graphic calculator 20 are not necessarily included in the system 10. It is also clear that several graphic calculators 20 are likely to be of the same type, i.e. comprising the same units 45, 50, 55.
[0052] According to a non-represented example, the system comprises: - at least one graphic calculator 20 comprising only one calculation unit 45 and generating one or more flows specific to it, - at least one graphics calculator 20 comprising only a calculation unit 45 and a graphics unit 50 and generating one or more flows specific to it, and - at least one graphics calculator 20 comprising a calculation unit 45, a graphics unit 50 and a video unit 55 and generating one or more streams specific to it.
[0053] In a variant not shown, even if one of the graphics calculators 20 comprises a graphics unit 50 and possibly a video unit 55, it is still capable of sending a calculated stream comprising only graphics or aeronautical commands from the calculation unit 45.
[0054] Furthermore, the graphics calculators 20 are of two types: critical graphics calculators 20 and non-critical graphics calculators 20.
[0055] Each critical computer 20 is capable of calculating at least one video or graphic / aeronautical command stream(s) comprising more important information for successfully carrying out the flight of the aircraft than the video or graphic / aeronautical command stream(s) calculated by each non-critical computer 20.
[0056] Furthermore, independently of the critical or non-critical aspects, the graphic calculators 20 are, according to one embodiment, distinct from one another and are capable of providing the calculated flows in distinct formats from one graphic calculator 20 to another.
[0057] The arrangement module 25 is connected to each graphics calculator 20 and to each display 15A, 15B or display surface 32. The arrangement module 25 is configured to form, from the calculated streams, a distributed video stream for each display 15A, 15B or for each display surface 32. Distributed video streams are also called distributed streams.
[0058] As shown in [Fig.3], the arrangement module 25 is also optionally connected to an external sensor (not shown) providing a respective external video stream 74, such as a camera.
[0059] The or at least one of the distributed video streams comprises informational contents from streams calculated by different graphic calculators 20.
[0060] For this purpose, the arrangement module 25 is configured to receive the calculated flows from each graphics calculator 20.
[0061] According to the embodiment in which the graphic calculators 20 are of distinct types, the arrangement module 25 comprises means suitable for acquiring the calculated flows according to the different formats of the graphic calculators 20. For example, the formats may be compliant with the aeronautical graphics protocol of the ARINC 661 type, compliant with the graphic APIs (from the English, Application Programming Interface) of the OpenGL, Vulkan type, or any other graphic API, compliant with all video standards (compressed or not), or compliant with any other type.
[0062] With reference to [Fig.5], the arrangement module 25 comprises a plurality of generation units 60. Preferably, the arrangement module 25 comprises at least one generation unit 60 for each graphics calculator 20.
[0063] Each generation unit 60 is configured to receive a calculated flow and to generate from this calculated flow, at least one Human-System Interface layer 56, also called IHS layer 56.
[0064] The term “IHS layer” means a video-type format comprising informational content intended for the user and preferably with which said user is able to interact when it is displayed.
[0065] Preferably, each generation unit 60 is configured to, if the calculated stream received is a video stream, extract the sub-images 37 from said video stream and generate for each sub-image 37, a respective IHS layer 56.
[0066] Preferably, each generation unit 60 is configured to, if the calculated flow received is a flow of graphics commands or a flow of aeronautical commands, generate one or more IHS layers 56 from said command(s) contained in the calculated flow received.
[0067] Optionally, each IHS layer 56 comprises at least one attribute indicating the graphics computer 20 from which the calculated flow from which the IHS layer 56 is generated originates. Thus, the IHS layers 56 originating from critical graphics computer(s) 20 are identifiable.
[0068] The arrangement module 25 further comprises a merging and distribution unit 65.
[0069] The merging and distribution unit 65 is configured to receive each IHS layer 56 generated by the generation units 60.
[0070] The merging and distribution unit 65 is configured to distribute the IHS layers 56 among the displays 15A, 15B or among the display surfaces 32 by forming the distributed video streams. The merging and distribution unit 65 is then configured to form one video stream per display 15A, 15B or per display surface 32. Each distributed video stream comprises all or part of one or more IHS layers 56, possibly processed.
[0071] Preferably, at least one distributed video stream comprises several Human-Machine Interface layers 56.
[0072] For example, a distributed stream comprises IHS 56 layers generated from computed streams from multiple separate graphics calculators 20.
[0073] The distribution merging unit 65 is for example further configured to form each distributed stream so that it is adapted to the display 15A, 15B, or to the display surface 32 on which it is intended to be displayed. For example, if the head-up display 15A is a transparent surface onto which video streams are projected, the arrangement module 25 is configured to adapt the distributed stream to be displayed on said head-up display 15A, so that the projected stream is consistent with the real world for the pilot of the aircraft. By "consistent with the real world" is meant the fact that a graphic object belonging to the distributed stream is perceived as superimposed on the corresponding real object. For example, if the distributed stream considered is a pointer relating to the position of a building, said distributed stream must superimpose the pointer and the real building targeted.For example, if the distributed video stream is the horizon line, said line is superimposed on the real horizon.
[0074] Furthermore, the merging and distribution unit 65 is configured to distribute the IHS layers 56 in the distributed streams so that there is no contradiction between the head-up displays 15A and head-down displays 15B.
[0075] As an optional addition, the merging and distribution unit 65 is capable of forming each distributed flow by applying predetermined rules, also called predefined rules, for example defined by the decision module 27, also called Windows manager 27, as will be described below. For example, the predetermined rules are selected by the decision module 27 in a static manner.
[0076] Preferably, the predefined rules depend on the graphics calculator 20 indicated in each attribute of each IHS layer 56. For example, the predetermined rules define, depending on the graphics calculator 20 from which the video stream originates, the processing to be applied to the generated IHS layers 56, and the displays 15A, 15B, or display surface(s) 32 on which the distributed streams formed from said layers 56 must be displayed.
[0077] For example, the predetermined rules are such that the arrangement module 25, and in particular the distribution unit 65, preserves the integrity, priority and visibility of the IHS layers 56 originating from flows calculated by the critical graphical computers 20. In other words, from the attribute(s) present in the IHS layers 56, the arrangement module 25 ensures that the IHS layers 56 originating from the critical computers 20 are always the upper layers in the event of superposition and that the information they contain is always accessible in the distributed flows formed.
[0078] The arrangement module 25, and in particular the merging and distribution unit 65, is preferably agnostic of the composition of each display 15A, 15B and of the display surfaces 32. In other words, for the distribution of the IHS layers 56 in the distributed streams, the arrangement module 25 preferably only has knowledge of the dimensions of the display 15A, 15B, or of the display surface 32, for example in terms of pixels, and of their geometry. The arrangement module 25, and the computers 20 are then ignorant of the number of tiles 30 making up each display 15A, 15B and / or display surface 32 and of the limits of each tile 30.
[0079] As an optional addition, the arrangement module 25, for example via its merging and distribution unit 65, is configured to display, in a superimposed manner, on the same area of the tiles 30, several IHS layers 56 originating from distinct calculated flows. For this purpose, the merging and distribution unit 65 is in particular configured to use the information of the IHS layers 56 during the formation of the distributed flow and configured to use mixing laws to be applied to the IHS layers 56 to be superimposed totally or partially. Thus, according to this optional addition, at least two IHS layers 56 are partially superimposed on the set of displays 15.
[0080] The arrangement module 25 is for example agnostic of the contiguous edges 40 of the slabs 30. Thus, the arrangement module 25 is for example configured to distribute the display of at least one distributed stream distributed between several slabs 30. In other words, the arrangement module 25 is for example configured to distribute the display of the distributed streams so that an IHS layer 56 included in a distributed stream is partially displayed on a first display slab 30 of the set of displays 15 and partially displayed on a second display slab 30 of the set of displays 15, the first and second display slabs 30 being contiguous.
[0081] Optionally, the arrangement module 25 is configured to, when forming the distributed streams, divide an IHS layer 56 geometrically. Each of said distributed video streams is then intended to be displayed on a separate display 15A, 15B or on a separate display surface 32. Preferably, the arrangement module 25 is configured to guarantee, in the distribution of said distributed streams, continuity between the displays 15A, 15B and display surfaces 32. As an example, the arrangement module 25 is configured to distribute said distributed streams so as to align the display of the IHS layer(s) 56 divided between the head-up display 15A and the head-down display 15B.
[0082] According to a variant not shown, the arrangement module 25 further comprises an output intended to be connected to a recorder not shown and included in the system 10. According to this variant, the arrangement module 25 is configured to send a copy, to said recorder, of the distributed video streams for subsequent post-processing. Optionally, the copy is in a format other than that of the distributed video streams. For example, the copy is compressed, resized or composed. For example, the copy is suitable for being sent to the recorder via an Ethernet cable.
[0083] As an optional addition, the arrangement module 25 is configured to, if a received stream is not valid, for example a noisy or empty signal due to a non-functional cable, transmit this information to the decision module 27 so that the decision module 27 determines new predefined rules to be transmitted to the arrangement module 25. According to an example not shown, the electronic display system 10 comprises several arrangement modules 25. In operation, each graphic calculator 20 is configured to send the calculated stream(s) to the same arrangement module 25, called the master module. If said master module is unavailable, each calculated stream is redirected to another arrangement module 25, which then becomes the master module.
[0084] Again with reference to [Fig.3], each display is configured to distribute the display of the associated distributed stream on its display panel 30 or among its display panels 30 if it comprises several display panels 30.
[0085] [Fig.4] represents an example of a display distribution of distributed flows from calculated flows, carried out by the arrangement module 25. In particular, [Fig.4] represents the same set of display(s) as that represented in [Fig.2]. The contiguous edges 40 of the slabs 30 are not represented in [Fig.4] for reasons of readability.
[0086] In [Fig.4], the IHS 56 layers of the distributed flows are represented by rectangles with rounded corners.
[0087] In the example illustrated in [Fig. 4], the electronic display system comprises three graphics calculators 20. Each graphics calculator 20 calculates calculated flows specific to it. A first graphics calculator 20 calculates the video flows corresponding to IHS layers 56 whose filling is dotted in [Fig. 4]. A second graphics calculator 20 calculates a flow of graphics commands corresponding to IHS layers 56 whose filling is hatched from bottom left to top right in [Fig. 4]. A third graphics calculator 20 calculates video flows corresponding to IHS layers 56 whose filling is hatched from bottom right to top left in [Fig.4]. Finally, a fourth graphic calculator 20 calculates aeronautical order flows corresponding to IHS 56 layers whose filling is hatched in crosshairs in [Fig.4].
[0088] It is visible in [Fig.4] that the IHS 56 layers resulting from the flows calculated by the same graphic calculator 20 are for example displayed on several displays 15A, 15B.
[0089] Furthermore, as visible in [Fig.4], the IHS layers 56 from the calculated flows coming from the second and fourth graphic calculators 20 are displayed on several tiles 30. These IHS layers bear the reference 561 in [Fig.4].
[0090] Thus, it is clear that the arrangement module 25 considers all of the tiles 30 of the same display 15 as a single display surface 32 without prejudging the limits of the tiles 30.
[0091] Again with reference to [Fig. 3], the sensor assembly 26 is configured to acquire an instruction from a user of the electronic display system 10. The user of the electronic display system 10 is preferably the pilot of the aircraft. More particularly, the sensor assembly 26 is configured to acquire data resulting from an instruction from the user.
[0092] A user instruction is for example: the selection of a displayed IHS 56 layer to obtain more information on the content of said layer, the selection of an interactive object of a layer to change its state, enter information, an instruction to enlarge or shrink a displayed IHS 56 layer, an instruction to move an IHS 56 layer displayed on the set of displays 15, or an instruction to delete a displayed layer, or any other possible types of actions.
[0093] The set of sensors 26 preferably comprises a tactile, force or haptic sensor 261 integrated in the set of displays 15. For example, each display 15A, 15B is a tactile display capable of receiving a tactile pressure from the user and of providing data resulting from this pressure. In particular, each panel 30 is a tactile panel.
[0094] The set of sensors 26 further optionally comprises one or more multimodal sensors 262. The term “multimodal sensors” means sensors capable of acquiring instructions from the user without support. Such sensors are, for example, sensors for tracking the user's gaze, voice sensors or motion sensors. The multimodal sensor(s) are also capable of providing data resulting from an instruction from the user.
[0095] The decision module 27 is connected to the set of sensors 26, to each graphic calculator 20 and to the arrangement module 25.
[0096] The decision module 27 is aware of the architecture of the system 10. Thus, the decision module 27 knows the arrangement of the displays 15 and the panels 30 as well as the number of computers 20. In particular, the decision module 27 knows whether each computer 20 is a critical computer or not. The decision module 27 is configured to develop the predefined rules and transmit them to the arrangement module 25.
[0097] The decision module 27 is configured to receive, from the set of sensors 26, the data resulting from the user's instruction. The decision module 27 is further configured to identify, from the acquired data, the user's instruction, and to send, according to the identified instruction, a predefined instruction to at least one of: at least one of the graphic calculators 20, and the arrangement module 25. The predefined instruction depends on the identified instruction.
[0098] In particular, the decision module 27 is configured to identify, based on the received data, the IHS layer 56 concerned by the user's instruction. The decision module 27 is configured to then identify the instruction, for example from among the aforementioned instruction examples.
[0099] The decision module 27 is configured to, based on the identified IHS 56 layer and the identified instruction, determine whether the instruction can be processed by the arrangement module 25, for example via a modification of the rules predefined by the decision module 27. In this case, the decision module 27 is configured to transmit the instruction to the arrangement module 25 to implement a corrective action on the distribution of the IHS 56 layers on the set of display(s) 15 during the formation of the distributed streams. This is particularly the case when the instruction is an instruction to enlarge or shrink a displayed IHS 56 layer, an instruction to move a displayed IHS 56 layer on the set of display(s) 15, or an instruction to delete a displayed IHS 56 layer.
[0100] When the instruction cannot be processed by the arrangement module 25, the decision module 27 is configured to transmit the instruction to the graphics computer 20 having calculated the calculated flow corresponding to the identified IHS layer 56, so that the graphics computer 20 implements the appropriate corrective action. In particular, the corresponding graphics computer 20 is configured to receive the instruction and the identified IHS layer 56 via its processing unit 45 previously described.
[0101] For example, each graphics calculator 20, the arrangement module 25 and the decision module 27 are calculators comprising respectively a memory, at least one calculation processor, at least one graphics processor, at least one video processor. The functionalities of these modules 25, 27 and graphics calculators 20 are then implemented in the form of software, or a software brick, executable by the associated processor. In particular, each processing unit 45, graphics unit 50, video unit 55, generation unit 60 and fusion and distribution unit 65 is a software or software brick.
[0102] Each memory is then capable of storing such software. Each processor is then capable of executing each of the software.
[0103] In a variant not shown, each graphic calculator 20, the arrangement module 25 and the decision module 27, are each produced in the form of a programmable logic component, such as an FPGA (Field Programmable Gate Array) or an integrated circuit, such as an ASIC (Application Specific Integrated Circuit).
[0104] When each graphic calculator 20, arrangement module 25 and decision module 27 is a calculator implementing software functionalities, i.e. computer programs, also called computer program products, said computer programs are furthermore capable of being recorded on a medium, not shown, readable by a computer. The computer-readable medium is for example a medium capable of storing electronic instructions and of being coupled to a bus of a computer system. By way of example, the readable medium is an optical disk, a magneto-optical disk, a ROM memory, a RAM memory, any type of non-volatile memory (for example FLASH or NVRAM) or a magnetic card. On the readable medium is then stored a computer program comprising software instructions.
[0105] The operation of the electronic display system 10 will now be described, via a display method, implemented by the arrangement module 25 and a flowchart of which is shown in [Fig.6].
[0106] Initially, each graphics calculator 20 calculates one or more calculated streams, for example from video content(s), and / or information to be displayed, received from the external equipment and / or calculated by the graphics calculator 20 itself.
[0107] The calculated flows are then sent to the arrangement module 25.
[0108] The display method comprises a reception step 110, during which the arrangement module 25 receives from each graphics calculator 20, at least one calculated flow.
[0109] The method then comprises a generation step 120, during which the arrangement module 25 generates, via its generation units 60 and for each calculated flow received, at least one IHS layer 56.
[0110] The method then comprises a formation step 130, during which the arrangement module 25 forms for each display 15A, 15B, or for each display surface 32, a video stream distributed from the IHS layers 56.
[0111] For this purpose, the arrangement module 25 determines, via its merging and distribution unit 65, a distribution of the IHS layers 56 by forming the distributed flows as explained previously, preferably by applying the predefined rules by decision module 27.
[0112] The method then comprises a sending step 140 during which the arrangement module 25 sends, for example via its merging and distribution unit 65, to the set of display(s) 15, the distributed video streams comprising the Human-System Interface layers (56) with a view to their display on each display 15A, 15B or each display surface 32.
[0113] Each display 15A, 15B receives the corresponding distributed video stream and distributes the display of the flow distributed on its 30 slab or between its 30 slabs.
[0114] Then, at a time, the driver optionally issues the display modification instruction.
[0115] This instruction is for example a tactile press on one of the set of display(s) 15, a voice instruction, an eye instruction or a movement instruction.
[0116] The set of sensors 26 then acquires data corresponding to the instruction issued by the pilot.
[0117] The set of sensors 26 transmits this data to the decision module 27. The decision module 27 then identifies the instruction issued by the pilot and the IHS layer 56 concerned.
[0118] The decision module 27 then determines whether the instruction can be processed by the arrangement module 25.
[0119] If yes, the decision module 27 transmits the instruction to the arrangement module 25, for example by establishing new predefined rules and transmitting them to the arrangement module 25.
[0120] The method then comprises a new reception step 150, during which the arrangement module 25 receives the instruction to modify the display of a distributed video stream, sent from a user of the display system 10, for example the pilot.
[0121] The method then comprises a step 160 of forming a new distributed video stream in place of the distributed video stream targeted by the instruction, as a function of the instruction received.
[0122] For this purpose, the arrangement module 25 forms the new distributed flow by adapting for example the distribution of the IHS layers 56 on the set of displays 15, according to the instruction received.
[0123] In particular, if the instruction is an instruction to move an IHS layer 56, the arrangement module 25 reorganizes the spatial distribution of the IHS layers 56 on the set of display(s) 15.
[0124] If the instruction is an instruction to enlarge or shrink the display of an IHS layer 56, the arrangement module 25 performs the modification of the size of the display of said IHS layer 56 on the set of displays 15. If this size modification involves a partial superposition of said IHS layer 56 with another IHS layer 56, the arrangement module 25 optionally reorganizes the distribution of the other IHS layers 56 on the set of display(s) 15 accordingly.
[0125] If the instruction is an instruction to delete a displayed IHS layer 56, the arrangement module 25 then deletes this IHS layer 56 from the display of the IHS layers 56. Optionally, the arrangement module 25 reorganizes the display of the IHS layers 56 on the set of displays 15 to better occupy the display space on the set of display(s) 15.
[0126] The method then comprises a new sending step 170, during which the arrangement module 25 sends to the corresponding display 15A, 15B, the new distributed video stream with a view to its display on the display 15A, 15B or the corresponding display surface 32.
[0127] If the decision module 27 determines that the instruction cannot be processed by the arrangement module 25, it transmits it to the graphics calculator 20 having calculated the calculated flow from which the identified IHS layer 56 originates.
[0128] The graphics computer concerned 20 then modifies the corresponding calculated flow. For example, if the instruction is a request for additions to information included in one of the IHS layers 56 or the selection of an interactive object of an IHS layer to change its state, the graphics computer 20 communicates for example with the external system to obtain these additions or the result of this change of state. The graphics computer 20 then calculates a new calculated IHS layer 56 flow comprising the completed information or the state to be changed and transmits it to the arrangement module 25. The arrangement module 25 then generates a new IHS layer 56 and includes it in its distribution of IHS layers 56 on the set of display(s) 15 when forming new distributed flows.
[0129] If the instruction is the entry of information, the graphics computer 20 communicates for example with the external system so that it processes the information entered and adapts the content to be displayed which it transmits to the graphics computer 20. Similar to previously, the graphics computer 20 calculates a new calculated flow and the arrangement module 25 generates a new IHS layer 56 and includes it in the flows distributed during the formation of said new flows.
[0130] It is clear that the electronic display system 10 according to the invention allows greater flexibility for the pilot of the aircraft, in particular thanks to the arrangement module 25 making it possible to no longer match the IHS layers 56 from flows calculated by the graphic computers 20 to a display 15A, 15B, or to a display panel 30.
[0131] Thus, it is possible for an IHS layer 56 to be partially displayed on several panels 30. In this, the electronic display system 10 according to the invention overcomes the limits of the set of displays 15 by considering the set of displays as a single display zone not segregated into several distinct and independent displays.
[0132] Furthermore, thanks to the arrangement module 25, it is possible to keep the graphic calculators 20 of the state of the art since the arrangement module 25 is compatible with these graphic calculators 20.
[0133] Furthermore, the fact that the display 15B comprises several contiguous tiles 30 allows the arrangement module 25 to form distributed video streams comprising IHS layers 56 extending over all or part of the display surface, and to reconfigure the distribution of the IHS layers 56 in the distributed streams.
[0134] Furthermore, the arrangement module 25 makes it possible to avoid integrating a unit for managing the display of the IHS layers 56 in each graphics computer 20, thus simplifying each graphics computer 20.
[0135] In addition, the arrangement module 25 makes it possible to mix information of different criticalities from different computers 20 while retaining the spatial and temporal segregation properties. Thus, the arrangement module 25 makes it possible to ensure that a non-critical flow does not impact a more critical flow. The arrangement module 25 is designed to implement robust partitioning between the different information flows received by the computers 20 and the control module 27.
[0136] The fact that the identified instruction is transmitted, by the decision module 27, directly to the arrangement module 25 when possible, makes it possible to accelerate the processing of the instruction by bypassing the graphics calculators 20. Thus, the interaction between a user and the system 10 is more fluid.
[0137] The arrangement module 25 guarantees the openness and robustness of the system 10 with respect to the graphics computers 20 by decoupling the graphics computers 20 and the set of displays 15 at the level of the video interfaces and the interfaces for transmitting the instructions issued for the set of display(s) 15 to the graphics computers 20.
[0138] The arrangement module 25 allows for optimizing the wiring in the electronic display system 10 with direct and unique connections between the graphics computers 20 and the arrangement module 25, and between the arrangement module 25 and the set of displays 15.
[0139] The arrangement module 25 guarantees the openness and robustness of the system 10 with respect to the graphics computers 20 that it comprises by ensuring the segregation properties between the video streams coming from possibly heterogeneous graphics computers 20, and between the IHS layers 56 that make up the video streams.
Claims
Claims
1. Electronic display system (10) intended to be integrated into a cockpit (9) of an aircraft, the electronic display system (10) comprising: - a set of display(s) (15) respectively comprising at least one display panel (30), each display defining at least one display surface (32); - a set of graphic calculators (20), each graphic calculator (20) being capable of calculating at least one calculated flow to be displayed on the set of display(s) (15), each calculated flow being one of a video flow, a graphic control flow(s), or an aeronautical control flow(s), each calculated flow comprising informational content; and - an arrangement module (25) connected to each graphics calculator (20) and to each display of the set of displays (15), and configured to form, from the calculated streams, a distributed video stream for each display (15A, 15B) or for each display surface (32), the or at least one of the distributed video streams comprising informational contents from streams calculated by different graphics calculators (20), the arrangement module (25) being further configured to send each distributed video stream to the corresponding display (15A, 15B) or to the display (15A, 15B) whose display panel(s) (30) define the associated display surface (32), each display (15A, 15B) being further configured to distribute the display of the associated distributed video stream on its display panel (30) or among its display panels (30).
2. The system (10) of claim 1, further comprising: - a set of sensor(s) (26) for instruction(s) from a user of the electronic display system (10), the set of sensor(s) (26) being configured to acquire data resulting from an instruction from the user, - a decision module (27) configured to identify, from the acquired data, the user's instruction, and to send, according to the identified instruction, a predefined instruction to at least one of: • at least one of the graphic calculators (20), and • the arrangement module (25), the predefined instruction depending on the identified instruction.
3. System according to claim 1 or 2, in which at least one display of the set of displays (15) comprises at least two contiguous display tiles (30) defining a single display surface (32).
4. The system (10) of claim 3, wherein the arrangement module (25) is configured to form the at least one distributed video stream such that the or at least one of the distributed video streams is partially displayed on a first display panel (30) of the set of display(s) (15) and partially displayed on a second display panel (30) of the set of display(s) (15), the first and second display panels (30) being contiguous.
5. A system (10) according to claim 3 or 4, wherein each contiguous display panel (30) has at least one edge (40) which is contiguous with an edge (40) of another contiguous display panel (30), the contiguous display panels (30) being such that, when the electronic display system (10) is integrated into a cockpit (9) of an aircraft, the contiguous edges (40) of the contiguous panels (30) are indistinguishable for a pilot of the aircraft.
6. A system (10) according to any one of claims 3 to 5, wherein the display assembly (15) comprises a head-up display (15A) and a head-down display (15B), the head-down display (15B) comprising the at least two contiguous display panels (30).
7. System (10) according to any one of the preceding claims, wherein the arrangement module (25) is configured to form the distributed stream(s) such that the information content comprised in at least two calculated streams is partially superimposed on a display (15A, 15B) of the set of display(s) (15).
8. System (10) according to any one of the preceding claims, wherein the arrangement module (25) is configured to generate, at from each calculated stream, at least one Human-System Interface layer (56), the arrangement module (25) being further configured to form the or each distributed video stream by distributing the Human-System Interface layers (56) in the or each distributed video stream.
9. System (10) according to any one of the preceding claims, in which the set of graphical computers (20) comprises at least one critical computer and at least one non-critical computer, each critical computer being capable of calculating a calculated flow comprising a greater informational content for successfully carrying out the flight of the aircraft than the flow calculated by each non-critical computer.
10. System (10) according to any one of the preceding claims, in which at least one of the graphics calculators (20) is capable of being connected to external equipment and of receiving, from said external equipment, information to be represented in the flow calculated by said graphics calculator (20).
Citation Information
Patent Citations
Video processing
EP3905236A1
Display controller, heads-up image display system and method thereof
US20160307346A1