SYSTEMS AND METHODS FOR MONITORING AIRCRAFT PREPARATION

DE602020042364T2Active Publication Date: 2024-12-04THE BOEING CO
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
DE602020042364
Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Priority Date
2019-05-28
Filing Date
2020-05-04
Publication Date
2024-12-04
Estimated Expiration
2040-05-04

AI Technical Summary

Technical Problem

Aircraft turnaround processes are inefficiently monitored, requiring tedious and time-consuming manual communication between various airport and aircraft stakeholders, lacking real-time situational awareness and automated analysis.

Method used

Aircraft turnaround monitoring system utilizing cameras and sensors to capture and analyze images and data, processing them with image recognition techniques to track turnaround activities, and a control unit that determines and predicts turnaround milestones, providing real-time status and predictions to stakeholders.

Benefits of technology

Enables efficient and automated monitoring and reporting of aircraft turnaround processes, reducing the need for manual communication and providing timely situational awareness and predictions, improving operational efficiency.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader
Need to check novelty before this filing date? Find Prior Art

Description

FIELD OF THE DISCLOSURE

[0001] Examples of the subject disclosure generally relate to aircraft turnaround monitoring systems and methods.BACKGROUND OF THE DISCLOSURE

[0002] Various types of aircraft are used to transport passengers and cargo between numerous locations. Each aircraft typically flies between different locations according to a defined flight plan or path. For example, an aircraft departs from a departure airport and flies to an arrival airport.

[0003] An aircraft may fly multiple flights between different airports. For example, an aircraft may depart from a first airport and arrive at a second airport. At the second airport, the aircraft may prepare for another flight to a third airport or back to the first airport. Turnaround between scheduled flights for an aircraft is a time from when the aircraft lands at an airport until the aircraft departs from the airport.

[0004] During a turnaround, various tasks are performed in order to ensure that the aircraft is readied for its next flight. For example, a first set of passengers arriving at a destination airport aboard the aircraft disembark from the aircraft. As and / or after the passengers leave the aircraft, an internal cabin of the aircraft is cleaned, such as by a cleaning staff. Further, luggage of the arriving passengers is removed from a luggage area of the aircraft. The aircraft is refueled for the next flight. A catering service removes used utensils and the like, and also resupplies the aircraft with food and drink items for the next flight. A flight crew for the arriving flight may depart the aircraft. A new flight crew for the next flight may board the aircraft. Additionally, a second set of passengers that is to depart from the airport aboard the aircraft boards the aircraft.

[0005] Typically, aircraft operators are not aware of all the details of progress of a turnaround process. In particular, while an aircraft operator is aware when an aircraft arrives at a gate, and when the aircraft leaves the gate, in order to determine a status of a particular turnaround services, the operator makes a series of phone calls between a ground operations center, airline dispatch, pilots, ramp agents, service companies, airport control offices, and / or the like As can be appreciated, the process of gaining situational awareness of a turnaround process may be tedious and time-consuming.

[0006] US 2018 / 0229856 A1 states, according to its abstract, in one example, a computing system to monitor aircraft operational parameters during turnaround of an aircraft is disclosed. The computing system may include at least one processor, and memory coupled to the at least one processor. The memory may include an analytics module to obtain at least one aircraft operational parameter during turnaround of an aircraft from an aircraft on-board system, analyze the at least one aircraft operational parameter related to the turnaround with respect to a threshold value or a range of threshold values, and generate an alert based on the analysis of the at least one obtained aircraft operational parameter.

[0007] WO 2012 / 110046 A1 states, according to its abstract, it's disclosure relates to a device for monitoring and controlling traffic guidance at an airport, comprising a database unit, a data processing unit, an input unit, a memory and an output unit, the device comprising a plurality of data acquisition sites, distributed across the airport area, for acquiring real-time data, at least one airport database for supplying flight-relevant master data and a conversion unit for converting received data, the data processing unit being designed to link received data and the output unit being equipped to display selected data in real time. It's disclosure further relates to a method for monitoring and controlling traffic guidance at an airport using said device.

[0008] US 2016 / 0247101 A1 states, according to its abstract, a system and method for aircraft cabin activity management occurring during turnaround using video analytics are disclosed. In one embodiment, real-time video feed of the aircraft cabin activities is obtained during the turnaround from at least one video camera disposed in an aircraft cabin. Further, aircraft cabin activity time stamps and progress associated with one or more aircraft cabin activities are determined by applying video analytics on the obtained video feed. Furthermore, the aircraft cabin activities are managed using the determined aircraft cabin activity time stamps and the progress associated with the one or more aircraft cabin activities.

[0009] EP 2 950 250 A1 states, according to its abstract, a system and method for providing an aircraft turnaround schedule are disclosed. In one embodiment, a time taken for each aircraft turnaround activity is obtained from touchdown to takeoff of an aircraft from an aircraft on-board system by a ground station system. Further, the aircraft turnaround schedule is computed based on the obtained time taken for each aircraft turnaround activity using a dynamic buffer management approach by the ground station system.

[0010] US 10,089,891 B2 states, according to its abstract, a system for monitoring scheduled turnaround activities and alerting on time deviation from the scheduled turnaround activities is disclosed. The system includes a ground computing station system, an aircraft on-board system, a cloud, and user interface. The cloud is communicatively coupled to the ground station computing system and the aircraft onboard system. The cloud includes processor and memory. The memory includes an analytics module to obtain actual start and end time stamps associated with scheduled turnaround activities, from touchdown to takeoff of an aircraft, from aircraft on-board systems and a ground station system. The analytics module to determine time deviation of scheduled turnaround activities by analyzing the obtained actual start and end time stamps. The user interface to present each scheduled turnaround activity and determined time deviation of the scheduled turnaround activities.

[0011] EP 3 270 336 A1 states, according to its abstract, methods, devices, and systems for generating an aircraft turnaround and airport terminal status analysis are described herein. One device includes a memory, and a processor configured to execute executable instructions stored in the memory to receive flight information and airport terminal information associated with an airport, generate an aircraft turnaround analysis based on the flight information and the airport terminal information, and a user interface to display the aircraft turnaround analysis in a single integrated display. One device includes a memory, and a processor configured to execute executable instructions stored in the memory to receive airport terminal information associated with an airport, generate an airport terminal status analysis based on the airport terminal information, and a user interface to display the airport terminal status analysis in a single integrated display.SUMMARY OF THE DISCLOSURE

[0012] A need exists for a system and a method for efficiently determining situational awareness of an aircraft turnaround process. Further, a need exists for a system and a method for automatically analyzing a turnaround process. Moreover, a need exists for a system and a method for gaining situational awareness of a turnaround process without requiring an individual to make a series of calls to other individuals within an airport and / or on an aircraft.

[0013] With those needs in mind, an aspect of the subject disclosure provides a turnaround monitoring system according to appended claim 1.

[0014] The camera(s) may include at least one camera on or within the aircraft. In at least one example, the camera(s) include one or more cabin cameras that are configured to capture and output images within the internal cabin, one or more tail cameras mounted on a tail of the aircraft that are configured to capture and output images outside of the aircraft, one or more stabilizer cameras mounted on one or more stabilizers of the aircraft that are configured to capture and output images outside of the aircraft, one or more belly cameras mounted on a belly or underside of a fuselage of the aircraft that are configured to capture and output images outside of the aircraft, and / or one or more wing cameras mounted on one more wings of the aircraft that are configured to capture and output images outside of the aircraft.

[0015] The sensor(s) may include one or more fuel sensors that are configured to detect an amount of fuel within one or more fuel tanks of the aircraft. The sensor(s) may include one or more door sensors that are configured to detect a position of one or more doors of the aircraft.

[0016] In at least one example, the turnaround data includes information including passenger information, and crew. In at least one example, the turnaround status includes information regarding passengers disembarking and boarding the aircraft, luggage removed from and boarded onto the aircraft, catering, fueling of the aircraft, cleaning of an internal cabin of the aircraft, and crew status.

[0017] The turnaround monitoring system may also include a gate computer at a gate of the airport. The turnaround analysis control unit is in communication with the gate computer. The gate computer outputs the turnaround data to the turnaround analysis control unit.

[0018] The turnaround monitoring system may also include a flight computer of the aircraft. The turnaround analysis control unit is in communication with the flight computer. The flight computer outputs the turnaround data to the turnaround analysis control unit.

[0019] In at least one example, the turnaround monitoring system also includes a display in communication with the turnaround analysis control unit (and optionally the turnaround prediction control unit). The turnaround analysis control unit shows the turnaround status on the display.

[0020] In at least one example, the turnaround analysis control unit includes a passenger analysis module, a luggage analysis module, a catering analysis module, a fueling analysis module, a cleaning analysis module, and a crew analysis module.

[0021] Another aspect of the subject disclosure provides a turnaround monitoring method according to appended claim 12.

[0022] The turnaround monitoring method may also include communicatively coupling a gate computer with the turnaround analysis control unit, and outputting the turnaround data from the gate computer. The receiving includes receiving the turnaround data output by the gate computer.

[0023] The turnaround monitoring method may also include communicatively coupling a flight computer of the aircraft with the turnaround analysis control unit, and outputting the turnaround data from the flight computer. The receiving includes receiving the turnaround data output by the flight computer.BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 is a schematic block diagram of an aircraft turnaround monitoring system, according to an example of the subject disclosure. Figure 2 is a diagrammatic representation of catering vehicles proximate to the aircraft, according to an example of the subject disclosure. Figure 3 is a diagrammatic representation of a display, according to an example of the subject disclosure. Figure 4 is a diagrammatic representation of the aircraft as imaged by a tail camera, according to an example of the subject disclosure. Figure 5 is a diagrammatic representation of the aircraft as imaged by cameras of the aircraft, according to an example of the subject disclosure. Figure 6 is a diagrammatic representation of an internal cabin of an aircraft as imaged by cabin cameras, according to an example of the subject disclosure. Figure 7 is a diagrammatic representation of a display showing turnaround status aspects, according to an example of the subject disclosure. Figure 8 is a diagrammatic representation of a front perspective view of the aircraft, according to an exemplary example of the subject disclosure. Figure 9 illustrates a flow chart of a turnaround monitoring method that is configured to monitor a turnaround of an aircraft at an airport, according to an example of the subject disclosure. DETAILED DESCRIPTION OF THE DISCLOSURE

[0025] The foregoing summary, as well as the following detailed description of certain examples will be better understood when read in conjunction with the appended drawings. As used herein, an element or step recited in the singular and preceded by the word "a" or "an" should be understood as not necessarily excluding the plural of the elements or steps. Further, references to "one embodiment" are not intended to be interpreted as excluding the existence of additional embodiments that also incorporate the recited features. Moreover, unless explicitly stated to the contrary, embodiments "comprising" or "having" an element or a plurality of elements having a particular condition may include additional elements not having that condition.

[0026] Certain examples of the subject disclosure provide aircraft turnaround monitoring systems and methods that are configured to automatically monitor and report an aircraft turnaround process. In at least one example, one or more images (such as a video feed) from aircraft-mounted cameras and status information from different aircraft and ground equipment sensors are received at a turnaround analysis control unit. The images are processed, applying image recognition techniques to detect and track elements related to the turnaround process (for example, fuel, catering or bag trucks, gate bridge position, power, pneumatic or air conditioner auxiliary connections, individual bags or catering trolleys, passenger disembarking and boarding, and / or the like). Such information may be aggregated with aircraft and ground equipment sensor information, (for example, parking brake status, doors open / close position, fuel levels, and / or the like). The aircraft turnaround monitoring systems and methods are configured to analyze such information and report and predict turnaround milestones to pilots, the airline control center, airports, air traffic control, and / or any other interested subscribers.

[0027] The presently claimed invention provides a turnaround monitoring system that includes a turnaround analysis control unit that receives turnaround data from one or more cameras and one or more sensors and determines a turnaround status of an aircraft based on the turnaround data, according to appended claim 1.

[0028] According to the presently claimed invention, the turnaround monitoring system also includes a turnaround prediction control unit that predicts a time of completion of the turnaround based on a comparison of the turnaround data and historical turnaround data. The turnaround data includes information indicative of luggage, and may additionally include information regarding various turnaround aspects, such as passenger information (for example, passengers disembarking from a first flight and passengers boarding a subsequent second flight), catering, fueling, cleaning, crew, and the like.

[0029] Figure 1 is a schematic block diagram of an aircraft turnaround monitoring system 100, according to an example of the subject disclosure. The aircraft turnaround monitoring system 100 is configured to monitor a turnaround of an aircraft 102 that lands at and departs from an airport 104. A turnaround for the aircraft relates to a time that the aircraft 102 on a first flight lands at the airport 104 and a time that the aircraft 102 subsequently departs from the airport 104 on a second flight.

[0030] The aircraft 102 includes an internal cabin 106. The internal cabin 106 includes a cockpit in which controls 108 and a flight computer 110 are located. The controls 108 and the flight computer 110 are used to control the aircraft 102 during a flight and on the ground. The flight computer 110 may also be used to input and output data, such as when passengers have disembarked, doors are opened and closed, and / or the like.

[0031] The aircraft 102 also includes a plurality of cameras 112 that are configured to capture and output images (such as still images and video feeds). The cameras 112 include one or more cabin cameras 112a that are configured to capture and output images within the internal cabin, one or more tail cameras 112b mounted on a tail of the aircraft 102 that are configured to capture and output images outside of the aircraft 102, one or more stabilizer cameras 112c mounted on one or more stabilizers of the aircraft 102 that are configured to capture and output images outside of the aircraft 102, one or more belly cameras 112d mounted on a belly or underside of a fuselage of the aircraft 102 that are configured to capture and output images outside of the aircraft 102, one or more wing cameras 112e mounted on one more wings of the aircraft 102 that are configured to capture and output images outside of the aircraft 102, and / or the like. In at least one example, the aircraft 102 includes more or less cameras 112 than shown. For example, the aircraft 102 may not include stabilizer cameras. As another example, the aircraft 102 may include cameras within a baggage and / or cargo area within the aircraft 102.

[0032] The aircraft 102 also includes a plurality of sensors 114 that are configured to sense different aspects. The sensors 114 includes one or more fuel sensor(s) 114a that are configured to detect an amount of fuel within one or more fuel tanks of the aircraft 102, one or more door sensors 114b that are configured to detect a position of one or more doors (such as between an open position and a closed position) of the aircraft 102, and / or the like. In at least one example, the aircraft 102 includes more or less sensors 114 than shown. For example, the aircraft may include weight sensors, baggage detection sensors, and / or the like.

[0033] After the aircraft 102 lands at the airport 104, the aircraft 102 taxis to a gate 116 of the airport 104. Passengers aboard the aircraft 102 disembark the aircraft 102 and pass into the airport 104 via the gate 116. The gate 116 includes a gate computer 118, which may be operated by a ramp agent, for example. The gate computer 118 is used to enter flight and passenger information, gate status, aircraft status (such as doors open or closed), and / or the like. Additionally, the gate 116 may include one or more gate cameras 120, which are used to capture and output images of the gate 116, the aircraft 102, and / or the like. Also, the airport 104 may include additional cameras that are not located at the gate 116.

[0034] The aircraft turnaround monitoring system 100 includes a turnaround analysis control unit 130 that is communicatively coupled with the flight computer 110, the cameras 112, the sensors 114, the gate computer 118, the gate camera(s) 120, and / or the like, such as through one or more wireless (or wired) connections. In at least one other example, the turnaround analysis control unit 130 is communicatively coupled with less than all of the flight computer 110, the cameras 112, the sensors 114, the gate computer 118, and the gate camera(s) 120. For example, the turnaround analysis control unit 130 may not be communicatively coupled to the gate computer 118 and / or the gate camera(s) 120.

[0035] In at least one example, the turnaround analysis control unit 130 is remotely located from the aircraft 102 and the gate 116. For example, the turnaround analysis control unit 130 may be at a central monitoring station, which may or may not be located at the airport 104. In at least one other example, the turnaround analysis control unit 130 is onboard the aircraft 102, such as within the internal cabin 106. In at least one other example, the turnaround analysis control unit 130 is at the gate 116.

[0036] The turnaround analysis control unit 130 is communicatively coupled to a display 132 (such as a television, computer monitor, touchscreen interface, handheld device such as a smart phone or tablet, and / or the like), such as through one or more wired or wireless connections. In at least one example, the display 132 is collocated with the turnaround analysis control unit 130, such as at a common workstation. Optionally, the display 132 is remotely located from the turnaround analysis control unit 130. For example, the display 132 may be onboard the aircraft 102, while the turnaround analysis control unit 130 is remotely located from the aircraft 102.

[0037] The turnaround analysis control unit 130 is also communicatively coupled to a turnaround prediction control unit 134, such as through one or more wired or wireless connections. In at least one example, the turnaround prediction control unit 134 is collocated with the turnaround analysis control unit 130, such as at a common workstation. The turnaround analysis control unit 130 and the turnaround prediction control unit 134 may be part of an integrated common processing system or control unit. In at least one other example, the turnaround analysis control unit 130 and the turnaround prediction control unit 134 are separated and distinct processing systems or control units. In at least one example, the turnaround analysis control unit 130 and the turnaround prediction control unit 134 are remotely located from one another.

[0038] The turnaround prediction control unit 134 is communicatively coupled to a turnaround database 136, such as through one or more wired or wireless connections. The turnaround prediction control unit 134 and the turnaround database 136 may be at a common location. Optionally, the turnaround database 136 may be remotely located from the turnaround prediction control unit 134. The turnaround database 136 stores historical turnaround data, such as turnaround data from past flights.

[0039] As shown, the turnaround analysis control unit 130 includes a passenger analysis module 138, a luggage analysis module 140, a catering analysis module 142, a fueling analysis module 144, a cleaning analysis module 146, a crew analysis module 148, and / or the like. The different modules may be separate portions of the turnaround analysis control unit 130. Optionally, the different modules may form a single, integrated processing system.

[0040] In operation, the turnaround analysis control unit 130 receives turnaround data from one or more of the flight computer 110, the cameras 112, the sensors 114, the gate computer 118, and / or the gate cameras 120. The turnaround analysis control unit 130 analyzes the turnaround data to determine turnaround status of the aircraft 102 between flights, such as information regarding passengers disembarking and boarding the aircraft 102, luggage removed from and boarded onto the aircraft 102, catering, fueling of the aircraft 102, cleaning of the internal cabin 106, crew status, and / or the like. In at least one example, the turnaround analysis control unit 130 outputs turnaround status data (indicative of the turnaround status) to the display 132, which shows the turnaround status to an individual.

[0041] In at least one example, the turnaround prediction control unit 134 receives the turnaround status data from the turnaround analysis control unit 130 and compares the turnaround status data with historical turnaround data stored in the turnaround database 136. By comparing the turnaround status data with the historical turnaround data, the turnaround prediction control unit 134 is able to predict a remaining time for various turnaround aspects. The turnaround prediction control unit 134 then outputs turnaround aspect prediction data to the display 132 (such as through one or more wired or wireless connections and / or via the turnaround analysis control unit 130) indicative of one or more turnaround aspect predictions, which are then shown on the display 132.

[0042] In at least one example, the flight computer 110 receives various turnaround aspects, which may be input by a pilot or other crew member. For example, turnaround aspects related to a number of passengers onboard the aircraft 102, whether passengers from a first flight have disembarked the aircraft 102, whether passengers for a subsequent second flight have boarded the aircraft 102, whether passenger doors are open or closed, and / or the like may be input into the flight computer 110 and output to the turnaround analysis control unit 130 as turnaround data. The turnaround data is received by the turnaround analysis control unit 130, which then analyzes the received turnaround data to determine a turnaround status related to such turnaround data. For example, the turnaround analysis control unit 130 (such as via the passenger analysis module 138) may determine the turnaround status related to passengers from a first flight disembarking the aircraft 102 and passengers for a second flight boarding the aircraft 102 through the turnaround data received from the flight computer 110. In at least one example, the turnaround analysis control unit 130 determines whether the passengers from the first flight have disembarked the aircraft 102 and whether the passengers for the second flight have boarded the aircraft 102 through the turnaround data received from the flight computer 110 and outputs the associated turnaround status data to the display 132, which may then show such turnaround status.

[0043] The turnaround prediction control unit 134 may compare the turnaround status data regarding the passengers and compare that with historical passenger data regarding disembarking and boarding stored within the turnaround database 136 to predict a remaining time for disembarking and / or boarding. The turnaround aspect prediction data regarding passengers disembarking and / or boarding is received by the display 132, which may then show an associated turnaround aspect prediction regarding such disembarking and / or boarding. For example, the turnaround database 136 may store historical data indicating that all passengers from a first flight should disembark within a certain time after landing and / or all passengers for a second flight should have board within a certain time after the first flight landed. The turnaround prediction control unit 134 may output an alert signal if the designated times stored in the turnaround database 136 have been surpassed without the passengers from the first flight having disembarked and / or the passengers for the second flight having boarded. The alert signal may be shown on the display 132 as a graphic and / or video message. As another example, the alert signal may be an audio signal broadcasted through a speaker.

[0044] In at least one example, the cameras capture images related to various turnaround aspects, such as those related to passengers disembarking and boarding the aircraft, luggage removed from and boarded onto the aircraft, catering, fueling, crew, and / or the like. The turnaround analysis control unit 130 may analyze the received image data to determine the status of various turnaround aspects.

[0045] One or more of the cameras 112 capture images related to passengers disembarking and boarding the aircraft 102 (such as via the cabin cameras 112a), the presence of luggage carts or vehicles (such as via one or more of the cameras 112b-112e), the presence of catering vehicles at a catering door of the aircraft 102 (such as via one or more of the cameras 112a-112e), the presence of a fueling truck proximate to the aircraft 102 (such as via one or more of the cameras 112a-112e), the presence of cleaning crew and / or vehicles proximate to the aircraft 102 (such as via one or more of the cameras 112a-112e), crew disembarking and / or boarding the aircraft 102 (such as via the cabin cameras 112(a)), and / or the like. The image data from the cameras 112 is received by the turnaround analysis control unit 130 as turnaround data.

[0046] For example, the turnaround analysis control unit 130, such as via the passenger analysis module 138, detects images of passengers leaving the aircraft 102 and determines passengers disembarking and / or boarding through image analysis. The turnaround analysis control unit 130 may know a passenger count for a first flight stored in memory and count the number of disembarking passengers in relation to the passenger count to determine whether all of the passengers from a first flight have disembarked. Similarly, the turnaround analysis control unit 130 may know a passenger count for a subsequent second flight stored in memory and count the number of boarding passengers in relation to the passenger count to determine whether all of the passengers for the second flight have boarded. As another example, the passenger analysis module 138 may determine that passengers have disembarked and / or boarded by monitoring a directional flow of passengers (either out of the aircraft 102 or onto the aircraft 102) and determine that the passengers have disembarked and / or boarded after a threshold time of no additional motion out of the aircraft and / or onto the aircraft. In at least one other example, passenger disembarking and / or boarding status is determined by the passenger analysis module 138 through the image data received from the cabin camera(s) 112a and data input into the flight computer 110, as described above. Also, as described above, the turnaround prediction control unit 134 may compare the turnaround status data regarding the passengers and compare that with historical passenger data regarding disembarking and boarding stored within the turnaround database 136 to predict a remaining time for disembarking and / or boarding.

[0047] As another example, the turnaround analysis control unit 130, via the passenger analysis module 138, detects passengers disembarking and boarding times through passenger doors being opened and closed via the door sensors 114b. For example, the passenger analysis module 138 monitors a sequence of doors opening and closing, via the door sensor(s) 114b, to determine whether passengers from a first flight have disembarked and passengers for a subsequent second flight have boarded.

[0048] The turnaround analysis control unit 130, such as via the crew analysis module 148, may monitor crew disembarking and / or boarding the aircraft 102 in a similar manner as with passengers. In at least one example, crew information may be input into the flight computer 110 and / or the gate computer 118 and received by the turnaround analysis control unit 130 and analyzed.

[0049] According to the presently claimed invention, the turnaround analysis control unit 130, such as via the luggage analysis module 140, detects images of luggage vehicles proximate to the luggage areas of the aircraft 102 and determines luggage removal and boarding through image analysis. According to the presently claimed invention, the turnaround analysis control unit 130 detects the presence of the luggage vehicle(s) through image analysis, such as via unique aspects of the luggage vehicle(s), distinguishing indicia thereof, and / or the like. For example, the luggage analysis module 140 may determine that luggage from a first flight has been removed from the aircraft 102 by detecting that a first set of luggage vehicles approaches and subsequently leaves the aircraft 102 over a first time frame. Similarly, the luggage analysis module 140 may determine that luggage for a second flight has been boarded onto the aircraft 102 by detecting that a second set of luggage vehicles approaches and subsequently leaves the aircraft 102 over a second time frame.

[0050] The turnaround prediction control unit 134 may compare the turnaround status data regarding the luggage and compare that with historical luggage data regarding removal and boarding stored within the turnaround database 136 to predict a remaining time for luggage removal and boarding. The turnaround prediction control unit 134 may output an alert signal if designated luggage times stored in the turnaround database 136 have been surpassed without the luggage from the first flight having been removed and / or the luggage for the second flight being boarded. The alert signal may be shown on the display 132 as a graphic and / or video message. As another example, the alert signal may be an audio signal broadcasted through a speaker.

[0051] As another example, the turnaround analysis control unit 130, such as via the catering analysis module 142, detects images of catering vehicles proximate to the aircraft 102 (such as at catering doors) and determines catering service time through image analysis. In at least one example, the turnaround analysis control unit 130 detects the presence of catering vehicles through image analysis, such as via unique aspects of the catering vehicle(s), distinguishing indicia thereof, and / or the like. For example, the catering analysis module 142 may determine that catering service time is completed by detecting that the catering vehicle approaches and subsequently leaves the aircraft 102.

[0052] The turnaround prediction control unit 134 may compare the turnaround status data regarding the catering service time and compare that with historical catering service data stored within the turnaround database 136 to predict a remaining time for catering service time. The turnaround prediction control unit 134 may output an alert signal if designated catering service time stored in the turnaround database 136 has been surpassed without the current catering service being completed. The alert signal may be shown on the display 132 as a graphic and / or video message. As another example, the alert signal may be an audio signal broadcasted through a speaker.

[0053] As a further example, the turnaround analysis control unit 130, such as via the fueling analysis module 144, detects images of fueling vehicles proximate to the aircraft 102 (such proximate fueling locations) and determines fueling time through image analysis. In at least one example, the turnaround analysis control unit 130 detects the presence of fueling vehicles through image analysis, such as via unique aspects of the fueling vehicle(s), distinguishing indicia thereof, and / or the like. For example, the fueling analysis module 144 may determine that fueling time is completed by detecting that the fueling vehicle approaches and subsequently leaves the aircraft 102.

[0054] As another example, the turnaround analysis control unit 130, via the fuel analysis module 144, detects fueling time through fueling data output by the fuel sensor(s) 114a of the aircraft 102. For example, the fuel analysis module 144 monitors a fuel level in relation to a final fuel amount to be supplied to the aircraft 102 through turnaround data output as fuel data by the fuel sensor(s) 114a.

[0055] The turnaround prediction control unit 134 may compare the turnaround status data regarding the fueling time and compare that with historical fueling data stored within the turnaround database 136 to predict a remaining time for fueling. The turnaround prediction control unit 134 may output an alert signal if designated fueling time stored in the turnaround database 136 has been surpassed without the current fueling being completed. The alert signal may be shown on the display 132 as a graphic and / or video message. As another example, the alert signal may be an audio signal broadcasted through a speaker.

[0056] In at least one exemplary example, the turnaround analysis control unit 130, such as via the cleaning analysis module 146, detects images of cleaning carts within the aircraft 102 and determines cleaning time through image analysis. In at least one example, the turnaround analysis control unit 130 detects the presence of the cleaning carts through image analysis, such as via unique aspects of the cleaning cart(s), distinguishing indicia thereof, and / or the like. For example, the cleaning analysis module 146 may determine that cleaning time is completed by detecting that the cleaning cart(s) is moved into the aircraft 102 and subsequently leaves the aircraft 102. As another example, the turnaround analysis control unit 130, via the cleaning analysis module 146, detects cleaning time through cleaning data output from the flight computer 110 (such as entered by crew) and / or the gate computer 118 (such as entered by a ramp agent).

[0057] The turnaround prediction control unit 134 may compare the turnaround status data regarding the cleaning time with historical cleaning data stored within the turnaround database 136 to predict a remaining time for cleaning. The turnaround prediction control unit 134 may output an alert signal if designated cleaning time stored in the turnaround database 136 has been surpassed without the current cleaning being completed. The alert signal may be shown on the display 132 as a graphic and / or video message. As another example, the alert signal may be an audio signal broadcasted through a speaker.

[0058] The gate camera(s) 120 or other airport cameras may also be used to capture images of passengers, luggage vehicles, catering vehicles, fueling vehicles, cleaning carts, crew, and / or the like, similar to the cameras 112 of the aircraft 102. The turnaround analysis control unit 130 may receive image data from the gate camera(s) 120 or other airport cameras to analyze the various turnaround aspects, as described above. Nevertheless, using the cameras 112, sensors 114, and / or the flight computer 110 of the aircraft 102 to output turnaround data to the turnaround analysis control unit 130 allows for aircraft-independent analysis of turnaround aspects, instead of relying on separate and distinct components data capturing devices outside of the aircraft 102.

[0059] As used herein, the term "control unit," "central processing unit," "unit," "CPU," "computer," or the like may include any processor-based or microprocessor-based system including systems using microcontrollers, reduced instruction set computers (RISC), application specific integrated circuits (ASICs), logic circuits, and any other circuit or processor including hardware, software, or a combination thereof capable of executing the functions described herein. Such are exemplary only, and are thus not intended to limit in any way the definition and / or meaning of such terms. For example, the turnaround analysis control unit 130 and the turnaround prediction control unit 134 may be or include one or more processors that are configured to control operation thereof, as described herein.

[0060] The turnaround analysis control unit 130 and the turnaround prediction control unit 134 are configured to execute a set of instructions that are stored in one or more data storage units or elements (such as one or more memories), in order to process data. For example, the turnaround analysis control unit 130 and the turnaround prediction control unit 134 may include or be coupled to one or more memories. The data storage units may also store data or other information as desired or needed. The data storage units may be in the form of an information source or a physical memory element within a processing machine.

[0061] The set of instructions may include various commands that instruct the turnaround analysis control unit 130 and the turnaround prediction control unit 134 as a processing machine to perform specific operations such as the methods and processes of the various examples of the subject matter described herein. The set of instructions may be in the form of a software program. The software may be in various forms such as system software or application software. Further, the software may be in the form of a collection of separate programs, a program subset within a larger program or a portion of a program. The software may also include modular programming in the form of object-oriented programming. The processing of input data by the processing machine may be in response to user commands, or in response to results of previous processing, or in response to a request made by another processing machine.

[0062] The diagrams of examples herein may illustrate one or more control or processing units, such as the turnaround analysis control unit 130 and the turnaround prediction control unit 134. It is to be understood that the processing or control units may represent circuits, circuitry, or portions thereof that may be implemented as hardware with associated instructions (e.g., software stored on a tangible and non-transitory computer readable storage medium, such as a computer hard drive, ROM, RAM, or the like) that perform the operations described herein. The hardware may include state machine circuitry hardwired to perform the functions described herein. Optionally, the hardware may include electronic circuits that include and / or are connected to one or more logic-based devices, such as microprocessors, processors, controllers, or the like. Optionally, the turnaround analysis control unit 130 and the turnaround prediction control unit 134 may represent processing circuitry such as one or more of a field programmable gate array (FPGA), application specific integrated circuit (ASIC), microprocessor(s), and / or the like. The circuits in various examples may be configured to execute one or more algorithms to perform functions described herein. The one or more algorithms may include aspects of examples disclosed herein, whether or not expressly identified in a flowchart or a method.

[0063] As used herein, the terms "software" and "firmware" are interchangeable, and include any computer program stored in a data storage unit (for example, one or more memories) for execution by a computer, including RAM memory, ROM memory, EPROM memory, EEPROM memory, and non-volatile RAM (NVRAM) memory. The above data storage unit types are exemplary only, and are thus not limiting as to the types of memory usable for storage of a computer program.

[0064] Figure 2 is a diagrammatic representation of catering vehicles 200 proximate to the aircraft 102, according to an example of the subject disclosure. Referring to Figures 1 and 2, the catering vehicles 200 may be imaged by the cameras 112 of the aircraft 102 or the gate cameras 120 (as shown in Figure 1). In at least one example, the turnaround analysis control unit 130 detects the presence of the catering vehicles 200, luggage vehicles, fueling vehicles, cleaning carts, and / or the like using machine learning image recognition. For example, the turnaround analysis control unit 130 may be programmed to detect distinguishing features, shapes, indicia, and / or the like of such vehicles, carts, and / or the like.

[0065] Figure 3 is a diagrammatic representation of the display 132, according to an example of the subject disclosure. Referring to Figures 1 and 3, in at least one example, the display 132 maybe within the internal cabin 106, such as within a flight deck of the aircraft 102.

[0066] Figure 4 is a diagrammatic representation of the aircraft 102 as imaged by a tail camera 112b (shown in Figure 1), according to an example of the subject disclosure. Figure 5 is a diagrammatic representation of the aircraft 102 as imaged by cameras 112 of the aircraft 102, according to an example of the subject disclosure. Referring to Figures 1, 4, and 5, the aircraft 102 includes numerous cameras 112 (shown in Figure 1) that allow imaging of areas surrounding the aircraft 102.

[0067] Figure 6 is a diagrammatic representation of the internal cabin 106 of the aircraft 102 as imaged by cabin cameras 112a, according to an example of the subject disclosure. Referring to Figures 1 and 6, for example, the internal cabin 106 may be imaged via the cabin cameras 112a and showing a flight deck entrance and boarding door open.

[0068] Figure 7 is a diagrammatic representation of the display 132 showing turnaround status aspects 300, according to an example of the subject disclosure. The turnaround statust aspects 300 include passengers 302, luggage 304, fueling 306, cleaning 308, catering 310, and crew 312. Referring to Figures 1 and 7, the turnaround analysis control unit 130 determines a status of each of the aspects 300, as described above, and shows such status 330, including completed task bars 331 and uncompleted task bars 333, on the display 132. The turnaround analysis control unit 130 may also show a current turnaround time graphic 350 that indicates a time between landing 352 and scheduled departure 354.

[0069] Figure 8 is a diagrammatic representation of a front perspective view of the aircraft 102, according to an exemplary example of the subject disclosure. The aircraft 102 includes a propulsion system 412 that may include two turbofan engines 414, for example. Optionally, the propulsion system 412 may include more engines 414 than shown. The engines 414 are carried by wings 416 of the aircraft 102. In other examples, the engines 414 may be carried by a fuselage 418 and / or an empennage 420. The empennage 420 may also support horizontal stabilizers 422 and a vertical stabilizer 424. The fuselage 418 of the aircraft 102 defines an internal cabin, which may include a cockpit 430.

[0070] Cameras 112 are mounted to various portions of the aircraft 102. The aircraft 102 may include more or less cameras 112 at different locations than shown.

[0071] The aircraft 102 may be sized, shaped, and configured other than shown in Figure 8. For example, the aircraft 102 may be a non-fixed wing aircraft, such as a helicopter.

[0072] Figure 9 illustrates a flow chart of a turnaround monitoring method that is configured to monitor a turnaround of an aircraft at an airport, according to an example of the subject disclosure. Referring to Figures 1 and 9, the turnaround monitoring method includes receiving 500, by the turnaround analysis control unit 130, turnaround data regarding the aircraft 102 at the airport 104. The method also includes determining 502, by the turnaround analysis control unit 130, a turnaround status of the aircraft 102 based on the turnaround data.

[0073] In at least one example, the turnaround monitoring method includes communicatively coupling the camera(s) 112 with the turnaround analysis control unit 130, communicatively coupling the sensor(s) 114 with the turnaround analysis control unit 130, and outputting the turnaround data by the camera(s) 112 and the sensor(s) 114. In at least one example, the receiving 500 includes receiving the turnaround data that is output by the camera(s) 112 and the sensor(s) 114.

[0074] According to the presently claimed invention, the turnaround monitoring method also includes storing 504 historical turnaround data in a turnaround database 136, and predicting 506, by the turnaround prediction control unit 134, a time of completion of a current turnaround of the aircraft based on a comparison of the turnaround data and the historical turnaround data.

[0075] The turnaround monitoring method may also include communicatively coupling the gate computer 118 with the turnaround analysis control unit 130, and outputting the turnaround data from the gate computer 118. In at least one example, the receiving 500 includes receiving the turnaround data output by the gate computer 118.

[0076] The turnaround monitoring method may also include communicatively coupling the flight computer 110 of the aircraft 102 with the turnaround analysis control unit 130, and outputting the turnaround data from the flight computer 110. In at least one example, the receiving 500 includes receiving the turnaround data output by the flight computer 110.

[0077] Examples of the subject disclosure provide systems and methods that allow large amounts of data to be quickly and efficiently analyzed by a computing device. Large amounts of data are being tracked and analyzed. The vast amounts of data are efficiently organized and / or analyzed by the turnaround analysis control unit 130 and the turnaround prediction control unit 134, as described herein. The turnaround analysis control unit 130 and the turnaround prediction control unit 134 analyze the data in a relatively short time in order to quickly and efficiently output turnaround analysis and predictions. A human being would be incapable of efficiently analyzing such vast amounts of data in such a short time. As such, examples of the subject disclosure provide increased and efficient functionality with respect to prior computing systems, and vastly superior performance in relation to a human being analyzing the vast amounts of data. In short, examples of the subject disclosure provide systems and methods that analyze thousands, if not millions, of calculations and computations that a human being is incapable of efficiently, effectively and accurately managing.

[0078] As described herein, examples of the subject disclosure provide systems and methods for efficiently determining situational awareness of an aircraft turnaround process. Further, examples of the subject disclosure provide systems and methods for automatically analyzing a turnaround process. Moreover, examples of the subject disclosure provide systems and methods for gaining situational awareness of a turnaround process without requiring an individual to make a series of calls to other individuals within an airport and / or on an aircraft.

[0079] While various spatial and directional terms, such as top, bottom, lower, mid, lateral, horizontal, vertical, front and the like may be used to describe examples of the subject disclosure, it is understood that such terms are merely used with respect to the orientations shown in the drawings. The orientations may be inverted, rotated, or otherwise changed, such that an upper portion is a lower portion, and vice versa, horizontal becomes vertical, and the like.

[0080] As used herein, a structure, limitation, or element that is "configured to" perform a task or operation is particularly structurally formed, constructed, or adapted in a manner corresponding to the task or operation. For purposes of clarity and the avoidance of doubt, an object that is merely capable of being modified to perform the task or operation is not "configured to" perform the task or operation as used herein.

[0081] It is to be understood that the above description is intended to be illustrative, and not restrictive. For example, the above-described examples (and / or aspects thereof) may be used in combination with each other. In addition, many modifications may be made to adapt a particular situation or material to the teachings of the various examples of the disclosure, the scope of protection being defined by the appended claims. While the dimensions and types of materials described herein are intended to define the parameters of the various examples of the disclosure, the examples are by no means limiting and are exemplary examples. Many other examples will be apparent to those of skill in the art upon reviewing the above description. The scope of the various examples of the disclosure should, therefore, be determined with reference to the appended claims, along with the full scope of equivalents to which such claims are entitled. In the appended claims, the terms "including" and "in which" are used as the plain-English equivalents of the respective terms "comprising" and "wherein." Moreover, the terms "first," "second," and "third," etc. are used merely as labels, and are not intended to impose numerical requirements on their objects.

[0082] This written description uses examples to disclose the various examples of the disclosure, including the best mode, and also to enable any person skilled in the art to practice the various examples of the disclosure, including making and using any devices or systems and performing any incorporated methods..

Claims

1. A turnaround monitoring system that is configured to monitor a turnaround of an aircraft (102) at an airport (104), the turnaround monitoring system comprising: a turnaround analysis control unit (130) that receives turnaround data regarding the aircraft (102) at the airport (104) and determines a turnaround status of the aircraft (102) based on the turnaround data; a turnaround database (136) that stores historical turnaround data; a turnaround prediction control unit (134) that predicts a time of completion of the turnaround based on a comparison of the turnaround data and the historical turnaround data; one or more cameras (112, 112a-112e, 112b-112e); and one or more sensors (114), wherein the one or more cameras (112, 112a-112e, 112b-112e) and the one or more sensors (114) output the turnaround data regarding the aircraft (102), wherein the turnaround analysis control unit (130) is in communication with the one or more cameras (112, 112a-112e, 112b-112e) and the one more sensors (114), wherein the turnaround analysis control unit (130) receives the turnaround data from the one or more cameras (112, 112a-112e, 112b-112e) and the one or more sensors (114), wherein the one or more cameras (112, 112a-112e, 112b-112e) are configured to capture images related to the presence of luggage carts or vehicles, and wherein the turnaround data includes information indicative of luggage (304), wherein the turnaround status comprises information regarding luggage (304) removed from and boarded onto the aircraft (102), wherein the turnaround analysis control unit (130) is configured to detect images of luggage vehicles proximate to luggage areas of the aircraft (102) and determine luggage removal and boarding through image analysis.

2. The turnaround monitoring system of claim 1, wherein the one or more cameras (112, 112a-112e, 112b-112e) comprise at least one camera on the aircraft (102), or within the aircraft (102), or at the airport (104).

3. The turnaround monitoring system of claim 1 or 2, wherein the one or more cameras (112, 112a-112e, 112b-112e) comprise one or more of: one or more cabin cameras (112, 112a-112e, 112b-112e) that are configured to capture and output images within an internal cabin (106); one or more tail cameras (112, 112a-112e, 112b-112e) mounted on a tail of the aircraft (102) that are configured to capture and output images outside of the aircraft (102); one or more stabilizer cameras (112, 112a-112e, 112b-112e) mounted on one or more stabilizers of the aircraft (102) that are configured to capture and output images outside of the aircraft (102); one or more belly cameras (112, 112a-112e, 112b-112e) (112d) mounted on a belly or underside of a fuselage (418) of the aircraft (102) that are configured to capture and output images outside of the aircraft (102); or one or more wing cameras (112, 112a-112e, 112b-112e) mounted on one more wings (416) of the aircraft (102) that are configured to capture and output images outside of the aircraft (102).

4. The turnaround monitoring system of claim 1, 2 or 3, wherein the one or more sensors (114) comprise one or more fuel sensors (114) that are configured to detect an amount of fuel within one or more fuel tanks of the aircraft (102).

5. The turnaround monitoring system of any of claims 1-4, wherein the one or more sensors (114) comprise one or more door sensors (114, 114b) that are configured to detect a position of one or more doors of the aircraft (102).

6. The turnaround monitoring system of any of claims 1-5, wherein the turnaround data includes information indicative of at least one of passenger information, catering (310), fueling (306), cleaning (308), or crew (312).

7. The turnaround monitoring system of any of claims 1-6, wherein the turnaround status comprises information regarding at least one of passengers (302) disembarking and boarding the aircraft (102), catering (310), fueling (306) of the aircraft (102), cleaning (308) of an internal cabin (106) of the aircraft (102), or crew (312) status.

8. The turnaround monitoring system of any of claims 1-7, further comprising a display (132) in communication with the turnaround analysis control unit (130), wherein the turnaround analysis control unit (130) shows the turnaround status on the display (132).

9. The turnaround monitoring system of any of claims 1-8, further comprising at least one of: a passenger analysis module (138, 144); a luggage (304) analysis module (144); a catering (310) analysis module (144); a fueling (306) analysis module (144); a cleaning (308) analysis module (144); or a crew (312) analysis module (144).

10. The turnaround monitoring system of any of claims 1-9, further comprising a gate (116) computer at a gate (116) of the airport (104), wherein the turnaround analysis control unit (130) is in communication with the gate (116) computer, and wherein the gate (116) computer outputs the turnaround data to the turnaround analysis control unit (130).

11. The turnaround monitoring system of any of claims 1-10, further comprising a flight computer (110) of the aircraft (102), wherein the turnaround analysis control unit (130) is in communication with the flight computer (110), and wherein the flight computer (110) outputs the turnaround data to the turnaround analysis control unit (130).

12. A turnaround monitoring method that is configured to monitor a turnaround of an aircraft (102) at an airport (104), the turnaround monitoring method comprising: receiving (500), by a turnaround analysis control unit (130), turnaround data regarding the aircraft (102) at the airport (104); determining (502), by the turnaround analysis control unit (130), a turnaround status of the aircraft (102) based on the turnaround data; storing (504) historical turnaround data in a turnaround database (136); predicting (506), by a turnaround prediction control unit (134), a time of completion of the turnaround based on a comparison of the turnaround data and the historical turnaround data; communicatively coupling one or more cameras (112, 112a-112e, 112b-112e) with the turnaround analysis control unit (130); communicatively coupling one or more sensors (114) with the turnaround analysis control unit (130); and outputting the turnaround data by the one or more cameras (112, 112a-112e, 112b-112e) and the one or more sensors (114), wherein the receiving (500) comprises receiving (500) the turnaround data that is output by the one or more cameras (112, 112a-112e, 112b-112e) and the one or more sensors (114), wherein the one or more cameras (112, 112a-112e, 112b-112e) are configured to capture images related to the presence of luggage carts or vehicles, and wherein the turnaround data includes information indicative of luggage (304), wherein the turnaround status comprises information regarding luggage (304) removed from and boarded onto the aircraft (102), wherein the turnaround analysis control unit (130) detects images of luggage vehicles proximate to luggage areas of the aircraft (102) and determines luggage removal and boarding through image analysis.

13. The turnaround monitoring method of claim 12, wherein the turnaround data includes information including passenger information, catering (310), fueling (306), cleaning (308), and crew (312).

14. The turnaround monitoring method of claim 12 or 13, further comprising: communicatively coupling a gate (116) computer with the turnaround analysis control unit (130); and outputting the turnaround data from the gate (116) computer, wherein the receiving (500) comprises receiving (500) the turnaround data output by the gate (116) computer.

15. The turnaround monitoring method of any of claims 12-14, further comprising: communicatively coupling a flight computer (110) of the aircraft (102) with the turnaround analysis control unit (130); and outputting the turnaround data from the flight computer (110), wherein the receiving (500) comprises receiving (500) the turnaround data output by the flight computer (110).