System and method for monitoring the storage of carry-on baggage in overhead compartments of an aircraft.

Abstract

To provide a system of monitoring carry-ons for a flight of an aircraft.SOLUTION: The system includes: one or more cameras positioned to capture images of carry-ons associated with passengers of an aircraft; an interface configured to receive image data from the one or more cameras; and one or more processors coupled to the interface; The one or more processors are configured to analyze the image data to determine characteristics of a carry-on. The one or more processors are configured to determine that one or more alert conditions are satisfied based on a comparison of one or more alert criteria to the characteristics of the carry-on and data associated with the aircraft. The one or more processors are also configured to transmit, to one or more devices, an output based on satisfaction of the one or more alert conditions.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure generally relates to monitoring the storage of carry-on luggage in an aircraft's storage bin.

Background Art

[0002] Many airlines permit passengers on an aircraft to have carry-on luggage stowed in the aircraft's storage bins (e.g., overhead bins) and one piece of personal luggage (e.g., a handbag, briefcase, laptop bag, etc.) stowed under the seat in front of the passenger. Airlines may impose size restrictions for carry-on luggage in order to enable proper operation of the storage bins and to enable each passenger to load carry-on luggage onto the aircraft. For example, one airline has a size restriction for carry-on luggage of 22 inches × 14 inches × 9 inches. Other airlines may impose different size restrictions. One or more passengers with oversized carry-on luggage, or carry-on luggage in an improper orientation within the storage bin, personal luggage that could be placed where carry-on luggage is supposed to be within the storage bin, or combinations thereof, can cause the passageway to be blocked or boarding to be delayed during boarding. The storage space within the storage bins often fills up for a flight, which may consequently require tagging one or more carry-on luggage associated with some of the passengers on the aircraft and storing it with the checked luggage.

Summary of the Invention

[0003] In a particular implementation, a system for monitoring carry-on baggage for an aircraft flight comprises one or more cameras positioned to capture images of carry-on baggage associated with aircraft passengers. The system comprises an interface configured to receive image data from one or more cameras. The system also comprises one or more processors connected to the interface. One or more processors are configured to analyze the image data to determine the characteristics of the carry-on baggage. One or more processors are configured to determine if one or more alert conditions are met based on a comparison of one or more alert criteria with the characteristics of the carry-on baggage and data associated with the aircraft. One or more processors are also configured to send outputs to one or more devices based on the meeting of one or more alert conditions.

[0004] In a particular implementation, a method for monitoring carry-on baggage for an aircraft flight includes a monitoring device receiving image data from cameras mounted on the aircraft. At least a portion of the cameras are positioned to capture images of the inside of the aircraft's overhead compartments. The method includes the monitoring device analyzing the image data to determine first information, which includes the characteristics of the baggage in each compartment and the available storage space in each compartment. The method includes the monitoring device determining that one or more alert conditions are met based on a comparison of one or more alert criteria with the first information. The method also includes transmitting outputs from the monitoring device to one or more devices based on the meeting of one or more alert conditions.

[0005] In a particular implementation, a method for monitoring carry-on baggage for an aircraft flight includes a monitoring device receiving image data from one or more cameras within the aircraft's boarding area. The one or more cameras are positioned to capture images of carry-on baggage associated with passengers preparing to board the aircraft. The method includes the monitoring device analyzing the image data to determine the characteristics of the carry-on baggage associated with the passengers. The method also includes the monitoring device determining that one or more alert conditions have been met based on one or more alert criteria and a comparison with the characteristics of the carry-on baggage and data associated with the aircraft. The method also includes transmitting outputs to one or more devices based on the meeting of one or more alert conditions.

[0006] The features, functions, and benefits described herein can be implemented individually in various embodiments or in combination in yet another embodiment. Further details can be understood by referring to the following specification and accompanying drawings. [Brief explanation of the drawing]

[0007] [Figure 1] This diagram shows a system configured to monitor carry-on baggage for aircraft flights. [Figure 2] This diagram shows a flowchart of a first method for monitoring carry-on baggage for aircraft flights. [Figure 3] This diagram shows a flowchart illustrating how to monitor aircraft overhead compartments. [Figure 4] This diagram shows a flowchart of a second method for monitoring carry-on baggage for aircraft flights. [Figure 5] This flowchart shows the lifespan of an aircraft configured to monitor the storage of carry-on baggage in the aircraft's overhead compartments. [Figure 6] This is a diagram of an aircraft configured to monitor the storage of carry-on baggage in the overhead compartments. [Figure 7] This is a block diagram of a computing environment including a computing device configured to support the computer-implemented methods and computer-executable program instructions (or code) related to this disclosure. [Modes for carrying out the invention]

[0008] Embodiments disclosed herein present systems and methods for monitoring the storage of carry-on baggage in overhead compartments of an aircraft.

[0009] In certain embodiments, a monitoring device analyzes image data from cameras inside the aircraft or in the aircraft's boarding area to detect luggage associated with aircraft passengers (e.g., personal belongings and carry-on baggage). Based on the analysis of the image data, the monitoring device can determine whether an alert condition is associated with one or more passengers. For example, the monitoring device can determine that a particular passenger has oversized carry-on baggage, too much luggage, or both. When the monitoring device detects an alert condition associated with a passenger, it issues an alert to the boarding staff or crew. Based on the alert, the boarding staff or crew can resolve the alert condition associated with the passenger.

[0010] In addition, the monitoring system tracks the number of carry-on bags permitted on the aircraft. Based on the aircraft's overhead compartment capacity and the number of carry-on bags permitted, the monitoring system can determine when to stop allowing additional carry-on bags on board, and can also send alerts to boarding staff or crew indicating whether the additional carry-on bags should be tagged and stored with checked baggage, or whether other actions should be taken to determine how many more passengers can load their carry-on bags onto the aircraft.

[0011] In a particular embodiment, the monitoring device analyzes image data from cameras mounted on the aircraft. At least a portion of the cameras are positioned to capture images of the interior of the aircraft's overhead compartments. Based on the analysis of the image data, the monitoring device determines the state associated with each compartment. For example, based on the compartment image data, the monitoring device can determine whether space is available in the compartment for one or more additional pieces of luggage, whether the compartment is full, whether additional space can be created in the compartment by moving or reorienting one or more pieces of luggage, whether luggage is stored in a prohibited position, whether one or more pieces of luggage could prevent the compartment from closing, and so on. For each compartment, the monitoring device transmits a signal to the status display device associated with the compartment, causing the status display device to display a specific status indicator (e.g., a color code) to indicate the state associated with the compartment during the boarding process. In addition, the monitoring device can transmit information regarding the state of each compartment to the aircraft crew and their associated portable devices. The crew can then address any issues detected by the monitoring device.

[0012] In addition, the monitoring device can transmit information about the remaining storage space in the overhead compartments to a device associated with the crew. The information transmitted to the crew allows them to alert remaining passengers that, when there is no more space available for carry-on baggage, one or more passengers may need to tag their carry-on baggage and store it together with their checked baggage. The information also allows the crew to indicate when they should stop allowing additional carry-on baggage onto the aircraft.

[0013] In other specific embodiments, the monitoring device may receive image data from a first set of cameras in the boarding area and a second set of cameras mounted on the aircraft. When one or more alert conditions are determined for luggage associated with a passenger in the boarding area, the monitoring device transmits an output to one or more devices associated with the crew to enable the crew to clear the alert conditions. The monitoring device may also monitor overhead compartments in the aircraft based on image data from the second set of cameras and provide information regarding the status of each compartment to a status display device for the compartments and to devices associated with the aircraft crew.

[0014] Image data from the boarding area, information determined from the image data from the boarding area, image data from the aircraft, and information determined from the image data from the aircraft may be stored in the database. If a problem occurs with a passenger before the aircraft takes off (for example, a passenger disembarks before takeoff) or with luggage associated with a passenger (for example, carry-on luggage is left on the aircraft after it has reached its destination), it is possible to access and analyze the information in the database to resolve the problem. For example, if a passenger disembarks before the flight takes off, it is possible to access the information in the database to ensure that luggage associated with the passenger is moved from the aircraft before takeoff.

[0015] Specific and exemplary embodiments are shown by the drawings and the following description. Those skilled in the art will recognize that, even if not expressly described or illustrated herein, various configurations embodying the principles described herein and included in the claims described thereafter in the specification can be devised. Furthermore, any embodiments described herein should be understood to be for the purpose of aiding the understanding of the principles of this disclosure and not as limitations. Consequently, this disclosure is limited by the claims and their equivalents, but not by the specific embodiments or examples described below.

[0016] This specification describes specific implementations with reference to the drawings. Throughout the description, common features are given a common reference number. In this specification, various terms are used solely to describe specific implementations and are not intended to be limiting. For example, the singular forms “a, an” and “the” are intended to include the plural unless the context clearly indicates otherwise. Furthermore, some features described herein are singular in some implementations and plural in others. As illustrated, Figure 1 shows a monitoring device 108 comprising one or more processors (the “processor” 140 in Figure 1), indicating that in some implementations the monitoring device 108 includes a single processor 140, while in other implementations the monitoring device 108 includes multiple processors 140. For ease of reference in this specification, such features are generally introduced as “one or more” features and thereafter referred to as singular unless embodiments relating to multiple features are described.

[0017] Furthermore, the terms “comprise,” “comprises,” and “comprising” are interchangeable with “include,” “includes,” and “including.” Furthermore, the terms “wherein” are interchangeable with “where.” In this specification, the term “exemplary” indicates an implementation and / or manner, and should not be construed as limiting or indicating a preferred or desirable implementation. In this specification, ordinal terms modifying elements such as structure, components, and actions (e.g., “first,” “second,” “third,” etc.) do not in themselves indicate any priority or order of the element above other elements, but merely distinguish other elements with the same name (apart from the use of ordinal terms). In this specification, the term “set” refers to a grouping of one or more elements, and the term “plurality” refers to multiple elements.

[0018] In this specification, the terms “generating,” “calculating,” “using,” “selecting,” “accessing,” and “determining” are interchangeable unless the context indicates otherwise. For example, “generating,” “calculating,” or “determining” a parameter (or signal) may mean actively generating, calculating, or determining the parameter (or signal), or using, selecting, or accessing a parameter (or signal) that has already been generated by another component or device. In this specification, the expression “coupled” may include, and (or alternatively) any combination thereof, “communicatively coupled,” “electrically coupled,” or “physically coupled.” Two devices (or components) may be directly or indirectly connected (communicatively coupled, electrically coupled, or physically coupled) via one or more other devices, components, wires, buses, networks (e.g., wired networks, wireless networks, or a combination thereof). Two electrically connected devices (or components) may be the same device or different devices and may be connected via electronic equipment, one or more connectors, or inductive coupling, in exemplary, non-limiting embodiments. In some realizations, two devices (or components) that are commutably connected, such as by telecommunications, may send and receive electrical signals (digital or analog signals) directly or indirectly via one or more wires, buses, networks, etc. In this specification, the expression “directly coupled” is used to describe two devices that are connected without the interposition of components (e.g., commutably connected, electrically connected, or physically connected).

[0019] In the following specification, various functions are described as being performed by a particular component or module. However, the above distribution to components and modules is for illustrative purposes only. In an alternative embodiment, functions described herein as being performed by a particular component or module may be divided among multiple components or modules. Furthermore, in an alternative embodiment, two or more components or modules described as separate entities may be integrated into a single component or module. Components or modules of electronic equipment may be implemented using hardware (e.g., field-programmable gate array (FPGA) devices, application-specific integrated circuits (ASICs), digital signal processors (DSPs), controllers, etc.), software (e.g., instructions executable by the processor), or any combination thereof.

[0020] Figure 1 shows an example of a system 100 configured to monitor the storage of carry-on baggage 102 in overhead compartments 104 of an aircraft 106. The system 100 includes a monitoring device 108 that is communicatively connected to one or more electronic devices in the boarding area 110 of the aircraft 106 and communicatively connected to one or more electronic devices in the aircraft 106. The boarding area 110 may be part of an airport. The monitoring device 108 analyzes the baggage associated with the passengers of the aircraft 106 and, based on the analysis, provides output to one or more devices in the boarding area 110, one or more devices in the aircraft 106, or both.

[0021] In certain implementations, one or more electronic devices within boarding area 110 include a boarding pass scanning station 112 that includes a monitor 114 visible to boarding personnel, a first set of cameras 116, location markers 118, and a status display device 120. In other implementations, the one or more electronic devices include additional devices, different devices, fewer devices, or combinations thereof. The first set of cameras 116 are arranged to capture images of passengers and baggage associated with the passengers as the passengers approach and arrive at the boarding pass scanning station 112. In some implementations, the first set of cameras 116 includes one or more video cameras, one or more still cameras, one or more lidar cameras, other types of cameras, or combinations thereof.

[0022] The location markers 118 function as calibration references. For example, the location markers 118 are arranged such that each location marker 118 is within the field of view of one or more of the cameras of the first set of cameras 116. Additionally, the location of the location markers 118 may be known to or accessible by the monitoring device 108. From the image of a particular location marker 118 in the image data 122 from the first set of cameras 116, in combination with the location data, the monitoring device 108 can calculate the dimensions of baggage (e.g., carry-on baggage 102) within the boarding area 110 from the image data 122 and the location data.

[0023] The status display device 120 includes visual or auditory outputs (e.g., lights, buzzers, speakers, or displays) for alerting crew members who are processing passengers for boarding the aircraft 106. The status display device 120 is operated to indicate the status of passengers and their associated luggage based on outputs 124 received from the monitoring device 108. In one implementation, the status display device 120 generates a first alert based on outputs 124 (e.g., by displaying a light of a first color, generating a first sound, or both) when the monitoring device 108 determines that there are no problems with the passengers and their associated luggage; generates a second alert (e.g., by displaying a light of a second color, generating a second sound, or both) when the monitoring device 108 determines that there are problems with at least one piece of luggage associated with the passenger; and generates a third alert (e.g., by displaying a light of a third color, generating a third sound, or both) when the monitoring device 108 cannot determine whether there are problems with one or more pieces of luggage associated with the passenger. In other implementations, the status display device 120 generates other types of alerts, such as text alerts or images (for example, an image of carry-on luggage with a problem).

[0024] When the status display device 120 indicates that there is no problem with the luggage associated with the passenger, the boarding staff permits the passenger to proceed to the aircraft 106 after processing the passenger's boarding pass at the boarding pass scanning station 112. When the status display device 120 indicates that there is a problem with one or more pieces of luggage associated with the passenger, the output 124 transmitted by the monitoring device 108 includes a notification that causes the monitor 114 to display details related to the problem and selectable options for the boarding staff. The boarding staff can select a specific selectable option, and the selection of this specific selectable option indicates to the monitoring device 108 how the problem was resolved. For example, the monitoring device 108 can determine that two pieces of luggage are associated with a particular passenger and that the two pieces of luggage are of a size that is considered carry-on luggage 102. Since each passenger is only permitted to load one piece of carry-on luggage 102 onto the aircraft 106, the monitoring device 108 supplies an output 124 that sends a signal to the status display device 120 indicating that there is a problem and sends a notification to the monitor 114. This notification indicates that a particular passenger has two pieces of luggage considered carry-on luggage 102 and provides a first selectable option indicating that the particular passenger is permitted to load one piece of carry-on luggage 102 onto the aircraft 106 and a second selectable option indicating that the particular passenger is not permitted to load the carry-on luggage 102 onto the aircraft.

[0025] When the status display device 120 indicates that the monitoring device 108 cannot determine whether there is a problem with the luggage associated with a passenger, the monitoring device 108 sends output 124 to the monitor 114, which includes a notification containing selectable options indicating possible responses that the crew can take (e.g., allowing the passenger to board the aircraft 106 with one carry-on baggage 102, or allowing the passenger to board the aircraft 106 without carry-on baggage 102). The crew can visually inspect the luggage associated with the passenger to determine if there is a problem and take corresponding action. The crew can select the appropriate selectable option and continue boarding the remaining passengers. For example, if the location of a carry-on baggage associated with a particular passenger prevents the monitoring device 108 from determining from the image data 122 that the carry-on baggage is oversized, the monitoring device sends output 124, which includes a signal to the status display device 120 indicating that no determination was made regarding the carry-on baggage 102 associated with that passenger, and sends a notification to the monitor 114. This notification provides a first selectable option indicating that the monitoring device 108 was unable to determine whether the carry-on baggage 102 was oversized and that the passenger was permitted to board the aircraft 106 with the carry-on baggage 102, and a second selectable option indicating that the passenger was permitted to board the aircraft without the carry-on baggage 102. When the dimensions of the carry-on baggage 102 associated with a particular passenger are required for calculations performed by the monitoring device 108 (e.g., determining the available storage space in the overhead compartment 104), the monitoring device 108 sets an uncertain dimension to maximize the allowable value for the carry-on baggage 102.

[0026] In certain realizations, one or more electronic devices mounted on the aircraft 106 include a second set of cameras 126, a shelf status display device 128 associated with each of the aircraft's bay 104, and one or more portable devices 130 (e.g., tablet computers, smartphones, etc.) associated with the aircraft's crew. Each portable device 130 includes an application configured to connect with the monitoring device 108. In other realizations, one or more electronic devices in the aircraft 106 include additional devices, different devices, fewer devices, or a combination thereof. In some realizations, the second set of cameras 126 includes video cameras, still cameras, LiDAR cameras, other types of cameras, or a combination thereof. In some realizations, a data connection is physically connected to the aircraft 106 to supply power to the second set of cameras 126 and the shelf status display devices 128, and to enable communication between the monitoring device 108 and the second set of cameras 126 and the shelf status display devices 128. In other realizations, power for the second set of cameras 126 and shelf status display devices 128 is supplied from the aircraft 106's power system, and communication between the second set of cameras 126 and shelf status display devices 128 and the monitoring device 108 is provided wirelessly or by a physical data connection to the aircraft 106.

[0027] One or more cameras of the second set of cameras 126 are positioned to take images of luggage stored in the overhead compartments 104 of the aircraft 106, and provide image data 132 to the monitoring device 108. For example, one or more cameras of the second set of cameras 126 are coupled to the partition wall of the overhead compartment, the support structure, the top surface of the overhead compartment 104, the door of the overhead compartment, other surfaces, or a combination thereof. In some realizations, one or more other cameras of the second set of cameras 126 are positioned to take images of the passenger and the luggage associated with the passenger as the passenger stores their luggage and goes to their seat. In some realizations, a particular camera of the second set of cameras 126 is configured to take images of the interior of the overhead compartment 104 located across the aisle from that particular camera. Known dimensions of the overhead compartment 104, and known space reserved within a particular overhead compartment for safety devices or other luggage, facilitate the determination of available space within the overhead compartment 104 and the orientation of the luggage. In some implementations, to facilitate the determination of the dimensions of the luggage, the space within the storage shelf 104, and the orientation of the luggage within the storage shelf 104, the storage shelf 104 may include one or more reference markers at known locations, and each storage shelf 104 may include at least two cameras, or both, to provide stereoscopic images.

[0028] The monitoring device 108 determines the status of each storage shelf 104 and transmits an output 134 containing a status signal to the shelf status display device 128. Each shelf status display device 128 generates a visual display of the storage shelf in response to the status signal of output 134 from the monitoring device 108. The visual display indicates the status of the storage shelf 104 associated with the shelf status display device 128. For example, the visual display may include text (e.g., "Full"), a color code (e.g., red to indicate a full storage shelf 104), or both.

[0029] The portable device 130 receives output 134 from the monitoring device 108 containing information indicating the status of the storage compartments 104 inside the aircraft 106. This information enables the portable device 130 to display visual information (e.g., text, graphics, and images), generate auditory information (e.g., specific sounds indicating problems associated with storage compartments 104), or both. In some implementations, the portable device 130 displays a diagram of a portion of the aircraft 106's fuselage, including the storage compartments 104, with each storage compartment 104 displayed in a color indicating its associated status. The crew member associated with the portable device 130 can scroll, zoom in and out of the diagram and select a specific storage compartment. Once the crew member selects a specific storage compartment, an image of that compartment taken by one of the cameras 126 of the second set, showing the interior of the compartment, is transmitted from the monitoring device 108 to the portable device 130 for display.

[0030] The monitoring device 108 includes one or more interfaces 136, memory 138, one or more processors 140, or a combination thereof. One or more interfaces 136 enable communication between the monitoring device 108, one or more electronic devices in the boarding area 110, one or more electronic devices on the aircraft 106, other electronic devices, or a combination thereof. The memory 138 includes a non-transient computer-readable medium (e.g., a computer-readable storage device) that stores instructions 142 that can be executed by the processor 140. The instructions 142 can be executed to initiate, perform, or control actions to assist in monitoring luggage associated with passengers on the aircraft 106, including carry-on baggage 102.

[0031] Memory 138 contains aircraft data 144. Aircraft data 144 contains bay information for aircraft 106. In some implementations, aircraft data 144 contains data for different types of aircraft 106 or different aircraft internal configurations. Bay information includes the number of bays, the total usable space of each bay, the dimensions of each bay, the identifier of a particular bay with limited space, and the location of the limited space within that bay.

[0032] The memory includes alert criteria 146. The alert criteria 146 includes information used by the processor 140 to determine whether one or more alert conditions are met. The alert criteria 146 includes thresholds for certain conditions. For example, the alert criteria 146 includes a per-passenger baggage count threshold indicating the maximum number of bags (or carry-on baggage) that a passenger is allowed to load onto the aircraft 106, a per-flight carry-on baggage count threshold indicating the number of carry-on baggage 102 allowed on the aircraft 106, a threshold for the dimensions of the carry-on baggage 102 (e.g., length, width, and height), other thresholds associated with limits for passengers or the aircraft 106, or a combination thereof. The memory also includes flight data 148. In some implementations, the flight data 148 is stored in the database of the monitoring device 108, or in the database of one or more external devices that allow the monitoring device 108 to access the flight data 148. Flight data 148 includes, for each passenger permitted to board aircraft 106, a flight identifier 150 (e.g., flight number), first image data 152, second image data 154, carry-on data 156, and passenger data 158. First image data 152 is a portion of image data 122 taken by one or more cameras of the first set of cameras 116 during the boarding process of aircraft 106. Second image data 154 is a portion of image data 132 from one or more cameras of the second set of cameras 126. Second image data 154 includes image data of passengers inside the aircraft from the time the passengers take their luggage and sit in their seats, taken by one or more cameras of the second set of cameras 126, and images of the inside of each overhead compartment 104. In some implementations, the flight data 148 does not include the first image data 152, the portion of the second image data 154 corresponding to the images of passengers inside the aircraft, the portion of the second image data 154 corresponding to the images of each overhead compartment 104, or a combination thereof.

[0033] Carry-on baggage data 156 includes aggregate information about carry-on baggage 102 on the aircraft 106. In one implementation, carry-on baggage data 156 indicates the total number of carry-on baggage items on the aircraft 106. In another implementation, carry-on baggage data 156 is the total number of carry-on baggage items and the sum of at least one dimension (e.g., height) of the carry-on baggage items on the aircraft. The total number of carry-on baggage items and the sum of at least one dimension may be used by the monitoring device 108 to determine an estimate of the number of additional carry-on baggage items that can be stored in the overhead compartments 104. The estimate of the number of additional carry-on baggage items that can be stored in the overhead compartments may be provided by the monitoring device 108 to the monitor 114 to inform the crew of the available storage space for the carry-on baggage 102 remaining on the aircraft 106.

[0034] Passenger data 158 includes information about each passenger on board aircraft 106. Passenger data 158 includes passenger identification information 160 and baggage information 162 about baggage associated with the passenger. In some implementations, passenger identification information 160 includes data contained in the boarding pass scanned by the boarding pass scanning station 112 (e.g., name and seat number), images of the passenger and baggage associated with the passenger from image data 132, or both. Baggage information 162 is determined from image data 122 of passengers who are at or approaching the boarding pass scanning station 112.

[0035] When carry-on baggage 102 exists, baggage information 162 includes the number of bags 164 associated with the passenger containing carry-on baggage 102, the number of carry-on baggage 166, and carry-on characteristics 168 (e.g., an estimate of the dimensions of carry-on baggage 102). In some implementations, baggage is considered carry-on baggage 102 based on its size. For example, if baggage is larger than the dimensions associated with personal belongings 178, for example, if it is too large to fit in the pocket on the back of the seat in front of the passenger or under the seat in front of the passenger, then baggage is considered carry-on baggage 102. In some implementations, each piece of baggage carried by a passenger is considered carry-on baggage 102. In some implementations, if a passenger has more than one piece of baggage, the largest piece of baggage is considered carry-on baggage 102. In some implementations, an alert criterion 146 defines a threshold used by the monitoring device 108 to characterize luggage as personal belongings 178 or carry-on luggage 102. The number of luggage 164, the number of carry-on luggage 166, and carry-on characteristics 168, along with the alert criterion 146, are used by the processor 140 of the monitoring device 108 to determine whether one or more alert conditions 170 exist for luggage associated with a passenger.

[0036] The processor 140 includes a luggage analyzer 172, a storage shelf analyzer 174, or both, which can be implemented at least partially by the processor 140 executing instructions 142. The processor 140 can be implemented as a single processor, or as multiple processors in a multi-core configuration, a multi-processor configuration, a distributed computing configuration, a cloud computing configuration, or any combination thereof. In some implementations, one or more parts of the luggage analyzer 172, the storage shelf analyzer 174, or both are implemented by the processor 140 using dedicated hardware, firmware, or a combination thereof.

[0037] The baggage analyzer 172 is configured to identify baggage associated with a passenger who is at or approaching the boarding pass scanning station 112, based on image data 122 from the first set of cameras 116, to determine whether the baggage includes carry-on baggage 102, and to determine one or more characteristics (e.g., length, width, and height) associated with the carry-on baggage 102. Carry-on baggage 102 may be of various sizes and shapes, and may be located in various positions relative to the passenger associated with the carry-on baggage 102. For example, some carry-on baggage 102 are roller carry bags, which are pulled via the expandable / retractable handles of the roller carry bags or carried by other handles of the roller carry bags. As another example, some carry-on baggage 102 may be backpacks that are placed on the passenger's back, or backpacks, tote bags, or other types of carrying means that are carried by handles or straps. The baggage analyzer provides the status of the baggage associated with the passenger as an alert condition 170. In some implementations, the package analyzer 172 includes machine learning models such as neural networks, random forests, and gradient-boosted decision trees, statistical models, or combinations thereof.

[0038] The storage compartment analyzer 174 is configured to determine the orientation of luggage in the storage compartments 104, check the amount of available space in each storage compartment 104, and determine whether there is a problem storing luggage in any of the storage compartments 104, based on image data 132 from a second set of cameras 126 positioned to capture images of the inside of the storage compartments 104 within the aircraft 106. The storage compartment analyzer 174 provides the state of each storage compartment 104 as an alert condition 170. In some implementations, the storage compartment analyzer 174 includes machine learning models such as neural networks, random forests, and gradient-boosted decision trees, statistical models, or a combination thereof.

[0039] During operation, the monitoring device 108 determines that boarding of the aircraft 106 for flight has begun. This determination may be based on the operation of the scanner at the boarding pass scanning station 112, the reception of input from the boarding staff, etc. In response to the start of boarding, the first set of cameras 116 in the boarding area 110 are activated to capture images of the boarding area 110. Image data 122 from the first set of cameras 116 is provided to the monitoring device 108 for analysis by the baggage analyzer 172. Furthermore, in response to the start of boarding, the overhead compartment status display device 128 and the cameras in the second set of cameras 126 in the aircraft 106 are activated. In one implementation, the overhead compartment status display device 128 and the cameras in the second set of cameras 126 associated with a closed overhead compartment 104 remain deactivated until the corresponding overhead compartment 104 is opened.

[0040] While each passenger approaches or arrives at the boarding pass scanning station 112, the baggage analyzer 172 of the monitoring device 108 analyzes image data 122 from the first set of cameras 116 to determine if one or more pieces of baggage are associated with that passenger, and creates an entry in the flight data 148 for the passenger data 158 associated with that passenger. When one or more pieces of baggage are associated with a passenger, the monitoring device 108 determines whether one or more pieces of baggage are carry-on baggage 102 and stores baggage information 162, including carry-on characteristics 168. Carry-on characteristics 168 may include the dimensions of the carry-on baggage 102 and other information. For example, if the monitoring device 108 determines that there is a safety alert for a particular piece of carry-on baggage that indicates the color of one or more parts of that particular piece of carry-on baggage, the other information would include data indicating the color of the carry-on baggage 102.

[0041] Based on carry-on baggage characteristics 168, aircraft data 144, and alert criteria 146, the monitoring device 108 determines whether one or more alert conditions 170 are met. If the monitoring device 108 determines that one or more alert conditions 170 are met, if it determines that certain information associated with carry-on baggage 102 (e.g., dimensions of carry-on baggage) cannot be determined from image data 122, or both, the monitoring device 108 provides output 124 to one or more electronic devices in the boarding area 110. Output 124 includes a specific signal to the crew via a status display device 120 and a message to the monitor 114 indicating one or more alert conditions 170, which characteristics the monitoring device 108 could not determine, or both. When a message is associated with carry-on baggage 102, the message includes selectable options associated with the crew's response to the message (e.g., a first selectable option indicating that the crew will allow carry-on baggage 102 onto aircraft 106, and a second selectable option indicating that the crew will not allow carry-on baggage 102 onto aircraft 106). By selecting the appropriate selectable option, the monitoring device 108 is able to maintain and store the appropriate carry-on data 156. In response to a specific signal, the crew can visually inspect carry-on baggage 102 and, accordingly, process the passenger and carry-on baggage 102 (e.g., allow carry-on baggage 102 onto aircraft 106, or tag carry-on baggage 102 for storage with checked baggage). The crew can select an selectable option, and the selection of this option indicates how the crew responded to the message.

[0042] When the monitoring device 108 determines specific information associated with the carry-on baggage 102 and determines that the alert condition 170 is that the passenger is permitted to board the aircraft 106, the monitoring device 108 supplies a specific signal to the status display device 120 to inform the crew that the crew is able to process the passenger and permit the passenger to board the aircraft 106 with the carry-on baggage 102.

[0043] When a crew member processes a passenger (for example, by scanning the passenger's boarding pass), passenger data 158 is stored by the monitoring device 108. In addition, if the passenger is associated with carry-on baggage 102, carry-on baggage data 156 is updated.

[0044] Furthermore, while in operation, the monitoring device 108 receives image data 132 from a second set of cameras 126 inside the aircraft 106. The storage compartment analyzer 174 of the monitoring device 108 processes the image data 132 from the second set of cameras 126 to determine information about the luggage stored in the storage compartments 104 of the aircraft 106 and the available space within the storage compartments 104. When the boarding process begins and the storage compartments 104 are opened, the image data 132 includes data corresponding to the inside of the opened storage compartment 104. In some implementations, when the corresponding storage compartment 104 is closed, operating power is not supplied to the cameras among the second set of cameras 126 that provide image data 132 of the inside of the storage compartment 104.

[0045] Based on portions of the image data 132 and aircraft data 144, the monitoring device determines first information 176 for each of the storage compartments 104 and stores it in memory 138. The first information 176 for each storage compartment 104 includes luggage characteristics for each piece of luggage in the storage compartment 104 and data about the storage space in the storage compartment 104. The luggage characteristics for the luggage in the storage compartment 104 include the dimensions of the luggage. The dimensions of the luggage in the storage compartment 104 are used to determine the type of luggage (e.g., personal belongings, clothing, or carry-on luggage, or other types of luggage), the orientation of the luggage, the remaining available storage space, and other information associated with the luggage. In some implementations, the space in the storage compartment 104 corresponds to a linear space along the length of the storage compartment 104 that can be used for additional luggage in the storage compartment 104.

[0046] For each storage compartment 104, the monitoring device 108 determines the state associated with the storage compartment 104 based on information determined from image data 132 by the storage compartment analyzer 174, aircraft data 144, and one or more thresholds from alert criteria 146. The first state of the storage compartment 104 indicates that there is space for luggage in the storage compartment 104. The second state indicates that there is a chance to create space in the storage compartment 104 by changing the orientation of one or more pieces of luggage, by rearranging one or more pieces of luggage (for example, by placing the luggage closer together), or by the passenger associated with the luggage removing one or more personal belongings or clothing that can be stored in the seat pocket or on the floor, or by removing one or more personal belongings or clothing from the storage compartment 104. The third state indicates that the storage compartment 104 is full. The fourth state indicates that there is a problem with the storage compartment 104. While the passenger places luggage in the storage compartment 104, the monitoring device 108 analyzes the image data 132 of the storage compartment 104 and updates the state associated with the storage compartment 104 when the state changes.

[0047] If the monitoring device 108 determines that the placement of one or more pieces of luggage in the storage compartment is preventing the storage compartment 104 from closing, or that a part of a piece of luggage (e.g., a strap) is protruding from the storage compartment 104, for a period longer than a threshold time (e.g., one minute, two minutes, or some other period), the monitoring device 108 changes the state of the storage compartment 104 to a fourth state to indicate that there is a problem with the storage compartment 104. The threshold time provides a certain amount of time for a passenger or crew member to correct the problem, and the state is changed to the fourth state if the problem with the storage compartment 104 persists.

[0048] The information determined by the monitoring device 108 includes the characteristics of the luggage in the storage compartment 104. The characteristics may include a first dimension corresponding to the longest length of the luggage in a direction parallel to the bottom of the storage compartment 104, and a second dimension corresponding to the longest length of the luggage in a direction parallel to the side of the storage compartment 104. These characteristics are compared with one or more thresholds from the alert criteria 146 to determine whether the luggage placed at the bottom of the storage compartment 104 is considered carry-on luggage 102, personal belongings, or other types of luggage. If the storage compartment analyzer determines that the luggage placed at the bottom of the storage compartment 104 is personal belongings, the state associated with the storage compartment 104 is changed to a second state, indicating that surplus space can be created within the storage compartment 104. This surplus space can be created, if there is sufficient space, by removing personal belongings from the storage compartment 104, or by placing personal belongings on top of carry-on luggage 102 within the storage compartment 104.

[0049] The monitoring device 108 also compares the first dimension with the second dimension. When the first dimension is larger than the second dimension, and the ratio of the first dimension to the second dimension is greater than a threshold, it is indicated that the state of the storage shelf 104 is changed to the second state, and that additional space can be created in the storage shelf 104 by changing the orientation of one or more items in the storage shelf 104. The ratio of the first dimension to the second dimension being greater than a threshold prevents changes in the state associated with the orientation of items that have a shape that does not change when their shape is changed (e.g., a roughly rectangular or circular shape).

[0050] The monitoring device 108 determines the separation distance between luggage placed at the bottom of the storage compartment 104 and the available space within the storage compartment 104. When the sum of the separation distances exceeds a threshold amount (e.g., the acceptable width of carry-on luggage 102), the state associated with the storage compartment 104 is changed to a second state, indicating that there is surplus space within the storage compartment 104. When the available space within the storage compartment 104 is less than the threshold (e.g., the acceptable width of carry-on luggage), even though there is no indication of improperly oriented luggage or personal belongings at the bottom of the storage compartment 104, the state is changed to a third state, indicating that the storage compartment 104 is full.

[0051] The monitoring device 108 provides a first portion of output 134 as a signal to the shelf status display device 128. The signal indicates the state of the storage shelf 104, associated with the corresponding storage shelf 104. In a particular implementation, the shelf status display device 128 includes lights of various colors (e.g., LEDs of various colors) to indicate the state associated with the storage shelf 104. For example, the first state is indicated by green, the second state by blue, the third state by purple, and the fourth state by yellow. For each storage shelf 104, the signal of the first portion of output 134 controls which color is indicated by the shelf status display device 128. In other implementations, various colors or various types of indicators (e.g., text display) are used. When the boarding process begins, the shelf status display device 128 of the storage shelf 104 is activated and image data 132 from inside the storage shelf 104 is received by the monitoring device 108. Once the boarding process is complete (for example, when the doors to aircraft 106 are closed), the tier status display device 128 is deactivated.

[0052] In addition to transmitting the first portion of output 134 to the shelf status display device 128, the monitoring device 108 transmits the second portion of output 134 to one or more portable devices 130 associated with the crew of the aircraft 106. The second portion of output 134 enables an application on the portable device 130 to display a diagram of the storage shelves 104, including the corresponding state of each storage shelf 104. When the state of a particular storage shelf 104 changes to a fourth state, the application can highlight that particular storage shelf 104 (e.g., visually distinguish it on the display), and the application can issue an audible notification to indicate that there is a problem with that particular storage shelf 104.

[0053] In some implementations, input from the crew via an application allows the crew to set a state for a specific storage compartment 104 that overrides the state determined by the monitoring device 108. For example, the monitoring device 108 determines that the state of a specific storage compartment 104 is a second state, indicating that space can be created within that storage compartment 104. The crew may determine that there are personal belongings in the storage compartment, but even if the personal belongings are removed, there will not be enough space for other carry-on baggage 102. The crew can use a portable device 130 to override the indicated third state and change the state to another state (for example, a first state indicating available space, or a fourth state indicating that the specific storage compartment 104 is full, as needed).

[0054] In some implementations, the monitoring device 108 periodically stores images showing the interior of each compartment 104 in a second image data 154 in memory 138 during the boarding process. When it becomes necessary to identify luggage associated with a passenger or a passenger associated with luggage, images of the interior of the compartment 104 from the second image data 154 may be examined together with information from passenger data 158 in memory 138 (e.g., passenger name, seat, and images of luggage associated with the passenger from passenger identification information 160).

[0055] In some implementations, the first set of cameras 116 remains active until the last passenger is processed by the boarding staff and the last passenger leaves the boarding area 110. In some implementations, the cameras among the second set of cameras 126 that take images inside the overhead compartments remain active during the boarding process until the corresponding overhead compartments 104 are closed, and the compartment status display device 128 remains active until all overhead compartments 104 are closed.

[0056] Figure 2 shows a method 200 for inspecting carry-on baggage for an aircraft flight. In a particular implementation, one or more steps of method 200 are performed by a monitoring device 108 of system 100 in Figure 1.

[0057] Method 200 includes receiving image data 122, 132 from one or more cameras in block 202. The one or more cameras may include a first set of cameras 116 in the boarding area 110, a second set of cameras 126 in the aircraft 106, or both. One or more cameras of the first set of cameras 116 are positioned to take images of the passenger and their associated luggage from the time the passenger approaches and arrives at a location where crew members process the passenger (e.g., a boarding pass scanning station 112 where crew members scan boarding passes and visually inspect the passenger and their associated luggage) before the passenger is permitted to proceed to the aircraft 106. One or more cameras of the first set of cameras 116 may be coupled to the ceiling, walls, corners, the boarding pass scanning station 112, or other structures in the boarding area 110.

[0058] One of the cameras in the second set of cameras 126 is positioned inside the aircraft 106 to take an image of the inside of an open storage compartment 104. In one implementation, one of the cameras in the second set of cameras 126 is coupled to a storage compartment partition wall, and each camera is positioned to take an image of the inside of the storage compartment from the camera across the aisle. In another implementation, each storage compartment 104 includes one of the cameras in the second set of cameras 126 coupled to a storage compartment partition wall, the top surface of the storage compartment, the door of the storage compartment, a structural member of the storage compartment, other supporting surfaces, or a combination thereof, and the camera is positioned to take an image of the inside of the storage compartment.

[0059] Method 200 includes, in block 204, analyzing image data 122, 132 taken by one or more cameras to detect characteristics 168 of carry-on baggage 102. For example, one or more cameras of a first set of cameras 116 in the boarding area 110 of the aircraft 106 are Lida cameras. Image data 122 from the Lida cameras is analyzed to determine the dimensions (e.g., length, width, and height) of the carry-on baggage 102. Alternatively or additionally, a certain area of ​​the boarding area 110 imaged by one or more cameras of the first set of cameras 116 may include one or more reference markers of position markers 118. Simultaneously or nearly simultaneously, images of the reference markers and carry-on baggage in image data 122 taken by two or more cameras at different known locations are analyzed to determine the dimensions of the carry-on baggage 102.

[0060] Another example of determining one or more characteristics of carry-on baggage 102 is when the carry-on baggage is placed in the overhead compartment 104 of the aircraft 106, one or more cameras from the second set of cameras 126 take an image of the carry-on baggage 102. The overhead compartment 104 may include one or more position markers, LiDAR cameras, or both, which enable the determination of the size of the baggage in the overhead compartment and the space between the baggage in the overhead compartment 104. Image data 132 from one or more cameras is analyzed to determine the dimensions of the carry-on baggage 102 (e.g., width, height, length, or a combination thereof). The dimensions and other information determined from the image data 132 may be stored in the first information 176 in the memory 138 of the monitoring device 108.

[0061] Method 200 includes determining in block 206 that one or more alert conditions 170 are met based on a comparison of one or more alert criteria 146 with the characteristics 168 of carry-on baggage 102 and aircraft data 144 associated with the aircraft 106. The alert criteria 146 include thresholds and conditions associated with baggage, including carry-on baggage 102, where storage space, orientation of baggage in overhead compartment 104, and other conditions are based on the baggage. Other alert conditions include safety issues regarding baggage associated with a passenger, safety alerts for baggage associated with a passenger, excessive baggage associated with a passenger, and other conditions.

[0062] Method 200 further includes, in block 208, transmitting outputs 124, 134 to one or more devices 114, 120, 128, 130 based on the fulfillment of one or more alert conditions 170. The one or more devices are associated with the crew (e.g., a computer device including a monitor 114 in a boarding pass scanning station 112, a portable device associated with the crew, a speaker, a status display device 120 visible to the crew, a boarding pass scanning station 112, etc.), a shelf status display device 128 associated with a storage compartment 104, a computer device associated with the aircraft crew (e.g., a portable device 130), other devices, or a combination thereof.

[0063] For example, if the monitoring device 108 determines that a particular carry-on baggage is oversized, the monitoring device 108 activates the status display device 120 to send a message to be displayed on the monitor 114 associated with the crew. The message informs the crew that the particular carry-on baggage is oversized and provides them with selectable options. The selectable options may include a first selectable option indicating that the particular carry-on baggage will be tagged for storage together with checked baggage, a second selectable option indicating that the crew will allow the particular carry-on baggage to be loaded onto the aircraft 106 (for example, an option to revoke the first option), other options, or a combination thereof. If a specific carry-on baggage is permitted to be loaded onto aircraft 106 as carry-on baggage 102, the monitoring device 108 is notified of the decision made by the crew member regarding the specific carry-on baggage through the input device by the crew member selecting a specific selectable option, the monitoring device 108 is prompted to reset the status display device 120, and the monitoring device 108 is then able to store information associated with the specific carry-on baggage. Preventing oversized carry-on baggage from being loaded onto aircraft 106 speeds up passenger boarding and prevents aisle blockages due to problems associated with placing luggage in overhead compartments 104.

[0064] As another example, a security guard or airport employee may enter an alert into a computer system describing specific attributes of a particular piece of luggage to be placed. The monitoring device 108 accesses the alert, determines a specific alert criterion associated with the alert, and stores that specific alert criterion along with the alert criterion 146. Based on the image data 122, 132, the monitoring device 108 determines that there is a high probability (for example, a 90 percent probability, or higher than some other percentage) that the luggage associated with the passenger is the specific luggage. If the monitoring device 108 determines that the threshold probability is met, the monitoring device 108 sends a message to the monitor 114 and a signal to the status display device 120 to draw the attention of the crew to a potential problem. The message describes the alert and provides selectable response options for the crew. Selectable response options may include an option to notify about safety, an option to cancel the alert based on the crew's determination that the luggage associated with the passenger is not the specific luggage, other options, or a combination thereof.

[0065] As another example, the monitoring device 108 continues to track the number of carry-on bags 102 permitted to enter the aircraft 106 through the crew and stores this information in carry-on data 156. When an alert condition based on the carry-on data 156 indicates that there is insufficient available storage space in the overhead compartments 104 (e.g., less than a threshold amount of available storage space), a signal is sent to the crew indicating that the remaining carry-on bags 102 of passengers who have not yet passed through the crew should be tagged for storage together with checked baggage. In some implementations, the monitoring device can provide the monitor 114 with a count of the number of carry-on bags 102 permitted to pass through the crew, a count of carry-on bags 102 in the overhead compartments 104, and an estimated count of the space available for carry-on bags 102 in the overhead compartments 104 of the aircraft 106, based on image data 132 from a second set of cameras 126. If the estimated count of space available for carry-on baggage 102 begins to approach zero (for example, to 6 or less), and there are more passengers remaining to board than the estimated count of space available, the boarding staff can contact the aircraft crew to determine whether surplus carry-on space can be created by rearranging carry-on baggage 102 already placed in the overhead compartments 104, and can also inform passengers waiting to board that they may need to tag their carry-on baggage 102 and store it together with their checked baggage.

[0066] As another example, the monitoring device 108 determines that alert condition 170 is met when one or more carry-on items 102 are oriented incorrectly in the overhead compartment 104, or when small items (e.g., personal belongings, clothing, etc.) are placed in the overhead compartment 104 where carry-on items 102 could be placed instead. The monitoring device 108 transmits a first part of output 134 to change the shelf status display device 128 for the overhead compartment 104 from a first color (e.g., green) indicating available storage space in the overhead compartment 104 to a second color (e.g., blue) indicating that extra space can be made in the overhead compartment 104, and transmits a second part of output 134 indicating that additional space can be made in the overhead compartment 104 to the portable device 130. Based on the first or second part of output 134, it is possible to reposition carry-on baggage 102 that is properly oriented, to place smaller items on top of other carry-on baggage 102, or to remove smaller items from the overhead compartment 104 to place in the seat pocket of the passenger seat associated with that item or on the floor next to that seat. By properly orienting carry-on baggage 102 and removing smaller items from the overhead compartment 104 where carry-on baggage 102 could be placed, it may be possible to maximize the number of carry-on baggage 102 that can be stacked in the overhead compartment.

[0067] As another example, when image data 132 indicates that the space between luggage in the overhead compartment 104 (e.g., carry-on luggage 102, safety devices, other luggage, or combinations thereof) is smaller than a threshold (e.g., a threshold for the allowable carry-on luggage height), the monitoring device 108 determines that the alert condition 170 is met. In response, the monitoring device 108 transmits a first part of output 134 to change the shelf status display device 128 for the overhead compartment 104 from a color indicating available space in the overhead compartment 104 to another color (i.e., purple) indicating that the overhead compartment 104 is full, and transmits a second part of output 134 as a message to the portable device 130. Depending on the change in the shelf status display device 128 or the message, the overhead compartment 104 may be closed.

[0068] As a further example, when image data 132 indicates that a certain problem is related to the storage compartment 104, the monitoring device 108 determines that the alert condition 170 is met. The problem could be that luggage in the storage compartment 104 would prevent the storage compartment 104 from closing, that luggage is placed on or in front of the safety device or in another reserved area within the storage compartment 104, that something is hanging from the storage compartment 104, or other problems, or a combination thereof. In response, the monitoring device 108 transmits a first part of output 134 to change the color of the shelf status display device 128 to a color indicating the problem (e.g., yellow), and transmits a second part of output 134 as a message to the portable device 130. In response, several aircraft crew members can go to the storage compartment 104 and resolve the problem.

[0069] Figure 3 shows a method 300 for monitoring carry-on baggage 102 for the flight of aircraft 106. In a particular implementation, one or more steps of method 300 are performed by a monitoring device 108 of system 100 in Figure 1.

[0070] Method 300, in block 302, includes receiving image data 122 from one or more cameras 116 within the boarding area 110 of the aircraft 106. One or more cameras 116 are positioned to capture images of carry-on baggage associated with passengers preparing to board the aircraft 106, where baggage includes carry-on baggage 102. One or more cameras 116 are coupled to the ceiling, walls, corners, boarding pass scanning stations 112, other structures, or a combination thereof within the boarding area 110. In some implementations, one or more cameras 116 include one or more digital video cameras, one or more LiDAR cameras, one or more digital cameras controlled by one or more timers to periodically (e.g., once every two seconds) capture images, or a combination thereof.

[0071] Method 300 includes, in block 304, analyzing image data 122 taken by one or more cameras 116 to determine characteristics 168 of carry-on baggage 102 associated with a passenger. These characteristics 168 may include the dimensions of the carry-on baggage 102 and other information. For example, one or more cameras 116 in the boarding area 110 of the aircraft 106 are Lida cameras. Image data from the Lida cameras is used to determine the dimensions (e.g., length, width, and height) of the carry-on baggage 102. Alternatively or additionally, a certain area of ​​the boarding area 110 imaged by one or more cameras 116 may include one or more markers of a location marker 118. The location marker 118 identifies the location of one or more markers and one or more cameras 116. Simultaneously or nearly simultaneously, images of the markers in the image data 122 taken by two or more of the cameras 116 are used to determine the dimensions of the carry-on baggage 102.

[0072] When determining the dimensions of carry-on baggage 102, certain characteristics of carry-on baggage 102 can be ignored. For example, many carry-on bags 102 are roller carry bags with expandable / stowable handles. When determining the length of a roller carry bag with expandable / stowable handles, the length of the expandable / stowable handles is ignored. That is, when determining the length of carry-on baggage 102, if the initial determination is that the length exceeds a length threshold, an additional determination is made to determine whether carry-on baggage 102 consists of two or more pieces of luggage stacked on top of each other. For example, a passenger may place personal belongings (i.e., a computer bag) on ​​top of a roller carry bag. The combined length of the roller carry bag and the personal belongings may exceed the threshold length. The additional determination results in the length of carry-on baggage 102 being only the length of the roller carry bag.

[0073] At the boarding pass scanning station 112, a boarding attendant processes the passenger. Processing a passenger may include scanning the passenger's boarding pass and observing the passenger and their associated luggage before the passenger is permitted to board the aircraft 106, and determining whether any matters associated with the passenger need to be addressed. Passenger-related data, image data 122 of the passenger and their associated luggage, data on the aircraft boarding process (e.g., video data), additional data, or a combination thereof, can be stored in a database within the monitoring device 108 or in one or more databases outside the monitoring device, in association with the flight.

[0074] If a problem arises, it is possible to access information in the flight database. For example, if a person who boarded aircraft 106 later disembarks from aircraft 106 before its departure, it is possible to access the information in the flight database to ensure that the luggage associated with that person is moved from aircraft 106. As another example, if luggage is left on aircraft 106 after a passenger has disembarked and is later discovered, it is possible to access the information in the flight database to identify the information associated with the appropriate passenger and facilitate the return of the luggage to that appropriate passenger.

[0075] Information in the database for a flight is stored in the database for a specific period of time, after which the information can be deleted or overwritten. The specific period of time may be one hour, one day, one week, or any other period of time, or any other time, after the aircraft 106 has arrived at its destination. If necessary, before the specific period of time has elapsed, the parties may be prohibited from deleting or overwriting the information in the database for the flight, or a copy of the information in the database for the flight may be made and stored in a location where it will not be deleted after the specific period of time has elapsed, thereby making the information available after the specific period of time has elapsed.

[0076] Method 300 includes determining in block 306 that one or more alert conditions 170 are met based on a comparison of one or more alert criteria 146 with the characteristics 168 of the carry-on baggage 102 and aircraft data 144 associated with the aircraft 106. The alert criteria 146 include size restrictions for the carry-on baggage 102 (e.g., length thresholds, width thresholds, and height thresholds), thresholds for the number of bags associated with the passenger, and other thresholds for other conditions. For example, the alert criteria 146 may include a threshold for the number of carry-on bags that may be allowed on the aircraft 106. For a flight, the type of aircraft 106 and the available storage space in the overhead compartments 104 of the aircraft 106 are known. The above number thresholds may be set values ​​(i.e., 112 carry-on bags 102) or may be dynamically calculated based on the dimensions of carry-on bags 102 already allowed on the aircraft 106 and the total storage space of the overhead compartments 104. Alternatively or additionally, the threshold for the above number may be based on the determination of the remaining available space by the monitoring device 108, based on image data 132 that provides specific image data of the inside of the storage compartment 104, received from the camera 126 on the aircraft 106.

[0077] Method 300 further includes, in block 308, sending an output to at least one device based on the fulfillment of one or more alert conditions 170. For example, when a fulfilled alert condition 170 indicates that carry-on baggage 102 is oversized, that a passenger is associated with more baggage than a threshold, or both, the monitoring device 108 sends a first portion of output 124 as an alert to the status display device 120 and a second portion of output 124 as a message viewable by the monitor 114. Depending on whether an alert condition 170 indicating oversized carry-on baggage is fulfilled, the crew can decide whether to tag the oversized carry-on baggage for transport with checked baggage, or to allow the oversized carry-on baggage to board the aircraft 106 with the passenger. The crew can input data regarding the status of the oversized carry-on baggage to the monitoring device 108 via an input device associated with the monitor 114. In response to an alert condition 170 indicating that there is too much luggage associated with a passenger, the crew member may acknowledge the alert condition and have the passenger reduce the number of pieces of luggage by placing one or more pieces of luggage in other pieces of luggage (for example, placing the first piece of luggage in carry-on luggage 102), have the passenger pay for the additional luggage, or the crew member may ignore the alert condition and allow the passenger to board aircraft 106.

[0078] Figure 4 shows a method 400 for inspecting carry-on baggage for a flight of aircraft 106. In a particular implementation, one or more steps of method 400 are performed by a monitoring device 108 of system 100 in Figure 1. First, the monitoring device 108 receives an input indicating that the boarding process for the flight has begun. In response to the start of the boarding process, the monitoring device 108 activates the operation of cameras 126 inside the aircraft 106 and activates the operation of the bin status display devices 128 for each bin 104 of the aircraft 106. A first portion of the cameras is positioned to capture images of the inside of the bin 104.

[0079] One of the cameras in the first part may be activated when the storage shelf 104 associated with that camera is open. The shelf status display device 128 for the storage shelf 104 is activated when the monitoring device 108 can determine the state of the storage shelf 104 from image data 132 received from one or more cameras associated with the storage shelf 104. In a particular implementation, the shelf status display device 128 indicates the state of the storage shelf 104 by emitting light of a specific color. For example, in one implementation, green light indicates available storage space, blue light indicates that additional space can be created in the storage shelf 104 by rearranging the contents inside, purple light indicates that the storage shelf 104 is full, and yellow light (e.g., amber light) indicates that there is a problem with the storage shelf 104. In other implementations, various color schemes may be used, fewer colors may be used, additional lights may be used to indicate other state conditions, or combinations thereof may be possible. In yet another implementation, various display methods may be used, such as displaying text indicating the state.

[0080] Method 400 includes, in block 402, receiving image data 132 from a camera 126 inside the aircraft 106. At least a first portion of the camera 126 is positioned to capture images of the inside of the overhead compartment 104. In some implementations, the other portion of the camera 126 is positioned to capture images of passengers inside the aircraft 106 while they are stowing their luggage and going to their seats. The camera 126 may be a video camera, one or more still cameras controlled by one or more timers to periodically take images, a LiDAR camera, other types of cameras, or a combination thereof.

[0081] Method 400 includes analyzing image data 132 in block 404 to determine first information 176 for each of the storage shelves 104. The first information 176 includes the characteristics of the luggage and the storage space within the storage shelf 104. The first information includes the type of luggage in the storage shelf 104, the dimensions of the luggage stored in the storage shelf 104, information on the orientation of the luggage stored in the storage shelf, the remaining space for the luggage in the storage shelf 104, the position of the luggage relative to the ends and safety devices of the storage shelf 104, the position of the luggage relative to the movable parts and door fasteners of the storage shelf 104, other characteristics, or a combination thereof. For example, the monitoring device 108 determines the width and height of luggage placed at the bottom of the storage shelf 104 based on image data 132 from camera 126. Based on the width and height of the luggage, the ratio of width to height, other coefficients, or combinations thereof, the monitoring device 108 determines whether the luggage is carry-on luggage 102 or a different type of luggage that does not need to be stored in the overhead compartment 104 (e.g., personal belongings, a coat, or other clothing).

[0082] As another example, the monitoring device 108 determines information about the orientation of items in the storage shelf 104 based on a comparison of a second dimension of the items along the height of the storage shelf with a first dimension of the items along the length of the storage shelf. As yet another example, the monitoring device 108 determines the available storage space in the storage shelf 104 as the length of the storage shelf obtained by subtracting the length of the unavailable space (e.g., the length occupied by safety devices) and the sum of the first dimensions of the items in the storage shelf 104 along the length of the storage shelf 104.

[0083] Method 400 includes determining in block 406 that one or more alert conditions 170 are met based on a comparison of one or more alert criteria 146 with the first information 176 of each of the storage compartments 104. The monitoring device 108 determines that an alert condition 170 is met when one or more carry-on items 102 are oriented improperly in the storage compartment 104, when small items (e.g., personal belongings, clothing, etc.) are placed in the storage compartment 104 where carry-on items 102 could be placed instead, when sufficient space for additional carry-on items 102 can be created by moving the items in the storage compartment 104 closer together, or when there is not enough space in the storage compartment 104 for other carry-on items 102 (i.e., the storage compartment is full).

[0084] Method 400 also includes, in block 408, sending an output 134 to one or more devices based on the fulfillment of one or more alert conditions 170. The output 134 may be a signal to one or more shelf status display devices 128, information to a portable device 130, other outputs, or a combination thereof.

[0085] Referring to Figure 5, a flowchart is shown illustrating the lifespan of an aircraft configured to monitor the storage of luggage in the aircraft's overhead compartments, denoted by reference numeral 500. In the pre-manufacturing stage, exemplary method 500 includes, in 502, the specification and design of an aircraft such as aircraft 106, as described with reference to Figure 6. In the aircraft specification and design stage, method 500 may include the specification and design of a second set of cameras 126 for monitoring passengers moving to their seats during the boarding process, for monitoring the inside of the overhead compartments 104, or for doing both. In the aircraft specification and design stage, in block 502, method 500 may include the specification and design of a compartment status indicator 128 for each of the compartments 104. In block 504, method 500 includes the procurement of materials, which may include the procurement of the second set of cameras 126 and the compartment status indicator 128, and any necessary accessories (e.g., wiring, power connections, etc.).

[0086] In the manufacturing phase, Method 500 includes, in Block 506, the manufacture of components and subassemblies, and in Block 508, the system integration of the aircraft. For example, Method 500 may include the manufacture of components and subassemblies of the second set of cameras 126 and shelf status display devices 128. Method 500 includes, in 510, the authorization and delivery of the aircraft, and in 512, the commencement of the aircraft's operation. Authorization and delivery may include authorization of the operation of the second set of cameras 126 and shelf status display devices 128, including other systems of the aircraft. While operated by the customer, the aircraft may be scheduled for periodic maintenance and servicing (including modifications, reconfigurations, and refurbishments). In Block 514, Method 500 includes performing maintenance and servicing on the aircraft, which may include performing maintenance and servicing on the second set of cameras 126 and shelf status display devices 128.

[0087] Each step of Method 500 may be performed or carried out by a system integrator, a third party, and / or an operator (e.g., a customer). For the purposes of this specification, a system integrator may include, but not limited to, any number of aircraft manufacturers and subcontractors of key systems; a third party may include, but not limited to, any number of vendors, subcontractors, and suppliers; and an operator may be an airline, leasing company, military organization, service organization, etc.

[0088] Aspects of this disclosure may be described in the context of an example of a vehicle. A particular example of a vehicle is the aircraft 106 shown in Figure 6.

[0089] As shown in Figure 6, the aircraft 106 includes a fuselage 618 containing a plurality of systems 620 and interior 622. Examples of the plurality of systems 620 include one or more of the propulsion system 624, electrical system 626, environmental system 628, and hydraulic system 630. Any number of other systems may be included, for example, a second set of cameras 126, shelf status display devices 128, or both.

[0090] Figure 7 shows a block diagram of a computing environment 700, including a computing device 710 configured to support the computer-implemented methods and computer-executable program instructions (or code) relating to this disclosure. For example, the computing device 710 or a part thereof is configured to execute instructions for initiating, performing, or controlling one or more processes described with reference to Figures 1 to 6. In a particular embodiment, the computing device 710 includes the monitoring device 108 of Figure 1, the boarding pass scanning station 112, a camera from the first set of cameras 116, a specific location indicator of the location indicator 118, a camera from the second set of cameras 126, a portable device 130, one or more servers, one or more virtual devices, or a combination thereof.

[0091] The computing device 710 includes one or more processors 720. In a particular embodiment, processor 720 corresponds to processor 140 in Figure 1. Processor 720 is configured to communicate with system memory 730, one or more storage devices 740, one or more input / output devices 770 via one or more input / output interfaces 750, one or more communication interfaces 760, or a combination thereof. System memory 730 may include volatile storage devices (e.g., random access memory (RAM) devices), non-volatile storage devices (e.g., read-only memory (ROM) devices, programmable read-only memory, and flash memory), or both. System memory 730 stores a full operating system that enables the computing device 710 to interact with users, other programs, and other devices, together with an operating system 732 that may include a basic input / output system for booting the computing device 710. The system memory 730 stores system (program) data 736, including, for example, aircraft data 144, alert criteria 146, flight data 148, and first information 176 (e.g., luggage characteristics and storage space in the overhead compartment 104).

[0092] The system memory 730 includes one or more applications 734 (e.g., sets of instructions) that can be executed by the processor 720. For example, one or more applications 734 include instructions 142, a luggage analyzer 172, and a storage rack analyzer 174 that can be executed by the processor 720 to start, control, or perform one or more processes as described with reference to Figures 1 to 6.

[0093] In a particular implementation, the system memory 730 includes a non-transient computer-readable medium (e.g., a computer-readable storage device) that stores an instruction 142, which, when executed by the processor 720, causes the processor 720 to initiate, perform, or control a process for monitoring the storage of carry-on baggage in the overhead compartments of an aircraft. The process includes receiving image data from one or more cameras. The process includes analyzing the image data to determine the characteristics of the carry-on baggage. The process includes determining that one or more alert conditions have been met based on a comparison of one or more alert criteria with data associated with the characteristics of the carry-on baggage and the aircraft. The process also includes transmitting output based on the fact that one or more alert criteria have been met.

[0094] One or more storage devices 740 include non-volatile storage devices such as magnetic disks, optical disks, or flash memory devices. In certain examples, storage devices 740 include both removable and non-removable storage devices. Storage devices 740 are configured to store the operating system, images of the operating system, applications (e.g., one or more applications 734), and program data (e.g., program data 736). In certain embodiments, system memory 730, storage devices 740, or both include tangible computer-readable media. In certain embodiments, one or more storage devices 740 are located outside the computing device 710.

[0095] One or more input / output interfaces 750 enable the computing device 710 to communicate with one or more input / output devices 770 to facilitate interaction with the user. For example, one or more input / output interfaces 750 may include a display interface, an input interface, or both. For example, the input / output interface 750 is adapted to receive input from the user, to receive input from other computing devices, or a combination thereof. In some implementations, the input / output interface 750 conforms to one or more standard interface protocols, which include serial interfaces (e.g., USB (universal serial bus) interface, or IEEE (Institute of Electrical and Electronics Engineers) interface standards), parallel interfaces, display adapters, audio adapters, or custom interfaces ("IEEE" is a registered trademark of the Institute of Electrical and Electronics Engineers, Piscataway, New Jersey). In some implementations, the input / output device 770 includes one or more user interface devices and displays, which include any combination of buttons, keyboards, pointing devices, displays, speakers, microphones, touchscreens, and other devices.

[0096] The processor 720 is configured to communicate with the device or controller 780 via one or more communication interfaces 760. For example, one or more communication interfaces 760 may include network interfaces. The device or controller 780 may include, for example, the monitoring device 108 in Figure 1, the monitor 114, one of the cameras in the first set of cameras 116, the status display device 120, one of the cameras in the second set of cameras 126, the shelf status display device 128, or a combination thereof.

[0097] Further exemplary and non-exclusive embodiments relating to this disclosure are described in the following paragraphs.

[0098] In one example relating to this disclosure, a system (100) for monitoring carry-on baggage (102) for the flight of an aircraft (106) One or more cameras (116, 126) positioned to capture images of carry-on baggage (102) associated with aircraft passengers, An interface (136) configured to receive image data (122, 132) from one or more cameras, One or more processors (140) connected to the interface, To determine the characteristics of carry-on baggage (168), image data is analyzed, Based on a comparison of one or more alert criteria (146) with data associated with the characteristics of carry-on baggage and the aircraft (144), it is determined that one or more alert conditions (170) are met. Based on the fulfillment of one or more alert conditions, an output (124, 134) is sent to one or more devices (114, 120, 128, 130), One or more processors (140) configured to perform the following: A system (100) is provided that includes the following.

[0099] Optionally, in the system described in the preceding paragraph, one or more cameras include one or more cameras from a first set of cameras (116) positioned to capture images of carry-on baggage within the aircraft's boarding area (110).

[0100] Optionally, in the system described in one of the preceding paragraphs, one or more cameras include one or more cameras from a second set of cameras (126) positioned to capture images of the inside of the aircraft's overhead compartment (104).

[0101] Optionally, in the system described in one of the preceding paragraphs, one of the alert criteria corresponds to carry-on baggage being oversized based on the dimensions of the carry-on baggage determined from image data, and depending on whether the carry-on baggage is oversized, an output is supplied to the equipment associated with the crew (114, 120).

[0102] Optionally, in the system described in one of the preceding paragraphs, one of the alert criteria corresponds to the availability of space in the aircraft's overhead compartments falling below a threshold amount, based on information obtained from image data, and an output is supplied to the crew-associated devices (114, 120) in accordance with the availability of space in the overhead compartments falling below a threshold amount.

[0103] Optionally, in the system described in one of the preceding paragraphs, the determination that the available storage space in the overhead compartment is below a threshold amount is based on aircraft data (144) associated with the aircraft and the number of carry-on bags permitted to pass from the boarding area to the aircraft (156).

[0104] Optionally, in the system described in one of the preceding paragraphs, the determination that the available storage space in the storage shelf is less than a threshold amount is further based on image data (132) of the inside of the storage shelf captured by a specific camera among one or more cameras.

[0105] Optionally, in the system described in one of the preceding paragraphs, one or more alert criteria are associated with a specific storage compartment, and the output includes information transmitted to an aircraft crew-associated device (130), a signal to activate a storage compartment status indicator (128) associated with a specific storage compartment, or both.

[0106] Optionally, in the system described in one of the preceding paragraphs, the color of the shelf status indicator is associated with a specific state of a particular storage shelf.

[0107] In other embodiments relating to this disclosure, a method (400) for monitoring carry-on baggage (102) for the flight of an aircraft (106), In the monitoring device (108), receiving (402) image data (132) from a camera (126) mounted on the aircraft, wherein at least a portion of the camera is positioned to capture images of the inside of a storage compartment (104) for carry-on baggage (102), In a monitoring device, the analysis (404) involves analyzing image data to determine a first piece of information (176), wherein the first piece of information includes the characteristics of the goods in each storage shelf and the available storage space in each storage shelf. In the monitoring device, it is determined (406) that one or more alert conditions (170) are met based on a comparison of one or more alert criteria (146) with the first piece of information, Based on the fulfillment of one or more alert conditions, the monitoring device sends an output (134) to one or more devices (128, 130) (408), A method (400) is provided, which includes the following.

[0108] Optionally, the method described in the preceding paragraph further includes analyzing the data to determine the state associated with each storage shelf, and transmitting the output to transmit a signal to change the color of the shelf status indicator (128) of the storage shelf to indicate the state associated with the storage shelf.

[0109] Optionally, in the method described in one of the preceding paragraphs, analyzing image data includes determining that the state is a first state depending on whether there is available space in the storage shelf, and analyzing image data includes determining that the state is a third state indicating that the storage shelf is full depending on whether there is available space in the storage shelf that is less than a threshold amount of available storage space.

[0110] Optionally, in the method described in one of the preceding paragraphs, analyzing the image data includes determining that the state is a second state, in that the dimensions of the luggage placed in a particular storage shelf correspond to the dimensions associated with the carry-on item (178).

[0111] Optionally, in the method described in one of the preceding paragraphs, analyzing the image data includes determining that the state is a fourth state, depending on whether one or more items placed inside the storage cabinet are preventing the cabinet from being closed.

[0112] Optionally, in the method described in one of the preceding paragraphs, analyzing image data further includes determining the available storage space in the overhead compartment, and transmitting output includes transmitting a message to a device (114) associated with a crew member indicating the number of additional carry-on bags that can be accommodated in the overhead compartment.

[0113] In other embodiments relating to this disclosure, a method (300) for monitoring carry-on baggage (102) for the flight of an aircraft (106), In a monitoring device (108), receiving image data (122) from one or more cameras (116) within the aircraft boarding area (110), wherein one or more cameras are positioned to capture images of carry-on baggage associated with passengers preparing to board the aircraft, and receiving image data (122) (302), In the monitoring device, image data is analyzed (304) to determine the characteristics (168) of carry-on baggage associated with the passenger, In the monitoring device, it is determined (306) that one or more alert conditions (170) are met based on a comparison of one or more alert criteria (146) with data (144) associated with the characteristics of carry-on baggage and the aircraft, Based on the fulfillment of one or more alert conditions, the monitoring device sends an output (124) to one or more devices (114, 120), A method (400) is provided, which includes the following.

[0114] Optionally, in the method described in the preceding paragraph, the characteristics include estimates of the length, width, and height of the carry-on baggage.

[0115] Optionally, in the method described in one of the preceding paragraphs, the output includes a statement indicating that the carry-on baggage is oversized, based on the fact that one or more of its length, width, or height exceeds one or more corresponding dimensional thresholds of one or more alert criteria for the acceptable dimensions of carry-on baggage.

[0116] To optionally estimate the length in one of the preceding paragraphs using the method described above, Determining the first length of carry-on baggage, In response to whether the first length exceeds a threshold, it is determined whether the first length is associated with two or more separate packages. This includes determining that a first length is associated with two or more separate packages, and then estimating that the first length is associated with the longest of the two or more separate packages.

[0117] Optionally, in the system described in one of the preceding paragraphs, one or more alert criteria correspond to the storage space in the aircraft's overhead compartment being less than a threshold amount, and the fulfillment of one or more alert conditions relating to the storage space being less than a threshold amount is based on second image data (134) received from the aircraft.

[0118] In some implementations, a non-transient computer-readable medium (e.g., a computer-readable storage device) stores instructions that, when executed by one or more processors, cause one or more processors to initiate, perform, or control operations to execute some or all of the functions described above. For example, such instructions may be executable to implement one or more operations or methods described in Figures 1 to 6. In some implementations, some or all of the one or more operations or methods described in Figures 1 to 6 may be implemented by one or more processors (e.g., one or more central processing units (CPUs), one or more graphics processing units (GPUs), one or more digital signal processors (DSPs)), or any combination thereof, which execute the instructions by their own hardware circuits.

[0119] The examples of embodiments described herein are intended to provide a general understanding of the structure of various embodiments. These examples are not intended to comprehensively describe all elements and features of apparatus and systems utilizing the structures or methods described herein. By examining this disclosure, many other implementations will become apparent to those skilled in the art. Other implementations may be utilized and derived from this disclosure so that structural and logical substitutions and modifications can be made without departing from the scope of this disclosure. For example, the steps of the method may be performed in a different order than shown in the drawings, or one or more steps of the method may be omitted. Accordingly, this disclosure and the drawings should be considered more illustrative than restrictive.

[0120] Furthermore, while specific embodiments have been illustrated in this specification, it should be understood that any subsequent configurations designed to achieve the same or similar results may be substituted for the specific embodiments shown. This disclosure is intended to cover all subsequent adaptations or modifications of various embodiments. Combinations of the above embodiments, as well as other embodiments not specifically described herein, will become apparent to those skilled in the art through careful examination of this specification.

[0121] This “Abstract” of the Disclosure is submitted with the understanding that it is not intended to be used to interpret or limit the claims or their meaning. In addition, in the “Modes for Carrying Out the Invention” described above, various features may be combined into one or described as a single implementation for the purpose of conciseness of the Disclosure. The above examples are illustrative, not limiting, of the Disclosure. It should also be understood that numerous modifications and variations are possible in accordance with the principles of the Disclosure. As reflected in the following claims, the subject matter of the claimed invention may correspond to fewer features than all of the features of any of the disclosed embodiments. Accordingly, the scope of the Disclosure is defined by the following claims and their equivalents.

Claims

1. A system (100) for monitoring carry-on baggage (102) for the flight of an aircraft (106), A camera (116, 126) positioned to capture images of carry-on baggage (102) associated with the passengers of the aircraft, wherein the camera includes a first set of cameras (116) and a second set of cameras (126), the second set of cameras being positioned to capture images of the inside of the overhead compartments of the aircraft, An interface (136) configured to receive image data (122, 132) from the camera, One or more processors (140) connected to the interface, Analyzing the image data in order to determine first information (176) including the characteristics (168) of carry-on baggage, wherein the first information for each piece of baggage includes a first dimension corresponding to the longest length of the baggage in a direction parallel to the bottom of the overhead compartment, and a second dimension corresponding to the longest length of the baggage in a direction parallel to the side of the overhead compartment. Determining that one or more alert conditions (170) are met based on a comparison of one or more alert criteria (146) with the characteristics of the carry-on baggage and data associated with the aircraft (144), wherein the first of the one or more alert conditions is that the ratio of the first dimensions of a particular piece of baggage to the second dimensions of the particular piece of baggage is greater than a threshold, and that additional space can be created by changing the orientation of the particular piece of baggage in a particular overhead compartment, and determining that one or more alert conditions (170) are met, Based on the fulfillment of one or more of the above alert conditions, outputs (124, 134) are transmitted to one or more devices (114, 120, 128, 130), One or more processors (140) configured to perform the following: Above, system (100).

2. The system according to claim 1, wherein the first set of cameras (116) is positioned to capture images of carry-on luggage within the aircraft's boarding area (110).

3. The system according to claim 1 or 2, wherein a second alert condition among the one or more alert conditions indicates that a particular storage cabinet cannot be closed.

4. The system according to any one of claims 1 to 3, wherein one of the one or more alert criteria corresponds to the carry-on baggage being oversized based on the dimensions of the carry-on baggage determined from the image data, and the output is supplied to a device (114, 120) associated with the crew, in accordance with the carry-on baggage being oversized.

5. The system according to any one of claims 1 to 4, wherein one of the one or more alert criteria corresponds to the available storage space in the overhead compartment of the aircraft being less than a threshold amount, based on information obtained from the image data, and the output is supplied to devices (114, 120) associated with the crew in response to the available storage space in the overhead compartment being less than the threshold amount.

6. The system according to claim 5, wherein the determination that the available storage space in the storage rack is less than the threshold amount is based on aircraft data (144) associated with the aircraft and the number of carry-on bags permitted to pass from the boarding area to the aircraft (156).

7. The system according to claim 5 or 6, wherein the determination that the available storage space in the storage shelf is less than the threshold amount is further based on an image of the inside of the storage shelf.

8. The system according to any one of claims 1 to 7, wherein one of the one or more alert criteria is associated with a specific storage compartment, and the output includes information transmitted to a device (130) associated with a specific crew member of the aircraft, a signal to activate a storage compartment status display device (128) associated with the specific storage compartment, or both.

9. The system according to claim 8, wherein the color of the shelf status display device is associated with a specific state of the specific storage shelf.

10. A method (400) for monitoring carry-on baggage (102) for the flight of an aircraft (106), In the monitoring device (108), receiving image data (132) from a camera (126) mounted on the aircraft (402), wherein at least a portion of the camera is positioned to capture images of the inside of a storage compartment (104) for carry-on baggage (102), The monitoring device includes analyzing the image data (404) to determine first information (176), wherein the first information includes the characteristics of the luggage in each of the storage shelves and the available storage space in each of the storage shelves, and the first information for each luggage includes a first dimension corresponding to the longest length of the luggage in a direction parallel to the bottom of the storage shelf and a second dimension corresponding to the longest length of the luggage in a direction parallel to the side of the storage shelf. The monitoring device determines (406) that one or more alert conditions (170) are met based on a comparison of one or more alert criteria (146) with the first information, wherein the first of the one or more alert conditions is that the ratio of the first dimensions of a particular item to the second dimensions of the particular item is greater than a threshold, and that additional space can be created by changing the orientation of the particular item in a particular storage shelf, and the monitoring device determines (406) that one or more alert conditions (170) are met. A method (400) comprising: transmitting an output (134) from the monitoring device to one or more devices (128, 130) based on the fulfillment of one or more of the aforementioned alert conditions (408).

11. The method according to claim 10, wherein analyzing the image data further comprises determining the state associated with each storage shelf, and transmitting the output comprises transmitting a signal to change the color of the shelf state display device (128) of the storage shelf to indicate the state associated with the storage shelf.

12. Analyzing the aforementioned image data includes determining that the state is a first state in accordance with whether there is usable space in the storage shelf, The method according to claim 11, comprising analyzing the image data to determine that the state is a third state indicating that the storage shelf is full, depending on whether the available storage space in the storage shelf is less than a threshold amount of available storage space.

13. The method according to claim 11 or 12, wherein analyzing the image data is determined to be a second state in such a way that the dimensions of the luggage placed in a particular storage shelf correspond to the dimensions associated with the personal belongings (178).

14. The method according to any one of claims 11 to 13, comprising analyzing the image data to determine that the state is a fourth state in that one or more items placed in the storage shelf are preventing the storage shelf from being closed.

15. The method according to any one of claims 10 to 14, further comprising analyzing the image data to determine the available storage space in the overhead compartment, and transmitting the output to a device (114) associated with a crew member indicating the number of additional carry-on bags that can be accommodated in the overhead compartment.

Images