Work progress estimation device and work progress estimation method

JPWO2024189772A5Active Publication Date: 2025-02-19MITSUBISHI ELECTRIC CORP
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
JP2023539328
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2023-03-14
Publication Date
2025-02-19
Estimated Expiration
2043-03-14

AI Technical Summary

Technical Problem

Conventional methods for estimating work progress at airports, such as those disclosed in Patent Document 1, rely on past statistics, leading to lower accuracy compared to using the latest information.

Method used

A work progress estimation device and method that acquires images of an airport apron and flight information, estimates the number of baggage movements, calculates unloaded or loaded baggage amounts, and updates scheduled end times based on real-time data to improve accuracy.

Benefits of technology

Enables high-accuracy estimation of work progress by utilizing the latest flight information, allowing for timely adjustments to work plans and aircraft operations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000007_0000
    Figure 00000007_0000
  • Figure 00000007_0001
    Figure 00000007_0001
  • Figure 00000007_0002
    Figure 00000007_0002
Patent Text Reader

Abstract

The work progress estimation device (3) includes an acquisition unit (31) that acquires an image (IM) including an airport parking lot, and an estimation unit (32) that estimates work progress information indicating the progress of work at the parking lot based on flight information of aircraft in the parking lot and the image (IM).
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to a work progress estimation device and a work progress estimation method for estimating work progress information indicating the progress of work at an airport.

Background Art

[0002] Ground operations carried out between the landing and takeoff of an aircraft at an airport are carried out according to a work plan. The work plan is a plan for determining which flight (or which ground operation) is assigned to which worker, and is formulated according to the flight schedule of the aircraft. In order for the aircraft to take off according to the flight schedule, it is necessary that the ground operations be carried out as planned. Therefore, it is important to grasp the progress of the work.

[0003] Patent Document 1 discloses an aircraft turnaround monitoring system that estimates the time required for each ground operation from the statistics of the time taken for past ground operations.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] In the conventional technology disclosed in Patent Document 1, since the time required for each ground operation is estimated based on past history, there is a problem that the estimation accuracy is lower than when estimating based on the latest information.

[0006] The present disclosure has been made to solve the above problems, and an object thereof is to provide a work progress estimation device and a work progress estimation method capable of accurately estimating the progress of work.

Means for Solving the Problems

[0007] The work progress estimation device according to this disclosure includes an acquisition unit that acquires video footage including the airport apron, and an acquisition unit that estimates work progress information, including the progress of work at the apron, based on flight information of aircraft parked in the apron and the video footage. The system then recognizes the luggage moving between the aircraft and the luggage transport vehicle from the video footage to estimate the number of luggage items, and updates the work progress information to reflect the estimated completion time for the luggage unloading or loading operation, based on the amount of luggage unloaded or loaded and the number of luggage items included in the flight information. It comprises an estimation unit and

[0008] Furthermore, the work progress estimation method relating to this disclosure includes the steps of acquiring video footage including the airport apron and estimating work progress information, including the progress of work at the apron, based on the flight information of aircraft parked in the apron and the video footage. The system then recognizes the luggage moving between the aircraft and the luggage transport vehicle from the video footage to estimate the number of luggage items, and updates the work progress information to reflect the estimated completion time for the luggage unloading or loading operation, based on the amount of luggage unloaded or loaded and the number of luggage items included in the flight information. The steps to do, The computer executes A method for estimating the progress of work. [Effects of the Invention]

[0009] According to this disclosure, the work progress estimation device and work progress estimation method can estimate the progress of work accurately because they do so based on the latest flight information. [Brief explanation of the drawing]

[0010] [Figure 1] This is an example of a configuration diagram of the work progress estimation device according to Embodiment 1. [Figure 2] This is an example of flight information stored in the memory device according to Embodiment 1. [Figure 3] This is an example of an image captured by the imaging device according to Embodiment 1. [Figure 4] This is an example of work progress information estimated by the estimation unit according to Embodiment 1. [Figure 5] This flowchart shows an example of the operation procedure of the work progress estimation device according to Embodiment 1. [Figure 6] This is an example of a hardware configuration diagram for the work progress estimation device according to Embodiment 1. [Modes for carrying out the invention]

[0011] The following describes in detail, with reference to the drawings, the work progress estimation device and work progress estimation method according to the embodiment.

[0012] Embodiment 1. Figure 1 is an example of a configuration diagram of the work progress estimation device 3 according to Embodiment 1. The work progress estimation device 3 comprises an acquisition unit 31, an estimation unit 32, a determination unit 33, and a notification unit 34. The work progress estimation device 3 is operated, for example, by a company that operates airport turnaround operations.

[0013] The acquisition unit 31 acquires flight information of aircraft A1 stored in the storage device 1 and video IM captured by the imaging device 2. The storage device 1 is operated, for example, by the airport operator. The airport operator records the latest flight information in the storage device 1. Alternatively, an airline may record the latest flight information in the recording device 1. The imaging device 2 is, for example, a camera installed on the airport's apron and captures video IM including the apron. The flight information includes at least information about aircraft A1 on the apron. The flight information and video IM will be described in detail later with reference to Figures 2 and 3.

[0014] The estimation unit 32 estimates work progress information indicating the progress of work on the apron based on the flight information of aircraft A1 on the apron and the video information. Specifically, the estimation unit 32 estimates the type of work on the apron and the start time of that work by image recognition of the video information. The estimation unit 32 estimates the time required to perform each task based on the flight information. Based on the start time of the work and the time required to perform the work, the estimation unit 32 estimates the scheduled end time of the work and estimates the progress of the work.

[0015] The determination unit 33 determines whether the work is behind schedule based on the work progress information. Specifically, the determination unit 33 determines whether the work is behind schedule based on whether the scheduled work completion time in the work progress information is past the scheduled departure time (or a predetermined time before the scheduled departure time).

[0016] The notification unit 34 outputs the work progress information estimated by the estimation unit 32 and the determination result determined by the determination unit 33. The notification unit 34 outputs the work progress information and the determination result to a display device (not shown) such as a monitor.

[0017] The notification unit 34 is a device (not shown) used by an operator who operates the turn-around operation at an airport, and may output the work progress information and the determination result to a device different from the work progress estimation device 3. As an example, based on the work progress information and the determination result, the device determines whether it is necessary to change the originally planned work plan, and if it is determined that a change is necessary, the work plan is changed.

[0018] The notification unit 34 may output the work progress information and the determination result to air traffic control. As an example, air traffic control determines the order of runway use based on the work progress information and the determination result. Specifically, air traffic control gives an instruction to take off the aircraft A1 parked at an airport where no work delay has occurred first, and take off the aircraft A1 parked at an airport where a work delay has occurred later.

[0019] The notification unit 34 may output the work progress information and the determination result to a device (not shown) used by the airport operator. As an example, based on the work progress information and the determination result, the device determines the airport to be assigned to the subsequent aircraft A1. Specifically, the device assigns the subsequent aircraft A1 to an airport where no work delay has occurred, and does not assign the subsequent aircraft A1 to an airport where a work delay has occurred.

[0020] Note that the notification unit 34 may output either the work progress information or the determination result.

[0021] The storage device 1 and the work progress estimation device 3 are connected to a network. The storage device 1 and the work progress estimation device 3 send and receive information from each other via the network. In Embodiment 1, the network is a WAN (Wide Area Network) such as the Internet, but it may also be a LAN (Local Area Network).

[0022] Figure 2 shows an example of flight information stored in the storage device 1 according to Embodiment 1. The flight information includes the parking spot number, aircraft registration number, type of work, departure point, destination, estimated arrival time, estimated departure time, number of passengers disembarking, number of passengers boarding, amount of cargo unloaded, and amount of cargo loaded.

[0023] The parking spot number is the number indicating the location where aircraft A1 will be parked. The aircraft registration number is a number that uniquely identifies the parked aircraft A1. The work type is the work ID assigned to the parked aircraft A1. The departure point is information indicating which airport aircraft A1, corresponding to the aircraft registration number, came from. The destination is information indicating the destination of aircraft A1, corresponding to the aircraft registration number. The estimated arrival time is the time the aircraft is scheduled to arrive at the airport where the work will be performed. The estimated departure time is the time the aircraft is scheduled to depart from the airport where the work will be performed. The number of disembarking passengers P2 is the number of passengers P2 disembarking at the airport where the work will be performed. The number of boarding passengers P2 is the number of passengers P2 boarding at the airport where the work will be performed. The unloading volume is the amount of luggage to be unloaded at the airport where the work will be performed. The loading volume is the amount of luggage to be loaded at the airport where the work will be performed.

[0024] In the example shown in Figure 2, the types of work performed on aircraft A1 (aircraft registration number "AA1234") in the parking area corresponding to parking area number 1 are "OP003" and "OP005".

[0025] In the example shown in Figure 2, the flight information includes both the number of passengers (number of disembarking and boarding) and the amount of luggage (amount of luggage unloaded and loaded). However, if the amount of luggage checked in by passengers is large and the amount of other cargo is small, it is sufficient to include at least one of the passenger count or luggage count. This is because the approximate amount of luggage can be estimated from the number of passengers. Similarly, the approximate number of passengers can be estimated from the luggage count.

[0026] Figure 3 is an example of an image IM captured by the imaging device 2 according to Embodiment 1. In the example shown in Figure 3, the estimation unit 32 recognizes an aircraft A1, a baggage transport vehicle V1, a refueling vehicle V2, a passenger boarding bridge P1, and a passenger P2 passing over the passenger boarding bridge P1 from the image IM.

[0027] Figure 4 shows an example of work progress information estimated by the estimation unit 32 according to Embodiment 1. The work progress information includes the parking space number, aircraft number, work type, work start time, work end time, work progress status, scheduled departure time, and update time.

[0028] The start time of the work is the time estimated by the estimation unit 32 based on the video information. In Figure 2, for example, let's assume that work type "OP003" corresponding to parking space number 1 is unloading and loading work, and work type "OP005" is refueling work. In the video information shown in Figure 3, the estimation unit 32 recognizes a baggage transport vehicle V1 approaching aircraft A1. When the estimation unit 32 recognizes that the baggage transport vehicle V1 has stopped in front of aircraft A1, it determines that the unloading and loading work has started. As shown in Figure 4, the estimation unit 32 estimates the start time of the unloading and loading work to be 13:15. Similarly, in the video information shown in Figure 3, the estimation unit 32 recognizes a refueling vehicle V2 approaching aircraft A1. When the estimation unit 32 recognizes that the refueling vehicle V2 has stopped in front of aircraft A1, it determines that the refueling work has started. As shown in Figure 4, the estimation unit 32 estimates the start time of the refueling work to be 13:30.

[0029] The estimated completion time of the work is the time estimated by the estimation unit 32 based on flight information. The estimation unit 32 estimates the time required to perform the unloading and loading operations based on the unloading and loading amounts shown in Figure 2. Then, the estimation unit 32 estimates the estimated completion time of the work based on the start time of the work and the time required to perform the work. As shown in Figure 4, the estimation unit 32 estimates that the time required to perform the unloading and loading operations is 1 hour. Then, the estimation unit 32 estimates the estimated completion time of the work to be 14:15. Similarly, the estimation unit 32 estimates the amount of fuel consumed based on the distance from the departure point to the target airport where the work will be performed, as shown in Figure 2, and estimates the time required to perform the refueling operation. Then, the estimation unit 32 estimates the estimated completion time of the work based on the start time of the work and the time required to perform the work. As shown in Figure 4, the estimation unit 32 estimates that the time required to perform the refueling operation is 15 minutes. Then, the estimation unit 32 estimates the estimated completion time of the work to be 13:45.

[0030] The work progress status visualizes the progress of each task. Specifically, the work progress status is expressed as a percentage and a warning mark at the update time when the work progress information shown in Figure 4 is updated. For example, the update time of the work progress information for parking space number 1 is exactly halfway between the start time and the scheduled end time of task type "OP003," so the work progress status of task type "OP003" is 50%. Furthermore, the scheduled end time of task type "OP003" has passed the scheduled departure time of aircraft A1 with aircraft registration number "AA1234," so a rain mark is displayed as a warning mark indicating that the work is delayed. On the other hand, the work progress status of task type "OP005" is 100%, meaning that it is completed. For this reason, a sunny mark is displayed as a warning mark for task type "OP005," indicating that the work is on schedule and not delayed.

[0031] Furthermore, if the work type "OP003" is loading and unloading, the estimation unit 32 may estimate the number of packages being moved by recognizing the packages moving between the aircraft A1 and the cargo transport vehicle V1. The estimation unit 32 may then update the estimated completion time of the work as appropriate based on the number of packages being moved.

[0032] In the example shown in Figure 4, the determination unit 33 determines that work type "OP003" is behind schedule, and that work types "OP005" and "OP010" are not behind schedule. The notification unit 34 outputs the work progress information and the determination result of the determination unit 33.

[0033] When the notification unit 34 outputs work progress information and judgment results to equipment operated by the operator managing airport turnaround operations, the equipment may recover from work delays by planning to increase the number of workers performing work type "OP003" as the revised work plan. In addition, the estimation unit 32 may update the time required to perform the work in accordance with the change in the work plan.

[0034] Figure 5 is a flowchart showing an example of the operation procedure of the work progress estimation device 3 according to Embodiment 1. That is, Figure 5 is a flowchart showing an example of the work progress estimation method according to Embodiment 1. As a prerequisite for the operation procedure described below, the latest flight information is stored in the storage device 1.

[0035] In step ST1, the acquisition unit 31 acquires flight information from the storage device 1 and video IM from the imaging device 2.

[0036] In step ST2, the estimation unit 32 estimates work progress information based on the flight information and video IM acquired by the acquisition unit 31.

[0037] In step ST3, the determination unit 33 determines whether or not the work is behind schedule based on the work progress information estimated by the estimation unit 32.

[0038] In step ST4, the notification unit 34 outputs the work progress information estimated by the estimation unit 32 and the determination result determined by the determination unit 33. With this, the work progress estimation device 3 completes its operation according to the procedure shown in Figure 5.

[0039] According to Embodiment 1, the estimation unit 32 estimates work progress information using the latest flight information, thereby enabling accurate estimation of work progress.

[0040] Here, the hardware configuration of the work progress estimation device 3 in Embodiment 1 will be described. Each function of the work progress estimation device 3 can be realized by a processing circuit. The processing circuit comprises at least one processor and at least one memory.

[0041] Figure 6 shows the hardware configuration of the work progress estimation device 3 in Embodiment 1. The work progress estimation device 3 can be realized by the processor 6 and memory 7 shown in Figure 6(a). The processor 6 is, for example, a CPU (Central Processing Unit, central processing unit, processing unit, arithmetic unit, microprocessor, microcomputer, processor, also called a DSP (Digital Signal Processor)) or a system LSI (Large Scale Integration).

[0042] Memory 7 includes, for example, non-volatile or volatile semiconductor memory such as RAM (Random Access Memory), ROM (Read Only Memory), flash memory, EPROM (Erasable Programmable Read Only Memory), EEPROM (Registered Trademark) (Electrically Erasable Programmable Read-Only Memory), HDD (Hard Disk Drive), magnetic disk, flexible disk, optical disk, compact disk, minidisc, or DVD (Digital Versatile Disk).

[0043] The functions of each part of the work progress estimation device 3 are realized by software, etc. (software, firmware, or software and firmware). The software, etc. is written as a program and stored in memory 7. The processor 6 realizes the functions of each part by reading and executing the program stored in memory 7. In other words, this program can be said to cause the computer to execute the procedures or methods of the work progress estimation device 3.

[0044] The program executed by processor 6 may be provided as a computer program product, stored on a computer-readable storage medium, in an installable or executable file format. Alternatively, the program executed by processor 6 may be provided to the work progress estimation device 3 via a network such as the Internet.

[0045] Alternatively, the work progress estimation device 3 may be implemented by a dedicated processing circuit 8 shown in Figure 6(b). If the processing circuit 8 is dedicated hardware, it may be, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or a combination thereof.

[0046] The above describes a configuration in which the functions of each component of the work progress estimation device 3 are realized either by software or by hardware. However, this is not the only configuration; some components of the work progress estimation device 3 may be realized by software, while others may be realized by dedicated hardware.

[0047] The configuration shown in Embodiment 1 above is merely an example and can be combined with other known technologies. [Explanation of Symbols]

[0048] 1 Storage device, 2 Imaging device, 3 Work progress estimation device, 31 Acquisition unit, 32 Estimation unit, 33 Judgment unit, 34 Notification unit, 6 Processor, 7 Memory, 8 Processing circuit, IM Video, A1 Aircraft, V1 Luggage transport vehicle, V2 Fueling vehicle, P1 Passenger boarding bridge, P2 Passengers.

Claims

1. an acquisition unit for acquiring video including an airport parking area; an estimation unit that estimates work progress information including a progress status of work at the parking lot based on flight information of aircraft parked at the parking lot and the image; A work progress estimation device comprising:

2. A work progress estimation device as claimed in claim 1, The estimation unit is a work progress estimation device that updates the work progress information based on the video.

3. A work progress estimation device as claimed in claim 2, The estimation unit estimates the number of pieces of luggage by recognizing the pieces of luggage moving between the aircraft and the luggage transport vehicle from the video, and updates the work progress information based on the number of pieces of luggage.

4. A work progress estimation device according to any one of claims 1 to 3, The estimation unit is a work progress estimation device that expresses the progress status of the work in terms of a percentage.

5. The work progress estimation device according to any one of claims 1 to 3, The estimation unit includes, as the work progress information, Estimating a work type and a work start time of the work based on the image; estimating the time required to perform the task based on the flight information; estimating a scheduled work completion time based on the work start time and the time required to perform the work; Work progress estimation device.

6. 3. The work progress estimation device according to claim 1, The estimation unit estimates the work progress information based on the flight information including at least one of the number of passengers and the amount of baggage.

7. The work progress estimation device according to any one of claims 1 to 3, A work progress estimation device comprising a determination unit that determines whether the work is delayed based on the work progress information.

8. acquiring an image including an airport apron; estimating work progress information including a progress status of work at the parking lot based on flight information of aircraft parked at the parking lot and the image; A work progress estimation method comprising: