Work progress estimation device, work progress estimation method, and work progress estimation program

Abstract

A work progress estimation device (10) has a communication unit (11) that receives video obtained by photography of an aircraft (40) that is to undergo deicing work, a processing unit (12) that acquires an aircraft area (40a) that is a pixel area within the outline of the aircraft (40) and a pixel area (61) for a first color within the aircraft area on the basis of the video received during first deicing work that involves application of a first chemical agent that is the first color to the outer surface of the aircraft (40), and an estimation unit (13) that estimates the state of the progress of the first deicing work on the basis of the area fraction of the pixel area (61) for the first color relative to the aircraft area.

Description

Work progress estimation device, work progress estimation method, and work progress estimation program

[0001] The present disclosure relates to a work progress estimation device, a work progress estimation method, and a work progress estimation program.

[0002] A method has been proposed for generating an action plan for snow and ice prevention and removal from an aircraft, updating the generated action plan, transmitting the updated action plan to a snow and ice prevention and removal vehicle, and performing snow and ice prevention and removal (see, for example, Patent Document 1).

[0003] Also, there has been proposed an ice-thawing device for use on aircraft, which includes an ice-detecting camera and means for spraying an ice-thawing chemical agent (see, for example, Patent Document 2).

[0004] JP-T-2023-522484 (see, for example, claims 1 to 18) JP-T-5-508368

[0005] However, the above-mentioned conventional technology was not able to estimate with high accuracy the progress of de-icing work, which is a ground handling operation at an airport.

[0006] The present disclosure aims to provide a work progress estimation device, a work progress estimation method, and a work progress estimation program that enable the progress of de-icing work on an aircraft to be estimated with high accuracy.

[0007] The work progress estimation device disclosed herein is characterized by having a communication unit that receives imagery obtained by photographing an aircraft that is the subject of a de-icing operation; a processing unit that acquires an aircraft area, which is a pixel area within the outline of the aircraft, and a pixel area of ​​the first color in the aircraft area, based on the imagery received during the execution of a first de-icing operation of applying a first chemical of a first color to the exterior surface of the aircraft; and an estimation unit that estimates the progress of the first de-icing operation based on the area ratio of the pixel area of ​​the first color to the aircraft area.

[0008] The work progress estimation method disclosed herein is characterized by comprising the steps of receiving video obtained by photographing an aircraft that is the subject of a de-icing work; acquiring an aircraft area, which is a pixel area within the outline of the aircraft, and a pixel area of ​​the first color in the aircraft area based on the video received during the execution of a first de-icing work of applying a first chemical of a first color to the exterior surface of the aircraft; and estimating the progress of the first de-icing work based on the area ratio of the pixel area of ​​the first color to the aircraft area.

[0009] According to the present disclosure, the progress of de-icing work on an aircraft can be estimated with high accuracy.

[0010] 1 is a schematic diagram showing a work progress estimation device according to an embodiment and the state of de-icing work. (A) to (D) are diagrams showing the progress of snow and ice removal work as a first de-icing work. (A) to (D) are diagrams showing the progress of snow and ice prevention work as a second de-icing work. A diagram showing an example of the hardware configuration of a work progress estimation device according to an embodiment. A flowchart showing the operation of a work progress estimation device according to an embodiment. (A) to (D) are diagrams showing example part areas of an aircraft, relating to a first variant of the embodiment. A schematic diagram showing a work progress estimation device of variant 2 and the state of de-icing work, relating to a second variant of the embodiment.

[0011] A work progress estimation device, a work progress estimation method, and a work progress estimation program according to embodiments will be described below with reference to the drawings. The following embodiments are merely examples, and each embodiment can be modified as appropriate.

[0012] This embodiment relates to a technology for analyzing aircraft de-icing work, which is one of the ground support operations (ground handling operations) at airports, estimating the progress of the de-icing work, and notifying relevant parties (e.g., airport air traffic controllers, airline personnel, etc.) of the progress. De-icing work is carried out at airports in areas where it snows. De-icing work includes work to remove snow and ice that has adhered to the body of an aircraft (i.e., snow removal work). In general, de-icing work includes snow removal work and work to make it less likely for snow and ice to adhere to the aircraft (i.e., snow prevention work). However, the de-icing work may consist of only one of snow removal work and snow prevention work.

[0013] If airport controllers and airline personnel can estimate the progress of de-icing work with high accuracy, they can revise flight plans (i.e., update flight plans) in accordance with the progress of de-icing work.Smooth airport operations can be achieved by quickly updating flight plans.

[0014] 1 is a schematic diagram showing a work progress estimation device 10 according to an embodiment and de-icing work. The work progress estimation device 10 is a device that can implement a work progress estimation method according to an embodiment. The work progress estimation device 10 is, for example, a computer that serves as an information processing device that can execute a work progress estimation program according to an embodiment. This computer includes a computer system made up of multiple information processing devices connected via a network.

[0015] The work progress estimation device 10 receives images obtained from a camera 30 that captures images of the aircraft 40 that is the target of de-icing work, and estimates the progress of the de-icing work. While one camera 30 is shown in FIG. 1 , the work progress estimation device 10 may use multiple images captured by multiple cameras. The camera 30 that provides images to the work progress estimation device 10 may be a permanently installed camera connected to the airport control system 20. The camera 30 may be either a fixed camera whose imaging range does not change, or a movable camera whose imaging range can be changed.

[0016] The work progress estimation device 10 has a communication unit 11 that performs communication, a processing unit 12 that performs processing based on images acquired from the camera 30, and an estimation unit 13 that estimates the progress of the de-icing work.

[0017] The communication unit 11 is connected to the camera 30 via a wired or wireless connection. The communication unit 11 receives images obtained by photographing the aircraft 40 that is the target of the de-icing work. In the example of Figure 1, the work progress estimation device 10 is also connected to an airport control system 20 so as to be able to communicate with it.

[0018] Figures 2(A) to 2(D) are diagrams showing the progress of snow and ice removal work as the first de-icing work. Figure 2(A) schematically shows the situation when the progress rate of the first de-icing work is 0%, Figure 2(B) schematically shows the situation when the progress rate of the first de-icing work is approximately 50%, Figure 2(C) schematically shows the situation when the progress rate of the first de-icing work is more than 50% but not yet 100%, and Figure 2(D) schematically shows the situation when the progress rate of the first de-icing work is 100%.

[0019] The processing unit 12 acquires an aircraft region 40a, which is a pixel region within the outline of the aircraft 40, and a first-color pixel region 61 in the aircraft region 40a, based on the video received by the communication unit 11 during the execution of a first de-icing operation in which a first agent 51 of a first color is applied to the exterior surface of the aircraft 40 (i.e., the surface of the fuselage). A known method can be used to divide the image into a target object region (foreground region) and a background region. The first de-icing operation is, for example, a snow / ice removal operation to remove snow and ice adhering to the fuselage of the aircraft 40. The first de-icing operation is, for example, a snow / ice removal operation to apply a first agent 51 of a first color, which is a first de-icing agent (first ADF (Anti- / Deicing Fluid)), to the exterior surface of the aircraft 40. The snow / ice removal operation is, for example, an operation to spray or apply the snow / ice removal fluid, which is the first ADF. Typically, the first color is orange.

[0020] The estimation unit 13 estimates the progress of the first de-icing work based on the area ratio of the first color pixel regions 61 to the aircraft region 40a. The estimation unit 13 calculates the ratio of the area of ​​the first color pixel regions 61 to the area of ​​the aircraft region 40a (i.e., the area ratio of the region whose color has changed to the first color), and outputs this ratio as the progress rate [%] of the first de-icing work.

[0021] The progress status of the first de-icing work estimated by the estimation unit 13 may be output as a scheduled time for completion of the first de-icing work or a remaining work time required until the first de-icing work is completed. At least one of the progress rate of the first de-icing work, the scheduled time for completion of the first de-icing work, and the remaining work time of the first de-icing work is notified.

[0022] Figures 3(A) to 3(D) are diagrams showing the progress of snow and ice prevention work as the second de-icing work. Figure 3(A) schematically shows the situation when the progress rate of the second de-icing work is 0%, Figure 3(B) schematically shows the situation when the progress rate of the second de-icing work is approximately 50%, Figure 3(C) schematically shows the situation when the progress rate of the second de-icing work exceeds 50%, and Figure 3(D) schematically shows the situation when the progress rate of the second de-icing work is 100%.

[0023] The second de-icing operation is performed after the first de-icing operation. The processing unit 12 acquires the aircraft region 40a and the second-color pixel region 62 in the aircraft region 40a based on the video received by the communication unit 11 during the second de-icing operation, which applies a second agent 52 of a second color different from the first color to the exterior surface of the aircraft 40. The second de-icing operation is, for example, a snow and ice prevention operation that makes it difficult for snow and ice to adhere to the fuselage of the aircraft 40. The second de-icing operation is, for example, a snow and ice prevention operation that applies a second snow and ice prevention and removal agent (second ADF), which is the second agent 52 of the second color, to the exterior surface of the aircraft 40. The snow and ice prevention operation is, for example, a work of spraying or applying a snow and ice prevention liquid, which is the second ADF. Typically, the second color is green.

[0024] The estimation unit 13 estimates the progress of the second de-icing work based on the area ratio of the second color pixel regions 62 to the aircraft region 40a. The estimation unit 13 calculates the ratio of the area of ​​the second color pixel regions 62 to the area of ​​the aircraft region 40a (i.e., the area ratio of the region whose color has changed to the second color), and outputs this ratio as the progress rate [%] of the second de-icing work.

[0025] The progress status of the second de-icing work estimated by the estimation unit 13 may be output as a scheduled time for completion of the second de-icing work or a remaining work time required until the second de-icing work is completed. At least one of the progress rate of the second de-icing work, the scheduled time for completion of the second de-icing work, and the remaining work time of the second de-icing work is notified.

[0026] 4 is a diagram showing an example of the hardware configuration of a work progress estimation device 10 according to an embodiment. The work progress estimation device 10 has a processor 101 such as a CPU (Central Processing Unit), memory 102 such as a RAM (Random Access Memory), a storage device 103 such as a non-volatile storage device such as an HDD (Hard Disk Drive) or SSD (Solid State Drive), and a communication device 104 corresponding to the communication unit 11 in FIG. 1. These components may be configured using dedicated processing circuits.

[0027] The processor 101 can execute a work progress estimation program according to an embodiment. The work progress estimation program is stored on a recording medium such as an SD (Secure Digital) memory card or a USB (Universal Serial Bus) memory card, or is provided by downloading via a network. The hardware configuration shown in FIG. 4 is an example, and various modifications are possible to the hardware configuration.

[0028] 5 is a flowchart showing the operation of the work progress estimation device 10 according to the embodiment. In this embodiment, the first de-icing operation is performed first, and then the second de-icing operation is performed.

[0029] In the first de-icing operation, the communication unit 11 receives images obtained by photographing the target aircraft 40 (step S1). The reception of images is carried out throughout all steps of the first de-icing operation.

[0030] Next, the processing unit 12 acquires the aircraft area 40a, which is a pixel area within the outline of the aircraft 40, and the pixel area 61 of the first color in this aircraft area 40a, based on the image received during the execution of the first de-icing operation, which applies (e.g., sprays or paints) the first ADF of the first color to the exterior surface of the aircraft 40 (step S2).

[0031] Next, the estimation unit 13 estimates the progress of the first de-icing work (for example, calculates the progress rate) based on the area ratio of the first color pixel region 61 to the aircraft region 40a (step S3).

[0032] The processes of steps S1 to S3 are repeatedly executed until the first de-icing operation is completed (step S4). The first de-icing operation is determined to be completed when the progress rate reaches 100% (or exceeds a predetermined value), for example.

[0033] In the second de-icing operation, the communication unit 11 receives images obtained by photographing the target aircraft 40 (step S5). The reception of images is carried out throughout the entire process of the second de-icing operation.

[0034] Next, the processing unit 12 acquires the aircraft region 40a, which is a pixel region within the outline of the aircraft 40, and the pixel region 62 of the second color in this aircraft region 40a, based on the image received during the execution of the second de-icing operation, which applies (e.g., sprays or paints) a second ADF of the second color to the exterior surface of the aircraft 40 (step S6).

[0035] Next, the estimation unit 13 estimates the progress of the second de-icing work (for example, calculates the progress rate) based on the area ratio of the second color pixel region 62 to the aircraft region 40a (step S7).

[0036] The processes of steps S5 to S7 are repeatedly executed until the first de-icing operation is completed (step S8). The second de-icing operation is determined to be completed when the progress rate reaches 100% (or exceeds a predetermined value), for example.

[0037] As described above, according to this embodiment, it is possible to estimate with high accuracy the progress status of the de-icing work on the aircraft 40. Specifically, it is possible to recognize the areas to which the first ADF, which is a snow-removing agent, and the areas to which the second ADF, which is a snow-proofing agent, is applied, and estimate the progress status of the de-icing work at the current time as a progress rate.

[0038] Furthermore, according to this embodiment, it is possible to notify the estimated time when the first de-icing work will be completed based on the progress of the first de-icing work and the current time. Alternatively, according to this embodiment, it is possible to notify the remaining work time required to complete the first de-icing work based on the progress of the first de-icing work (for example, a calculated value of the work progress rate).

[0039] Furthermore, according to this embodiment, it is possible to notify the estimated time when the second de-icing work will be completed based on the progress of the second de-icing work and the current time. Alternatively, according to this embodiment, it is possible to notify the remaining work time required from the start of the second de-icing work until the second de-icing work is completed.

[0040] In this embodiment, an example has been described in which both the first de-icing work and the second de-icing work are performed, but the progress status can also be estimated when only one of the de-icing work is performed.

[0041] <<Variation 1>> Figures 6(A) to 6(D) are diagrams showing examples of part regions of an aircraft 40 according to Variation 1 of the embodiment. Figure 6(A) shows a right wing region 42 as a part region, and Figure 6(B) shows a fuselage region 41 as a part region. Figure 6(C) shows a left wing region 43 as a part region, and Figure 6(D) shows a tail region 44 as a part region.

[0042] In the work progress estimation device of variant example 1, the processing unit 12 divides the aircraft region 40a into a plurality of part regions corresponding to a plurality of parts of the aircraft 40, and the estimation unit 13 estimates the partial progress status, which is the progress status of the first de-icing work in each of the plurality of part regions, based on the area proportion of the first color pixel region 61 in each of the plurality of part regions (e.g., fuselage region 41, right wing region 42, left wing region 43, tail region 44).

[0043] Furthermore, in the work progress estimation device of variant example 1, the processing unit 12 divides the aircraft region 40a into a plurality of part regions corresponding to a plurality of parts of the aircraft 40, and the estimation unit 13 estimates the partial progress status, which is the progress status of the second de-icing work in each of the plurality of part regions, based on the area proportion of the second color pixel region 62 in each of the plurality of part regions (e.g., fuselage region 41, right wing region 42, left wing region 43, tail region 44).

[0044] According to the first modification, the progress of the de-icing work on the aircraft 40 can be estimated with high accuracy for each region. Specifically, the regions to which the first ADF, which is a snow-removing agent, and the regions to which the second ADF, which is a snow-proofing agent, have been applied can be recognized, and the progress of the de-icing work at the current time can be estimated as a progress rate for each region. For example, according to the first modification, the progress rate of the de-icing work can be notified as "right wing region 0%, left wing region 100%, fuselage region 50%, tail region 0%."

[0045] Other than the above, the first modification is the same as the example described with reference to FIGS.

[0046] <<Variation 2>> Figure 7 is a schematic diagram showing a work progress estimation device 10 and de-icing work according to Variation 2 of the embodiment. In Figure 7, the work progress estimation device 10 is provided as part of an airport control system 20a. This type of configuration can be realized by installing the work progress estimation program according to the embodiment on a computer (including a computer system consisting of multiple information processing devices) of the airport control system 20a. In all other respects, Variation 2 is the same as the examples described with reference to Figures 1 to 6.

[0047] 10 Work progress estimation device, 11 Communication unit, 12 Processing unit, 13 Estimation unit, 20, 20a Airport control system, 30 Camera, 40 Aircraft, 40a Aircraft area, 41 Fuselage area (part area), 42 Right wing area (part area), 43 Left wing area (part area), 44 Tail area (part area), 51 First ADF (first agent), 52 Second ADF (second agent), 61 First color pixel area, 62 Second color pixel area.

Claims

1. A communications unit that receives images obtained by photographing the aircraft subject to de-icing work, A processing unit that acquires an aircraft region, which is a pixel region within the contour of the aircraft, and a pixel region of the first color within the aircraft region, based on the image received during the execution of a first de-icing operation in which a first color first agent is applied to the outer surface of the aircraft. An estimation unit that estimates the progress of the first de-icing operation based on the area ratio of the pixel area of ​​the first color to the aircraft area, A work progress estimation device characterized by having the following features.

2. The progress of the first de-icing operation estimated by the estimation unit includes the scheduled time when the first de-icing operation will be completed or the remaining time required until the first de-icing operation is completed. The work progress estimation device according to feature 1.

3. The processing unit divides the aircraft region into multiple region areas corresponding to multiple parts of the aircraft, The estimation unit estimates the partial progress status, which is the progress status of the first de-icing operation in each of the multiple sub-regions, based on the area ratio of the pixel region of the first color in each of the multiple sub-regions. The work progress estimation device according to feature 1.

4. The processing unit acquires the pixel region of the second color in the aircraft region based on the image received during the execution of a second de-icing operation in which a second agent of a second color different from the first color is applied to the aircraft, The estimation unit estimates the progress of the second de-icing operation based on the area ratio of the pixel area of ​​the second color to the aircraft area. The work progress estimation device according to feature 1.

5. The progress of the second de-icing operation estimated by the estimation unit includes the scheduled time when the second de-icing operation will be completed or the remaining time required until the second de-icing operation is completed. The work progress estimation device according to feature 4.

6. The processing unit divides the aircraft region into multiple region areas corresponding to multiple parts of the aircraft, The estimation unit estimates the partial progress status, which is the progress status of the second de-icing operation in each of the multiple sub-regions, based on the area ratio of the second color pixel region in each of the multiple sub-regions. The work progress estimation device according to feature 4.

7. The first color is the color of the snow-removing de-icing agent, which is the first chemical agent. A work progress estimation device according to any one of claims 1 to 6.

8. The first color is the color of the snow-removing de-icing agent as the first chemical agent. The second color is the color of the de-icing agent, which is the second chemical agent. The work progress estimation device according to any one of claims 4 to 6.

9. A work progress estimation method performed by a work progress estimation device, The steps include receiving images obtained by photographing the aircraft subject to de-icing work, The steps include acquiring an aircraft region, which is a pixel region within the contour of the aircraft, and a pixel region of the first color within the aircraft region, based on the image received during the execution of a first de-icing operation in which a first color first agent is applied to the outer surface of the aircraft, A step of estimating the progress of the first de-icing operation based on the area ratio of the pixel area of ​​the first color to the aircraft area, A method for estimating work progress, characterized by having the following features.

10. On the computer, The steps include receiving images obtained by photographing the aircraft subject to de-icing work, The steps include acquiring an aircraft region, which is a pixel region within the contour of the aircraft, and a pixel region of the first color within the aircraft region, based on the image received during the execution of a first de-icing operation in which a first color first agent is applied to the outer surface of the aircraft, A step of estimating the progress of the first de-icing operation based on the area ratio of the pixel area of ​​the first color to the aircraft area, A work progress estimation program characterized by causing the execution of a specific action.