A control method and device for aircraft storage

By obtaining point cloud data of obstacles in the hangar and the movement parameters of the aircraft, predicting the future movement trajectory of the aircraft and monitoring the distance to the obstacles in real time, the risk of collision during the aircraft entry is solved, and efficient and accurate entry is achieved Library operation.

CN115167431BActive Publication Date: 2024-11-29CHINA TELECOM CLOUD TECH CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202210863612.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-07-21
Publication Date
2024-11-29
Estimated Expiration
2042-07-21

AI Technical Summary

Technical Problem

During the aircraft entering the ward, due to the blind spot of the tractor driver's line of sight, collisions between the aircraft and the maintenance table or obstacles in the hangar are prone to occur. The existing manual observation methods are costly and misjudgment. risk.

Method used

By obtaining point cloud data of obstacles in the hangar, combining the movement speed and posture data of the aircraft, predicting the future movement trajectory of the aircraft, and computing the distance between the aircraft tail wing and the maintenance station in the hangar in real time, when the distance is less than or When the threshold is equal to the set value, the tractor is instructed to stop moving the aircraft.

Benefits of technology

It effectively reduces the chance of collision events during aircraft storage, saves labor costs, and improves the efficiency of aircraft storage.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115167431B_ABST
    Figure CN115167431B_ABST
Patent Text Reader

Abstract

The present application discloses a control method and device for aircraft entering a hangar, which is used to reduce the probability of collision incidents during the process of aircraft entering a hangar. The method includes: when the fuselage of the aircraft enters the hangar completely, obtaining point cloud data of obstacles in the hangar; determining the movement trajectory of the aircraft within a future set time according to the speed and posture data of the aircraft during the movement in the hangar; when it is determined according to the point cloud data that there are no obstacles on the movement trajectory, calculating the first distance between the tail of the aircraft and the maintenance platform in the hangar in real time; when the first distance is less than or equal to the first set threshold, instructing the tractor to stop moving the aircraft.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to a control method and device for aircraft storage. Background Art

[0002] Air currents and small obstacles in the air can damage the surface of an aircraft during takeoff, landing, and flight. Therefore, in order to ensure safe flight, each time an aircraft lands, it needs to be towed into the hangar by a tractor for safety inspection. However, when an aircraft is put into the hangar, there is a blind spot for the driver of the tractor, so there may be collisions between aircraft, between aircraft and the maintenance platform or obstacles in the hangar.

[0003] In the related art, in order to avoid collisions during the aircraft storage process, multiple ground crew members will cooperate to conduct manual observations and report the observed problems that may cause collisions to the driver of the tractor through a radio intercom, so as to achieve collision-free storage of the aircraft. However, this method has a high labor cost, and because the aircraft is large and has high wings, the ground crew will have line of sight errors when observing on the ground, which is easy to misjudge. Summary of the invention

[0004] The embodiment of the present application provides a control method and device for aircraft storage, wherein the aircraft is driven into the hangar by a tractor, and is used to reduce the probability of a collision incident occurring during the process of the aircraft entering the hangar.

[0005] In a first aspect, the present application provides a method for controlling aircraft storage, comprising:

[0006] When the fuselage of the aircraft enters the hangar completely, obtaining point cloud data of obstacles in the hangar;

[0007] Determine the moving trajectory of the aircraft within a set time in the future according to the speed and posture data of the aircraft during its movement in the hangar;

[0008] When it is determined according to the point cloud data that the obstacle does not exist on the moving trajectory, calculating in real time a first distance between the tail wing of the aircraft and the maintenance platform in the hangar;

[0009] When the first distance is less than or equal to a first set threshold, the tractor is instructed to stop moving the aircraft.

[0010] In some embodiments, the method further comprises:

[0011] Acquire point cloud data of the aircraft and point cloud data of the maintenance platform;

[0012] Determining standard parking position data of the aircraft according to the point cloud data of the aircraft and the point cloud data of the maintenance platform;

[0013] After instructing the tractor to stop moving the aircraft, acquiring position data of the aircraft;

[0014] When the difference between the position data of the aircraft and the standard parking position data is greater than a preset value, the position of the aircraft is adjusted until the difference between the position data of the aircraft and the position data of the standard parking position is less than or equal to the preset value.

[0015] In some embodiments, the step of obtaining point cloud data of obstacles in the hangar includes:

[0016] Acquire multiple images of various areas in the hangar taken by a camera, and acquire point cloud data of objects contained in each area;

[0017] Inputting the plurality of images into a pre-trained obstacle recognition model to determine positions of obstacles included in the plurality of images;

[0018] According to the positions of the obstacles included in the multiple images, the point cloud data of the obstacles are extracted from the point cloud data of the objects included in the respective areas.

[0019] In some embodiments, before the fuselage of the aircraft enters the hangar in its entirety, the method further comprises:

[0020] Determine, according to a distance sensor disposed on the door of the hangar, a second distance between the door of the hangar and a target position point on the fuselage of the aircraft; the target position point is a point on the fuselage of the aircraft that is closest to the door of the hangar;

[0021] If the second distance is greater than a second set threshold, continue to move the aircraft;

[0022] If the second distance is less than or equal to the second set threshold, the tractor is instructed to stop moving the aircraft, and the tractor is instructed to adjust the moving trajectory of the aircraft.

[0023] In a second aspect, an embodiment of the present application provides a control device for aircraft storage, wherein the aircraft is driven into storage by a tractor, comprising:

[0024] An acquisition unit, used for acquiring point cloud data of obstacles in the hangar when the fuselage of the aircraft enters the hangar completely;

[0025] A processing unit configured to perform:

[0026] Determine the moving trajectory of the aircraft within a set time in the future according to the speed and posture data of the aircraft during its movement in the hangar;

[0027] When it is determined according to the point cloud data that the obstacle does not exist on the moving trajectory, calculating in real time a first distance between the tail wing of the aircraft and the maintenance platform in the hangar;

[0028] When the first distance is less than or equal to a first set threshold, the tractor is instructed to stop moving the aircraft.

[0029] In some embodiments, the acquisition unit is further used to acquire point cloud data of the aircraft and point cloud data of the maintenance platform;

[0030] The processing unit is further configured to execute:

[0031] Determining standard parking position data of the aircraft according to the point cloud data of the aircraft and the point cloud data of the maintenance platform;

[0032] After instructing the tractor to stop moving the aircraft, acquiring the position data of the aircraft through the acquisition unit;

[0033] When the difference between the position data of the aircraft and the standard parking position data is greater than a preset value, the position of the aircraft is adjusted until the difference between the position data of the aircraft and the position data of the standard parking position is less than or equal to the preset value.

[0034] In some embodiments, the processing unit is specifically configured to:

[0035] Acquire, by the acquisition unit, a plurality of images of various areas in the hangar taken by a camera, and acquire point cloud data of objects contained in the various areas;

[0036] Inputting the plurality of images into a pre-trained obstacle recognition model to determine positions of obstacles included in the plurality of images;

[0037] According to the positions of the obstacles included in the multiple images, the point cloud data of the obstacles are extracted from the point cloud data of the objects included in the respective areas.

[0038] In some embodiments, the processing unit is further configured to:

[0039] Determine, according to a distance sensor disposed on the door of the hangar, a second distance between the door of the hangar and a target position point on the fuselage of the aircraft; the target position point is a point on the fuselage of the aircraft that is closest to the door of the hangar;

[0040] When the second distance is greater than a second set threshold, continue to move the aircraft;

[0041] When the second distance is less than or equal to the second set threshold, the tractor is instructed to stop moving the aircraft, and the tractor is instructed to adjust the moving trajectory of the aircraft.

[0042] In a third aspect, an electronic device is provided, the electronic device comprising a controller and a memory. The memory is used to store computer-executable instructions, and the controller executes the computer-executable instructions in the memory to use hardware resources in the controller to perform the operation steps of any possible implementation method of the first aspect.

[0043] In a fourth aspect, a computer-readable storage medium is provided, in which instructions are stored, and when the computer-readable storage medium is run on a computer, the computer executes the above-mentioned methods.

[0044] This application proposes to collect data such as the hangar, obstacles in the hangar, aircraft, and aircraft movement parameters through sensors and cameras, and to perform digital twins based on the collected data to predict the aircraft's movement trajectory and determine whether there are obstacles on the aircraft's future movement trajectory. This allows obstacles to be removed or the movement trajectory to be changed in a timely manner to avoid collisions. Compared to the prior art, the solution of this application can not only save labor costs, but also improve the efficiency of aircraft storage and reduce the probability of collisions during aircraft storage. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0046] Figure 1 A schematic diagram of a scenario of an aircraft entering a warehouse provided in an embodiment of the present application;

[0047] Figure 2 A flow chart of a control method for aircraft storage provided in an embodiment of the present application;

[0048] Figure 3 A flow chart of a control method for an aircraft passing through a hangar door provided in an embodiment of the present application;

[0049] Figure 4 A flow chart of another control method for aircraft storage provided in an embodiment of the present application;

[0050] Figure 5 A schematic diagram of the structure of a control device for aircraft storage provided in an embodiment of the present application;

[0051] Figure 6A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0052] To make the purpose, technical solution and advantages of the embodiments of the present invention more clear, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention.

[0053] It should be noted that the terms "first", "second", etc. in this application are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. On the contrary, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0054] In order to facilitate the understanding of the solution proposed in this application, the technical terms involved in this application are first introduced:

[0055] (1) Digital twin: It is a simulation process that uses data such as physical models, sensor updates, and operation history to integrate multiple disciplines, multiple physical quantities, multiple scales, and multiple probabilities, completes mapping in virtual space, and thus reflects the entire life cycle of the corresponding physical equipment. Digital twin is a concept that transcends reality and can be regarded as a digital mapping system of one or more important, interdependent equipment systems. Digital twin is currently commonly used in product design, product manufacturing, medical analysis, engineering construction and other fields.

[0056] (2) Posture data: The posture data of an object includes the object's Euler angle, axis angle, rotation matrix and quaternion. Generally, Euler angle and axis angle are three data that make up a vector, rotation matrix is ​​nine data that make up a vector, and quaternion is four data that make up a vector.

[0057] (3) Ultrasonic sensor: It detects the distance to the target by emitting ultrasonic waves with a specific frequency. The distance to the target is calculated by the time it takes for the ultrasonic waves with a specific frequency to be emitted and reflected back by the target. The current ultrasonic sensors generally have a short range in the air, with an effective detection distance of 5-10m.

[0058] (4) LiDAR sensor: used to emit laser light and measure distance based on the laser light reflected from the target. It can also perform laser scanning on the target and generate three-dimensional point cloud data of the target.

[0059] At present, since airflow and small obstacles in the air can damage the fuselage surface of the aircraft during take-off, landing and flight, in order to ensure the safe operation of the aircraft and reduce the occurrence of air crashes, the safety status of the aircraft needs to be checked after each landing. Some detailed inspections require the use of a tractor to tow the aircraft into the hangar. Since the driver of the tractor has a blind spot, the process of the aircraft entering the hangar may collide with obstacles in the surrounding environment, which may easily cause damage to the aircraft. In order to avoid such collisions, the relevant technology proposes to coordinate the driver of the tractor through multiple ground crews to avoid collisions caused by the tractor. However, the aircraft is large in size and has high wings. There may be visual errors when observing manually on the ground, which is prone to misjudgment. Therefore, the manual guidance method not only consumes human resources, but also has a relatively low success rate.

[0060] In order to solve this problem, the embodiment of the present application provides a control method for aircraft storage, and proposes to use digital twins to determine whether there are obstacles in the process of aircraft storage and parking, so that obstacles can be avoided in time and the problem of human eye error can be avoided. Compared with the existing manual observation method, the method of the present application is more efficient and accurate.

[0061] In order to facilitate understanding of the aircraft storage control method provided in the embodiment of the present application, the application scenario of the present application is first introduced. Figure 1 , which is a scene diagram of an aircraft entering a warehouse provided in an embodiment of the present application. Figure 1 The picture shows a scene where an aircraft is parked at a set parking position. It can be seen that multiple ultrasonic sensors, cameras and lidar sensors are deployed in the hangar to collect relevant data about the aircraft and its movement. Digital twins are realized based on the collected data, so that collision events can be predicted based on the model constructed by the digital twins and the predicted movement trajectory of the aircraft, thereby avoiding the occurrence of collision events.

[0062] It should be noted that Figure 1 As an example only, the present application does not limit the number of ultrasonic sensors, cameras, and lidar sensors included in the aircraft storage scenario.

[0063] Next, combine Figure 1The scene diagram shown specifically introduces the control method and device for aircraft storage proposed in this application. In the following embodiments of this application, "and / or" describes the association relationship of the associated objects, indicating that there may be three relationships, for example, A and / or B, which can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the associated objects before and after are in an "or" relationship. "At least one of the following" or its similar expressions refers to any combination of these items, including any combination of single items or plural items. For example, at least one of a, b or c can represent: a, b, c, ab, ac, bc, or abc, where a, b, c can be single or multiple. The singular expressions "one", "a kind", "said", "above", "the" and "this" are intended to also include expressions such as "one or more", unless there is a clear indication to the contrary in the context. Furthermore, unless otherwise specified, the ordinal numbers such as "first" and "second" mentioned in the embodiments of the present application are used to distinguish multiple objects, and are not used to limit the order, timing, priority or importance of multiple objects. For example, the first task execution device and the second task execution device are only used to distinguish different task execution devices, and do not indicate the difference in priority or importance of the two task execution devices.

[0064] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0065] The following is a detailed introduction to the solution provided by this application. Figure 2 , is a flow chart of a control method for aircraft storage provided by an embodiment of the present application. The method flow is executed by a control system in the hangar of the aircraft. It should be noted that the present application does not limit the specific implementation of the system for executing the method. For example, the system can be a processing chip, a processor, or other electronic device or server with computing resources, or a collection of multiple computing platforms. Figure 2 The method flow shown specifically includes:

[0066] 201, when the fuselage of the aircraft enters the hangar completely, the point cloud data of obstacles in the hangar is obtained.

[0067] Optionally, a camera or an ultrasonic sensor may be used to detect whether the entire fuselage of the aircraft has entered the hangar. After the entire fuselage of the aircraft has entered the hangar, point cloud data of obstacles in the hangar may be acquired. The point cloud data of obstacles may be used to characterize the location and size of obstacles.

[0068] In one possible implementation, when all aircraft enter the hangar, the camera can be used to capture images of various areas in the hangar, and the image recognition algorithm can be used to identify the positions of obstacles included in the captured images. Furthermore, the point cloud data of obstacles at corresponding positions can be obtained through a laser radar sensor.

[0069] In another possible implementation, a laser radar sensor may be directly used to scan various areas within the hangar to obtain point cloud data of obstacles included in each area.

[0070] 202, determining the moving trajectory of the aircraft within a set time in the future according to the speed and posture data of the aircraft during its movement in the hangar.

[0071] Alternatively, the image of the aircraft in motion may be captured by a camera, and the speed of the aircraft may be calculated based on the position of the aircraft in two or more consecutive frames of images. Alternatively, the speed of the tractor driving the aircraft may be used as the moving speed of the aircraft. Alternatively, the position and posture data of the aircraft may also be obtained through the images captured by the camera.

[0072] Furthermore, the aircraft's movement trajectory within a set time in the future can be predicted based on the aircraft's speed and posture data. For example, if the aircraft's speed is 1 meter per second and the aircraft's posture data indicates that the aircraft is in a straight-line state, then the aircraft's movement trajectory within the next 5 seconds can be determined to be the distance 5 meters directly in front of the aircraft.

[0073] 203 , when it is determined based on the point cloud data of the obstacle that there is no obstacle on the moving trajectory within the future set time, a first distance between the tail wing of the aircraft and the maintenance platform in the hangar is calculated in real time.

[0074] The point cloud data of the obstacle represents the position and size of the obstacle. After determining the movement trajectory of the aircraft within a set time in the future, it can be determined whether there is an obstacle on the predicted movement trajectory based on the position of the obstacle.

[0075] Continuing with the above example, the moving trajectory of the aircraft in the next 5 seconds is the distance of 5 meters directly in front of the aircraft. The position coordinate range of this 5-meter distance can be determined. For example, the four vertices of the position coordinate range are: (2, 3), (2, 7), (5, 3) and (5, 7). Then, it can be further determined whether the position coordinate of any obstacle falls within the range. If it does, it means that there is an obstacle on the moving trajectory of the aircraft within the future set time. If not, it means that there is no obstacle on the moving trajectory of the aircraft within the future set time.

[0076] Optionally, when it is determined that there are no obstacles on the moving trajectory of the aircraft within a set time in the future, the first distance between the tail of the aircraft and the maintenance platform in the hangar can be collected in real time. For example, the first distance to the tail can be collected by an ultrasonic sensor located at the maintenance platform. In other words, when it is determined that no collision event will occur, the distance between the tail of the aircraft and the maintenance platform can be obtained in real time to determine whether the aircraft has stopped at the designated location.

[0077] 204 , when the first distance is less than or equal to a first set threshold, instruct the tractor to stop moving the aircraft.

[0078] When it is determined that the collected first distance is less than or equal to the first set threshold, that is, it can be determined that the aircraft has stopped at the set position, and an instruction can be given to stop moving the aircraft. Optionally, instruction information for instructing to stop moving the aircraft can be sent to the communication module of the tractor, and the driver of the tractor can stop the tractor after receiving the instruction information, thereby stopping moving the aircraft.

[0079] Based on the above scheme, this application proposes to collect data such as the hangar, obstacles in the hangar, aircraft, and aircraft movement parameters through sensors and cameras, and to perform digital twins based on the collected data to predict the movement trajectory of the aircraft and determine whether there are obstacles on the aircraft's future movement trajectory. Thereby, obstacles can be removed in time or the movement trajectory can be changed in time to avoid collision incidents. Compared with the prior art, the solution of this application can not only save labor costs, but also improve the efficiency of aircraft storage and reduce the probability of collision incidents during aircraft storage.

[0080] In some scenarios, distance sensors can be configured on the hangar door, such as ultrasonic sensors, see Figure 1The scene diagram shown. An ultrasonic sensor is configured on the door to collect the distance between the hangar door and the aircraft, avoiding collision between the hangar door and the aircraft during entry. Optionally, the second distance between the hangar door and the target position point on the fuselage of the aircraft can be determined based on the ultrasonic sensor configured on the hangar door. The target position point is not the execution point, but the point where the fuselage length of the aircraft is closest to the hangar door. For example, during the process of the aircraft entering the hangar, a certain point on the nose of the aircraft is closest to the hangar door at the beginning, then this point is the target position point. After a period of time, when the wing of the aircraft passes through the door of the hangar, a certain point on the wing is closest to the door of the hangar, then this point is the target position point.

[0081] Optionally, after determining the second distance, it may be determined whether the second distance is greater than a second set threshold. If so, the aircraft continues to be moved. If not, it indicates that there is a risk of the aircraft colliding with the door of the hangar, and the tractor may be instructed to stop moving the aircraft and to adjust the movement trajectory of the aircraft to avoid the aircraft colliding with the door of the hangar.

[0082] In order to facilitate understanding of the solution proposed in this application for controlling the aircraft to avoid collision with the hangar door during the storage process, the following is an introduction in conjunction with a specific embodiment. Figure 3 , is a flow chart of a control method for an aircraft passing through a hangar door proposed in an embodiment of the present application, specifically including:

[0083] 301 , when the aircraft starts to move, detecting a second distance between the door of the hangar and a target position point on the fuselage of the aircraft.

[0084] Specifically, the distance between the hangar door and the target position point can be detected by an ultrasonic sensor configured on the hangar door. The explanation of the target position point can refer to the introduction in the above embodiment, which will not be repeated here.

[0085] 302. Determine whether the second distance is greater than a second set threshold.

[0086] If yes, return to step 301.

[0087] If not, continue to execute step 303.

[0088] 303 , generating alarm information of different levels according to the size of the second distance, and sending the generated alarm information to the tractor.

[0089] Optionally, the alarm information is used to instruct the tractor to stop moving the aircraft, and to adjust the moving trajectory of the aircraft according to the position of the target position point on the fuselage and the size of the second distance.

[0090] In an optional manner, after completing step 303 , when it is determined that the aircraft has moved again, the process may return to step 301 to continue detecting the second distance between the hangar door and the target location point.

[0091] In some embodiments, after determining that the aircraft will not collide with the hangar door during the process of entering the hangar through the hangar door, the tractor drives the aircraft into the hangar. After the fuselage of the aircraft is completely entered into the hangar, point cloud data of obstacles in the hangar can be obtained.

[0092] In one possible implementation, images of various areas in the hangar taken by a camera may be obtained. Further, the obtained images may be input into a pre-trained obstacle recognition model to determine the positions of obstacles included in the images. Further, according to the positions of the obstacles, point cloud data of the obstacles at various positions may be detected by a laser radar sensor.

[0093] In another possible implementation, based on the images of various areas in the hangar taken by the camera, the laser radar sensor can be used to detect the point cloud data of the objects contained in each area. After the location of the obstacle is identified based on the pre-trained obstacle recognition model, the point cloud data of the obstacle can be extracted from the point cloud data of the detected multiple objects.

[0094] Optionally, when the obstacle recognition model recognizes the image captured by the camera, the model can accurately recognize known obstacles, but the model cannot directly recognize some newly added obstacles. In other words, when obstacles that do not exist in the training set appear during the model training process, the model cannot directly recognize these newly added obstacles. In this case, an image recognition algorithm can be used to recognize all objects in the image. After removing the known obstacles, the remaining objects can be regarded as potential obstacles. When acquiring the obstacle point cloud data, the point cloud data of the potential obstacles also needs to be acquired.

[0095] In one possible implementation, when it is determined that there is a potential obstacle, the potential obstacle can be added to a training set for training an obstacle recognition model, and then the obstacle recognition model is trained based on the updated training set to improve the recognition accuracy of the obstacle recognition model.

[0096] In other embodiments, after determining that the entire fuselage has entered the hangar and obtaining the point cloud data of obstacles in the hangar, it is possible to determine whether there are obstacles on the historical trajectory based on the historical trajectory of past aircraft movements. If there are obstacles, the location of the obstacles can be indicated to the staff first, and the staff can clear the obstacles in advance. This can further reduce the probability of collision events.

[0097] As described above, after the point cloud data of the obstacles included in the hangar are determined, it can be further determined whether there are obstacles on the moving trajectory of the aircraft within a set time in the future based on the acquired point cloud data.

[0098] In one possible situation, if there is an obstacle on the moving trajectory of the aircraft within a set time in the future, the aircraft can be stopped to clear the obstacle or adjust the moving trajectory of the aircraft to avoid a collision.

[0099] In another possible case, if there are no obstacles on the moving trajectory of the aircraft within a set time in the future, the first distance between the tail of the aircraft and the maintenance platform in the hangar can be calculated in real time. If the first distance is greater than the first set threshold, it means that the aircraft has not stopped at the specified position, and the step of calculating the first distance is returned until the first distance is less than or equal to the first set threshold. When it is determined that the calculated first distance is less than or equal to the first set threshold, it means that the aircraft has stopped at the specified position, and the tractor can be instructed to stop moving the aircraft.

[0100] In some scenarios, after determining that the first distance between the tail of the aircraft and the maintenance platform is less than or equal to the first set threshold, it can also be determined whether the aircraft has stopped at the standard parking position. If not, the position of the aircraft can be further adjusted. The aircraft stopping at the standard parking position can facilitate the maintenance platform to inspect the aircraft.

[0101] In a possible implementation, the following method may be used to determine the standard parking position:

[0102] Optionally, the point cloud data of the aircraft and the point cloud data of the maintenance platform can be obtained. The point cloud data of the aircraft is the three-dimensional data of the fuselage of the aircraft, which is related to the model of the aircraft. The point cloud data of aircraft of different models or sizes are different. The point cloud data of the maintenance platform is used to characterize the position of each point of the maintenance platform. Further, the standard parking position of the aircraft can be determined based on the point cloud data of the aircraft and the point cloud data of the maintenance platform. For example, see Figure 1 In the scene diagram shown, the standard parking position may be the center of two maintenance stands, that is, when the aircraft is parked at the standard parking position, the horizontal line of the aircraft fuselage is perpendicular to the line between the two maintenance stands.

[0103] After determining that the first distance between the tail of the aircraft and the maintenance platform is less than or equal to the first set threshold and the aircraft is stopped from moving, the current position data of the aircraft can be obtained. Further, it can be determined whether the distance between the current position data of the aircraft and the standard parking position is greater than a preset value. If it is greater, it means that the current parking position of the aircraft is greatly offset from the standard parking position, and the position of the aircraft needs to be adjusted. The position of the aircraft can be adjusted based on the standard parking position. If it is not greater, it means that the current position of the aircraft is less offset from the standard parking position, and the position of the aircraft does not need to be adjusted.

[0104] In order to further understand the control method for aircraft storage proposed in this application, a specific embodiment is described below. Figure 4 , which is a flow chart of another control method for aircraft storage provided in an embodiment of the present application, comprising:

[0105] 401, when the aircraft starts to enter the hangar, a second distance between the target position point of the aircraft and the door of the hangar is detected in real time.

[0106] Optionally, the second distance between the hangar door and the target position point of the aircraft can be detected by an ultrasonic sensor configured on the hangar door. The introduction of the target position point can be referred to the above embodiment, which will not be repeated here.

[0107] 402, determine whether the second distance is greater than a second set threshold.

[0108] If yes, continue to execute step 403.

[0109] If not, the tractor is instructed to adjust the moving track of the aircraft according to the target position point and the second distance, and the process returns to step 401 .

[0110] 403, after the fuselage of the aircraft has completely entered the hangar, point cloud data of obstacles in the hangar is obtained.

[0111] Optionally, the steps for obtaining the point cloud data in the hangar may refer to the introduction in the above embodiment, which will not be repeated here.

[0112] 404, predicting the moving trajectory of the aircraft within a set time in the future based on the speed and posture data of the aircraft.

[0113] 405 , determine whether there is an obstacle on the moving track.

[0114] If yes, stop moving the aircraft, clear the obstacle or adjust the moving track of the aircraft, and return to step 404.

[0115] If not, continue to execute step 406.

[0116] 406 , calculating in real time a first distance between the tail wing of the aircraft and a maintenance platform in the hangar.

[0117] 407 , determining whether the first distance is less than or equal to a first set threshold.

[0118] If yes, continue to execute step 408.

[0119] If not, the process returns to step 406 .

[0120] 408, obtaining the current position data of the aircraft and the pre-configured standard parking position data.

[0121] 409, determining whether the distance between the position data and the standard parking data is greater than a preset value.

[0122] If yes, the position of the aircraft is adjusted based on the standard parking data, and the process returns to step 408 .

[0123] If not, continue to execute step 410.

[0124] 410, instructing the tug to stop moving the aircraft.

[0125] Based on the same concept as the above method, see Figure 5 , is a control device 500 for aircraft storage provided in an embodiment of the present application, the device 500 is used to execute each step in the above method, and in order to avoid repetition, it will not be described again here. The device 500 includes: an acquisition unit 501 and a processing unit 502.

[0126] An acquisition unit 501 is used to acquire point cloud data of obstacles in the hangar when the fuselage of the aircraft enters the hangar completely;

[0127] The processing unit 502 is configured to execute:

[0128] Determine the moving trajectory of the aircraft within a set time in the future according to the speed and posture data of the aircraft during its movement in the hangar;

[0129] When it is determined according to the point cloud data that the obstacle does not exist on the moving trajectory, calculating in real time a first distance between the tail wing of the aircraft and the maintenance platform in the hangar;

[0130] When the first distance is less than or equal to a first set threshold, the tractor is instructed to stop moving the aircraft.

[0131] In some embodiments, the acquisition unit 501 is further used to acquire point cloud data of the aircraft and point cloud data of the maintenance platform;

[0132] The processing unit 502 is further configured to execute:

[0133] Determining standard parking position data of the aircraft according to the point cloud data of the aircraft and the point cloud data of the maintenance platform;

[0134] After instructing the tractor to stop moving the aircraft, acquiring the position data of the aircraft through the acquisition unit 501;

[0135] When the difference between the position data of the aircraft and the standard parking position data is greater than a preset value, the position of the aircraft is adjusted until the difference between the position data of the aircraft and the position data of the standard parking position is less than or equal to the preset value.

[0136] In some embodiments, the processing unit 502 is specifically configured to:

[0137] Acquire multiple images of various areas in the hangar taken by the camera through the acquisition unit 501, and acquire point cloud data of objects contained in each area;

[0138] Inputting the plurality of images into a pre-trained obstacle recognition model to determine positions of obstacles included in the plurality of images;

[0139] According to the positions of the obstacles included in the multiple images, the point cloud data of the obstacles are extracted from the point cloud data of the objects included in the respective areas.

[0140] In some embodiments, the processing unit 502 is further configured to:

[0141] Determine, according to a distance sensor disposed on the door of the hangar, a second distance between the door of the hangar and a target position point on the fuselage of the aircraft; the target position point is a point on the fuselage of the aircraft that is closest to the door of the hangar;

[0142] When the second distance is greater than a second set threshold, continue to move the aircraft;

[0143] When the second distance is less than or equal to the second set threshold, the tractor is instructed to stop moving the aircraft, and the tractor is instructed to adjust the moving trajectory of the aircraft.

[0144] Figure 6 The electronic device 600 provided in the embodiment of the present application is shown in FIG. 6. The electronic device 600 in the embodiment of the present application may further include a communication interface 603, such as a network port, through which the electronic device may transmit data.

[0145] In the embodiment of the present application, the memory 602 stores instructions that can be executed by at least one controller 601. The at least one controller 601 can be used to execute each step in the above method by executing the instructions stored in the memory 602. For example, the controller 601 can implement the above Figure 5 The functions of the acquisition unit 501 and the processing unit 502 in .

[0146] Among them, the controller 601 is the control center of the electronic device, which can use various interfaces and lines to connect various parts of the entire electronic device, by running or executing instructions stored in the memory 602 and calling data stored in the memory 602. Optionally, the controller 601 may include one or more processing units, and the controller 601 may integrate an application controller and a modem controller, wherein the application controller mainly processes the operating system and application programs, etc., and the modem controller mainly processes wireless communications. It is understandable that the above-mentioned modem controller may not be integrated into the controller 601. In some embodiments, the controller 601 and the memory 602 may be implemented on the same chip, and in some embodiments, they may also be implemented separately on independent chips.

[0147] The controller 601 may be a general controller, such as a central processing unit (CPU), a digital signal controller, an application specific integrated circuit, a field programmable gate array or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component, which may implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of the present application. The general controller may be a microcontroller or any conventional controller, etc. The steps performed by the data statistics platform disclosed in the embodiments of the present application may be performed directly by a hardware controller, or by a combination of hardware and software modules in the controller.

[0148] The memory 602 is a non-volatile computer-readable storage medium that can be used to store non-volatile software programs, non-volatile computer executable programs and modules. The memory 602 may include at least one type of storage medium, such as a flash memory, a hard disk, a multimedia card, a card-type memory, a random access memory (English: Random Access Memory, referred to as: RAM), a static random access memory (English: Static Random Access Memory, referred to as: SRAM), a programmable read-only memory (English: Programmable Read Only Memory, referred to as: PROM), a read-only memory (English: Read Only Memory, referred to as: ROM), an electrically erasable programmable read-only memory (English: Electrically Erasable Programmable Read-Only Memory, referred to as: EEPROM), a magnetic memory, a disk, an optical disk, etc. The memory 602 is any other medium that can be used to carry or store a desired program code in the form of an instruction or data structure and can be accessed by a computer, but is not limited thereto. The memory 602 in the embodiment of the present application can also be a circuit or any other device that can realize a storage function, for storing program instructions and / or data.

[0149] By designing and programming the controller 601, for example, the code corresponding to the training method of the neural network model introduced in the aforementioned embodiment can be solidified into the chip, so that the chip can execute the steps of the aforementioned neural network model training method during operation. How to design and program the controller 601 is a technology well known to those skilled in the art and will not be repeated here.

[0150] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.

[0151] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a controller of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the controller of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0152] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0153] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0154] Although the preferred embodiments of the present application have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications falling within the scope of the present application.

[0155] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims

1. A control method for aircraft storage, wherein the aircraft is driven into storage by a tractor, characterized in that: The method comprises: When the fuselage of the aircraft enters the hangar completely, obtaining point cloud data of obstacles in the hangar; Determine the moving trajectory of the aircraft within a set time in the future according to the speed and posture data of the aircraft during its movement in the hangar; When it is determined according to the point cloud data that the obstacle does not exist on the moving trajectory, calculating in real time a first distance between the tail wing of the aircraft and the maintenance platform in the hangar; When the first distance is less than or equal to a first set threshold, instructing the tractor to stop moving the aircraft; Acquire point cloud data of the aircraft and point cloud data of the maintenance platform; Determining standard parking position data of the aircraft according to the point cloud data of the aircraft and the point cloud data of the maintenance platform; After instructing the tractor to stop moving the aircraft, acquiring position data of the aircraft; When the difference between the position data of the aircraft and the standard parking position data is greater than a preset value, the position of the aircraft is adjusted until the difference between the position data of the aircraft and the position data of the standard parking position is less than or equal to the preset value.

2. The method according to claim 1, characterized in that The step of obtaining point cloud data of obstacles in the hangar includes: Acquire multiple images of various areas in the hangar taken by a camera, and acquire point cloud data of objects contained in each area; Inputting the plurality of images into a pre-trained obstacle recognition model to determine positions of obstacles included in the plurality of images; According to the positions of the obstacles included in the multiple images, the point cloud data of the obstacles are extracted from the point cloud data of the objects included in the respective areas.

3. The method according to claim 1, characterized in that: Before the fuselage of the aircraft enters the hangar completely, the method further comprises: Determine, according to a distance sensor disposed on the door of the hangar, a second distance between the door of the hangar and a target position point on the fuselage of the aircraft; the target position point is a point on the fuselage of the aircraft that is closest to the door of the hangar; If the second distance is greater than a second set threshold, continue to move the aircraft; If the second distance is less than or equal to the second set threshold, the tractor is instructed to stop moving the aircraft, and the tractor is instructed to adjust the moving trajectory of the aircraft.

4. A control device for an aircraft entering a warehouse, wherein the aircraft is driven into the warehouse by a tractor, characterized in that: include: An acquisition unit, used for acquiring point cloud data of obstacles in the hangar when the fuselage of the aircraft enters the hangar completely; A processing unit configured to perform: Determine the moving trajectory of the aircraft within a set time in the future according to the speed and posture data of the aircraft during its movement in the hangar; When it is determined according to the point cloud data that the obstacle does not exist on the moving trajectory, calculating in real time a first distance between the tail wing of the aircraft and the maintenance platform in the hangar; When the first distance is less than or equal to a first set threshold, instructing the tractor to stop moving the aircraft; The acquisition unit is further used to acquire the point cloud data of the aircraft and the point cloud data of the maintenance platform; The processing unit is further configured to execute: Determining standard parking position data of the aircraft according to the point cloud data of the aircraft and the point cloud data of the maintenance platform; After instructing the tractor to stop moving the aircraft, acquiring the position data of the aircraft through the acquisition unit; When the difference between the position data of the aircraft and the standard parking position data is greater than a preset value, the position of the aircraft is adjusted until the difference between the position data of the aircraft and the position data of the standard parking position is less than or equal to the preset value.

5. The device according to claim 4, characterized in that The processing unit is specifically used for: Acquire, by the acquisition unit, a plurality of images of various areas in the hangar taken by a camera, and acquire point cloud data of objects contained in the various areas; Inputting the plurality of images into a pre-trained obstacle recognition model to determine positions of obstacles included in the plurality of images; According to the positions of the obstacles included in the multiple images, the point cloud data of the obstacles are extracted from the point cloud data of the objects included in the respective areas.

6. The device according to claim 4, characterized in that The processing unit is further used for: Determine, according to a distance sensor disposed on the door of the hangar, a second distance between the door of the hangar and a target position point on the fuselage of the aircraft; the target position point is a point on the fuselage of the aircraft that is closest to the door of the hangar; When the second distance is greater than a second set threshold, continue to move the aircraft; When the second distance is less than or equal to the second set threshold, the tractor is instructed to stop moving the aircraft, and the tractor is instructed to adjust the moving trajectory of the aircraft.

7. An electronic device, characterized in that: include: Memory, for storing computer instructions; A controller is connected to the memory and is used to execute computer instructions in the memory, and implement the method according to any one of claims 1 to 3 when executing the computer instructions.

8. A computer-readable storage medium, characterized in that: include: The computer-readable storage medium stores computer instructions, and when the computer instructions are executed on a computer, the computer is enabled to execute the method according to any one of claims 1 to 3.

Citation Information

Patent Citations

  • Automatic intelligent airplane traction system and method for airport ground

    CN107703944A

  • Unmanned aerial vehicle flight obstacle avoidance method, device, electronic device and storage medium

    CN109116867A

  • System and method for navigating an aircraft in a hangar

    CN109631878A