Device for monitoring loading operation

By inserting and moving imaging equipment in the loading space of the carrier tool to capture three-dimensional data, the problem of difficult monitoring of load space utilization in the prior art is solved, efficient monitoring and utilization of the loading space of the carrier tool is achieved, and the shipment efficiency is improved.

CN222097552UActive Publication Date: 2024-12-03HAND HELD PRODS INC
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202322945578.1
Authority / Receiving Office
CN · China
Patent Type
Utility models(China)
Current Assignee / Owner
Priority Date
2022-11-15
Filing Date
2023-11-01
Publication Date
2024-12-03
Estimated Expiration
2033-11-01

AI Technical Summary

Technical Problem

The prior art is difficult to effectively monitor and utilize the loading space of carrier tools, resulting in waste of resources, increased costs and delays in shipment.

Method used

A device for monitoring loading operations is designed, including a movable body, an imaging device, a distance measuring device and a controller. By inserting and moving the imaging device in the loading space, three-dimensional imaging data is captured and the space utilization and loading status of the loading space are detected. , and process data through machine learning to determine progress and unused space for loading operations.

Benefits of technology

Efficient monitoring and utilization of the loading space of the carrier tool is achieved, reducing resource waste and cost increase, and improving shipping efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN222097552U_ABST
    Figure CN222097552U_ABST
Patent Text Reader

Abstract

An apparatus for monitoring loading operations. Various embodiments of the utility model relate to a device for monitoring loading operation, comprising: a movable main body configured to be inserted into a loading space of a carrying tool during loading operation and close to the upper part of the loading space; an imaging device fixed to the movable body, the imaging device configured to capture imaging data of the loading space, where the captured imaging data includes a three-dimensional (3D) map of the loading space; a distance measuring device fixed to the movable body, the distance measuring device configured to measure a distance between the imaging device and a front wall of the loading space; and a controller configured to receive imaging data captured by the imaging device, where the controller includes one or more processors configured to detect a loading condition of a loading space of the vehicle based at least in part on the imaging data.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] Various embodiments described herein relate generally to monitoring devices, and more particularly, to loading operation monitoring devices. Background Art

[0002] Generally speaking, the loading process of vehicles (such as containers, trucks, trailers, dump trucks and many other vehicles) is a manual operation performed at the loading environment (including but not limited to commercial loading docks, private loading docks and warehouses). Applicants have identified several technical challenges associated with monitoring equipment for loading vehicles. Through hard work, wisdom and innovation, many of these identified challenges have been overcome by developing solutions, including in the embodiments of the present disclosure, many examples of which are described in detail herein. Utility Model Content

[0003] Various embodiments described herein relate to devices, methods, and systems for monitoring loading operations. Various embodiments relate to a device for monitoring loading operations, the device comprising: a movable body configured to be inserted into a loading space of a carrier during a loading operation and close to an upper portion of the loading space; an imaging device, the imaging device being fixed to the movable body, the imaging device being configured to capture imaging data of the loading space, wherein the captured imaging data comprises a three-dimensional map of the loading space; a distance measuring device, the distance measuring device being fixed to the movable body, the distance measuring device being configured to measure the distance between the imaging device and a front wall of the loading space; and a controller, the controller being configured to receive imaging data captured by the imaging device, wherein the controller comprises one or more processors, the one or more processors being configured to detect a loading condition of the loading space of the carrier based at least in part on the imaging data.

[0004] In various embodiments, the controller is further configured to monitor loading operations of the loading space by at least substantially continuously capturing imaging data.

[0005] In various embodiments, the controller is further configured to monitor loading operations of the loading space by at least periodically capturing imaging data.

[0006] In various embodiments, the movable body includes an extendable beam.

[0007] The imaging device is secured to the first end of the extendable beam, and the imaging device is configured to move via extension of the extendable beam.

[0008] In various embodiments, the movable body includes a carriage secured to the beam, the carriage configured to move along the length of the beam, and the imaging device is secured to the carriage and configured to move along the length of the loading space via movement of the carriage.

[0009] In various embodiments, the moving subject comprises a flying object.

[0010] In various embodiments, the flying object comprises a drone.

[0011] In various embodiments, the distance measuring device includes a distance sensor.

[0012] In various embodiments, the field of view of the imaging device is oriented substantially vertically relative to the bottom wall of the loading space.

[0013] In various embodiments, the field of view of the imaging device is oriented substantially parallel relative to a bottom wall of the loading space.

[0014] In various embodiments, the controller is configured to: (i) determine the height of contents of a particular area of ​​the loading space during a loading operation; and (ii) in response to determining the height of contents of the particular area of ​​the loading space, satisfying a content height threshold: (a) determine that loading of the particular area of ​​the loading space has been completed, and (b) cause the active body to move a second length less than the first length when the active body is reinserted into the loading space.

[0015] In various embodiments, the imaging device is a three-dimensional camera configured to capture a three-dimensional point cloud image.

[0016] In various embodiments, the controller is configured to cause the imaging device to capture a number N of images along the length of the loading space, wherein the number N of images is determined based at least in part on a distance between the imaging device and a front wall of the loading space.

[0017] In various embodiments, the controller is configured to determine a space utilization metric based at least in part on the imaging data, wherein the loading condition is detected based at least in part on comparing the space utilization metric to a space utilization threshold.

[0018] In various embodiments, the device also includes a loading condition indicator, which electronically communicates with the controller, such that the loading condition indicator is configured to receive one or more indicator signals corresponding to the detected loading condition from the controller, and in response, transmit an alarm signal corresponding to the detected loading condition based on the one or more indicator signals, the alarm signal embodying an indicator of the detected loading condition.

[0019] In various embodiments, the controller is configured to process imaging data captured by the imaging device by performing one or more machine learning operations.

[0020] Various embodiments relate to a method for monitoring a loading operation, the method comprising: inserting an active body into a loading space of a carrier during the loading operation; capturing imaging data of the loading space, wherein the captured imaging data includes a three-dimensional map of the loading space; and detecting a loading condition of the loading space of the carrier based at least in part on the imaging data.

[0021] In various embodiments, the method further comprises monitoring the loading operation of the loading space by at least substantially continuously capturing imaging data.

[0022] In various embodiments, the method further comprises monitoring a loading operation of the loading space by at least periodically capturing imaging data.

[0023] In various embodiments, the imaging data is captured using a three-dimensional camera. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Reference will now be made to the accompanying drawings, which are not necessarily drawn to scale, and in which:

[0025] Figure 1 shows a side view of an exemplary loading operation monitoring device in an operational configuration according to an exemplary embodiment described herein;

[0026] Figure 2A shows a side view of an exemplary loading operation monitoring device in an operational configuration according to another exemplary embodiment described herein;

[0027] Figure 2B An exemplary embodiment according to the present invention is shown. Figure 2A A top view of an exemplary loading operation monitoring device;

[0028] Figure 3 shows a side view of an exemplary loading operation monitoring device in an operational configuration according to another exemplary embodiment described herein;

[0029] Figure 4 shows a schematic diagram of an exemplary apparatus according to various embodiments of the present disclosure; and

[0030] Figure 5 is an illustrative flow chart of various steps of an exemplary method according to various embodiments of the present disclosure. DETAILED DESCRIPTION

[0031] The present disclosure more fully describes various embodiments with reference to the accompanying drawings. It should be understood that some but not all embodiments are shown and described herein. In fact, the embodiments may take many different forms, and therefore the present disclosure should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided in order to enable the present disclosure to meet applicable legal requirements. Throughout the content, similar reference numerals refer to similar elements.

[0032] First, it should be understood that although illustrative specific implementations of one or more aspects are shown below, any number of technologies (whether currently known or not yet available) can be used to implement the disclosed systems and methods. The present disclosure should in no way be limited to the exemplary embodiments, drawings, and techniques shown below, but can be modified within the scope of the appended claims and the full scope of their equivalents. Although the dimensional values ​​of various elements are disclosed, the drawings may not be drawn to scale.

[0033] As used herein, the word “example” or “exemplary” is intended to mean “serving as an example, instance, or illustration.” Any specific implementation described herein as an “example” or “exemplary embodiment” is not necessarily preferred or advantageous over other specific implementations.

[0034] In loading environments (e.g., distribution centers, transportation centers, warehouses, factories, etc.), it is often desirable to maximize the loading space of vehicles (e.g., containers, trucks, trailers, dump trucks, vans, etc.) used to transport various objects (goods, articles, or the like) throughout the country and even throughout the world. Generally speaking, the loading process of a vehicle is a manual process that may involve stacking objects of various shapes and sizes (e.g., boxes, pallets, bags, etc.) within the loading space of the vehicle. Typically, the loading space of a vehicle is underutilized at least in part due to the manual loading process and the variations in the shapes and sizes of the objects loaded in the vehicle. In addition, underutilization of the loading space of a vehicle typically leads to, but is not limited to, inefficient use of resources, increased costs, shipping delays, and scheduling problems. Monitoring equipment can be used to monitor and / or track the utilization of the loading space of a vehicle. For example, the monitoring equipment can be permanently fixed in the loading space to monitor the loading process. However, installing monitoring equipment in each vehicle is uneconomical and may not be feasible for many reasons, including but not limited to cost and logistics. In addition, there are certain drawbacks associated with monitoring equipment that is located externally relative to the loading space of the vehicle. For example, monitoring equipment that is located externally relative to the loading space may experience a loss of visibility due to shadows (e.g., when an object is placed in front of an unoccupied space) and therefore cannot accurately monitor the loading operation of the vehicle.

[0035] Various embodiments described herein relate to apparatus and methods for monitoring space utilization of a carrier associated with a loading operation. In various embodiments, the present disclosure includes a loading operation monitoring apparatus configured to be inserted into (e.g., located in) a loading space of a carrier during a loading operation. In various embodiments, the loading operation monitoring apparatus may include: an imaging device configured to capture imaging data associated with the loading space; a movable body configured to support the imaging device and facilitate movement of the imaging device; a distance measuring device (e.g., a distance sensor such as a laser distance sensor) for detecting a distance between the imaging device and a first position (e.g., a reference point) associated with the loading space; and a controller configured to detect a loading condition of the loading space relative to the space utilization of the loading space based at least in part on the imaging data captured by the imaging device. In various embodiments, the imaging device may include one or more sensors configured to scan the contents of the loading space to generate imaging data that collectively represent a map of the loading space. The imaging device may, for example, include a 3D imaging device, such as, but not limited to, a 3D camera, a 2D TOF camera, an optomechanical LIDAR device (e.g., a solid-state LIDAR device), a millimeter wave radar device, a structured light-based 3D camera (e.g., an autocube), a stereo camera system, or any suitable 3D mapping device that can be operably located within the loading space to capture imaging data.

[0036] As described herein, the active body may be configured to be inserted into, driven into, flow into, or otherwise located within the loading space of the carrier during a loading operation. As further described herein, the active body may be configured to be close to the upper portion (e.g., ceiling) of the loading space of the carrier during a loading operation, and may be configured to be located above relative to the height of the contents of the loading space during its loading operation. In addition, as described herein, the imaging device may be moved along the length of the loading space of the carrier, and the imaging data captured by the imaging device may include one or more images of the contents of the loading space that can surround the length of the loading space. In various embodiments, the active body may be configured to be reinserted into the loading space one or more times during the loading operation and / or repositioned one or more times during the loading operation based at least in part on the height of the contents of the loading space during a portion of the loading operation. For example, in various loading environments, the loading operation may be performed incrementally (e.g., starting from the front of the loading space), wherein an area of ​​the loading space is completed before an adjacent area of ​​the loading space is completed. In addition, in the exemplary loading environment mentioned, the objects loaded in the loading space can be stacked so that the uppermost surface of the stacked objects is close to the upper part (e.g., the ceiling) of the loading space (e.g., stacked to the ceiling of the loading space or substantially close to the ceiling, with an air gap between the stacked objects and the ceiling). In the example mentioned, the active subject can be reinserted into the loading space and / or repositioned within the loading space after the area of ​​the loading space has been completed, wherein the area of ​​the loading space can be determined as completed by the loading operation monitoring device at least in part based on the height of the contents. Therefore, the exemplary loading operation monitoring device described herein can be configured to programmatically monitor the loading operation and determine the space utilization and / or detect the loading condition (relative to the space utilization) based at least in part on the imaging data captured by the imaging device during the loading operation. For example, the present disclosure may include processing imaging data captured by an imaging device by performing one or more operations (e.g., machine learning operations and / or image processing operations) to programmatically determine space utilization and detect loading conditions associated with the loading space, such as unsatisfactory loading conditions (e.g., unused space / volume / area within the loading space) and satisfactory loading conditions (e.g., 100% space utilization, 98% space utilization, etc.).

[0037] In various embodiments, the movable body may be configured to facilitate movement of the imaging device along the length of the loading space. For example, in some embodiments, the imaging device may be mounted, suspended, or otherwise secured to a movable body that is configured to substantially surround the length of the loading space of the carrier when inserted into the loading space and is configured to be inserted into the loading space during a loading operation. The imaging device may be movable along the movable body and may be caused by a controller to capture imaging data at predetermined intervals based at least in part on the length of the loading space of the carrier. In some embodiments, a distance measuring device (e.g., a distance sensor) may be used to measure the distance between the imaging device and a first position within the loading space, wherein the first position may include a reference point for a controller that is used to control movement of the movable body and / or cause the imaging device to capture imaging data.

[0038] In some embodiments, the movable body may be embodied as an extendable movable body (e.g., an extendable beam), and the imaging device may be mounted on and / or otherwise secured to the extendable beam (e.g., near the end of the extendable beam) such that the imaging device may be caused to move along the length of the loading space by extending the extendable beam into the loading space (e.g., from the rear of the vehicle) (e.g., via operation of a motor). As described above, in various embodiments, the extendable beam may be configured to be located within the loading space of the vehicle during loading operations and to be located above relative to the height of the contents within the loading space. During loading operations associated with the loading space, the extendable beam may be reinserted and / or repositioned within the loading space one or more times.

[0039] In some embodiments, the movable body may be embodied as a beam having a carriage secured thereto (e.g., a carriage beam), and the imaging device may be mounted on and / or otherwise secured to the carriage, wherein when the carriage beam is positioned within the loading space, the imaging device may be caused to move along the length of the loading space (e.g., via substantially horizontal movement of the carriage). In various embodiments, the carriage beam may be configured to be positioned within the loading space of the carrier and above the height of the contents of the loading space during a loading operation. The carriage beam may be reinserted and / or repositioned within the loading space one or more times during a loading operation associated with the loading space.

[0040] In some embodiments, the active subject may be embodied as a flying object (e.g., a drone, etc.) having an imaging device fixed to the flying object (e.g., fixed to a lower portion of the flying object, fixed to a front portion of the flying object, or other suitable position relative to the flying object), wherein the active subject is configured to be inserted into the loading space during a loading operation associated with the loading space so as to monitor the loading operation and detect a loading condition defined by the space utilization of the loading space. During the loading operation associated with the loading space, the flying object may be reinserted and / or repositioned one or more times within the loading space.

[0041] Therefore, according to various embodiments of the present disclosure, an exemplary loading operation monitoring device can be used to monitor loading operations associated with various types of carriers (including carriers with open tops and carriers with closed tops) without interfering with the loading operations, and can be used to monitor objects of various sizes.

[0042] Although various exemplary embodiments of a movable body are described herein, it should be understood that a movable body according to various embodiments of the present disclosure may include any movable body capable of being inserted and / or otherwise caused to move within a loading space to facilitate movement of an imaging device secured to the movable body.

[0043] The controller may be configured to insert the imaging device into the loading space of the carrier via the operation of the active subject, and may cause the imaging device to capture imaging data of the loading space and the contents therein. The controller may include one or more processors configured to analyze and / or process the imaging data to determine a space utilization metric about the loading space and the loading condition of the loading space. The controller may determine the length of the loading space (e.g., the distance between the rear of the loading space and the front wall of the loading space) using the output of a distance measuring device (e.g., a distance sensor), and may determine the number of images / frames to be captured (e.g., the optimal number of images) to generate a complete representation of the loading space and the contents therein. The controller may be configured to cause the imaging device to move stepwise (e.g., a stepping distance) along the length of the loading space and cause the imaging device to capture imaging data at intervals based at least in part on the desired number of images (e.g., the optimal number of images) determined by the controller. The controller may be configured to periodically or continuously cause the imaging device to capture an optimal number of images that substantially surround the entire length of the loading space, and periodically or continuously analyze and / or process the imaging data to determine the space utilization of the loading space and / or the loading condition of the loading space (e.g., periodically). Additionally and / or alternatively, the controller may be configured to cause the imaging device to capture an optimal number of images substantially surrounding the entire length of the loading space based at least in part on receiving signals and / or data indicative of a loading operation (e.g., movement of a human operator into and out of the loading space). The controller may be configured to receive the mentioned signals and / or data from one or more sensors positioned proximate to the loading space, wherein the one or more sensors may be configured to determine the loading operation status based at least in part on movement of a human operator into and out of the loading space.

[0044] In addition, the controller (e.g., one or more processors thereof) may be configured to generate a representation (e.g., a 3D representation) of the loading space of the carrier, and determine space utilization metrics based at least in part on the loading space representation (e.g., the 3D representation); determine loading conditions; determine remaining floor space and / or volume; monitor and guide the placement of objects via feedback to a loader (e.g., a human operator), or track the rate of progress of the loading operation. In addition, the controller may be configured to generate reporting data, which may include one or more of the space utilization metrics; remaining floor space and / or volume; the rate of progress of the loading operation; loading conditions. The controller may be configured to transmit the mentioned reporting data to one or more computing devices (e.g., computing devices associated with managers, administrators, etc. associated with the loading environment).

[0045] In various embodiments, the exemplary loading operation monitoring device described herein may also include a loading condition indicator electrically connected to the controller. In various embodiments, when a loading condition associated with the loading space is detected (e.g., determined) by the exemplary loading operation monitoring device based at least in part on imaging data captured by the imaging device, the controller described herein may be configured to cause one or more alarm signals corresponding to the detected loading condition to be transmitted from the loading condition indicator of the exemplary loading operation monitoring device. For example, one or more alarm signals including audio and / or visual signals corresponding to the detected loading condition may be transmitted from the loading condition indicator, such that when transmitted from the loading condition indicator, a perceptible indication (e.g., light, sound, message, etc., or any combination thereof) of a specific loading condition detected by the loading operation monitoring device and / or an instruction message corresponding to the detected loading condition may be embodied.

[0046] Additionally and / or alternatively, in various embodiments, when a loading condition associated with a loading space is detected by an exemplary loading operation monitoring device based at least in part on imaging data captured by an imaging device, a controller described herein may be configured to cause a loading condition user interface to be presented on one or more computing devices. For example, one or more messages corresponding to the detected loading condition may be caused to be transmitted by the controller so that an alarm and / or instruction message corresponding to the detected loading condition may be embodied when transmitted. For example, one or more computing devices may be associated with a manager, administrator, etc. of the loading environment.

[0047] As described herein, the present disclosure includes utilizing an imaging device that can move along the length of a loading space to capture imaging data associated with the loading space, and programmatically processing the captured imaging data to facilitate monitoring of loading operations, which may include detecting loading conditions associated with the loading space (e.g., unused areas, unused floor space, unused volumes within the loading space). The present disclosure utilizing the active optical detection technology described herein enables a loading operation monitoring device to monitor a loading operation or determine conditions defined therein, which is defined by a lower product cost relative to a device that can utilize multiple other sensors distributed around the loading space. In addition, the present disclosure can be configured to monitor the loading of a carrier (e.g., a truck, a container, a truck, a dump truck, a trailer, etc.) associated with a loading environment such as a commercial loading station, a private loading station, a warehouse, etc., substantially continuously and / or periodically, and transmit a corresponding alarm signal substantially in real time as an indication of the loading condition defined by the loading space of the carrier at a particular moment. Therefore, as described herein, the present disclosure significantly reduces the opportunity for underutilization of the loading space of the carrier.

[0048] Figure 1A side view of an exemplary apparatus for monitoring a loading operation of a loading space associated with a vehicle is schematically shown. Specifically, Figure 1 A side view of an exemplary loading operation monitoring device configured to monitor the loading operation of a carrier is schematically shown, wherein a loading condition, for example, a loading condition related to space utilization of the loading space of the carrier, can be detected based at least in part on captured imaging data corresponding to a loading arrangement of contents (e.g., objects) placed within the loading space. Figure 1 An exemplary loading operation monitoring device in an operational configuration (e.g., during use) is depicted. In various embodiments, for example, the exemplary loading operation monitoring device 100 may be configured to monitor the loading of the loading space of an exemplary carrier 20 (e.g., a container, a truck, a trailer, a dump truck, etc.) to detect a loading condition associated with a loading operation associated with the carrier. For example, the carrier 20 may be manually loaded with objects by one or more manual operators in a loading environment (e.g., a loading station, a warehouse, etc.) to facilitate the transportation of the objects to a destination for unloading the objects. The loading operation may involve stacking objects to occupy a volume within the loading space. As described above, in various loading environments, the objects loaded in the loading space may be stacked so that the uppermost surface of the stacked objects is close to the upper portion (e.g., ceiling) of the loading space. In addition, in various loading environments, the loading operation may be performed incrementally (e.g., starting from the front of the loading space), wherein an area of ​​the loading space is completed before an adjacent area of ​​the loading space is completed.

[0049] An exemplary carrier 20 may include a loading space 21 configured to receive objects that may be embodied in various forms (e.g., boxes, trays, etc.) and may have various sizes (e.g., various lengths and widths). The loading space 21 of the carrier 20 may be defined by a front wall 21a, opposing side walls 21b, side walls 21c, a rear wall 21d, a bottom wall 21e (e.g., a platform, a floor), and a top wall 21f (e.g., a roof, a ceiling). The rear wall 21d may be configured to be in an open configuration during a loading operation and may be used as an entry point for a human operator to position an object within the loading space 21, wherein the object is supported by the bottom wall 21e of the loading space 21, and wherein the object may be loaded from the front of the loading space to the rear of the loading space.

[0050] In various embodiments, the loading operation monitoring device can be configured to be inserted and / or positioned within a loading space of a carrier to monitor loading operations, such as to monitor the utilization of the loading space and detect a loading condition defined at least in part by the arrangement of objects placed within the loading space. Figure 1As shown, an exemplary loading operation monitoring device 100 may be positioned (at least a portion thereof) within the loading space 21 during a loading operation, and may be configured to determine space utilization and detect a loading condition within the loading space 21, wherein the loading condition may be at least partially defined by the arrangement of objects placed within the loading space (e.g., the positions of the objects relative to each other).

[0051] As a non-limiting example, the loading operation monitoring device 100 may be configured to detect a satisfactory loading condition defined at least in part by objects arranged in a condition that maximizes the utilization of the loading space 21 and an unsatisfactory loading condition defined at least in part by objects arranged in a condition that fails to maximize the utilization of the loading space 21. The loading operation monitoring device 100 may be configured to periodically and / or continuously monitor the loading operation to detect loading conditions (e.g., satisfactory loading conditions, unsatisfactory loading conditions, etc.) during the loading operation. However, it should be understood that a satisfactory loading condition and an unsatisfactory loading condition are examples of loading conditions, and other embodiments may include a variety of other loading conditions that may be detected.

[0052] In various embodiments, the loading operation monitoring device 100 may include: an imaging device 110, which is configured to capture imaging data of the contents (e.g., objects) of the loading space 21; a movable body (embodied as an extendable beam 130), which is configured to support the imaging device 110 and facilitate the movement of the imaging device 110; a distance measuring device 140, which is configured to determine (or facilitate determination by a controller (e.g., controller 120)) the distance between the imaging device 110 and the front wall 21a of the loading space 21; and a controller 120, which communicates with the imaging device 110 and is configured to determine a space utilization metric and detect a loading condition based at least in part on the imaging data received from the imaging device 110.

[0053] In various embodiments, the imaging device 110 may be configured to capture imaging data of the contents within the loading space of the carrier. In various embodiments, the imaging device 110 may at least substantially continuously and / or periodically capture imaging data including multiple images, etc., and may at least periodically or substantially continuously process and / or analyze (e.g., by the controller 120) these images, etc., so that the exemplary loading operation monitoring device 100 is configured to at least substantially continuously and / or periodically monitor multiple loading configurations embodying outputs, which can be used to collectively determine and / or define loading conditions at multiple times. For example, this exemplary configuration can facilitate a stable configuration that is used to maximize the operational reliability (e.g., accuracy) of the loading operation monitoring device 100 when detecting loading conditions at a particular time.

[0054] The movable body (embodied as the extendable beam 130) can be movable in that the movable body can be temporarily positioned within the loading space 21 (e.g., not permanently fixed within the loading space). For example, the extendable beam 130 can be configured to be reinserted (e.g., moved in and out) into the loading space 21 one or more times during a loading operation and / or repositioned one or more times during a loading operation.

[0055] exist Figure 1 In the depicted embodiment, the extendable beam 130 can be configured for substantially horizontal movement, such that the extendable beam 130 can be extended substantially horizontally into the loading space 21 of the exemplary carrier 20. For example, Figure 1 As shown, the extendable beam 130 can be configured so that when extended into the loading space 21, the extendable beam 130 is substantially horizontal relative to the bottom wall 21e of the loading space 21 (configured to support objects placed in the loading space 21). As a non-limiting example, in some embodiments, the extendable beam may include a substantially rigid single-piece bar (e.g., a single-piece aluminum bar) having various cross-sections or tension supports. As a non-limiting example, in various embodiments, the extendable beam 130 can be moved (e.g., extended) via a motorized mechanism. For example, the active body can be embodied as a motorized extendable beam 130.

[0056] The extendable beam 130 can be configured to support the imaging device 110. In addition, the extendable beam 130 can be configured to facilitate movement of the imaging device 110 along the length (e.g., substantially the entire length) of the loading space 21, wherein the imaging device can capture one or more images of the loading space that collectively represent a map (e.g., a 3D map) of the contents within the loading space. Figure 1 , the imaging device 110 may be fixed to the first end portion 132 of the extendable beam 130, wherein the imaging device 110 may be configured to move along the length of the loading space 21 via operation (e.g., movement) of the extendable beam 130. In various embodiments, the imaging device 110 may be fixed to the extendable beam 130 at the first end portion 132 of the movable body 130, so that the imaging device 110 does not move relative to the movable body 130. In various embodiments, the horizontal movement of the extendable beam 130 over the object placed in the loading space may facilitate the horizontal movement of the imaging device 110 over the object placed in the loading space 21, wherein the imaging device 110 may capture imaging data surrounding the length (e.g., substantially the entire length) of the loading space. In various embodiments, the imaging device 110 may be fixed (e.g., mounted) to the first end portion 132 of the extendable beam 130 via a pallet (not shown) and / or other suitable coupling / mounting mechanism.

[0057] In various embodiments, the extendable beam 130 may be configured to be reinserted into the loading space 21 one or more times during the loading operation and / or repositioned one or more times during the loading operation based at least in part on completing the loading in the area of ​​the loading space. For example, the extendable beam 130 may be extended into the loading space periodically or continuously at varying lengths, wherein an imaging device (e.g., by the controller 120) may be enabled to capture imaging data of the contents of the loading space, and may be retracted after the imaging device is extended along the length of the loading space. For example, the extendable beam 130 may be extended to a first length in the loading space 21 and may subsequently be extended (e.g., after retracting) to a second length in the loading space 21, wherein the second length may be less than the first length. In various embodiments, the first length and the second length may be determined at least in part based on the height of the contents of the loading space at a particular moment. For example, as described above, in various loading environments, the loading operation may be performed incrementally (e.g., starting from the front of the loading space), wherein an area of ​​the loading space is completed before completing an adjacent area of ​​the loading space, and wherein the loading space may be stacked so that the uppermost surface of the stacked objects is close to the upper portion (e.g., ceiling) of the loading space. In various embodiments, the controller 120 may be configured to: (i) at least periodically determine a height of the contents of the loading space (e.g., the contents of a particular area of ​​the loading space) during a loading operation; and (ii) in response to determining that the height of the contents of the loading space meets (e.g., exceeds) a contents height threshold: (a) determine that loading of the particular area of ​​the loading space has been completed, and (b) when the extendable beam is reinserted into the loading space, cause the extendable beam to extend a second length that is less than an immediately previous first length. The contents height threshold may describe a maximum loading height for a given loading space, the maximum loading height being configured to be used by a controller (e.g., controller 120) to determine how far the active subject should be inserted into the loading space.

[0058] In various embodiments, the imaging device may be secured to the extendable beam such that the field of view of the imaging device is in a substantially vertical direction (e.g., facing / pointing downward toward the bottom wall of the loading space 21), wherein the imaging device 110 may be configured to capture one or more imaging data of the loading space that collectively represent a map of the loading space (and thus the contents within the loading space) as the imaging device moves along the length of the loading space. For example, in various embodiments, the field of view of the imaging device may be oriented substantially vertically relative to the bottom wall 21e of the loading space such that the field of view of the imaging device is facing downward.

[0059] In some embodiments, the imaging device may be secured to the extendable beam such that the field of view of the imaging device is in a substantially horizontal orientation (e.g., facing / pointing forward toward the front wall of the loading space 21), wherein the imaging device 110 may capture one or more imaging data of the loading space that collectively represent a map of the loading space (and thus the contents within the loading space) as the imaging device moves along the length of the loading space. For example, in various embodiments, the field of view of the imaging device may be oriented substantially parallel relative to the bottom wall 21e of the loading space.

[0060] In various embodiments, the controller 120 may cause the imaging device to capture imaging data at intervals, wherein the imaging data encompasses the length of the stowage space, and wherein consecutive imaging data overlap. Figure 1 As shown in , in various embodiments, the field of view of the imaging device can be configured to encompass the width of the loading space (e.g., substantially the entire width), wherein the imaging device can be configured to move from a first position within the loading space to a second position within the loading space that is substantially horizontal relative to the bottom wall 21e (e.g., the floor of the loading space). Figure 1 In the depicted embodiment, the imaging device 110 is oriented such that the imaging device's field of view 160 faces downward. As described above, in various other embodiments, the imaging device 110 may be oriented such that the imaging device's field of view faces forward toward the front wall of the loading space, wherein the rear edge of the field of view may be substantially vertical.

[0061] In various embodiments, the distance measuring device 140 may include a distance sensor (e.g., a laser distance sensor) and may be fixed to the first end portion 132 (or other suitable portion) of the extendable beam, wherein the distance measuring device may be configured to measure the distance between the imaging device 110 and the front wall 21a (or facilitate determination of the distance between the imaging device 110 and the front wall 21a by a controller (e.g., the controller 120)), and wherein the controller may cause the imaging device to capture imaging data at intervals determined based at least on the measured / determined distance between the imaging device 110 and the front wall 21a. However, it should be understood that in some embodiments, the loading operation monitoring apparatus 100 may not include a distance sensor, but may include one or more other devices and / or mechanisms configured to measure the distance between the imaging device and the front wall 21a.

[0062] As described above, the extendable beam 130 may be movable in that the extendable beam may be temporarily positioned within the loading space 21 (e.g., not permanently fixed within the loading space). For example, in various embodiments, the extendable beam 130 may be configured to move between different locations (e.g., between different platforms), wherein the loading operation monitoring device 100 may be used at different locations. As a non-limiting example, in some embodiments, the extendable beam 130 may be fixed to a mobile object (e.g., a vehicle), wherein the extendable beam 130 (including other components of the loading operation monitoring device coupled / fixed to the extendable beam 130) may be transported from one location to another (e.g., from one platform door to another platform door) and may be used at the different locations mentioned. For example, the extendable beam 130 may be fixed to a substantially vertical support structure mounted on the mobile object (e.g., an autonomous vehicle) and / or one or more wheels to facilitate movement of the extendable beam 130 between different locations.

[0063] Figure 2A A side view of an exemplary loading operation monitoring device 100' configured to monitor a loading operation of a carrier is schematically shown, wherein space utilization and loading conditions, such as loading conditions related to space utilization of the loading space of the carrier, can be detected (e.g., determined) based at least in part on captured imaging data corresponding to a loading arrangement of contents (e.g., objects) placed in the loading space. The exemplary loading operation monitoring device 100' may be an alternative embodiment of the exemplary loading operation monitoring device 100. Figure 2B A top view of an exemplary loading operation monitoring device 100 ′ is schematically shown.

[0064] Figure 2A and Figure 2B The exemplary loading operation monitoring device 100' is depicted in an operational configuration (e.g., during use) as at least a portion of the loading operation monitoring device 100' is positioned within a loading space of an exemplary carrier. The exemplary loading operation monitoring device 100' may be configured to monitor the loading of a loading space of an exemplary carrier 20 (e.g., a container, a truck, a trailer, a dump truck, etc.) to determine space utilization and detect loading conditions associated with loading operations associated with the carrier. For example, the carrier 20 may be manually loaded with objects by one or more human operators within a loading environment (e.g., a loading dock, a warehouse, etc.) to facilitate transportation of the objects to a destination for unloading the objects.

[0065] An exemplary carrier 20 may include a loading space 21 configured to receive objects that may be embodied in various forms (e.g., boxes, trays, etc.) and may have various sizes (e.g., various lengths and widths). The loading space 21 of the carrier 20 may be defined by a front wall 21a, opposing side walls 21b, side walls 21c, a rear wall 21d, a bottom wall 21e (e.g., a platform), and a top wall 21f (e.g., a roof). The rear wall 21d may be configured to be in an open configuration during a loading operation and may be used as an entry point for a human operator to position objects within the loading space 21 such that the objects are supported by the bottom wall 21e of the loading space 21.

[0066] In various embodiments, the loading operation monitoring device can be configured to be inserted / positioned within the loading space of the carrier to monitor the loading operation, for example, to determine space utilization and detect a loading condition defined at least in part by the arrangement of objects placed within the loading space. Figure 2A and 2B As shown, an exemplary loading operation monitoring device 100' can be positioned in the loading space 21 during a loading operation and can be configured to detect a loading condition in the loading space 21, wherein the loading condition can be at least partially defined by the arrangement of objects placed in the loading space (e.g., the positions of the objects relative to each other).

[0067] As a non-limiting example, the loading operation monitoring device 100' may be configured to detect a satisfactory loading condition defined at least in part by objects arranged in a condition that maximizes the utilization of the loading space 21 and an unsatisfactory loading condition defined at least in part by objects arranged in a condition that fails to maximize the utilization of the loading space 21. The loading operation monitoring device 100' may be configured to periodically and / or continuously detect loading conditions (e.g., satisfactory loading conditions and unsatisfactory loading conditions) during the loading operation. However, it should be understood that the satisfactory loading condition and the unsatisfactory loading condition are exemplary loading conditions, and other embodiments may include different loading conditions that can be detected.

[0068] In various embodiments, the loading operation monitoring device 100' may include: an imaging device 110, which is configured to capture imaging data of the contents (e.g., objects) of the loading space; a movable body (embodied as a bracket beam 130'), which is configured to support the imaging device 110 and facilitate the movement of the imaging device 110; a distance measuring device 140, which is configured to determine (or facilitate determination by a controller (e.g., controller 120)) the distance between the imaging device 110 and the front wall 21a of the loading space 21; and a controller 120, which communicates with the imaging device 110 and is configured to detect the loading condition based at least in part on the imaging data received from the imaging device 110.

[0069] In various embodiments, the imaging device 110 may be configured to capture imaging data representing a map (e.g., a 3D map) of the contents within the loading space of the carrier. In various embodiments, the imaging device 110 may at least substantially continuously and / or periodically capture imaging data including multiple images, etc., and may at least periodically or substantially continuously process and / or analyze (e.g., by the controller 120) these images, etc., so that the exemplary loading operation monitoring device 100 is configured to at least substantially continuously or periodically monitor multiple loading configurations embodying outputs, which can be used to collectively determine and / or define loading conditions at multiple times. For example, this exemplary configuration can facilitate a stable configuration that is used to maximize the operational reliability (e.g., accuracy) of the loading operation monitoring device 100' when detecting loading conditions at a particular time.

[0070] The movable body (embodied as the carrier beam 130') may be movable in that the carrier beam 130' may be temporarily positioned within the loading space 21 during the loading operation. Figure 2A and Figure 2BIn the illustrated embodiment, the support beam 130' may include a support 137 fixed to the beam 136, wherein the support 137 may be configured to move substantially horizontally along the beam 136. The carriage beam 130' may further include a drive mechanism (not shown) configured to facilitate movement of the carriage 137 along the beam 136. As a non-limiting example, the drive mechanism may include one or more drive rollers (e.g., wheels) coupled to the carriage 137 and configured to enable the carriage 137 to move along the beam 136. The drive roller (not shown) may, for example, be coupled to a drive motor configured to facilitate movement of the drive roller. As a non-limiting example, the carriage beam 130' may include one or more guide rails (e.g., a single guide rail, a pair of guide rails) configured to guide the carriage along the beam. For example, the carriage may include one or more wheels configured to be coupled to the one or more guide rails to allow / enable horizontal movement of the carriage 137 along the beam 136. As another non-limiting example, in some embodiments, the beam 136 can include a “C” shaped channel aluminum beam. In various embodiments, the bracket 137 can move along the entire length of the beam 136 (eg, substantially the entire length).

[0071] In various embodiments, the carriage beam 130' may be configured to be reinserted into the loading space 21 one or more times during the loading operation and / or repositioned one or more times during the loading operation based at least in part on completing the loading in the area of ​​the loading space. For example, the carriage beam 130' may be inserted into the loading space periodically or continuously at varying lengths, wherein the imaging device (e.g., by the controller 120) may be enabled to capture imaging data of the contents of the loading space along the length of the loading space. For example, the carriage beam 130' may be inserted into the loading space 21 for a first length and may subsequently be reinserted (e.g., after being removed from the loading space) into the loading space 21 for a second length, wherein the second length may be less than the first length. In various embodiments, the first length and the second length may be determined at least in part based on the height of the contents of the loading space at a particular moment. For example, as described above, in various loading environments, the loading operation may be performed incrementally (e.g., starting from the front of the loading space), wherein an area of ​​the loading space may be completed before completing an adjacent area of ​​the loading space, and wherein the loading spaces may be stacked so that the uppermost surface of the stacked objects is close to the upper portion (e.g., ceiling) of the loading space. In various embodiments, the controller 120 may be configured to: (i) determine at least periodically during a loading operation the height of the contents of the loading space (e.g., the contents of a particular region of the loading space); and (ii) in response to determining that the height of the contents of the loading space meets (e.g., exceeds) a contents height threshold: (a) determine that loading of the particular region of the loading space has been completed, and (b) when the carriage beam is reinserted into the loading space, cause the carriage beam 130' to encompass a second length that is less than an immediately preceding first length. As described above, the contents height threshold may describe a maximum loading height for a given loading space, the maximum loading height being configured to be used by a controller (e.g., the controller 120) to determine how far the active body (e.g., the carriage beam 130') should be inserted into the loading space.

[0072] In various embodiments, the imaging device 110 may be fixed (e.g., securely fixed) to the bracket to allow the imaging device 110 to move along the length (e.g., substantially the entire length) of the beam 136. In various embodiments, the imaging device 110 may be fixed to a bottom portion of the bracket 137. For example, the imaging device 110 may be fixed to the bracket 137 so that the imaging device is suspended from the bracket. In various embodiments, the imaging device may be fixed to the bracket 137 so that the field of view of the imaging device is in a substantially vertical direction (e.g., facing / pointing downward toward the bottom wall of the loading space 21), wherein the imaging device 110 may be configured to capture one or more imaging data of the loading space that collectively represent a map of the contents within the loading space as the imaging device moves along the length of the loading space. For example, in various embodiments, the field of view 160 of the imaging device may be oriented substantially vertically relative to the bottom wall 21e of the loading space so that the field of view of the imaging device is facing downward.

[0073] In various embodiments, the imaging device 110 may be secured to the bracket 137 such that the field of view 160 of the imaging device 110 is in a substantially horizontal orientation (e.g., facing / pointing forward toward the front wall of the loading space 21), wherein, as the imaging device moves along the length of the loading space, the imaging device 110 may capture one or more imaging data of the loading space that collectively represent a map of the loading space (and therefore the contents within the loading space). For example, in various embodiments, the field of view 160 of the imaging device may be oriented substantially parallel to the bottom wall of the loading space. However, it should be understood that the bracket 137 may be embodied as any movable structure configured to support the imaging device 110 and configured to move along the beam. As a non-limiting example, the bracket 137 may be embodied as a shuttle, a trolley, a slide, etc.

[0074] In various embodiments, the controller 120 can cause the imaging device 110 to capture imaging data at intervals, wherein the imaging data encompasses the length of the loading space (e.g., substantially the entire length), and wherein consecutive imaging data can overlap. In various embodiments, the field of view 160 of the imaging device 110 can be configured to encompass the width of the loading space (e.g., substantially the entire width), wherein the imaging device 110 can be configured to move from a first position within the loading space to a second position within the loading space that is substantially horizontal relative to a bottom wall (e.g., the floor of the loading space). Figure 2B In the depicted embodiment, the imaging device is oriented such that the field of view 160 of the imaging device faces downward. As described above, in various other embodiments, the imaging device 110 can be oriented such that the field of view 160 of the imaging device faces forward toward the front wall 21a of the loading space 21, wherein the rear edge of the field of view can be substantially vertical.

[0075] In various embodiments, horizontal movement of the carriage 137 over an object placed in the loading space can facilitate horizontal movement of the imaging device 110 over an object placed in the loading space 21, so that the imaging device 110 can capture imaging data surrounding the length (e.g., substantially the entire length) of the loading space 21. The carriage beam 130' can be configured to be positioned within the loading space 21 during a loading operation. The carriage beam 130' can be configured such that when inserted into the loading space 21, the carriage beam 130' is substantially horizontal relative to the bottom wall 21e of the loading space 21 (configured to support an object placed in the loading space 21).

[0076] In various embodiments, the carriage beam 130' can be configured to be positioned within the loading space 21 of the carrier at an upper position relative to the maximum loading height of the loading space during a loading operation of the carriage, such that the carriage beam 130' and the imaging device 110 do not contact objects placed within the loading space 21 (e.g., even when the loading space is at 100% utilization). The maximum loading height of the loading space 21 can define the maximum height of objects placed within the loading space that can be stacked and / or the maximum height of objects that can be placed within the loading space 21.

[0077] In various embodiments, the distance measuring device 140 may include a distance sensor and may be fixed to the bracket 137 of the bracket beam and may be configured to measure (or facilitate determination by a controller (e.g., controller 120)) the distance between the imaging device 110 and the front wall 21a, wherein the controller may cause the imaging device to capture image data at a position determined based at least on the measured / determined distance between the imaging device 110 and the front wall 21a. Additionally and / or alternatively, the distance measuring device 140 (not shown) may be fixed to the beam 136 and may be configured to determine the distance between the front end of the beam 136 and the front wall 21a of the loading space 21. However, it should be understood that in some embodiments, the loading operation monitoring apparatus 100 may not include a distance sensor, but may include one or more other devices and / or mechanisms configured to measure the distance between the camera and the front wall 21a.

[0078] Figure 3 A side view of an exemplary loading operation monitoring device 100' is schematically shown, which is configured to detect a loading condition, for example, a space utilization of a loading space of a carrier based at least in part on captured imaging data corresponding to a loading arrangement of contents (e.g., objects) placed in the loading space. The exemplary loading operation monitoring device 100" may be an alternative embodiment of the exemplary loading operation monitoring device 100.

[0079] Figure 3An exemplary loading operation monitoring device 100 is depicted in an operational configuration, wherein the exemplary loading operation monitoring device is within a loading space of an exemplary carrier. The exemplary loading operation monitoring device 100" may be configured to monitor the loading of a loading space of an exemplary carrier 20 (e.g., a container, a truck, a trailer, a dump truck, etc.) to determine space utilization and detect loading conditions associated with loading operations associated with the carrier. For example, the carrier 20 may be manually loaded with objects by one or more manual operators within a loading environment (e.g., a loading dock, a warehouse, etc.) to facilitate transportation of the objects to a destination for unloading the objects.

[0080] An exemplary carrier 20 may include a loading space 21 configured to receive objects that may be embodied in various forms (e.g., boxes, trays, etc.) and may have various sizes (e.g., various lengths and widths). The loading space 21 of the carrier 20 may be defined by a front wall 21a, opposing side walls 21b, side walls 21c, a rear wall 21d, a bottom wall 21e (e.g., a platform), and a top wall 21f (e.g., a roof). The rear wall 21d may be configured to be in an open configuration during a loading operation and may be used as an entry point for a human operator to position objects within the loading space 21 such that the objects are supported by the bottom wall 21e of the loading space 21.

[0081] In various embodiments, the loading operation monitoring device 100" can be configured to be positioned within a loading space of a carrier to monitor loading operations, for example, to determine space utilization and detect a loading condition defined at least in part by the arrangement of objects placed within the loading space. For example, Figure 3 As shown, an exemplary loading operation monitoring device 100" can be positioned in the loading space 21 during a loading operation and can be configured to detect a loading condition in the loading space 21, wherein the loading condition can be at least partially defined by the arrangement of objects placed in the loading space (e.g., the positions of the objects relative to each other).

[0082] As a non-limiting example, the loading operation monitoring device 100" may be configured to detect a satisfactory loading condition defined at least in part by objects arranged in a condition that maximizes the utilization of the loading space 21 and an unsatisfactory loading condition defined at least in part by objects arranged in a condition that fails to maximize the utilization of the loading space 21. The loading operation monitoring device 100' may be configured to periodically detect loading conditions (e.g., satisfactory loading conditions and unsatisfactory loading conditions) during the loading operation. However, it should be understood that satisfactory loading conditions and unsatisfactory loading conditions are exemplary loading conditions, and other embodiments may include different loading conditions and include more or fewer detectable loading conditions.

[0083] In various embodiments, the loading operation monitoring device 100"" may include: an imaging device 110, which is configured to capture imaging data of the contents (e.g., objects) of the loading space; an active body (embodied as a flying object 130"), which is configured to support the imaging device 110 and facilitate the movement of the imaging device 110 within the loading space; a distance measuring device 140, which is configured to determine the distance between the imaging device 110 and the front wall 21a of the loading space 21; and a controller 120, which communicates with the imaging device 110 and is configured to detect the loading condition based at least in part on the imaging data received from the imaging device 110.

[0084] In various embodiments, the imaging device 110 may be configured to capture imaging data representing a map of the contents within the loading space of the carrier. In various embodiments, the imaging device 110 may be configured to capture imaging data including multiple images, etc. substantially continuously and / or periodically, and these images, etc. may be processed and / or analyzed (e.g., by the controller 120) at least periodically or substantially continuously, wherein the exemplary loading operation monitoring device 100' may be configured to at least substantially continuously monitor multiple loading configurations embodying outputs that can be used to collectively determine and / or define loading conditions at multiple times. For example, such an exemplary configuration may facilitate a robust configuration that is used to maximize the operational reliability (e.g., accuracy) of the loading operation monitoring device 100" when detecting loading conditions at a particular time.

[0085] The flying object 130 may include, for example, an unmanned aircraft or any flying object capable of being temporarily positioned within the loading space of a carrier and capable of supporting an imaging device. In various embodiments, the imaging device 110 may be fixed (e.g., securely fixed) to the flying object 130' so that when the flying object is within the loading space 21, the field of view 160 of the imaging device is in a substantially vertical direction (e.g., looking down toward the bottom wall of the loading space 21), wherein the imaging device 110 may be caused (e.g., via the controller 120) to capture one or more imaging data of the loading space, the one or more imaging data collectively representing a map (e.g., a 3D map) of the contents within the loading space. The controller 120 may cause the flying object 130' to be positioned within the loading space for a period of time to capture the imaging data, and may cause the flying object 130' to be positioned outside the loading space while the imaging data is being captured. For example, the controller may cause the flying object 130 to be periodically and / or continuously moved into and out of the loading space (e.g., reinserted).

[0086] For example, in various embodiments, the flying object 130 may be configured to be reinserted into the loading space 21 one or more times during a loading operation and / or to be repositioned one or more times during a loading operation based at least in part on completing loading in an area of ​​the loading space. For example, the flying object 130" may be periodically or continuously inserted into the loading space, wherein an imaging device (e.g., via the controller 120) is caused to capture imaging data of the contents of the loading space along the length of the loading space. In various embodiments, the carrier beam 130' may be moved to a first length in the loading space 21 and may subsequently be moved (e.g., after being removed from the loading space) to a second length in the loading space 21, wherein the second length may be less than the first length. In various embodiments, the first length and the second length may be determined at a particular moment based at least in part on the height of the contents of the loading space. For example, as described above, in various loading environments, loading operations may be performed incrementally (e.g., starting from the front of the loading space), wherein an area of ​​the loading space may be completed before an adjacent area of ​​the loading space is completed, and wherein the loading space may be stacked such that the uppermost surface of the stacked objects is proximate an upper portion (e.g., a ceiling) of the loading space. In various embodiments, the controller 120 may be configured to: (i) determine the height of the contents of the loading space (e.g., the contents of a particular area of ​​the loading space) at least periodically during a loading operation; and (ii) in response to determining that the height of the contents of the loading space meets (e.g., exceeds) a content height threshold: (a) determine that loading of the particular area of ​​the loading space has been completed, and (b) when the flying object 130" is reinserted into the loading space, cause the flying object to move a second length that is less than an immediately preceding first length. As described above, the content height threshold may describe a maximum loading height of the loading space.

[0087] In addition, the controller 120 can be configured to cause the flying object 130" to be "positioned" in the charging station when the flying object 130" is not within the loading space. In various embodiments, the controller can cause the flying object 130" to move between different locations within the loading environment (e.g., between platform doors) to capture images of the contents of multiple loading spaces, thereby significantly reducing equipment costs.

[0088] In various embodiments, the distance measuring device 140 may include a distance sensor. The distance measuring device 140 may be fixed to the front end of the flying object and may be configured to measure the distance between the imaging device 110 and the front wall 21a of the loading space 21 (or otherwise facilitate determining the distance between the imaging device 110 and the front wall 21a of the loading space 21), wherein the controller may cause the imaging device 110 to capture imaging data at a position determined at least based on the measured / determined distance between the imaging device 110 and the front wall 21a. However, it should be understood that in some embodiments, the loading operation monitoring device 100" may not include a distance sensor, but may include one or more other devices and / or mechanisms configured to measure the distance between the camera and the front wall 21a.

[0089] In various embodiments, the loading operation monitoring device 100" may include a plurality of distance measuring devices 140 (e.g., embodied as distance sensors) fixed to the flying object at various positions of the flying object 130", wherein the plurality of distance measuring devices 140 may be configured to measure the distance between the flying object 130" and various parts within the loading space 21 at a certain moment. For example, the plurality of distance measuring devices 140 may be fixed to the flying object 130" to facilitate measurement of one or more of the following items: (i) the distance between the flying object 130" and the side walls 21b, 21c of the loading space 21; (ii) the distance between the flying object and the top wall 21f (e.g., the roof, the ceiling) of the loading space; (iii) the distance between the flying object 130" and the bottom wall 21e (e.g., the floor) of the loading space 21; (iv) the distance between the flying object 130" and the rear of the loading space 21; or (v) the distance between the flying object 130" and the contents (e.g., objects) within the loading space 21. For example, one or more distance measuring devices 140 may be fixed to a first position of the flying object 130", which first position is capable of measuring the distance between the flying object and the side wall of the loading space. As another example, one or more second distance measuring devices 140 may be fixed to a second position of the flying object 130", which second position is capable of measuring the distance between the flying object 130" and the upper part of the loading space 21. As yet another example, one or more third distance measuring devices 140 may be fixed to a third position of the flying object 130", which third position is capable of measuring the distance between the flying object 130" and the front wall of the loading space. As a further example, one or more fourth distance measuring devices may be fixed to a fourth position of the flying object, which fourth position is capable of measuring the distance between the flying object 130" and the contents and / or the bottom wall of the loading space. In various embodiments, the controller 120 may utilize the outputs of multiple distance measuring devices 140 (e.g., measured distances) to facilitate the movement of the flying object 130" within the loading space 21. For example, the controller 120 may utilize the outputs of multiple distance measuring devices 140 to facilitate the safe navigation / movement of the flying object 130" within the loading space 21.

[0090] In various embodiments, the field of view 160 of the imaging device 110 can be configured to encompass the width (e.g., substantially the entire width) of the stowage space. In various embodiments, the field of view 160 of the imaging device 110 can be configured to encompass the width of the stowage space, wherein the imaging device can be configured to move from a first position within the stowage space to a second position within the stowage space. In various embodiments, as Figure 3As shown in , the imaging device can be oriented so that the field of view 160 of the imaging device is directed downward. In various other embodiments, the imaging device 110 can be oriented so that the field of view of the imaging device is directed toward the front wall of the loading space, wherein the rear edge of the field of view can be substantially vertical.

[0091] like Figures 1 to 3 As shown, an exemplary loading operation monitoring apparatus 100, 100', 100"' may include an imaging device 110 secured to a movable body (e.g., 130, 130', 130") configured to be positioned within a loading space at least at some point (e.g., temporarily) during a loading operation, wherein the imaging device 110 may have a direct line of sight to a loading space 21 defined by the carrier, for example, along a top portion of the carrier 20 (e.g., a ceiling in the case of a closed carrier). In various embodiments, the imaging device 110 may be secured to the movable body, wherein a field of view 160 of the imaging device intersects an object located below relative to the imaging device. In various embodiments, the field of view of the imaging device may encompass the width of the loading space. In various embodiments, the imaging device may be oriented such that the field of view of the imaging device is directed downward. In various other embodiments, the imaging device may be oriented such that the field of view of the imaging device is directed toward a front wall of the loading space, wherein a rear edge of the field of view may be substantially vertical.

[0092] In various embodiments, imaging device 110 may include one or more sensors configured to scan the contents of the loading space to generate imaging data that collectively represent a map of the loading space. In various embodiments, imaging device 110 may include 3D imaging devices, such as but not limited to three-dimensional cameras, 2D TOF cameras, optical mechanical LIDAR devices (e.g., solid-state LIDAR devices), millimeter wave radar devices, three-dimensional cameras based on structured light (e.g., automatic cubes), stereo camera systems, or any suitable 3D mapping devices that are operably located in the loading space to capture imaging data. In various embodiments, 3D imaging devices are preferred imaging devices. In various embodiments, preferred imaging devices are 2D TOF cameras. However, it should be understood that in certain embodiments, imaging device 110 can be different types of imaging devices, and / or imaging data can be different types of imaging data.

[0093] In various embodiments, the imaging device 110 may include a 3D imaging device configured to capture imaging data including an image. In some embodiments, the 3D imaging device may be configured to additionally capture video, etc. In various embodiments, the 3D imaging device may have a selected resolution so that the 3D imaging device can clearly capture images of objects of different sizes. For example, the 3D imaging device may have a selected resolution (e.g., based at least in part on the application), wherein the mentioned resolution of the 3D imaging device enables the smallest object captured in the field of view of the 3D imaging device to be distinguishable. In various embodiments, the 3D imaging device includes: an optical lens configured to define the field of view of the imaging device 110; an imaging device processing unit; various internal circuits configured to facilitate power management and connectivity and / or network communication of the imaging device. In various embodiments, as a non-limiting example, the optical lens of the imaging device may be configured so that the field of view of the imaging device may be at least between approximately 45 degrees and 180 degrees. In addition, in various embodiments, the imaging device 110 may include a protective housing, such as a plastic dome, configured to provide coverage for other imaging device components for protecting the imaging device. In various embodiments, the imaging device processing unit of the imaging device 110 may include a neural accelerator. In various embodiments, the imaging device processing unit of the imaging device 110 may include one or more hardware components and / or circuits that are different from the controller 120 of the exemplary loading operation monitoring device 100. Alternatively or additionally, in various embodiments, one or more hardware components, circuits, and / or functionality of the imaging device processing unit of the imaging device 110 may be defined by the controller 120, as described herein, so that the imaging device processing unit of the imaging device 110 may be defined as part of the controller 120. In various embodiments, the imaging device 110 may include one or more EDGE artificial intelligence (AI) components, which may include different hardware and / or circuits that communicate with the controller 120, or alternatively, may include various hardware and / or circuits that define parts of the controller 120. As non-limiting examples provided for illustrative purposes, in various embodiments, one or more EDGE AI components may include one or more of a k210 accelerator on a MAIX1 module, a V831 SoC on a MAIX2 module, a MAX78000 SoC, etc., and may be configured to utilize OpenCV AI Kit Lite as a hardware platform.

[0094] In various embodiments, the imaging device 110 may have a designated field of view for permanently and / or temporarily capturing one or more images of the loading space 21 defined by the carrier. For example, in various embodiments, the imaging device 110 may be configured such that at least a portion of the loading space 21 configured to receive an object is within the designated field of view during movement of the imaging device from one location within the loading space to another location within the loading space.

[0095] In various embodiments, the 3D map generated by the imaging device may include depth information that is analyzed by the controller to generate space utilization metrics and / or loading condition detection. For example, the imaging device 110 may include a 3D camera configured to capture a 3D point cloud image, wherein the 3D point cloud image may include point cloud data associated with objects within the loading space, wherein the point cloud data may include information, such as the proximity of an object within the loading space relative to another object, the depth of the object relative to the camera, etc.

[0096] like Figure 4 As shown, exemplary loading operation monitoring devices (e.g., respectively Figures 1 to 3 The embodiments 100, 100', 100" depicted in the drawings may include a controller 120, which includes a memory 121, a processor 122, input / output circuits 123, communication circuits 124, an imaging device data repository 107, a movement control circuit 125, an image processing circuit 126, an imaging device position circuit 127, an operator presence detection circuit 128 and an alarm management circuit 129. The controller 120 may be configured to perform the operations described herein. Although the components are described with respect to functional limitations, it should be understood that a particular implementation necessarily includes the use of specific hardware. It should also be understood that certain components described herein may include similar or common hardware. For example, both sets of circuits may use the same processor, network interface, storage medium, etc. to perform their associated functions, so that each set of circuits does not require duplicate hardware.

[0097] The term "circuitry" should be broadly understood to include hardware, and in some embodiments, software for configuring hardware. For example, in some embodiments, a "circuitry" may include processing circuits, storage media, network interfaces, input / output devices, etc. In some embodiments, other elements of the controller 120 may provide or supplement the functionality of a particular circuit. For example, the processor 122 may provide processing functionality, the memory 121 may provide storage functionality, the communication circuit 124 may provide network interface functionality, etc.

[0098] In some embodiments, the processor 122 (and / or a coprocessor or any other processing circuit that assists the processor or is otherwise associated with the processor) may communicate with the memory 121 via a bus for transferring information between components of the device. The memory 121 may be non-transitory and may include, for example, one or more volatile and / or non-volatile memories. For example, the memory 121 may be an electronic storage device (e.g., a computer-readable storage medium). In various embodiments, the memory 121 may be configured to store information, data, content, applications, instructions, etc. for enabling the device to implement various functions according to the exemplary embodiments of the present disclosure. It will be understood that the memory 121 may be configured to partially or completely store any electronic information, data, data structure, embodiment, example, figure, process, operation, technique, algorithm, instruction, system, device, method, lookup table, or computer program product described herein, or any combination thereof. As a non-limiting example, the memory 121 may be configured to store imaging data captured by an imaging device of the loading operation monitoring device 100, corresponding data generated by the controller 120 of the loading operation monitoring device 100, timestamp data associated with the loading operation associated with the loading space, location data, historical data, etc.

[0099] The processor 122 may be embodied in a variety of different ways, and may, for example, include one or more processing devices configured to execute independently. Additionally or alternatively, the processor may include one or more processors configured in series via a bus to enable independent execution of instructions, pipelining, and / or multithreading. The use of the term "processing circuitry" may be understood to include a single-core processor, a multi-core processor, multiple processors internal to a device, and / or a remote or "cloud" processor.

[0100] In an exemplary embodiment, the processor 122 may be configured to execute instructions stored in the memory 121 or otherwise accessible by the processor. Alternatively or in addition, the processor may be configured to perform hard-coded functions. Therefore, whether configured by hardware methods or software methods, or by a combination of them, the processor may represent an entity (e.g., physically embodied in the form of a circuit system) that is capable of performing operations according to the embodiments of the present disclosure while being configured accordingly. Alternatively, for example, when the processor is embodied as an executor of software instructions, the instructions may specifically configure the processor to perform the algorithms and / or operations described herein when executing the instructions.

[0101] In some embodiments, the controller 120 may include an input / output circuit 123, which may then communicate with the processor 122 to provide output to the user, and in some embodiments, receive input such as commands provided by the user. The input / output circuit 123 may include a user interface, such as a graphical user interface (GUI), and may include a display, which may include a network user interface, a GUI application, a mobile application, a client device, or any other suitable hardware or software. In some embodiments, the input / output circuit 123 may also include a display device, a display screen, a user input element (such as a touch screen), a touch area, a soft key, a keyboard, a mouse, a microphone, a speaker (e.g., a buzzer), a light emitting device (e.g., a red light emitting diode (LED), a green LED, a blue LED, a white LED, an infrared (IR) LED, or a combination thereof), or other input / output mechanisms. The processor 122, the input / output circuit 123 (which may utilize a processing circuit) or both may be configured to control one or more functions of one or more user interface elements by computer executable program code instructions (e.g., software, firmware) stored in a non-transitory computer readable storage medium (e.g., memory 121). The input / output circuit 123 is optional, and in some embodiments, the controller 120 may not include an input / output circuit. For example, in various embodiments, the controller 120 may generate one or more alarm signals (e.g., data) that are to be transmitted to one or more other devices with which one or more authorized users (administrators, security coordinators, etc.) directly interact, and cause the one or more alarm signals to be transmitted at the one or more other devices.

[0102] The communication circuit 124 may be a device or circuit embodied in hardware or a combination of hardware and software that is configured to receive and / or transmit data to a network and / or any other device, circuit, or module in communication with the controller 120. For example, the communication circuit 124 may be configured to communicate with one or more computing devices via a wired (e.g., USB) or wireless (e.g., Bluetooth, Wi-Fi, cellular, etc.) communication protocol. For example, in various embodiments, the communication circuit 124 may be configured to facilitate data communication between the exemplary loading operation monitoring apparatus 100 and one or more external computing devices via a wired (e.g., USB, Ethernet, etc.) and / or wireless (e.g., Bluetooth, Wi-Fi, cellular, etc.) communication protocol.

[0103] In various embodiments, the processor 122 may be configured to communicate with the mobile control circuit 125. The mobile control circuit 125 may be a device or circuit embodied in hardware or a combination of hardware and software, which is configured to facilitate the operation of the movable body by generating control signals configured to operate the drive mechanism of the movable body. In various embodiments, the mobile control circuit 125 may be configured to generate the mentioned control signals to operate the drive mechanism of the movable body periodically and / or in response to the operator's interaction with the loading space (e.g., the operator enters the loading space of the carrier, the operator leaves the loading space of the carrier) during the loading operation. In various embodiments, the movable body control circuit may be configured to receive one or more signals from the operator presence detection circuit 128, which indicate that the operator enters the loading space and / or the operator leaves the loading space.

[0104] In various embodiments, the movement control circuit 125 may be configured to receive a first control signal (e.g., periodically during a loading operation and / or in response to an operator's interaction with the loading space) and, in response, transmit a corresponding signal to one or more circuits of the controller 120, such as an imaging device position circuit 127, an operator presence detection circuit 128, and / or an alarm management circuit 129, to facilitate detecting a loading condition (e.g., an unsatisfactory loading condition) based at least in part on the loading arrangement of objects placed in the loading space by one or more operators.

[0105] In various embodiments, the processor 122 may be configured to communicate with the imaging device position circuit 127. The imaging device position circuit 127 may be a device or circuit embodied in hardware or a combination of hardware and software that is configured to receive, process, generate and / or transmit data, such as one or more signals received from the distance measurement device 140. In various embodiments, the imaging device position circuit 127 may be configured to determine the position of the imaging device within the loading space relative to a reference point. In various embodiments, the reference point may include a front wall of the loading space. For example, the imaging device position circuit 127 may be configured to process one or more signals received from the distance measurement device 140 to determine the position of the imaging device within the loading space relative to the front wall of the loading space.

[0106] In various embodiments, the processor 122 may be configured to communicate with the image processing circuit 126. The image processing circuit 126 may be a device and / or circuit embodied in hardware or a combination of hardware and software that is configured to receive, process, generate and / or transmit data (e.g., imaging data), such as one or more images, videos, etc. captured by the imaging device 110 of the exemplary loading operation monitoring apparatus 100, 100', 100". In various embodiments, the image processing circuit 126 may be further configured to analyze the one or more images captured by the imaging device 110 using at least one processing technique to determine one or more characteristics of the conditions captured in the one or more images, such as the proximity (e.g., distance) between two adjacent boxes, the proximity between a side wall and an adjacent object, the proximity between a top wall (e.g., ceiling) and adjacent objects at different locations within the loading space below the top wall, the proximity between a front wall and adjacent objects, the relative height of contents at a first location within the loading space and a second location within the loading space (e.g., the height of stacked objects), the volume of space between objects, etc.

[0107] The image processing circuit 126 may be configured to determine a space utilization metric (e.g., the volume of utilized space) in the loading space (e.g., 80% space utilization, 20% space utilization, etc.) based at least in part on the mentioned one or more characteristics of the condition captured in the one or more images, as described above. In addition, in various embodiments, the image processing circuit 126 may be configured to detect the loading condition based at least in part on the determined space utilization metric. As a non-limiting example, in various embodiments, the loading condition may be detected based at least in part on comparing the determined space utilization metric to a space utilization threshold, wherein a space utilization metric that meets the space utilization threshold may be considered a satisfactory loading condition, and a space utilization metric that fails to meet the space utilization threshold may be considered an unsatisfactory loading condition.

[0108] Additionally, in various embodiments, the image processing circuitry 126 may also be configured to analyze one or more images captured by the imaging device 110 to detect the presence of an operator within the loading space of the carrier, for example, using one or more machine learning techniques and / or one or more image processing techniques. Additionally, in various embodiments, the image processing circuitry 126 may further be configured to analyze one or more images captured by the imaging device 110 to detect a safety condition (e.g., a platform door status (e.g., open or closed)). Additionally, in various embodiments, the image processing circuitry 126 may also be configured to analyze one or more images captured by the imaging device 110 to detect the status of equipment within the loading space of the carrier, for example, using one or more machine learning techniques and / or one or more image processing techniques.

[0109] In various embodiments, for example, when processing various imaging data captured by the imaging device 110, the image processing circuit 126 may be configured to generate corresponding data that can be stored by the loading operation monitoring device 100, 100', 100" (e.g., at an imaging device data repository 107 associated therewith) in a supported format that facilitates the loading operation monitoring device 100, 100', 100" to interact with and / or retrieve the data as part of one or more machine learning operations. In various embodiments, as a non-limiting illustrative example, one or more machine learning techniques are used by the image processing circuit 126 to determine loading space utilization within the loading space 21 of the carrier, which machine learning techniques may include deep supervised learning using one or more labeled data sets having one or more known characteristics and / or conditions, such as known distances, arrangements, contours, materials, colors, depths and / or any other data generated, transmitted and / or received by the controller 120.

[0110] In various embodiments, the image processing circuitry 126 may transmit and / or receive imaging data captured by the imaging device 110 and / or corresponding data associated therewith generated by the image processing circuitry 126 in a supported format to and / or from the imaging device data repository 107 .

[0111] In various embodiments, the processor 122 may be configured to communicate with an alarm management circuit 129. The alarm management circuit 129 may be a device or circuit implemented in hardware or a combination of hardware and software that is configured to, when the exemplary loading operation monitoring device detects a loading condition associated with the loading space, cause one or more alarm signals corresponding to the detected loading condition to be transmitted from the operating condition indicator of the exemplary loading operation monitoring device. As described herein, the alarm management circuit 129 circuit may facilitate the transmission (e.g., emission, display, and / or any other perceptible means of signal communication) of an exemplary alarm signal including an audio and / or visual signal corresponding to the detected loading condition, which, after being transmitted from the operating condition indicator, may embody a perceptible indication of the loading condition (e.g., light, sound, message, etc., or any combination thereof) and / or an instruction message corresponding to the detected loading condition. For example, the alarm management circuit 129 may generate an indicator signal corresponding to the detected loading condition and may cause the indicator signal to be transmitted to the operating condition indicator for transmission from the operating condition indicator as one or more audio and / or visual alarm signals embodying an indication of the loading condition detected by the loading operation monitoring device. As described herein, the alarm management circuit 129 may be configured to facilitate transmission of unique alarm signals based on the loading condition detected by the loading operation monitoring device 100, e.g., a first alarm signal having a first signal configuration corresponding to an unsatisfactory loading condition, a second alarm signal having a second signal configuration corresponding to a satisfactory loading condition, etc.

[0112] In various embodiments, the exemplary loading operation monitoring device 100, 100', 100" may be configured to have an imaging device data repository 107 or to communicate with the imaging device data repository. The imaging device data repository 107 may be at least partially stored on the system's memory 121. In some embodiments, the imaging device data repository 107 may be remote from the device 100, 100', 100" but integrated with the device. The imaging device data repository 107 may contain information, such as images associated with one or more loading spaces. In some embodiments, the device 100, 100', 100" may also use machine learning to detect one or more conditions, states, etc. associated with the loading space and / or the loading environment to assist in detecting loading conditions associated with the loading space, so that the device 100 can use a reference database (e.g., the imaging device data repository 107) to initially train the device 100, 100', 100", and can then be configured to detect loading conditions without reference to the imaging device data repository 107 or other reference databases. For example, in various embodiments, the controller 120 may be configured to execute a feedback loop wherein one or more imaging data and corresponding spatial utilization data and / or determined features (associated with the imaging data) may be limited to one or more inputs to a machine learning model in order to increase the rate of machine learning associated with the one or more machine learning techniques, as described herein.

[0113] Having described exemplary systems, devices, environments, data flows according to the present disclosure, exemplary processes according to the present disclosure will now be discussed. It should be understood that each flowchart depicts an exemplary computer-implemented process that can be performed by one or more of the devices, systems, equipment, and / or computer program products described herein, such as one or more of its specially configured components. The depicted frame indicates the operation of each process. Such operations can be any of a variety of ways, including but not limited to the order and manner depicted and described herein. In some embodiments, one or more frames of any process described herein occur between one or more frames of another process, before one or more frames of another process, in parallel with one or more frames of another process, and / or as a subprocess of a second process. Additionally or alternatively, any process may include some or all of the operational steps described and / or depicted, including one or more optional frames in some embodiments. With regard to the flowchart shown herein, in some or all embodiments of the present disclosure, one or more of the depicted frames may be optional. Optional frames are shown with dotted lines (or "dash-dot lines"). Similarly, it should be appreciated that one or more of the operations of each flow diagram may be combined, replaced, and / or otherwise varied as described herein.

[0114] As described herein, in various embodiments, the exemplary loading operation monitoring device may be configured to detect the loading condition of the loading space based at least in part on the captured imaging data of the loading space. Specifically, as described herein, the exemplary loading operation monitoring device may be configured to detect the loading condition within the loading space of the carrier. For example, now referring to Figure 5 , a flow chart of an exemplary method 500 for detecting a loading condition of a loading space of a carrier based at least in part on captured imaging data of the loading space is shown. In some embodiments, one or more operations of the exemplary method 500 shown may be performed by controlling a loading operation monitoring device according to one or more exemplary embodiments described herein. For example, the various operations discussed below with respect to the exemplary method 500 may be performed using various components of the exemplary loading operation monitoring device, such as those described above with reference to Figures 1 to 4 The exemplary loading operation monitoring device 100, 100', 100". In various embodiments, the exemplary loading operation monitoring device for performing one or more operations of the exemplary method 500 may include an imaging device, an active body, a distance measuring device, and a controller including one or more processors. In various embodiments, the exemplary loading operation monitoring device may further include a loading status indicator.

[0115] In various embodiments, although various steps described herein with respect to the exemplary method 500 may be described, shown, and / or otherwise disclosed for illustrative purposes as sequential steps (e.g., operations) that are performed in sequence to facilitate execution of the exemplary method, it should be understood that at least a portion of the exemplary method 500 may include synchronous steps that may be performed at least substantially simultaneously (e.g., by the exemplary loading operation monitoring device). For example, in various embodiments, a loading condition may be detected in at least substantially a single instance based on multiple data outputs corresponding to multiple loading configurations (e.g., positions, orientations, proximity, depths, etc.), as captured by the exemplary imaging device in association with at least substantially the same instance. For example, at least a portion of the exemplary methods described herein may be facilitated by a machine learning model, wherein an artificial intelligence driven device (e.g., a controller of the exemplary loading operation monitoring device) may be used to at least substantially minimize the number of asynchronous detection operations and / or corresponding determinations required to detect a loading condition.

[0116] like Figure 5As shown, at box 502, the exemplary method 500 may include identifying the start of a loading operation via a controller. In some embodiments, the start of a loading operation may be identified at least in part based on receiving a notification (e.g., a signal, a message, etc.) indicating the start of a loading operation associated with a loading space of a carrier via a controller associated with an exemplary loading operation monitoring device. For example, in various embodiments, the start of a loading operation may be detected by the exemplary loading operation monitoring device at least in part based on a detected operator presence state and / or a detected carrier presence state. For example, the exemplary loading operation monitoring device may be determined at least in part based on one or more signals and / or imaging data received from a sensor device (e.g., a proximity sensor, an RGB imaging device, etc.), wherein the controller may be configured to analyze the one or more signals and / or imaging data to determine the start of a loading operation (e.g., the start of a loading operation). In various embodiments, a loading operation may describe the process of placing an object (e.g., by a human operator) in a loading space of a carrier (e.g., a container, a truck, a trailer, a truck, a dump truck, etc.) for transport to one or more locations (e.g., one or more destinations). In some embodiments, one or more of the signals and / or imaging data mentioned may be generated by a sensor device located near the loading environment (e.g., a loading station), wherein the sensor device may generate the signals and / or imaging data in response to the presence of an operator and / or a carrier.

[0117] At block 504, the exemplary method 500 may further include causing, via the controller, the movable body having the imaging device secured thereto to be inserted into the stowage space.

[0118] At block 506, the exemplary method 500 may further include capturing imaging data of the loading space and contents of the loading space (e.g., an object) via an imaging device that is fixed to the active body and configured to move between a first position and a second position within the loading space via operation of the active body, wherein the imaging data includes imaging data of the object within the field of view of the imaging device at a time during the movement of the imaging device, and wherein the distance between the first position and the second position may include a length of the loading space of the carrier. For example, the imaging data may be captured by an imaging device of an exemplary loading operation monitoring apparatus.

[0119] In various embodiments, the controller may cause the imaging device to capture images at intervals along the length of the loading space based at least in part on the field of view of the imaging device and the length of the loading space of the carrier (e.g., the distance from the front wall of the loading space to the rear of the loading space). For example, the controller may be configured to determine intervals along the length of the loading space based at least in part on the length of the loading space and the field of view of the imaging device, and the controller causes the imaging device to capture images relative to the intervals so as to efficiently and effectively obtain imaging data that substantially surrounds the entire loading space. For example, the controller may be configured to determine an optimal number of images (e.g., frames) to be captured and the distance / interval between each captured image based at least in part on the length of the loading space and the field of view of the imaging device. For example, in various embodiments, the controller may be configured to cause the imaging device to capture images at intervals such that the imaging data between consecutive images overlap. For example, in various embodiments, when the optimal number of images to be captured and the optimal distance between each image capture operation are detected, the controller causes the imaging device to move within the loading space in a stepwise / stepping distance manner, wherein the controller causes the imaging device to capture images at one or more intervals during movement within the loading space based at least in part on the determined optimal number of images and the distance between images. For example, the controller may be configured to cause the imaging device to capture a number N of images along the length of the loading space, wherein the number of images is determined based at least in part on a distance between the imaging device and a front wall of the loading space.

[0120] In various embodiments, the controller may determine the length of the carrier based at least in part on one or more signals and / or data indicating the position of the distance between the front wall of the loading space and the rear of the loading space received from the sensor device (e.g., the distance sensor device). In various embodiments, the controller may cause the imaging device to capture imaging data of the contents (e.g., objects) of the loading space based at least in part on one or more signals and / or data received from the sensor device (e.g., the distance sensor device), the one or more signals and / or data indicating the distance between the imaging device and the front wall at a certain moment. In various embodiments, the controller may be configured to cause the active body to drive, flow, move, insert, position, and / or similar operations within the loading space. In an exemplary embodiment, the active body may include an extendable beam, wherein the controller may cause the extendable beam to extend from the rear end of the loading space into the loading space (e.g., in response to the start of the loading operation), and as the imaging device moves from a first position (e.g., the rear of the loading space) to a second position (e.g., the front of the loading space) via the movement of the extendable beam, the imaging device is caused to capture imaging data at a determined position. In another exemplary embodiment, the movable body may include a carriage beam, wherein the controller may cause a carriage associated with the carriage beam (e.g., temporarily located within the loading space) to move from a first position (e.g., a rear end of the carriage beam) to a second position (e.g., a front end of the beam), and cause an imaging device fixed to the carriage to capture imaging data at a determined position as the imaging device moves from the first position (e.g., a rear portion of the loading space) to the second position (e.g., a front portion of the loading space) via movement of the carriage. In yet another exemplary embodiment, the movable body may include a flying object (e.g., an unmanned aircraft), wherein the controller may be configured to cause the flying object to be driven (e.g., inserted) into the loading space in response to detecting the start of a loading operation, and also cause the imaging device to be at a determined position within the loading space. In various embodiments,

[0121] In various embodiments, imaging data captured by an imaging device of an exemplary loading operation monitoring apparatus may be used to monitor loading operations to determine space utilization of a loading space (e.g., utilized space volume) and detect loading conditions. For example, the imaging data may include information such as proximity information and depth information associated with objects within the loading space, and the imaging device may be enabled to capture imaging data of the loading space periodically during the loading operation and / or in response to an operator presence condition (e.g., an operator entering the loading space or an operator leaving the loading space), wherein the image may include a map (e.g., a 3D map) of the contents of substantially the entire loading space.

[0122] At block 508, the exemplary method 500 may further include determining a space utilization metric (e.g., utilized volume of space) based at least in part on the imaging data. As described herein, imaging data captured by an imaging device may be processed by an exemplary loading operation monitoring apparatus (e.g., a controller thereof) to detect unused volumetric space based at least in part on the imaging data including depth of an object relative to the imaging device, proximity of a given object to adjacent objects, etc. For example, one or more machine learning techniques and / or one or more image processing techniques may be performed with respect to the imaging data to detect loading space utilization.

[0123] At block 510, the exemplary method 500 may further include detecting a loading condition based at least in part on a space utilization metric, wherein, as a non-limiting example, the loading condition may include a satisfactory space utilization condition, an unsatisfactory space utilization condition, and the like. As a non-limiting example, in various embodiments, the loading condition may be detected based at least in part on comparing a determined space utilization metric (e.g., utilized space volume) to a space utilization threshold, wherein a space utilization metric that satisfies the space utilization threshold may be considered a satisfactory loading condition, and a space utilization metric that fails to meet the space utilization threshold may be considered an unsatisfactory loading condition. In various embodiments, one or more image processing operations may be performed relative to the space utilization metric to detect the loading condition. Additionally and / or alternatively, in various embodiments, one or more machine learning techniques may be performed relative to the space utilization metric to detect the loading condition.

[0124] At block 512, the exemplary method 500 may also include transmitting, from the operating condition indicator, a first alarm signal embodying an indicator of underutilized loading space upon detection of an unsatisfactory loading condition. As described herein, upon detection of an unsatisfactory space utilization condition associated with the loading space, the exemplary loading operation monitoring device may generate a first alarm signal configured to be transmitted from the loading condition indicator of the loading operation monitoring device to an operator and / or one or more persons (e.g., a manager, administrator, etc.) as an indication of the unsatisfactory loading condition. For example, upon detection of an unsatisfactory loading condition, the exemplary loading operation monitoring device may cause the first alarm signal corresponding to the unsatisfactory loading condition to be transmitted from the loading condition indicator as a visual signal, such as selective illumination of a light element (e.g., an LED) of the operating condition indicator, the light element being configured to emit a particular color of light (e.g., green light) that specifically corresponds to a safe operating condition.

[0125] It should be understood that in various other embodiments, the exemplary loading operation monitoring device may enable the transmission of an alarm signal for each loading condition detection and / or a subset of loading conditions. Although the various embodiments described herein discuss a single imaging device, it should be understood that the exemplary loading operation monitoring device may include multiple imaging devices. In addition, although the various embodiments described herein discuss a single distance measuring device, it should be understood that the exemplary loading operation monitoring device may include multiple distance measuring devices. In addition, although the various embodiments described herein discuss a single controller, it should be understood that the exemplary loading operation monitoring device may include multiple controllers.

[0126] Many modifications and other embodiments will occur to those skilled in the art to which the present disclosure pertains, having the benefit of the teachings presented in the foregoing description and the associated drawings. Therefore, it should be understood that the present disclosure is not limited to the particular embodiments disclosed, and modifications and other embodiments are intended to be included within the scope of the appended claims. Although specific terms are employed herein, they are used in a generic and descriptive sense only and not for purposes of limitation.

Claims

1. A device for monitoring a loading operation, the device comprising: a movable body configured to be inserted into a loading space of a carrier and to approach an upper portion of the loading space during a loading operation; an imaging device secured to the movable body, the imaging device being configured to capture imaging data of the loading space, wherein the captured imaging data comprises a three-dimensional map of the loading space; a distance measuring device fixed to the movable body, the distance measuring device being configured to measure a distance between the imaging device and a front wall of the loading space; and A controller configured to receive the imaging data captured by the imaging device, wherein the controller includes one or more processors configured to detect a loading condition of the loading space of the carrier based at least in part on the imaging data.

2. The device according to claim 1, wherein: The movable body comprises an extendable beam, The imaging device is secured to a first end of the extendable beam, and The imaging device is configured to move via extension of the extendable beam.

3. The device according to claim 1, wherein: The movable body includes a bracket fixed to the beam, The carriage is configured to move along the length of the beam, and The imaging device is secured to the carriage and is configured to move along a length of the loading space via movement of the carriage.

4. The device according to claim 1, wherein: The moving subject includes a flying object.

5. The device according to claim 1, wherein: The controller is configured to: i. determine the height of the contents of the area of ​​the loading space during the loading operation; and ii. in response to determining that the height of the contents of the area of ​​the loading space meets a content height threshold: a. determine that loading of the area of ​​the loading space has been completed, and b. cause the active body to move a second length less than the first length when reinserted into the loading space.

6. The device according to claim 1, wherein: The imaging device is a three-dimensional camera configured to capture a three-dimensional point cloud image.

7. The device according to claim 1, wherein: The controller is configured to cause the imaging device to capture a number N of images along a length of the loading space, wherein the number N of images is determined based at least in part on the distance between the imaging device and the front wall of the loading space.

8. The device according to claim 1, wherein: The controller is configured to determine a space utilization metric based at least in part on the imaging data, wherein the loading condition is detected based at least in part on comparing the space utilization metric to a space utilization threshold.

9. The device according to claim 1 further includes a loading status indicator, which is in electronic communication with the controller, so that the loading status indicator is configured to receive one or more indicator signals corresponding to the detected loading condition from the controller, and in response, transmit an alarm signal corresponding to the detected loading condition based on the one or more indicator signals, and the alarm signal embodies an indicator of the detected loading condition.