Generating image data for a real-time situational awareness system
A portable, omnidirectional imaging apparatus with integrated sensors and wireless charging addresses the limitations of existing cameras by providing a comprehensive view and efficient data capture in harsh environments, enhancing real-time situational awareness and reducing costs.
Patent Information
- Application Number
- GB2023007698
- Authority / Receiving Office
- GB · GB
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-23
- Publication Date
- 2024-11-27
AI Technical Summary
Existing airport CCTV cameras and dedicated high-resolution digital cameras struggle to provide effective real-time situational awareness due to obstructions and high costs, while manual data capture methods are time-consuming and prone to errors, posing safety hazards in busy airport environments.
A portable imaging apparatus with an omnidirectional camera, wireless communication module, and mounting structure that can be removably attached to objects, providing a panoramic view and integrating sensors for environmental data, and capable of wireless charging, designed for use in explosive and harsh conditions.
The apparatus offers a complete and reliable view of the environment, reducing installation costs and enhancing situational awareness, while minimizing power consumption and avoiding unnecessary data generation through sensor-driven operation.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
Technical Field The present disclosure relates, in general, to generating image data for a real-time situational awareness system. Aspects of the disclosure relate to an apparatus for generating image data. Background Across many sectors such as aviation, maritime, and logistics, in order to make operations more efficient and to provide visual aid, situational awareness is required. There are many events and actions that are required to be taken between an aircraft’s arrival at an airport and its departure therefrom. For below-wing operations, task status and events are typically manually captured using a digital input tool or via a paper-based process. This is not only time-consuming, but also poses problems due to the quality of data and the capture point thereof, making it unsuitable for operational use, particularly in case a duplicate input process is required. Furthermore, there are many hazards associated with performing below-wing operations. While existing airport CCTV cameras can be used to capture physical events and timestamp those, the view provided by those is often not suitable for real-time situational awareness applications. This is due to the fact that the events to be captures are often obscured by aircraft and other vehicles present at the airport. A dedicated high-resolution digital camera can be employed at a nose of the aircraft in order to provide port and starboard visibility. Unfortunately, such a solution is not only expensive to implement, but also the view of the camera can be obscured by the wings and ramp assets, reducing the effectiveness of such setup. Summary An objective of the present disclosure is to provide an effective solution for generating image data for a real-time situational awareness system. The foregoing and other objectives are achieved by the features of the independent claims. Further implementation forms are apparent from the dependent claims, the description and the Figures. A first aspect of the present disclosure provides an apparatus for generating image data for a real-time situational awareness system, the apparatus comprising an imaging structure comprising at least one imaging device provided within a body of the apparatus and configured to generate image data representing a panoramic image of an environment within which the apparatus is to be deployed, a wireless communications module configured to transmit the image data from the apparatus, and a mounting structure depending from the body to removably mount the apparatus to an object within the environment. Accordingly, an imaging apparatus that offers a complete and useful view regardless of the presence of any possible obstructions / obstacles in the environment can be provided. The apparatus is thus suitable for use with a real-time situational awareness system. Furthermore, as the apparatus is not fixed in place, installation costs can be reduced In an implementation of the first aspect, the imagining device may comprise an omnidirectional camera apparatus. Thus, a complete view of the environment can be provided. The imaging structure may comprise n imaging devices each having a field of view of 360 / n degrees. Thus, a complete view of the environment can be provided in an alternative manner. The body may define a hermetically sealed cavity for at least one of the imaging structure and the wireless communications module. Thus, the apparatus can be secured against water vapour and foreign bodies to maintain proper functioning and reliability. The body may be mechanically configured for use in explosive atmospheres. Thus, the apparatus can reliably be deployed in environments where explosions might be an issue. The apparatus may further comprise at least one of: an antenna, a radio frequency communications transceiver, a GPS module, a laser imaging, detection, and ranging, LiDAR, device, an accelerometer, a gyrometer, a magnetometer, a temperature sensor, a 3 humidity sensor, a light meter, a microphone, and a power source. Thus, the performance of the apparatus can be enhanced. The apparatus may further comprise at least one photovoltaic cell configured to charge the power source. Thus, the apparatus can be powered using solar energy. The apparatus may further comprise a wireless charging structure configured to wirelessly charge a power source for the apparatus. Thus, the apparatus can be charged wirelessly, reducing the need to use wires. The wireless charging structure may be provided within or as part of the mounting structure. The mounting structure may comprise an elongate section configured to locate within an opening of a safety cone. Thus, the apparatus can be mounted on a safety cone within the environment. The mounting structure may comprise a switch configured to generate a deployment signal on the basis of a deployment state of the apparatus. Thus, unnecessary use of the apparatus (and increased power consumption associated therewith) can be avoided. The apparatus may further comprise a processor, a memory coupled to the processor, the memory configured to store program code executable by the processor and comprising one or more instructions, whereby to cause the apparatus to transmit, using the wireless communications module, image data generated by the imaging structure to the real-time situational awareness system. Thus, the apparatus can communicate with the real-time situational awareness system in an effective manner. The program code may further comprise one or more further instructions, whereby to cause the apparatus to process the image data generated by the imaging structure, whereby to augment the image data generated by the imaging structure with information relating to at least one of a location of the apparatus, a time of capture of a panoramic image, movement of the apparatus, temperature and / or humidity of the environment within which the apparatus is deployed and / or of the apparatus, and light level of the environment within which the apparatus is deployed. Thus, the apparatus can provide an enhanced view of the environment and provide valuable information to the system. The program code may further comprise one or more further instructions, whereby to cause the apparatus to generate, or cease generating, image data on the basis of a position of the apparatus. Thus, unnecessary use of the apparatus (and increased power consumption associated therewith) can be avoided. The program code may further comprise one or more further instructions, whereby to cause the apparatus to receive, using the wireless communications module, a signal configured to trigger or cease generation of image data. Thus, the generation of the image data can be governed by an external entity. The program code may further comprise one or more further instructions, whereby to cause the apparatus to determine a deployment state of the apparatus using the deployment signal, and generate, or cease generating, image data on the basis of the determined deployment state of the apparatus. Thus, unnecessary use of the apparatus (and increased power consumption associated therewith) can be avoided. Brief Description of the Drawings In order that the present invention may be more readily understood, embodiments of the invention will now be described, by way of example, with reference to the accompanying drawings, in which: Figure lisa schematic representation of an apparatus according to an example; Figure 2 is a schematic representation of a deployed apparatus according to an example; Figure 3 is a schematic representation of positioning of a plurality of apparatuses according to an example; Figure 4 is a schematic representation of different positioning of a plurality of apparatuses according to an example; Figure 5 is a schematic representation of another positioning of a plurality of apparatuses according to an example; and Figure 6 is a schematic representation of different positioning of a plurality of apparatuses according to an example; Detailed Description Example embodiments are described below in sufficient detail to enable those of ordinary skill in the art to embody and implement the systems and processes herein described. It is important to understand that embodiments can be provided in many alternate forms and should not be construed as limited to the examples set forth herein. Accordingly, while embodiments can be modified in various ways and take on various alternative forms, specific embodiments thereof are shown in the drawings and described in detail below as examples. There is no intent to limit to the particular forms disclosed. On the contrary, all modifications, equivalents, and alternatives falling within the scope of the appended claims should be included. Elements of the example embodiments are consistently denoted by the same reference numerals throughout the drawings and detailed description where appropriate. The terminology used herein to describe embodiments is not intended to limit the scope. The articles “a,” “an,” and “the” are singular in that they have a single referent, however the use of the singular form in the present document should not preclude the presence of more than one referent. In other words, elements referred to in the singular can number one or more, unless the context clearly indicates otherwise. It will be further understood that the terms “comprises,” “comprising,” “includes,” and / or “including,” when used herein, specify the presence of stated features, items, steps, operations, elements, and / or components, but do not preclude the presence or addition of one or more other features, items, steps, operations, elements, components, and / or groups thereof. Unless otherwise defined, all terms (including technical and scientific terms) used herein are to be interpreted as is customary in the art. It will be further understood that terms in common usage should also be interpreted as is customary in the relevant art and not in an idealized or overly formal sense unless expressly so defined herein. Airport ground travel surfaces, such as ramp areas, are typically very busy zones. Simultaneous arrival and departure of multiple aircrafts, as well as the presence of ground-based support and service vehicles and staff, contribute to the creation of a fast-paced environment. To ensure smooth operation in such a busy environment, careful monitoring is required. For example, to avoid collisions and similar accidents, the 6 location and movements of aircraft, ground vehicles, personnel, and equipment must be monitored and controlled. Various cameras and sensors are used for the purpose of monitoring. These cameras and sensors are often fixed in place, such as CCTV cameras, typically supplied at gate locations in airport ramp areas at many airports. Unfortunately, in the busy ramp area, the cameras are often unable to provide a useful view due to objects moving into the view of the camera and blocking it. Additionally, the information obtained by CCTV and other cameras is limited during low visibility weather conditions. This can create a safety hazard and lead to incidents such as collisions, as it may not be possible to safely guide the ground vehicles and / or aircraft around the ramp area. Another drawback of using telemetry from existing CCTV to provide remote assistance and manual or automated timestamping is that the legacy technology is often difficult to interface with. Furthermore, implementing additional fixed cameras is expensive and time consuming. Figure 1 schematically represents an apparatus for generating image data for a real-time situational awareness system. The apparatus 100 comprises an imaging structure 102 comprising at least one imaging device 104 provided within a body 106 of the apparatus 100. The at least one imaging device 104 may comprise a high-resolution camera, preferably a high-resolution, wide-angle camera to provide an expansive view of the environment. The at least one imaging device 104 may comprise a fish-eye camera. The imaging structure 102 may comprise n imaging devices 104 each having a field of view of 360 / n degrees. As such, the imaging structure 102 may provide a 360-degree field-of-view regardless of the positioning of the apparatus 100. The at least one imaging device 104 is configured to generate image data representing a panoramic image of an environment within which the apparatus 100 is to be deployed. The environment may include, for example, an airport ramp, a maritime port, or a logistics facility. The generated image data may show, for example, positioning of objects around the apparatus 100, including the presence or absence of any structures / objects that might interfere with or obstruct movement at the ramp area. The apparatus 100 comprises a wireless communications module 108 configured to transmit the image data from the apparatus 100. The wireless communications module 108 may be configured to transmit the image data from the apparatus 100 via any 7 suitable wireless communications protocol, such as Wi-Fi, 4G / 5G, and / or Bluetooth. In an example, the apparatus 100 may be configured to utilise the wireless communications module 108 to interface with other devices within range. For example, the apparatus 100 may be arranged to interface with another apparatus of the same kind to thereby create a mesh network. The image data from the apparatus 100 may be transmitted to a real-time situational awareness system for analysis and processing. The apparatus 100 comprises a mounting structure 110 depending from the body 106 to removably mount the apparatus 100 to an object within the environment. For example, in case the apparatus 100 is deployed in an airport ramp environment, the object on which the apparatus 100 is mounted on may include a mobile static object, such as a cone or a safety tape stand. However, the apparatus 100 may be mounted on any object, as long as the object can provide the apparatus 100 with an unobstructed view of its surroundings. The apparatus 100 may be mounted at the top of the object. The body 106 may define a hermetically sealed cavity for at least one of the imaging structure 102 and the wireless communications module 108. The body 106 may be mechanically configured for use in explosive atmospheres. For example, the body 106 may be designed to be explosion proof in that it isolates the el ectri c / electronic components and equipment from the surrounding atmosphere, such that any faults which may occur within the body 106 are intended to be contained within the body 106 so that they do not cause firesand / or explosions in the surrounding area. That is, the body 106 may be designed to block hazardous conditions (such as flames or sparks) occurring within the body 106 from travelling out of the body 106, and vice versa. The apparatus 100 may be further equipped with a radio frequency communications transceiver. The apparatus 100 may further comprise a laser imaging, detection, and ranging (LiDAR) device. The apparatus 100 may further comprise an accelerometer, a gyrometer, and / or a magnetometer. A mode of operation of the apparatus 100 may be changed based on information obtained using the accelerometer and / or gyrometer and / or magnetometer. In an example, the apparatus 100 may use the information obtained via the accelerometer to determine an orientation of the apparatus 100, 8 generating and transmitting an alert if the apparatus 100 is arranged horizontally when it is expected to be arranged vertically, or vice versa. The apparatus 100 may further comprise with at least one sensor, for example, a temperature sensor, a humidity sensor, and / or a light meter. The apparatus 100 may further comprise a GPS module. When deployed, the apparatus 100 may obtain, via the GPS module, information relating to its location, and use that information (combined with other information obtained using the at least one sensor) to enable a creation of a 3D model of the environment in which the apparatus 100 is deployed. The apparatus 100 may further comprise audio detection means, such as a microphone, to thereby monitor noise in the environment in which the apparatus 100 has been deployed. For example, if the apparatus 100 is deployed at an airport ramp, the audio detection means may be configured to enable the apparatus 100 to detect an aircraft engine start and / or stop based on the noise. The apparatus 100 may further comprise gas detection means, such as a gas detector. The gas detection means may enable the apparatus 100 to, when deployed, detect fuel leaks and other chemical spills in the environment. The apparatus 100 may further comprise thermal imaging means. The thermal imaging means may be comprised in the imaging structure 102. The thermal imaging means may enable the apparatus 100 to identify hot spots in the environment in which the apparatus 100 has been deployed, thereby identifying potential fire hazards. The apparatus 100 may further comprise a power source. The power source may be, for example, a battery, or a capacitor. The power source may also be connected to the apparatus using an umbilical lead, thus enabling the apparatus to be deployed more flexibly. The apparatus 100 may also comprise at least one photovoltaic cell configured to charge the power source. In an example, the apparatus 100 further comprises a wireless charging structure configured to wirelessly charge a power source for the apparatus. The wireless charging structure may be provided within, or as part of, the mounting structure 110. The wireless charging structure may be arranged to wirelessly charge the power source for the apparatus based on the position of the apparatus 100, as detected by at least one of the apparatus’ 100 sensors. In a specific example, the 9 wireless charging structure may be arranged to charge the power source in response to a determination that the apparatus 100 is positioned upside down. The mounting structure 110 may comprise an elongate section configured to locate within an opening of a safety cone. The mounting structure 110 may further comprise a switch configured to generate a deployment signal on the basis of a deployment state of the apparatus 100. The apparatus 100 may further comprise a processor and a memory coupled to the processor, the memory configured to store program code executable by the processor and comprising one or more instructions, whereby to cause the apparatus 100 to transmit, using the wireless communications module 108, the image data generated by the imaging structure to the real-time situational awareness system. The program code may further comprise instructions to cause the apparatus 100 to process the image data generated by the imaging structure 102, whereby to augment the image data generated by the imaging structure 102 with information relating to at least one of a location of the apparatus, a time of capture of a panoramic image, movement of the apparatus, temperature and / or humidity of the environment within which the apparatus is deployed and / or of the apparatus, and light level of the environment within which the apparatus is deployed. The program code may further comprise instructions to cause the apparatus 100 to generate, or cease generating, image data on the basis of a position of the apparatus 100. As described above in relation to charging, the apparatus 100 may be arranged to utilise the information obtained from its sensors to thereby determine its position, and generate image data based thereon. For example, in response to a determination that the apparatus 100 is mounted on an object and is now stationary, the apparatus 100 may start generating image data. The program code may further comprise instructions to cause the apparatus 100 to receive, using the wireless communications module 108, a signal configured to trigger or cease generation of image data. The program code may further comprise instructions to cause the apparatus 100 to determine a deployment state of the apparatus 100 using a deployment signal and generate, or cease generating, image data on the basis of the determined deployment state of the apparatus. Figure 2 is a schematic representation of a deployed apparatus according to an example. In particular, Figure 2 shows the apparatus 202 for generating image data for a real-time situational awareness system deployed on a traffic cone 204, the traffic cone 204 being an object within the environment within which the apparatus 202 is to be deployed. However, the disclosure is not limited to traffic cones and the skilled person would appreciate that other objects may also be considered when deploying the apparatus 202. The apparatus 202 is identical to the apparatus 100 in terms of function and structure. Figure 3 is a schematic representation of positioning of a plurality of apparatuses according to an example. In the example of Figure 3, a plurality of apparatuses for generating image data for a real-time situational awareness system is deployed. The apparatuses 300-1, 300-2 and 300-3 are identical to the apparatus 100 of Figure 1. The positioning of the apparatuses 300-n provides full port and starboard views of the aircraft, both fore and aft, due to the panoramic view provided by each of the apparatuses. The aircraft shown may comprise a wing-mounted twin jet aircraft. Figure 4 is a schematic representation of different positioning of a plurality of apparatuses according to an example. The positioning of the deployed plurality of apparatuses may depend on the type of an aircraft which the apparatuses are supposed to provide image data of. In the example of Figure 4, the aircraft shown may comprise a wing-mounted four engine aircraft. Figure 4 shows a plurality of apparatuses 400-1, ..., 400-9 deployed around the aircraft. The apparatuses are identical to the apparatus of Figure 1. Figure 5 is a schematic representation of another positioning of a plurality of apparatuses according to an example. The figure depicts a deployed plurality of apparatuses in a logistics use case, with a van being unloaded. Figure 5 shows a plurality of apparatuses 500-1 deployed around the van. The apparatuses are identical to the apparatus of Figure 1. In this example, the apparatus 500-2 and 500-3 is shown as deployed on a fixed structure, but the invention is not limited thereto. For example, the apparatus could be deployed on the vehicle. Figure 6 is a schematic representation of different positioning of a plurality of apparatuses according to an example. In particular, Figure 6 depicts a plurality of apparatuses 600-1, 600-2 and 600-3 deployed in a maritime environment, for example, in an environment where a vessel is being unloaded. As with the above figures, the apparatuses are identical 5 to the apparatus of Figure 1. The preceding description has been provided to enable others skilled in the art to best utilize various aspects of the exemplary embodiments disclosed herein. This exemplary description is not intended to be exhaustive or to be limited to any precise form disclosed. Many modifications and variations are possible without departing from the 10 spirit and scope of the instant disclosure. The embodiments disclosed herein should be considered in all respects illustrative and not restrictive. Reference should be made to the appended claims and their equivalents in determining the scope of the instant disclosure.
Claims
1. Apparatus for generating image data for a real-time situational awareness system, the apparatus comprising:an imaging structure comprising at least one imaging device provided within a body of the apparatus and configured to generate image data representing a panoramic image of an environment within which the apparatus is to be deployed;a wireless communications module configured to transmit the image data from the apparatus; anda mounting structure depending from the body to removably mount the apparatus to an object within the environment.
2. The apparatus as claimed in claim 1, wherein the imaging device comprises an omnidirectional camera apparatus.
3. The apparatus as claimed in claim 1, wherein the imaging structure comprises n imaging devices each having a field of view of 360 / n degrees.
4. The apparatus as claimed in any preceding claim, wherein the body defines a hermetically sealed cavity for at least one of the imaging structure and the wireless communications module.
5. The apparatus as claimed in any preceding claim, wherein the body is mechanically configured for use in explosive atmospheres.
6. The apparatus as claimed in any preceding claim, further comprising at least one of an antenna, a radio frequency communications transceiver, a GPS module, a laser imaging, detection, and ranging, LiDAR, device, an accelerometer, a gyrometer, a13 magnetometer, a temperature sensor, a humidity sensor, a light meter, a microphone, and a power source.
7. The apparatus as claimed in claim 6, further comprising at least onephotovoltaic cell configured to charge the power source.
8. The apparatus as claimed in any preceding claim, further comprising a wireless charging structure configured to wirelessly charge a power source for the apparatus.
9. The apparatus as claimed in claim 8, wherein the wireless charging structure is provided within or as part of the mounting structure.
10. The apparatus as claimed in any preceding claim, wherein the mounting structure comprises an elongate section configured to locate within an opening of a safety cone.
11. The apparatus as claimed in any preceding claim, wherein the mounting structure comprises a switch configured to generate a deployment signal on the basis of a deployment state of the apparatus.
12. The apparatus as claimed in any preceding claim, further comprising:a processor;a memory coupled to the processor, the memory configured to store program code executable by the processor and comprising one or more instructions, whereby to cause the apparatus to:transmit, using the wireless communications module, image data generated by the imaging structure to the real-time situational awareness system.
13. The apparatus as claimed in claim 12, the program code comprising one or more further instructions, whereby to cause the apparatus to:process the image data generated by the imaging structure, whereby to augment the image data generated by the imaging structure with information relating to at least one of a location of the apparatus, a time of capture of a panoramic image, movement of the apparatus, temperature and / or humidity of the environment within which the apparatus is deployed and / or of the apparatus, and light level of the environment within which the apparatus is deployed.
14. The apparatus as claimed in claim 12 or 13, the program code comprising one or more further instructions, whereby to cause the apparatus to:generate, or cease generating, image data on the basis of a position of the apparatus.
15. The apparatus as claimed in claim 12 or 13, the program code comprising one or more further instructions, whereby to cause the apparatus to:receive, using the wireless communications module, a signal configured to trigger or cease generation of image data.
16. The apparatus as claimed in any of claims 12 to 15, the program code comprising one or more further instructions, whereby to cause the apparatus to:determine a deployment state of the apparatus using the deployment signal; andgenerate, or cease generating, image data on the basis of the determined deployment state of the apparatus.
Citation Information
Patent Citations
Intelligent conical bucket for parking
CN109457635A
Lane-occupying construction hazard management and control early warning system and method
CN110117938A
Multifunctional traffic cone
CN211948093U
Unattended object monitoring device, unattended object monitoring system equipped with same, and unattended object monitoring method
WO2021205831A1
A smart traffic management system
WO2021260533A1
