Integrated intelligent internet-of-things sensing method and device for civil aviation airborne monitoring

Abstract

The invention relates to the technical field of civil aviation devices, and particularly discloses an integrated intelligent Internet of Things sensing method and device for civil aviation airborne monitoring. The device comprises a multi-modal data acquisition unit, a side end intelligent processing unit, an integrated and invisible sign integrated packaging assembly and a communication interface. The data acquisition unit is used for acquiring in-cabin environment information and video data in real time; the intelligent processing unit integrates an artificial intelligence algorithm, analyzes the data in real time, and identifies abnormal behaviors and abnormal events; the integrated packaging assembly adopts an integrated method, integrates various sensors, adopts an invisible design, and is seamlessly fused into an in-cabin environment; and the communication interface realizes external data exchange of the device. The problems that existing airborne monitoring data collection is single, intelligent analysis is insufficient, and passenger experience is affected are solved, the safety performance, operation and maintenance efficiency and riding comfort of the civil aircraft are remarkably improved, fine management of the full flight state is achieved, and the intelligent process of the civil aircraft is powerfully promoted.

Description

Technical Field

[0001] This invention relates to an integrated intelligent IoT sensing method and device for airborne monitoring in civil aviation. Background Technology

[0002] Currently, airborne monitoring equipment on civil aircraft generally suffers from limitations in data collection and analysis capabilities. This not only restricts the comprehensive assessment and early warning capabilities for civil aviation flight safety but also increases the workload of flight crews. Furthermore, existing airborne monitoring devices are often designed and installed without adequate consideration for passenger experience, resulting in conspicuous and obtrusive equipment that may provoke passenger resistance regarding privacy and hinder the creation of a comfortable and seamless flight environment. Summary of the Invention

[0003] This invention aims to overcome the shortcomings of existing technologies and provides an integrated intelligent IoT sensing method and device for civil aviation airborne monitoring. In particular, it innovates and optimizes existing technologies to address issues such as the limited types of information collected by airborne monitoring equipment, the inability to achieve edge intelligent analysis, and the impact of device design on passenger experience.

[0004] Firstly, one of the core components of this invention is a multimodal IoT sensing data acquisition unit. This data acquisition unit consists of multiple integrated sensor elements, which are mainly responsible for collecting various data information within the cabin of civil aircraft. These sensor elements include visible light cameras, infrared cameras, audio acquisition modules, smoke sensors, temperature sensors, and other components. It can collect real-time and comprehensive status data reflecting civil aviation operational safety, including visible light video images, infrared video images, cabin audio and voice recordings, cabin smoke concentration, and cabin temperature. The beneficial effects of this technical solution are: compared to existing technologies, this invention significantly enhances the diversity and breadth of data acquisition in the monitoring system, breaking through the limitations of traditional airborne monitoring equipment information acquisition.

[0005] Secondly, this invention introduces a highly efficient and intelligent edge data processing unit. This unit is equipped with advanced big data processing technology and artificial intelligence algorithms, enabling in-depth analysis and intelligent identification of a large amount of real-time cabin data received from the multimodal IoT sensing data acquisition unit. The beneficial effects of this technical solution are: the edge data processing unit can not only provide real-time feedback on the status of various indicators within the aircraft cabin, but also, through learning from historical data and predicting future trends, proactively identify and alert to potential safety hazards, greatly improving the reliability of civil aviation flight safety and compensating for the shortcomings of current airborne monitoring devices in lacking intelligent sensing and analysis capabilities.

[0006] Furthermore, this invention stands out in its device packaging design, creatively employing a stealth design concept to perfectly integrate the airborne monitoring device with the aircraft's interior environment. By selecting low-reflectivity materials, integrating airborne signage into the packaging, and embedding the device within the aircraft cabin, the invention ensures that while achieving IoT sensing and intelligent monitoring functions, it minimizes interference with the passenger experience, enhancing the overall aesthetics of the cabin space and passenger comfort. This completely overturns the abrupt appearance of traditional airborne monitoring devices in terms of design and installation.

[0007] The beneficial effects of this technical solution: This invention is not only an integrated intelligent IoT sensing method and device for civil aviation airborne monitoring, but also a comprehensive solution that integrates multimodal data information acquisition, edge intelligent analysis and stealth integrated design. It has great value and significance for improving aircraft emergency response capabilities, ensuring flight safety and enhancing the passenger experience. Attached Figure Description

[0008] Figure 1 This is a schematic diagram of the stealth-integrated design of an integrated intelligent IoT sensing device for civil aviation airborne monitoring according to an embodiment of the present invention.

[0009] Figure 2 This is a functional block diagram of an integrated intelligent IoT sensing device for civil aviation airborne monitoring according to an embodiment of the present invention.

[0010] Figure 3 This is a schematic diagram of the installation of a restroom sign of an integrated intelligent IoT sensing device for civil aviation airborne monitoring, according to an embodiment of the present invention.

[0011] Figure 4 This is a schematic diagram of the installation of a safety exit sign for an integrated intelligent IoT sensing device for civil aviation airborne monitoring, according to an embodiment of the present invention. Detailed Implementation

[0012] The embodiments of the technical solution of the present invention will now be described in detail with reference to the accompanying drawings. These embodiments are only used to more clearly illustrate the technical solution of the present invention, and are therefore merely examples and should not be used to limit the scope of protection of the present invention.

[0013] Example 1:

[0014] like Figure 1 An integrated intelligent IoT sensing device for civil aviation airborne monitoring includes a multimodal IoT sensing data acquisition unit, an edge data processing unit, a stealth design and integration unit, and a communication interface unit.

[0015] in:

[0016] The multimodal IoT sensing data acquisition unit includes a visible light camera (1), a near-infrared camera (2), a temperature sensor (3), a smoke sensor (4), and an audio sensor (5); the edge data processing unit uses an ARM processor (6); the stealth design and integration unit uses an integrated molded package base plate (7); the communication interface unit includes a Wi-Fi module (8) and a network port (9).

[0017] Furthermore, such as Figure 2 As shown, an integrated intelligent IoT sensing method for civil aviation airborne monitoring according to an embodiment of the present invention includes the following steps:

[0018] (1) IoT sensing data acquisition steps include using various types of sensors, including visible light camera (1), near-infrared camera (2), temperature sensor (3), smoke sensor (4), and audio sensor (5), to collect data from the cabin of civil aircraft, including multimodal video image data, voice audio data, smoke concentration data, ambient temperature data and other multi-source data. The collected data is then enhanced by scene adaptation using artificial intelligence methods to form a high-quality civil aircraft cabin status database.

[0019] (2) Data intelligent analysis steps include using edge data processing units and artificial intelligence algorithms to perform real-time edge processing and intelligent analysis on the received aircraft cabin status data. This not only identifies abnormal behavior and events of cabin passengers, but also monitors cabin environmental status information to issue fire alarms, greatly improving the safety of aircraft flight.

[0020] (3) Stealth design and integration steps, including the use of embedded and hidden layout of signage in accordance with ergonomic and aviation interior design concepts, to ensure that the device is integrated with the existing interior environment of the aircraft and avoids affecting the passenger experience; at the same time, the surface of the signage adopts a soft yet clear display technology, which can accurately convey the original directional signage information while ensuring visual comfort.

[0021] (4) Monitoring result feedback and alarm steps, including using an integrated intelligent IoT sensing device for civil aviation record monitoring to provide intelligent analysis results of IoT sensing in a graphical and dynamic form to crew members or ground control center through communication interface unit, so that they can grasp abnormal situations affecting flight safety in a timely and intuitive manner and make corresponding decisions.

[0022] The specific implementation process is as follows:

[0023] The aforementioned integrated intelligent IoT sensing method and device for civil aviation airborne monitoring is used to monitor the passenger cabin section of civil aircraft.

[0024] If a passenger attempts to illegally open an emergency escape hatch during normal flight within the monitoring area of ​​an integrated intelligent IoT sensing device for civil aviation airborne monitoring, the device's multimodal IoT sensing data acquisition unit collects image information of the violation using visible light and infrared cameras. The efficient and intelligent edge data processing unit then enhances and intelligently analyzes this image information. The result of this abnormal behavior—the attempt to open the emergency escape hatch—is transmitted to the airborne server, and finally, a notification and alarm are sent to the crew and / or ground control center.

[0025] If an abnormal gathering of people occurs within the monitoring area of ​​the integrated intelligent IoT sensing device for civil aviation airborne monitoring, the device's multimodal IoT sensing data acquisition unit will collect the voice audio in the cabin through the audio data acquisition module, store the audio data through the efficient and intelligent edge data processing unit, transmit the voice data to the airborne server, and finally complete the prompting and alarm to the crew members or the ground control center.

[0026] If a large amount of smoke or fire occurs in the monitoring area of ​​the integrated intelligent IoT sensing device for civil aviation airborne monitoring, the device's multimodal IoT sensing data acquisition unit will collect smoke concentration and temperature data in the cabin through smoke sensors and temperature sensors. The efficient and intelligent edge data processing unit will then intelligently identify and analyze the smoke concentration and temperature data, transmit the fire analysis results to the airborne server, and finally complete the prompting and alarm to the crew or ground control center.

[0027] Example 2:

[0028] like Figure 3 and Figure 4 As shown, according to the present invention, an integrated intelligent IoT sensing method and device for airborne monitoring in civil aviation can be combined with conventional in-flight signage such as restroom signs or emergency exit signs in civil aircraft cabins. The following describes a preferred embodiment of the present invention, including:

[0029] The present invention describes an integrated IoT sensing method for civil aviation airborne monitoring, which modifies conventional in-cabin signage such as restroom signs or emergency exit signs. The integrated intelligent IoT sensing device (1) for civil aviation airborne monitoring includes a multimodal IoT sensing data acquisition unit, an edge data processing unit, a stealth design and integration unit, and a communication interface unit. A power supply line (12) is reserved on the side of the installation position. Then, the integrated intelligent IoT sensing device (11) for civil aviation airborne monitoring is seamlessly installed on the wall (14) of the civil aviation cabin section using fastening screws (13). Finally, based on the non-sensory design and encapsulation integration method, the device is encapsulated and integrated using a sign shell (15) containing indicative slogans. This achieves non-sensory multi-source sensing and integrated intelligent analysis of the cabin status, completing airborne monitoring while reducing passengers' resistance to the airborne monitoring system.

[0030] The above description is merely a preferred embodiment of the present invention and does not limit the scope of protection of the present invention to the entirety. Any appropriate modifications, equivalent substitutions, or functional enhancements made by those skilled in the art to the above embodiments without departing from the basic concept of the present invention shall fall within the scope of protection claimed by the present invention.

Claims

1. An integrated intelligent IoT sensing device for civil aviation airborne monitoring, characterized in that... It includes a multimodal IoT sensing data acquisition unit, an edge data processing unit, a stealth design and integration unit, and a communication interface unit. in: The multimodal IoT sensing data acquisition unit includes a visible light camera (1), a near-infrared camera (2), a temperature sensor (3), a smoke sensor (4), and an audio sensor (5). It is used to collect data from the cabin of a civil aircraft, including multimodal video image data, voice audio data, smoke concentration data, and ambient temperature data. The collected data is then enhanced using artificial intelligence methods to create a high-quality civil aircraft cabin status database. The edge data processing unit includes an ARM processor (6), which uses artificial intelligence algorithms to perform real-time edge processing and intelligent analysis on the received aircraft cabin status data, identify abnormal behaviors and events of cabin passengers and related audio data, monitor cabin environmental status information and issue fire alarms. The stealth design and integration unit includes an integrated molded package base plate (7), which, through the embedded and concealed layout of the signage, ensures that the integrated smart IoT sensing device blends seamlessly with the existing aircraft interior environment, avoiding any impact on the passenger experience. The communication interface unit includes a Wi-Fi module (8) and a reserved network port (9), which is used to provide the results of the intelligent analysis of IoT sensing to the crew members and / or the ground control center in a graphical and dynamic form.

2. The integrated intelligent IoT sensing device according to claim 1, characterized in that: The integrated intelligent IoT sensing device is installed by modifying and adapting conventional directional signs such as restroom signs and / or emergency exit signs in civil aircraft cabins, including: A power supply line (12) is reserved on the side of the installation position; Subsequently, the integrated intelligent IoT sensing device for civil aviation airborne monitoring was seamlessly installed on the wall (14) of the civil aircraft cabin section using fastening screws (13); Finally, the integrated smart IoT sensing device is encapsulated and integrated using a sign shell (15) containing indicative slogans.

3. The integrated intelligent IoT sensing device according to claim 1 or 2, characterized in that: The integrated intelligent IoT sensing device is used for: When an integrated intelligent IoT sensing device for civil aviation airborne monitoring detects a passenger attempting to illegally open an emergency escape hatch during normal flight, the multimodal IoT sensing data acquisition unit collects image information of the violation using visible light and infrared cameras. The edge data processing unit then enhances and intelligently analyzes this image information. Finally, the abnormal behavior of attempting to open the emergency escape hatch is transmitted to the airborne server, alerting and warning the crew and / or ground control center. When a heated argument and / or gathering of people occur within the monitoring area of ​​the integrated intelligent IoT sensing device for civil aviation airborne monitoring, the multimodal IoT sensing data acquisition unit collects audio data that threatens flight safety through the audio data acquisition module, stores the audio data through the edge data processing unit, and then transmits the audio content to the airborne server to complete the prompting and alarm to the crew members or the ground control center. When a large amount of smoke and / or fire occurs in the monitoring area of ​​the integrated intelligent IoT sensing device for civil aviation airborne monitoring, the multimodal IoT sensing data acquisition unit collects smoke concentration and temperature data in the cabin through smoke sensors and temperature sensors, and performs intelligent identification and analysis of smoke concentration and temperature data through the edge data processing unit. Then, the fire analysis results are transmitted to the airborne server to complete the prompting and alarm to the crew members or the ground control center.

4. The integrated intelligent IoT sensing device according to claim 1 or 2, characterized in that: The integrated molded packaging base plate (7) adopts ergonomic and aerospace interior design.

5. The integrated intelligent IoT sensing device according to claim 1 or 2, characterized in that: The surface of the sign uses a soft yet clear display to accurately convey the original directional information while ensuring visual comfort.

6. An integrated intelligent IoT sensing method for civil aviation airborne monitoring, characterized in that... include: 1) IoT sensing data acquisition steps: Using a multimodal IoT sensing data acquisition unit, data from the cabin of a civil aircraft are collected, including multimodal video image data, voice audio data, smoke concentration data, and ambient temperature data. The collected data is then enhanced by scene adaptation using artificial intelligence methods to form a high-quality civil aircraft cabin status database. The multimodal IoT sensing data acquisition unit includes a visible light camera (1), a near-infrared camera (2), a temperature sensor (3), a smoke sensor (4), and an audio sensor (5). 2) Data intelligent analysis step: Using an edge data processing unit and artificial intelligence algorithms, the received aircraft cabin status data is processed and intelligently analyzed in real time to identify abnormal behaviors and events of cabin passengers and related audio data, and to monitor cabin environmental status information and issue fire alarms. The edge data processing unit includes an ARM processor (6). 3) Stealth Design and Integration Steps: Stealth design and integration units are employed to ensure that the integrated intelligent IoT sensing device for civil aviation record monitoring blends seamlessly with the aircraft's internal environment, avoiding any impact on passenger experience. This integrated intelligent IoT sensing device includes a multimodal IoT sensing data acquisition unit, an edge data processing unit, a stealth design and integration unit, and a communication interface unit. 4) Monitoring result feedback and alarm steps: The integrated intelligent IoT sensing device will use the IoT sensing intelligent analysis results to provide graphical and dynamic information to the crew members and / or ground control center via the communication interface unit. The stealth design and integration unit includes an integrated molded packaging base plate (7), which is used to ensure that the integrated smart IoT sensing device is integrated with the aircraft interior environment by adopting an embedded and hidden layout of the sign, so as to avoid affecting the passenger experience.

7. The integrated intelligent IoT sensing method according to claim 6, characterized in that... Step 3) includes: The installation of conventional directional signs such as restroom signs and / or emergency exit signs in civil aircraft cabins is carried out by modifying existing signs using integrated smart IoT sensing devices. A power supply line (12) is reserved on the side of the installation position; Subsequently, the integrated intelligent IoT sensing device for civil aviation airborne monitoring was seamlessly installed on the wall (14) of the civil aircraft cabin section using fastening screws (13); Finally, the integrated smart IoT sensing device is encapsulated and integrated using a sign shell (15) containing indicative slogans.

8. The integrated intelligent IoT sensing method according to claim 6 or 7, characterized in that... include: The following operations are performed using the integrated intelligent IoT sensing device: When an integrated intelligent IoT sensing device for civil aviation airborne monitoring detects a passenger attempting to illegally open an emergency escape hatch during normal flight, the multimodal IoT sensing data acquisition unit collects image information of the violation using visible light and infrared cameras. The edge data processing unit then enhances and intelligently analyzes this image information. Finally, the abnormal behavior of attempting to open the emergency escape hatch is transmitted to the airborne server, alerting and warning the crew and / or ground control center. When a heated argument and / or gathering of people occur within the monitoring area of ​​the integrated intelligent IoT sensing device for civil aviation airborne monitoring, the multimodal IoT sensing data acquisition unit collects audio data that threatens flight safety through the audio data acquisition module, stores the audio data through the edge data processing unit, and then transmits the audio content to the airborne server to complete the prompting and alarm to the crew members or the ground control center. When a large amount of smoke and / or fire occurs in the monitoring area of ​​the integrated intelligent IoT sensing device for civil aviation airborne monitoring, the multimodal IoT sensing data acquisition unit collects smoke concentration and temperature data in the cabin through smoke sensors and temperature sensors, and performs intelligent identification and analysis of smoke concentration and temperature data through the edge data processing unit. Then, the fire analysis results are transmitted to the airborne server to complete the prompting and alarm to the crew members or the ground control center.

9. The integrated intelligent IoT sensing method according to claim 6 or 7, characterized in that: The integrated molded packaging base plate (7) adopts ergonomic and aerospace interior design.

10. The integrated intelligent IoT sensing method according to claim 6 or 7, characterized in that: The surface of the sign uses a soft yet clear display to accurately convey the original directional information while ensuring visual comfort.

Images