An airport cargo security remote communication system based on WebRTC

Abstract

The present invention relates to a WebRTC-based airport cargo security inspection remote communication system, comprising: a WebRTC communication module, a security inspection equipment control module, a security inspection image display module, an audio and video acquisition module, a data storage module and a video image display module; the image judgement personnel at the image judging site sequentially identify whether the cargo is abnormal based on the image displayed in the security inspection image display module, and when an abnormality is identified, send an unpacking instruction to the unpacking personnel at the cargo on-site inspection site through the WebRTC communication module; the unpacking personnel performs the unpacking operation after receiving the unpacking instruction through the WebRTC communication module in their handheld mobile terminal; the image judgement personnel checks the unpacking operation of the unpacking personnel through the video image display module after sending the unpacking instruction, and sends a call request to the unpacking personnel through the WebRTC communication module when an abnormality is found. The present invention realizes the high efficiency, convenience and intelligence of airport cargo security inspection.

Description

Technical Field

[0001] The present invention relates to the field of airport security inspection, and in particular to an airport cargo security inspection remote communication system based on WebRTC. Background Art

[0002] With the rapid development of the global aviation industry, the volume of airport cargo is increasing, which puts higher requirements on the efficiency and accuracy of security inspection. Traditional airport cargo security inspection communication systems mostly rely on wired networks or dedicated communication equipment, which have problems such as high equipment cost, limited communication range, and lack of real-time performance. These problems are particularly prominent in large airports or cross-regional security inspection scenarios. Summary of the invention

[0003] In order to solve the above problems, the present invention proposes an airport cargo security remote communication system based on WebRTC.

[0004] The specific plan is as follows:

[0005] A WebRTC-based airport cargo security remote communication system, comprising: a WebRTC communication module, a security equipment control module, a security image display module, an audio and video acquisition module, a data storage module and a video image display module;

[0006] The WebRTC communication module is used to establish and manage remote real-time communications;

[0007] The security personnel in the remote control room of the cargo area remotely control the security equipment installed at the cargo on-site inspection site through the security equipment control module. The message used for the remote control is generated based on the message protocol agreed with the security equipment manufacturer;

[0008] The audio and video acquisition module installed at the cargo on-site inspection site collects the audio and video of the unpacking station in real time and sends it to the video image display module for display, and at the same time sends it to the data storage module for storage;

[0009] The security inspection equipment installed at the cargo on-site inspection site sends the security inspection images generated during the security inspection process to the security inspection image display module for display in real time;

[0010] The image judgement personnel at the image judgment site sequentially identify whether there is any abnormality in the cargo based on the security inspection image displayed in the security inspection image display module. When an abnormality is identified, an unpacking instruction is sent to the unpacking personnel at the cargo on-site inspection site through the WebRTC communication module;

[0011] After receiving the unpacking instruction through the WebRTC communication module in the handheld mobile terminal, the unpacking personnel perform the unpacking operation on the goods corresponding to the unpacking instruction;

[0012] After sending the unpacking instruction, the image judge checks the unpacking operation of the unpacking personnel through the video image display module, and when finding any abnormality in the unpacking operation, sends a call request to the unpacking personnel through the WebRTC communication module; after the unpacking personnel receives the call request in the WebRTC communication module in their handheld mobile terminal, the call is established, and the unpacking personnel performs the unpacking operation under the voice guidance of the image judge.

[0013] Furthermore, it also includes that the inspection personnel at the inspection site conducts random inspections on whether there are any abnormalities in the goods based on the security inspection images displayed in the security inspection image display module. When an abnormality is identified, an unpacking instruction is sent to the unpacking personnel at the on-site cargo inspection site through the WebRTC communication module; after sending the unpacking instruction, the inspection personnel views the unpacking operation of the unpacking personnel through the video image display module, and when an abnormality is found in the unpacking operation, a call request is sent to the unpacking personnel through the WebRTC communication module.

[0014] Furthermore, when the WebRTC communication module is in a public network environment, the optimized packet loss retransmission strategy, in addition to introducing FEC, PLC and NACK mechanisms, also includes real-time monitoring of network status indicators, dynamically adjusting network parameters according to the monitoring results, and also setting a retransmission mechanism.

[0015] Furthermore, the retransmission mechanism includes selective retransmission and adaptive retransmission; in selective retransmission, data with higher importance is retransmitted first according to the importance of the data; in adaptive retransmission, the number of retransmissions is dynamically adjusted according to the packet loss situation during retransmission.

[0016] Furthermore, network status indicators include packet loss rate and latency.

[0017] Furthermore, the network parameters include transmission bit rate, frame rate and timeout period.

[0018] Furthermore, when the WebRTC communication module is in a private network environment, the configured routing rules and network policies include the following:

[0019] (1) Divide the subnets within the private network;

[0020] (2) Configure static routing protocol or dynamic routing protocol on the router;

[0021] (3) Configure routing between VLANs;

[0022] (4) Configure firewall rules so that they do not block audio and video ports or protocols;

[0023] (5) Set up an optimized packet loss retransmission strategy.

[0024] The present invention adopts the above technical solution and realizes efficient, convenient and intelligent airport cargo security inspection through remote real-time interactive communication technology based on WebRTC. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] Figure 1 Shown is a schematic diagram of the structure of the system according to an embodiment of the present invention. DETAILED DESCRIPTION

[0026] To further illustrate various embodiments, the present invention provides drawings. These drawings are part of the disclosure of the present invention, which are mainly used to illustrate the embodiments and can be used in conjunction with the relevant descriptions in the specification to explain the operating principles of the embodiments. With reference to these contents, ordinary technicians in this field should be able to understand other possible implementations and advantages of the present invention.

[0027] The present invention will now be further described with reference to the accompanying drawings and specific implementation methods.

[0028] The embodiment of the present invention provides an airport cargo security remote communication system based on WebRTC, such as Figure 1 As shown, it includes a WebRTC communication module, a security inspection equipment control module, a security inspection image display module, an audio and video acquisition module, a data storage module and a video image display module.

[0029] 1. WebRTC communication module

[0030] The WebRTC communication module is used to establish and manage remote real-time communication connections, and to implement voice communication between security inspectors, image judges, and unpackers at on-site cargo inspection sites through the WebRTC protocol.

[0031] The WebRTC communication module supports communication in a variety of network environments and can be used in both public and private network environments.

[0032] When applied in a public network environment, in order to adapt to changes in network bandwidth and reduce the impact of network delay and jitter on audio and video quality, an optimized packet loss retransmission strategy is also set in this embodiment. In addition to introducing FEC (forward error correction), PLC (packet loss concealment) and NACK (negative acknowledgment) mechanisms, the optimized packet loss retransmission strategy also includes real-time monitoring of network status indicators, dynamically adjusting network parameters based on monitoring results, and setting a retransmission mechanism. The above measures can significantly reduce retransmission delays and improve data transmission efficiency.

[0033] The FEC mechanism performs redundant encoding on the data at the sending end, so that the receiving end can still restore the original data through the redundant data when some data packets are lost. This mechanism can reduce the number of retransmissions and reduce network latency to a certain extent. In WebRTC, you can enable the FEC function by configuring FEC parameters and adjust the FEC redundancy according to the actual network conditions.

[0034] The PLC mechanism is mainly used in audio and video communications. When packet loss is detected, the lost data is filled by prediction or interpolation to maintain the continuity of the audio and video streams. The PLC mechanism can be combined with other packet loss recovery mechanisms (such as retransmission and FEC) to further improve the quality of audio and video communications.

[0035] The NACK mechanism allows the receiver to send a negative confirmation message to the sender to inform which data packets have been lost. After receiving the NACK message, the sender can immediately retransmit the lost data packets without waiting for a timeout.

[0036] Network status indicators include packet loss rate, latency, etc., and network parameters include transmission bit rate, frame rate, timeout, etc. Network status indicators can be obtained through WebRTC's RTCP (Real-time Control Protocol) feedback mechanism. All network parameters can be dynamically adjusted based on the network status indicators obtained through feedback. For example, when the network status is poor, the timeout can be appropriately increased to avoid frequent retransmissions causing network congestion; when the network status is good, the timeout can be appropriately shortened to improve data transmission efficiency; when the bandwidth is limited, the bit rate of audio and video encoding can be reduced; when the latency is high, the buffer size can be increased.

[0037] The retransmission mechanism in this embodiment includes selective retransmission and adaptive retransmission. In selective retransmission, instead of simply retransmitting all lost data packets, data with higher importance is retransmitted first according to the importance of the data. For example, for real-time audio and video communication, key frame data that has a greater impact on the continuity of audio and video can be retransmitted first. In adaptive retransmission, the number of retransmissions is dynamically adjusted according to the packet loss during retransmission. If multiple consecutive retransmissions fail, it may indicate that the current network status is extremely poor. At this time, the number of retransmissions should be appropriately reduced to avoid wasting network resources.

[0038] Since this embodiment is applied to the airport security environment, it requires higher communication security. Therefore, it is preferred to apply the WebRTC communication module to the private network environment. In the application of the private network environment, it is necessary to configure appropriate routing rules and network policies. The routing rules and network policies configured in this embodiment include the following points:

[0039] (1) Divide the subnets within the private network to ensure that each subnet has a clear IP address range and gateway.

[0040] (2) Configure static routing protocols or dynamic routing protocols (such as OSPF, RIP, etc.) on the router to ensure that data packets can be forwarded from one subnet to another along the correct path.

[0041] (3) When VLAN (Virtual Local Area Network) is used within a private network to isolate different subnets, it is necessary to ensure that the routing between VLANs is configured correctly so that audio and video data packets can cross the VLAN boundaries.

[0042] (4) Although strict firewall rules are usually not required to block internal communications within a private network, you should ensure that firewall rules do not accidentally block audio and video ports or protocols to ensure that audio and video information can be transmitted smoothly between different subnets.

[0043] (5) Set up the optimized packet loss retransmission strategy in the same way as in the public network environment mentioned above.

[0044] 2. Security inspection equipment control module

[0045] The security inspection equipment control module is used to remotely control the security inspection equipment installed at the cargo on-site inspection site. Remote control includes starting, stopping and adjusting working parameters.

[0046] The security personnel in the remote control room of the cargo area can operate the security equipment control module through the terminal device (such as a PC) set up in the remote control room of the cargo area, that is, the security equipment control module is installed in the terminal device in the remote control room of the cargo area, and the security personnel realize remote control of the security equipment by operating the terminal device.

[0047] In order to ensure the accuracy and efficiency of control, the security inspection equipment control module adopts the message protocol pre-defined with the security inspection equipment manufacturer. When the security inspector selects the corresponding control function, the security inspection equipment control module will immediately generate the corresponding message information according to the message protocol and send it to the security inspection equipment. After receiving these message information, the security inspection equipment will immediately parse and execute the corresponding actions. For example, if the message information is a remote start instruction, the security inspection equipment will start and start working immediately; if it is an instruction to adjust the working parameters, the security inspection equipment will make corresponding adjustments according to the specific parameters in the message. In this way, security inspectors can achieve precise control of security inspection equipment. This not only improves the efficiency and accuracy of security inspection work, but also greatly enhances the management ability of the freight site and ensures the safe transportation of goods. In general, the security inspection equipment control module realizes remote and precise control of security inspection equipment through the message protocol under the premise of ensuring smooth network communication, providing strong support for real-time monitoring and management of the freight site.

[0048] 3. Audio and video acquisition module

[0049] The audio and video acquisition module is installed at the cargo on-site inspection site. In order to be able to synchronously view the unpacking operations of the unpacking personnel, the audio and video acquisition module in this embodiment is installed in the unpacking station area of ​​the cargo on-site inspection site. The audio and video acquisition module collects the audio and video of the unpacking station in real time and sends it to the video image display module for display, and at the same time sends it to the data storage module for storage.

[0050] In this embodiment, the audio and video acquisition module uses a high-definition camera and audio acquisition equipment to ensure that the collected audio and video information is clear and accurate, and can meet the needs of security inspection work.

[0051] 4. Data storage module

[0052] The data storage module is used to store audio and video data and detailed information during the communication process through the WebRTC communication module, such as communication time, communication content, etc., so as to facilitate subsequent data analysis and query.

[0053] 5. Security inspection image display module

[0054] The security inspection image display module is used to display the security inspection images generated by the security inspection equipment (such as S optical machine scanner) during the security inspection process.

[0055] 6. Video image display module

[0056] The video image display module is used to display the video images collected by the audio and video collection module in real time.

[0057] In the actual business process of airport cargo transportation, the image judgment site is often far away from the cargo on-site inspection site. The image judge at the image judgment site can sequentially identify whether there are any abnormalities in the cargo through the security inspection image displayed in the security inspection image display module in the terminal device set in the image judgment site. When an abnormality is identified, the WebRTC communication module in the terminal device set in the image judgment site sends an unpacking instruction to the unpacking personnel at the cargo on-site inspection site.

[0058] The unpacking personnel receive the unpacking instruction through the WebRTC communication module in their handheld mobile terminal, and after receiving the unpacking instruction, perform the unpacking operation on the goods corresponding to the unpacking instruction.

[0059] In order to facilitate the image judge to judge whether there is any abnormality in the unpacking operation, a video image display module is set in the terminal device of the image judgement site. After sending the unpacking instruction, the unpacking personnel can view the unpacking operation of the unpacking personnel through the video image display module, and if the unpacking operation is found to be abnormal, a call request is sent to the unpacking personnel through the WebRTC communication module. After the unpacking personnel receives the call request in the WebRTC communication module in their handheld mobile terminal, the call is established, and the unpacking personnel performs the unpacking operation under the voice guidance of the image judge.

[0060] Furthermore, in order to improve the quality of security inspection, random inspection sites are also set up in this embodiment. The inspection personnel at the random inspection sites only check the goods displayed in the security inspection image display module. When an abnormality is found and the image judgement personnel do not find any abnormality, the unpacking instruction is sent to the unpacking personnel in the same way as the image judgement personnel.

[0061] The above-mentioned image judgment site and sampling inspection site can be set at the same location, such as both being set in the remote control room of the cargo area, or they can be set at different locations, without limitation. Regardless of whether they are set at the same location, they use their respective terminal settings to perform their required operations.

[0062] This embodiment has the following beneficial effects:

[0063] (1) Improved security inspection efficiency and accuracy: By implementing remote real-time interactive communication through WebRTC technology, security inspectors can more intuitively understand the situation at the freight site and promptly identify and handle safety hazards.

[0064] (2) Reduced communication costs: By leveraging the low-cost advantage of WebRTC technology, the construction and maintenance costs of dedicated communication equipment and networks are reduced.

[0065] (3) Enhanced communication flexibility: WebRTC technology supports communication in a variety of network environments. Through its browser operation characteristics, WebRTC enables devices in different locations such as image judgment sites, sampling sites, and on-site package opening sites to communicate in real time through the browser without installing additional software or plug-ins. Regardless of whether these workstations are connected to a wired network or a wireless network, WebRTC can provide stable and high-quality communication services.

[0066] In addition, WebRTC also supports communication in different types of network environments. Whether in a high-speed and stable wired network environment or in a highly mobile wireless network environment, WebRTC can provide reliable communication services. This allows security personnel to conduct efficient remote communication and control in different locations and scenarios. During the implementation process, WebRTC's signaling server, ICE protocol, and STUN / TURN server components played an important role. The signaling server is used to coordinate communication between browsers and establish channels for WebRTC communication; the ICE protocol is used to find available network paths between different devices; and the STUN / TURN server helps WebRTC overcome firewall network barriers and achieve direct point-to-point connections. These components work together to enable WebRTC to provide stable and efficient communication services in complex network environments.

[0067] (4) A modular design is adopted, and each module works together to achieve functional integration and optimization.

[0068] Although the present invention has been specifically shown and described in conjunction with the preferred embodiments, it should be understood by those skilled in the art that various changes may be made to the present invention in form and details without departing from the spirit and scope of the present invention as defined by the appended claims, all of which are within the scope of protection of the present invention.

Claims

1. A WebRTC-based airport cargo security remote communication system, characterized in that: include: WebRTC communication module, security inspection equipment control module, security inspection image display module, audio and video acquisition module, data storage module and video image display module; The WebRTC communication module is used to establish and manage remote real-time communications; The security personnel in the remote control room of the cargo area remotely control the security equipment installed at the cargo on-site inspection site through the security equipment control module. The message used for the remote control is generated based on the message protocol agreed with the security equipment manufacturer; The audio and video acquisition module installed at the cargo on-site inspection site collects the audio and video of the unpacking station in real time and sends it to the video image display module for display, and at the same time sends it to the data storage module for storage; The security inspection equipment installed at the cargo on-site inspection site sends the security inspection images generated during the security inspection process to the security inspection image display module for display in real time; The image judgement personnel at the image judgment site sequentially identify whether there is any abnormality in the cargo based on the security inspection image displayed in the security inspection image display module. When an abnormality is identified, an unpacking instruction is sent to the unpacking personnel at the cargo on-site inspection site through the WebRTC communication module; After receiving the unpacking instruction through the WebRTC communication module in the handheld mobile terminal, the unpacking personnel perform the unpacking operation on the goods corresponding to the unpacking instruction; After sending the unpacking instruction, the image judge checks the unpacking operation of the unpacking personnel through the video image display module, and when finding any abnormality in the unpacking operation, sends a call request to the unpacking personnel through the WebRTC communication module; after the unpacking personnel receives the call request in the WebRTC communication module in their handheld mobile terminal, the call is established, and the unpacking personnel performs the unpacking operation under the voice guidance of the image judge.

2. The WebRTC-based airport cargo security remote communication system according to claim 1, characterized in that: It also includes the sampling personnel at the sampling inspection site conducting random inspections on whether there are any abnormalities in the goods based on the security inspection images displayed in the security inspection image display module. When an abnormality is identified, an unpacking instruction is sent to the unpacking personnel at the on-site cargo inspection site through the WebRTC communication module; after sending the unpacking instruction, the sampling personnel views the unpacking operation of the unpacking personnel through the video image display module, and when an abnormality is found in the unpacking operation, a call request is sent to the unpacking personnel through the WebRTC communication module.

3. The WebRTC-based airport cargo security remote communication system according to claim 1, characterized in that: When the WebRTC communication module is in a public network environment, the optimized packet loss retransmission strategy, in addition to introducing FEC, PLC and NACK mechanisms, also includes real-time monitoring of network status indicators, dynamically adjusting network parameters based on monitoring results, and setting up a retransmission mechanism.

4. The WebRTC-based airport cargo security remote communication system according to claim 3, characterized in that: Retransmission mechanisms include selective retransmission and adaptive retransmission; In selective retransmission, data with higher importance is retransmitted first according to its importance; in adaptive retransmission, the number of retransmissions is dynamically adjusted according to the packet loss during retransmission.

5. The WebRTC-based airport cargo security remote communication system according to claim 3, characterized in that: Network status indicators include packet loss rate and latency.

6. The WebRTC-based airport cargo security remote communication system according to claim 3, characterized in that: Network parameters include transmission bit rate, frame rate and timeout.

7. The WebRTC-based airport cargo security remote communication system according to claim 1, characterized in that: When the WebRTC communication module is in a private network environment, the configured routing rules and network policies include the following: (1) Divide the subnets within the private network; (2) Configure static routing protocol or dynamic routing protocol on the router; (3) Configure routing between VLANs; (4) Configure firewall rules so that they do not block audio and video ports or protocols; (5) Set up an optimized packet loss retransmission strategy.

Images