Real-time video linkage intercom system based on communication interaction technology

Abstract

The invention relates to a real-time video linkage intercom system based on a communication interaction technology, and belongs to the technical field of train safety monitoring. According to the invention, interactive communication between the ground video terminal telephone and the vehicle-mounted acquisition terminal is established by using the video call server, the video call server realizes forwarding of an intercom request, an intercom protocol format, an intercom communication port and a format by using a signaling interaction mode, and realizes forwarding of audio and video streaming media data by using a streaming media interaction mode. According to the invention, bidirectional display of the video image is realized in this way, real-time commanding can be carried out through the image, and the effect is more visual and direct than that through voice commanding; in addition, special video call equipment does not need to be additionally arranged, existing equipment of the locomotive is utilized, hardware cost is reduced, and the influence of the additionally arranged special video call equipment on a locomotive circuit and a communication system is reduced.

Description

Technical Field

[0001] This invention relates to a real-time video linkage intercom system based on communication interaction technology, belonging to the field of train safety monitoring technology. Background Technology

[0002] Currently, trains are equipped with video surveillance systems, which monitor the train's operation and crew behavior in real time. Ground staff can view the video and conduct intercoms via an online platform. However, because GB28181 does not define video intercom functionality, ground staff can only see the onboard monitoring screen. When two-way communication via GB28181 is needed, only voice communication is possible. The onboard video surveillance system cannot display the real-time footage from the ground, forcing ground staff to issue commands via voice, which is not intuitive. To achieve real-time video intercom between the onboard and ground systems, the current approach is to install a dedicated video call device. While this method enables real-time video intercom, it increases hardware costs and may potentially impact the locomotive's original electrical and communication systems. Summary of the Invention

[0003] The purpose of this invention is to provide a real-time video intercom system based on communication interaction technology, so as to solve the problem that the current system requires the installation of dedicated video call equipment to realize real-time video intercom between the vehicle-mounted terminal and the ground terminal, which results in high cost and significant impact.

[0004] To address the aforementioned technical problems, this invention provides a real-time video-linked intercom system based on communication interaction technology. The system includes a vehicle-mounted display screen and a vehicle-mounted acquisition terminal, and a video call server located on the ground. It also includes a ground video terminal phone. The video call server is communicatively connected to the ground video terminal phone and the vehicle-mounted acquisition terminal. Through signaling interaction, it forwards intercom requests and intercom protocol formats sent by the ground video terminal phone to the vehicle-mounted acquisition terminal, and forwards the video intercom communication port and format responses from the vehicle-mounted acquisition terminal to the ground video terminal phone. Through streaming media interaction, it forwards audio and video streaming media data from the vehicle-mounted acquisition terminal to the ground video terminal phone for playback and display. Finally, through streaming media interaction, it forwards audio and video streaming media data from the ground video terminal phone to the vehicle-mounted acquisition terminal for playback and display on the vehicle-mounted display screen connected to the vehicle-mounted acquisition terminal.

[0005] Furthermore, the signaling interaction between the video call server and the ground video terminal phone and the vehicle-mounted acquisition terminal is carried out using the SIP communication protocol; the streaming media interaction between the video call server and the ground video terminal phone and the vehicle-mounted acquisition terminal is carried out using the RTP / RTCP protocol.

[0006] Furthermore, the vehicle-mounted acquisition terminal communicates with the vehicle-mounted display screen via the TCP protocol. The vehicle-mounted acquisition terminal is used to send the current connection status and call information between the vehicle-mounted acquisition terminal and the video call server to the vehicle-mounted display screen and display it on the vehicle-mounted display screen.

[0007] Furthermore, after receiving the video footage sent from the ground, the vehicle-mounted acquisition terminal forwards it to the vehicle-mounted display screen via the TCP protocol.

[0008] Furthermore, the vehicle-mounted data acquisition terminal establishes a communication connection with the video call server through the vehicle-mounted internet gateway.

[0009] Furthermore, the in-vehicle internet gateway uses a SIM card to access the internet.

[0010] Furthermore, the ground video terminal phone is equipped with a microphone, speaker, display screen and camera.

[0011] Furthermore, the audio and video streaming media data includes audio data and video data, with the audio data using G711 format and the video data using H264 encoding.

[0012] The beneficial effects of this invention are as follows: As an improved invention, this invention utilizes a video call server to establish interactive communication between the ground video terminal and the vehicle-mounted acquisition terminal. The video call server uses signaling interaction to forward intercom requests, intercom protocol formats, intercom communication ports, and formats, and uses streaming media interaction to forward audio and video streaming media data. This invention achieves bidirectional video display in this way, allowing for real-time command via video, which is more intuitive and direct than voice command alone. Furthermore, this invention does not require the installation of dedicated video call equipment; it can utilize existing equipment on the locomotive, reducing hardware costs and the impact of installing dedicated video call equipment on the locomotive's circuitry and communication systems. Attached Figure Description

[0013] Figure 1 This is a schematic diagram of the communication connection of the real-time video linkage intercom system based on communication interaction technology of the present invention;

[0014] Figure 2 This is a schematic diagram of the signaling interaction of the real-time video linkage intercom system based on communication interaction technology of the present invention;

[0015] Figure 3This is a schematic diagram of media stream interaction in the real-time video linkage intercom system based on communication interaction technology of the present invention. Detailed Implementation

[0016] The specific embodiments of the present invention will be further described below with reference to the accompanying drawings.

[0017] The real-time video-linked intercom system based on communication interaction technology of the present invention includes an on-vehicle display screen and an on-vehicle acquisition terminal installed on the vehicle, and a video call server and a ground video terminal phone installed on the ground. The video call server is communicatively connected to the ground video terminal phone and the on-vehicle acquisition terminal. Through signaling interaction, it forwards intercom requests and intercom protocol formats sent by the ground video terminal phone to the on-vehicle acquisition terminal, and forwards the video intercom communication port and format responses from the on-vehicle acquisition terminal to the ground video terminal phone. Through streaming media interaction, it forwards audio and video streaming media data from the on-vehicle acquisition terminal to the ground video terminal phone for playback and display. Similarly, it forwards audio and video streaming media data from the ground video terminal phone to the on-vehicle acquisition terminal for playback and display on the on-vehicle display screen connected to the on-vehicle acquisition terminal. Therefore, the present invention can achieve two-way video display in this way, allowing for real-time command via video, which is more intuitive and direct than voice command alone. Furthermore, the present invention does not require the installation of dedicated video call equipment; it can utilize existing equipment on the locomotive, reducing hardware costs and the impact of installing dedicated video call equipment on the locomotive's circuitry and communication systems.

[0018] Specifically, the real-time video-linked intercom system based on communication interaction technology of the present invention is as follows: Figure 1 As shown, the system includes an onboard display screen, onboard data acquisition terminal, and onboard internet gateway installed on the vehicle, and a video call server and ground video terminal phones installed on the ground. The onboard display screen, onboard data acquisition terminal, and onboard internet gateway are part of the locomotive video monitoring system and are existing equipment on the vehicle. The onboard data acquisition terminal acquires vehicle monitoring data and sends it to the onboard display screen for display. Ground personnel can access the monitored video data through the onboard internet gateway. The video call server is an existing national standard video-on-demand platform. The ground video terminal phones are added devices for enabling video intercom. Figure 1 The video call server shown is connected to the ground video terminal phone via an intranet. The video call server is connected to the vehicle-mounted internet gateway through an internet firewall. The vehicle-mounted internet gateway communicates with the vehicle-mounted acquisition terminal via a local area network. The vehicle-mounted acquisition terminal communicates with the vehicle-mounted display screen via the vehicle-mounted local area network.

[0019] The ground video terminal phones can be deployed in the ground duty center and connected to the video call server via an internal network. These phones are for video intercom and are equipped with microphones, speakers, displays, and cameras. They can initiate calls by registering with the video call server via a wired network. The video call server is deployed in a ground equipment room and connected to the internet. It functions as a central signaling control server and media server, integrating a streaming media server and an application server with deployed business systems. This server also provides real-time media stream forwarding, media storage services, and historical media information retrieval and on-demand services. The vehicle-mounted internet gateway is deployed on the vehicle, providing internet access and routing functions. In this embodiment, the gateway can access the internet via a SIM card and has 4G / 5G internet access capabilities. The vehicle-mounted acquisition terminal connects to the video call server through the internet gateway. The vehicle-mounted data acquisition terminal, deployed on the locomotive, features audio acquisition, audio playback, and video acquisition functions. It also functions as a SIP client, registering with the video call server through the vehicle's internet gateway. It has the ability to automatically answer voice and video call requests. The vehicle-mounted data acquisition terminal is an existing device on the locomotive; its automatic answering function is controlled by software logic. Upon receiving a SIP signaling request from the media server (i.e., the video call server), the vehicle-mounted data acquisition terminal automatically responds. This logic is implemented by adding software functionality to the vehicle-mounted data acquisition terminal. The vehicle-mounted display screen, also deployed on the locomotive, provides monitoring screen display, video status viewing, and fire prevention status monitoring. The display screen receives video feeds from the vehicle-mounted data acquisition terminal and automatically redirects to display the feeds, achieving a screen projection effect.

[0020] Having introduced the architecture and connectivity of the intercom system, the present invention will now explain the means by which the intercom system achieves real-time video intercom.

[0021] The video call server needs to forward data between the ground video terminal and the vehicle-mounted acquisition terminal. The data exchanged between these two terminals includes signaling data and streaming media data. This invention uses VoIP technology to achieve bidirectional video display. Figure 2As shown, the video call server communicates with the ground video terminal phone and the vehicle-mounted acquisition terminal via the SIP protocol. SIP (Session Initialization Protocol) is a multimedia communication protocol developed by the IETF (Internet Engineering Task Force). SIP is an IP voice session control protocol originating from the Internet, characterized by its flexibility, ease of implementation, and scalability. Through the SIP protocol, the ground video terminal phone and the vehicle-mounted acquisition terminal can perform operations such as device registration, calling, and hanging up; that is, they can exchange signaling data through the SIP protocol.

[0022] like Figure 3 As shown, the video call server transmits data with the ground video terminal via RTP / RTCP protocol, and the video call server also transmits data with the vehicle-mounted acquisition terminal via RTP / RTCP protocol. Real-time Transport Protocol (RTP) is a network transport protocol published by the IETF Multimedia Transport Working Group in RFC 1889 in 1996, supporting multiple transmission methods including TCP and UDP. The device's audio and video streams are sent through independent ports; audio uses G.711 format, and video uses H.264 encoding. After receiving the video feed from the ground, the vehicle-mounted acquisition terminal forwards it to the vehicle-mounted display screen via TCP, which then displays the feed on the large screen.

[0023] The following section explains the working process of the aforementioned intercom system.

[0024] First, the ground video terminal phone registers with the video call server via the SIP protocol. The vehicle-mounted internet gateway connects to the internet, and the vehicle-mounted acquisition terminal registers with the video call server via the SIP protocol. Based on this, real-time video intercom functionality can be achieved. During signaling interaction between the ground and vehicle ends, the ground-based video call server establishes a connection with the vehicle-mounted acquisition terminal through a handshake via a media server. Then, the vehicle-mounted acquisition terminal can find the ground equipment terminal through the negotiated communication port and obtain its media information.

[0025] When ground staff need to conduct real-time video intercom with the vehicle, they use a ground video terminal phone to send the intercom request and intercom protocol format to the video call server via the SIP protocol. The video call server then forwards the received intercom request and intercom protocol format to the vehicle-mounted data acquisition terminal through the vehicle's internet gateway, also using the SIP protocol.

[0026] The vehicle-mounted acquisition terminal queries its own device status based on the received video intercom request and intercom protocol format. When its device status is idle, it sends the video intercom communication port and format to the video call server through the vehicle-mounted internet gateway. The video call server forwards the received video intercom communication port and format to the ground video terminal phone. This transmission process also uses the SIP protocol. In this embodiment, the device status includes ringing, busy, in use, and idle. Ringing indicates that the called party is ringing and waiting to answer the call; Busy indicates that the device is currently busy and cannot answer new calls; In use indicates that the device is occupied and cannot be used for new communication; Idle indicates that the device is not currently in a call or other communication activity and is in standby mode.

[0027] The ground video terminal phone parses the received communication port, receives the audio and video media stream, displays it on the ground video terminal phone screen, and sends the audio and video media stream to the video call server through the corresponding communication port (this is the communication port that the vehicle-mounted acquisition terminal sends to the video call server); the video call server forwards the audio and video media stream sent by the ground video terminal phone to the vehicle-mounted acquisition terminal; the data transmission in this process uses the RTP protocol.

[0028] The vehicle-mounted acquisition terminal receives audio and video media streams, notifies the vehicle-mounted display of video intercom information via TCP protocol, and sends the audio and video media streams to the vehicle-mounted display. Upon receiving the video intercom information, the vehicle-mounted display switches screens and parses the audio and video media streams to display them on the screen. In addition, the vehicle-mounted display is also used to receive the connection status between the vehicle-mounted and ground terminals and display information such as online / offline status and call numbers.

[0029] The vehicle-mounted terminal can also send intercom requests to the ground terminal as needed. The principle is the same as that of the ground terminal sending intercom requests to the vehicle-mounted terminal, which will not be detailed here. According to current driver regulations, the vehicle-mounted terminal is generally required to actively call the ground terminal. Through the above process, real-time two-way video intercom between the vehicle-mounted terminal and the ground terminal can be achieved. When there is no need for real-time video intercom, the vehicle-mounted display screen will normally display vehicle monitoring data.

Claims

1. A real-time video intercom system based on communication interaction technology, comprising a vehicle-mounted display screen and a vehicle-mounted acquisition terminal, and a video call server located on the ground, characterized in that, It also includes a ground video terminal phone. The video call server is communicatively connected to the ground video terminal phone and the vehicle-mounted acquisition terminal. Through signaling interaction, it forwards the intercom request and intercom protocol format sent by the ground video terminal phone to the vehicle-mounted acquisition terminal, and forwards the video intercom communication port and format replied by the vehicle-mounted acquisition terminal to the ground video terminal phone. Through streaming media interaction, it forwards the audio and video streaming media data of the vehicle-mounted acquisition terminal to the ground video terminal phone for playback and display. Through streaming media interaction, it forwards the audio and video streaming media data of the ground video terminal phone to the vehicle-mounted acquisition terminal for playback and display on the vehicle-mounted display screen connected to the vehicle-mounted acquisition terminal.

2. The real-time video intercom system based on communication interaction technology according to claim 1, characterized in that, The signaling interaction between the video call server, the ground video terminal phone, and the vehicle-mounted acquisition terminal all uses the SIP communication protocol. The streaming media interaction between the video call server and the ground video terminal telephone and the vehicle-mounted acquisition terminal all adopt the RTP / RTCP protocol.

3. The real-time video intercom system based on communication interaction technology according to claim 1, characterized in that, The vehicle-mounted acquisition terminal communicates with the vehicle-mounted display screen via the TCP protocol. The vehicle-mounted acquisition terminal is used to send the current connection status and call information between the vehicle-mounted acquisition terminal and the video call server to the vehicle-mounted display screen and display it on the vehicle-mounted display screen.

4. The real-time video intercom system based on communication interaction technology according to claim 1, characterized in that, After receiving the video footage sent from the ground, the vehicle-mounted acquisition terminal forwards it to the vehicle-mounted display screen via the TCP protocol.

5. The real-time video intercom system based on communication interaction technology according to claim 1, characterized in that, The vehicle-mounted data acquisition terminal establishes a communication connection with the video call server through the vehicle-mounted internet gateway.

6. The real-time video intercom system based on communication interaction technology according to claim 5, characterized in that, The aforementioned vehicle-mounted internet gateway uses a SIM card to access the internet.

7. The real-time video intercom system based on communication interaction technology according to claim 1, characterized in that, The ground video terminal phone is equipped with a microphone, speaker, display screen and camera.

8. The real-time video intercom system based on communication interaction technology according to claim 1, characterized in that, The audio and video streaming media data includes audio data and video data. The audio data is in G711 format and the video data is encoded in H264.

Images