Intercom system and method for special situation disposal of expressway

Abstract

The invention belongs to the technical field of intelligent highways, and particularly relates to an intercom system and method for special situation disposal of a highway. The intercom system comprises a lane client, a FREESWITCH service center, a seat server and a seat center. The lane client and the FREESWITCH service center are mutually connected and carry out signaling interaction, and signaling comprises registration and login, call invitation and audio and video protocol exchange; the seat center is mutually connected and communicated with the FREESWITCH service center through WebRTC, and a call is switched to the seat center to complete audio and video talkback; the seat server is connected with the FREESWITCH service center and the seat center and is used for monitoring a registration event and a seat login event of the lane client; the lane client is deployed in a charging network; the talkback method is realized based on the talkback system. According to the intercom system and method, a monitoring network and a charging network are connected, and a vehicle user directly communicates with a charging background service staff, so that special situations which cannot be handled by a lane robot are handled in time.

Description

Technical Field

[0001] The present invention belongs to the technical field of smart highways, and in particular relates to an intercom system and method for handling special situations on highways. Background Art

[0002] With the current huge highway mileage, highway management companies face operating cost issues, including high labor costs, heavy equipment assets, and energy consumption.

[0003] The development goal of the modern integrated transportation system is to basically achieve integrated and integrated development of integrated transportation, achieve substantial breakthroughs in intelligence and greening, and significantly improve comprehensive capabilities, service quality, operating efficiency and overall benefits. Highway informatization and smart highway construction, among which toll collection robots will bring disruptive changes to the operation and management mode of highways. Through the upgrading of ETC non-stop toll collection, mobile payment, self-service card issuance, license plate recognition and other technologies, and the rise of emerging technologies such as 5G communication, big data, and artificial intelligence, highway toll stations are constantly being upgraded and renovated. In this context, many places continue to explore the "smart" and "unmanned" construction of toll stations, and actively promote the deep integration of digital technology and toll business scenarios.

[0004] The traditional highway business system includes a toll collection system and a monitoring system. The toll collection network and the monitoring network are isolated from each other, and the toll collection system business and the monitoring system business cannot be well integrated. The traditional monitoring system can realize intercom with the lane, but it belongs to the monitoring business. Generally, it intercoms with the toll collector in the lane toll booth and cannot communicate directly with the vehicle user. When handling special situations remotely, the special situation events are reported by the toll lane to the back-end system of the toll collection business, which belongs to the toll collection business system. In the traditional mode, the back-end service personnel need to operate two systems, which is very inconvenient. After the lane is unmanned for toll collection, the back-end monitoring personnel need to directly face the vehicle user when handling special situations. However, the existing toll collection network is isolated from the monitoring network, and the intercom of the monitoring network cannot communicate directly with the vehicle user. The lane robot sometimes encounters special situations that cannot be handled, such as license plate recognition errors, barrier not raised, etc. In addition, vehicle users cannot communicate with the back-end service personnel conveniently on the mobile terminal, which affects the work efficiency of the service personnel. Summary of the invention

[0005] The present invention solves the problem that lane robots sometimes encounter special situations that they cannot handle due to the isolation of the existing toll collection network and the monitoring network. It provides an intercom system and method for handling special situations on highways, which connects the monitoring network and the toll collection network, allowing vehicle users to communicate directly with toll collection backend service personnel to promptly handle special situations that the lane robots cannot handle.

[0006] The technical solution claimed in the present invention is as follows:

[0007] A talkback system for handling special situations on a highway, comprising a lane client, a FREESWITCH service center, an agent service end and an agent center; the lane client refers to software installed on a lane robot working machine, which implements the SDP protocol, monitors button events and converts button events into call invitations through the SDP protocol; the FREESWITCH service center is configured with a call center function, a recording function, a call record and a call queue; the lane client is interconnected with the FREESWITCH service center and performs signaling interaction, and the signaling includes registration and login, call invitation, and audio and video protocol exchange; the agent center is interconnected and communicates with the FREESWITCH service center through WebRTC, transfers the call invitation to the agent, and completes the audio and video talkback; the agent service end is interconnected with the FREESWITCH service center and the agent center to monitor the registration events of the lane client and the agent login events; the talkback system is deployed in a toll network.

[0008] Preferably, the lane client is equipped with a camera and a microphone and is connected to a charging network.

[0009] Preferably, the lane client registers and logs in to connect to the FREESWITCH service center according to the configured number by default, adopts SDP protocol communication signaling, uses codec voice information and ffmpeg library to perform H264 encoding and decoding on the video, and transmits H264 video through RTP; the codec voice information includes: PCMU, PCMA, G711, G726_32 and G726_40.

[0010] Preferably, the lane client is written in Java language.

[0011] Preferably, the FREESWITCH service center function is implemented through FREESWITCH; the FREESWITCH is an open source communication software platform for building and deploying various real-time communication applications, including telephone communication, video conferencing, and instant messaging.

[0012] Preferably, the FREESWITCH service center uses the FREESWITCH call center; the FREESWITCH call center is implemented through the mod_callcenter module, which provides seat management, call queue, and call distribution functions.

[0013] Preferably, the FREESWITCH service center bridges the lane client to communicate with the agent center.

[0014] Preferably, the agent server adopts a BS service architecture, receives registration events of lane clients, agent login events and records call records.

[0015] Preferably, the seat center implements the SDP protocol through the JSSIP framework and websocket, and realizes the audio and video functions with WebRTC.

[0016] An intercom method for handling special situations on a highway based on the intercom system described above comprises the following steps:

[0017] S1: The Lane client monitors the button event, converts the button event into a call invitation, and exchanges the call invitation with the FREESWITCH service center through signaling; at the same time, the FREESWITCH service center monitors the telephone communication made by the seat center to the Lane client and exchanges signaling with the Lane client;

[0018] S2: After receiving the call invitation from the Lane client, the FREESWITCH service center interacts with the agent server, obtains the agent status, and transfers and rings the agent according to the agent status; the FREESWITCH service center receives the telephone communication from the agent center and interacts with the Lane client through signaling;

[0019] S3: When the seat center rings, the staff will answer the audio and video call and handle the special event; when the lane center rings, the staff will remotely check the lane conditions and provide remote voice guidance on lane vehicle behavior.

[0020] Beneficial effects:

[0021] The present invention provides an intercom system and method for handling special situations on highways. The intercom system includes a lane client, a FREESWITCH service center, a seat service end and a seat center. When the user encounters a special situation that the lane robot cannot handle, the user can press a button on the lane robot to trigger the lane client to initiate a call invitation and directly call the seat center for a call. The seat staff remotely handles the special situation event, thereby solving the problem that the lane robot sometimes encounters special situations that cannot be handled due to the isolation of the existing toll network and the monitoring network.

[0022] The lane client is written in Java and can be deployed across platforms. It integrates audio and video functions without the need to build a huge call center. When the toll collection robot encounters a special situation that it cannot handle, the vehicle user can directly call the agent for audio and video communication to seek help. For example, if the car owner encounters a lane that does not lift the barrier, the car owner presses the help button to call the agent center. The agent connects to the audio and video for a conversation and finds that the vehicle information is not recognized, so it manually inputs remotely and starts lifting the barrier. For another example, the agent center directly connects to the lane audio and video, remotely checks the lane conditions, and remotely voice guides the behavior of lane vehicles.

[0023] The intercom system and method provided by the present invention can reduce costs and increase efficiency in operation. The original highway management company needs to deploy toll service personnel in each lane. Through the present invention, only some seat center personnel need to be deployed to serve multiple lanes and multiple toll stations. The seat personnel can also use handheld pads to communicate, which is convenient for the on-duty personnel to deal with lane special situations anytime and anywhere. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 This is an architecture diagram of an intercom system for handling special situations on highways according to an embodiment of the present invention. DETAILED DESCRIPTION

[0025] The present invention will be further described below in conjunction with the accompanying drawings and specific embodiments.

[0026] First Group of Embodiments: Intercom System for Handling Special Situations on Expressways

[0027] This group of embodiments provides an intercom system for handling special situations on highways, such as Figure 1 As shown, it includes: a lane client, a FREESWITCH service center, an agent server and an agent center; the lane client refers to the software installed on the lane robot working machine, which implements the SDP protocol, monitors button events and converts button events into call invitations through the SDP protocol; in a specific embodiment of the present invention, the lane client is installed with basic running software, java operating environment and ffmpeg, and the lane client is copied to the industrial computer of the lane robot through mjsip, and then the mjsip configuration is configured, and the assigned lane number and the FREESWITCH service center ip address are configured.

[0028] The FREESWITCH service center configures call center functions, recording functions, call records and call queues; the lane client is interconnected with the FREESWITCH service center and performs signaling interaction to implement PCMU, PCMA, G711, G726_32, G726_40 and other encoding and decoding voice information; the signaling includes registration and login, call invitation, audio and video protocol exchange; the FREESWITCH service center installs the java operating environment, the docker operating environment, imports the produced FREESWITCH image (windows environment, directly download FREESWITCH and install it), configures FREESWITCH configuration (such as configuring the seat center settings and answering settings) and configures the dial plan.

[0029] The seat center is interconnected and communicated with the FREESWITCH service center through WebRTC, transfers the call to the seat personnel, and completes the audio and video intercom; the seat service end is interconnected with the FREESWITCH service center and the seat center to monitor the registration events of the lane client and the seat login events; the intercom system is deployed in the toll network to avoid the problem of isolation between the toll service and the monitoring service network.

[0030] In a specific embodiment of the present invention, the lane client is installed with a camera and a microphone and is connected to a charging network, so as to solve the problem that the vehicle user cannot communicate directly with the back-end service personnel.

[0031] When the Lane client registers and logs in, it will register and log in to the FREESWITCH service center according to the number assigned and configured, use the SDP protocol communication signaling, use the codec voice information and ffmpeg library to encode and decode the video in H264, and transmit the H264 video through RTP; the codec voice information includes: PCMU, PCMA, G711, G726_32 and G726_40; in a specific embodiment of the present invention, the Lane client is written in Java language, which can support cross-platform environment and be deployed on platforms such as Linux and Windows. The Lane client communicates with the FREESWITCH service center through an optimized SDP signaling process, including supported codec format negotiation, bandwidth and network condition adaptation. When the Lane client is started, it registers and logs in to the background FREESWITCH service center through the configured account. After the startup, the Lane client is in a listening state. When the help button triggers the IO electrical signal, the Lane client dials the FREESWITCH service center, and the FREESWITCH service center transfers according to the seat status, the seat rings, and the audio and video are connected. When the lane client is monitoring, the FREESWITCH service center directly connects the lane client audio and video by dialing the lane number.

[0032] The lane client implements the monitoring of IO button events, uses its own UDP protocol, and connects to the dynamic library of the docking manufacturer. The UDP protocol is: the lane client is used to monitor the owner's help button event and use the UDP protocol to realize the communication between the owner and the seat center. The communication form is: the UDP receiver is the lane client, and the sender is the button driver library. The communication data frame format is shown in Table 1, the communication data frame format description is shown in Table 2, and the DATA data is shown in Table 3.

[0033] Table 1. Communication data frame format

[0034] STX RSCTL DATA BCC

[0035] Table 2. Communication data frame format description

[0036]

[0037]

[0038] Table 3. DATA

[0039] Location Number of bytes Data element Data content 0 1 instruction 88H 1 1 length Data length 2 1 Workstation 1-Upper station 2-Lower station

[0040] The FREESWITCH service center functions are implemented through FREESWITCH; the FREESWITCH is an open source communication software platform for building and deploying various real-time communication applications, including telephone communications, video conferencing, and instant messaging; the FREESWITCH service center uses the FREESWITCH call center; the FREESWITCH call center is implemented through the mod_callcenter module, which provides advanced call center functions such as agent management, call queues, and call distribution.

[0041] The agent server adopts BS service architecture, receives lane client registration events, agent login events and records call records. The agent server monitors lane client registration offline events, agent login and logout events, records call records through FREESWITCH ESL event mechanism, and FREESWITCH bridges lane client and agent client communication. The monitored events include agent-status-change event, channel_hangup_complete event, and statusprofile internal reg event. The agent center implements browser audio and video communication through JSSIP framework, implements SDP protocol through websocket, implements audio and video functions with WebRTC, and communicates with FREESWITCH through WebRTC; the agent logs in to the system, automatically registers the FREESWITCH service center, and displays that the current agent is ready. When a lane client calls the call center, the call center will transfer the call to the agent according to the average distribution mechanism, and the agent will ring and answer to complete the audio and video intercom. When the agent hangs up the current audio and video, the agent returns to the agent waiting pool and waits for the next allocated call. 。 In a specific embodiment of the present invention, the agent server logs in to the intercom system through a web page and automatically signs in to the agent's waiting status. The page displays the online and offline status of all current lane clients (lanes). Dial the corresponding lane number to connect the lane's audio and video intercom. When a lane calls in, the platform displays a ringing sound and plays a ringtone. The agent center answers the call and starts the audio and video intercom. The agent center platform uses the JSSIP library to communicate with the FREESWITCH service center through websocket. Through the web page, the agent service personnel can use it conveniently on the mobile terminal. The agent server installs the java runtime environment, installs the database mysql, configures the database, copies and deploys the agent background service, and starts the background service.

[0042] Second Group of Embodiments: Intercom Method for Handling Special Situations on Expressways

[0043] This group of embodiments provides an intercom method for handling special situations on a highway based on the intercom system, comprising the following steps:

[0044] S1: The Lane client monitors the button event, converts the button event into a call invitation, and exchanges the call invitation with the FREESWITCH service center through signaling; at the same time, the FREESWITCH service center monitors the telephone communication made by the seat center to the Lane client and exchanges signaling with the Lane client;

[0045] S2: After receiving the call invitation from the Lane client, the FREESWITCH service center interacts with the agent server, obtains the agent status, and transfers and rings the agent according to the agent status; the FREESWITCH service center receives the telephone communication from the agent center and interacts with the Lane client through signaling;

[0046] S3: When the seat center rings, the staff will answer the audio and video call and handle the special event; when the lane center rings, the staff will remotely check the lane conditions and provide remote voice guidance on lane vehicle behavior.

[0047] It should be noted that the above-described specific implementations can enable those skilled in the art to more fully understand the invention, but do not limit the invention in any way. Therefore, although this specification has described the invention in detail with reference to the drawings and embodiments, those skilled in the art should understand that the invention can still be modified or replaced by equivalents. In short, all technical solutions and improvements that do not deviate from the spirit and scope of the invention should be included in the protection scope of the patent for the invention.

Claims

1. An intercom system for handling special situations on highways, characterized in that: It includes a lane client, a FREESWITCH service center, an agent service end and an agent center; the lane client refers to the software installed on the lane robot working machine, which implements the SDP protocol, monitors button events and converts button events into call invitations through the SDP protocol; the FREESWITCH service center configures call center functions, recording functions, call records and call queues; the lane client and the FREESWITCH service center are interconnected and interact with each other through signaling, and the signaling includes registration and login, call invitations, and audio and video protocol exchanges; the agent center is interconnected and communicates with the FREESWITCH service center through WebRTC, transfers call invitations to agents, and completes audio and video intercoms; the agent service end is interconnected with the FREESWITCH service center and the agent center to monitor the registration events of the lane client and the agent login events; the intercom system is deployed in a toll network.

2. The intercom system for handling special situations on highways according to claim 1 is characterized in that: The lane client is equipped with a camera and a microphone and is connected to a charging network.

3. The intercom system for handling special situations on highways according to claim 2 is characterized in that: The lane client registers and logs in to the FREESWITCH service center by default according to the configured number, adopts SDP protocol communication signaling, uses codec voice information and ffmpeg library to encode and decode the video in H264, and transmits H264 video through RTP; the codec voice information includes: PCMU, PCMA, G711, G726_32 and G726_40.

4. The intercom system for handling special situations on highways according to claim 1 is characterized in that: The lane client is written in Java language.

5. The intercom system for handling special situations on highways according to claim 1 is characterized in that: The FREESWITCH service center function is implemented through FREESWITCH; FREESWITCH is an open source communication software platform for building and deploying various real-time communication applications, including telephone communication, video conferencing, and instant messaging.

6. The intercom system for handling special situations on highways according to claim 5 is characterized in that: The FREESWITCH service center uses the FREESWITCH call center; the FREESWITCH call center is implemented through the mod_callcenter module, which provides seat management, call queue, and call distribution functions.

7. The intercom system for handling special situations on highways according to claim 6 is characterized in that: The FREESWITCH service center bridges the lane client and communicates with the agent center.

8. The intercom system for handling special situations on highways according to claim 1 is characterized in that: The agent server adopts the BS service architecture, receives the registration events of the lane client, the agent login events and records the call records.

9. The intercom system for handling special situations on highways according to claim 1, characterized in that: The agent center implements the SDP protocol through the JSSIP framework and websocket, and realizes audio and video functions with WebRTC.

10. An intercom method for handling special situations on highways based on the intercom system according to any one of claims 1 to 9, characterized in that: The steps include: S1: The Lane client monitors the button event, converts the button event into a call invitation, and exchanges the call invitation with the FREESWITCH service center through signaling; at the same time, the FREESWITCH service center monitors the telephone communication made by the seat center to the Lane client and exchanges signaling with the Lane client; S2: After receiving the call invitation from the Lane client, the FREESWITCH service center interacts with the agent server, obtains the agent status, and transfers and rings the agent according to the agent status; the FREESWITCH service center receives the telephone communication from the agent center and interacts with the Lane client through signaling; S3: After the seat center rings, the staff answers the audio and video call and handles the special event; The center of the lane rings, and staff can remotely check lane conditions and provide remote voice guidance on lane vehicle behavior.

Images