Lane remote management system

Abstract

The invention discloses a lane remote management system. The lane remote management system comprises a remote seat end and at least one lane equipment end, wherein a streaming media channel and a visual intercom channel are established between the remote seat end and the at least one lane equipment end; wherein the remote seat end determines a target lane equipment end through a streaming media list, and the target lane equipment end visually maps a service data stream to a streaming media window of the remote seat end through a streaming media channel; the remote seat end maps the collected remote video data and remote audio data to the target lane equipment end based on the visual intercom channel, and the target lane equipment end maps the collected lane video data and lane audio data to the remote seat end based on the visual intercom channel. By means of the system, efficient and reliable lane remote management can be achieved, communication between the remote seat end and the lane equipment end is more visual and convenient, and the efficiency and quality of lane management can be improved.

Description

Technical Field

[0001] The present application relates to the field of traffic operation technology, and in particular to a lane remote management system. Background Art

[0002] With the acceleration of urbanization and the continuous growth of traffic demand, road traffic management is facing increasing pressure. The lane remote management system realizes real-time monitoring and intelligent scheduling of traffic flow through remote monitoring and management, thereby improving the safety and efficiency of road traffic, and has gradually been applied to modern lane management.

[0003] However, the existing lane remote management system can usually only reflect the lane conditions through text data and conventional remote monitoring, and its remote monitoring often has delays and freezes, lacks fluency and immediacy in business processing, and has difficulty providing intuitive, real-time audio and video interaction. It lacks flexibility and convenience, and is prone to operational errors. In addition, the existing lane remote management system lacks noise and echo processing for audio and video in complex traffic environments, which is not conducive to the effectiveness and reliability of the lane remote management system in lane remote management. Summary of the invention

[0004] This application mainly provides a lane remote management system, which aims to solve the technical problem that the existing lane remote management system is difficult to provide intuitive and real-time audio and video interaction.

[0005] In order to solve the above technical problems, the technical solution adopted in this application is: to provide a lane remote management system. The lane remote management system includes: at least one lane device end, which is provided with a streaming media acquisition module, a lane audio and video acquisition module, a lane visual intercom window and a lane audio module; a remote agent end, which is provided with a streaming media window, a remote audio and video acquisition module, a remote visual intercom window and a remote audio module, and a streaming media channel and a visual intercom channel are established between the remote agent end and the at least one lane device end; wherein, the remote agent end obtains a streaming media list through the streaming media channel, and in response to detecting a selection request for a target streaming media in the streaming media list, determines a target lane device end corresponding to the target streaming media from the at least one lane device end, and the target lane device end is used to transmit the business data collected by the streaming media acquisition module through the streaming media channel. The service data stream is visually mapped to the streaming media window of the remote agent end; the remote agent end also responds to the received visual intercom instruction and, based on the visual intercom channel, visually maps the remote video data collected by the remote audio and video acquisition module to the lane visual intercom window of the target lane device end, and maps the collected remote audio data to the lane audio module of the target lane device end; the target lane device end responds to the received visual intercom instruction and, based on the visual intercom channel, visually maps the lane video data collected by the lane audio and video acquisition module to the remote visual intercom window of the remote agent end, and maps the collected lane audio data to the remote audio module of the remote agent end.

[0006] In some embodiments, the streaming media acquisition module includes a video graphics array interface module 221 and / or a high-definition multimedia interface module, the lane device end also includes a first data encoder, and the remote agent end also includes a channel switching processing module, a user input device receiving module and a first data decoder; the remote agent end detects whether the selection request for the target streaming media is received through the user input device receiving module, and after confirming that the selection request is received, sends a streaming media request to the target lane device end through the streaming media channel; in response to detecting the streaming media request, the target lane device end receives original streaming media data based on the video graphics array interface and / or the high-definition multimedia interface module, performs digital quantity conversion and business stream conversion on the original streaming media data to obtain the business data stream, and encodes the business data stream through the first data encoder to transmit the business data stream to the remote agent end through the streaming media channel; in response to receiving the business data stream, the remote agent end decodes the business data stream based on the first data decoder, and switches the decoded business data stream to the streaming media window based on the channel switching processing module to visually map the business data stream to the streaming media window.

[0007] In some embodiments, the remote agent end includes an intercom initiation switch and / or the lane equipment end includes an operation assistance switch; the remote agent end sends the visual intercom instruction to the target lane equipment end in response to determining that the intercom initiation switch is turned on; the target lane equipment end sends the visual intercom instruction to the remote agent end in response to determining that the operation assistance switch is turned on.

[0008] In some embodiments, the remote audio and video acquisition module includes a remote camera, a remote microphone, a second data encoder and a second data decoder, and the lane audio and video acquisition module includes a lane camera, a lane microphone, a third data encoder and a third data decoder; the remote camera is used to acquire the remote video data, the remote microphone is used to acquire the remote audio data, the second data encoder is used to encode the remote video data and the remote audio data, and transmit the encoded remote video data and the remote audio data to the third data decoder at the target lane device end through the video intercom channel, and the third data decoder is used to decode the received encoded remote video data and the remote audio data to convert the remote The video data is visually mapped to the lane visual intercom window, and the remote audio data is visually mapped to the lane audio module; the lane camera is used to collect the lane video data, the lane microphone is used to collect the lane audio data, the third data encoder is used to encode the lane video data and the lane audio data, and transmit the encoded lane video data and the lane audio data to the second data decoder of the remote seat end through the visual intercom channel, the second data decoder is used to decode the received encoded lane video data and the lane audio data to visually map the lane video data to the remote visual intercom window, and visually map the lane audio data to the remote audio module.

[0009] In some embodiments, the remote agent end includes a first algorithm module, and the lane device end includes a second algorithm module; the first algorithm module is used to perform noise reduction processing on the remote video data and the remote audio data based on a first preset noise reduction algorithm, and to perform noise elimination processing on the remote video data and the remote audio data based on a first preset echo elimination algorithm; the second algorithm module is used to perform noise reduction processing on the lane video data and the lane audio data based on a second preset noise reduction algorithm, and to perform noise elimination processing on the lane video data and the lane audio data based on a second preset echo elimination algorithm.

[0010] In some embodiments, the remote agent end is also provided with a remote self-drawing window, and the lane device end is also provided with a lane self-drawing window; the remote agent end is also used to map the remote video data collected by the remote audio and video acquisition module to the remote self-drawing window; the target lane device end is also used to map the lane video data collected by the lane audio and video acquisition module to the lane self-drawing window.

[0011] In some embodiments, the lane remote management system also includes a central server; the central server is connected to the remote agent end and the lane equipment end respectively, and is used to detect the operating status of the remote agent end and the lane equipment end and provide functional services; in response to determining that the operating status of the remote agent end and / or the target lane equipment end does not meet the preset visual intercom condition, the central server closes the video acquisition function service of the remote audio and video acquisition module and the lane audio and video acquisition module, and only retains the audio acquisition function service of the remote audio and video acquisition module and the lane audio and video acquisition module to switch the visual intercom between the remote agent end and the target lane equipment end to voice intercom; or the central server closes the visual intercom channel in response to determining that the operating status of the remote agent end and / or the target lane equipment end does not meet the preset visual intercom condition, and establishes a voice intercom channel between the remote agent end and the lane equipment end based on Internet phone technology.

[0012] In some embodiments, the streaming media channel is established based on a real-time messaging protocol, and the video intercom channel is established based on a web real-time communication technology.

[0013] In some embodiments, the lane equipment end also includes a hardware-controlled video box, and the remote agent end also includes a remote desktop player; the hardware-controlled video box is used to store the business data stream, and in response to receiving a play instruction issued by the remote desktop player through the streaming media channel, sends the business data stream to the remote desktop player based on a highly compressed digital video codec standard; the remote desktop player responds to receiving a play request triggered by the streaming media window, and visually plays the business data stream in the streaming media window.

[0014] In some embodiments, the lane equipment end includes at least two lane visual intercom windows arranged at different heights, and the target lane equipment end is also used to switch the lane visual intercom window based on the vehicle height of the corresponding lane.

[0015] The beneficial effect of the present application is that, different from the prior art, the present application discloses a lane remote management system. The present application establishes an efficient and reliable lane remote management system through a visual intercom channel and a streaming media transmission channel, realizes real-time streaming media transmission and real-time visual intercom, enables remote agents to monitor lane conditions in real time, and realizes real-time audio and video communication between the remote agent end and the lane equipment end, improves the flexibility and response speed of lane management, realizes the intelligence, automation and visualization of lane management, reduces the configuration requirements for on-site personnel and equipment, reduces labor costs, makes the communication between the remote agent end and the lane equipment end more intuitive and convenient, and is conducive to improving the efficiency and quality of lane management. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the prior art descriptions are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative work, among which: Figure 1 It is a structural diagram of an embodiment of a lane remote management system provided by the present application; Figure 2 yes Figure 1 A schematic diagram of the structure of a target lane device end 210 and a remote agent end 300 in an embodiment; Figure 3 yes Figure 1 A schematic diagram of the structure of another embodiment of the target lane device end 210 and the remote agent end 300 in the embodiment. DETAILED DESCRIPTION

[0017] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0018] The terms "first", "second", "third" in the embodiments of the present application are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Thus, the feature defined as "first", "second", "third" can expressly or implicitly include at least one of the features. In the description of the present application, the meaning of "multiple" is at least two, such as two, three, etc., unless otherwise clearly and specifically limited. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device comprising a series of steps or units is not limited to the listed steps or units, but optionally also includes steps or units that are not listed, or optionally also includes other steps or units inherent to these processes, methods, products or devices.

[0019] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0020] This application provides a lane remote management system, see Figure 1 and Figure 2 , Figure 1 is a structural diagram of an embodiment of a lane remote management system 100 provided by the present application, Figure 2 yes Figure 1 A schematic diagram of the structure of an embodiment of the target lane device end 210 and the remote agent end 300 in the embodiment.

[0021] The lane remote management system 100 includes: at least one lane device end 200, which is provided with a streaming media acquisition module 211, a lane audio and video acquisition module 212, a lane visual intercom window 213 and a lane audio module 214; a remote agent end 300, which is provided with a streaming media window 311, a remote audio and video acquisition module 312, a remote visual intercom window 313 and a remote audio module 314, and a streaming media channel and a visual intercom channel are established between the remote agent end 300 and at least one lane device end 200; wherein the remote agent end 300 obtains a streaming media list through the streaming media channel, and in response to detecting a selection request for a target streaming media in the streaming media list, determines a target lane device end 210 corresponding to the target streaming media from at least one lane device end 200, and the target lane device end 210 is used to transmit the streaming media to the target lane device end 210 through the streaming media channel. The business data stream collected by the body acquisition module 211 is visually mapped to the streaming media window 311 of the remote agent end 300; the remote agent end 300 also responds to the received visual intercom instruction and, based on the visual intercom channel, visually maps the remote video data collected by the remote audio and video acquisition module 312 to the lane visual intercom window 213 of the target lane device end 210, and maps the collected remote audio data to the lane audio module 214 of the target lane device end 210; the target lane device end 210 responds to the received visual intercom instruction and, based on the visual intercom channel, visually maps the lane video data collected by the lane audio and video acquisition module 212 to the remote visual intercom window 313 of the remote agent end 300, and maps the collected lane audio data to the remote audio module 314 of the remote agent end 300.

[0022] The lane equipment end 200 is an electronic device installed on each lane, which is used to realize the monitoring of passing vehicles in the lane, payment work order processing and special situation processing. Specifically, the lane equipment end 200 can be selected as one of the lane automatic card issuing machines, payment machines and card issuing robots installed in lanes that need to be controlled, such as traditional highways, urban expressways, internal roads of parks or boundary roads, or a specific functional module in the equipment and a corresponding software program system. The lane equipment end 200 can also be additionally integrated or connected with traffic lights, electronic police, vehicle detectors and ETC (Electronic Toll Collection) equipment and other devices. The remote seat end 300 is a remote operation and management platform connected to the lane equipment end 200 through the network, which is responsible for remote monitoring, scheduling, maintenance and exception processing of the lane equipment end 200. Specifically, the remote seat end 300 can be selected as a computer system installed in a designated traffic management center, monitoring center or service center, or a specific functional module in the system and a corresponding software program component.

[0023] A streaming media channel and a visual intercom channel are established between the remote agent terminal 300 and at least one lane device terminal 200, wherein the streaming media channel is a channel link for real-time transmission of video, audio or other multimedia data streams, and can be established based on streaming media transmission protocols such as the real-time messaging protocol RTP (Real-time Transport Protocol), HLS (Http Live Streaming, an adaptive bit rate streaming media transmission protocol based on the hypertext transfer protocol) or HTTP-FLV (Flash Video over HTTP, an interactive vector graphics and animation standard protocol based on the hypertext transfer protocol), DASH (Dynamic Adaptive Streaming over HTTP), etc., so that based on the streaming media channel, the desktop operated and controlled in the traditional toll station or management booth corresponding to the lane device terminal 200 can be displayed on the corresponding display interface of the remote agent terminal 300, thereby realizing remote operation of related services.

[0024] The video intercom channel is a channel that can realize two-way video calls and audio transmission. It can be established based on real-time communication protocols such as TCP / IP (Transmission Control Protocol / Internet Protocol), UDP (User Datagram Protocol) or SIP (Session Initiation Protocol), and combined with audio and video encoding and decoding technology and terminal display and audio playback technology to realize audio and video interaction, thereby realizing two-way audio and video intercom between the remote seat end 300 and the lane equipment end 200, so as to handle various special situations and abnormal situations more intuitively and effectively.

[0025] At the same time, in the above-mentioned video intercom channel, secure encryption and decryption mechanisms, codec mechanisms, signal modulation and demodulation mechanisms, etc. can also be introduced to ensure the security, effectiveness and stability of data transmission. For example, based on encryption and decryption algorithms such as AES (Advanced Encryption Standard) or RSA (Rivest-Shamir-Adleman, an asymmetric encryption algorithm), based on MP3 (Moving Picture Experts Group Audio Layer III, dynamic image expert compression standard audio layer 3), AAC (Advanced Audio Coding) or Opus and other audio codec technologies, based on H.264, H.265 or MPEG-4 and other video codec technologies, the transmitted data can be pre-processed, and based on pulse modulation, bandpass modulation and frequency extension and corresponding demodulation methods, the transmitted data can be modulated and demodulated, thereby ensuring the security and efficiency of the data during transmission, and further improving the security and reliability of the system.

[0026] Optionally, the streaming media channel is established based on a real-time messaging protocol, and the video intercom channel is established based on a web page real-time communication technology.

[0027] Real-time Messaging Protocol (RTMP) is an efficient and lightweight communication protocol designed for real-time transmission of streaming media, audio and video, and data in the network. It supports multiple transmission methods such as Transmission Control Protocol (TCP), User Datagram Protocol (UDP), and WebSocket. The streaming media channel established by the real-time messaging protocol can ensure that the business data stream collected by the lane device end 200 is transmitted to the remote agent end 300 in real time and with low latency, so as to achieve rapid response and processing of various businesses. In addition, the real-time messaging protocol not only supports encrypted data transmission and enhances the security of data transmission, but also has automatic reconnection and error recovery mechanisms to effectively deal with network fluctuations or interruptions, ensure the continuity and stability of data transmission, and improve the stability and scalability of the streaming media channel.

[0028] Web Real-Time Communication (WebRTC) is a technology that supports web browsers for real-time video and voice intercom. It allows web browsers and mobile applications to communicate in real time without plug-ins, and supports the transmission of audio, video and data. At the same time, through the signaling mechanism, web real-time communication technology can establish a point-to-point connection between clients, thereby realizing high-quality video intercom functions. It can not only improve user experience and simplify system architecture, but also effectively reduce data transmission delays and enhance the immediacy of remote interaction. In addition, end-to-end encryption, identity authentication, security vulnerability and malicious attack protection can be carried out on the video intercom channel to ensure the security of the implementation of web real-time communication technology and the protection of user privacy.

[0029] After determining the streaming media channel between the remote agent terminal 300 and the lane device terminal 200, the corresponding streaming media list can be determined. The streaming media list is a list containing all streaming media resources that need to be transmitted. The items in the streaming media list correspond to different streaming media channels and the corresponding lane device terminal 200, which can specifically include the identification, type, source, destination, transmission protocol, codec format, quality level and current status of each streaming media channel. The generation of the streaming media list is usually completed automatically by the system background, but it can also be adjusted through manual intervention. For example, when the lane device terminal 200 with a streaming media channel is added or removed, the system will automatically update the streaming media list to reflect the currently available streaming media resources. In addition, relevant personnel can manually adjust the priority and bandwidth allocation in the streaming media list according to actual needs to optimize the use of network resources. Through real-time updates and intelligent scheduling, it is ensured that the remote agent terminal 300 can obtain high-quality video and audio data, thereby achieving efficient and safe remote operation and interaction.

[0030] After the streaming media list is determined, when the user of the remote agent terminal 300 issues a selection request for a specific streaming media resource in the streaming media list or a streaming media resource in the streaming media list needs to be reported, a selection request for the target streaming media in the streaming media list can be triggered, and then the target lane device terminal 210 corresponding to the target streaming media can be determined, so as to realize the streaming media transmission between the remote agent terminal 300 and the target lane device terminal 210 based on the corresponding streaming media channel, so that the target lane device terminal 210 transmits the collected business data stream to the remote agent terminal 300 in real time through the streaming media channel. During the streaming media transmission process, the target lane device end 210 uses the streaming media acquisition module 211 to collect business data streams, wherein the streaming media acquisition module 211 generally includes sensors such as cameras for video data acquisition and microphones for audio data acquisition, and a processing unit for expanding relevant data. The data for expanding relevant data may include information such as license plate number, vehicle model, driver identity and environmental conditions identified based on video data, and information such as abnormal sounds, conversation content and emotional state identified based on audio data. The business data stream can be obtained by stream processing part of this information related to business needs.

[0031] Afterwards, the streaming media processing module may also optionally encode, compress, slice and modulate the collected audio and video data to ensure the efficiency and compatibility of the data during transmission. The processed data stream will be sent to the streaming media transmission module, which is responsible for sending the data stream to the remote agent terminal 300 through the selected transmission protocol. The audio and video data received at the remote agent terminal 300 will be mapped to the streaming media window 311, thereby realizing the visual display of the remote desktop and further realizing the remote operation of related services.

[0032] Optionally, see Figure 3 , the streaming media acquisition module 211 includes a video graphics array interface module 221 and / or a high-definition multimedia interface module 222, the lane device end 200 also includes a first data encoder 223, and the remote agent end 300 also includes a channel switching processing module 321, a user input device receiving module 322 and a first data decoder 323; the remote agent end 300 detects whether a selection request for the target streaming media is received through the user input device receiving module 322, and after confirming that the selection request is received, sends a streaming media request to the target lane device end 210 through the streaming media channel; the target lane device end 210 responds to the detection of the streaming media request, based on The video graphics array interface and / or high-definition multimedia interface module 222 receives the original streaming media data, performs digital quantity conversion and business stream conversion on the original streaming media data to obtain a business data stream, and encodes the business data stream through the first data encoder 223 to transmit the business data stream to the remote agent end 300 through the streaming media channel; in response to receiving the business data stream, the remote agent end 300 decodes the business data stream based on the first data decoder 323, and switches the decoded business data stream to the streaming media window 311 based on the channel switching processing module 321 to visualize the business data stream and map it to the streaming media window 311.

[0033] The user input device receiving module 322 is a module for receiving operation instructions input by the user through a device such as a mouse, keyboard, touch pad or touch screen. Through the user input device receiving module 322, it can be determined that the remote agent terminal 300 triggers a selection request by clicking and typing, so as to determine the target streaming media and the corresponding streaming media request of the target lane device terminal 210, so as to subsequently realize the streaming media transmission between the remote agent terminal 300 and the target lane device terminal 210. It should be noted that the streaming media request and selection request process the active selection and issuance of the remote agent terminal 300, and can also be sent through the active reporting triggered by the lane device terminal 200 through a specific control, and a similar selection and sending based on the user input device can also be set on the lane device terminal 200.

[0034] Video Graphics Array (VGA) and High Definition Multimedia Interface (HDMI) are two commonly used video interface standards, among which the VGA interface is mainly used to transmit analog signals, while the HDMI interface supports digital signal transmission. The two interfaces are used to connect external cameras and microphones and other devices, so as to obtain real-time, high-definition and stable audio and video data and other business data, and obtain original streaming media data. In the streaming media acquisition module 211, the video graphics array interface module 221 and / or the high-definition multimedia interface module 222 include corresponding video graphics arrays and high-definition multimedia interfaces, as well as corresponding processing units, so that after receiving the original streaming media data of the connected device, the original streaming media data can be converted into digital quantities and business streams. After receiving the streaming media request, the target lane device end 210 can encode the business data stream to obtain a business data stream in a format suitable for subsequent processing and transmission, and send the encoded data stream to the remote seat end 300 through the streaming media channel.

[0035] After the remote agent terminal 300 receives the service data stream, the service data stream is decoded based on the first data decoder 323, and the decoded service data stream is switched to the streaming media window 311 based on the channel switching processing module 321, so that the service data stream can be visually mapped to the streaming media window 311. Among them, the channel switching processing module 321 is responsible for mapping the decoded service data stream to the corresponding streaming media window 311, ensuring that the user can obtain real-time service data to realize the visual display of the remote desktop, and then realize the remote operation of related services. In addition, the remote agent terminal 300 can also receive user control instructions for the streaming media window 311 through the user input device receiving module 322, such as pause, play, adjust volume and service operations, etc. These instructions can also be sent to the target lane device terminal 210 through a specific channel or server to realize the management of the target lane device terminal. Through the implementation of the remote desktop based on the streaming media channel, high-quality remote operation and interactive experience can be provided to meet the needs of business scenarios of remote management of different lanes.

[0036] Optionally, see Figure 3 The lane equipment end 200 also includes a hardware-controlled video box 271, and the remote agent end 300 also includes a remote desktop player 371; the hardware-controlled video box 271 is used to store the business data stream, and in response to receiving a play instruction issued by the remote desktop player 371 through the streaming media channel, sends the business data stream to the remote desktop player 371 based on the highly compressed digital video codec standard; the remote desktop player 371 responds to receiving a play request triggered by the streaming media window 311, and visually plays the business data stream in the streaming media window 311.

[0037] The hardware-controlled video box 271 is a device specially designed for processing and storing business data streams. It has a highly compressed digital video codec standard and can effectively compress and decompress video data. In the remote management scenario, the hardware-controlled video box 271 can store a large amount of business data streams to ensure that data support can be quickly provided when needed. In addition, the hardware-controlled video box 271 also has a certain computing power and can perform preliminary processing and analysis on the data stream, thereby reducing the burden on the remote seat end 300. The remote desktop player 371 is a client program software, which is usually installed on the computer of the remote seat end 300. It is responsible for receiving the control instructions of the seat personnel to the streaming media window 311, and sending these instructions to the lane device end 200 through the streaming media channel. The remote desktop player 371 can play the business data stream visually, allowing users to view and operate the audio and video data and other business data of the remote lane device end 200 in real time.

[0038] When the agent at the remote agent end 300 triggers a play request in the streaming window 311, the remote desktop player 371 sends a play instruction to the hardware control video box 271. After receiving the instruction, the hardware control video box 271 sends the stored business data stream to the remote desktop player 371 based on the highly compressed digital video codec standard. After receiving the data stream, the remote desktop player 371 performs visual playback in the streaming window 311, so that the agent can view and operate the audio and video data and other business data of the remote lane device end 200 in real time.

[0039] This setting not only improves the efficiency of data transmission, but also ensures the real-time and smoothness of remote operation. Through the cooperation of the hardware control video box 271 and the remote desktop player 371, high-quality remote operation and interactive experience can be achieved to meet the needs of business scenarios of remote management of different lanes. In addition, this setting also has good scalability and flexibility, and can be adjusted and optimized according to actual business needs to adapt to changing business scenarios.

[0040] When conducting video intercom, the video intercom command sent is the command issued when the remote agent end 300 needs to conduct management dialogue, technical guidance or situation understanding with the lane equipment end 200, and the command generated when the lane equipment end 200 needs to obtain operation understanding, emergency assistance or situation reporting from the remote agent end 300.

[0041] Optionally, see Figure 3 The remote agent end 300 includes an intercom initiation switch 331 and / or the lane device end 200 includes an operation help switch 231; the remote agent end 300 responds to determining that the intercom initiation switch 331 is turned on and sends a visual intercom instruction to the target lane device end 210; the target lane device end 210 responds to determining that the operation help switch 231 is turned on and sends a visual intercom instruction to the remote agent end 300.

[0042] The intercom initiation switch 331 and the operation help switch 231 are physical units or software program units respectively set at both ends for initiating video intercom. During the video intercom process, one end actively triggers the intercom initiation switch 331 or the operation help switch 231 through a control, an interface or a program, thereby triggering the video intercom instruction at the end where it is located to enable the video intercom related functions at the end. At the same time, after being triggered, the switch will also send a video intercom instruction to the other end to enable the video intercom related functions at the other end, thereby realizing video intercom between the two ends.

[0043] After receiving the video intercom command, the remote agent terminal 300 will immediately start the remote audio and video acquisition module 312, which is responsible for real-time acquisition of audio and video data of the remote agent terminal 300. The collected video data is transmitted to the target lane device terminal 210 through the video intercom channel, and after processing, it is visualized and mapped to the lane video intercom window 213, so that the staff of the remote agent terminal 300 can see the real-time picture of the lane scene. At the same time, the collected audio data will also be transmitted to the target lane device terminal 210 through the video intercom channel and mapped to the lane audio module 214 to ensure that the remote agent terminal 300 can hear the sound of the lane scene.

[0044] After receiving the video intercom command, the target lane device end 210 will start the lane audio and video acquisition module 212, which is responsible for real-time acquisition of audio and video data at the lane site. The collected video data is transmitted to the remote agent end 300 through the video intercom channel. After processing, it is visualized and mapped to the remote video intercom window 313 of the remote agent end 300, so that the staff at the lane site can see the real-time picture of the remote agent end 300. At the same time, the collected audio data will also be transmitted to the remote agent end 300 through the video intercom channel and mapped to the remote audio module 314 to ensure that the staff at the lane site can hear the sound of the remote agent end 300.

[0045] By establishing this two-way visual intercom channel, real-time interaction of audio and video data can be achieved between the remote agent end 300 and the target lane device end 210, thereby providing a more intuitive and efficient remote communication experience. Whether it is remote guidance, troubleshooting or customer service, this visual intercom function can greatly improve work efficiency and the accuracy of problem solving. In addition, the visual intercom channel also optionally supports a variety of control instructions, such as adjusting the volume, switching the camera angle, etc. These instructions can be sent to the other end through a specific channel or server to achieve remote control of the audio and video acquisition module. In this way, the remote agent end 300 and the target lane device end 210 can flexibly adjust the intercom environment to ensure the clarity and fluency of the audio and video data, thereby providing more stable and high-quality support for remote operation and interaction.

[0046] Optionally, see Figure 3The remote audio and video acquisition module 312 includes a remote camera 341, a remote microphone 342, a second data encoder 343 and a second data decoder 344. The lane audio and video acquisition module 212 includes a lane camera 241, a lane microphone 242, a third data encoder 243 and a third data decoder 244; the remote camera 341 is used to collect remote video data, the remote microphone 342 is used to collect remote audio data, the second data encoder 343 is used to encode the remote video data and the remote audio data, and transmit the encoded remote video data and remote audio data to the third data decoder 244 at the target lane device end through the visual intercom channel, and the third data decoder 244 is used to receive the encoded remote video data and remote audio data. Lane decoding is performed to visually map the remote video data to the lane visual intercom window 213, and to visually map the remote audio data to the lane audio module 214; the lane camera 241 is used to collect lane video data, the lane microphone 242 is used to collect lane audio data, the third data encoder 243 is used to encode the lane video data and the lane audio data, and transmit the encoded lane video data and the lane audio data to the second data decoder 344 of the remote agent end 300 through the visual intercom channel, and the second data decoder 344 is used to decode the received encoded lane video data and lane audio data to visually map the lane video data to the remote visual intercom window 313, and to visually map the lane audio data to the remote audio module 314.

[0047] The remote audio and video acquisition module 312 provided at the remote seat end 300 and the lane audio and video acquisition module 212 provided at the lane device end 200 are intended to ensure high-quality acquisition and transmission of audio and video data. Among them, the remote camera 341 and the lane camera 241 provided in the remote audio and video acquisition module 312 and the lane audio and video acquisition module 212 are responsible for capturing the live images of the remote seat end 300 and the lane device end 200, respectively, while the remote microphone 342 and the lane microphone 242 are responsible for capturing the audio information of the seat personnel and the lane personnel, respectively, to ensure the intuitiveness and real-time nature of remote communication.

[0048] At the same time, the second data encoder 343 and the third data encoder 243 efficiently encode the collected audio and video data, compress the data to reduce the transmission time, and maintain high image and sound quality. The encoded data is transmitted through the visual intercom channel to ensure the stability and reliability of data transmission. At the target lane device end 210, the third data decoder 244 decodes the received encoded remote audio and video data and restores the data to recognizable video and audio signals. These signals are then visually mapped to the lane visual intercom window 213 and the lane audio module 214, so that the staff at the lane site can see and hear the staff at the remote seat end 300 in real time. Similarly, at the remote seat end 300, the second data decoder 344 decodes the received encoded lane audio and video data and restores the data to recognizable video and audio signals. These signals are then visually mapped to the remote visual intercom window 313 and the remote audio module 314, so that the staff at the remote seat end 300 can see and hear the real-time images and sounds at the lane site in real time.

[0049] By setting the remote audio and video acquisition module 312 and the lane audio and video acquisition module 212, the remote agent terminal 300 and the target lane device terminal 210 can flexibly adjust the intercom environment to ensure the clarity and fluency of the audio and video data, thereby providing more stable and high-quality support for remote operation and interaction. The establishment of this two-way visual intercom channel not only improves the efficiency of remote communication, but also enhances the accuracy and reliability of remote operation, meeting the needs of different business scenarios.

[0050] Optionally, see Figure 3 The remote agent end 300 includes a first algorithm module 351, and the lane device end 200 includes a second algorithm module 251; the first algorithm module 351 is used to perform noise reduction processing on the remote video data and the remote audio data based on the first preset noise reduction algorithm, and to perform noise elimination processing on the remote video data and the remote audio data based on the first preset echo elimination algorithm; the second algorithm module 251 is used to perform noise reduction processing on the lane video data and the lane audio data based on the second preset noise reduction algorithm, and to perform noise elimination processing on the lane video data and the lane audio data based on the second preset echo elimination algorithm.

[0051] In the process of remote communication, interference factors such as environmental noise, equipment noise and echo will have an adverse effect on the quality of audio and video data. In order to further improve the quality of audio and video communication, the present application optionally sets a first algorithm module 351 and a second algorithm module 251 on the remote seat end 300 and the lane device end 200, respectively, and processes the audio and video data of each end through the algorithm modules to achieve noise reduction and echo cancellation functions, ensuring a clear and interference-free communication experience in various environments.

[0052] The first preset noise reduction algorithm and the second preset noise reduction algorithm used by the first algorithm module 351 and the second algorithm module 251 can specifically be one or more of finite impulse response filtering algorithm (Finite Impulse Response, FIR), Kalman filtering algorithm (KF), adaptive noise reduction algorithm (Adaptive Noise Reduction, ANR), high quality 3D denoise algorithm (High Quality 3D Denoise.hqdn3d), noise reduction algorithm based on learning model and noise reduction algorithm based on statistical model, and the first preset echo cancellation algorithm and the second preset echo cancellation algorithm used by the first algorithm module 351 and the second algorithm module 251 can specifically be one or more of adaptive filter-based echo cancellation algorithm (Adaptive Filter-based Echo Cancellation, AFE), frequency domain based echo cancellation algorithm (Frequency Domain Echo Cancellation, FDEC), minimum mean square error (Least Mean Square, LMS) based echo cancellation algorithm, normalized minimum mean square error (Normalized Least Mean Square, NLMS) based echo cancellation algorithm and the like.

[0053] The preset noise reduction algorithm and the preset echo cancellation algorithm used by the first algorithm module 351 and the second algorithm module 251 can be selected according to the specific video data and audio data to ensure the clarity of the audio and video data and the smoothness of the remote video intercom communication. In addition, according to the changes in the actual communication environment, the parameters of noise reduction and echo cancellation can be dynamically adjusted to adapt to different noise conditions. This adaptive capability enables the remote audio and video communication system to maintain a high communication quality in various complex environments, providing more stable and high-quality support for remote operation and interaction.

[0054] Optionally, see Figure 3 The remote agent end 300 is also provided with a remote self-drawing window 361, and the lane device end 200 is also provided with a lane self-drawing window 261; the remote agent end 300 is also used to map the remote video data collected by the remote audio and video acquisition module 312 to the remote self-drawing window 361; the target lane device end 210 is also used to map the lane video data collected by the lane audio and video acquisition module 212 to the lane self-drawing window 261.

[0055] The present application may also optionally set a seat self-drawing window and a lane self-drawing window 261 at the remote seat end 300 and the lane device remotely, respectively, so as to provide an intuitive self-display interface for the relevant personnel at the remote seat end 300 and the lane device end 200. Through these self-drawing windows, the seat personnel and the lane personnel can see their own video images in real time, so as to better control and adjust their own images and expressions, improve the realism of the video intercom, and help improve the concentration and interactivity of the video intercom, thereby ensuring the effectiveness and reliability of the processing of video intercom related services. At the same time, the operation process and emotional expression can be understood by recording the dynamics of the seat self-drawing window and the lane self-drawing window 261, which is convenient for subsequent analysis and summary, and improves work efficiency and quality.

[0056] Optionally, see Figure 3 The lane remote management system 100 further includes a central server 400; the central server 400 is connected to the remote agent terminal 300 and the lane device terminal 200 respectively, and is used to detect the operating status of the remote agent terminal 300 and the lane device terminal 200 and provide functional services; the central server 400, in response to determining that the operating status of the remote agent terminal 300 and / or the target lane device terminal 210 does not meet the preset visual intercom condition, turns off the video acquisition of the remote audio and video acquisition module 312 and the lane audio and video acquisition module 212 Functional service, only retaining the audio collection function service of the remote audio and video collection module 312 and the lane audio and video collection module 212 to switch the video intercom between the remote agent terminal 300 and the target lane equipment terminal 210 to voice intercom; or the central server 400 responds to determining that the operating status of the remote agent terminal 300 and / or the target lane equipment terminal 210 does not meet the preset video intercom conditions, closes the video intercom channel, and establishes a voice intercom channel between the remote agent terminal 300 and the lane equipment terminal 200 based on the Internet phone technology.

[0057] In the lane remote management system 100 of the present application, a central server 400 is optionally provided to monitor the operating status of the remote agent terminal 300 and the lane equipment terminal 200 in real time, and manage corresponding service functions based on the operating status to ensure stable operation of the system to meet the needs of different business scenarios.

[0058] Video intercom conditions refer to a series of standards and requirements that must be met for the normal operation of remote audio and video intercom communications. These conditions may include network bandwidth, video resolution, audio quality, system response time, etc. You can determine whether the video intercom conditions are met by setting corresponding judgment thresholds. When the central server 400 detects that the operating status of the remote agent terminal 300 and / or the target lane device terminal 210 does not meet the preset video intercom conditions, in order to ensure the continuity and reliability of communication, the central server 400 can respond quickly by shutting down the video acquisition function service of the remote audio and video acquisition module 312 and the lane audio and video acquisition module 212, and only retaining the audio acquisition function service, so as to switch the video intercom between the remote agent terminal 300 and the target lane device terminal 210 to a voice intercom mode, or establish a voice intercom channel between the remote agent terminal 300 and the lane device terminal 200 through Internet telephone technology, such as IP-based voice transmission technology (Voice over Internet Protocol, VoIP), Session Initiation Protocol (SIP), etc., to ensure that the two parties of the intercom can still continue to communicate effectively.

[0059] Through the rapid response of the central server 400 and the downgrade mechanism of retaining only voice intercom when the conditions for video intercom are not met, it is ensured that when the quality of audio and video data of the lane remote management system 100 is severely degraded or the system fails, both parties can still communicate through voice, avoiding the impact on the efficiency and quality of business processing due to communication interruption, and ensuring the stability and reliability of remote video intercom.

[0060] Optionally, see Figure 3 The lane device end 200 includes at least two lane visual intercom windows 213 set at different heights, and the target lane device end 210 is also used to switch the lane visual intercom window 213 based on the vehicle height of the corresponding lane.

[0061] In order to adapt to vehicles of different models and heights, the present application also switches between at least two lane video intercom windows 213 of different heights on the lane equipment end 200 to communicate with different vehicles. For example, two windows of different heights can be set, one video intercom window is used for video intercom with large vehicles such as large trucks, engineering vehicles and armored vehicles, and the other video intercom is used for video intercom with small and medium-sized vehicles such as sedans, SUVs (Sport Utility Vehicles) and vans. Through this design, the lane equipment end 200 can automatically or manually select the appropriate video intercom window according to the actual height of the vehicle, thereby ensuring smoother and more efficient communication between the seat personnel and the lane personnel.

[0062] It is understandable that other components in the lane remote management system 100 can also be set for different heights, distributed at different heights, or the components in the vehicle-side management system can be adjusted in height through lifting mechanisms such as sliding rods, telescopic frames, and tractors to adapt to the height requirements of different vehicles. Taking the lane camera 241 of the lane equipment end 200 as an example, multiple cameras can be set, and the position of each camera can be set at a different height range. The camera can also be set on a sliding rod, and the height of the camera can be adjusted by lifting the sliding rod, so as to obtain more accurate video of vehicles of different models, which is conducive to better identifying the corresponding license plate number, vehicle model, driver information and other business data. Through the adaptive design of different heights, the lane remote management system 100 can provide a more flexible and efficient remote desktop and visual intercom, thereby improving the overall business processing efficiency.

[0063] Different from the prior art, the present application discloses a lane remote management system. An efficient and reliable lane remote management system is established through a visual intercom channel and a streaming media transmission channel, which realizes real-time streaming media transmission and real-time visual intercom, enables remote agents to monitor lane conditions in real time, and realizes real-time audio and video communication between the remote agent terminal and the lane device terminal 200, improves the flexibility and response speed of lane management, realizes the intelligence, automation and visualization of lane management, reduces the configuration requirements for on-site personnel and equipment, reduces labor costs, makes the communication between the remote agent terminal and the lane device terminal more intuitive and convenient, and is conducive to improving the efficiency and quality of lane management.

[0064] The various embodiments in this specification are described in a progressive manner, and the same or similar parts between the various embodiments can be referenced to each other, and each embodiment focuses on the differences from other embodiments.

[0065] In the several embodiments provided in this application, it should be understood that what is disclosed can be implemented in other ways. For example, the system implementation described above is only illustrative, for example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed.

[0066] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0067] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0068] The above descriptions are merely embodiments of the present application and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A lane remote management system, characterized in that: The lane remote management system comprises: At least one lane device terminal is provided with a streaming media acquisition module, a lane audio and video acquisition module, a lane visual intercom window and a lane audio module; The remote agent terminal is provided with a streaming media window, a remote audio and video acquisition module, a remote visual intercom window and a remote audio module, and a streaming media channel and a visual intercom channel are established between the remote agent terminal and the at least one lane device terminal; The remote agent terminal obtains a streaming media list through the streaming media channel, and in response to detecting a selection request for a target streaming media in the streaming media list, determines a target lane device terminal corresponding to the target streaming media from the at least one lane device terminal, and the target lane device terminal is used to visually map the service data stream collected by the streaming media collection module to the streaming media window of the remote agent terminal through the streaming media channel; The remote agent terminal also responds to the received visual intercom instruction and, based on the visual intercom channel, visually maps the remote video data collected by the remote audio and video collection module to the lane visual intercom window of the target lane device terminal, and maps the collected remote audio data to the lane audio module of the target lane device terminal; The target lane device side responds to the received visual intercom instruction and, based on the visual intercom channel, visually maps the lane video data collected by the lane audio and video collection module to the remote visual intercom window of the remote agent side, and maps the collected lane audio data to the remote audio module of the remote agent side; The remote agent terminal includes an intercom initiation switch and / or the lane equipment terminal includes an operation assistance switch; In response to determining that the intercom initiation switch is turned on, the remote agent sends the visual intercom instruction to the target lane device; In response to determining that the operation help switch is turned on, the target lane device sends the video intercom instruction to the remote agent terminal; The lane equipment end includes at least two lane visual intercom windows arranged at different heights, and the target lane equipment end is also used to switch the lane visual intercom window based on the vehicle height of the corresponding lane.

2. The lane remote management system according to claim 1, characterized in that: The streaming media acquisition module includes a video graphics array interface module and / or a high-definition multimedia interface module, the lane device end also includes a first data encoder, and the remote seat end also includes a channel switching processing module, a user input device receiving module and a first data decoder; The remote agent terminal detects whether the selection request for the target streaming media is received through the user input device receiving module, and after confirming that the selection request is received, sends the streaming media request to the target lane device terminal through the streaming media channel; In response to detecting the streaming media request, the target lane device receives the original streaming media data based on the video graphics array interface and / or the high-definition multimedia interface module, performs digital quantity conversion and service stream conversion on the original streaming media data to obtain the service data stream, and encodes the service data stream through the first data encoder to transmit the service data stream to the remote agent through the streaming media channel; In response to receiving the business data stream, the remote agent decodes the business data stream based on the first data decoder, and switches the decoded business data stream to the streaming media window based on the channel switching processing module to visually map the business data stream to the streaming media window.

3. The lane remote management system according to claim 1, characterized in that: The remote audio and video acquisition module includes a remote camera, a remote microphone, a second data encoder and a second data decoder, and the lane audio and video acquisition module includes a lane camera, a lane microphone and a third data encoder and a third data decoder; The remote camera is used to collect the remote video data, the remote microphone is used to collect the remote audio data, the second data encoder is used to encode the remote video data and the remote audio data, and transmit the encoded remote video data and the remote audio data to the third data decoder of the target lane device through the visual intercom channel, and the third data decoder is used to decode the received encoded remote video data and the remote audio data to visually map the remote video data to the lane visual intercom window, and visually map the remote audio data to the lane audio module; The lane camera is used to collect the lane video data, the lane microphone is used to collect the lane audio data, the third data encoder is used to encode the lane video data and the lane audio data, and transmit the encoded lane video data and the lane audio data to the second data decoder of the remote seat through the visual intercom channel, and the second data decoder is used to decode the received encoded lane video data and the lane audio data to visually map the lane video data to the remote visual intercom window, and visually map the lane audio data to the remote audio module.

4. The lane remote management system according to claim 1, characterized in that: The remote agent end includes a first algorithm module, and the lane device end includes a second algorithm module; The first algorithm module is used to perform noise reduction processing on the remote video data and the remote audio data based on a first preset noise reduction algorithm, and to perform noise elimination processing on the remote video data and the remote audio data based on a first preset echo elimination algorithm; The second algorithm module is used to perform noise reduction processing on the lane video data and the lane audio data based on a second preset noise reduction algorithm, and to perform noise elimination processing on the lane video data and the lane audio data based on a second preset echo elimination algorithm.

5. The lane remote management system according to claim 1, characterized in that: The remote seat end is also provided with a remote self-drawing window, and the lane device end is also provided with a lane self-drawing window; The remote agent terminal is also used to map the remote video data collected by the remote audio and video collection module to the remote self-drawing window; The target lane device end is also used to map the lane video data collected by the lane audio and video collection module to the lane self-drawing window.

6. The lane remote management system according to claim 1, characterized in that: The lane remote management system also includes a central server; The central server is connected to the remote agent terminal and the lane device terminal respectively, and is used to detect the operating status of the remote agent terminal and the lane device terminal and provide functional services; In response to determining that the operating state of the remote agent terminal and / or the target lane device terminal does not meet the preset visual intercom condition, the central server turns off the video acquisition function service of the remote audio and video acquisition module and the lane audio and video acquisition module, and only retains the audio acquisition function service of the remote audio and video acquisition module and the lane audio and video acquisition module, so as to switch the visual intercom between the remote agent terminal and the target lane device terminal to voice intercom; or In response to determining that the operating status of the remote agent terminal and / or the target lane equipment terminal does not meet the preset video intercom conditions, the central server closes the video intercom channel and establishes a voice intercom channel between the remote agent terminal and the lane equipment terminal based on Internet telephone technology.

7. The lane remote management system according to claim 1, characterized in that: The streaming media channel is established based on a real-time messaging protocol, and the visual intercom channel is established based on a web page real-time communication technology.

8. The lane remote management system according to claim 1, characterized in that: The lane equipment end also includes a hardware control video box, and the remote seat end also includes a remote desktop player; The hardware-controlled video box is used to store the service data stream, and in response to receiving a play instruction issued by the remote desktop player through the streaming channel, sends the service data stream to the remote desktop player based on a highly compressed digital video codec standard; In response to receiving a play request triggered by the streaming media window, the remote desktop player visually plays the business data stream in the streaming media window.

Images