Cross-regional equipment networking system and method

Abstract

The invention provides a cross-regional device networking system and method. The system comprises a system server, a main gateway arranged on the system server, a plurality of terminal devices, a plurality of client devices, a Coturn server, a local area network switch and a plurality of Webrtc edge gateways. The terminal equipment is connected with the system server through the local area network switch or is connected with the system server through the Webrtc edge gateway; the client device and the Coturn server are respectively connected with the system server, and external network access of videos is provided through the Coturn server; the Webrtc edge gateway comprises a soft routing module, a VPN (Virtual Private Network) networking module and a Webrtc video module; the system server comprises a video monitoring module and a Webrtc video module, the Webrtc video module provides video playing service for the client, and the Coturn server provides an intranet direct connection mode, a P2P mode or a relay mode for path optimization transparent playing. According to the invention, low-cost cross-regional networking can be realized, high-efficiency video access is realized, and various equipment access systems are compatible.

Description

Technical Field

[0001] The present invention relates to the field of communication technology, and in particular to a cross-regional device networking system and method. Background Art

[0002] Digital parks are the product of the digital society. Based on the application of digital technology and artificial intelligence technology, they penetrate into all business activities of industrial parks, including production operations, park management and operations, workplace personnel services, etc. The core of digital parks is to use advanced information technology and communication networks to build a complete digital infrastructure to achieve efficient resource management and intelligent services.

[0003] The traditional way of networking a digital park is to set up a local area network system in one park, which is mainly used to access access control equipment and video surveillance equipment to supervise the park. In addition, the video surveillance data outside the park cannot be accessed across parks. In the traditional network configuration, if remote access to video data is required, it is usually necessary to rent a DDN (digital data network) dedicated line or frame relay. Such a communication solution will inevitably lead to high network communication and maintenance costs. Summary of the invention

[0004] The technical problem to be solved by the present invention is to provide a cross-regional device networking system and method to overcome the problems of high existing networking costs, incompatible devices, etc.

[0005] In a first aspect, the present invention provides a cross-region device networking system, including a system server, a main gateway disposed on the system server, a plurality of terminal devices, a plurality of client devices, a Coturn server, a local area network switch and a plurality of WebRTC edge gateways;

[0006] Among them, the terminal equipment of the local park is connected to the main gateway of the system server through the LAN switch, and the terminal equipment of each remote park is connected to the main gateway of the system server through a Webrtc edge gateway;

[0007] The client device and the Coturn server are respectively connected to the system server, and the Coturn server provides extranet access to the video;

[0008] The Webrtc edge gateway includes a soft routing module, a VPN networking module and a Webrtc video module; the soft routing module is used to provide intranet IP allocation for terminal devices and realize docking with the main gateway of the system server, the VPN networking module is used to realize VPN networking, and the system server includes a video monitoring module and a Webrtc video module, and the video monitoring module is used to connect the surveillance cameras of each park to the system server and obtain video monitoring data;

[0009] The Webrtc video module is used to provide video playback services for the client, and the Coturn server provides an intranet direct connection, a P2P method or a relay method to optimize the path and transparently transmit the final video access.

[0010] Furthermore, the local park deploys a webrtc cluster through a local server, or builds a webrtc server cluster across parks, or builds a webrtc gateway cluster through a webrtc edge gateway across parks.

[0011] Furthermore, the system server also includes a device gateway module, which is used to set the intranet IP address access method, device active registration access method, MQTT access method, GB28181 access method, domain name access method, Onvif access method and Pass access method.

[0012] Furthermore, the system server is configured as a cloud server or a local server in any park.

[0013] Furthermore, the system server also includes a parking management module, an access control management module, a networking module, an attendance module, an enterprise department personnel management module, a visitor management module and a canteen management module;

[0014] The parking management module is used for identifying vehicles and parking charges, the access control management module is used for access control through face, fingerprint or access control card, the networking module is used to connect various terminal devices to the system, the attendance module is used for attendance management of staff, the enterprise department personnel management module is used for information entry and authority allocation management of enterprise department personnel, the visitor management module is used to register visitors, and the canteen management module is used to manage menus and inventory and integrate payment systems.

[0015] Furthermore, the terminal equipment includes access control equipment, cameras for video surveillance, parking lot management equipment, network conversion equipment and dynamic environment detection equipment.

[0016] In a second aspect, the present invention provides a cross-regional device networking method, which needs to provide a cross-regional device networking system as described in the first aspect, and the method includes a video playback process:

[0017] Log into the park system;

[0018] The coturn server determines whether it belongs to the intranet access. If so, it directly connects to the corresponding camera in the LAN through the webrtc service for real-time playback. Otherwise, it tries to connect to the webrtc edge gateway in a point-to-point manner through P2P. If the connection is successful, the corresponding intranet camera or cross-campus camera is obtained for real-time playback. If the P2P point-to-point connection fails, the video is transferred through the coturn server, and then the corresponding intranet camera or cross-campus camera is obtained through the webrtc edge gateway for real-time playback.

[0019] Furthermore, when registering the camera, the intranet IP address access method, the active registration access method, the GB28181 access method or the Onvif access method is used to register with the system server.

[0020] The advantages of the present invention are:

[0021] 1. The present invention can realize the access of one system to remote devices in multiple parks, and can also network the systems of multiple remote parks into one system platform for access, so as to realize unified management across parks;

[0022] 2. The networking terminal of the present invention can be a privately deployed internal server or a cloud server. The VPN network or SD-WAN network is built by the software system. The networking method is simple, no dedicated line or network is required, and the networking cost and operation and maintenance cost are low and efficient.

[0023] 3. Use Webrtc to implement distributed cluster applications. The networking only requires a fixed IP for the platform. There is no special strict requirement for the network. The hardware is end-to-end networked and does not pick devices. As long as it can be converted into tcp / udp / kcp / quic / http / https / stcp / sudp protocol, it can be networked and accessed. The system is compatible with LAN, active registration, MQTT, self-built networking equipment docking, and can also be docked with other serial port devices to achieve unified control of various devices.

[0024] 4. Adaptive video networking access: If the visitor accesses the video in the campus LAN, the LAN link will be automatically selected. If the external network is accessed, the link will be automatically accessed through the coturn relay or P2P access link, achieving the best video streaming experience without the user's awareness. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] The present invention will be further described below in conjunction with embodiments with reference to the accompanying drawings.

[0026] Figure 1 The present invention is a structural block diagram of a cross-regional equipment networking system.

[0027] Figure 2 The present invention is a flowchart of an execution of a cross-region device networking method. DETAILED DESCRIPTION

[0028] The embodiments of the present application provide a cross-regional device networking system and method, which are mainly used to solve the problem of high existing networking costs, while being able to meet the access and management needs of different devices and unified management and control of different types of devices.

[0029] In order to better understand the technical solution of the present invention, the above technical solution will be described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0030] Embodiment 1

[0031] like Figure 1 , this embodiment provides a cross-region device networking system, including a system server, a main gateway set on the system server, a plurality of terminal devices, a plurality of client devices, a Coturn server, a local area network switch and a plurality of Webrtc edge gateways;

[0032] Among them, the terminal equipment of the local park is connected to the main gateway of the system server through the LAN switch, and the terminal equipment of each remote park is connected to the main gateway of the system server through a Webrtc edge gateway;

[0033] The client device and the Coturn server are respectively connected to the system server, and the Coturn server provides extranet access to the video;

[0034] The Webrtc edge gateway includes a soft routing module, a VPN networking module and a Webrtc video module; the soft routing module is used to provide terminal equipment intranet IP allocation and realize docking with the main gateway of the system server, the VPN networking module is used to realize VPN networking, and the system server includes a video monitoring module and a Webrtc video module, and the video monitoring module is used to connect the monitoring cameras of each park to the system server and obtain video monitoring data; the Webrtc edge gateway of the present invention is different from the conventional edge gateway. The functions of the conventional edge gateway are concentrated in the server, and the server does the work of the edge gateway. The present invention miniaturizes the equipment and directly deploys it in the front of the project, which can realize local processing, speed up the corresponding capacity, avoid the hidden dangers of network instability, and realize the access of remote parks and the Webrtc video viewing function through the connection between the Webrtc edge gateway of the present invention and the main gateway.

[0035] The Webrtc video module is used to provide video playback services for the client, and the Coturn server provides an intranet direct connection, a P2P method or a relay method to optimize the path and transparently transmit the final video access.

[0036] Preferably, the local park deploys a webrtc cluster through a local server, or builds a webrtc server cluster across parks, or builds a webrtc gateway cluster across parks through a webrtc edge gateway. Specific combinations are selected according to project needs. For example, at the beginning of a project, one server webrtc + edge gateway integration is sufficient. Later, when the project concurrency increases, multiple webrtc clusters can be built through the local park. If the later project requires data security and high availability, a webrtc cluster can also be built across parks.

[0037] Preferably, the system server can be a cloud server or a local server in any park.

[0038] Preferably, the system server also includes a parking management module, a access control management module, a networking module, an attendance module, an enterprise department personnel management module, a visitor management module and a canteen management module; the system of the present invention also includes a self-developed elevator control module, an application market module, a housing management module, a dormitory management module, an intelligent media management module and a behavior management module, etc.

[0039] The parking management module is used for identifying vehicles and parking charges, the access control management module is used for access control through face, fingerprint or access control card, the networking module is used to connect various terminal devices to the system, the attendance module is used for attendance management of staff, the enterprise department personnel management module is used for information entry and authority allocation management of enterprise department personnel, the visitor management module is used to register visitors, and the canteen management module is used to manage menus and inventory and integrate payment systems.

[0040] Preferably, the system server also includes a gateway module, i.e., a device gateway module, which is used to set the intranet IP address access method, the device active registration access method, the MQTT access method, the GB28181 access method, the domain name access method, the Onvif access method, and the Pass access method. In the existing conventional networking, each park must pull a dedicated line and a fixed IP before access operations can be performed. In the present invention, the network access method is aggregated, and the protocol method is compatible with tcp / udp / kcp / quic / http / https / stcp / sudp, so that it can be compatible with different access methods on the market.

[0041] The access methods aggregated to the system server above are selected according to the specific project requirements to enable one or several access methods. The specific characteristics of each access method are as follows:

[0042] Intranet IP address access:

[0043] Description: In a LAN, the device communicates with the platform through the intranet IP address. This method is used when the device and platform are in the same LAN.

[0044] Advantages: Protected by network boundaries, low network latency.

[0045] Disadvantages: Not suitable for cross-network environments, devices can only be accessed within the same intranet.

[0046] Device active registration access:

[0047] Description: When the device starts, it will actively register with the access platform and send information such as device ID and device type. After the platform registers, the device is officially managed.

[0048] Advantages: Suitable for dynamic access, high flexibility, and the device can be used in various network environments.

[0049] Disadvantages: The device must have the active registration function, which is relatively complex.

[0050] MQTT access:

[0051] Description: Use the MQTT protocol for device access. MQTT is a lightweight publish / subscribe message transmission protocol suitable for resource-constrained devices and unstable network environments.

[0052] Advantages: low latency, low bandwidth consumption, suitable for concurrent access by a large number of devices.

[0053] Disadvantages: Requires support from MQTT server (Broker), and security depends on the implementation of the MQTT protocol.

[0054] GB28181 access:

[0055] Description: GB28181 is a Chinese national standard, mainly used for video surveillance equipment access platforms, and specifies communication protocols and interfaces.

[0056] Advantages: high degree of standardization, suitable for video surveillance field, good compatibility.

[0057] Disadvantages: Mainly used for video surveillance, support for other device types is limited, and configuration is relatively complex.

[0058] Domain name access:

[0059] Description: The device accesses the platform communication through the domain name, which is usually used in a cross-network environment. The IP address of the platform is found through DNS resolution.

[0060] Advantages: Suitable for wide area network environment, domain name is easy to remember and easy to manage.

[0061] Disadvantages: Depends on DNS service, with the risk of resolution delays and failures.

[0062] Onvif access:

[0063] Description: Use Onvif (Open Network Video Interface Forum) standard access, mainly used for interoperability of network video devices.

[0064] Advantages: high degree of standardization, suitable for video surveillance equipment, easy to interoperate.

[0065] Disadvantages: Mainly used for video devices, limited support for other devices, and complex standard implementation.

[0066] Pass access:

[0067] Description: Devices are connected to the platform in a transparent and direct way, usually for simple sensors or actuators.

[0068] Advantages: Simple implementation, the device communicates directly with the platform.

[0069] Disadvantages: single function, limited applicable scenarios, poor security and scalability.

[0070] These access methods have their own advantages and disadvantages. Choosing the appropriate access method needs to be determined based on the specific application scenario, device type, network environment, and security requirements.

[0071] The terminal equipment includes access control equipment, cameras for video surveillance, parking lot management equipment, network conversion equipment, dynamic environment detection equipment and other network equipment. The terminal equipment of the present invention basically covers the park Internet equipment (including equipment using wifi, wired, 4g) and non-networking equipment (such as equipment using rs232 interface), covering standard serial port equipment and non-standard serial port, such as temperature, water and electricity meters and other equipment.

[0072] In this embodiment, the LAN switch is set to a regular network function, the webrtc edge gateway is integrated with webrtc, the system server (cloud server or local server) is integrated with webrtc, and the main gateway is responsible for handling networking. For example, the main gateway is deployed on Alibaba Cloud to connect the webrtc edge gateway to realize the networking of the device and the Alibaba Cloud platform. The networking of devices on the market is limited to the local area network.

[0073] Embodiment 2

[0074] like Figure 2 As shown, the present invention provides a cross-region device networking method, the method comprising a video playback process:

[0075] Log into the campus system on the system server;

[0076] The coturn server determines whether it belongs to the intranet access. If so, it directly connects to the corresponding camera in the LAN through the webrtc service for real-time playback. Otherwise, it tries to connect to the webrtc edge gateway in a point-to-point manner through P2P. If the connection is successful, the corresponding intranet camera or cross-campus camera is obtained for real-time playback. If the P2P point-to-point connection fails, the video is transferred through the coturn server, and then the corresponding intranet camera or cross-campus camera is obtained through the webrtc edge gateway for real-time playback.

[0077] Specifically, based on the networking system of the present invention, the following three video access modes can be implemented:

[0078] Scenario A: Accessing the video in the LAN

[0079] The client device logs in to the campus system -> the coturn server determines that it is an intranet access -> through the server-side webrtc -> directly connects to the LAN camera for real-time playback;

[0080] Scenario b: Viewing intranet cameras or cameras across campuses on the Internet:

[0081] The client device logs in to the campus system -> the coturn server determines that it is an external network access -> tries to connect the user end to the webrtc edge gateway in a point-to-point manner through P2P -> connects to the intranet camera or the cross-campus camera for real-time playback;

[0082] Scenario c: Viewing intranet cameras or cameras across campuses on the Internet:

[0083] The client device logs in to the campus system -> the coturn server determines that it is an external network access -> the P2P attempt fails -> coturn uses the server-side video transfer method -> webrtc edge gateway -> connects to the intranet camera or the cross-campus camera for real-time playback.

[0084] Preferably, the camera is registered to the system server using the intranet IP address access method, active registration access method, GB28181 access method or Onvif access method. Generally, when the surveillance camera is registered and used with webrtc, the intranet IP address registration method or active registration method is used by default to access the system server. If the project requires the camera to be played online through GB28181 or Onvif, the server needs to build an additional streaming media related service system, which takes up a lot of resources.

[0085] The advantages of the present invention are:

[0086] 1. One system can access remote devices in multiple parks, and multiple remote park systems can be networked into one system platform for access (that is, a distributed server cluster);

[0087] 2. System unified scheduling of distributed clusters: For example, Webrtc implements distributed cluster applications. The networking only requires a fixed IP for the platform, and there are no special strict requirements for the network;

[0088] 3. The platform has unified management and operation, simple networking, low cost and high efficiency;

[0089] 4. Use hardware end-to-end networking. Any protocol that can be converted into TCP / UDP / KCP / QUIC / HTTP / HTTPS / STCP / SUDP can be connected to the network, which means that the device is not selected.

[0090] 5. The main end of the network can be a privately deployed internal server (such as the government network), or a cloud server (Alibaba Cloud, Tencent Cloud, Huawei Cloud, etc.), and a VPN private network or SD-WAN network can be built through the software system;

[0091] 6. Realize adaptive video networking access: If the visitor accesses the video in the campus LAN, the LAN link will be automatically selected. If the visitor accesses the video from the external network, the link will be automatically accessed through the coturn relay or P2P access link, so that the user can experience the best video stream without any feeling.

[0092] 7. The platform is compatible with LAN, active registration, MQTT, self-built networking equipment docking, and can also be connected to other serial port devices.

[0093] Although the specific implementation modes of the present invention are described above, those skilled in the art should understand that the specific implementation modes described are only illustrative and are not intended to limit the scope of the present invention. Equivalent modifications and changes made by those skilled in the art in accordance with the spirit of the present invention should be included in the scope of protection of the claims of the present invention.

Claims

1. A cross-regional equipment networking system, Features: It includes a system server, a main gateway set on the system server, a plurality of terminal devices, a plurality of client devices, a Coturn server, a local area network switch and a plurality of WebRTC edge gateways; Among them, the terminal equipment of the local park is connected to the main gateway of the system server through the LAN switch, and the terminal equipment of each remote park is connected to the main gateway of the system server through a Webrtc edge gateway; The client device and the Coturn server are respectively connected to the system server, and the Coturn server provides extranet access to the video; The Webrtc edge gateway includes a soft routing module, a VPN networking module and a Webrtc video module; the soft routing module is used to provide intranet IP allocation for terminal devices and realize docking with the main gateway of the system server, the VPN networking module is used to realize VPN networking, and the system server includes a video monitoring module and a Webrtc video module, and the video monitoring module is used to connect the surveillance cameras of each park to the system server and obtain video monitoring data; The Webrtc video module is used to provide video playback services for the client, and the Coturn server provides an intranet direct connection, a P2P method or a relay method to optimize the path and transparently transmit the final video access.

2. A cross-regional device networking system as claimed in claim 1, Features: The local campus deploys a webrtc cluster through a local server, or builds a webrtc server cluster across campuses, or builds a webrtc gateway cluster through a webrtc edge gateway across campuses.

3. A cross-regional device networking system as claimed in claim 1, Features: The system server also includes a device gateway module, which is used to set the intranet IP address access method, device active registration access method, MQTT access method, GB28181 access method, domain name access method, Onvif access method and Pass access method.

4. A cross-regional device networking system as claimed in claim 1, Features: The system server is configured as a cloud server or a local server in any park.

5. A cross-regional device networking system as claimed in claim 4, Features: The terminal equipment includes access control equipment, cameras for video surveillance, parking lot management equipment, network conversion equipment and dynamic environment detection equipment.

6. A cross-regional device networking system as claimed in claim 1, Features: The system server also includes a parking management module, an access control management module, a networking module, an attendance module, an enterprise department personnel management module, a visitor management module and a canteen management module; The parking management module is used for identifying vehicles and parking charges, the access control management module is used for access control through face, fingerprint or access control card, the networking module is used to connect various terminal devices to the system, the attendance module is used for attendance management of staff, the enterprise department personnel management module is used for information entry and authority allocation management of enterprise department personnel, the visitor management module is used to register visitors, and the canteen management module is used to manage menus and inventory and integrate payment systems.

7. A cross-regional device networking method, which requires providing a cross-regional device networking system as claimed in any one of claims 1 or 6, Features: The method includes a video playback process: Log into the park system; The coturn server determines whether it belongs to the intranet access. If so, it directly connects to the corresponding camera in the LAN through the webrtc service for real-time playback. Otherwise, it tries to connect to the webrtc edge gateway in a point-to-point manner through P2P. If the connection is successful, the corresponding intranet camera or cross-campus camera is obtained for real-time playback. If the P2P point-to-point connection fails, the video is transferred through the coturn server, and then the corresponding intranet camera or cross-campus camera is obtained through the webrtc edge gateway for real-time playback.

8. A cross-regional device networking method as claimed in claim 7, Features: When registering the camera, use the intranet IP address access method, active registration access method, GB28181 access method or Onvif access method to register to the system server.

Images