Efficient forwarding video code stream transmission method based on cross-domain direct connection

Abstract

The invention discloses an efficient forwarding video code stream transmission method based on cross-domain direct connection, which relates to the technical field of video code stream forwarding transmission, and comprises the following specific steps: S1, a superior domain client issues a playing request signaling to superior domain signaling service, the superior domain signaling service adds an efficient forwarding strategy parameter after receiving a playing message, and the efficient forwarding strategy parameter is sent to the superior domain client; the signaling service is issued to a lower-level domain; s2, after receiving the playing request, the subordinate domain signaling service analyzes the efficient forwarding strategy parameter and issues the playing request to the front-end equipment; s3, the front-end equipment replies a response result after receiving the playing request message; and stream pushing is started to the requester after the ack message of the superior domain is received. According to the efficient forwarding video code stream transmission method based on cross-domain direct connection, the problem that video picture playing delay is large under the multi-domain condition is effectively solved, meanwhile, the streaming media pressure of an upper-level networking platform is reduced, and the effect is more remarkable especially in a multi-domain video networking platform cascade scene. The algorithm is simple, easy to understand and wide in application range.

Description

Technical Field

[0001] The present invention relates to the technical field of video code stream forwarding transmission, and in particular to a method for efficiently forwarding video code stream transmission based on cross-domain direct connection. Background Art

[0002] New technologies such as the Internet of Things, cloud computing, big data, and AI are gradually emerging and being applied to the security industry. The networking application of public security video surveillance construction will provide basic information for more in-depth video-based applications, continuously promote social management innovation, and have important strategic significance; under the national strategy of new "smart city" + new infrastructure, as the most intuitive, effective, and real-time monitoring method, audio and video data is one of the most important data supports for various upper-level AI practical application systems built by various industries and departments of the government / civilian society.

[0003] In the actual business scenarios of various departments, achieving cross-domain video interconnection and interoperability is a relatively common application; to achieve interoperability of video streams, taking the two-level (district / city) domain as an example, the district and county front-end video streams are usually pushed to the district and county video networking platform streaming media, the district and county video networking platform streaming media is pushed to the municipal networking platform streaming media, and then the municipal networking platform streaming media is pushed to the municipal client for playback.

[0004] The existing forwarding transmission method still has the following shortcomings:

[0005] 1. In the cascade scenario of multi-domain video networking platforms, when the upper-level domain client views the video, the client plays the video with a large delay;

[0006] 2. In the cascade scenario of multiple domain video networking platforms, when the upper-level domain client calls up and plays the video, since the upper-level domain video networking platform aggregates and accesses multiple parallel lower-level domain video networking platforms, the media module of the upper-level domain networking platform is under great forwarding pressure. At the same time, the network between the lower-level domain and upper-level domain streaming media is prone to network congestion problems.

[0007] Therefore, an efficient method for forwarding video stream transmission is particularly important, because this method adopts a cross-level direct connection method. After the district and county video networking platform receives the video playback request signaling from the municipal video networking platform, it generates a stream retrieval URL and pushes it to the municipal client via the municipal signaling module; the municipal client calls the stream retrieval URL, and the front-end video stream is directly pushed to the municipal client via the district and county networking platform streaming media module. Since the video stream does not pass through the streaming media module of the municipal networking platform, the video stream transmission time is greatly reduced, and the streaming media service pressure of the municipal networking platform is also reduced, shortening the delay time of the municipal client playing the video picture, and improving the user experience. Summary of the invention

[0008] In view of the deficiencies in the prior art, the present invention provides a method for efficiently forwarding video code stream transmission based on cross-domain direct connection, which solves the problems raised in the above background technology.

[0009] To achieve the above objectives, the present invention is implemented through the following technical solutions: a method for efficiently forwarding video stream transmission based on cross-domain direct connection, comprising the following specific steps:

[0010] S1. The upper-level domain client sends the play request signaling to the upper-level domain signaling service. After receiving the play message, the upper-level domain signaling service adds efficient forwarding strategy parameters and sends it to the signaling service of the lower-level domain.

[0011] S2. After receiving the play request, the lower-level domain signaling service parses the efficient forwarding strategy parameters and sends the play request to the front-end device;

[0012] S3: The front-end device replies with a response result after receiving the playback request message; after receiving the ack message from the upper-level domain, it starts to push the stream to the requester and pushes it to the streaming media service in the lower-level domain;

[0013] S4. After receiving the successful response message from the front-end device, the domain notifies the streaming service; the streaming service sets the encoding format and generates the stream acquisition URL according to the efficient forwarding strategy parameters, and pushes the stream acquisition URL to the signaling service;

[0014] S5. After receiving the stream acquisition URL, the lower-level domain signaling service pushes the stream acquisition URL to the upper-level domain client via the upper-level domain signaling service;

[0015] S6. After receiving the stream acquisition URL, the upper-level domain client starts to play the video. The lower-level domain streaming media service directly pushes the received video code stream to the upper-level domain client for playback without passing through the upper-level domain streaming media service.

[0016] An efficient forwarding video code stream transmission method based on cross-domain direct connection, the lower-level domain adopts a video networking platform, and the upper-level domain adopts one of the platforms other than the lower-level domain. The specific process is as follows:

[0017] Step 1: Initialization. The process is as follows:

[0018] (1) Read service configuration information and efficient forwarding strategy information;

[0019] (2) Load basic data;

[0020] (3) Initialize the protocol stack; add the lower-level domain information to the management queue and start the lower-level domain management thread according to the configuration parameters;

[0021] (4) Establish communication with the lower-level domain; obtain lower-level domain information from the management queue loop, set the message callback function, connect to the lower-level domain, and create a signaling communication link;

[0022] (5) Start the signaling message monitoring thread to monitor various types of on-demand control messages issued by the local domain and the upper-level domain;

[0023] (6) Start the protocol stack processing thread and receive control messages sent by the local domain and the upper-level domain;

[0024] Step 2: Receive and process local and external domain control messages;

[0025] Step 3: Send a control request message to the lower-level domain. The process is as follows:

[0026] (1) Start the lower-level domain processing business thread;

[0027] (2) Get the control message from the message queue; if there is no message in the queue, wait for the next time interval to continue reading; if there is a message, execute step (3);

[0028] (3) Read control messages and parse message data to obtain live, playback, download and other types of messages;

[0029] (4) Determine whether there is corresponding lower-level domain link information based on the domain ID in the message. If yes, execute step (5); otherwise, return and continue to execute step (2);

[0030] (5) Deliver the request control message to the protocol stack, which sends it to the corresponding lower-level domain based on the lower-level domain link information;

[0031] Step 4: Generate a stream URL. The process is as follows:

[0032] (1) Receive a response message from a lower-level domain;

[0033] (2) Determine whether the response result indicates that the request is successful; if the request is successful, execute step (3); if the request fails, execute step (1);

[0034] (3) Parse the request control message and notify the streaming service; the streaming service opens the receiving port to receive the media stream of the lower-level domain; according to the request efficient forwarding strategy parameters, the video stream is converted into the corresponding format according to the configuration parameters, and the stream acquisition URL is generated;

[0035] (4) The streaming service pushes the generated URL to the signaling service, which then pushes it to the parent domain;

[0036] (5) After receiving the stream URL, the upper-level domain pushes it to the client. The upper-level domain client requests the stream URL, and the lower-level domain networking platform directly pushes the video stream to the upper-level domain client without passing through the upper-level domain streaming media.

[0037] Optionally, the service configuration information in step 1 includes an IP address, a listening port, authentication information, a heartbeat detection strategy, and a reporting frequency.

[0038] Optionally, the efficient forwarding strategy in step 1 includes an enable flag, a user ID, user permissions, and URL flow fetching rules.

[0039] Optionally, the basic data in step 1 includes lower-level domain information, and the lower-level domain includes a platform or a front-end device; the platform or front-end device information includes a platform code, a domain name, authentication information, a signaling transmission protocol, and a media transmission protocol.

[0040] Optionally, the process of receiving and processing local domain and external domain control messages is as follows:

[0041] (1) Start the signaling message monitoring thread to receive control signaling; start the business processing thread;

[0042] (2) Parse the control signaling, determine whether the message type is correct, and execute step (3) correctly;

[0043] (3) Deliver the message to the corresponding message cache queue according to the message type; the message includes query type, notification type and control type message;

[0044] (4) Start the business processing thread; read the message from the message cache queue, determine whether the message type is a request from the local domain or a request from the upper-level domain, and execute step (5) for the request from the local domain and step (6) for the request from the upper-level domain;

[0045] (5) Parsing message data;

[0046] (6) Parse the message data to obtain cross-level stream information, including playback type flag, video encoding format, stream protocol, etc.;

[0047] (7) Assemble into a unified request control message and deliver it to the efficient forwarding business processing thread.

[0048] Optionally, if the message type is judged to be an error in step (2), step (1) is executed.

[0049] Optionally, the message data in step (5) includes target IP, port, media transmission protocol, audio and video switch, user information, user level, and path.

[0050] The present invention provides a method for efficiently forwarding video code stream transmission based on cross-domain direct connection, which has the following beneficial effects:

[0051] This efficient forwarding video code stream transmission method based on cross-domain direct connection is applied to the cascade scenario of multi-domain video networking platform. The upper-level client reads the video and plays it. Through the cross-domain direct connection and stream acquisition technology, the forwarding of media stream forwarding nodes is reduced, especially in the cascade scenario of multi-domain video networking platform, the effect is more obvious.

[0052] When multi-domain video is being reviewed, the lower-level domain video networking platform directly pushes the video code stream to the upper-level domain client through signaling control and setting of efficient forwarding strategies, without passing through the upper-level domain video networking platform media module, thus reducing the forwarding pressure of the upper-level domain video networking platform media module. At the same time, through cross-level direct connection to obtain the stream, the network bandwidth occupation between the upper-level domain streaming media and the lower-level streaming media is reasonably and effectively reduced, ensuring smooth video transmission.

[0053] The signaling module of the video networking platform adds protocol adaptation for control signaling. The streaming media module of the lower-level domain converts the real-time transport protocol RTP into the real-time streaming protocols RTSP, FLV, and HLS, generates a streaming URL and pushes it to the client of the upper-level domain. The client of the upper-level domain can directly pull the streaming media data of the lower-level domain for playback through the streaming URL without being forwarded by the streaming media module of the upper-level domain.

[0054] The signaling module of the networking platform adds signaling trigger source identification and judgment. The signaling comes from the request of the upper domain, adds efficient forwarding strategy configuration information, and sends the signaling to the lower platform; receives the stream acquisition URL responded by the lower platform and pushes it to the upper domain networking platform, so that the lower domain video code stream does not pass through the media module of the networking platform of this domain, but is directly pushed to the upper domain networking platform;

[0055] In the cascade scenario of multi-domain video networking platforms, when the upper-level domain video is reviewed, the delay of video playback on the client is effectively reduced, and the user experience effect is improved. In the cascade scenario of multi-domain video networking platforms, the forwarding pressure of the media module of the upper-level domain networking platform is effectively reduced, and the network bandwidth between the media module of the upper-level domain networking platform and the media module of the lower-level domain networking platform is reasonably and effectively reduced to ensure smooth video transmission. BRIEF DESCRIPTION OF THE DRAWINGS

[0056] Figure 1 This is a flow chart of the cross-domain direct connection flow acquisition service in the invention;

[0057] Figure 2 Initialize the business process diagram in the invention;

[0058] Figure 3 A flowchart of receiving and processing upper domain signaling services in the present invention;

[0059] Figure 4 It is a flowchart of the business process of the lower-level domain in the invention;

[0060] Figure 5Generate a business process diagram for obtaining the stream URL in the present invention. DETAILED DESCRIPTION

[0061] The technical solutions in the embodiments of the present invention will be described clearly and completely below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all the embodiments.

[0062] like Figure 1 As shown, a method for efficiently forwarding video code stream transmission based on cross-domain direct connection includes the following specific steps:

[0063] S1. The upper-level domain client sends the play request signaling to the upper-level domain signaling service. After receiving the play message, the upper-level domain signaling service adds efficient forwarding strategy parameters and sends it to the signaling service of the lower-level domain.

[0064] S2. After receiving the play request, the lower-level domain signaling service parses the efficient forwarding strategy parameters and sends the play request to the front-end device;

[0065] S3: The front-end device replies with a response result after receiving the playback request message; after receiving the ack message from the upper-level domain, it starts to push the stream to the requester and pushes it to the streaming media service in the lower-level domain;

[0066] S4. After receiving the successful response message from the front-end device, the domain notifies the streaming service; the streaming service sets the encoding format and generates the stream acquisition URL according to the efficient forwarding strategy parameters, and pushes the stream acquisition URL to the signaling service;

[0067] S5. After receiving the stream acquisition URL, the lower-level domain signaling service pushes the stream acquisition URL to the upper-level domain client via the upper-level domain signaling service;

[0068] S6. After receiving the stream acquisition URL, the upper-level domain client starts to play the video. The lower-level domain streaming media service directly pushes the received video code stream to the upper-level domain client for playback without passing through the upper-level domain streaming media service.

[0069] The video networking platform can be used as a parent domain or a child domain. The following example uses the video networking platform as a child domain and other networking platforms as parent domains. For the main business functions, the detailed implementation steps are as follows:

[0070] The specific process is as follows:

[0071] Step 1, initialization, such as Figure 2 As shown, the process is as follows:

[0072] (1) Read service configuration information and efficient forwarding strategy information; service configuration information includes IP address, listening port, authentication information, heartbeat detection strategy, reporting frequency, etc.; efficient forwarding strategy includes enable flag, user ID, user authority, URL flow rules, etc.;

[0073] (2) Loading basic data; the data includes lower-level domain information, which includes platform or front-end equipment; platform or front-end equipment information includes platform code, domain name, authentication information, signaling transmission protocol, media transmission protocol, etc.;

[0074] (3) Initialize the protocol stack; add the lower-level domain information to the management queue and start the lower-level domain management thread according to the configuration parameters;

[0075] (4) Establish communication with the lower-level domain; obtain lower-level domain information from the management queue loop, set the message callback function, connect to the lower-level domain, and create a signaling communication link;

[0076] (5) Start the signaling message monitoring thread to monitor various on-demand control messages issued by the local domain and the upper-level domain;

[0077] (6) Start the protocol stack processing thread and receive control messages sent by the local domain and the upper-level domain;

[0078] Step 2: Receive and process local and external domain control messages, such as Figure 3 As shown, the process is as follows:

[0079] (1) Start the signaling message monitoring thread to receive control signaling; start the business processing thread;

[0080] (2) Parse the control signaling and determine whether the message type is correct. If it is correct, execute step (3); if it is wrong, execute step (1);

[0081] (3) Deliver the message to the corresponding message cache queue according to the message type; the message includes query type, notification type and control type message;

[0082] (4) Start the business processing thread; read the message from the message cache queue, determine whether the message type is a request from the local domain or a request from the upper-level domain, execute step (5) for the local domain request, and execute step (6) for the upper-level domain request;

[0083] (5) Parse the message data to obtain information such as the target IP, port, media transmission protocol, audio and video switch, user information, user level, path, etc.;

[0084] (6) Parse the message data to obtain cross-level stream information, including playback type flag, video encoding format, stream protocol, etc.;

[0085] (7) Assemble into a unified request control message and deliver it to the efficient forwarding business processing thread;

[0086] Step 3: Send a control request message to the lower-level domain. Figure 4 As shown, the process is as follows:

[0087] (1) Start the lower-level domain processing business thread;

[0088] (2) Get the control message from the message queue; if there is no message in the queue, wait for the next time interval to continue reading; if there is a message, execute step (3);

[0089] (3) Read control messages and parse message data to obtain live, playback, download and other types of messages;

[0090] (4) Determine whether there is corresponding lower-level domain link information based on the domain ID in the message. If yes, execute step (5); otherwise, return and continue to execute step (2);

[0091] (5) Deliver the request control message to the protocol stack, which sends it to the corresponding lower-level domain based on the lower-level domain link information;

[0092] Step 4: Generate a stream URL, such as Figure 5 As shown, the process is as follows:

[0093] (1) Receive a response message from a lower-level domain;

[0094] (2) Determine whether the response result indicates that the request is successful; if the request is successful, execute step (3); if the request fails, execute step (1);

[0095] (3) Parse the request control message and notify the streaming service; the streaming service opens the receiving port to receive the media code stream of the lower-level domain; according to the request efficient forwarding strategy parameters, the video code stream is converted into the corresponding format according to the configuration parameters, and the stream acquisition URL is generated;

[0096] (4) The streaming service pushes the generated URL to the signaling service, which then pushes it to the parent domain;

[0097] (5) After receiving the stream URL, the upper-level domain pushes it to the client. The upper-level domain client requests the stream URL, and the lower-level domain networking platform directly pushes the video stream to the upper-level domain client without passing through the upper-level domain streaming media.

[0098] Conclusion: By adding specific stream fetching rule information to the on-demand signaling and sending it to the lower-level domain video networking platform, the lower-level domain networking platform parses the stream fetching rule information after receiving the playback signaling, and then provides a stream fetching URL that meets the rules and pushes it to the upper-level domain networking platform. The upper-level domain networking platform obtains the stream fetching URL and pushes it to the client. The client can use the stream fetching URL to directly pull the stream from the lower-level domain networking platform for playback, without forwarding it through the streaming media service of the current domain networking platform, thereby realizing an efficient forwarding video stream transmission method based on cross-domain direct connection.

[0099] The above description is only a preferred specific implementation manner of the present invention, but the protection scope of the present invention is not limited thereto. Any technician familiar with the technical field can make equivalent replacements or changes according to the technical scheme and inventive concept of the present invention within the technical scope disclosed by the present invention, which should be covered by the protection scope of the present invention.

Claims

1. A method for efficiently forwarding video stream transmission based on cross-domain direct connection, characterized in that: The specific steps include: S1. The upper-level domain client sends the play request signaling to the upper-level domain signaling service. After receiving the play message, the upper-level domain signaling service adds efficient forwarding strategy parameters and sends it to the signaling service of the lower-level domain. S2. After receiving the play request, the lower-level domain signaling service parses the efficient forwarding strategy parameters and sends the play request to the front-end device; S3, the front-end device replies with a response result after receiving the play request message; After receiving the ACK message from the upper-level domain, it starts to push the stream to the requester and pushes it to the streaming media service in the lower-level domain; S4. After receiving the successful response message from the front-end device, the domain notifies the streaming media service; The streaming service sets the encoding format and generates a streaming URL according to the efficient forwarding strategy parameters, and pushes the streaming URL to the signaling service; S5. After receiving the stream acquisition URL, the lower-level domain signaling service pushes the stream acquisition URL to the upper-level domain client via the upper-level domain signaling service; S6. After receiving the stream acquisition URL, the upper-level domain client starts to play the video. The lower-level domain streaming media service directly pushes the received video code stream to the upper-level domain client for playback without passing through the upper-level domain streaming media service.

2. According to claim 1, a highly efficient forwarding video code stream transmission method based on cross-domain direct connection is characterized in that: The lower-level domain adopts the video networking platform, and the upper-level domain adopts one of the other platforms except the lower-level domain. The specific process is as follows: Step 1: Initialization. The process is as follows: (1) Read service configuration information and efficient forwarding strategy information; (2) Load basic data; (3) Initialize the protocol stack; add the lower-level domain information to the management queue and start the lower-level domain management thread according to the configuration parameters; (4) Establish communication with the lower-level domain; obtain lower-level domain information from the management queue loop, set the message callback function, connect to the lower-level domain, and create a signaling communication link; (5) Start the signaling message monitoring thread to monitor various types of on-demand control messages issued by the local domain and the upper-level domain; (6) Start the protocol stack processing thread and receive control messages sent by the local domain and the upper-level domain; Step 2: Receive and process local and external domain control messages; Step 3: Send a control request message to the lower-level domain. The process is as follows: (1) Start the lower-level domain processing business thread; (2) Obtain control messages from the message queue; if there are no messages in the queue, wait for the next time interval to continue reading; if there are messages, execute step (3); (3) Read control messages and parse message data to obtain live, playback, and download messages; (4) Determine whether there is corresponding lower-level domain link information based on the domain ID in the message; if yes, execute step (5); if no, return and continue to execute step (2); (5) Deliver the request control message to the protocol stack, which sends it to the corresponding lower-level domain based on the lower-level domain link information; Step 4: Generate a stream acquisition URL. The process is as follows: (1) Receive a response message from a lower-level domain; (2) Determine whether the response result indicates that the request is successful; if the request is successful, execute step (3); if the request fails, execute step (1); (3) Parse the request control message and notify the streaming media service; the streaming media service opens the receiving port to receive the lower-level domain media code stream; According to the request efficient forwarding strategy parameters, the video stream is converted into the corresponding format according to the configuration parameters, and the stream acquisition URL is generated at the same time; (4) The streaming service pushes the generated URL to the signaling service, which then pushes it to the parent domain; (5) After receiving the stream URL, the upper-level domain pushes it to the client. The upper-level domain client requests the stream URL, and the lower-level domain networking platform directly pushes the video stream to the upper-level domain client without passing through the upper-level domain streaming media.

3. According to claim 1, a highly efficient forwarding video code stream transmission method based on cross-domain direct connection is characterized in that: The service configuration information in step 1 includes IP address, listening port, authentication information, heartbeat detection strategy, and reporting frequency.

4. According to claim 1, a highly efficient forwarding video code stream transmission method based on cross-domain direct connection is characterized in that: The efficient forwarding strategy in step 1 includes an enable flag, a user ID, user permissions, and URL flow fetching rules.

5. According to claim 1, a highly efficient forwarding video code stream transmission method based on cross-domain direct connection is characterized in that: The basic data in step 1 includes lower-level domain information, and the lower-level domain includes a platform or a front-end device; the platform or front-end device information includes a platform code, a domain name, authentication information, a signaling transmission protocol, and a media transmission protocol.

6. According to claim 1, a highly efficient forwarding video code stream transmission method based on cross-domain direct connection is characterized in that: The process of receiving and processing local domain and external domain control messages is as follows: (1) Start the signaling message monitoring thread to receive control signaling; start the business processing thread; (2) Parse the control signaling, determine whether the message type is correct, and execute step (3) correctly; (3) Deliver the message to the corresponding message cache queue according to the message type; the message includes query type, notification type and control type message; (4) Start the business processing thread; read the message from the message cache queue, determine whether the message type is a request from the local domain or a request from the upper-level domain, and execute step (5) for the request from the local domain and step (6) for the request from the upper-level domain; (5) Parsing message data; (6) Parse the message data to obtain cross-level stream information, including playback type flag, video encoding format, and stream protocol; (7) Assemble into a unified request control message and deliver it to the efficient forwarding business processing thread.

7. The method for efficiently forwarding video stream transmission based on cross-domain direct connection according to claim 6 is characterized in that: If the message type is judged to be an error in step (2), step (1) is executed.

8. The method for efficiently forwarding video stream transmission based on cross-domain direct connection according to claim 6 is characterized in that: The message data in step (5) includes target IP, port, media transmission protocol, audio and video switch, user information, user level, and path.

Images