Video on demand system

Abstract

The application discloses a video on demand system, comprising an NVR storage device, a server control module and a client control platform, the server control module further comprises a protocol interaction unit, an NVR video information storage unit and a streaming media transcoding unit, the client control platform further comprises a client control unit and a client display unit, a user initiates NVR video on demand, the client control unit sends a request to the server control module, and video information is inquired first; the server control module receives the on demand inquiry request; the NVR storage device responds to the http request, the returned video information is stored in the NVR video information storage unit by the server control module, and the client control platform is informed of the inquired video information; the inquired video information is displayed on the client display unit, at this time, the user watches the interested fragment on demand and sets the watching demand, the watching demand is sent to the server control module through the client control unit, content interaction is carried out through SIP, and the request is analyzed by the SIP protocol interaction module.

Description

Technical Field

[0001] The invention belongs to the technical field of streaming media, and in particular relates to a video-on-demand system. Background Art

[0002] In the security monitoring industry, the combination of Network Video Recorder (NVR) and streaming media technology has become a major trend.

[0003] Traditional NVR devices are primarily used for local video storage and viewing. While this approach ensures high image quality and stability, it suffers from significant limitations in remote access and flexible control. However, with the increasing demand for mobile internet and remote monitoring, users require more flexible ways to access and manage video content. Modern surveillance systems require not only efficient storage and transmission capabilities, but also intelligent analysis and remote control capabilities to adapt to complex and ever-changing application scenarios. Traditional NVR devices perform poorly in terms of bandwidth utilization, latency control, and video quality optimization, making them unable to meet the demands of modern applications. Summary of the Invention

[0004] In view of the above problems, the present invention provides a video on demand system for improving remote access and control capabilities while further optimizing video transmission and viewing experience to meet the needs of security monitoring systems.

[0005] In order to solve the above technical problems, the present invention adopts the following technical solutions:

[0006] A video-on-demand system includes an NVR storage device, a server control module, and a client control platform. The server control module further includes a protocol interaction unit, an NVR video information storage unit, and a streaming media transcoding unit. The client control platform further includes a client control unit and a client display unit.

[0007] When a user initiates an NVR video on demand, the client control unit sends the request to the server control module, which first queries the video information and uses the Session Initiation Protocol (SIP) to interact with the video query request for the device or video channel of interest.

[0008] The server control module receives the on-demand query request, uses HTTP request to access the NVR storage device, and queries all video information; the NVR storage device responds to the HTTP request, and the returned video information is stored in the NVR video information storage unit by the server control module, and the queried video information is notified to the client control platform through the SIP protocol;

[0009] The queried video information is displayed on the client display unit, at this time the user on-demand watches the interested segment and sets the watching requirement, the watching requirement is sent to the server control module through the client control unit, the content interaction is carried out through SIP, and the request is analyzed by the SIP protocol interaction module;

[0010] The server control module generates a pull stream command according to the on-demand query request and the locally stored NVR video information, and the pull stream command is given to the stream media transcoding unit to pull the data of the NVR;

[0011] The stream media transcoding unit executes the pull stream command and interacts with the NVR storage device to pull the interested segment of the user;

[0012] The NVR storage device responds to the pull stream command and transmits data to the stream media transcoding unit, and the stream media transcoding unit processes the data,

[0013] The processed audio and video data is sent to the client display unit for display using a protocol supported by the client.

[0014] In a possible implementation, the processing of the data by the stream media transcoding unit includes: if the playing protocol of the playing end is inconsistent with the RTSP protocol supported by the NVR storage device, the stream media transcoding unit performs protocol conversion on the data.

[0015] In a possible implementation, the processing of the data by the stream media transcoding unit includes: performing operations such as text information superposition, picture content superposition, picture content modification, face and behavior recognition on the basis of original video frames.

[0016] In a possible implementation, the processing of the data by the stream media transcoding unit includes: in a low-bandwidth environment, re-compressing the video data, compressing the interested region at a low multiple, and compressing the uninterested region at a high multiple.

[0017] In a possible implementation, the processing of the data by the stream media transcoding unit includes: in the case of data delay or frequent data loss at the client, interacting with the server control module to control the stream media transcoding unit to perform operations such as blocking data loss, improving the compression level, and reducing the resolution.

[0018] In a possible implementation, the watching requirement includes at least one of the following: automatic adjustment of the code rate according to the network bandwidth, face recognition, abnormal behavior recognition, or text information superposition or picture content modification in transcoding.

[0019] In a possible implementation, the method further includes:

[0020] The client control unit sends a pause watching command to the server control module.

[0021] The server control module transmits the command to the streaming media transcoding unit. The streaming media transcoding unit acts as an agent and transmits the command to the NVR storage device through the RTSP protocol. The NVR storage device responds to the pause command and stops sending data.

[0022] The streaming media transcoding unit maintains a long link during the data transmission suspension phase and is ready to receive data at any time.

[0023] In a possible implementation, the method further includes:

[0024] The client control unit sends a speed viewing command to the server control module;

[0025] The server control module transmits the command to the streaming media transcoding unit, which acts as a proxy and transmits the command to the NVR storage device via the RTSP protocol;

[0026] The NVR storage device changes the speed of sending data and sends data at the specified speed.

[0027] In a possible implementation, the method further includes:

[0028] The client control unit sends a jump command to the server control module;

[0029] The server control module transmits the command to the streaming media transcoding unit, which acts as a proxy and transmits the command to the NVR storage device via the RTSP protocol;

[0030] The NVR storage device jumps to the specified file location to read and output data.

[0031] The present invention has the following beneficial effects:

[0032] (1) Users can remotely access and control the video content of the NVR storage device through the client display unit. The streaming media transcoding unit achieves efficient audio and video transmission, flexible on-demand control, and controllable content modification, meeting users' viewing needs under different network conditions.

[0033] (2) The streaming media transcoding unit of the server control module can automatically adjust the video encoding quality according to the current network conditions (or customer configuration), ensuring the best viewing experience under different network conditions. Whether it is high-definition playback with sufficient bandwidth or smooth playback under limited bandwidth, intelligent regulation can be achieved.

[0034] (3) The server control module is responsible for controlling the streaming media transcoding unit and protocol interaction, interacting with the NVR device and pulling data, ensuring the efficiency and stability of data transmission.

[0035] (4) The streaming media service module converts the processed data, and pushes the data to the client, so that the client can seamlessly receive and play the streaming media content, and the protocol compatibility between data transmission and user experience are improved. BRIEF DESCRIPTION OF DRAWINGS

[0036] Figure 1 The figure is a structural schematic diagram of the video on-demand system of an embodiment of the present application. DETAILED DESCRIPTION

[0037] The technical solutions in the embodiments of the present application will be clearly and completely described with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are some of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments in the present application, all the other embodiments obtained by those skilled in the art without creative work fall within the protection scope of the present application.

[0038] Reference is made to Figure 1, shown is a structural diagram of a video on demand system according to an embodiment of the present invention, comprising an NVR storage device 10, a server control module 20 and a client control platform 30, wherein the server control module 20 further comprises a protocol interaction unit 201, an NVR video information storage unit 202 and a streaming media transcoding unit 203, and the client control platform 30 further comprises a client control unit 301 and a client display unit 302. When a user initiates an NVR video on demand, the client control unit 301 sends the request to the server control module 20. Before the client initiates a video on demand to the server control module, it needs to know which channels and video clips are available, so it needs to perform a video query operation, first performing a video information query, wherein the video information refers to the video files of each camera stored in the NVR, including the total number of video files (under each camera device); the video file name, the duration of each file, the start time and the end time of each file. The Session Initiation Protocol (SIP) is used for interaction, and the content is a video query request for the device of interest or the video channel of interest; the server control module 20 receives the on-demand query request and uses an HTTP request to access the NVR storage device 10 , and queries all video information; the NVR storage device 10 responds to the http request, and the returned video information is stored in the NVR video information storage unit 202 by the server control module 20, and the queried video information is notified to the client control platform 30 via the SIP protocol; the queried video information is displayed on the client display unit 302, and the user then requests to watch the clip of interest on demand and sets the viewing requirement. The viewing requirement is sent to the server control module 20 via the client control unit 301, and content interaction is performed via SIP. The request is parsed by the SIP protocol interaction module; the server control module 20 generates a stream pulling command based on the on-demand query request and the locally stored NVR video information, and sends it to the streaming media transcoding unit 203 to pull data from the NVR storage device 10; the streaming media transcoding unit 203 executes the stream pulling command, exchanges data with the NVR storage device 10, and pulls the clip of interest to the user; the NVR storage device 10 responds to the stream pulling command and transmits the data to the streaming media transcoding unit 203, which processes the data and sends the processed audio and video data to the client display unit 302 for display using the protocol supported by the client. Through the above settings, the client initiates video on demand and configures the encoding method, resolution, intelligent detection, information overlay, etc. The server control module controls the underlying streaming media transcoding unit to pull the video from the NVR and modify the audio and video content according to the client's settings; after the modification, the data stream is passed to the client through this module.

[0039] In a specific application example, the NVR storage device 10 mainly refers to a hard disk video recorder, which supports efficient IO access and can store a large number of video files, and is generally connected to an external camera.

[0040] In another embodiment of the present invention, a video-on-demand system includes a streaming media transcoding unit that processes data by performing protocol conversion if the playback protocol of the playback terminal is inconsistent with the RTSP protocol supported by the NVR storage device. This configuration is primarily intended to accommodate customer requirements for playback devices. For example, if a customer requires the playback terminal to use the H264-encoded RTMP protocol to play content stored in the NVR, but the NVR only supports the RTSP protocol for transmitting video files, the streaming media module will be required to perform protocol conversion, and if the encoding is inconsistent, transcoding will also be required.

[0041] In a video-on-demand system according to another embodiment of the present invention, the streaming media transcoding unit 203 processes data including: performing text information superposition, image content superposition, image content modification, and face and behavior recognition operations on the basis of the original video frame. Image content modification can be performed by blurring a portion of the image; face and behavior recognition operations can be, for example, face recognition, fight behavior recognition, fall recognition, and fire detection alarms. Through the above settings, the purpose of modifying and marking remote video content can be further achieved, making the data modifiable and analyzable; after adding intelligent information recognition, alarms can be better implemented based on the video content without consuming manpower and energy for real-time monitoring.

[0042] In a video-on-demand system according to another embodiment of the present invention, the streaming media transcoding unit 203 processes data including: re-compressing the video data in a low-bandwidth environment, compressing the area of ​​interest at a low factor, and compressing the area of ​​no interest at a high factor. In order to maintain high definition, the data in the NVR storage device is generally not processed other than traditional encoding compression. However, in a weak network environment (low transmission bandwidth), high-definition audio and video transmission is difficult to perform under low bandwidth, and packet loss or delay may occur. To solve this problem, the video data needs to be re-compressed, compressing the area of ​​interest at a low factor, and compressing the area of ​​no interest at a high factor, to achieve a higher compression ratio (compression ratio of 10 to 100 times); the video bit rate can also be reduced by changing the video resolution to ensure the real-time and integrity of the data.

[0043] In the video on demand system of the still another embodiment of the application, the data processing of the stream media transcode unit 203 comprises: in the case that the data received by the client is delayed or frequently lost, the server control module is interacted with messages to control the stream media transcode unit to perform operations including blocking data loss, improving compression level and reducing resolution. When the network environment is poor, in order to realize real-time transmission, it is generally expected that the data source is controllable in code rate, but if the playback end is directly connected with the NVR storage device for data transmission, the code rate of the data cannot be controlled, which results in frequent occurrence of packet loss, delay, disconnection due to timeout of received data and the like; through the server control module, in the case that the data received by the client is delayed or frequently lost (cannot be decoded and has no key frame), the server control module is interacted with messages to control the stream media transcode module to perform operations including blocking data loss, improving compression level, reducing resolution and the like, so that the data can be transmitted in real time.

[0044] In the video on demand system set through the above, the viewing requirements include at least one of code rate automatically adjusted according to network bandwidth, face recognition, abnormal behavior recognition or at least one of superimposed text information or modified picture content in transcoding, which can be adjusted according to the viewing requirements.

[0045] In the video on demand system of the still another embodiment of the application, further comprising: the client control unit sends a pause viewing command to the server control module; the server control module conveys the command to the stream media transcode unit, the stream media transcode unit acts as an agent to transmit the command to the NVR storage device through the RTSP protocol, and the NVR storage device pauses data transmission in response to the pause command; the stream media transcode unit maintains a long link during the data pause transmission stage and is ready to receive data at any time. Further comprising: the client control unit sends a speed viewing command to the server control module; the server control module conveys the command to the stream media transcode unit, the stream media transcode unit acts as an agent to transmit the command to the NVR storage device through the RTSP protocol; the NVR storage device changes the speed of data transmission and transmits data at the specified speed. Further comprising: the client control unit sends a jump command to the server control module; the server control module conveys the command to the stream media transcode unit, the stream media transcode unit acts as an agent to transmit the command to the NVR storage device through the RTSP protocol; the NVR storage device jumps to the specified file position for data reading and output. Through the above setting, the pause, jump and speed operations of on demand are realized.

[0046] Through the video on demand system set up above, users can remotely access and control the video content of the NVR storage device through the client display unit. The streaming media transcoding unit realizes efficient audio and video transmission, flexible on-demand control and controllable content modification, meeting the viewing needs of users under different network conditions. The streaming media transcoding unit of the server control module can automatically adjust the video encoding quality according to the current network conditions (or customer configuration) to ensure the best viewing experience under different network conditions. Whether it is high-definition playback with sufficient bandwidth or smooth playback when bandwidth is limited, intelligent regulation can be achieved. The server control module is responsible for controlling the streaming media transcoding unit and protocol interaction, realizing interaction with the NVR device and pulling data, ensuring the efficiency and stability of data transmission. The streaming media service module converts the processed data into a protocol and pushes the stream to the client, so that the client can seamlessly receive and play streaming media content, improving the protocol compatibility and user experience between data transmission.

[0047] It should be understood that the exemplary embodiments described herein are illustrative and not restrictive. Although one or more embodiments of the present invention have been described in conjunction with the accompanying drawings, it should be understood by those skilled in the art that various changes in form and details may be made without departing from the spirit and scope of the present invention as defined by the appended claims.

Claims

1. A video on demand system, characterized in that: It includes an NVR storage device, a server control module and a client control platform. The server control module further includes a protocol interaction unit, an NVR video information storage unit and a streaming media transcoding unit. The client control platform further includes a client control unit and a client display unit. When a user initiates an NVR video on demand, the client control unit sends the request to the server control module, which first queries the video information and uses the Session Initiation Protocol (SIP) to interact with the video query request for the device or video channel of interest. The server control module receives the on-demand query request, uses HTTP request to access the NVR storage device, and queries all video information; the NVR storage device responds to the HTTP request, and the returned video information is stored in the NVR video information storage unit by the server control module, and the queried video information is notified to the client control platform through the SIP protocol; The retrieved video information is displayed on the client display unit. At this time, the user can watch the clips of interest on demand and set viewing requirements. The viewing requirements are sent to the server control module through the client control unit. Content interaction is carried out through SIP, and the request is parsed by the SIP protocol interaction module. The server control module generates a stream pulling command based on the on-demand query request and the locally stored NVR recording information, and passes it to the streaming media transcoding unit to pull the NVR data; The streaming media transcoding unit executes the pull stream command, interacts with the NVR storage device, and pulls the clips that the user is interested in; The NVR storage device responds to the pull stream command and transmits the data to the streaming media transcoding unit, which processes the data. The processed audio and video data is sent to the client display unit for display using the protocol supported by the client.

2. The video-on-demand system according to claim 1, wherein: The streaming media transcoding unit processes the data, including: if the playback protocol of the playback end is inconsistent with the RTSP protocol supported by the NVR storage device, the streaming media transcoding unit performs protocol conversion on the data.

3. The video-on-demand system according to claim 1, wherein: The streaming media transcoding unit processes data including: performing text information superposition, picture content superposition, picture content modification, and face and behavior recognition operations on the basis of the original video frame.

4. The video-on-demand system according to claim 1, wherein: The streaming media transcoding unit processes data by re-compressing the video data in a low-bandwidth environment, compressing the area of ​​interest at a low factor and compressing the area of ​​no interest at a high factor.

5. The video-on-demand system according to claim 1, wherein: The streaming media transcoding unit processes data by: interacting with the server control module to control the streaming media transcoding unit to perform operations including blocking data discarding, increasing compression level and reducing resolution when the client receives data with delay or frequently loses data.

6. The video-on-demand system according to claim 1, wherein: The viewing requirements include at least one of automatic bit rate adjustment according to network bandwidth, face recognition, abnormal behavior recognition, or transcoding text information superposition or picture content modification.

7. The video-on-demand system according to claim 1, wherein: Further including: The client control unit sends a pause viewing command to the server control module; The server control module transmits the command to the streaming media transcoding unit. The streaming media transcoding unit acts as an agent and transmits the command to the NVR storage device through the RTSP protocol. The NVR storage device responds to the pause command and stops sending data. The streaming media transcoding unit maintains a long link during the data transmission suspension phase and is ready to receive data at any time.

8. The video-on-demand system according to claim 1, wherein: Further including: The client control unit sends a speed viewing command to the server control module; The server control module transmits the command to the streaming media transcoding unit, which acts as a proxy and transmits the command to the NVR storage device via the RTSP protocol; The NVR storage device changes the speed of sending data and sends data at the specified speed.

9. The video-on-demand system according to claim 1, wherein: Further including: The client control unit sends a jump command to the server control module; The server control module transmits the command to the streaming media transcoding unit, which acts as a proxy and transmits the command to the NVR storage device via the RTSP protocol; The NVR storage device jumps to the specified file location to read and output data.

Images