A remote video monitoring method and detection system

Abstract

The application relates to the technical field of video monitoring, and provides a remote video monitoring method and system, which comprises the following steps: after detecting a remote video monitoring instruction, sending a monitoring request signaling to a cloud signaling service; when the monitoring request signaling is a live broadcast request, sending a start live broadcast signaling to the cloud signaling service, connecting the cloud streaming media service, and waiting for receiving a remote audio and video stream returned by an audio and video collection end; after receiving an audio and video stream forwarded by the cloud streaming media service, sorting the audio and video stream according to a stream serial number to obtain a sorted audio and video stream, decoding the sorted audio and video stream according to an audio and video coding format to obtain image data, and rendering and playing the image data. The application improves the remote video monitoring effect across networks and platforms.

Description

Technical Field

[0001] This application relates to the technical field of video surveillance, and in particular to a remote video surveillance method and detection system. Background Technology

[0002] With the increasing demand for security monitoring, video surveillance systems have been widely applied in various scenarios. Existing video surveillance technologies mainly fall into the following categories: one is monitoring systems that only support use within a local area network (LAN). These systems are limited by the network environment and cannot achieve remote monitoring; users must be on-site or via a dedicated network to view the monitoring footage, resulting in poor flexibility. Another type is monitoring systems that support remote viewing, but these systems are usually closed architectures with no external interfaces, making integration with other business systems difficult and limiting scalability. A third type is monitoring solutions provided by various camera manufacturers. While these provide interfaces for other systems to call, they often have constraints such as limitations on the number of concurrent connections and viewing time, failing to meet the needs of large-scale, long-term monitoring. Furthermore, cameras from different manufacturers use different communication protocols, such as GB / T28181 and ONVIF, making it difficult for existing systems to achieve unified compatibility, leading to high system integration complexity and maintenance costs. Therefore, there is an urgent need for a video surveillance solution that is compatible with multiple protocols, supports remote access, and possesses good openness. Summary of the Invention

[0003] To address at least one of the aforementioned technical problems, this application provides a remote video monitoring method and detection system.

[0004] Firstly, this application provides a remote video monitoring method, which adopts the following technical solution: A remote video monitoring method, applied to a client, includes: Upon detecting a remote video monitoring command, a monitoring request signaling is sent to the cloud signaling service. The monitoring request signaling includes at least one of a live broadcast request, a playback request, a PTZ control request, or an intercom request. When the monitoring request signaling is a live broadcast request, a start live broadcast signaling is sent to the cloud signaling service; Connect to the cloud streaming media service and wait to receive the remote audio and video stream returned by the audio and video acquisition terminal; Upon receiving the audio and video streams forwarded by the cloud streaming media service, the audio and video streams are sorted according to the stream sequence number to obtain the sorted audio and video streams; The sorted audio and video streams are decoded according to the audio and video encoding format to obtain image data, which is then rendered and played.

[0005] In one possible implementation, when the monitoring request signaling is a PTZ control request, the method includes: Send a PTZ control command to the cloud signaling service, the PTZ control command including PTZ action parameters; The cloud signaling service forwards the PTZ control commands to the audio / video acquisition terminal to control the camera's PTZ.

[0006] In one possible implementation, when the monitoring request signaling is an intercom request, the method includes: Send a start intercom request to the cloud signaling service, start audio recording, collect audio data, and transcode the audio format; The transcoded audio data is sent to the cloud intercom media service, which then forwards it to the audio and video acquisition terminal for playback.

[0007] In one possible implementation, the connection to the cloud streaming service, and the waiting to receive the remote audio and video stream returned by the audio and video acquisition terminal, further includes: Obtain encrypted transmission information and transmission channel identifier, wherein the encrypted transmission information is the encrypted transmission protocol information between the audio and video acquisition terminal and the client, and the transmission channel identifier is the channel identifier used by the cloud streaming media service to transmit remote audio and video streams; The data application address corresponding to the transmission channel identifier is determined based on the preset data address identifier relationship database and the transmission channel identifier; The data encryption node corresponding to the transmission channel identifier is determined based on the data application address; Based on the preset audio and video communication certificate, an image decryption algorithm is determined, and a dynamic decrypted data image is generated according to the image decryption algorithm, encrypted transmission information, transmission channel identifier, and the data encryption node. The decrypted data image is compared with the encrypted video image in the remote audio and video stream. If the nodes match, the remote audio and video stream is decrypted using the encrypted transmission information to obtain the decrypted remote audio and video stream. If the nodes do not match, the remote audio and video stream is discarded.

[0008] Secondly, this application provides a remote video monitoring method, which adopts the following technical solution: A remote video monitoring method, applied to an audio / video acquisition terminal, includes: Send a registration request to the cloud signaling service to establish and maintain a network connection with the cloud signaling service; The system receives control commands sent by the cloud signaling service, wherein the control commands are generated by the client sending a monitoring request signaling to the cloud signaling service after detecting a remote video monitoring command, and sending a start live broadcast signaling to the cloud signaling service when the monitoring request signaling is a live broadcast request. In response to the control command, remote audio and video streams are acquired and pushed to the cloud streaming media service.

[0009] In one possible implementation, the acquisition of remote audio and video streams and their push to a cloud-based streaming media service includes: Obtain the local encryption node identifier, which is the encryption gateway and client identity identifier that performs secure encapsulation of remote audio and video streams; Based on the routing information issued by the cloud signaling service and the target receiving end information of the remote audio and video stream, determine the corresponding remote data encryption address; The target transmission channel identifier and target encryption node are determined based on the data encryption address; A video encryption image is constructed based on a preset audio and video communication certificate, the local encryption node identifier, the target transmission channel identifier, and the target encryption node. The remote audio and video stream is then encrypted using the video encryption image to obtain the encrypted remote audio and video stream. The encrypted remote audio and video stream is pushed to the cloud streaming media service.

[0010] Thirdly, this application provides a remote video surveillance system, which adopts the following technical solution: A remote video monitoring system, applied to a client, includes: The signaling sending module is used to send a monitoring request signaling to the cloud signaling service after detecting a remote video monitoring command. The monitoring request signaling includes at least one of a live broadcast request, a playback request, a PTZ control request, or an intercom request. The live streaming request module is used to send a start live streaming signal to the cloud signaling service when the monitoring request signaling is a live streaming request; The service connection module is used to connect to the cloud streaming media service and wait to receive the remote audio and video stream returned by the audio and video acquisition terminal; The audio sorting module is used to sort the audio and video streams according to the stream sequence number after receiving the audio and video streams forwarded by the cloud streaming media service, so as to obtain the sorted audio and video streams. The audio decoding module is used to decode the sorted audio and video streams according to the audio and video encoding format, obtain image data, and render and play it.

[0011] Fourthly, this application provides a remote video surveillance system, which adopts the following technical solution: A remote video monitoring method, characterized in that it is applied to an audio / video acquisition terminal, comprising: The connection establishment module is used to send registration requests to the cloud signaling service and establish and maintain a network connection with the cloud signaling service; The instruction receiving module is used to receive control instructions sent by the cloud signaling service. The control instructions are generated by the client sending a monitoring request signaling to the cloud signaling service after detecting a remote video monitoring instruction, and sending a start live broadcast signaling to the cloud signaling service when the monitoring request signaling is a live broadcast request. The instruction response module is used to respond to the control instructions, collect remote audio and video streams, and push them to the cloud streaming media service.

[0012] Fifthly, this application provides a computer-readable storage medium, which adopts the following technical solution: A computer-readable storage medium having a computer program stored thereon, which, when executed in a computer, causes the computer to perform a remote video monitoring method as described in any of the first aspects.

[0013] In summary, this application includes at least one of the following beneficial technical effects: By adopting the above technical solution and separating the cloud signaling service and streaming media service, the decoupling of signaling control and media transmission is achieved, effectively improving the response speed and transmission stability of remote monitoring. The client sends monitoring request signaling to the cloud signaling service and connects to the cloud streaming media service to receive audio and video streams, realizing cross-network and cross-platform remote video monitoring. Simultaneously, by performing sequence number sorting and decoding processing on the audio and video streams, smooth playback and real-time performance are ensured. Furthermore, through a node comparison mechanism for dynamically decrypting data images, secure transmission and decryption verification of the audio and video streams are achieved, effectively guaranteeing the security of remote monitoring data. This invention is applicable to both remote monitoring scenarios where cameras are directly connected to the cloud and remote monitoring needs that access the cloud through a local area network monitoring platform, providing users with flexible and diverse remote monitoring solutions. Attached Figure Description

[0014] Figure 1 This is a first flowchart illustrating a remote video monitoring method according to one embodiment of this application.

[0015] Figure 2 This is a second flowchart of a remote video surveillance system according to one embodiment of this application.

[0016] Figure 3 This is a third flowchart illustrating a remote video monitoring method according to one embodiment of this application.

[0017] Figure 4 This is a schematic diagram of the fourth process of a remote video surveillance system according to one embodiment of this application. Detailed Implementation

[0018] To make the purpose, technical solution, and advantages of this application clearer, the following description is provided in conjunction with the appendix. Figure 1-4 The present application will be further described in detail below with reference to embodiments. It should be understood that the specific embodiments described herein are for illustrative purposes only and are not intended to limit the scope of the application.

[0019] This application embodiment is based on a remote video monitoring method disclosed on the client side.

[0020] Reference Figure 1 A remote video monitoring method, applied to a client, includes: Step S101: Upon detecting a remote video monitoring command, a monitoring request signaling is sent to the cloud signaling service.

[0021] Among them, the monitoring request signaling includes at least one of the following: live broadcast request, playback request, PTZ control request, or intercom request.

[0022] Specifically, the client provides a monitoring list or monitoring icons on the user interface. When a user clicks the live stream icon of a camera, the client internally generates a trigger signal, indicating that a remote video monitoring command has been detected. The client responds to this command by encapsulating and generating a monitoring request signaling. This monitoring request signaling is not limited to live stream requests; it can also be encapsulated as a playback request, PTZ control request, or intercom request, depending on the user's operation type. For example, if the user clicks the historical recording playback button, the generated signaling is a playback request. The client sends this signaling to the cloud signaling service via a pre-established TCP long connection or WebSocket connection. The cloud signaling service, as the system's control center, is responsible for parsing the signaling type and routing it.

[0023] Step S102: When the monitoring request signaling is a live broadcast request, send a start live broadcast signaling to the cloud signaling service.

[0024] Specifically, after the monitoring request signaling sent by the client receives an initial response from the cloud signaling service, if the signaling is determined to be a live streaming request, the client further sends a "Start Live Streaming" signaling to the cloud signaling service. This "Start Live Streaming" signaling carries identification information such as the target camera's device ID and channel number. Upon receiving this signaling, the cloud signaling service assembles it into device control commands according to the target camera's online status and network address, following a preset communication protocol (such as GB / T28181), and sends it to the corresponding audio / video acquisition terminal. It should be understood that signaling interaction and subsequent media stream transmission are logically separate; signaling is primarily responsible for control negotiation, ensuring the establishment of the media channel.

[0025] Step S103: Connect to the cloud streaming media service and wait to receive the remote audio and video stream returned by the audio and video acquisition terminal.

[0026] Specifically, simultaneously with or after sending the start-live broadcast signaling, the client proactively initiates a connection request to the cloud-based streaming media service. The cloud-based streaming media service is a media data forwarding node independent of the cloud-based signaling service, specifically designed to carry high-bandwidth audio and video data streams. A transmission channel based on UDP or RTP / RTCP protocols is typically established between the client and the cloud-based streaming media service to reduce transmission latency. The client enters a waiting state, ready to receive real-time audio and video data packets from the audio and video capture end, forwarded via the cloud-based streaming media service. This architecture, separating signaling from media, effectively avoids control signaling blockage, ensuring the real-time performance and smoothness of the monitoring footage.

[0027] Step S104: After receiving the audio and video streams forwarded by the cloud streaming media service, sort the audio and video streams according to the stream sequence number to obtain the sorted audio and video streams.

[0028] Due to the instability of network transmission, data packets may arrive out of order, be lost, or arrive repeatedly during transmission. To address this issue, the audio / video acquisition terminal assigns a consecutive stream sequence number to each data packet when sending the audio / video stream. Upon receiving the data packets, the client first parses the sequence number field in the packet header and rearranges any out-of-order packets into their correct positions. For example, if the client receives three data packets with sequence numbers 101, 103, and 102 in sequence, the sorting module will rearrange them into the order 101, 102, and 103. For detected packet loss, the client can choose to request a retransmission or handle error concealment according to a preset strategy, thereby ensuring the continuity and correctness of subsequent decoded input data.

[0029] Step S105: Decode the sorted audio and video streams according to the audio and video encoding format to obtain image data and render and play it.

[0030] The sorted audio and video streams are still compressed data and need to be decoded to restore the original image data. The client parses the encoding format information of the audio and video streams, such as standard formats like H.264, H.265, or MPEG-4. Subsequently, the client calls the decoder for decoding processing. In specific implementations, the client can integrate the FFMPEG (Fast Forward MPEG) multimedia processing library and use its provided decoding interface to decode the compressed video frames into raw image data in YUV format. Finally, the client uses a graphics rendering interface (such as OpenGL ES or DirectX) to render the YUV data onto the playback window on the screen for the user to view in real time. Through the above steps, a complete live streaming process from user command triggering to screen presentation is realized, constructing an efficient remote monitoring mechanism that decouples signaling control and media transmission.

[0031] In one possible implementation of this application embodiment, when the monitoring request signaling is a PTZ control request, the method includes: sending a PTZ control command to a cloud signaling service, the PTZ control command including PTZ action parameters; and forwarding the PTZ control command to the audio / video acquisition terminal through the cloud signaling service to control the camera's PTZ.

[0032] Specifically, in a PTZ control scenario, when a user clicks a PTZ control button (such as the directional keys or zoom button) on the client's live playback interface, the client detects the corresponding operation command. At this time, the monitoring request signaling manifests as a PTZ control request. Responding to this request, the client sends a PTZ control command to the cloud signaling service. This PTZ control command includes PTZ action parameters. Specifically, the PTZ action parameters include the specific action type (such as up, down, left, right rotation, or zoom in / out), action speed, and preset position numbers. The client encapsulates these parameters into a control message according to a preset communication protocol format. Upon receiving this control message, the cloud signaling service does not directly execute the action but acts as an intermediary, forwarding the PTZ control command to the audio / video acquisition terminal to control the camera's PTZ. The audio / video acquisition terminal (i.e., the camera) parses the command and drives the motor to perform the corresponding mechanical action. It should be understood that this control method, which relays control information through cloud signaling services, can effectively solve the potential Network Address Translation (NAT) traversal problem between the client and the camera. At the same time, it facilitates unified management and authentication of control permissions by cloud services, ensuring the security of the monitoring system.

[0033] In one possible implementation of this application embodiment, when the monitoring request signaling is an intercom request, the method includes: sending a start intercom request to the cloud signaling service and starting audio recording, collecting audio data and transcoding the audio format; sending the transcoded audio data to the cloud intercom media service, and forwarding it to the audio and video acquisition terminal for playback through the cloud intercom media service.

[0034] In voice intercom scenarios, when a user needs to communicate two-way with the monitoring site, the monitoring request signaling manifests as an intercom request. The client first sends a start intercom request to the cloud signaling service and initiates audio recording, collecting audio data and transcoding it. Specifically, the client uses the mobile terminal's microphone hardware to collect audio; the raw audio data is typically in PCM format. To reduce bandwidth consumption and adapt to network transmission, the client sends the transcoded audio data to the cloud intercom media service, which then forwards it to the audio / video acquisition end for playback. It's important to distinguish that the transmission path of the intercom data is logically independent of the transmission path of the live video stream. The live video stream flows from the audio / video acquisition end to the client, while the intercom audio stream flows from the client to the audio / video acquisition end, forming a reverse data link. The cloud intercom media service acts as a relay node in this reverse link, responsible for forwarding audio data packets from the client to the corresponding audio / video acquisition end based on the destination address. After receiving audio data, the audio / video acquisition terminal plays it through the built-in speaker or external audio equipment, enabling real-time voice communication between the client user and personnel at the monitoring site. This function greatly enriches the interactive means of remote monitoring, giving the monitoring system not only the ability to "see" but also the ability to "speak," making it suitable for various application scenarios such as remote command and remote inquiry.

[0035] Reference Figure 2 This application also discloses a remote video monitoring system 20 based on the client side.

[0036] A remote video monitoring system 20, applied to a client, includes: The signaling sending module 21 is used to send a monitoring request signaling to the cloud signaling service after detecting a remote video monitoring command. The monitoring request signaling includes at least one of a live broadcast request, a playback request, a PTZ control request, or an intercom request. The live streaming request module 22 is used to send a start live streaming signal to the cloud signaling service when the monitoring request signaling is a live streaming request; Service connection module 23 is used to connect to the cloud streaming media service and wait to receive the remote audio and video stream returned by the audio and video acquisition terminal; The audio sorting module 24 is used to sort the audio and video streams according to the stream sequence number after receiving the audio and video streams forwarded by the cloud streaming media service, so as to obtain the sorted audio and video streams. The audio decoding module 25 is used to decode the sorted audio and video streams according to the audio and video encoding format, obtain image data, and render and play it.

[0037] The client-side-based remote video monitoring system of this application embodiment can implement any of the above-described client-side-based remote video monitoring methods, and the specific working process of each module in the remote video monitoring system can refer to the corresponding process in the above-described method embodiments.

[0038] This application also discloses a remote video monitoring method based on the audio and video acquisition terminal side.

[0039] Reference Figure 3 A remote video monitoring method, applied to an audio / video acquisition terminal, includes: In this application embodiment, the audio and video acquisition terminal can be a network camera (IPC), a hard disk recorder (NVR), or other IoT terminal device with audio and video acquisition capabilities that supports the national standard GB / T28181 protocol. This application uses a network camera as an example for illustration.

[0040] Step S301: Send a registration request to the cloud signaling service to establish and maintain a network connection with the cloud signaling service.

[0041] Specifically, after the audio / video capture terminal starts up and connects to the network, it proactively initiates a registration process with the cloud signaling service. The registration request includes the device's national standard number, network address (such as IP address and port number), device type, and other identification information. Upon receiving the registration request, the cloud signaling service authenticates the device. If authentication succeeds, it returns a registration success response and records the device's network connection information in the cloud; if authentication fails, it returns a response requiring authentication, and the device must resubmit the authentication information. After successful registration, the audio / video capture terminal enters a "hold" state, periodically sending heartbeat signaling to maintain a long-term connection with the cloud signaling service. It should be understood that since audio / video capture terminals are typically deployed in an intranet environment, their public IP address may change dynamically or be restricted by Network Address Translation (NAT) devices. The heartbeat mechanism not only informs the cloud device of its current online status but also maintains the mapping relationship on the NAT device, ensuring that the cloud signaling service can issue commands to the device at any time, thus solving the network reachability problem when the device passively receives commands. If the heartbeat times out, the cloud signaling service determines that the device is offline and stops issuing commands to it.

[0042] Step S302: Receive control commands sent by the cloud signaling service. The control commands are generated by the client sending a monitoring request signaling to the cloud signaling service after detecting the remote video monitoring command, and sending a start live broadcast signaling to the cloud signaling service when the monitoring request signaling is a live broadcast request.

[0043] After establishing a stable signaling connection, the audio / video acquisition terminal enters a standby listening state, awaiting scheduling from the cloud. When a user initiates a live streaming request on the client, the cloud signaling service converts the client's request into a control command recognizable by the device according to a preset communication protocol (such as GB / T28181). This control command includes the specific operation type (such as live streaming, historical playback, PTZ control, etc.) and necessary parameters. The audio / video acquisition terminal receives this control command through the established long-term connection channel. This step embodies the "passive response" interaction mode of the audio / video acquisition terminal, meaning the device does not need to actively poll the server; it only needs to trigger the corresponding action when it receives the command. This mode effectively reduces the device's computing resource consumption and network bandwidth usage, making it particularly suitable for monitoring scenarios with large-scale device access.

[0044] Step S303: Respond to the control command, collect remote audio and video streams and push them to the cloud streaming media service.

[0045] Specifically, the audio / video acquisition terminal parses the received control commands. If the command type is "Start Live Stream," it activates the camera and microphone to acquire audio and video data. The acquired raw audio and video data is encoded and compressed (e.g., H.264 or H.265 encoding) to form a remote audio / video stream. Unlike the signaling transmission path, the audio / video acquisition terminal establishes a media transmission channel based on the cloud streaming media service address carried in the control command, pushing the audio / video stream to the cloud streaming media service. The cloud streaming media service acts as a data relay node, then distributes the audio / video stream to the clients requesting to view it. This design of separating signaling and media streams eliminates the need for audio and video data to pass through a signaling server, avoiding the blockage of control signaling transmission by high-bandwidth traffic and ensuring low latency and high stability of the monitoring footage. Furthermore, during the streaming process, the audio / video acquisition terminal can dynamically adjust the bitrate or frame rate according to network conditions to adapt to the transmission needs of different network environments.

[0046] In remote video surveillance scenarios, especially those involving public safety or privacy-sensitive areas, data security during transmission is paramount. To prevent audio and video streams from being intercepted, tampered with, or forged during transmission, this application provides an encrypted streaming method based on encrypted video images: A local encryption node identifier is obtained, which is the encryption gateway and client identity identifier that performs secure encapsulation of the remote audio and video stream; the corresponding remote data encryption address is determined based on routing information issued by the cloud signaling service and the target receiving end information of the remote audio and video stream; the target transmission channel identifier and target encryption node are determined based on the data encryption address; an encrypted video image is constructed based on a preset audio and video communication certificate, the local encryption node identifier, the target transmission channel identifier, and the target encryption node; the remote audio and video stream is encrypted using the encrypted video image to obtain the encrypted remote audio and video stream; and the encrypted remote audio and video stream is pushed to a cloud streaming media service.

[0047] Specifically, before initiating the streaming task, the audio / video capture terminal first reads pre-set identity information from the local security module or encryption chip. The local encryption node identifier is not merely a simple ID string; it contains a unique identifier for the hardware or software gateway performing the encryption operation, as well as a list of legitimate client identifiers currently requesting access to the video stream. By strongly binding encryption operations to device hardware and user identity, even if data packets are intercepted during transmission, attackers cannot forge legitimate encrypted data packets due to the lack of corresponding local encryption node identifier information, thus ensuring data trustworthiness from the source.

[0048] When establishing a transmission channel, the cloud signaling service sends routing information to the audio / video capture terminal based on network topology and load conditions, indicating which streaming media server node the data should be sent to. Simultaneously, the audio / video capture terminal parses the target receiver information (i.e., the client information requesting to watch the video). Combining these two types of information, the capture terminal can determine the corresponding remote data encryption address. It should be understood that this data encryption address is not a simple IP address, but rather a mapping address pointing to a specific logical processing unit within the client's decryption module. This address guides the generation direction of subsequent encryption parameters, ensuring that the encrypted data can only be correctly parsed by the specific target client.

[0049] In this embodiment, the preset audio / video communication certificate is a security credential pre-negotiated between the acquisition end and the client, containing the public key or shared key parameters required by the encryption algorithm. The acquisition end calls the graphics rendering engine or data encoding module to map the four key parameters—the preset audio / video communication certificate, the local encryption node identifier, the target transmission channel identifier, and the target encryption node—to image pixel values ​​or frequency domain coefficients according to preset rules, thereby generating a video encrypted image. It should be noted that this video encrypted image is not a visual image for human viewing, but a special data carrier. Due to the high redundancy and complex spatial correlation of image data itself, hiding the encryption parameters in the image structure can effectively resist attacks based on protocol format analysis compared to carrying the parameters directly in the protocol header. Subsequently, the acquisition end uses this video encrypted image to encapsulate and encrypt the acquired remote audio / video stream. Specifically, the video encrypted image can be embedded as extended data of keyframes, or a dynamic key can be generated using the image data to perform symmetric encryption on the audio / video payload, thereby obtaining the encrypted remote audio / video stream.

[0050] In this embodiment, the audio / video acquisition terminal pushes the encapsulated encrypted data packet to the cloud streaming media service via the network. Since the data stream has been encrypted, the cloud streaming media service acts only as a transparent data forwarding node, unable to spy on or tamper with the video content, truly achieving end-to-end encrypted transmission. When the client receives the data stream, it executes the decryption process described in Embodiment 3, verifying the integrity and legitimacy of the data source by comparing the node information in the encrypted video image, thus completing the closed loop of secure transmission. Through the above steps, this embodiment utilizes the innovative carrier of encrypted video images to achieve covert transmission and dynamic verification of encrypted parameters, greatly enhancing the anti-attack capability of the remote video surveillance system in complex network environments.

[0051] In one possible implementation of this application, encrypted transmission information and a transmission channel identifier are obtained. The encrypted transmission information is the encrypted transmission protocol information between the audio / video acquisition end and the client, and the transmission channel identifier is the channel identifier used by the cloud streaming media service to transmit remote audio / video streams. A data application address corresponding to the transmission channel identifier is determined based on a preset data address identifier relational database and the transmission channel identifier. A data encryption node corresponding to the transmission channel identifier is determined based on the data application address. An image decryption algorithm is determined based on a preset audio / video communication certificate, and a dynamic decrypted data image is generated based on the image decryption algorithm, the encrypted transmission information, the transmission channel identifier, and the data encryption node. The decrypted data image is compared node-wise with the encrypted video image in the remote audio / video stream. If the nodes match, the remote audio / video stream is decrypted using the encrypted transmission information to obtain the decrypted remote audio / video stream; if the nodes do not match, the remote audio / video stream is discarded.

[0052] Specifically, encrypted transmission information refers to the encrypted transmission protocol information between the audio / video capture end and the client, such as the session key negotiated by both parties, the encryption algorithm type (e.g., AES-256), or an asymmetric encryption certificate. The transmission channel identifier is the channel identifier used by the cloud streaming media service to transmit remote audio / video streams. This identifier can be a temporary port mapping ID assigned by the streaming media service or a specific stream ID, used to uniquely identify the current data transmission session. The client obtains the above information through signaling interaction or a handshake protocol when establishing a connection with the streaming media service.

[0053] The client maintains a local data address identifier database, which stores the mapping between transmission channel identifiers and data application addresses. The data application address is not a physical network address, but rather a logical address pointing to a specific decryption logic unit or key storage area within the local decryption module. By querying this database, the client can determine which decryption logic unit should process the currently received data stream, thus enabling multi-channel concurrent decryption management. Data encryption nodes refer to the indexes of specific encryption parameters or key fragments used by the audio / video acquisition end during the encryption process. Based on the data application address, the client indexes the corresponding node information stored locally. This node information should match the encryption node used by the acquisition end, forming the basis for subsequent image comparison.

[0054] In this embodiment, the preset audio / video communication certificate is a security credential shared in advance between the client and the acquisition end, containing parameters or a public key for the decryption algorithm. The client uses an image decryption algorithm, combined with real-time acquired encrypted transmission information, transmission channel identifiers, and data encryption nodes, to generate a dynamic decrypted data image using a specific graphics rendering engine (such as OpenGL or Skia). It should be understood that this image is not a visual image for display, but a data carrier; the color values, texture features, or frequency domain features of its pixels carry the combined information of the aforementioned parameters. Since encrypted transmission information and transmission channel identifiers are typically time-sensitive or random, the generated decrypted data image is also dynamically changing; the image corresponding to each decryption process may be different, which greatly increases the difficulty of cracking.

[0055] Before sending the audio and video streams, the audio and video acquisition terminal generates encrypted video images based on encryption parameters and embeds them into specific locations within the audio and video streams (such as the header of keyframes or extended data areas). Upon receiving the data, the client extracts the encrypted video images and performs node-by-node comparison with the locally generated decrypted data images. Node-by-node comparison verifies the consistency of feature values ​​(such as the RGB values ​​or DCT coefficients of specific pixels) at specific locations in the two images. If the comparison results match, it indicates that the data source is trustworthy and has not been tampered with. The client then calls the decryption engine to decrypt the audio and video stream payload using the encrypted transmission information, restoring the original audio and video data. If the comparison results do not match, it indicates that the data may have originated from an unauthorized device or has been tampered with. The client discards the data stream and can trigger an alarm mechanism.

[0056] Reference Figure 4 This application also discloses a remote video monitoring system 40 based on the audio and video acquisition terminal side.

[0057] A remote video monitoring system 40, applied to an audio and video acquisition terminal, includes: Connection establishment module 41 is used to send a registration request to the cloud signaling service and establish and maintain a network connection with the cloud signaling service; The instruction receiving module 42 is used to receive control instructions sent by the cloud signaling service. The control instructions are generated by the client sending a monitoring request signaling to the cloud signaling service after detecting the remote video monitoring instruction, and sending a start live broadcast signaling to the cloud signaling service when the monitoring request signaling is a live broadcast request. The instruction response module 43 is used to respond to control instructions, collect remote audio and video streams, and push them to the cloud streaming media service.

[0058] In the several embodiments provided in this application, it should be understood that the provided methods and systems can be implemented in other ways. For example, the system embodiments described above are merely illustrative; for example, the division of a certain module is merely a logical functional division, and in actual implementation there may be other division methods, such as multiple modules can be combined or integrated into another system, or some features can be ignored or not executed.

[0059] This embodiment provides an application scenario for remote video surveillance, specifically describing an implementation method where the audio and video acquisition terminal accesses the cloud through a local area network (LAN) monitoring platform. In the aforementioned embodiment, the audio and video acquisition terminal was described as a device that directly registers with and streams to the cloud signaling service, such as a camera supporting the national standard GB / T28181 protocol. However, in actual security monitoring networks, there are many traditional cameras that only support the ONVIF (Open Network Video Interface Forum) protocol, or LAN devices that are restricted by network policies from directly accessing the public network. To ensure compatibility with such devices, this embodiment introduces a LAN monitoring platform as an intermediate layer to achieve heterogeneous protocol conversion and cross-network data transmission.

[0060] In this application scenario, the LAN monitoring platform acts as a bridge between the audio / video acquisition end and the cloud service. The LAN monitoring platform first performs device scanning and access steps. Specifically, it scans all cameras within the LAN that support the ONVIF protocol, obtains the camera configuration information based on the scanned network addresses, and stores it in a local database. At this point, the LAN monitoring platform acts as a "proxy device," interacting with the cloud on behalf of all cameras within the LAN.

[0061] At the signaling interaction level, the LAN monitoring platform sends a registration request to the cloud signaling service to establish and maintain a network connection with it. This registration process is similar to that of a single camera in the aforementioned embodiments, except that the LAN monitoring platform reports its own national standard number and network address during registration and maintains a mapping table that maps ONVIF cameras within the LAN to virtual sub-devices under the platform. The cloud signaling service records the platform's connection information and maintains a normal network connection based on heartbeats. If a heartbeat times out, the platform and all its subordinate cameras are determined to be offline. This design eliminates the need for the cloud to directly perceive the network details of each specific camera within the LAN, significantly reducing the complexity of cloud device management.

[0062] When a user initiates a live streaming request on the client, the client sends a monitoring request signaling to the cloud signaling service. If the monitoring request signaling is a live streaming request, the client sends a start live streaming signaling to the cloud signaling service. Upon receiving this signaling, the cloud signaling service checks whether the cloud streaming media service is online. If online, it combines the start live streaming signaling according to the GB / T28181 protocol and sends the signaling to the local area network monitoring platform based on the saved network address.

[0063] After receiving the live streaming command from the cloud, the LAN monitoring platform performs protocol conversion and data forwarding operations. Specifically, the LAN monitoring platform parses the live streaming command in GB / T28181 format and extracts the identification information of the target camera. Subsequently, the LAN monitoring platform determines the ONVIF camera corresponding to the identification based on a locally stored mapping table and initiates a real-time streaming request to the camera according to the ONVIF protocol standard. The ONVIF camera responds to the request and pushes the audio and video streams to the LAN monitoring platform. After receiving the audio and video streams, the LAN monitoring platform repackages them into a format that conforms to the cloud transmission standard (such as PS stream or ES stream) and pushes them to the cloud streaming media service.

[0064] After receiving the audio and video streams, the cloud-based streaming service detects the client connection and forwards the audio and video streams to the client. Upon receiving the audio and video streams, the client sorts them according to their sequence numbers, obtaining a sorted audio and video stream. Then, it decodes the sorted audio and video streams according to the audio and video encoding format to obtain image data, which is then rendered and played.

[0065] In addition, for the PTZ control function, the client sends PTZ control commands to the cloud signaling service, which then forwards the commands to the local area network (LAN) monitoring platform. The LAN monitoring platform parses the commands and converts the PTZ control parameters of the GB / T28181 protocol into PTZ (Pan-Tilt-Zoom) control commands corresponding to the ONVIF protocol, which are then sent to the designated camera, thereby enabling remote PTZ control of cameras that do not support the national standard protocol.

[0066] It should be understood that this embodiment, through the introduction of a local area network (LAN) monitoring platform, achieves interoperability between the ONVIF protocol and the GB / T28181 protocol, solving the technical challenge of LAN-based private protocol devices being unable to directly access the cloud-based public network monitoring system. The LAN monitoring platform not only performs signaling protocol conversion but also acts as a media stream relay node, enabling cross-network segment data forwarding. This layered architecture design ensures both the uniformity and standardization of the cloud service architecture and significantly expands system compatibility, allowing users to simultaneously view standard cameras directly connected to the cloud and traditional cameras accessed through the LAN platform via a unified client interface, achieving true network-wide remote monitoring.

[0067] This application also discloses a computer-readable storage medium.

[0068] A computer-readable storage medium storing a computer program that can be loaded by a processor and executed as described above in any of the remote video surveillance methods.

[0069] The computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in connection with an instruction execution system, apparatus, or device; the program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to wireless, wire, optical fiber, RF, etc., or any suitable combination thereof.

[0070] It should be noted that the descriptions of each embodiment in the above embodiments have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions in other embodiments.

[0071] The above are all preferred embodiments of this application and are not intended to limit the scope of protection of this application. Any feature disclosed in this specification (including the abstract and drawings) may be replaced by other equivalent or similar features unless specifically stated otherwise. That is, unless specifically stated otherwise, each feature is only one example of a series of equivalent or similar features.

Claims

1. A method of remote video monitoring, characterized by, Applied to the client side, including: Upon detecting a remote video monitoring command, a monitoring request signaling is sent to the cloud signaling service. The monitoring request signaling includes at least one of a live broadcast request, a playback request, a PTZ control request, or an intercom request. When the monitoring request signaling is a live broadcast request, a start live broadcast signaling is sent to the cloud signaling service; Connect to the cloud streaming media service and wait to receive the remote audio and video stream returned by the audio and video acquisition terminal; Upon receiving the audio and video streams forwarded by the cloud streaming media service, the audio and video streams are sorted according to the stream sequence number to obtain the sorted audio and video streams; The sorted audio and video streams are decoded according to the audio and video encoding format to obtain image data, which is then rendered and played.

2. The remote video monitoring method of claim 1, wherein, When the monitoring request signaling is a PTZ control request, the method includes: Send a PTZ control command to the cloud signaling service, the PTZ control command including PTZ action parameters; The cloud signaling service forwards the PTZ control commands to the audio / video acquisition terminal to control the camera's PTZ.

3. The remote video monitoring method of claim 1, wherein, When the monitoring request signaling is an intercom request, the method includes: Send a start intercom request to the cloud signaling service, start audio recording, collect audio data, and transcode the audio format; The transcoded audio data is sent to the cloud intercom media service, which then forwards it to the audio and video acquisition terminal for playback.

4. A remote video monitoring method characterized by, Applications include audio and video capture terminals, including: Send a registration request to the cloud signaling service to establish and maintain a network connection with the cloud signaling service; The system receives control commands sent by the cloud signaling service, wherein the control commands are generated by the client sending a monitoring request signaling to the cloud signaling service after detecting a remote video monitoring command, and sending a start live broadcast signaling to the cloud signaling service when the monitoring request signaling is a live broadcast request. In response to the control command, remote audio and video streams are acquired and pushed to the cloud streaming media service.

5. The method of claim 4, wherein, The process of acquiring remote audio and video streams and pushing them to a cloud-based streaming media service includes: Obtain the local encryption node identifier, which is the encryption gateway and client identity identifier that performs secure encapsulation of remote audio and video streams; Based on the routing information issued by the cloud signaling service and the target receiving end information of the remote audio and video stream, determine the corresponding remote data encryption address; The target transmission channel identifier and target encryption node are determined based on the data encryption address; A video encryption image is constructed based on a preset audio and video communication certificate, the local encryption node identifier, the target transmission channel identifier, and the target encryption node. The remote audio and video stream is then encrypted using the video encryption image to obtain the encrypted remote audio and video stream. The encrypted remote audio and video stream is pushed to the cloud streaming media service.

6. The remote video monitoring method of claim 1, wherein, The process of connecting to the cloud streaming media service and waiting to receive the remote audio and video stream returned by the audio and video acquisition terminal also includes: Obtain encrypted transmission information and transmission channel identifier, wherein the encrypted transmission information is the encrypted transmission protocol information between the audio and video acquisition terminal and the client, and the transmission channel identifier is the channel identifier used by the cloud streaming media service to transmit remote audio and video streams; The data application address corresponding to the transmission channel identifier is determined based on the preset data address identifier relationship database and the transmission channel identifier; The data encryption node corresponding to the transmission channel identifier is determined based on the data application address; Based on the preset audio and video communication certificate, an image decryption algorithm is determined, and a dynamic decrypted data image is generated according to the image decryption algorithm, encrypted transmission information, transmission channel identifier, and the data encryption node. The decrypted data image is compared with the encrypted video image in the remote audio and video stream. If the nodes match, the remote audio and video stream is decrypted using the encrypted transmission information to obtain the decrypted remote audio and video stream. If the nodes do not match, the remote audio and video stream is discarded.

7. A remote video monitoring system characterized by, Applied to the client side, including: The signaling sending module is used to send a monitoring request signaling to the cloud signaling service after detecting a remote video monitoring command. The monitoring request signaling includes at least one of a live broadcast request, a playback request, a PTZ control request, or an intercom request. The live streaming request module is used to send a start live streaming signal to the cloud signaling service when the monitoring request signaling is a live streaming request; The service connection module is used to connect to the cloud streaming media service and wait to receive the remote audio and video stream returned by the audio and video acquisition terminal; The audio sorting module is used to sort the audio and video streams according to the stream sequence number after receiving the audio and video streams forwarded by the cloud streaming media service, so as to obtain the sorted audio and video streams. The audio decoding module is used to decode the sorted audio and video streams according to the audio and video encoding format, obtain image data, and render and play it.

8. A remote video monitoring method characterized by, Applications include audio and video capture terminals, including: The connection establishment module is used to send registration requests to the cloud signaling service and establish and maintain a network connection with the cloud signaling service; The instruction receiving module is used to receive control instructions sent by the cloud signaling service. The control instructions are generated by the client sending a monitoring request signaling to the cloud signaling service after detecting a remote video monitoring instruction, and sending a start live broadcast signaling to the cloud signaling service when the monitoring request signaling is a live broadcast request. The instruction response module is used to respond to the control instructions, collect remote audio and video streams, and push them to the cloud streaming media service.

9. A computer-readable storage medium, characterized in that, include: The computer program is stored and can be loaded by a processor and executed as described in any one of claims 1-6.

Images