Video privacy masking area configuration method and apparatus, electronic device, and storage medium

Abstract

The application provides a video privacy covering area configuration method and device, electronic equipment and storage medium, and relates to the technical field of intelligent security and protection. In the method, after receiving the starting configuration stream signaling, the current video data is video encoded without a privacy covering area, and the obtained privacy covering configuration code stream is sent to the first client together with the current position information of the current privacy covering area, so that the user can view the complete picture of the current video data and the specific position of the current privacy covering area in the complete picture. The covered area in the complete picture is clear and visible, which facilitates the user to adjust the position and size of the current privacy covering area according to the need, obtain more accurate privacy covering configuration information, and accurately adjust the covered area in the real-time picture. Through the privacy covering configuration information, the current position information is updated to obtain the updated privacy covering area, and accurate covering of the video picture is realized.

Description

Technical Field

[0001] This invention relates to the field of intelligent security technology, and in particular to a method, apparatus, electronic device, and storage medium for configuring video privacy masking areas. Background Technology

[0002] Cameras are now ubiquitous in people's lives, bringing security to society but also posing security risks to the public, especially in sensitive areas. For example, outdoor network cameras facing residents' windows need to protect residents' privacy while monitoring security, by covering the window area. Similarly, home network cameras also need to cover areas such as bedrooms, beds, and bathrooms.

[0003] For ease of configuration and intuitiveness, privacy masking areas are typically drawn or adjusted on the live feed of the network camera. In traditional LAN applications, the privacy masking area is adjusted by the user on the network camera's client, which then sends the adjusted area to the network camera. This allows the network camera to directly cover the corresponding area in the video during video encoding. However, in the era of the Internet of Things (IoT), all interactions are transmitted over a wide area network (WAN). Due to latency in WAN interactions, applications that performed well on a LAN now perform poorly on a WAN and are no longer suitable.

[0004] In wide area network applications, a common practice is for users to first adjust the privacy masking area on the webcam's client and then click save. The client then sends the saved privacy masking area to the webcam. While this prevents the problem of delayed loading caused by the client adjusting and sending the privacy masking area multiple times, users cannot intuitively determine whether the size of the saved privacy masking area is appropriate, and therefore cannot accurately adjust the obscured area in the live image. Summary of the Invention

[0005] This invention provides a method, apparatus, electronic device, and storage medium for configuring video privacy covering areas, in order to address the deficiencies existing in related technologies.

[0006] This invention provides a method for configuring video privacy masking areas, applied to network cameras, including: Receive the start configuration stream signaling sent by the first client, encode the current video data for the non-privacy masking area, and obtain the privacy masking configuration bitstream; The current location information of the current privacy-covered area is determined, and the privacy-covered configuration stream and the current location information are sent to the first client. The first client is used to parse the privacy-covered configuration stream to obtain a first real-time image, overlay the current location information on the first real-time image, and receive the privacy-covered configuration information input by the user in the first real-time image. The privacy masking configuration information sent by the first client is received, and the current privacy masking area is updated.

[0007] According to a video privacy overlay region configuration method provided by the present invention, the step of receiving the start configuration stream signaling sent by the first client includes: Based on the current privacy-covered area, the current video data is encoded with the privacy-covered area to obtain a first live stream, and the first live stream is sent to the streaming media server; the streaming media server is used to copy and distribute the first live stream to the first client. Accordingly, receiving the start configuration stream signaling sent by the first client and performing video encoding on the current video data for the non-privacy-masking region to obtain the privacy-masking configuration bitstream includes: Stop video encoding the current video data with privacy-covered areas, and perform video encoding on the current video data without privacy-covered areas to obtain the privacy-covered configuration bitstream.

[0008] According to a video privacy overlay region configuration method provided by the present invention, the step of receiving the start configuration stream signaling sent by the first client includes: The system receives a first live streaming start signaling sent by a second client, performs video encoding on the current video data with the privacy-covered area based on the current privacy-covered area, obtains a second live stream, and sends the second live stream to the streaming media server; the streaming media server is used to copy and distribute the second live stream to the second client.

[0009] According to a video privacy masking region configuration method provided by the present invention, the step of performing video encoding on the current video data with the privacy masking region based on the current privacy masking region to obtain a second live bitstream specifically includes: While performing video encoding on the current video data without privacy masking areas to obtain a privacy masking configuration bitstream, the current video data is also performed video encoding on the current privacy masking areas to obtain a second live bitstream.

[0010] According to a video privacy masking region configuration method provided by the present invention, the step of receiving the privacy masking configuration information sent by the first client and updating the current privacy masking region includes: The system receives a second live streaming start signal sent by the first client, performs video encoding on the current video data with the privacy-covered area based on the current privacy-covered area, obtains a third live stream, and sends the third live stream to the streaming media server; the streaming media server is used to copy and distribute the third live stream to the first client.

[0011] The present invention also provides a method for configuring a video privacy overlay area, applied to a first client, comprising: Send a start configuration stream signaling to the network camera, and receive the privacy masking configuration bitstream and the current location information of the current privacy masking area fed back by the network camera based on the start configuration stream signaling; The privacy masking configuration bitstream is parsed to obtain a first real-time image, and the current location information is superimposed on the first real-time image; Obtain the privacy masking configuration information input by the user in the first real-time frame, and send the privacy masking configuration information to the network camera.

[0012] According to a video privacy masking region configuration method provided by the present invention, the step of obtaining the privacy masking configuration information input by the user in the first real-time frame includes: After receiving a save command triggered by the user, the privacy masking configuration information is obtained.

[0013] According to a video privacy masking area configuration method provided by the present invention, the step of sending the start configuration stream signaling to the network camera includes, before: Send a second live streaming start signal to the network camera and receive a fourth live stream from the network camera based on the current privacy-covered area; The fourth live stream is parsed to obtain the second live video feed; Alternatively, send a playback start signaling message to the network camera and receive the historical bitstream stored by the network camera, which is encoded based on the current privacy masking area; The historical bitstream is parsed to obtain the playback footage.

[0014] The present invention also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the video privacy masking region configuration method as described above.

[0015] The present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the video privacy masking region configuration method as described above.

[0016] The present invention also provides a computer program product, including a computer program that, when executed by a processor, implements the video privacy masking region configuration method as described above.

[0017] This invention provides a video privacy masking region configuration method, apparatus, electronic device, and storage medium. In this method, upon receiving a start configuration stream signaling, the current video data is encoded without privacy masking regions. The resulting privacy masking configuration bitstream, along with the current location information of the current privacy masking region, is sent to a first client. This allows the user to view the complete video frame and the specific location of the current privacy masking region within the complete frame. The masked area in the complete frame is clearly visible, facilitating user adjustment of the position and size of the current privacy masking region as needed, resulting in more accurate privacy masking configuration information. Precise adjustment of the masked area in the real-time frame is possible. Furthermore, the current location information is updated using the privacy masking configuration information to obtain the updated privacy masking region, achieving precise masking of the video frame. Attached Figure Description

[0018] To more clearly illustrate the technical solutions in this invention or related technologies, the accompanying drawings used in the description of the embodiments or related technologies will be briefly introduced below. Obviously, the accompanying drawings described below are some embodiments of this invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0019] Figure 1 This is one of the diagrams illustrating existing privacy-covering areas.

[0020] Figure 2 This is the second illustration of an existing privacy-covering area.

[0021] Figure 3 This is a flowchart illustrating the video privacy masking area configuration method provided by the present invention.

[0022] Figure 4 This is a schematic diagram of the real-time screen in the video privacy masking area configuration method provided by the present invention.

[0023] Figure 5 This is a schematic diagram of the playback screen in the video privacy masking area configuration method provided by the present invention.

[0024] Figure 6 This is the second flowchart illustrating the video privacy masking area configuration method provided by the present invention.

[0025] Figure 7This is a schematic diagram of the current location information in the real-time image of the video privacy masking area configuration method provided by the present invention.

[0026] Figure 8 This is a schematic diagram of privacy masking configuration information in the real-time image of the video privacy masking area configuration method provided by the present invention.

[0027] Figure 9 This is one of the structural schematic diagrams of the video privacy covering area configuration device provided by the present invention.

[0028] Figure 10 This is the second structural schematic diagram of the video privacy covering area configuration device provided by the present invention.

[0029] Figure 11 This is a schematic diagram of the structure of the electronic device provided by the present invention. Detailed Implementation

[0030] To make the objectives, technical solutions, and advantages of this invention clearer, the technical solutions of this invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this invention. All other embodiments obtained by those skilled in the art based on the embodiments of this invention without creative effort are within the scope of protection of this invention.

[0031] Privacy masking is a crucial function in network camera surveillance, and a good user experience is essential. Current methods for configuring video privacy masking areas all involve configuring them on the live feed. However, if the privacy masking area is downloaded in real-time, multiple downloads and reloads can occur. If adjustments are made before downloading, the live feed may be obscured by the existing privacy masking area, making it impossible to accurately adjust the obscured areas within the live feed.

[0032] like Figure 1 and Figure 2 As shown, the black area within the red rectangle is the privacy-covered area. Because users cannot see the obscured area in the live view, precise operation is impossible without deleting the original privacy-covered area. Figure 2 The privacy-covering effect is only achieved by... Figure 1 The privacy-covering effect is limited; however, for precise operation, the original privacy-covered area needs to be deleted before operation. This increases the number of steps for the user and also deletes the privacy-covered area during video recording, which may lead to privacy leaks.

[0033] Based on this, this embodiment of the invention provides a method for configuring video privacy covering areas.

[0034] Figure 3This is a flowchart illustrating a video privacy masking region configuration method provided in an embodiment of the present invention, as shown below. Figure 3 As shown, this method is applied to a network camera and includes: S11, receive the start configuration stream signaling sent by the first client, perform video encoding on the current video data for the non-privacy masking area, and obtain the privacy masking configuration bitstream; S12, determine the current location information of the current privacy-covering area, and send the privacy-covering configuration stream and the current location information to the first client; the first client is used to parse the privacy-covering configuration stream to obtain a first real-time image, overlay the current location information on the first real-time image, and receive the privacy-covering configuration information input by the user in the first real-time image; S13, receive the privacy masking configuration information sent by the first client, and update the current privacy masking area.

[0035] Specifically, the video privacy masking area configuration method provided in this embodiment of the invention is executed by a network camera (Internet Protocol Camera, IPC). Privacy masking refers to covering certain privacy areas in the monitoring screen with black or mosaic to protect those areas.

[0036] Webcams have encoding capabilities, which refer to the ability of a webcam to encode video streams. For example, home webcams can encode two video streams without interference, while some specialized webcams can encode even more video streams.

[0037] First, in step S11, the user sends a start configuration stream signaling command to the network camera via a first client. This user can be an administrator, configuring the privacy masking area in the video. The first client can be an application (APP) installed on an electronic device, such as a smartphone or tablet. This start configuration stream signaling command allows the user to close the live feed on the first client, enter the privacy masking configuration interface, and switch the live feed to the privacy masking configuration interface. This start configuration stream signaling command instructs the network camera to begin the privacy masking area configuration process, i.e., the network camera stops sending the live stream and begins sending the privacy masking configuration stream. This configuration process can be an update of the current privacy masking area, specifically updating the size and position of the current privacy masking area. The current privacy masking area can be the network camera's default privacy masking area or the privacy masking area previously configured by the user.

[0038] After receiving the start configuration stream signaling from the first client, the network camera can perform video encoding on the acquired current video data without privacy masking areas to obtain a privacy masking configuration bitstream. It can be understood that video encoding without privacy masking areas means removing the current privacy masking area during video encoding.

[0039] Then, step S12 is executed to determine the current location information of the current privacy-covering area. This current location information can be represented by the coordinate information of each vertex of the current privacy-covering area. The privacy-covering configuration bitstream and the current location information can be sent together to the first client.

[0040] Subsequently, after receiving the privacy masking configuration stream and the current location information, the first client can parse the privacy masking configuration stream to obtain the first real-time view. This first real-time view contains no masked areas, allowing the current location information to be overlaid on it. For example, a closed frame can be determined based on the current location information and then displayed on the first real-time view.

[0041] Users can view this first real-time frame, which provides a clear view of the complete video feed. They can also determine the position and size of the current privacy-covered area. Users can then adjust the position and size of this privacy-covered area once or multiple times as needed to obtain privacy-covering configuration information. This configuration information can include the adjusted position and size of the privacy-covered area.

[0042] Users can click the save button to transmit the privacy masking configuration information to the webcam via the first client. The webcam can then receive the privacy masking configuration information entered by the user in the first live view.

[0043] Finally, in step S13, if the network camera can receive the privacy masking configuration information sent by the first client, it will stop sending the privacy masking configuration stream to the first client and update the current privacy masking area according to the privacy masking configuration information, changing the position and / or size of the current privacy masking area to obtain the updated privacy masking area.

[0044] Subsequently, the updated privacy-masking area can be used to encode the acquired current video data with the privacy-masked area, obtaining the current live stream, which is then sent to the streaming media server for replication and distribution to currently active clients. The clients can then parse the current stream to obtain the live video feed.

[0045] It is understandable that video encoding with privacy-covered areas refers to encoding the current privacy-covered areas into the video bitstream during video encoding, thereby obtaining the current live bitstream.

[0046] The video privacy masking region configuration method provided in this embodiment of the invention first receives a start configuration stream signaling sent by a first client, performs video encoding on the current video data without privacy masking regions, and obtains a privacy masking configuration bitstream; then, it determines the current location information of the current privacy masking region, and sends the privacy masking configuration bitstream and the current location information to the first client; the first client is used to parse the privacy masking configuration bitstream to obtain a first real-time frame, overlay the current location information on the first real-time frame, and receive privacy masking configuration information input by the user in the first real-time frame; finally, it receives the privacy masking configuration information sent by the first client and updates the current location information. In this method, upon receiving the start configuration stream signaling, the acquired current video data undergoes video encoding for areas without privacy masking. The resulting privacy masking configuration stream, along with the current location information of the privacy masking area, is sent to the first client. This allows the user to view the complete video frame and the specific location of the privacy masking area within that frame. The masked area is clearly visible, facilitating adjustments to the position and size of the privacy masking area as needed, resulting in more accurate privacy masking configuration information. This allows for precise adjustment of the masked area in the real-time frame. Furthermore, the current location information is updated using the privacy masking configuration information to obtain the updated privacy masking area, achieving precise masking of the video frame.

[0047] Based on the above embodiments, the step of receiving the startup configuration stream signaling sent by the first client includes: Based on the current privacy-covered area, the current video data is encoded with the privacy-covered area to obtain a first live stream, and the first live stream is sent to the streaming media server; the streaming media server is used to copy and distribute the first live stream to the first client. Accordingly, receiving the start configuration stream signaling sent by the first client and performing video encoding on the current video data for the privacy-masking region to obtain the privacy-masking configuration bitstream includes: Stop video encoding the current video data with privacy-covered areas, and perform video encoding on the current video data without privacy-covered areas to obtain the privacy-covered configuration bitstream.

[0048] Specifically, when a user launches the client, the webcam automatically utilizes the current privacy-covered area to encode the current video data using the privacy-covered area, obtaining a first live stream, which is then sent to the streaming media server. The streaming media server then copies and distributes the first live stream to each client.

[0049] Therefore, when a user launches the first client, they can receive the first live stream distributed by the streaming media server. If the user then wants to update the current privacy-covered area, they open the privacy-covered area configuration interface. At this point, the first client sends a start configuration stream signaling to the network camera. Subsequently, the network camera needs to switch from encoding the live stream to encoding the privacy-covered configuration stream; that is, it stops encoding the current video data with the privacy-covered area and starts encoding the current video data without the privacy-covered area, resulting in the privacy-covered configuration stream.

[0050] In this embodiment of the invention, by switching the encoding process of the live bitstream and the privacy masking configuration bitstream, conflicts between different encoding processes can be avoided.

[0051] Based on the above embodiments, the step of receiving the startup configuration stream signaling sent by the first client further includes: The system receives a first live streaming start signaling sent by a second client, performs video encoding on the current video data with the privacy-covered area based on the current privacy-covered area, obtains a second live stream, and sends the second live stream to the streaming media server; the streaming media server is used to copy and distribute the second live stream to the second client.

[0052] Specifically, during the configuration of the privacy-covered area, after receiving the start configuration stream signaling sent by the first client, a first live stream start signaling sent by the second client can also be received. This second client can be a client logged in by a non-administrator user who needs to view the video, or it can be an application installed on an electronic device.

[0053] The first live stream initiation signal can be initiated by the user launching a second client to open the live video generation process. This first live stream initiation signal can be used to instruct the network camera to begin the generation and transmission of the live stream.

[0054] The network camera can utilize the current privacy-covered area to perform video encoding on the current video data, resulting in a second live stream. It's understood that this current privacy-covered area can be either the original privacy-covered area before the update or the updated privacy-covered area, depending on the timing of the first live stream initiation signaling. If the first live stream initiation signaling is sent before the update operation of the current privacy-covered area, then the current privacy-covered area is the original privacy-covered area before the update. If the first live stream initiation signaling is sent after the update operation of the current privacy-covered area, then the current privacy-covered area is the updated privacy-covered area.

[0055] Afterward, the webcam can send a second live stream to the streaming media server, which can then copy and distribute the second live stream to the second client.

[0056] The second client then parses the second live stream to obtain the real-time video. This real-time video contains areas that are obscured by the current privacy masking area.

[0057] In this embodiment of the invention, by using the current privacy-covering area to encode the current video data, a privacy-covering area is created. This ensures that the real-time image decoded by the second client contains an obscured area. Thus, during the configuration of the privacy-covering area, other users viewing the live stream are always protected by privacy coverage, preventing privacy exposure caused by the removal of the privacy cover. Furthermore, after updating the current privacy-covering area, if a user wants to view the live stream, the updated privacy-covering area can be used to obscure the live stream, facilitating the timely fulfillment of the privacy needs of the first client's users.

[0058] Based on the above embodiments, the step of performing video encoding on the acquired current video data for regions without privacy masking to obtain a privacy masking configuration bitstream includes: Determine the bitstream parameters of the first live bitstream; Based on the bitstream parameters of the first real-time bitstream, determine the bitstream parameters of the privacy masking configuration bitstream; Based on the bitstream parameters of the privacy masking configuration bitstream, the current video data is encoded for the non-privacy masking region to obtain the privacy masking configuration bitstream.

[0059] Specifically, before determining the privacy masking configuration bitstream, it is necessary to first determine the bitstream parameters of the privacy masking configuration bitstream, and then perform video encoding on the unmasked areas of the acquired current video data based on these bitstream parameters. The bitstream parameters of the privacy masking configuration bitstream are determined by the bitstream parameters of the first live bitstream.

[0060] First, determine the bitstream parameters of the first live bitstream. These first live bitstream parameters are the stored configuration bitstream parameters, which are the pre-configured bitstream parameters of the live bitstream that needs to be stored. They may include one or more of the following: bitrate, resolution, frame rate, etc., without specific limitations here.

[0061] Subsequently, based on the bitstream parameters of the first live stream, the bitstream parameters of the privacy masking configuration bitstream are determined. The bitstream parameters of the first live stream and the privacy masking configuration bitstream can be the same or different. To ensure that the configuration process does not interfere with the live viewing process of other users, the bitstream parameters of the first live stream and the privacy masking configuration bitstream can be set differently. Differences in bitstream parameters can include different bitstream parameter types or different bitstream parameter values. The value of the bitstream parameter of the first live stream can be superior to the value of the bitstream parameter of the privacy masking configuration bitstream. For example, if the bitstream parameter is bitrate, then the first live stream can be the primary bitstream, and the privacy masking configuration bitstream can be the secondary bitstream, or other bitstreams with different bitrates. This ensures that the first live stream and the privacy masking configuration bitstream are not the same bitstream, thereby ensuring that the configuration process does not interfere with the live viewing process of other users and also saving encoding resources.

[0062] Taking the primary live stream as the main stream and the secondary stream as the privacy masking stream as an example, if the network camera only has two encoding capabilities (i.e., it can only encode the main stream and the secondary stream), then when configuring privacy masking, because the secondary stream encoding capability of the network camera is occupied, if other users need to view the live feed, they can only view the main stream encoded normally by the network camera's main stream encoding capability. If the network camera has multiple encoding capabilities (i.e., it can encode not only the main stream and the secondary stream, but also other streams with different bitrate parameters), then when configuring privacy masking, if other users need to view the live feed, they can switch normally to the corresponding bitrate parameters that the network camera can encode, and the stream viewed is not limited to the main stream.

[0063] Finally, by using the bitstream parameters of the privacy-masking configuration bitstream, the current video data can be encoded in areas without privacy masking, resulting in a privacy-masking configuration bitstream that does not interfere with the encoding of the first live bitstream.

[0064] Based on the above embodiments, the step of performing video encoding on the current video data with the privacy-covered area based on the current privacy-covered area to obtain the second live bitstream specifically includes: While performing video encoding on the current video data without privacy masking areas to obtain a privacy masking configuration bitstream, the current video data is also performed video encoding on the current privacy masking areas to obtain a second live bitstream.

[0065] Specifically, in this embodiment of the invention, the process of encoding the video to obtain the second live stream and the privacy-masking configuration stream can be performed simultaneously. That is, while encoding the current video data for the non-privacy-masking region to obtain the privacy-masking configuration stream, the current video data can be encoded for the privacy-masking region using the current privacy-masking region to obtain the second live stream. This ensures timely response to operations from both the first and second clients.

[0066] Based on the above embodiments, the step of receiving the privacy masking configuration information sent by the first client and updating the current privacy masking area includes: The system receives a second live streaming start signal sent by the first client, performs video encoding on the current video data with the privacy-covered area based on the current privacy-covered area, obtains a third live stream, and sends the third live stream to the streaming media server; the streaming media server is used to copy and distribute the third live stream to the first client.

[0067] Specifically, after updating the current privacy-covered area, if the user of the first client wants to know the effect of the update, they can send a second live streaming start signal to the network camera through the first client. The network camera can then use the current privacy-covered area to encode the current video data with the privacy-covered area, obtaining a third live stream, and send the third live stream to the streaming media server. The streaming media server can then copy and distribute the third live stream to the first client.

[0068] Here, the second live stream start signaling can be generated by the user re-enabling the live feed after configuring a privacy masking area. This second live stream start signaling can be used to instruct the network camera to begin the generation and transmission of the live stream.

[0069] After receiving the third live stream, the first client parses it to obtain the live video feed. This live video feed contains areas that have been obscured by an updated privacy masking area. For example... Figure 4 The image shown is a schematic diagram of the real-time video feed. Figure 4 The black rectangular area in the image represents the area that is obscured in the real-time view by the updated privacy overlay area.

[0070] It is understandable that if the first live stream start signaling sent by the second client is after the current privacy coverage area has been updated, then the third live stream and the second live stream are the same stream.

[0071] In this embodiment of the invention, by responding to the second real-time streaming signaling of the first client, the user of the first client can conveniently view the update effect of the current privacy-covered area in a timely manner.

[0072] After updating the current privacy-covered area to obtain the updated privacy-covered area, if no live streaming signal is received from any client, the network camera can still directly use the updated privacy-covered area to encode the acquired current video data with the privacy-covered area, obtain the live stream, and store the live stream so that users can play back the stored live stream. The playback image is also covered by the updated privacy-covered area. Figure 5 The image shown is a schematic diagram of the playback. Figure 5 The black rectangular area in the image is the area that was covered by the updated privacy overlay area in the playback footage.

[0073] Based on the above embodiments, the step of receiving the startup configuration stream signaling sent by the first client includes: The system receives a third live streaming signal sent by the first client, performs video encoding on the acquired current video data with the privacy-covered area based on the current privacy-covered area, obtains a live stream, and sends the live stream to the streaming media server; the streaming media server is used to copy and distribute the live stream to the first client, and the first client is also used to parse the live stream to obtain real-time images; Alternatively, based on the current privacy-covered area, the acquired current video data can be encoded with the privacy-covered area to obtain a live stream, and the live stream can be stored.

[0074] Specifically, before receiving the start configuration stream signaling from the first client, the network camera can receive the third live stream start signaling from the first client. The third live stream start signaling can be used by the user to launch the first client and initiate live stream generation. This third live stream start signaling can be used to instruct the network camera to begin the live stream generation process.

[0075] Webcams can utilize the current privacy-covered area to encode the acquired video data in the privacy-covered area, thus obtaining a live stream.

[0076] After that, the webcam can send the live stream to the streaming media server, which then copies and distributes the live stream to the first client.

[0077] The first client then parses the live stream to obtain the real-time image. This real-time image contains areas that are obscured by the current privacy masking area.

[0078] In this embodiment of the invention, by using the current privacy-covering area to encode the acquired current video data with a privacy-covering area, the real-time image decoded by the first client can have an obscured area. In this way, before the current privacy-covering area is updated, there will always be privacy coverage when a user wants to view the live image, which is convenient for privacy protection. At the same time, it is convenient for the user corresponding to the first client to check whether the current privacy area configuration is accurate.

[0079] Before receiving the start configuration stream signaling sent by the first client, the network camera can also use the current privacy-covered area to encode the acquired current video data with the privacy-covered area to obtain a live stream, and store the live stream so that users can play back the stored live stream. The playback screen is also obtained by using the current privacy-covered area to cover the live screen.

[0080] like Figure 6 As shown, based on the above embodiments, this embodiment of the invention also provides a method for configuring a video privacy overlay area, applied to a first client, including: S21, send a start configuration stream signaling to the network camera, and receive the privacy masking configuration bitstream and the current location information of the current privacy masking area fed back by the network camera based on the start configuration stream signaling; S22, parse the privacy masking configuration bitstream to obtain a first real-time image, and superimpose the current location information onto the first real-time image; S23, obtain the privacy masking configuration information input by the user in the first real-time image, and send the privacy masking configuration information to the network camera.

[0081] Specifically, the video privacy covering area configuration method provided in this embodiment of the invention is executed by a first client.

[0082] First, in step S21, after receiving a trigger command from the user to switch the live feed on the first client to the privacy masking configuration interface, the first client can generate a start configuration stream signaling and send the start configuration stream signaling to the network camera. The network camera can then execute the steps in the embodiments described above, which use the network camera as the execution subject, to obtain the privacy masking configuration stream and the current location information of the current privacy masking area, and send the privacy masking configuration stream and the current location information of the current privacy masking area to the first client.

[0083] The first client receives the privacy masking configuration bitstream and the current location information of the current privacy masking area from the network camera based on the startup configuration stream signaling.

[0084] Then, step S22 is executed, where the first client parses the privacy masking configuration stream to obtain the first real-time image. This first real-time image contains no obscured areas, allowing the current location information to be overlaid on it. For example, a closed frame can be determined based on the current location information and then displayed on the first real-time image. The current location information in the first real-time image is as follows: Figure 7 As shown.

[0085] Users can view this first real-time frame, which provides a clear view of the complete video feed and allows them to determine the position and size of the current privacy-covered area. Users can then adjust the position and size of this area once or multiple times as needed, using gestures or mouse dragging to zoom in or out on the closed bounding box, drawing the updated closed bounding box of the privacy-covered area and obtaining privacy-covering configuration information. This configuration information can include the updated position and size of the privacy-covered area. The privacy-covering configuration information in the first real-time frame is as follows: Figure 8 As shown.

[0086] Finally, in step S23, the first client can obtain the privacy masking configuration information input by the user in the first real-time view and send the privacy masking configuration information to the network camera. If the network camera can receive the privacy masking configuration information sent by the first client, it will stop sending the privacy masking configuration stream to the first client, and update the current privacy masking area according to the privacy masking configuration information, changing the position and / or size of the current privacy masking area to obtain the updated privacy masking area.

[0087] Subsequently, the webcam can utilize the updated privacy-covered area to encode the acquired current video data with the privacy-covered area, obtain the current live stream, and send it to the streaming media server. The streaming media server then copies and distributes the current live stream to the first client.

[0088] The video privacy masking region configuration method provided in this embodiment of the invention first sends a start configuration stream signaling to the network camera and receives the privacy masking configuration bitstream and the current location information of the current privacy masking region from the network camera based on the start configuration stream signaling. Then, the privacy masking configuration bitstream is parsed to obtain a first real-time image, and the current location information is superimposed on the first real-time image. Finally, a user-triggered save command is received, the privacy masking configuration information input by the user in the first real-time image is obtained, and the privacy masking configuration information is sent to the network camera. This method, by receiving the privacy masking configuration bitstream and the current location information of the current privacy masking region, allows the user to view the complete image of the current video data and the specific location of the current privacy masking region within the complete image. The masked area in the complete image is clearly visible, facilitating the user to adjust the position and size of the current privacy masking region as needed, obtaining more accurate privacy masking configuration information, and enabling precise adjustment of the masked area in the real-time image. Furthermore, the current location information is updated using the privacy masking configuration information to obtain the updated privacy masking region, achieving precise masking of the video image.

[0089] Based on the above embodiments, obtaining the privacy masking configuration information input by the user in the first real-time screen includes: After receiving a save command triggered by the user, the privacy masking configuration information is obtained.

[0090] Specifically, the first client can be configured with a save button, which users can click to trigger a save command. The first client can receive this save command, and after receiving it, it retrieves the privacy masking configuration information and sends it to the webcam. This allows the privacy masking area to be adjusted and then sent out all at once, reducing the loading process caused by multiple network interactions.

[0091] Based on the above embodiments, before sending the start configuration stream signaling to the network camera, the following steps are included: Send a second live streaming start signal to the network camera and receive a fourth live stream from the network camera based on the current privacy-covered area; The fourth live stream is parsed to obtain the second live video feed; Alternatively, send a playback start signaling message to the network camera and receive the historical bitstream stored by the network camera, which is encoded based on the current privacy masking area; The historical bitstream is parsed to obtain the playback footage.

[0092] Specifically, before sending the start configuration stream signaling to the network camera, the first client can first send a second live stream start signaling to the network camera. When the user starts the first client and opens the live feed, this triggers the generation of the second live stream start signaling. This second live stream start signaling can be used to instruct the network camera to begin the generation and transmission of the live stream. The network camera can utilize the current privacy-covered area to perform video encoding on the acquired current video data with the privacy-covered area, obtaining a fourth live stream, and then send the fourth live stream to the streaming media server. The streaming media server then copies and distributes the fourth live stream to the first client.

[0093] After receiving the fourth live stream, the first client can parse it to obtain the second live view. This second live view contains areas that are obscured by the current privacy masking area.

[0094] In this embodiment of the invention, the second real-time image decoded by the first client has an obscured area. This ensures that before the current privacy obscuration area is updated, there is always privacy obscuration when a user wants to view the live image, which is conducive to privacy protection. At the same time, it is convenient for the user corresponding to the first client to check whether the current privacy area configuration is accurate.

[0095] Before sending the start configuration stream signaling to the network camera, the first client can also send a playback start stream signaling to the network camera. The playback start stream signaling can be initiated by the user launching the first client and opening the live feed generation. This playback start stream signaling can be used to instruct the network camera to begin the playback feed generation process.

[0096] Webcams can utilize the current privacy-covered area to encode the acquired video data in the privacy-covered area, thus obtaining the historical bitstream.

[0097] Afterward, the webcam can send the historical stream to a streaming media server, which then copies and distributes the historical stream to the first client. The first client can parse the historical stream to obtain the playback image. This playback image contains areas that are obscured by the current privacy masking area.

[0098] In summary, the video privacy masking region configuration method provided in this embodiment of the invention addresses the pain points of wide area network privacy masking configuration and proposes a new method for wide area network privacy masking configuration. The default privacy masking area for network cameras is A. Both live and playback streams are encoded normally according to privacy masking area A. Therefore, regardless of whether the user is watching the live or playback stream, they will see video protected by the privacy masking area. When a user with administrator privileges opens the privacy masking configuration interface, the first client sends a start configuration stream signaling to the network camera. Upon receiving the start configuration stream signaling, the network camera, when encoding the privacy masking configuration stream, does not include privacy masking area A in the privacy masking configuration stream. Instead, it carries the location information of privacy masking area A when sending the privacy masking configuration stream. After receiving the privacy masking configuration stream and the location information of privacy masking area A, the first client decodes the video and overlays the location information of privacy masking area A onto the first live screen. The user then adjusts the privacy masking area to B, sends and saves the changes, and the network camera's privacy masking area is updated from A to B.

[0099] If some users have guest privileges and only have permission to watch live and replay video streams, but not permission to update the privacy overlay area, then the entire screen seen by these guest users will be covered by the privacy overlay area, which can effectively protect privacy while configuring the privacy overlay.

[0100] like Figure 9 As shown, based on the above embodiments, this embodiment of the invention provides a video privacy masking area configuration device, applied to a network camera, comprising: The video encoding module 91 is used to receive the start configuration stream signaling sent by the first client, and to encode the current video data for the non-privacy masking area to obtain the privacy masking configuration bitstream; The privacy masking configuration module 92 is used to determine the current location information of the current privacy masking area, and send the privacy masking configuration stream and the current location information to the first client; the first client is used to parse the privacy masking configuration stream to obtain a first real-time image, overlay the current location information on the first real-time image, and receive the privacy masking configuration information input by the user in the first real-time image; The privacy masking update module 93 is used to receive the privacy masking configuration information sent by the first client and update the current privacy masking area.

[0101] Based on the above embodiments, the video encoding module is further used for: Before receiving the start configuration stream signaling sent by the first client, the current video data is encoded with a privacy-covered area based on the current privacy-covered area to obtain a first live stream, and the first live stream is sent to the streaming media server; the streaming media server is used to copy and distribute the first live stream to the first client. Stop video encoding the current video data with privacy-covered areas, and perform video encoding on the current video data without privacy-covered areas to obtain the privacy-covered configuration bitstream.

[0102] Based on the above embodiments, the video encoding module is further used for: The system receives a first live streaming start signaling sent by a second client, performs video encoding on the current video data with the privacy-covered area based on the current privacy-covered area, obtains a second live stream, and sends the second live stream to the streaming media server; the streaming media server is used to copy and distribute the second live stream to the second client.

[0103] Based on the above embodiments, the video encoding module is further used for: While performing video encoding on the current video data without privacy masking areas to obtain a privacy masking configuration bitstream, the current video data is also performed video encoding on the current privacy masking areas to obtain a second live bitstream.

[0104] Based on the above embodiments, the video encoding module is further used for: The system receives a second live streaming start signal sent by the first client, performs video encoding on the current video data with the privacy-covered area based on the current privacy-covered area, obtains a third live stream, and sends the third live stream to the streaming media server; the streaming media server is used to copy and distribute the third live stream to the first client.

[0105] Specifically, the functions of each module in the video privacy covering area configuration device provided in this embodiment of the invention correspond one-to-one with the operation flow of each step in the above-mentioned method embodiment with network camera as the execution subject, and the achieved effect is also the same. For details, please refer to the above embodiments, and this will not be repeated in this embodiment of the invention.

[0106] like Figure 10 As shown, based on the above embodiments, this embodiment of the invention provides a video privacy overlay area configuration device, applied to a first client, comprising: The information interaction module 101 is used to send a start configuration stream signaling to the network camera and receive the privacy masking configuration bitstream and the current location information of the current privacy masking area fed back by the network camera based on the start configuration stream signaling. The information overlay module 102 is used to parse the privacy masking configuration bitstream to obtain a first real-time image, and overlay the current location information onto the first real-time image; User configuration module 103 is used to obtain privacy masking configuration information input by the user in the first real-time image and send the privacy masking configuration information to the network camera.

[0107] Based on the above embodiments, the user configuration module is specifically used for: After receiving a save command triggered by the user, the privacy masking configuration information is obtained.

[0108] Based on the above embodiments, the information interaction module is further used for: Before sending the start configuration stream signaling to the network camera, a second live stream start signaling is sent to the network camera, and a fourth live stream is received from the network camera based on the current privacy coverage area. The information overlay module is also used for: The fourth live stream is parsed to obtain the second live video feed; or, The information interaction module is also used for: Send a playback start signaling message to the network camera and receive the historical bitstream stored by the network camera, which is encoded based on the current privacy masking area; The information overlay module is also used for: The historical bitstream is parsed to obtain the playback footage.

[0109] Specifically, the functions of each module in the video privacy covering area configuration device provided in this embodiment of the invention correspond one-to-one with the operation flow of each step in the above-mentioned method-like embodiment with the first client as the execution subject, and the achieved effects are also the same. For details, please refer to the above-mentioned embodiments, and this will not be repeated in this embodiment of the invention.

[0110] Figure 11 An example is a schematic diagram of the physical structure of an electronic device, such as... Figure 11 As shown, the electronic device may include a processor 110, a communications interface 120, a memory 130, and a communication bus 140, wherein the processor 110, the communications interface 120, and the memory 130 communicate with each other via the communication bus 140. The processor 110 can call logical instructions in the memory 130 to execute the video privacy masking region configuration method provided in various embodiments.

[0111] Furthermore, the logical instructions in the aforementioned memory 130 can be implemented as software functional units and, when sold or used as independent products, can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to related technologies, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0112] On the other hand, the present invention also provides a computer program product, the computer program product including a computer program that can be stored on a non-transitory computer-readable storage medium, and when the computer program is executed by a processor, the computer is able to execute the video privacy masking area configuration method provided in the various embodiments.

[0113] In another aspect, the present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, is implemented to perform the video privacy masking region configuration method provided in the various embodiments.

[0114] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.

[0115] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus necessary general-purpose hardware platforms, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the parts that contribute to the related technology, can be embodied in the form of software products. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments or some parts of the embodiments.

[0116] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for configuring a video privacy overlay area, characterized in that, Applications in network cameras, including: Receive the start configuration stream signaling sent by the first client, encode the current video data for the non-privacy masking area, and obtain the privacy masking configuration bitstream; The current location information of the current privacy-covered area is determined, and the privacy-covered configuration stream and the current location information are sent to the first client. The first client is used to parse the privacy-covered configuration stream to obtain a first real-time image, overlay the current location information on the first real-time image, and receive the privacy-covered configuration information input by the user in the first real-time image. The privacy masking configuration information sent by the first client is received, and the current privacy masking area is updated.

2. The video privacy covering area configuration method according to claim 1, characterized in that, The process of receiving the startup configuration stream signaling sent by the first client includes, prior to: Based on the current privacy-covered area, the current video data is encoded with the privacy-covered area to obtain a first live stream, and the first live stream is sent to the streaming media server; the streaming media server is used to copy and distribute the first live stream to the first client. Accordingly, receiving the start configuration stream signaling sent by the first client and performing video encoding on the current video data for the non-privacy-masking region to obtain the privacy-masking configuration bitstream includes: Stop video encoding the current video data with privacy-covered areas, and perform video encoding on the current video data without privacy-covered areas to obtain the privacy-covered configuration bitstream.

3. The video privacy covering area configuration method according to claim 1, characterized in that, The process of receiving the startup configuration stream signaling sent by the first client further includes: The system receives a first live streaming start signaling sent by a second client, performs video encoding on the current video data with the privacy-covered area based on the current privacy-covered area, obtains a second live stream, and sends the second live stream to the streaming media server; the streaming media server is used to copy and distribute the second live stream to the second client.

4. The video privacy covering area configuration method according to claim 3, characterized in that, The step of performing video encoding on the current video data based on the current privacy-covered region to obtain the second live bitstream specifically includes: While performing video encoding on the current video data without privacy masking areas to obtain a privacy masking configuration bitstream, the current video data is also performed video encoding on the current privacy masking areas to obtain a second live bitstream.

5. The video privacy covering area configuration method according to claim 1, characterized in that, The step of receiving the privacy masking configuration information sent by the first client, updating the current privacy masking area, and then including: The system receives a second live streaming start signal sent by the first client, performs video encoding on the current video data with the privacy-covered area based on the current privacy-covered area, obtains a third live stream, and sends the third live stream to the streaming media server; the streaming media server is used to copy and distribute the third live stream to the first client.

6. A method for configuring a video privacy overlay area, characterized in that, Applied to the first client, including: Send a start configuration stream signaling to the network camera, and receive the privacy masking configuration bitstream and the current location information of the current privacy masking area fed back by the network camera based on the start configuration stream signaling; The privacy masking configuration bitstream is parsed to obtain a first real-time image, and the current location information is superimposed on the first real-time image; Obtain the privacy masking configuration information input by the user in the first real-time frame, and send the privacy masking configuration information to the network camera.

7. The video privacy covering area configuration method according to claim 6, characterized in that, The step of obtaining the privacy masking configuration information input by the user in the first real-time screen includes: After receiving a save command triggered by the user, the privacy masking configuration information is obtained.

8. The video privacy covering area configuration method according to claim 6, characterized in that, The step of sending the start configuration stream signaling to the network camera includes: Send a second live streaming start signal to the network camera and receive a fourth live stream from the network camera based on the current privacy-covered area; The fourth live stream is parsed to obtain the second live video feed; Alternatively, send a playback start signaling message to the network camera and receive the historical bitstream stored by the network camera, which is encoded based on the current privacy masking area; The historical bitstream is parsed to obtain the playback footage.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the program, it implements the video privacy masking region configuration method as described in any one of claims 1-8.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the video privacy masking region configuration method as described in any one of claims 1-8.

Images