Video processing method, video transmission method, video viewing method and device

Abstract

The embodiments of the present application provide a video processing method, a video transmission method, a video viewing method and a device. The video processing method includes obtaining encoded video data; the video data includes at least one frame of image data; identifying image data with sensitive areas in the video data; and encrypting the sensitive areas in the image data using key information to obtain encrypted video data. Through the video processing method of the embodiment of the present application, the sensitive areas can be encrypted based on the encoded video data, which can avoid affecting the encoding process of the video and reducing the encoding efficiency of the video. The sensitive areas in the image data are encrypted using key information, and the encrypted video data and the encoded video data can have a smaller data volume difference without affecting the video quality.

Description

Technical Field

[0001] The present application relates to the field of video processing technology, and in particular to a video processing method, a video transmission method, a video viewing method, a video processing device, a video transmission device, and a video viewing device. Background Art

[0002] In the existing technology, videos may have high information protection requirements. For example, in special fields such as industry, commerce, and medicine, confidential or sensitive content captured in the video needs to be shielded. For another example, some users do not want their faces to appear in the video. For another example, in a video of a factory environment, specific facilities need to be masked. In this case, the video can be processed to prevent the content that needs to be protected from being viewed by unrelated personnel. However, since the video is composed of a large number of images, if the images in the video need to be processed separately, the amount of video data may increase significantly, which is not conducive to the video encoding and decoding processing and video transmission. Summary of the Invention

[0003] In view of the above problems, the embodiments of the present application are proposed to provide a video processing method, a video transmission method, a video viewing method, a video processing device, a video transmission device, and a video viewing device that overcome the above problems or at least partially solve the above problems.

[0004] In order to solve the above problems, the present application discloses a video processing method, including:

[0005] Acquire encoded video data; the video data includes at least one frame of image data;

[0006] Identifying image data containing sensitive areas in the video data;

[0007] The sensitive area in the image data is encrypted using the key information to obtain encrypted video data.

[0008] Optionally, the method further includes:

[0009] The key information is recorded in the encrypted video data.

[0010] Optionally, the method further includes:

[0011] The identification information of the image data where the sensitive area exists and the position information of the sensitive area in the image data are recorded in the encrypted video data.

[0012] Optionally, the step of using key information to encrypt the sensitive area in the image data to obtain encrypted video data includes:

[0013] determining a location of the sensitive area in the image data;

[0014] The key information is used to perform an encryption operation on the data at the location of the sensitive area in the image data to obtain encrypted video data.

[0015] Optionally, the step of identifying image data containing sensitive areas in the video data includes:

[0016] Identifying image data containing at least one sensitive content in the video data, and determining sensitive areas where the sensitive content is located in the image data;

[0017] Allocating sensitive content identification codes to the sensitive contents respectively;

[0018] For the sensitive content, a corresponding relationship between the sensitive content identification code and key information is established.

[0019] Optionally, the step of using key information to encrypt the sensitive area in the image data to obtain encrypted video data includes:

[0020] For the sensitive area where the sensitive content in the image data is located, the key information corresponding to the sensitive content identification code is used to encrypt the sensitive area where the sensitive content in the image data is located to obtain encrypted video data.

[0021] The present application also discloses a video processing method, which includes:

[0022] Obtaining encoded encrypted video data and key information; the encrypted video data includes at least one frame of encrypted image data;

[0023] The key information is used to decrypt the sensitive area in the encrypted image data to obtain decrypted video data.

[0024] The present application also discloses a video transmission method, which is applied to a transmitting end and a receiving end. The method includes:

[0025] The transmitting end obtains the encoded video data; the video data includes at least one frame of image data;

[0026] The sending end identifies image data having a sensitive area in the video data;

[0027] The transmitting end uses the key information to encrypt the sensitive area in the image data to obtain encrypted video data; the encrypted video data includes at least one frame of encrypted image data;

[0028] The receiving end receives the encrypted video data and the key information sent by the sending end;

[0029] The receiving end uses the key information to decrypt the encrypted image data to obtain decrypted video data.

[0030] The present application also discloses a video viewing method, which includes:

[0031] Obtaining authentication information entered by the user for the encrypted video data;

[0032] Searching for key information matching the authentication information;

[0033] Decrypting the image data in the sensitive area of ​​the encrypted video data using the key information to obtain decrypted video data;

[0034] The decrypted video data is presented to a user.

[0035] The embodiment of the present application discloses a video processing device, comprising:

[0036] A video acquisition module, configured to acquire encoded video data; the video data includes at least one frame of image data;

[0037] an identification module, configured to identify image data containing sensitive areas in the video data;

[0038] The encryption module is used to encrypt the sensitive area in the image data using key information to obtain encrypted video data.

[0039] Optionally, the device further comprises:

[0040] A key recording module is used to record the key information in the encrypted video data.

[0041] Optionally, the device further comprises:

[0042] An information recording module is used to record identification information of image data containing the sensitive area and location information of the sensitive area in the image data in the encrypted video data.

[0043] Optionally, the encryption module includes:

[0044] a position determination submodule, configured to determine the position of the sensitive area in the image data;

[0045] The encryption operation submodule is used to use the key information to perform an encryption operation on the data at the location of the sensitive area in the image data to obtain encrypted video data.

[0046] Optionally, the identification module includes:

[0047] an identification submodule, configured to identify image data containing at least one sensitive content in the video data, and determine sensitive areas where the sensitive content is located in the image data;

[0048] an allocation submodule, configured to allocate sensitive content identification codes to the sensitive contents respectively;

[0049] The relationship establishing submodule is used to establish a corresponding relationship between the sensitive content identification code and the key information for the sensitive content.

[0050] Optionally, the encryption module includes:

[0051] The encryption submodule is used to encrypt the sensitive area where the sensitive content in the image data is located using the key information corresponding to the sensitive content identification code to obtain encrypted video data.

[0052] The present application also discloses a video processing device, comprising:

[0053] An encrypted video acquisition module is used to acquire encoded encrypted video data and key information; the encrypted video data includes at least one frame of encrypted image data;

[0054] The decryption module is used to decrypt the sensitive area in the encrypted image data using the key information to obtain decrypted video data.

[0055] The embodiment of the present application also discloses a video transmission device, which is applied to a sending end and a receiving end. The sending end includes a coded video acquisition module, a sensitive data identification module, and a data encryption module; the receiving end includes an encrypted data receiving module and a video decryption module;

[0056] The encoded video acquisition module is used to acquire encoded video data; the video data includes at least one frame of image data;

[0057] The sensitive data identification module is used to identify image data containing sensitive areas in the video data;

[0058] The data encryption module is used to encrypt the sensitive area in the image data using key information to obtain encrypted video data; the encrypted video data includes at least one frame of encrypted image data;

[0059] The encrypted data receiving module is used to receive the encrypted video data and the key information sent by the sending end;

[0060] The video decryption module is used to decrypt the encrypted image data using the key information to obtain decrypted video data.

[0061] The present application also discloses a video viewing device, comprising:

[0062] An authentication acquisition module, used to obtain authentication information input by the user for encrypted video data;

[0063] A key matching module, configured to search for key information matching the authentication information;

[0064] a video decryption module, configured to decrypt image data in sensitive areas of the encrypted video data using the key information to obtain decrypted video data;

[0065] The video display module is used to display the decrypted video data to the user.

[0066] The present application also discloses an electronic device, including:

[0067] one or more processors; and

[0068] One or more machine-readable media having instructions stored thereon, when executed by the one or more processors, enable the electronic device to perform one or more methods as described in the embodiments of the present application.

[0069] The embodiments of the present application also disclose one or more machine-readable media having instructions stored thereon, which, when executed by one or more processors, enable the processors to perform one or more methods as described in the embodiments of the present application.

[0070] The embodiments of the present application also disclose a software product, including a computer program / instruction, wherein when the computer program / instruction is executed, any one of the methods described in the embodiments of the present application is implemented.

[0071] The embodiments of the present application include the following advantages:

[0072] The video processing method of the embodiment of the present application can obtain encoded video data; identify image data containing sensitive areas in the video data; and encrypt the sensitive areas in the image data using key information to obtain encrypted video data. Thus, the sensitive areas can be encrypted based on the encoded video data without affecting the video encoding process or reducing video encoding efficiency. Furthermore, by using key information to encrypt the sensitive areas in the image data, the encrypted video data can have a smaller data size difference than the encoded video data, without affecting video quality. BRIEF DESCRIPTION OF THE DRAWINGS

[0073] Figure 1 This is a flowchart of the steps of a video processing method embodiment of the present application;

[0074] Figure 2 A schematic diagram of an image data processing process according to an embodiment of the present application;

[0075] Figure 3 This is a flowchart of another video processing method embodiment of the present application;

[0076] Figure 4 A schematic diagram of a video data structure according to an embodiment of the present application

[0077] Figure 5 This is another schematic diagram of a video data structure according to an embodiment of the present application;

[0078] Figure 6 This is a flowchart of another video processing method embodiment of the present application;

[0079] Figure 7 This is a flowchart of a video transmission method according to an embodiment of the present application;

[0080] Figure 8 This is a flowchart of a video viewing method embodiment of the present application;

[0081] Figure 9 This is a structural block diagram of a video processing device embodiment of the present application;

[0082] Figure 10 is a structural block diagram of another video processing device embodiment of the present application;

[0083] Figure 11 This is a structural block diagram of a video transmission device embodiment of the present application;

[0084] Figure 12 This is a structural block diagram of an embodiment of a video viewing device according to an embodiment of the present application. DETAILED DESCRIPTION

[0085] In order to make the above-mentioned purposes, features and advantages of the present application more obvious and easy to understand, the present application is further described in detail below with reference to the accompanying drawings and specific implementation methods.

[0086] In the embodiment of the present application, generally speaking, a video can be composed of multiple frames of continuous images. In the case where the video is an unprocessed original video, the video can have a large amount of data. For example, for a video with a resolution of 1920×1280 pixels and a frame rate of 24 frames, the data volume of each frame can be 6.22MB. If the video is 90 minutes long, the data volume can be close to 1000GB. Therefore, the video usually needs to be encoded, and some frames retain all information, while some frames only retain data that is different from other frames. During subsequent decoding, inter-frame prediction is performed based on the frames before and / or after the frame to predict all the content contained in the frame, thereby achieving compression of the video.

[0087] Specifically, the encoded video can contain the following types of images:

[0088] I-frames (Intra-coded pictures): They contain complete information and occupy the largest space compared to other types of pictures. I-frames can be decoded independently without referencing other pictures.

[0089] A P-frame (Predictive-coded Picture) records the difference between itself and the previous frame. The previous frame can be an I-frame or a P-frame. During decoding, the difference defined by the current frame is superimposed on the previously decoded image to generate the final image. It has a high compression ratio and occupies relatively little space.

[0090] B-frames (Bidirectionally predicted pictures): These record the differences between themselves and the preceding and following frames. The preceding and following frames can be I-frames or P-frames. During decoding, the differences defined by the current frame are superimposed on the decoded images before and after the frame to generate the final image. B-frames can achieve higher compression rates and occupy less space than P-frames.

[0091] In the embodiments of the present application, generally speaking, when it is necessary to process a video to protect sensitive content, each frame of the video containing sensitive content can be processed. In this case, the processed image can be replaced with the unprocessed image in the video, thereby completing the processing of the sensitive content in the video. However, using this image replacement method can easily result in the previous and next frames being unable to reference each other during the encoding process, significantly reducing the encoding efficiency of the video and significantly increasing the video data volume.

[0092] Therefore, the embodiment of the present application processes the video based on the already encoded video data, identifies the image data in the sensitive area in the video data, and uses the key information to encrypt the sensitive area in the image data, so that unauthorized personnel cannot view the content in the encrypted sensitive area. At the same time, because the embodiment of the present application encrypts the already encoded video data, the encryption process will not significantly affect the data volume of the video. The encrypted video data is relatively close to the original video data, and it will not affect the encoding efficiency and video quality of the video.

[0093] Reference Figure 1 , shows a flowchart of a video processing method according to an embodiment of the present application, which may specifically include the following steps:

[0094] Step 101: Obtain encoded video data; the video data includes at least one frame of image data;

[0095] In an embodiment of the present application, when video data needs to be processed, encoded video data can be obtained. The video data can include at least one frame of image data. The image data can be any one of an I-frame, a P-frame, and a B-frame.

[0096] Specifically, the video data may be video data of complete content or video data of content transmitted in real time. If the video data is video data of complete content, such as video data of a movie or concert stored locally, the video data may include I frames, or the video data may include I frames, P frames, and / or B frames. If the video data is video data of content transmitted in real time, such as video data of a live broadcast or real-time video conference, the video data may include I frames, or the video data may include I frames and P frames.

[0097] Step 102, identifying image data containing sensitive areas in the video data;

[0098] In an embodiment of the present application, it is possible to identify whether at least one frame of image data in the video data has a sensitive area recording sensitive content, thereby identifying image data with a sensitive area in the video data.

[0099] Specifically, the sensitive area may be an area in the image data containing sensitive content. The sensitive area may be the entire area of ​​the image data or a portion of the image data. The sensitive content may be content that needs to be protected to prevent unauthorized access. For example, images of production equipment, product images, terrain images, real scenes of office areas or production areas that need to be protected in the industrial, commercial, and medical fields; facial images or full-body images of people; trademark information of products, and copyrighted portraits.

[0100] In a specific implementation, template matching, model recognition, and the like can be used to identify sensitive areas containing sensitive content in the image data. For example, when template matching is used, images related to the sensitive content can be prepared in advance as templates, and the image data can be searched to see whether there are areas with a high degree of similarity to the template. If so, the areas can be used as sensitive areas. For another example, when model recognition is used, images related to the sensitive content can be prepared in advance as training samples to train the model. After the model training is completed, the model can be used to identify whether there are sensitive areas in the image data. When there are sensitive areas in the image data, the model can output the location information of the sensitive areas in the image data, so that the location information of the sensitive areas can be determined while knowing whether there are sensitive areas in the image data.

[0101] In a specific implementation, since the image data of the P frame or B frame type usually does not have complete image information, it may result in the inability to normally identify the sensitive area in the image data. Therefore, when identifying whether there is a sensitive area in the image data, the image data can be first decoded, and then the decoded image data can be used to identify whether there is a sensitive area. If there is a sensitive area, the position information of the sensitive area can be recorded to facilitate the subsequent encryption of the sensitive area in the encoded image data. If there is unencoded video data, it is also possible to first identify the image data with sensitive areas in the unencoded video data before encoding the video data, and record the position information of the sensitive areas in the unencoded image data. After the encoding of the video data is completed, the position information of the sensitive areas in the unencoded image data is used as the position information of the sensitive areas in the corresponding encoded image data.

[0102] Step 103: Use the key information to encrypt the sensitive area in the image data to obtain encrypted video data.

[0103] In an embodiment of the present application, after identifying image data containing sensitive areas in the video data, key information can be used to encrypt the sensitive areas in the image data to protect sensitive content in the sensitive areas.

[0104] Specifically, the key information can be pre-generated. The key information can be used to perform an encryption operation on the data in the sensitive area of ​​the image data to obtain encrypted video data. This prevents the video codec module from decoding the sensitive area in the image data without knowing the key information, thereby obtaining a normal image of the sensitive area. For example, without knowing the key information, the sensitive area may be decoded as a black image. This effectively protects sensitive content in the video data.

[0105] Since encryption occurs after encoding, it does not affect the video encoding process and reduce video encoding efficiency. Furthermore, since the key information is used to directly perform encryption operations on the encoded image data, the difference in data size between the encrypted image data and the encoded image data is minimal, and the video data size is not significantly altered.

[0106] As a specific example of the present application, in a video conferencing scenario, the video encryption method of the present application can be adopted, and the video processing method of the present application can be adopted to encrypt the faces of participants in real-time transmitted conference video data and / or specific devices displayed in the conference to prevent the privacy of participants and / or specific devices from being leaked.

[0107] In the scenario of special child monitoring, the video processing method of the present application can be used to encrypt the face of the special child in the real-time transmitted special child monitoring video data, thereby preventing the identity of the special child from being disclosed.

[0108] In the context of video entertainment, specific stars appearing in entertainment videos can be encrypted. Depending on actual needs, some viewers can avoid seeing specific stars they don't want to see in entertainment videos, while others can decrypt the encrypted entertainment videos to see the specific stars they want to see.

[0109] As a specific example of this application, Figure 2This is a schematic diagram of the image data processing process of an embodiment of the present application. The original image data 201 may be image data obtained by decoding a frame of image data A in the encoded video data. In the case where the sensitive content is a face, a face recognition model, such as a RetinaFace model, an MTCNN (Multi-task Cascaded Convolutional Networks) model, an S3FD (Single Shot Scale-invariant Face Detector) model, etc., may be used to perform face detection on the original image data 201, so as to determine the sensitive area 202 where the face is located in the original image data 201, thereby determining the sensitive area in the image data A corresponding to the original image data 201. Thereafter, the key information may be used to encrypt the sensitive area in the image data A to obtain encrypted image data A. After completing encryption of the sensitive areas in the video data, if the user decrypts the image data A without the key information, the user can obtain decrypted image data 203. However, due to the lack of key information, the sensitive areas in the decrypted image data 203 cannot be properly decoded and are displayed in black. If the user has the key information, the original image data 201 can be obtained after decoding.

[0110] The video processing method of the embodiment of the present application can obtain encoded video data; identify image data containing sensitive areas in the video data; and encrypt the sensitive areas in the image data using key information to obtain encrypted video data. Thus, the sensitive areas can be encrypted based on the encoded video data without affecting the video encoding process or reducing video encoding efficiency. Furthermore, by using key information to encrypt the sensitive areas in the image data, the encrypted video data can have a smaller data size difference than the encoded video data, without affecting video quality.

[0111] Reference Figure 3 , shows a flowchart of a video processing method according to an embodiment of the present application, which may specifically include the following steps:

[0112] Step 301: Obtain encoded video data; the video data includes at least one frame of image data;

[0113] In an embodiment of the present application, when video data needs to be processed, encoded video data can be obtained. The video data can include at least one frame of image data. The image data can be any one of an I-frame, a P-frame, and a B-frame.

[0114] Step 302: Identify image data containing sensitive areas in the video data;

[0115] In an embodiment of the present application, it is possible to identify whether at least one frame of image data in the video data has a sensitive area recording sensitive content, thereby identifying image data with a sensitive area in the video data.

[0116] Specifically, the sensitive area may be an area in the image data containing sensitive content. The sensitive area may be the entire area in the image data or a portion of the image data. The sensitive content may be content that needs to be protected to prevent unauthorized access. In a specific implementation, template matching, model recognition, or the like may be used to identify sensitive areas in the image data containing sensitive content. For example, when using template matching, images related to the sensitive content may be prepared in advance as templates, and the image data may be searched for areas with a high degree of similarity to the template. If so, the areas may be identified as sensitive areas. For another example, when using model recognition, images related to the sensitive content may be prepared in advance as training samples to train the model. After model training is complete, the model may be used to identify whether a sensitive area exists in the image data. If a sensitive area exists in the image data, the model may output location information of the sensitive area in the image data, thereby determining both the presence of a sensitive area in the image data and the location information of the sensitive area.

[0117] In one embodiment of the present application, the step of identifying image data containing sensitive areas in the video data includes:

[0118] S11, identifying image data containing at least one sensitive content in the video data, and determining sensitive areas where the sensitive content is located in the image data respectively;

[0119] In an embodiment of the present application, the video data may contain one or more sensitive contents. For example, the video data may contain multiple people's faces, and each person's face may be a type of sensitive content. For another example, the video data may contain production equipment that needs to be kept confidential, as well as people's faces. The production equipment may be one type of sensitive content, and the human face may be another type of sensitive content. To prevent the possible leakage of key information that could lead to the disclosure of all types of sensitive content in the video data, different sensitive contents can be distinguished and encrypted using different methods.

[0120] Therefore, while identifying whether there is image data containing sensitive areas in the video data, it is also possible to further identify the type of sensitive content contained in the sensitive area, and further distinguish the sensitive areas in the image data based on the type of sensitive content, and determine the sensitive areas where different sensitive contents are located in the image data.

[0121] Specifically, the sensitive area containing the sensitive content in an image data may be one or more. For example, if the sensitive content is production equipment, the image data may contain multiple production equipment, and the image data may contain multiple areas containing production equipment, thereby having multiple sensitive areas. If the sensitive content is a face, each person's face may be a type of sensitive content, and the area corresponding to each person's face in the image data may correspond to a sensitive area.

[0122] S12, assigning sensitive content identification codes to the sensitive contents respectively, and establishing a correspondence between the sensitive content identification codes and the sensitive areas;

[0123] In an embodiment of the present application, sensitive content identification codes can be assigned to the sensitive content, and a correspondence between the sensitive content identification codes and the sensitive areas can be established. Based on the sensitive content identification codes, sensitive areas of different sensitive content can be distinguished in the image data, and sensitive areas of different image data containing the same sensitive content can be quickly identified in the video data.

[0124] For example, when parents remotely monitor children attending kindergarten, multiple children may be present in the video data at the same time. A sensitive content identification code can be assigned to each child in the video data, and a corresponding relationship between the sensitive content identification code and the area in the image data where the child is located, i.e., the sensitive area, can be established. In this way, the image data in which a specific child appears can be quickly determined based on the sensitive content identification code. If different children appear in the same image data at the same time, the sensitive area corresponding to each child in the same image data can also be distinguished based on the sensitive content identification code. Thereafter, if it is necessary to decrypt the encrypted image data in the video data, corresponding sensitive content identification codes can be assigned to the parents of different children, so that parents can view the video data related to their own children while avoiding exposing the privacy of other children.

[0125] For another example, when analyzing pedestrian flow in a retail scenario, the video data may be video data from locations such as shopping mall entrances and exits, retail store entrances and exits, and retail store counters. The video data may contain multiple different customers. Each customer in the video may be assigned a sensitive content identification code. A group of customers appearing simultaneously may use the same identification code, or each customer may be assigned a sensitive content identification code, etc., and this application does not impose any restrictions thereon. Subsequently, a correspondence between the sensitive content identification code and the customer's face, i.e., the sensitive area, may be established. When passenger flow analysis is required, since the sensitive content identification code corresponds to the customer, passenger flow analysis can be performed using the sensitive content identification code and the time and location of the appearance of the sensitive area corresponding to the sensitive content identification code in the video data. This allows passenger flow analysis to be completed while protecting customer privacy. Furthermore, the encryption process for the video data can be completed immediately after the video data is collected, so that the video has been encrypted during transmission, preventing the leakage of customer privacy during video transmission. In addition, based on actual needs and with the customer's consent, the encrypted image data in the video data can be decrypted to view the video data related to the customer while avoiding exposing the privacy of other customers.

[0126] In a specific implementation, during the process of identifying image data containing sensitive areas, if the sensitive content in the sensitive area is found to be newly emerged, a sensitive content identification code may be generated for the sensitive content. Simultaneously, after determining the location information of the sensitive area where the sensitive content is located, a correspondence between the location information of the sensitive area and the sensitive content identification code is established.

[0127] For example, when a face recognition model is used to identify faces in image data, if the image data contains a person's face, the face recognition model can output a sensitive content identification code for the task and the location information of the corresponding sensitive area. Based on the sensitive content identification code, the person corresponding to the sensitive area can be determined.

[0128] S13: For the sensitive content, establish a corresponding relationship between the sensitive content identification code and key information.

[0129] In an embodiment of the present application, to better protect sensitive content in the video data, different key information can be configured for different sensitive content. Thus, a correspondence between the sensitive content identification code and the key information can be established for a particular sensitive content. The key information can be used solely for that sensitive content. In this case, if the key information for other sensitive content is leaked, it will not adversely affect that sensitive content.

[0130] In addition, when it is necessary to transmit the encrypted video data to other users, the key information corresponding to the sensitive content that can be viewed by the user can be stored in the encrypted video data according to the permissions of different users, so that the encrypted video data can be managed more flexibly. For example, in the case of a parent remotely monitoring a child attending kindergarten, the parent may only have the permission to view their own child. In this case, only the key information corresponding to the parent's child can be recorded in the encrypted video data, without recording the key information of other children. Therefore, after receiving the encrypted video data, the parent can only view the relevant content of their own child, avoiding exposing the privacy of other children. For another example, in the scenario of product production management, if the manager only has the permission to manage device A, only the key information corresponding to device A can be recorded in the encrypted video data, without recording the key information of sensitive content of other devices. Therefore, the manager can only manage device A and will not view other devices in the video. For another example, in a video conference scenario, if a participant only has permission to view participants in Group A, the encrypted video data can record only the key information corresponding to participants in Group A, without recording the key information of other participants. This allows participants to view only the meeting content of participants in Group A. For another example, in a live shopping broadcast scenario, if the audience only has permission to purchase toys, but not alcohol and tobacco products, the encrypted video data can record only the key information corresponding to toys, without recording the key information corresponding to alcohol and tobacco products. This allows viewers to view only content related to toys, but not alcohol and tobacco products.

[0131] Optionally, since the sensitive content identification code can usually have a high degree of complexity, the sensitive content identification code can be directly used as the key information without the need to generate additional key information for the sensitive content, while also better protecting the sensitive content in the video data.

[0132] Step 303: Use the key information to encrypt the sensitive area in the image data to obtain encrypted video data.

[0133] In an embodiment of the present application, after identifying image data containing sensitive areas in the video data, key information can be used to encrypt the sensitive areas in the image data to protect sensitive content in the sensitive areas.

[0134] Specifically, the key information can be pre-generated. The key information can be used to perform an encryption operation on the data in the sensitive area of ​​the image data to obtain encrypted video data. This prevents the video codec module from decoding the sensitive area in the image data without knowing the key information, thereby obtaining a normal image of the sensitive area. For example, without knowing the key information, the sensitive area may be decoded as a black image. This effectively protects sensitive content in the video data.

[0135] Since encryption occurs after encoding, it does not affect the video encoding process and reduce video encoding efficiency. Furthermore, since the key information is used to directly perform encryption operations on the encoded image data, the difference in data size between the encrypted image data and the encoded image data is minimal, and the video data size is not significantly altered.

[0136] In one embodiment of the present application, the step of using key information to encrypt the sensitive area in the image data to obtain encrypted video data includes:

[0137] S21, determining the location of the sensitive area in the image data;

[0138] In an embodiment of the present application, in the step of identifying image data containing sensitive areas in the video data, if image data containing sensitive areas is identified, location information of the sensitive areas in the image data may also be output. Thus, the location of the sensitive areas in the image data may be determined.

[0139] S22: Using the key information, perform encryption operation on the data at the location of the sensitive area in the image data to obtain encrypted video data.

[0140] In an embodiment of the present application, after determining the location of the sensitive area, the location of the sensitive area can be encrypted. The key information can be used to perform an encryption operation on the data at the location of the sensitive area in the image data to obtain encrypted video data.

[0141] Specifically, the pixel value of each pixel in the image data can be a triplet [R, G, B] (red channel value, green channel value, blue channel value), and the value of each value is between 0 and 255. The key information can be used to perform an encryption operation on each pixel value of the pixel at the location of the sensitive area to obtain encrypted image data, thereby obtaining encrypted video data.

[0142] The algorithm used for the encryption operation can be determined according to actual needs, for example, the DES algorithm, the AES algorithm, the XOR algorithm, etc., which is not limited in this application.

[0143] As a specific example of the present application, when the encryption algorithm is an XOR algorithm, bit operations can be performed on the pixel values ​​of the pixel points, and the encryption of the sensitive area can be completed at a faster speed, avoiding adverse effects on the efficiency of possible video transmission.

[0144] In one embodiment of the present application, the step of using key information to encrypt the sensitive area in the image data to obtain encrypted video data includes:

[0145] S31 , for a sensitive area in the image data where sensitive content is located, using key information corresponding to the sensitive content identification code, to encrypt the sensitive area in the image data where sensitive content is located, to obtain encrypted video data.

[0146] In an embodiment of the present application, different sensitive content can have different key information. Thus, for sensitive areas containing different sensitive content in the image data, the key information corresponding to the sensitive content identification code of the sensitive content can be used to encrypt the sensitive content area in the image data, thereby obtaining encrypted video data. Thus, sensitive areas containing different sensitive content can be encrypted using different key information, and the leakage of the key information for one sensitive content will not adversely affect other sensitive content. This further improves the security of the encrypted video data.

[0147] Optionally, since the sensitive content identification code can typically be highly complex, it can be used directly as the key information. In this case, the sensitive area of ​​the image data containing sensitive content can be directly encrypted using the sensitive content identification code to obtain encrypted video data. This can simplify the image data encryption process to a certain extent while maintaining a high level of security.

[0148] Step 304: Record the key information in the encrypted video data.

[0149] In an embodiment of the present application, after obtaining the encrypted video data, the encrypted video data can be transmitted to other users. The key information may not be recorded in the encrypted video data, but may be sent to the user using other sending methods. In order to facilitate the trusted user to obtain the key information required to decrypt the encrypted video data without changing the original video data transmission process, the key information may also be recorded in the encrypted video data. The trusted user can know the encryption method of the encrypted video data and the location where the key information of the encrypted video data is recorded. Thus, the trusted user can quickly learn the key information in the encrypted video data without changing the original video data acquisition method, and decode the encrypted video data based on the key information. In this way, the transmission security of the video data can be ensured without affecting the trusted user's normal viewing of the video.

[0150] Specifically, the encrypted video data may have an area where custom information can be added, and the key information may be recorded in the area where custom information can be added, so that a trusted user can subsequently decode the encrypted video data.

[0151] In one embodiment of the present application, the method further includes:

[0152] S41, recording identification information of the image data containing the sensitive area and location information of the sensitive area in the image data in the encrypted video data.

[0153] In an embodiment of the present application, identification information of the image data containing the sensitive area and location information of the sensitive area in the image data may also be recorded in the encrypted video data. This allows a trusted user to quickly learn the image data that needs to be decrypted and the specific location of the sensitive area in the image data. This facilitates the trusted user to quickly decrypt the encrypted video data after acquiring it without changing the original method for acquiring the video data, thereby ensuring that the trusted user can view the video normally and that the transmission of the video data is secure.

[0154] As a specific example of this application, Figure 4 This is a schematic diagram of a video data structure of an embodiment of the present application, and the video data can be stored in the following structure: the top layer is a sequence layer, and the sequence layer can include a sequence start code, a sequence header, sequence data, and a sequence end code; the sequence data includes a picture group layer, and the picture group layer can include at least one group of picture group headers and picture group data; the picture group data includes a picture layer, and the picture layer can include at least one group of picture headers and picture data; the image data includes a macroblock layer, and the macroblock layer includes macroblock information and macroblock data; the macroblock data includes a block layer, and the block layer includes at least one block data.

[0155] Specifically, each of the image group data may include at least one I-frame image data and P-frame image data and / or B-frame image data following the I-frame image data. The image data may be further divided into at least one stripe of data, which may be further divided into at least one macroblock of data (16×16 pixel blocks), which may be further divided into at least one block of data (entropy coded data of transform quantization coefficients of an 8×8 or 4×4 block).

[0156] In one embodiment of the present application, Figure 5 This is another schematic diagram of the video data structure of an embodiment of the present application. In order to record the presence of the key information, the identification information of the image data of the sensitive area, and the location information of the sensitive area in the image data in the video data, the information can be embedded in the following manner:

[0157] Recording the image group data containing the sensitive area in the image group layer, that is, the identification information of the encrypted image group data;

[0158] Recording the image data containing the sensitive area in the image layer, that is, the identification information of the encrypted image data;

[0159] Recording the stripe data where the sensitive area exists in the stripe layer, that is, identification information of the encrypted stripe data, and location information of the sensitive area;

[0160] Recording the macroblock data of the sensitive area in the macroblock layer, namely, identification information of the encrypted macroblock data, location information of the sensitive area, and key information;

[0161] The block data of the sensitive area, ie, identification information of the encrypted block data, location information of the sensitive area, and key information are recorded in the block layer.

[0162] As a result, identification information for encrypted data can be recorded in each data layer of the video data, allowing trusted users to quickly identify the data that needs to be decrypted. Furthermore, location information for sensitive areas is recorded at the slice, macroblock, and block layers, allowing trusted users to quickly identify the locations of sensitive areas within the strip, macroblock, and block, respectively. Furthermore, key information is recorded at the macroblock and block layers, allowing trusted users to quickly decrypt encrypted data without having to change the video acquisition method or obtain key information separately.

[0163] In one embodiment of the present application, the key information, the location information of the sensitive area in the image data, and the identification information of the image data where the sensitive area exists can also be encapsulated as SEI (Supplemental Enhancement Information) information, and then the SEI information can be embedded in the encrypted video data.

[0164] Specifically, the data structure of the encrypted video data can be called a NALU (Network Abstract Layer Unit) structure. The encrypted video data can be considered to be composed of multiple NALU units. The types of NALU units may include SPS (Sequence Parameter Set), PPS (Picture Parameter Set), VCL (Video Coding Layer), and SEI. The VCL unit stores data such as group of pictures, pictures, slices, and macroblocks.

[0165] At least one NALU unit of SEI information type can be added to the encrypted video data, and SEI information recording the key information, the location information of the sensitive area in the image data, and the identification information of the image data where the sensitive area exists can be stored in the NALU unit, so that a trusted user can decrypt the encrypted video data based on the SEI information.

[0166] Optionally, encryption identification information may be recorded in the SEI information, and a trusted user may determine whether encrypted image data exists in the video data based on the encryption identification information recorded in the SEI information.

[0167] Optionally, the SEI information may not record the key information, but may record the method for obtaining the key information. The user may obtain the key information from the video data or other content other than the video data based on the method for obtaining the key information recorded in the SEI information.

[0168] As a specific example of the present application, Table 1 is an example of SEI information in an embodiment of the present application.

[0169]

[0170] Table 1 SEI information example

[0171] Among them, the payloadType field is used to determine the type of SEI information. When the payloadType field is set to 5, it can indicate that this SEI information is user-defined data. The payloadSize field is used to indicate the uuid and the total size of the user data. The uuid field can be used to determine the encryption type of the video. For example, when the uuid is ac32e5b6e6d948b7362cd828d9c3bbef, it can be indicated that the encryption type is a face encryption type. The payload field can record image data identification information, sensitive area location information and key information. For example, when the content is 010140503c0fdec5e9ade4d24db8632c, the first two bytes 01 can be used to indicate that the image data identification information of the sensitive area is 1, that is, the first frame of image data. The subsequent 10 bytes can be used to indicate the location information of the sensitive area in the image (x left ,y up ,x right ,y down Each parameter can also be used to indicate the number of macroblocks in that dimension. For example, 0140503c0f can be used to indicate that the location information of the sensitive area is the coordinates (5, 5, 15, 15). left =5 means the sensitive area is located on the fifth macroblock from the left in the x-direction. The remaining bytes of the location information can be used to record key information. For example, dec5e9ade4d24db8632c is the key information corresponding to the sensitive area.

[0172] Through the video processing method of the embodiment of the present application, it is possible to obtain encoded video data; identify image data with sensitive areas in the video data; and use key information to encrypt the sensitive areas in the image data to obtain encrypted video data. Thus, the sensitive areas can be encrypted based on the encoded video data without affecting the video encoding process or reducing the video encoding efficiency. Furthermore, the sensitive areas in the image data are encrypted using key information, and the encrypted video data and the encoded video data can have a smaller data volume difference without affecting the video quality. Furthermore, the key information is recorded in the encrypted video data. Without changing the original video transmission method, a decryption method for encrypted video data can be provided to trusted users, while at the same time continuing to prevent other users from viewing the content in the video that needs to be protected.

[0173] Reference Figure 6 , shows a flowchart of a video processing method according to an embodiment of the present application, which may specifically include the following steps:

[0174] Step 601: Obtain encoded encrypted video data and key information; the encrypted video data includes at least one frame of encrypted image data;

[0175] In the embodiment of the present application, when video data needs to be acquired, the encoded encrypted video data and key information can be acquired. The encrypted video data may include at least one frame of encrypted image data.

[0176] Specifically, the encrypted video data can be generated by obtaining encoded video data; identifying image data containing sensitive areas in the video data; and encrypting the sensitive areas in the image data using key information to obtain the encrypted video data. Because the encrypted data is processed based on the encoded video data, the encrypted video data can have a smaller data size difference than the encoded video data without affecting video quality.

[0177] Specifically, the key information may be information used to decrypt the encrypted video data. The key information may be recorded in the encrypted video data or may not be recorded in the encrypted video data.

[0178] If the key information is recorded in the encrypted video data, the user can obtain the video data in the same way as before. The user only needs to directly receive the video data to obtain the encrypted video data and the key information recorded in the encrypted video data.

[0179] If the key information is not recorded in the encrypted video data, the way the user obtains the video data is different from the original way, and the user needs to use other ways to receive the key information, which can further improve the security of the encrypted video data to a certain extent.

[0180] Specifically, the encrypted video data may include at least one frame of encrypted image data. The encrypted image data may contain a sensitive area containing sensitive content. The data in the sensitive area may be encrypted with the key information and cannot be directly decoded and viewed.

[0181] Step 602: Decrypt the sensitive area in the encrypted image data using the key information to obtain decrypted video data.

[0182] In an embodiment of the present application, since the sensitive areas in the image data are encrypted using key information, the key information can also be used to decrypt the sensitive areas in the encrypted image data to obtain decrypted video data. The decrypted video data can be encoded video data. After the decryption of the encrypted video data is completed, the original video decoding method can be used to decode the decrypted video data for viewing. Therefore, the user only needs to use the key information for decryption to obtain the video data with the same encoding method as the original one. While ensuring data security, it can cause less impact on the viewing of video data by trusted users.

[0183] Specifically, the user may know the encryption method of the encrypted video data, the identification information of the image data containing the sensitive area, and the storage location of the location of the sensitive area in the image data. Thus, after obtaining the key information, the user can determine the image data in the encrypted video data that needs to be decrypted based on the image data identification information, and determine the data in the image data that needs to be decrypted based on the location information of the sensitive area, and decrypt the sensitive area in the encrypted image data.

[0184] Through the video processing method of the embodiment of the present application, encoded encrypted video data and key information are obtained; the encrypted video data includes at least one frame of encrypted image data; the key information is used to decrypt the sensitive area of ​​the encrypted image data to obtain decrypted video data. The encoded encrypted video data can have a video quality similar to that of the original encoded video data. At the same time, after decrypting the encrypted video data, the user can use the original video decoding method to decode the decrypted video data for viewing. While ensuring the security of video transmission, the user is provided with video data that maintains the original video quality, which has a minimal impact on the viewing of video data by trusted users.

[0185] Reference Figure 7 , shows a step flow chart of an embodiment of a video transmission method of an embodiment of the present application, which is applied to a sending end and a receiving end.

[0186] The method may specifically include the following steps:

[0187] Step 701: The transmitting end obtains encoded video data; the video data includes at least one frame of image data;

[0188] In the embodiment of the present application, the transmitting end can send video data to the receiving end. However, in order to ensure that the sensitive content in the video data is not accessible to unauthorized persons, the transmitting end needs to encrypt the sensitive content in the video data before sending the video data to the receiving end.

[0189] Thus, the transmitting end can first obtain the encoded video data; the video data includes at least one frame of image data.

[0190] Specifically, the encoded video data may be stored in the sending end, or the sending end may obtain the encoded video data sent by other devices, which is not limited in this application.

[0191] Step 702: The transmitting end identifies image data of a sensitive area in the video data;

[0192] In an embodiment of the present application, the sending end can identify whether at least one frame of image data in the video data has a sensitive area recording sensitive content, thereby being able to identify image data with sensitive areas in the video data.

[0193] In a specific implementation, template matching, model recognition, and the like can be used to identify sensitive areas containing sensitive content in the image data. Since image data of the P-frame or B-frame type generally does not have complete image information, it may be impossible to normally identify sensitive areas in the image data. Therefore, when identifying whether there are sensitive areas in the image data, the image data can be first decoded, and then the decoded image data can be used to identify whether there are sensitive areas. If there are sensitive areas, the location information of the sensitive areas can be recorded to facilitate subsequent encryption of the sensitive areas in the encoded image data.

[0194] Step 703: The transmitting end uses the key information to encrypt the sensitive area in the image data to obtain encrypted video data; the encrypted video data includes at least one frame of encrypted image data;

[0195] In an embodiment of the present application, after the sending end identifies the image data containing sensitive areas in the video data, it can use key information to encrypt the sensitive areas in the image data and protect the sensitive content in the sensitive areas.

[0196] Since encryption occurs after encoding, it does not affect the video encoding process and reduce video encoding efficiency. Furthermore, since the key information is used to directly perform encryption operations on the encoded image data, the difference in data size between the encrypted image data and the encoded image data is minimal, and the video data size is not significantly altered.

[0197] Step 704: the receiving end receives the encrypted video data and the key information sent by the sending end;

[0198] In an embodiment of the present application, after the transmitting end completes video encryption, the receiving end can use different methods to receive the encrypted video data and the key information sent by the transmitting end. For example, the encrypted video data can be sent to the receiving end in a push manner, or in a broadcast manner, or the receiving end can proactively send a request to the transmitting end to obtain the encrypted video data. Sensitive content in the encrypted video data may have been encrypted, which can ensure the security of the encrypted video data during transmission to a certain extent.

[0199] Specifically, the key information may be information used to decrypt the encrypted video data. The key information may be recorded in the encrypted video data or may not be recorded in the encrypted video data.

[0200] If the key information is recorded in the encrypted video data, the receiving end can obtain the video data in the same way as before. The receiving end only needs to directly receive the video data to obtain the encrypted video data and the key information recorded in the encrypted video data.

[0201] If the key information is not recorded in the encrypted video data, the way the receiving end obtains the video data is different from the original way. The receiving end needs to adopt other ways to receive the key information, which can further improve the security of the encrypted video data to a certain extent.

[0202] In step 705 , the receiving end uses the key information to decrypt the encrypted image data to obtain decrypted video data.

[0203] In an embodiment of the present application, the receiving end can use the key information to decrypt the sensitive area in the encrypted image data to obtain decrypted video data. The decrypted video data can be encoded video data. After the encrypted video data is decrypted, the decrypted video data can be decoded and viewed using the original video decoding method. As a result, the user only needs to use the key information for decryption to obtain video data encoded in the same manner as originally encoded. This ensures data security while minimizing the impact on trusted users viewing the video data.

[0204] As a result, the video encryption and decryption processes can be tightly coupled with the video encoding and decoding processes. The sender can encrypt the video data after encoding it. After receiving the encrypted video data, the receiver can decrypt it and then decode it, allowing the receiver to view the video data. Furthermore, neither the encryption nor the decryption of the video data affects the original encoding and decoding processes, ensuring both encoding and decoding efficiency and video quality while maintaining the encrypted video data close to the original standard.

[0205] Through the video transmission method of the embodiment of the present application, the sending end obtains encoded video data; the video data includes at least one frame of image data; the sending end identifies image data with sensitive areas in the video data; the sending end uses key information to encrypt the sensitive areas in the image data to obtain encrypted video data; the encrypted video data includes at least one frame of encrypted image data; the sending end sends the encrypted video data and the key information to the receiving end; the receiving end uses the key information to decrypt the encrypted image data to obtain decrypted video data. The encryption and decryption of video data will not affect the original encoding process and decoding process of the video data, so that both the sending end and the receiving end can transmit the video in a similar manner to the original video transmission, while ensuring the quality and efficiency of video transmission, and improving the security of video transmission.

[0206] Reference Figure 8 , shows a video viewing method according to an embodiment of the present application, characterized in that the method includes:

[0207] Step 801: obtaining authentication information input by the user for encrypted video data;

[0208] In the embodiments of the present application, users can obtain encrypted video data through their electronic devices in a variety of scenarios, such as participating in real-time video conferences, watching entertainment and educational videos provided by video platforms, watching live video broadcasts on shopping platforms, monitoring children, managing company security, and analyzing customer flow in shopping malls. The encrypted video data may include at least one frame of encrypted image data.

[0209] Among them, the electronic device can be a mobile phone, a laptop computer, a tablet computer, a desktop computer, a smart watch, a projector, etc., and this application does not impose any restrictions on this.

[0210] Specifically, the encrypted video data can be generated by obtaining encoded video data; identifying image data containing sensitive areas in the video data; and encrypting the sensitive areas in the image data using key information to obtain the encrypted video data. Because the encrypted data is processed based on the encoded video data, the encrypted video data can have a smaller data size difference than the encoded video data without affecting video quality.

[0211] In order to view the image data containing sensitive areas in the encrypted video data, the user may input authentication information to authenticate whether the user has the authority to view the image data containing sensitive areas in the encrypted video data.

[0212] Among them, the authentication information can be human feature information such as fingerprint, face, iris, text password, graphic password, authentication certificate stored in a mobile storage device, etc., and this application does not impose any restrictions on this.

[0213] Specifically, the user can input authentication information by touching the electronic device, operating input devices such as a camera, keyboard, mouse, etc. connected to the electronic device, connecting a mobile storage device to the electronic device so that the electronic device can obtain the authentication certificate in the mobile storage device, etc., so that the electronic device held by the user can obtain the authentication information input by the user for the encrypted video data.

[0214] In a specific implementation, after obtaining the encrypted video data, the user may be prompted to enter authentication information in order to decrypt the encrypted video data. The user may also pre-enter authentication information for the encrypted video data before obtaining the encrypted video data, so that after the electronic device obtains the encrypted video data, it can decrypt the encrypted video data based on the authentication information. The electronic device may also obtain the authentication information entered by the user before obtaining the encrypted video data, and send the user's authentication information to a transmitting device used to transmit the encrypted video data, so that the transmitting device can transmit the encrypted video data carrying key information matching the authentication information based on the user's authentication information, thereby completing the decryption of the encrypted video data without having to obtain additional key information.

[0215] Step 802: searching for key information matching the authentication information;

[0216] In an embodiment of the present application, encrypted video data can be decrypted using key information. Thus, after obtaining authentication information, key information matching the authentication information can be searched for to subsequently decrypt image data containing sensitive areas in the encrypted video data. If the user allows viewing of the encrypted video data, key information matching the user's authentication information can be searched for. If the user does not allow viewing of the encrypted video data, key information matching the user's authentication information cannot be searched for, and thus the sensitive content in the encrypted video data cannot be viewed.

[0217] In a specific implementation, the electronic device may send the user's authentication information to a device that manages key information to obtain key information that matches the authentication information.

[0218] The electronic device can also search for key information that matches the authentication information in the encrypted video data. For example, the encrypted video data may contain an address for obtaining the key information, and the electronic device can send a request containing the authentication information to this address to obtain key information that matches the authentication information. Alternatively, the electronic device may contain encrypted key information, and the electronic device can attempt to decrypt the key information based on the authentication information. If the key information can be correctly decrypted using the authentication information, it can be determined that the authentication information has matching key information. Alternatively, before obtaining the encrypted video data, the electronic device can send the user's authentication information to a transmitting device used to transmit the encrypted video data. The transmitting device can then send encrypted video data carrying key information that matches the authentication information based on the user's authentication information. The electronic device can know in advance the location and recording method of the key information in the encrypted video data, and thus can extract the key information it needs from the encrypted video data.

[0219] In a specific implementation, image data in sensitive areas of encrypted video data can all be encrypted using the same key information. In this case, the authentication information of multiple users can be set to match the key information, so that multiple users can use their own authentication information to obtain the key information required to decrypt the encrypted video data.

[0220] In encrypted video data, different key information can be used to encrypt image data of different types of sensitive areas. In this case, the authentication information of different users can be matched with at least one key information. Therefore, according to the permissions of different users, users can view different types of sensitive content in the encrypted video data. For example, in the scenario of parents supervising their children, the image data of different areas where children are located in the video data can be encrypted with different key information. After the parents enter the authentication information, they can obtain the key information corresponding to their children. For another example, in the scenario of product production management, the image data of areas where different types of production equipment are located can be encrypted with different key information. The manager enters the authentication information and can obtain at least one key information that matches his or her permissions. For example, the authentication information of a low-authority manager can only obtain the key information corresponding to production equipment A, while the authentication information of a high-authority manager can simultaneously obtain multiple key information corresponding to production equipment A to D.

[0221] Step 803: Decrypt the image data in the sensitive area of ​​the encrypted video data using the key information to obtain decrypted video data.

[0222] In an embodiment of the present application, after obtaining the key information, the electronic device can use the key information to decrypt the sensitive area in the encrypted image data to obtain decrypted video data. The decrypted video data can be the same as the encrypted video data, both being encoded video data. Therefore, after the video is decrypted, the amount of the decrypted video data obtained does not change significantly, ensuring data security while minimizing the impact on the user's viewing of the video data.

[0223] Specifically, the electronic device may know the encryption method of the encrypted video data and, based on the information recorded in the encrypted video data, may also know the identification information of the image data containing the sensitive area and the storage location of the location information of the sensitive area in the image data. Thus, after obtaining the key information, the electronic device may determine the image data in the encrypted video data that needs to be decrypted based on the image data identification information, and determine the data in the image data that needs to be decrypted based on the location information of the sensitive area, and decrypt the sensitive area in the encrypted image data.

[0224] Step 804: Display the decrypted video data to the user.

[0225] In an embodiment of the present application, after the electronic device obtains the decrypted video data, it can decrypt the decrypted video data and play the decrypted video data to display the decrypted video data to the user. Furthermore, the decrypted video data is decoded in the same manner as the unencrypted video data. Thus, the user only needs to use the key information for decryption to obtain video data encoded in the same manner as originally encoded. This ensures data security while minimizing the impact on the playback and display of the video data.

[0226] The video viewing method of the embodiment of the present invention obtains authentication information entered by a user for encrypted video data; searches for key information matching the authentication information; uses the key information to decrypt image data containing sensitive areas in the encrypted video data to obtain decrypted video data; and displays the decrypted video data to the user. Users can easily decrypt the video data using the authentication information and view the decrypted video data. This significantly improves the security of video transmission while minimizing the impact on applications.

[0227] It should be noted that for the method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the embodiments of the present application are not limited by the order of the actions described, because according to the embodiments of the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present application.

[0228] Reference Figure 9 , shows a structural block diagram of an embodiment of a video processing device according to an embodiment of the present application, which may specifically include the following modules:

[0229] The video acquisition module 901 is configured to acquire encoded video data, wherein the video data includes at least one frame of image data;

[0230] Identification module 902, used to identify image data containing sensitive areas in the video data;

[0231] The encryption module 903 is configured to encrypt the sensitive area in the image data using key information to obtain encrypted video data.

[0232] In one embodiment of the present application, the device further includes:

[0233] A key recording module is used to record the key information in the encrypted video data.

[0234] In one embodiment of the present application, the device further includes:

[0235] An information recording module is used to record identification information of image data containing the sensitive area and location information of the sensitive area in the image data in the encrypted video data.

[0236] In one embodiment of the present application, the encryption module includes:

[0237] a position determination submodule, configured to determine the position of the sensitive area in the image data;

[0238] The encryption operation submodule is used to use the key information to perform an encryption operation on the data at the location of the sensitive area in the image data to obtain encrypted video data.

[0239] In one embodiment of the present application, the identification module includes:

[0240] an identification submodule, configured to identify image data containing at least one sensitive content in the video data, and determine sensitive areas where the sensitive content is located in the image data;

[0241] an allocation submodule, configured to allocate sensitive content identification codes to the sensitive contents respectively;

[0242] The relationship establishing submodule is used to establish a corresponding relationship between the sensitive content identification code and the key information for the sensitive content.

[0243] In one embodiment of the present application, the encryption module includes:

[0244] The encryption submodule is used to encrypt the sensitive area where the sensitive content in the image data is located using the key information corresponding to the sensitive content identification code to obtain encrypted video data.

[0245] Reference Figure 10 , shows a structural block diagram of another video processing device embodiment of the present application, which may specifically include the following modules:

[0246] The encrypted video acquisition module 1001 is configured to acquire encoded encrypted video data and key information; the encrypted video data includes at least one frame of encrypted image data;

[0247] The decryption module 1002 is configured to use the key information to decrypt the sensitive area in the encrypted image data to obtain decrypted video data.

[0248] Reference Figure 11, shows a structural block diagram of an embodiment of a video transmission device according to an embodiment of the present application, which is applied to a transmitting end and a receiving end. The transmitting end includes a coded video acquisition module 1101, a sensitive data identification module 1102, and a data encryption module 1103; the receiving end includes a video receiving module 1104 and a video decryption module 1105;

[0249] The encoded video acquisition module 1101 is used to acquire encoded video data; the video data includes at least one frame of image data;

[0250] The sensitive data identification module 1102 is used to identify image data containing sensitive areas in the video data;

[0251] The data encryption module 1103 is used to encrypt the sensitive area in the image data using key information to obtain encrypted video data; the encrypted video data includes at least one frame of encrypted image data;

[0252] The encrypted data receiving module 1104 is used to receive the encrypted video data and the key information sent by the sending end;

[0253] The video decryption module 1105 is configured to use the key information to decrypt the encrypted image data to obtain decrypted video data.

[0254] Reference Figure 12 , shows a structural block diagram of an embodiment of a video viewing device according to an embodiment of the present application, the device comprising:

[0255] The authentication acquisition module 1201 is used to obtain the authentication information input by the user for the encrypted video data;

[0256] A key matching module 1202 is configured to search for key information matching the authentication information;

[0257] The video decryption module 1203 is configured to decrypt the image data in the sensitive area in the encrypted video data using the key information to obtain decrypted video data;

[0258] The video display module 1204 is used to display the decrypted video data to the user.

[0259] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0260] An embodiment of the present application further provides an electronic device, including:

[0261] one or more processors; and

[0262] One or more machine-readable media having instructions stored thereon, when executed by the one or more processors, enable the electronic device to execute the method described in the embodiments of the present application.

[0263] The embodiments of the present application also provide one or more machine-readable media having instructions stored thereon, which, when executed by one or more processors, enable the processors to execute the methods described in the embodiments of the present application.

[0264] The embodiments of the present application also disclose a software product, including a computer program / instruction, wherein when the computer program / instruction is executed, any one of the methods described in the embodiments of the present application is implemented.

[0265] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0266] Those skilled in the art will appreciate that the embodiments of the present application can be provided as methods, devices, or computer program products. Therefore, the present application can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0267] The embodiments of the present application are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the steps in the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0268] These computer program instructions may also be stored in a computer readable memory that can direct a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 a process or multiple processes and / or boxes Figure 1The function specified in one or more boxes.

[0269] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable terminal device to implement the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0270] Although preferred embodiments of the present invention have been described, those skilled in the art may make additional changes and modifications to these embodiments once they become aware of the basic inventive concepts. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present invention.

[0271] Finally, it should be noted that, in this document, relational terms such as first and second, etc., are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or terminal device that includes a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or terminal device. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article, or terminal device that includes the element.

[0272] The above describes in detail a video processing method, a video transmission method, a video viewing method, a video processing device, a video transmission device, and a video viewing device provided by the present application. Specific examples are used herein to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method and core idea of ​​the present application. At the same time, for those skilled in the art, according to the idea of ​​the present application, there may be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as limiting the present application.

Claims

1. A video processing method, characterized in that: include: Acquire encoded video data; the video data includes at least one frame of image data; Identifying image data containing sensitive areas in the video data; Using key information, encrypting the sensitive area in the image data to obtain encrypted video data; The step of encrypting the sensitive area in the image data using the key information to obtain encrypted video data includes: For sensitive areas in the image data where different sensitive contents are located, encrypting the sensitive areas in the image data where the sensitive contents are located using key information corresponding to sensitive content identification codes of the sensitive contents to obtain the encrypted video data, wherein the sensitive content identification codes are used to distinguish sensitive areas in the image data where different sensitive contents are located; The method further includes: encapsulating the key information, location information of the sensitive area in the image data, and identification information of the image data where the sensitive area exists into supplementary enhancement information, and embedding the supplementary enhancement information into the encrypted video data; The method further comprises: Prompt the user to enter authentication information on the user side; Based on the user's authentication information, encrypted video data carrying key information matching the authentication information is sent to the user end.

2. The method according to claim 1, characterized in that The step of identifying image data containing sensitive areas in the video data includes: Identifying image data containing at least one sensitive content in the video data, and determining sensitive areas where the sensitive content is located in the image data; Allocating sensitive content identification codes to the sensitive contents respectively; For the sensitive content, a corresponding relationship between the sensitive content identification code and key information is established.

3. A video processing method, characterized in that: The method comprises: Obtaining encoded encrypted video data and key information; the encrypted video data includes at least one frame of encrypted image data; the encrypted video data is obtained by encrypting the sensitive areas of the image data containing sensitive content using key information corresponding to sensitive content identification codes of the sensitive content, wherein the sensitive content identification codes are used to distinguish sensitive areas of different sensitive content in the image data; the encrypted video data is embedded with supplemental enhancement information; the supplemental enhancement information is encapsulated by the key information, location information of the sensitive areas in the image data, and identification information of the image data containing the sensitive areas; The key information is used to decrypt the sensitive area in the encrypted image data to obtain decrypted video data.

4. A video transmission method, characterized in that: The method is applied to a transmitting end and a receiving end, and includes: The transmitting end obtains the encoded video data; the video data includes at least one frame of image data; The sending end identifies image data having a sensitive area in the video data; The transmitting end uses the key information to encrypt the sensitive area in the image data to obtain encrypted video data; the encrypted video data includes at least one frame of encrypted image data; the encrypted video data is obtained by encrypting the sensitive area in the image data containing sensitive content using the key information corresponding to the sensitive content identification code of the sensitive content, wherein the sensitive content identification code is used to distinguish sensitive areas of different sensitive content in the image data; the encrypted video data is embedded with supplementary enhancement information; the supplementary enhancement information is obtained by encapsulating the key information, the location information of the sensitive area in the image data, and the identification information of the image data containing the sensitive area; The receiving end receives the encrypted video data and the key information sent by the sending end; The receiving end uses the key information to decrypt the encrypted image data to obtain decrypted video data; The method further comprises: Prompt the user to enter authentication information on the user side; Based on the user's authentication information, encrypted video data carrying key information matching the authentication information is sent to the user end.

5. A video viewing method, characterized in that: The method comprises: Obtaining authentication information input by a user for encrypted video data; the encrypted video data is obtained by encrypting the sensitive areas of the image data containing different sensitive contents using key information corresponding to sensitive content identification codes of the sensitive contents, wherein the sensitive content identification codes are used to distinguish sensitive areas of different sensitive contents in the image data; the encrypted video data is embedded with supplementary enhancement information; the supplementary enhancement information is obtained by encapsulating the key information, location information of the sensitive areas in the image data, and identification information of the image data containing the sensitive areas; Searching for key information matching the authentication information; Decrypting the image data in the sensitive area of ​​the encrypted video data using the key information to obtain decrypted video data; Displaying the decrypted video data to a user; The method further comprises: Prompt the user to enter authentication information on the user side; Based on the user's authentication information, encrypted video data carrying key information matching the authentication information is sent to the user end.

6. A video processing device, characterized in that: The device comprises: A video acquisition module, configured to acquire encoded video data; the video data includes at least one frame of image data; an identification module, configured to identify image data containing sensitive areas in the video data; an encryption module, configured to encrypt the sensitive area in the image data using key information to obtain encrypted video data; The encryption module includes: an encryption submodule, configured to encrypt, for each sensitive area in the image data containing different sensitive contents, the sensitive area containing the sensitive contents using key information corresponding to a sensitive content identification code of the sensitive contents, to obtain encrypted video data, wherein the sensitive content identification code is used to distinguish between sensitive areas containing different sensitive contents in the image data; The device further comprises: an information embedding module, configured to encapsulate the key information, location information of the sensitive area in the image data, and identification information of the image data where the sensitive area exists into supplementary enhancement information, and embed the supplementary enhancement information into the encrypted video data; A prompt module is used to prompt the user to enter authentication information on the user side; The authentication module is used to send encrypted video data carrying key information matching the authentication information to the user end based on the user's authentication information.

7. A video processing device, characterized in that: The device comprises: An encrypted video acquisition module is configured to acquire encoded encrypted video data and key information; the encrypted video data includes at least one frame of encrypted image data; the encrypted video data is obtained by encrypting sensitive areas of different sensitive content in the image data using key information corresponding to sensitive content identification codes of the sensitive content, wherein the sensitive content identification codes are used to distinguish sensitive areas of different sensitive content in the image data; the encrypted video data is embedded with supplemental enhancement information, which is obtained by encapsulating the key information, location information of the sensitive area in the image data, and identification information of the image data containing the sensitive area; a decryption module, configured to decrypt the sensitive area in the encrypted image data using the key information to obtain decrypted video data; The device further comprises: A prompt module is used to prompt the user to enter authentication information on the user side; The authentication module is used to send encrypted video data carrying key information matching the authentication information to the user end based on the user's authentication information.

8. A video transmission device, characterized in that: It is applied to a sending end and a receiving end, wherein the sending end includes a coded video acquisition module, a sensitive data identification module, and a data encryption module; the receiving end includes an encrypted data receiving module and a video decryption module; The encoded video acquisition module is used to acquire encoded video data; the video data includes at least one frame of image data; The sensitive data identification module is used to identify image data containing sensitive areas in the video data; The data encryption module is configured to encrypt the sensitive area in the image data using key information to obtain encrypted video data; the encrypted video data includes at least one frame of encrypted image data; the encrypted video data is obtained by encrypting the sensitive areas of the image data containing different sensitive contents using key information corresponding to sensitive content identification codes of the sensitive contents, wherein the sensitive content identification codes are used to distinguish between sensitive areas of different sensitive contents in the image data; the encrypted video data is embedded with supplementary enhancement information; The supplementary enhancement information is obtained by encapsulating the key information, the location information of the sensitive area in the image data, and the identification information of the image data where the sensitive area exists; The encrypted data receiving module is used to receive the encrypted video data and the key information sent by the sending end; The video decryption module is used to decrypt the encrypted image data using the key information to obtain decrypted video data; The device further comprises: A prompt module is used to prompt the user to enter authentication information on the user side; The authentication module is used to send encrypted video data carrying key information matching the authentication information to the user end based on the user's authentication information.

9. A video viewing device, characterized in that: The device comprises: An authentication acquisition module is configured to obtain authentication information input by a user for encrypted video data; the encrypted video data is obtained by encrypting sensitive areas of different sensitive content in the image data using key information corresponding to sensitive content identification codes of the sensitive content, wherein the sensitive content identification codes are used to distinguish sensitive areas of different sensitive content in the image data; the encrypted video data is embedded with supplementary enhancement information, which is obtained by encapsulating the key information, location information of the sensitive area in the image data, and identification information of the image data containing the sensitive area; A key matching module, configured to search for key information matching the authentication information; a video decryption module, configured to decrypt image data in sensitive areas of the encrypted video data using the key information to obtain decrypted video data; A video display module, used to display the decrypted video data to the user; The device further comprises: A prompt module is used to prompt the user to enter authentication information on the user side; The authentication module is used to send encrypted video data carrying key information matching the authentication information to the user end based on the user's authentication information.

10. An electronic device, characterized in that: include: one or more processors; and One or more machine-readable media having instructions stored thereon, when executed by the one or more processors, cause the electronic device to perform any one of the methods of claims 1-2 or 3 or 4 or 5.

11. One or more machine-readable media having instructions stored thereon, which, when executed by one or more processors, cause the processors to perform any of the methods of claims 1-2 or 3 or 4 or 5.

12. A computer program product comprising a computer program / instructions, wherein: When the computer program / instructions are executed, the method according to any one of claims 1 to 2 or 3 or 4 or 5 is implemented.

Images