An image processing method and apparatus

Abstract

The application discloses an image processing method and device, which is used for detecting and encrypting a key region of a collected image by using a camera, thereby improving the safe transmission of the image collected by the camera and fundamentally eliminating the privacy leakage problem of a terminal user such as a social television. The image processing method provided by the application comprises the following steps: determining a key region on a collected image, and encrypting image data of the key region; and sending the collected image containing the image data of the key region after the encryption to a terminal used for displaying the collected image.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of information processing, and in particular to an image processing method and device. BACKGROUND

[0002] The traditional TV has monotonous programs and functions, which cannot meet the increasing cultural and entertainment needs of people. Under this background, social TV develops rapidly. The biggest highlight of social TV is its significant social attribute. Therefore, the webcam hardware device has been called the standard peripheral of social TV. However, due to the unique application scenario of social TV and the importance of network security and home privacy of consumers, how to better protect the privacy inside the home and how to ensure that the webcam of social TV is not illegally used by hackers have become a problem to be solved.

[0003] In view of this problem, the manufacturers of social TV currently propose some solutions. One solution is to use a detachable camera. This camera is not embedded in the TV, but is inserted into the social TV through a USB interface. This solution not only has certain requirements for the structure of the TV and the camera module, but also requires the user to pull out the camera module when the social TV is not used. Another solution is improved on this basis. A lifting gimbal is used. When not in use, the gimbal automatically falls down, and the camera module is blocked by the shell. This solution needs to increase the cost of the lifting gimbal, and still cannot fundamentally prevent hackers from attacking the TV through the network and opening the camera. SUMMARY

[0004] The embodiments of the present application provide an image processing method and device, which are used for detecting and encrypting a key region of a collected image by using a camera, so as to improve the secure transmission of the collected image of the camera and fundamentally prevent the privacy leakage problem of terminal users such as social TV.

[0005] On the camera side, the image processing method provided by the embodiments of the present application includes:

[0006] determining a key region on a collected image, and encrypting image data of the key region;

[0007] sending the collected image containing the image data of the key region after the encryption to a terminal for displaying the collected image.

[0008] By the method, a key region on the captured image is determined, and image data of the key region is encrypted; the captured image containing the image data of the key region after the encryption is sent to a terminal for displaying the captured image, so that the camera can be used to detect and encrypt the key region of the captured image, thereby improving the secure transmission of the captured image by the camera and fundamentally eliminating the privacy leakage problem of a user of a display terminal such as a social TV.

[0009] Optionally, the image data of the key region is encrypted, and the encryption specifically includes:

[0010] The image data of the key region is encrypted by using a symmetric key.

[0011] Optionally, the method further includes:

[0012] The public key sent by the terminal is received.

[0013] The symmetric key is encrypted by using the public key and sent to the terminal.

[0014] Optionally, the captured image is an image processed by an image signal processing (ISP) module.

[0015] Optionally, the determination of the key region on the captured image specifically includes:

[0016] An application program interface (API) related to a face detection algorithm function is called to detect a face position of the captured image and determine face position information.

[0017] Optionally, the captured image containing the image data of the key region after the encryption is sent to the terminal for displaying the captured image, and the sending specifically includes:

[0018] The captured image containing the image data of the key region after the encryption is sent to the terminal for displaying the captured image by using a USB video class (UVC) transmission protocol.

[0019] On the terminal side for displaying the image, an image processing method provided by an embodiment of the application includes:

[0020] The captured image containing the image data of the key region after the encryption sent by the camera is received.

[0021] After the image data of the key region is decrypted, a complete captured image is generated and output for display.

[0022] Optionally, the method further includes:

[0023] When the camera is started, a non-symmetrical key pair is generated, including a private key and a public key, and the public key is sent to the camera;

[0024] The camera receives a symmetrical key encrypted by the public key;

[0025] The symmetrical key is decrypted by the private key to obtain a decrypted symmetrical key.

[0026] Optionally, the image data of the key area is decrypted by the symmetrical key.

[0027] Another embodiment of the present application provides an image processing device, comprising a memory and a processor, wherein the memory is used to store program instructions, and the processor is used to call the program instructions stored in the memory to execute any one or more of the above methods.

[0028] Another embodiment of the present application provides a computer storage medium, which stores computer executable instructions, and the computer executable instructions are used to make the computer execute any one or more of the above methods. BRIEF DESCRIPTION OF DRAWINGS

[0029] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed in the embodiment description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0030] Figure 1 The system flowchart provided by the embodiment of the present application;

[0031] Figure 2 The image encryption and decryption flowchart provided by the embodiment of the present application;

[0032] Figure 3 The flowchart of an image processing method on the image acquisition device side provided by the embodiment of the present application;

[0033] Figure 4 The flowchart of an image processing method on the image display device side provided by the embodiment of the present application;

[0034] Figure 5 The structure diagram of an image processing device provided by the embodiment of the present application;

[0035] Figure 6 The structure diagram of an image processing device on the image acquisition device side provided by the embodiment of the present application;

[0036] Figure 7 FIG. 1 is a schematic diagram of an image processing device on the image display device side according to an embodiment of the present application. DETAILED DESCRIPTION

[0037] The technical solutions in the embodiments of the present application will be clearly and completely described in connection with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, and not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by a person of ordinary skill in the art without creative work fall within the scope of protection of the present application.

[0038] The embodiments of the present application provide an image processing method and device, which are used for detecting and encrypting a key region of a collected image by using a camera, thereby improving the secure transmission of the image collected by the camera and fundamentally eliminating the privacy leakage problem of a terminal user such as a social TV.

[0039] The method and the device are based on the same application concept. Since the principles of the method and the device for solving problems are similar, the implementation of the device and the method can be referred to each other, and the repeated parts will not be described again.

[0040] The embodiments of the present application will be described in detail in connection with the drawings of the specification. It should be noted that the display order of the embodiments of the present application only represents the order of the embodiments, and does not represent the advantages and disadvantages of the technical solutions provided by the embodiments.

[0041] The embodiments of the present application are described by taking the image transmission between the camera and the social TV as an example, but are not limited thereto. The technical solutions provided by the embodiments of the present application can be applied to various terminals and network side devices.

[0042] The embodiments of the present application provide a method and device for encrypting key content of a camera image of a social TV. The NPU (embedded neural network processor) module and the security (Security) module of the camera chip are used to realize key region detection and encryption. Without increasing any hardware cost, the key region encryption function of the image captured by the social TV network camera is realized, and the privacy leakage problem of the user of the social TV is fundamentally eliminated.

[0043] The key content of the image, for example, can be the face region image content or other image content related to the user privacy. The key content can be a default setting, or can be set or customized by the user, so that personalized settings can be made according to the user's needs.

[0044] In view of the problem of invasion of family privacy existing in the current social TV camera, the embodiment of the application provides a more reasonable solution compared with the existing solution.

[0045] The technical scheme provided by the embodiment of the application includes a server on the network side, a camera on the terminal side, a TV (which can be any terminal device such as a TV that can be connected to the camera) and the like from a large aspect. In detail, the technical scheme mainly includes the following parts:

[0046] 1. NPU (embedded neural network processor) module of the camera SOC (System on Chip) chip: capable of running video signal processing algorithms and artificial intelligence algorithms of various edge side devices with high energy efficiency, accelerating and completing the detection and recognition of key contents of the camera collected images.

[0047] 2. Security module of the camera SOC chip: this part encrypts the key contents of the image data collected by the camera through the hardware encryption engine provided by the SOC chip. The hardware provides encryption and decryption hardware acceleration functions such as Advanced Encryption Standard (AES), Secure Hash Algorithm (SHA) and RSA, supports 128-bit, 192-bit and 256-bit keys, and can complete the encryption function of the key area detected by the image detection algorithm on the NPU.

[0048] 3. UVC (USB Video Class) image transmission module of the camera: capable of encoding and compressing image data through an image transmission protocol stack, and sending the encoded and compressed image data to the social TV side through the USB bus.

[0049] 4. Security module of the social TV SOC chip: after receiving the image with encrypted key contents sent by the UVC module of the camera, a corresponding decryption module needs to be run to decrypt it, and the decompressed and decrypted image is displayed on the screen.

[0050] The image processing flow provided by the embodiment of the application is introduced from the perspective of the whole system.

[0051] Referring to Figure 1 The technical scheme provided by the embodiment of the application may, for example, include the following steps:

[0052] Step 1. For the scene of using a camera indoors, a face detection algorithm is trained on a server using a TensorFlow artificial intelligence learning framework, and common algorithms such as Retinaface, Yolo3, etc. The generated network weight file saves the weight values of each layer of the trained neural network. The network weight file is converted into a usable format (for example, in the form of a C language array) through a conversion tool. The algorithm is optimized for the characteristics of the NPU used in the project, that is, the NPU (Neural Network Processing Unit) is used to accelerate the matrix operation of the neural network to improve the face detection accuracy and frame rate.

[0053] This step is to train a face detection algorithm on a server and set the trained face detection algorithm in the camera. As for how to train the face detection algorithm and what kind of face detection algorithm to train, it can be implemented using existing technologies, and can be determined according to actual needs. The embodiments of the present application do not limit it. When the camera performs face detection later, the pre-set face detection algorithm can be directly used, and there is no need to interact with the server again.

[0054] Step 2. When the social TV starts the camera module, the social TV can generate an RSA asymmetric key pair through the Security module of the social TV, and send the RSA public key to the camera module through the extension unit of the UVC. After receiving the RSA public key, the camera module records it, then generates an AES symmetric key and encrypts the AES symmetric key using the RSA public key. The encrypted AES symmetric key is transmitted to the social TV through the extension unit, and the social TV can decrypt the AES symmetric key encrypted by the RSA public key using the RSA private key to obtain the AES symmetric key.

[0055] Among them, about the RSA asymmetric key pair, that is, the RSA public key and the RSA private key, RSA is a kind of asymmetric encryption mechanism, using public key encryption and private key decryption.

[0056] About the symmetric key, that is, the same key must be used by both the sender and the receiver of the symmetric encryption algorithm to encrypt and decrypt the plaintext. The key of the symmetric encryption algorithm is called a symmetric key.

[0057] Step 3. After the camera sensor captures an image, the bayer format raw image data captured by the sensor will not conform to the habit of the human eye, and needs to be processed by the ISP (image signal processing) module for automatic exposure, automatic white balance, etc. to obtain a frame of RAW (unprocessed) image data with better subjective quality (RAW image data is the original data converted by the CMOS or CCD image sensor from the captured light source signal to digital signal), and then encoded into YUV or MJPEG format image data by the encoder.

[0058] Step 4. After obtaining a frame of YUV or MJPEG format image data, the camera calls the API (application program interface) related to the face detection algorithm function for the frame of image to complete face position detection and store the face position information in the additional information of the frame of image. For example, for the living room use scenario of the network television, and limited to the operation ability of the NPU, up to 10 faces can be supported, and more than 10 faces are detected first.

[0059] Step 5. The camera uses the face position in the image additional information to perform local AES encryption processing on the face image data using the AES symmetric key. The camera main chip provides a hardware encryption module to accelerate the data encryption process and reduce the CPU resource consumption of the encryption process. The camera completes the encryption operation by calling the application program interface of the Security module encapsulated in advance.

[0060] Step 6. The camera transmits the AES encrypted image to the social television host SOC chip through the USB bus through the UVC transmission protocol. After receiving the frame of image transmitted by the UVC, the social television host SOC chip uses the AES symmetric key generated by the decoding in step 2 to decrypt the key position data such as the face of the image, and can obtain a complete frame of image data. Then the image data is decoded by the decoder and displayed on the screen through the OSD (On-Screen Display) channel.

[0061] The above 6 steps can complete the key data encryption and decryption process of the camera module. The whole process is shown in the attached figure. Figure 1As shown, the whole process adopts two encryption algorithms, which are AES symmetric encryption algorithm and RSA asymmetric encryption algorithm. The RSA asymmetric encryption algorithm has low running efficiency due to the need of large number multiplication and other algorithms, and is generally only suitable for processing small amount of data, such as keys. The AES algorithm is a symmetric encryption algorithm, which has low resource consumption in the encryption process, high security, and is suitable for the scene of encrypting a large amount of data. In the present scheme, the AES symmetric encryption algorithm is used to encrypt the image data due to the large amount of image data, and the RSA asymmetric encryption algorithm is used to encrypt the key of the AES algorithm due to the small amount of data and the need for infrequent encryption and decryption. The advantages and disadvantages of the two encryption algorithms are combined to complete the encryption and decryption process of the image key data.

[0062] In the above process, the distribution of the key and the encryption and decryption process of the image can also be seen from the attached Figure 2 as shown.

[0063] The implementation of the present scheme completes the encryption function of the key position data of the social television camera without increasing any hardware cost, uses the edge computing capability of the NPU (embedded neural network processor) processing engine of the network camera processing chip and the hardware encryption engine to complete the encryption function of the key position data of the social television camera, eliminates the possibility of illegal persons attacking the social television through the network and infringing the privacy of the consumers in the home through the camera from the source, and greatly improves the security of the Hisense social television product.

[0064] In summary, referring to Figure 3 On the image acquisition device side such as a camera, the image processing method provided by the embodiments of the present application comprises:

[0065] S101, determining a key region on an acquired image, and encrypting image data of the key region;

[0066] The key region is, for example, a face image region.

[0067] The encryption is, for example, encryption using an AES symmetric key.

[0068] The terminal is, for example, a television set, and specifically can be the above-mentioned social television. Of course, in addition thereto, any terminal with an image display function and connectable with a camera, such as a computer, a mobile phone, or other display, etc., can be used.

[0069] It should be noted that in the embodiments of the present application, the key region is mainly encrypted, and the whole image can also be encrypted. In addition, the key region can be one or more, for example, there are multiple face images on a frame of image, and then multiple face regions need to be encrypted respectively.

[0070] S102: Send the captured image containing the encrypted image data of the key area to a terminal for displaying the captured image.

[0071] Furthermore, the transmitted image is a compressed image. The specific compression method is not limited in the embodiment of the present application and there can be multiple types.

[0072] Optionally, encrypting the image data of the key area specifically includes:

[0073] The image data of the key area is encrypted using a symmetric key.

[0074] The symmetric key is, for example, an AES symmetric key.

[0075] Optionally, the method further includes:

[0076] Receiving a public key sent by the terminal, such as an RSA public key;

[0077] The symmetric key is encrypted using the public key and sent to the terminal.

[0078] Optionally, the captured image is an image processed by an image signal processing (ISP) module.

[0079] In addition, the image may be further adjusted in other ways, such as being encoded into image data in YUV or MJPEG format by an encoder as described in step 3 above, which is not limited in the specific embodiment of the present application.

[0080] Optionally, determining the key area on the captured image specifically includes:

[0081] The application program interface (API) related to the face detection algorithm function is called to perform face position detection on the collected image to determine face position information.

[0082] Optionally, sending the captured image containing the encrypted image data of the key area to a terminal for displaying the captured image specifically includes:

[0083] The captured image containing the encrypted image data of the key area is sent to a terminal for displaying the captured image via the USB Video Class (UVC) protocol.

[0084] On the terminal side of the image display, see Figure 4 , an image processing method provided by an embodiment of the present application includes:

[0085] S201, receiving a captured image containing encrypted image data of a key area sent by a camera;

[0086] S202, after the image data of the key region is decrypted, a complete acquisition image is generated and output for display.

[0087] Optionally, the method further comprises:

[0088] When the camera is started, an asymmetric key pair is generated, including a private key and a public key, and the public key is sent to the camera;

[0089] The symmetric key encrypted by the public key is received by the camera;

[0090] The symmetric key is decrypted by using the private key to obtain a decrypted symmetric key.

[0091] Optionally, the image data of the key region is decrypted by using the symmetric key.

[0092] Referring to Figure 5 , the image processing device provided by the embodiment of the application comprises a memory 11 and a processor 12.

[0093] If the image processing device is a camera, then:

[0094] The processor 12 is configured to read a program in the memory 10 and perform the following processes:

[0095] A key region on an acquisition image is determined, and image data of the key region is encrypted;

[0096] An acquisition image containing the image data of the key region after the encryption is sent to a terminal for displaying the acquisition image.

[0097] Optionally, the image data of the key region is encrypted, and specifically comprises:

[0098] The image data of the key region is encrypted by using a symmetric key.

[0099] Optionally, the processor 12 is further configured to:

[0100] The public key sent by the terminal is received;

[0101] The symmetric key is encrypted by using the public key and is sent to the terminal.

[0102] Optionally, the acquisition image is an image processed by an image signal processing (ISP) module.

[0103] Optionally, the key region on the acquisition image is determined, and specifically comprises:

[0104] An application program interface (API) related to a face detection algorithm function is called to detect the face position of the captured image and determine face position information.

[0105] Optionally, the captured image containing the image data of the encrypted key region is sent to a terminal for displaying the captured image, and specifically includes:

[0106] The captured image containing the image data of the encrypted key region is sent to a terminal for displaying the captured image through a USB video class (UVC) transmission protocol.

[0107] If the image processing device is an image display device, then:

[0108] The processor 12 is configured to read a program in the memory 10 and perform the following processes.

[0109] The captured image containing the image data of the encrypted key region is received from the camera.

[0110] After the image data of the key region is decrypted, a complete captured image is generated and output for display.

[0111] Optionally, the processor 12 is further configured to:

[0112] When the camera is started, an asymmetric key pair including a private key and a public key is generated, and the public key is sent to the camera.

[0113] The symmetric key encrypted by the public key of the camera is received.

[0114] The symmetric key is decrypted by using the private key to obtain a decrypted symmetric key.

[0115] Optionally, the processor 12 decrypts the image data of the key region by using the symmetric key.

[0116] It should be noted that the device provided by the embodiments of the present application can not only be used as a camera or a television, but also can be a device integrated together, for example, a camera integrated into a television, as an image processing device as a whole, which is also within the protection scope of the present application.

[0117] The apparatus provided by the embodiments of the present application can further include a transceiver configured to receive and send data under the control of the processor. The processor, the memory and the transceiver can be connected through a bus interface. The transceiver can be a plurality of elements, i.e., including a transmitter and a receiver, and provides a unit for communicating with various other apparatuses over a transmission medium. For different user equipment, a user interface is further provided, which can be an interface capable of connecting to a required device, including but not limited to a keypad, a display, a speaker, a microphone, a joystick, etc.

[0118] The processor 12 is responsible for managing the bus architecture and general processing, and the memory 11 can store data used by the processor 12 when performing operations.

[0119] Optionally, the processor 12 can be a CPU (Central Processor), an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array) or a CPLD (Complex Programmable Logic Device).

[0120] Referring to Figure 6 On the image acquisition side, the image processing apparatus provided by the embodiments of the present application includes:

[0121] A determination unit 21 is configured to determine a key region on an acquired image, and encrypt image data of the key region.

[0122] A transmission unit 22 is configured to send the acquired image containing the image data of the encrypted key region to a terminal for displaying the acquired image.

[0123] Optionally, the image data of the key region is encrypted, and the encryption specifically includes:

[0124] The image data of the key region is encrypted by using a symmetric key.

[0125] Optionally, the transmission unit 22 is further configured to:

[0126] Receive a public key sent by the terminal;

[0127] Encrypt the symmetric key by using the public key, and send the symmetric key to the terminal.

[0128] Optionally, the acquired image is an image processed by an ISP (Image Signal Processing) module.

[0129] Optionally, the determining the key region on the captured image specifically comprises:

[0130] An application program interface (API) related to the face detection algorithm function is called to detect the face position of the captured image and determine the face position information.

[0131] Optionally, the captured image containing the image data of the encrypted key region is sent to a terminal for displaying the captured image, specifically comprising:

[0132] The captured image containing the image data of the encrypted key region is sent to a terminal for displaying the captured image through a USB video class (UVC) transmission protocol.

[0133] Referring to Figure 7 On the image display side, an image processing device provided by an embodiment of the present application comprises:

[0134] A first unit 31 receives a captured image containing image data of an encrypted key region sent by a camera;

[0135] A second unit 32 is configured to decrypt the image data of the key region to generate and output a complete captured image.

[0136] Optionally, the first unit 31 is further configured to:

[0137] When the camera is started, an asymmetric key pair including a private key and a public key is generated, and the public key is sent to the camera;

[0138] The symmetric key encrypted by the public key of the camera is received;

[0139] The symmetric key is decrypted by using the private key to obtain a decrypted symmetric key.

[0140] Optionally, the second unit 32 decrypts the image data of the key region by using the symmetric key.

[0141] It should be noted that the division of the units in the embodiments of the present application is illustrative, and is only a logical function division. In actual implementation, another division mode can be used. In addition, each functional unit in each embodiment of the present application can be integrated in one processing unit, or each unit can be physically present alone, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware or in the form of a software functional unit.

[0142] The integrated unit, if implemented in the form of a software function unit and sold or used as an independent product, can be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the present application essentially or the part that contributes to the prior art or the whole or part of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor to perform all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and various program code storage media.

[0143] The embodiments of the present application provide a computing device, which can be a desktop computer, a portable computer, a smart phone, a tablet computer, a personal digital assistant (PDA), etc. The computing device can include a central processing unit (CPU), a memory, an input / output device, etc. The input device can include a keyboard, a mouse, a touch screen, etc. The output device can include a display device, such as a liquid crystal display (LCD), a cathode ray tube (CRT), etc.

[0144] The memory can include a read-only memory (ROM) and a random access memory (RAM), and provide the processor with program instructions and data stored in the memory. In the embodiments of the present application, the memory can be used to store the programs of any of the methods provided in the embodiments of the present application.

[0145] The processor calls the program instructions stored in the memory, and the processor is used to execute any of the methods provided in the embodiments of the present application according to the obtained program instructions.

[0146] The embodiments of the present application provide a computer storage medium for storing computer program instructions for the apparatus provided in the above embodiments of the present application, which includes programs for executing any of the methods provided in the above embodiments of the present application.

[0147] The computer storage media can be any available media that can be accessed by a computer, including but not limited to magnetic storage (e.g., floppy disks, hard disks, tape, MO, etc.), optical storage (e.g., CD, DVD, BD, HVD, etc.), semiconductor storage (e.g., ROM, EPROM, EEPROM, NAND FLASH, SSD, etc.), etc.

[0148] The above method process can be implemented by a software program, which can be stored in a storage medium, and when the stored software program is invoked, the above method steps are executed.

[0149] Those skilled in the art will understand that the embodiments of the present application can be provided as methods, systems, or computer program products. Therefore, the present application can take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present application can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) containing computer-usable program code.

[0150] The present application is described with reference to flowcharts and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the present application. It should be understood that each flow and / or block in the flowcharts and / or block diagrams, as well as combinations of flows and / or blocks in the flowcharts and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing apparatus to produce a machine, so that the instructions that are executed by the processor of the computer or other programmable data processing apparatus generate means for implementing the functions specified in the flowcharts and / or block diagrams. Figure 1 one or more flows and / or blocks Figure 1 an apparatus with the specified functions of one or more flows and / or blocks.

[0151] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to work in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including instruction apparatus, which implements the functions specified in the flowcharts and / or block diagrams. Figure 1 one or more flows and / or blocks Figure 1 an apparatus with the specified functions of one or more flows and / or blocks.

[0152] These computer program instructions can also be loaded onto a computer or other programmable data processing apparatus, so that a series of operation steps are performed on the computer or other programmable data processing apparatus to produce a computer-implemented process, so that the instructions executed on the computer or other programmable data processing apparatus provide a process for implementing the functions specified in the flowcharts and / or block diagrams. Figure 1one or more processes and / or blocks Figure 1 the steps of a function specified in one or more blocks.

[0153] It is clear that many modifications and changes can be made to the application without departing from the spirit and scope of the application. It is therefore intended that such modifications and changes be included within the scope of the application as measured by the claims and their equivalents.

Claims

1. An image processing method, characterized in that: The method includes: After the camera sensor captures a frame of captured image, the captured image is processed by the image signal processing (ISP) module to obtain image data; and the image data is encoded by the encoder to obtain an encoded captured image; The embedded neural network processor (NPU) module of the camera system-level SOC chip determines the key area on the encoded captured image, and the hardware encryption engine provided by the camera system-level SOC chip uses a symmetric key to encrypt the image data of the key area; the symmetric key is generated by the camera after receiving the public key sent by the social TV; the asymmetric key pair including the public key is generated by the security module of the social TV; the social TV includes the camera; The captured image containing the image data of the encrypted key area is encoded and compressed, and the encoded and compressed captured image is sent to the social TV used to display the captured image, so that the social TV main control system-level SOC chip decompresses and decrypts the captured image, and displays the decompressed and decrypted captured image on the screen.

2. The method according to claim 1, characterized in that The method further includes: receiving a public key sent by the social TV; The symmetric key is encrypted using the public key and sent to the social TV.

3. The method according to claim 1, characterized in that The determining of the key area on the encoded captured image specifically includes: The application program interface (API) related to the face detection algorithm function is called to perform face position detection on the encoded collected image to determine face position information.

4. The method according to claim 1, wherein Sending the encoded and compressed captured image to a social television for displaying the captured image specifically includes: The encoded and compressed captured image is sent to a terminal for displaying the captured image via a USB video class transmission protocol.

5. An image processing method, characterized in that: The method includes: The social TV main control system-level SOC chip receives a captured image containing encrypted image data of a key area sent by a camera; wherein the key area is determined on the encoded captured image by an embedded neural network processor NPU module of the camera system-level SOC chip; the encoded captured image is obtained by processing a frame of captured image by a camera sensor through an image signal processing (ISP) module to obtain image data; and the image data is encoded by an encoder; the social TV includes the camera; The key area is encrypted using a symmetric key through a hardware encryption engine provided by the camera system-level SOC chip; wherein, when the camera is started, the security module of the social TV generates an asymmetric key pair, which includes a private key and a public key, and sends the public key to the camera, so that the camera generates the symmetric key after receiving the public key sent by the social TV; The captured image containing the encrypted image data of the key area sent by the camera is a captured image that has been coded and compressed; After decompressing and decrypting the image data of the key area, a complete captured image is generated and output for display.

6. The method according to claim 5, characterized in that The method further includes: receiving a symmetric key encrypted by the camera using the public key; The symmetric key is decrypted using the private key to obtain a decrypted symmetric key.

7. The method according to claim 6, characterized in that The image data of the key area is decrypted using the symmetric key.

8. An image processing device, characterized in that: include: a memory for storing program instructions; A processor, configured to call the program instructions stored in the memory and execute the method according to any one of claims 1 to 4 and / or the method according to any one of claims 5 to 7 according to the obtained program.

9. A computer storage medium, characterized in that The computer storage medium stores computer-executable instructions, and the computer-executable instructions are used to enable the computer to execute the method according to any one of claims 1 to 4 and / or the method according to any one of claims 5 to 7.

Images