Image data processing method and electronic device
By performing privacy processing or prompt information when the matching degree of the image collected by the camera and the content displayed on the interface is less than the target value, the leakage problem of user privacy data is solved when the target application is not fully displayed, and the security and privacy protection of image data are achieved.
Patent Information
- Application Number
- CN202111265900.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-10-28
- Publication Date
- 2025-08-15
- Estimated Expiration
- 2041-10-28
AI Technical Summary
During business processing, the user's privacy data may be leaked without knowing it, especially in parts of images that are not fully displayed on the interface of the target application.
By obtaining the matching degree between the image collected by the camera and the content displayed on the interface, if it is less than or equal to the target value, the image will be processed or prompted to ensure that the part of the image that is not displayed on the interface does not contain user privacy data, for example, prompting the user to adjust the position through image replacement or output floating window.
It effectively avoids the leakage of user privacy data, improves the security of image data, and ensures the privacy protection of target applications when calling cameras to shoot.
Smart Images

Figure CN113987602B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of artificial intelligence, and specifically relates to an image data processing method and electronic device. Background Art
[0002] With the rapid development of the field of artificial intelligence, some applications need to call camera applications to call the camera to collect facial image data of the target user during business processing, and then perform corresponding business processing based on the facial image data, for example, face recognition, video conferencing, and other business processing based on the facial image data.
[0003] However, during the business processing of certain applications, users may be in an environment where their privacy is exposed without knowing it, which may lead to the leakage of users' private data. Summary of the Invention
[0004] The purpose of the embodiments of the present application is to provide an image data processing method and electronic device that can solve the problem of user privacy data leakage in the prior art.
[0005] In a first aspect, an embodiment of the present application provides a method for processing image data, the method comprising:
[0006] Acquire a first image captured by a camera, where the first image includes a facial image area of a target user;
[0007] When the matching degree between the first image and the display content of the interface is less than or equal to the target value, privacy processing is performed on the first image, or prompt information is output.
[0008] In a second aspect, an embodiment of the present application provides an electronic device, the electronic device comprising:
[0009] A first image acquisition module is configured to acquire a first image captured by a camera, wherein the first image includes a facial image area of a target user;
[0010] The first image processing module is configured to perform privacy processing on the first image or output a prompt message when the matching degree between the first image and the display content of the interface is less than or equal to a target value.
[0011] In a third aspect, an embodiment of the present application provides an electronic device comprising: a processor, a memory, and a program or instruction stored on the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the image data processing method as described in the first aspect.
[0012] In a fourth aspect, an embodiment of the present application provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the image data processing method as described in the first aspect.
[0013] In an embodiment of the present application, a first image captured by a camera is first acquired, where the first image includes a facial image area of a target user. If the degree of match between the first image and the displayed content of the interface is less than or equal to a target value, privacy processing is performed on the first image, or a prompt message is output. Specifically, the first image actually captured by the camera is matched with the content actually displayed on the interface of the target application. If the degree of match is less than or equal to the target value, the first image actually captured by the camera cannot be fully displayed on the interface of the target application, and the portion of the first image not displayed on the interface of the target application may contain the user's private data. This poses a risk of the user's private data being leaked without their knowledge. Therefore, before transmitting the first image to the target application, privacy processing is performed on the portion of the first image not displayed on the interface of the target application to obtain an image that does not contain the user's private data, or a prompt message is output. This reduces the risk of user private data leakage due to the presence of user private data in the portion of the first image not displayed on the interface of the target application, thereby fundamentally avoiding the leakage of the target user's private data, achieving the effect of protecting the user's private data, and improving the security of image data captured when the target application calls the camera for shooting. BRIEF DESCRIPTION OF THE DRAWINGS
[0014] Figure 1 This is a first flow chart of the method for processing image data provided by an embodiment of the present application;
[0015] Figure 2 This is a second flow chart of the method for processing image data provided in an embodiment of the present application;
[0016] Figure 3 This is a schematic diagram of the implementation principle of the first image privacy protection processing method of the image data processing method provided in the embodiment of the present application;
[0017] Figure 4 This is a schematic diagram of the implementation principle of the second image privacy protection processing of the image data processing method provided in an embodiment of the present application;
[0018] Figure 5 This is a third flow chart of the method for processing image data provided in an embodiment of the present application;
[0019] Figure 6 This is a schematic diagram of the first module composition of the electronic device provided in an embodiment of the present application;
[0020] Figure 7 This is a schematic diagram of the second module composition of the electronic device provided in an embodiment of the present application;
[0021] Figure 8 It is a structural diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0022] The following will be combined with the accompanying drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the embodiments described are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field are within the scope of protection of this application.
[0023] The terms "first," "second," and the like in the specification and claims of this application are used to distinguish similar objects, and are not used to describe a specific order or precedence. It should be understood that the terms used in this manner are interchangeable where appropriate, so that the embodiments of this application can be implemented in an order other than that illustrated or described herein, and that the objects distinguished by "first," "second," and the like are generally of the same type, and do not limit the number of objects; for example, the first object can be one or more. In addition, the term "and / or" in the specification and claims refers to at least one of the connected objects, and the character " / " generally indicates that the objects connected are in an "or" relationship.
[0024] The image data processing method and electronic device provided in the embodiments of the present application are described in detail below with reference to specific embodiments and their application scenarios in conjunction with the accompanying drawings.
[0025] Figure 1 This is a schematic diagram of a first flow chart of a method for processing image data provided in an embodiment of the present application. Figure 1 The method can be executed by an electronic device, in particular a processor in the electronic device, such as Figure 1 As shown, the method comprises at least the following steps:
[0026] S102, acquiring a first image captured by a camera, where the first image includes a facial image area of a target user;
[0027] Before acquiring the first image captured by the camera, the method further includes: the target application calls the camera application to call the camera to capture the first image.
[0028] Specifically, when the electronic device detects a user's access request for a specified service of a target application, if the current service processing node needs to collect the user's image data, the camera application is called to call the camera to collect the user's first image; for example, when the user uses a payment application, if it is detected that the current service processing node is face recognition, the camera application is called to call the camera to collect the user's first image; for another example, when the user uses a video sharing application, if it is detected that the current service processing node is video creation and shooting, the camera application is called to call the camera to collect the user's first image.
[0029] Furthermore, considering the different image display modes of the target application, the first image may be partially displayed in the interface of the target application, that is, the first image captured by the target application using the camera is not fully displayed in the above interface, and since the portion of the first image not displayed on the interface of the target application may contain the user's private data, if the first image is directly transmitted to the target application, there may be a risk of leakage of the user's private data due to the user's inability to observe the complete first image. Therefore, it is necessary to perform privacy processing on the first image or output a prompt message. Based on this, before the target application obtains the first image, the processor in the electronic device obtains the first image captured by the camera. The first image may include the facial image area of the target user captured by the camera, and other image areas other than the facial image area. The other image areas may include at least one of the facial image areas of other users other than the target user's face, the non-facial image area of the target user, the non-facial image area of other users, and the image area of the target user's current environment.
[0030] S104: When the matching degree between the first image and the displayed content of the interface is less than or equal to the target value, perform privacy processing on the first image or output a prompt message.
[0031] Specifically, if the degree of match between the first image captured by the camera and the display content of the interface of the target application is less than or equal to the target value, the display mode of the target application is determined to be partial image area display, that is, the first image is partially displayed in the interface of the target application; if the degree of match between the first image captured by the camera and the display content of the interface is greater than the target value, the display mode of the target application is determined to be full image area display, that is, the first image is fully displayed in the interface of the target application.
[0032] Specifically, for the case where the degree of match between the first image captured by the camera and the display content of the interface is less than or equal to the target value, that is, the image display mode of the target application is to display a partial area of the image, the processor in the electronic device needs to perform privacy processing on the first image after obtaining the first image captured by the camera, or output a prompt message; wherein the above-mentioned method of performing privacy processing on the first image can be to perform image replacement processing on the target image area in other image areas except the facial image area of the target user, that is, to replace or fill the target image area with publicly available data, for example, a preset image (which can be a background of a uniform color or other backgrounds) ), and then obtain a second image that does not contain the target user's private data, and then transmit it to the target application; the above-mentioned way of outputting prompt information can be to display prompt information, voice reminders, vibrations, etc. to the user in the interface to prompt the target user to adjust the posture. For example, the first image (that is, the content of the picture actually captured by the camera) is displayed in the form of a floating window to prompt the target user to adjust the posture based on the first image, that is, to adjust the posture based on the real shooting picture displayed in real time on the floating window, so as to ensure that the subsequently collected images do not contain the user's private data. Specifically, the user can be prompted to continue using the camera and adjust the posture, or the user can be prompted to temporarily terminate the use of the camera function.
[0033] In an embodiment of the present application, by matching the first image actually captured by the camera with the content actually displayed on the interface of the target application of the first image, if the matching degree is less than or equal to the target value, the first image actually captured by the camera cannot be fully displayed on the interface of the target application, and the portion of the first image not displayed on the interface of the target application may contain the user's privacy data. Therefore, there is a risk that the user's privacy data will be leaked without knowing it. Therefore, before transmitting the first image to the target application, it is necessary to perform privacy processing on the portion of the first image not displayed on the interface of the target application to obtain an image that does not contain user privacy data, or output a prompt message. This can reduce the risk of leakage of user privacy data due to the presence of user privacy data in the portion of the first image not displayed on the interface of the target application, thereby avoiding the leakage of the target user's privacy data at the root, achieving the effect of protecting the user's privacy data, and improving the security of the image data captured when the target application calls the camera for shooting.
[0034] Among them, considering that the second image obtained by performing privacy processing on the first image does not contain the user's privacy data, the second image can be directly transmitted to the target application. Based on this, Figure 2 As shown, in the above step S104, after performing privacy processing on the above first image or outputting prompt information, the following is further included:
[0035] S106: Transmit a second image obtained based on the first image to a target application, and the target application performs corresponding business processing based on the second image.
[0036] Specifically, the specific application scenarios of the image data processing method provided by this application can be: face recognition, video conferencing, short video publishing, etc., which require the use of the target application for corresponding business processing while also calling the camera application to call the camera for shooting; wherein the target application and the camera application are different applications;
[0037] In the specific implementation, for the application scenario of face recognition, the target application needs to perform face recognition on the target user based on the facial image area of the target user captured by the camera; for the application scenario of video conferencing, the target application needs to display the portrait data of the target user captured by the camera on the display interface (display); for the application scenario of short video publishing, the target application needs to display the short video data of the target user captured by the camera on the display interface (display).
[0038] In a specific implementation, taking a face recognition scenario as an example, since the target application only recognizes the target user's facial data when performing face recognition on the target user, the display interface of the target application only displays the target user's facial image area in the first image captured by the camera, that is, the matching degree between the first image and the display content of the interface is less than or equal to the target value (that is, the first image is partially displayed on the display interface of the target application), but the first image captured by the camera includes not only the target user's facial image area, but also other image areas except the target user's facial image area. Therefore, the target user will not be able to observe other image areas that may contain the target user's private data captured by the camera and transmitted to the target application, thereby causing the leakage of the target user's private data; based on this, in order to protect the target user's private data, before the target application obtains the first image, the processor of the electronic device first obtains the first image of the target user captured by the camera (that is, the target user's facial image area and other image areas except the facial image area of the target user), and then the processor performs privacy processing on the other image areas of the target user in the above-mentioned first image to obtain a second image, and transmits the second image obtained based on the privacy processing of the first image to the target application, that is, the combination of the facial image area of the target user and the other image areas after privacy processing is determined as the second image, and then transmits the second image to the target application, so that the target application performs face recognition on the target user based on the facial image area of the target user in the second image; or outputs a prompt message and displays the first image (that is, the content of the picture actually captured by the camera) in the form of a floating window to prompt the target user to adjust the posture based on the first image, that is, adjust the posture based on the actual shooting picture displayed in real time on the floating window, so as to ensure that the subsequently collected images do not contain the user's privacy data, and thus ensure that the subsequently collected images do not contain the user's privacy data.
[0039] In this application, since the processor pre-collects and transmits to the target application the image areas other than the target user's facial image area that may contain the target user's private data, and performs privacy protection processing, the other image areas finally transmitted to the target application do not contain the target user's private data, thereby achieving the purpose of avoiding the leakage of user privacy data from the root, and further realizing the role of protecting user privacy data.
[0040] Considering that when performing privacy processing on the first image, the target image region containing private data in the first image may be replaced with publicly available data, based on this, in step S104, performing privacy processing on the first image specifically includes: performing image replacement processing on the target image region in the image regions other than the target user's facial image region in the first image;
[0041] Specifically, in the case where the degree of match between the first image and the displayed content of the interface is less than or equal to the target value (i.e., the target application displays images in a partial image area), first, a first image of the target user captured by a camera is obtained, and then image replacement processing is performed on the target image area containing the target user's private data in the image area other than the target user's facial image area of the first image, replacing the target user's private data with publicly available data, thereby obtaining a second image that does not contain the target user's private data;
[0042] Furthermore, the above-mentioned second image that does not contain the target user's privacy data can be transmitted to the target application. Based on this, the second image obtained based on the above-mentioned first image is transmitted to the target application, specifically including: generating a second image of the target user based on other image areas after image replacement and the facial image area of the target user; and transmitting the second image to the target application.
[0043] Among them, considering that in addition to privacy processing of the first image, prompt information can also be output to enable the target user to adjust the posture based on the prompt information to ensure that the images subsequently captured by the camera do not contain the user's privacy data, based on this, in the above step S104, the prompt information is output, specifically including: displaying the first image in the form of a floating window to prompt the target user to adjust the posture based on the first image.
[0044] Specifically, while the original image of the target application is displayed on the display screen of the electronic device, the image actually captured by the camera can also be fully displayed in the form of a thumbnail or a floating window, (that is, on the display interface of the target application, not only is the first image partially displayed in the original image display mode of the target application, but the first image is also fully displayed in a thumbnail or a floating window). Based on this, the target user can be prompted to adjust the posture based on the fully displayed first image, so that the user can ensure that the image shooting range of the camera does not contain privacy data through posture adjustment.
[0045] Furthermore, when the target user determines that the first image does not contain user privacy data after the posture adjustment, the image captured by the camera can be transmitted to the target application. Based on this, after outputting the prompt information, it also includes: when receiving the confirmation input of the end of the target user's posture adjustment, obtaining the third image captured by the camera; and transmitting the third image to the target application.
[0046] Specifically, a confirmation input is received from the target user indicating that the target user's posture adjustment is completed based on the first image displayed completely in real time (i.e., a confirmation input is received from the target user indicating that the first image does not contain the target user's privacy data based on the first image displayed completely in real time). Based on the confirmation input, a third image of the target user after posture adjustment, which is captured by the camera, is obtained. Since the third image does not contain the target user's privacy data, that is, the third image that does not contain the user's privacy information is determined based on the first image after posture adjustment. Therefore, after receiving the third image captured by the camera, the processor in the electronic device can directly transmit the third image to the target application.
[0047] Among them, considering that different privacy processing methods or a combination of multiple privacy processing methods can be adopted for different situations to increase the flexibility of privacy processing, and in order to further improve the security of user privacy data, the two methods of privacy processing other image areas except the facial image area of the target user in the first image of the target user and outputting prompt information can be combined.
[0048] Specifically, a first image of the target user is first displayed in the form of a floating window to prompt the target user to adjust the posture based on the first image, and receive a confirmation input from the target user indicating that the posture adjustment is completed based on the first image observed in real time (that is, a confirmation input that the first image does not contain the target user's privacy data). In order to improve the accuracy of the confirmation input, the processor of the electronic device can first obtain the first image of the target user after the posture adjustment is collected by the camera, and when the degree of match between the first image and the display content of the interface of the target application is less than or equal to the target value, perform privacy processing on the first image, that is, identify privacy risks on the first image. If a risk of privacy leakage is identified, image replacement processing is performed on the target image area in the first image that contains the user's privacy data, and based on the first image after the image replacement processing, a second image of the target user that does not contain the user's privacy data is determined; or image replacement processing is directly performed on the target image area in the first image, and based on the first image after the image replacement processing, a second image of the target user that does not contain the user's privacy data is determined.
[0049] In an embodiment of the present application, different privacy protection processing methods are used by setting output prompt information to prompt the target user to adjust the posture, and performing image replacement processing on the target image area in the first image area to increase the flexibility of privacy protection. Combining the two methods can further enhance the security of user privacy data.
[0050] Furthermore, with respect to the above-mentioned method of outputting prompt information, prompting the target user to adjust the posture, and upon receiving a confirmation input indicating that the posture adjustment is completed by the target user, obtaining a third image captured by the camera, specifically includes:
[0051] Step 1: Displaying the target user's facial image area and other image areas except the target user's facial image area in a floating window on the display interface of the target application;
[0052] Specifically, a floating window is popped up on a designated area of a display interface of the target application. The floating window may be at least one of a semi-transparent floating window and a fully transparent floating window, and the complete first image of the target user (i.e., the target user's facial image area and other image areas except the target user's facial image area) is displayed on the floating window.
[0053] Step 2: prompting the target user to adjust the posture based on the first image of the target user displayed in the floating window;
[0054] The posture adjustment may include at least one of posture adjustment of the electronic device (i.e., adjustment of the posture of the camera) and posture adjustment of the target user. The posture adjustment criterion is that the target user observes in real time that the first image area displayed in the floating window does not contain the target user's private data.
[0055] Step 3: Upon receiving a confirmation input indicating that the target user's posture adjustment is complete, obtaining a third image captured by the camera;
[0056] Among them, the third image obtained after receiving the confirmation input that the target user's posture adjustment is completed (i.e., the third image after the target user's posture adjustment is performed) does not contain the target user's privacy data (i.e., the target of the posture adjustment is that other image areas outside the adjusted target user's facial image area do not contain the user's privacy data).
[0057] Specifically, such as Figure 3 As shown, a floating window pops up on the display interface of the target application, and the floating window can fully display the first image (that is, the target user's facial image area and other image areas except the target user's facial image area) to the target user, that is, Figure 3The display effect shown in (b) in the figure is displayed, and the target user is prompted to adjust the posture based on the first image of the target user displayed in the above floating window. When a confirmation input is received indicating that the posture adjustment of the target user is completed, that is, when a confirmation input is received from the target user that the first image fed back based on the image observed in the interface of the target application does not contain the target user's privacy data, the first image after the posture adjustment is determined as the third image (that is, the third image captured by the camera is obtained), and the above third image is transmitted to the target application, so that the target application performs corresponding business processing based on the third image.
[0058] Furthermore, with respect to the above-mentioned privacy processing method for the first image, image replacement processing is performed on the target image area in other image areas of the first image of the target user except the target user's facial image area, specifically including:
[0059] Step 1: determining a target image area in other image areas of the first image except the face image area of the target user; wherein the target image area includes: other image areas, or image areas in other image areas that are not displayed on the interface;
[0060] Specifically, for the case where the target image area includes other image areas, image recognition processing is performed on the first image to determine the area where the facial image area of the target user is located, and the image area outside the area where the facial image area is located is determined as the target image area; for the case where the target image area includes image areas that are not displayed on the interface among other image areas, the undisplayed area is determined as the target image area based on the positional relationship between the display area and the undisplayed area of the pre-stored display interface of the target application; wherein, the positional relationship between the display area and the undisplayed area of the pre-stored display interface of the target application can be determined based on the proportional relationship between the complete image display area of a preset default image on the display screen and the display area of the image partial area on the display interface of the target application. Specifically, the default image can be first transmitted to the target application (a publicly available image transmitted to the target application by the processor), and then the display area of the image partial area displayed on the display interface of the target application of the default image is obtained, and the proportional relationship between the display area of the image partial area and the complete image display area in the default image is calculated.
[0061] Step 2: performing image replacement processing on the target image area based on a preset image;
[0062] Specifically, the image content in the target image area in the above-mentioned first image is replaced with a preset image, that is, the target image area is subjected to image replacement processing, that is, the target image area in the above-mentioned first image area is updated, wherein the above-mentioned preset image can be a mosaic background, a background of uniform color, or other publicly available background images.
[0063] Furthermore, a combination of the facial image area of the target user in the first image and other image areas except the facial image area of the target user after the image replacement process is determined as the second image of the target user.
[0064] Specifically, for the case where the target image area is in other image areas, based on the preset image, image replacement processing is performed on other image areas in the first image except the target user's facial image area to obtain an updated first image (i.e., other image areas in the first image are replaced with the preset image); Figure 4 As shown, for the case where the target image area is an image area that is not displayed on the interface among other image areas of the first image, the first image (including the displayed image area and the undisplayed image area) is displayed on the display interface of the target application, that is, Figure 4 The display effect shown in (a) in FIG, wherein the complete display effect of the first image is Figure 4 In step (b), the image areas not displayed in the other image areas except the face image area of the target user in the first image are replaced with the preset image, and a combination of the face image area of the target user (i.e., the face image area of the target user in the displayed image area), the image areas displayed in the other image areas except the face image area of the target user, and the image areas not displayed in the other image areas after image replacement processing is obtained, i.e. Figure 4 In the display effect shown in (c), the above-mentioned other image areas include the image areas not displayed in the other image areas after the image replacement processing (that is, the preset images) and the combination of the image areas displayed on the interface in the other image areas.
[0065] In an embodiment of the present application, in the method of performing privacy processing on the first image, when performing image replacement on the target image area in the first image of the target user, the flexibility of the privacy protection processing is further improved by flexibly setting the range of the target image area.
[0066] In specific implementation, after obtaining the first image captured by the camera, the image privacy protection mechanism can be directly triggered, that is, the above-mentioned step S104 is directly triggered to perform privacy processing on the first image, or output a prompt message; further, considering that there is a relatively large risk of privacy data leakage only when the image display mode of the target application is to display a partial area of the image, therefore, in order to improve the pertinence of image privacy protection, thereby achieving the improvement of the business processing response efficiency of the target application while ensuring the security of the user's privacy data, that is, first confirming that the matching degree between the first image and the display content of the interface of the target application is less than or equal to the target value, that is, only when it is determined that the image display mode of the target application is to display a partial area of the image, the image privacy protection mechanism is triggered. Specifically, Figure 5 As shown, the above step S104, when the matching degree between the first image and the display content of the interface is less than or equal to the target value, performs privacy processing on the first image, or before outputting the prompt information, specifically includes:
[0067] S108, obtaining the display content of the interface;
[0068] S110: performing an image content comparison between a first image captured by a camera and display content of an interface to determine a matching degree between the first image and the display content.
[0069] Specifically, since after obtaining the first image captured by the camera, the first image may contain the user's private data, the first image cannot be directly transmitted to the target application. Therefore, while obtaining the first image captured by the camera, step S108 can be executed to obtain the display content of the interface to ensure that the display content on the interface and the first image captured by the camera are captured in the same shooting environment and have part of the same image content, so that the first image and the display content can be compared for image content, determine the matching degree between the first image and the display content, and then determine the image display mode of the target application. Among them, the above-mentioned step S108, obtaining the display content of the interface can also be executed before S102, obtaining the first image captured by the camera, or after S102, obtaining the first image captured by the camera, to solve the problem that the target application may automatically call the camera to capture the first image of the target user, thereby leaking the user's private data.
[0070] Specifically, the first image captured by the camera is compared with the display content of the interface to determine the matching degree between the first image and the display content. If the matching degree between the first image and the display content of the interface is less than or equal to the target value, it is determined that the first image of the target user on the display interface of the target application is displayed as a partial image area; if the matching degree between the first image and the display content of the interface is greater than the target value, it is determined that the first image of the target user on the display interface of the target application is displayed as the entire image area.
[0071] Furthermore, with respect to the process of determining the degree of match between the first image captured by the camera and the display content of the target application interface, in addition to the above-mentioned method of acquiring the display content of the interface while acquiring the first image captured by the camera and performing image content comparison between the first image captured by the camera and the display content of the interface, the degree of match between the first image captured by the camera and the display content of the target application interface may also be determined based on a default image. Specifically, each time the target application uses the camera to capture the first image of the target user, the degree of match between the first image and the display content of the target application interface is determined based on the default image, thereby determining the image display mode of the target application, that is, determining whether the first image is displayed in a partial image area or in the entire image area. Alternatively, when the target application meets preset usage conditions, such as when the target application is installed for the first time or when there is a version update of the target application, the degree of match between the first image and the display content of the target application interface is determined based on the default image, thereby determining the image display mode of the target application, and storing the image display mode of the target application (for example, displaying a partial image area or displaying the entire image area). In this way, it is possible to subsequently directly determine whether the first image is displayed in a partial image area or in the entire image area based on the pre-stored display mode label of the target application.
[0072] Specifically, if it is determined that the display mode of the target application is to display a partial area of the image, then the above step S104 is executed to perform privacy processing on the above first image, or output prompt information.
[0073] If it is determined that the display mode of the target application is to display the entire area of the image, the first image of the target user is directly transmitted to the target application; in order to further ensure the security of privacy data, after determining that the display mode of the target application is to display the entire area of the image, the target user can be prompted to confirm that there is no privacy leakage risk in the first image displayed in the interface of the target application. After receiving the confirmation information from the target user, the first image of the target user is transmitted to the target application, so that the target application performs corresponding business processing based on the first image.
[0074] Specifically, the process of determining the degree of matching between the first image captured by the camera and the display content of the target application interface based on the default image, and then determining the image display mode of the target application, specifically includes:
[0075] Step 1: Display a default image on the display interface of the target application, and take a screenshot of the display interface to obtain a fourth image;
[0076] The above-mentioned default image is different from the first image of the target user captured by the camera. The default image is a default image (a publicly available image) directly transmitted by the processor to the target application and does not contain the target user's private data.
[0077] Step 2: Comparing the first image captured by the camera with the display content of the default image in the interface of the target application to determine the degree of match between the first image and the display content, that is, determining whether the area occupied by the same image between the default image and the fourth image is less than or equal to a target value;
[0078] The area occupied by the same image is specifically the area occupied by the same image between the default image and the fourth image on the fourth image (i.e., the display interface); specifically, if the occupied area is less than or equal to the target value (i.e., the degree of match between the first image and the display content of the interface is less than or equal to the target value), it is determined that the image display mode in the target application is to display a partial area of the image, and privacy processing is performed on the first image, or a prompt message is output; if the occupied area is greater than the target value (i.e., the degree of match between the first image and the display content of the interface is greater than the target value), it is determined that the image display mode in the target application is to display the entire area of the image, and the first image of the target user can be directly transmitted to the target application;
[0079] In a specific implementation, the process of determining the image display mode of the target application may be determined based on the default image each time, that is, each time it is detected that the target application calls the camera to shoot, the process of determining the image display mode of the target application based on the default image is executed once;
[0080] Alternatively, it can be determined directly based on a pre-stored image display mode label of the target application; specifically, the image display mode of the target application (i.e., the image display mode label of the target application) is determined in advance based on the default image, and the image display mode of the target image is marked. For example, the correspondence between the target application and the image display mode label can be stored, and the image display mode label includes: partial image area display or full image area display; then, during the use of the target application, the image display mode corresponding to the target application can be quickly determined based on the image display mode label; wherein, if the image display mode is partial image area display, it is determined that the matching degree between the first image and the display content of the interface is less than or equal to the target value, and then the first image is privacy processed, or a prompt message is output.
[0081] Specifically, for each designated application installed on the electronic device (including the target application and other applications with the function of calling the camera application), the above-mentioned image display mode determination process is pre-executed once (that is, it is determined whether the image display mode of the designated application for the default image is partial image area display or full image area display), and the image display mode of the designated application is marked according to the determination result of the image display mode. Furthermore, in the case where the target application with the image display mode of partial image area display calls the camera (camera application), after obtaining the first image captured by the camera, step S104 is automatically executed to perform privacy processing on the first image, and then the second image obtained based on the first image is transmitted to the target application, or a prompt message is output to prompt the user to adjust the posture.
[0082] Furthermore, considering that the image display mode of the target application may change when the target user's image data is displayed, it is necessary to change the image display mode label of the target application after the image display mode is changed. Therefore, a verification mechanism for the image display mode label of the target application is introduced; specifically, when it is detected that there is an application version update of the target application, the above steps one to two are executed, that is, the image display mode of the target application is determined again based on the default image, and the original image display mode is updated based on the new image display mode, so that the updated image display mode label can be used to decide whether to trigger the execution of the above S104, the step of performing privacy processing on the first image, or outputting prompt information.
[0083] Furthermore, even if a version update of the target application is not detected, there may still be a situation where the image display mode of the target application has changed. Since the target application has been marked as displaying the entire image area, once the image display mode changes but the original image display mode of the target application has not been updated, user privacy data may be leaked. Based on this, a label verification process can be performed on the target application marked as displaying the entire image area at a preset time interval. Specifically, for the target application with the display mode label of displaying the entire image area, not only is the above-mentioned determination of the image display mode of the target application based on the default image performed once when an application version update is detected, but the above-mentioned determination of the image display mode of the target application based on the default image is also performed at a preset time interval. The above-mentioned determination of the image display mode of the target application based on the default image (i.e., determining whether the image display mode of the designated application for the default image is partial image display or full image display) is performed at a preset time interval. Then, based on the image display mode recognition result, it is determined whether the image display mode label of the target application needs to be updated. Specifically, if the image display mode label recognized this time is inconsistent with the image display mode label recognized last time, the image display mode of the target application is updated based on the image display mode label recognized this time.
[0084] In an embodiment of the present application, a pre-recorded image display mode label of the target application is adopted. In this way, during the use of the target application, the image display mode of the target application can be directly determined based on the image display mode label to display a partial area of the image or the entire area of the image. There is no need to determine the image display mode of the target application based on the default image every time. Therefore, the response efficiency of the target application to user business requests can be improved. However, due to the update of the application version, the display mode of the application's shooting interface may change, thereby causing the display mode label to change. Therefore, it is necessary to introduce the above-mentioned label verification mechanism to verify the image display mode of the target application, so as to improve the accuracy of privacy protection for the first image, thereby further improving the security of the target user's privacy data.
[0085] Furthermore, when it is determined that the degree of match between the first image and the display content of the interface is less than or equal to a target value, that is, when it is determined that the first image is displayed as a partial image area on the display interface of the target application (that is, the image display mode of the target application is partial image area display), privacy processing can be directly performed on the first image, or a prompt message can be output. Furthermore, considering that the first image is displayed as a partial image area on the display interface of the target application, the first image may contain private data that cannot be observed by the user. In this case, there is a risk of leakage of user privacy data. Correspondingly, the first image may not contain user privacy data. Therefore, in order to improve the targetedness of image privacy protection processing and thereby ensure the security of user privacy data, image recognition can be first performed on the first image to determine whether it contains user privacy data. Only when it contains user privacy data, the process of performing privacy protection processing on the first image is executed. Based on this, when it is determined that the degree of match between the first image and the display content of the interface is less than or equal to the target value, that is, when it is determined that the image display mode of the target application is partial image area display, privacy processing is performed on the above-mentioned first image, or a prompt message is output, specifically including:
[0086] The first image is subjected to image recognition using a pre-trained image recognition model to obtain a privacy risk identification result; if the privacy risk identification result indicates that there is a risk of privacy leakage, privacy processing is performed on the first image, or a prompt message is output.
[0087] Among them, the existing machine learning methods can be used to iteratively train and update the model parameters of the preset image recognition model to obtain updated model parameters until the model function corresponding to the image recognition model converges, thereby obtaining a trained image recognition model, wherein the image recognition model is used to perform image recognition on the first image, thereby obtaining a privacy risk identification result.
[0088] Among them, when using the image recognition model for prediction, if the first image input into the pre-trained image recognition model contains the target user's private data, the recognition result of the image recognition model is determined to be that there is a privacy leakage risk; if the above privacy risk identification result is that there is a privacy leakage risk, the first image is privacy processed to obtain a second image that does not contain the target user's private data, and then the second image is transmitted to the target application for related business processing; or a prompt message is output to enable the target user to adjust the posture based on the real-time observed image content.
[0089] Specifically, after determining that the degree of match between the first image and the display content of the interface is less than or equal to the target value, that is, after determining that the image display mode of the target application is to display a partial area of the image, privacy processing can be directly performed on the first image. Furthermore, in order to improve the targeted privacy processing, privacy risk identification can be first performed on the first image. If it is identified that the first image contains the target user's private data, privacy processing can be performed on the first image. In particular, in order to increase the process of identifying private data in the first image, corresponding prompt information can be output based on the image area where the private data is located in the first image identified as containing the private data, prompting the target user to adjust the posture. For example, the target user can be prompted with "Privacy leak, please adjust the angle", "Privacy leak, please pay attention to your clothing", and "Privacy leak, please change the shooting location". In specific implementation, the image area where the private data is located can be marked in the first image displayed in the floating window to enable the user to quickly identify the location of the private data; and / or the image area where the private data is located in the first image containing the private data can be directly replaced with a preset image.
[0090] If the first image input into the pre-trained image recognition model does not contain the target user's private data, the recognition result of the image recognition model is determined to be that there is no risk of privacy leakage, and the first image is directly transmitted to the target application for corresponding business processing. Furthermore, in order to improve the accuracy of the recognition result, the user can also be prompted to confirm that there is no risk of privacy leakage. After detecting the user's confirmation information, the above-mentioned first image is transmitted to the target application for corresponding business processing.
[0091] The image data processing method in the embodiment of the present application first obtains a first image captured by a camera, the first image including the facial image area of the target user, and performs privacy processing on the first image when the matching degree between the first image and the display content of the interface is less than or equal to the target value, or outputs a prompt message, that is, by matching the first image actually captured by the camera with the content actually displayed on the interface of the target application of the first image. If the matching degree is less than or equal to the target value, the first image actually captured by the camera cannot be fully displayed on the interface of the target application, and the part of the first image that is not displayed on the interface of the target application may contain the user's Privacy data, so there is a risk that the user's privacy data will be leaked without knowing it. Therefore, before transmitting the first image to the target application, it is necessary to perform privacy processing on the portion of the first image that is not displayed on the interface of the target application, so as to obtain an image that does not contain the user's privacy data, or output a prompt message. This can reduce the risk of leakage of user privacy data due to the presence of user privacy data in the portion of the first image that is not displayed on the interface of the target application, thereby avoiding the leakage of the target user's privacy data at the root, achieving the effect of protecting the user's privacy data, and improving the security of the image data captured when the target application calls the camera for shooting.
[0092] It should be noted that the image data processing method provided in the embodiments of the present application can be executed by an electronic device, particularly a processor in the electronic device, or a control module in the electronic device for executing the image data processing method. In the embodiments of the present application, the electronic device provided in the embodiments of the present application is described by taking the execution of the image data processing method by an electronic device as an example.
[0093] Corresponding to the image data processing method provided in the above embodiment, based on the same technical concept, the embodiment of the present application further provides an electronic device, Figure 6 This is a schematic diagram of the module composition of an electronic device provided in an embodiment of the present application, which is used to perform Figures 1 to 5 Describes the image data processing methods, such as Figure 6 As shown, the electronic device includes:
[0094] A first image acquisition module 602 is configured to acquire a first image captured by a camera, wherein the first image includes a facial image area of a target user;
[0095] The first image processing module 604 is configured to perform privacy processing on the first image or output a prompt message when the matching degree between the first image and the display content of the interface is less than or equal to a target value.
[0096] In an embodiment of the present application, by matching the first image actually captured by the camera with the content actually displayed on the interface of the target application of the first image, if the matching degree is less than or equal to the target value, the first image actually captured by the camera cannot be fully displayed on the interface of the target application, and the portion of the first image not displayed on the interface of the target application may contain the user's privacy data. Therefore, there is a risk that the user's privacy data will be leaked without knowing it. Therefore, before transmitting the first image to the target application, it is necessary to perform privacy processing on the portion of the first image not displayed on the interface of the target application to obtain an image that does not contain user privacy data, or output a prompt message. This can reduce the risk of leakage of user privacy data due to the presence of user privacy data in the portion of the first image not displayed on the interface of the target application, thereby avoiding the leakage of the target user's privacy data at the root, achieving the effect of protecting the user's privacy data, and improving the security of the image data captured when the target application calls the camera for shooting.
[0097] Optional, such as Figure 7 As shown, the electronic device further includes a second image transmission module 606, which is used to:
[0098] A second image obtained based on the first image is transmitted to a target application, and the target application performs corresponding business processing based on the second image.
[0099] Optional, such as Figure 7 As shown, the electronic device further includes:
[0100] The interface content acquisition module 608 is used to acquire the display content of the interface;
[0101] The image comparison module 610 is configured to perform an image content comparison between the first image and the display content to determine a matching degree between the first image and the display content.
[0102] Optionally, the first image further includes: other image areas except the target user's facial image area;
[0103] The first image processing module 604 is specifically configured to:
[0104] performing image replacement processing on the target image area in the other image areas;
[0105] The second image transmission module 606 is specifically configured to:
[0106] generating a second image of the target user based on the other image regions after image replacement and the facial image region of the target user;
[0107] The second image is transmitted to a target application.
[0108] Optionally, the first image processing module 604 is further specifically configured to:
[0109] Determine a target image area in the other image areas, where the target image area includes: the other image areas, or an image area in the other image areas that is not displayed on the interface;
[0110] Based on a preset image, image replacement processing is performed on the target image area.
[0111] Optionally, the first image processing module 604 is further specifically configured to:
[0112] The first image is displayed in a floating window to prompt the target user to adjust the posture based on the first image.
[0113] Optionally, the electronic device further includes:
[0114] A third image acquisition module is configured to acquire a third image captured by the camera upon receiving a confirmation input indicating that the position adjustment of the target user is complete;
[0115] The third image transmission module is configured to transmit the third image to a target application.
[0116] The electronic device in the embodiment of the present application first obtains a first image captured by a camera, where the first image includes a facial image area of a target user, and performs privacy processing on the first image when the degree of match between the first image and the display content of the interface is less than or equal to a target value, or outputs a prompt message, that is, by matching the first image actually captured by the camera with the content actually displayed on the interface of the target application of the first image. If the degree of match is less than or equal to the target value, the first image actually captured by the camera cannot be fully displayed on the interface of the target application, and the portion of the first image that is not displayed on the interface of the target application may contain the user's privacy. Therefore, there is a risk that the user's privacy data will be leaked without knowing it. Therefore, before transmitting the first image to the target application, it is necessary to perform privacy processing on the portion of the first image that is not displayed on the interface of the target application, so as to obtain an image that does not contain the user's privacy data, or output a prompt message. This can reduce the risk of leakage of the user's privacy data due to the presence of user privacy data in the portion of the first image that is not displayed on the interface of the target application, thereby avoiding the leakage of the target user's privacy data at the root, achieving the effect of protecting the user's privacy data, and improving the security of the image data captured when the target application calls the camera for shooting.
[0117] The electronic device in the embodiments of the present application may be a device, or a component, integrated circuit, or chip in a terminal. The device may be a mobile electronic device or a non-mobile electronic device. For example, the mobile electronic device may be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), etc. The non-mobile electronic device may be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), a teller machine, or a self-service machine, etc., and the embodiments of the present application do not specifically limit this.
[0118] The electronic device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.
[0119] The electronic device provided in the embodiment of the present application can achieve Figures 1 to 5 To avoid repetition, the various processes implemented in the embodiment of the method for processing image data will not be described here.
[0120] Alternatively, as Figure 8 As shown, an embodiment of the present application also provides an electronic device, including a processor 810, a memory 809, and a program or instruction stored in the memory 809 and executable on the processor 810. When the program or instruction is executed by the processor 810, each process of the above-mentioned image data processing method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be described here.
[0121] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.
[0122] Figure 8 A schematic diagram of the hardware structure of an electronic device implementing an embodiment of the present application.
[0123] The electronic device includes but is not limited to components such as a radio frequency unit 801 , a network module 802 , an audio output unit 803 , an input unit 804 , a sensor 805 , a display unit 806 , a user input unit 807 , an interface unit 808 , a memory 809 , a processor 810 , and a power supply 811 .
[0124] Those skilled in the art will understand that the electronic device may also include a power supply 811 (such as a battery) to supply power to each component. The power supply 811 may be logically connected to the processor 810 through a power management system, thereby implementing functions such as charging, discharging, and power consumption management through the power management system. Figure 8 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be repeated here.
[0125] The processor 810 is configured to obtain a first image captured by a camera, where the first image includes a facial image area of a target user;
[0126] When the matching degree between the first image and the display content of the interface is less than or equal to the target value, privacy processing is performed on the first image, or prompt information is output.
[0127] In an embodiment of the present application, by matching the first image actually captured by the camera with the content actually displayed on the interface of the target application of the first image, if the matching degree is less than or equal to the target value, the first image actually captured by the camera cannot be fully displayed on the interface of the target application, and the portion of the first image not displayed on the interface of the target application may contain the user's privacy data. Therefore, there is a risk that the user's privacy data will be leaked without knowing it. Therefore, before transmitting the first image to the target application, it is necessary to perform privacy processing on the portion of the first image not displayed on the interface of the target application to obtain an image that does not contain user privacy data, or output a prompt message. This can reduce the risk of leakage of user privacy data due to the presence of user privacy data in the portion of the first image not displayed on the interface of the target application, thereby avoiding the leakage of the target user's privacy data at the root, achieving the effect of protecting the user's privacy data, and improving the security of the image data captured when the target application calls the camera for shooting.
[0128] Optionally, the processor 810 is further configured to transmit a second image obtained based on the first image to a target application after performing privacy processing on the first image or outputting prompt information, and the target application performs corresponding business processing based on the second image.
[0129] Optionally, the above-mentioned processor 810 is also used to perform privacy processing on the first image when the matching degree between the first image and the display content of the interface is less than or equal to the target value, or obtain the display content of the interface before outputting the prompt information; perform image content comparison between the first image and the display content to determine the matching degree between the first image and the display content.
[0130] Optionally, the first image also includes: other image areas other than the facial image area of the target user; the above-mentioned processor 810 is also used to perform image replacement processing on the target image area in the other image areas; based on the other image areas after image replacement and the facial image area of the target user, generate a second image of the target user; and transmit the second image to the target application.
[0131] Optionally, the above-mentioned processor 810 is also used to determine the target image area in the other image areas, and the target image area includes: the other image area, or the image area not displayed on the interface of the other image area; based on the preset image, perform image replacement processing on the target image area.
[0132] Optionally, the processor 810 is further configured to display the first image in a floating window to prompt the target user to adjust the posture based on the first image.
[0133] Optionally, the processor 810 is further configured to, after outputting the prompt information, obtain a third image captured by the camera upon receiving a confirmation input indicating that the position adjustment of the target user is complete; and transmit the third image to the target application.
[0134] The electronic device in the embodiment of the present application first obtains a first image captured by a camera, where the first image includes a facial image area of a target user, and performs privacy processing on the first image when the degree of match between the first image and the display content of the interface is less than or equal to a target value, or outputs a prompt message, that is, by matching the first image actually captured by the camera with the content actually displayed on the interface of the target application of the first image. If the degree of match is less than or equal to the target value, the first image actually captured by the camera cannot be fully displayed on the interface of the target application, and the portion of the first image that is not displayed on the interface of the target application may contain the user's privacy. Therefore, there is a risk that the user's privacy data will be leaked without knowing it. Therefore, before transmitting the first image to the target application, it is necessary to perform privacy processing on the portion of the first image that is not displayed on the interface of the target application, so as to obtain an image that does not contain the user's privacy data, or output a prompt message. This can reduce the risk of leakage of the user's privacy data due to the presence of user privacy data in the portion of the first image that is not displayed on the interface of the target application, thereby avoiding the leakage of the target user's privacy data at the root, achieving the effect of protecting the user's privacy data, and improving the security of the image data captured when the target application calls the camera for shooting.
[0135] It should be understood that in the embodiments of the present application, the RF unit 801 may be used to receive and transmit signals during information transmission or calls. Specifically, it receives downlink data from the base station and transmits it to the processor 810 for processing; in addition, it transmits uplink data to the base station. Typically, the RF unit 801 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low-noise amplifier, a duplexer, and the like. Furthermore, the RF unit 801 may communicate with the network and other devices via a wireless communication system.
[0136] The electronic device provides users with wireless broadband Internet access through the network module 802, such as helping users to send and receive emails, browse web pages, and access streaming media.
[0137] The audio output unit 803 can convert audio data received by the RF unit 801 or the network module 802 or stored in the memory 809 into an audio signal and output it as sound. In addition, the audio output unit 803 can also provide audio output related to specific functions performed by the electronic device (for example, a call signal reception sound, a message reception sound, etc.). The audio output unit 803 includes a speaker, a buzzer, a receiver, etc.
[0138] The input unit 804 may include a graphics processing unit (GPU) 8041 and a microphone 8042. The graphics processor 8041 processes image data of still images or videos obtained by an image capture device (such as a camera) in video capture mode or image capture mode. The display unit 806 may include a display panel 8061, which may be configured in the form of a liquid crystal display, an organic light-emitting diode, etc. The user input unit 807 includes a touch panel 8071 and other input devices 8072. The touch panel 8071 is also called a touch screen. The touch panel 8071 may include two parts: a touch detection device and a touch controller. Other input devices 8072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, power keys, etc.), a trackball, a mouse, and a joystick, which will not be described in detail here. The memory 809 may be used to store software programs and various data, including, but not limited to, applications and operating systems. The processor 810 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and applications, etc., and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 810.
[0139] The electronic device also includes at least one sensor 805, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 8061 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 8061 and / or the backlight when the electronic device is moved to the ear. As a type of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (generally three axes), and can detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of the electronic device (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; the sensor 805 can also include a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, etc., which will not be repeated here.
[0140] The display unit 806 is used to display information input by the user or information provided to the user. The display unit 806 may include a display panel 8061, which may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.
[0141] The user input unit 807 can be used to receive input digital or character information, and to generate key signal input related to the user settings and function control of the electronic device. Specifically, the user input unit 807 includes a touch panel 8071 and other input devices 8072. The touch panel 8071, also known as a touch screen, can collect user touch operations on or near it (such as operations performed by the user using any suitable object or accessory such as a finger, stylus, etc. on or near the touch panel 8071). The touch panel 8071 may include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch direction and detects the signal caused by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device and converts it into touch point coordinates, which are then sent to the processor 810, which receives and executes the command sent by the processor 810. In addition, the touch panel 8071 can be implemented using various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 8071, the user input unit 807 may also include other input devices 8072. Specifically, other input devices 8072 may include but are not limited to a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be described in detail here.
[0142] Furthermore, the touch panel 8071 may be overlaid on the display panel 8061. When the touch panel 8071 detects a touch operation on or near it, it transmits the information to the processor 810 to determine the type of touch event. Subsequently, the processor 810 provides corresponding visual output on the display panel 8061 according to the type of touch event. Figure 8 In the figure, the touch panel 8071 and the display panel 8061 are two independent components to realize the input and output functions of the electronic device. However, in some embodiments, the touch panel 8071 and the display panel 8061 can be integrated to realize the input and output functions of the electronic device, which is not limited here.
[0143] The interface unit 808 is an interface for connecting external devices to the electronic device. For example, the external device may include a wired or wireless headset port, an external power supply 811 (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, an audio input / output (I / O) port, a video I / O port, a headphone port, etc. The interface unit 808 can be used to receive input (e.g., data information, power, etc.) from the external device and transmit the received input to one or more components within the electronic device, or can be used to transmit data between the electronic device and the external device.
[0144] Memory 809 can be used to store software programs and various data. Memory 809 may primarily include a program storage area and a data storage area. The program storage area may store an operating system and at least one application required for a function (such as a sound playback function or an image playback function); the data storage area may store data generated based on the use of the mobile phone (such as audio data, a phone book, etc.). Furthermore, memory 809 may include high-speed random access memory and non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device.
[0145] The processor 810 is the control center of the electronic device. It connects the various components of the electronic device using various interfaces and circuits. By running or executing software programs and / or modules stored in the memory 809 and accessing data stored in the memory 809, it performs various functions of the electronic device and processes data, thereby monitoring the entire electronic device. The processor 810 may include one or more processing units; preferably, the processor 810 may integrate an application processor 810 and a modem processor 810. The application processor 810 primarily processes the operating system, user interface, and application programs, while the modem processor 810 primarily handles wireless communications. It is understood that the modem processor 810 may not be integrated into the processor 810.
[0146] The electronic device may also include a power supply 811 (such as a battery) to supply power to each component. Preferably, the power supply 811 can be logically connected to the processor 810 through the power supply 811 management system, thereby realizing functions such as charging, discharging, and power consumption management through the power supply 811 management system.
[0147] In addition, the electronic device includes some functional modules not shown, which will not be described here.
[0148] Preferably, an embodiment of the present application also provides an electronic device, including a processor 810, a memory 809, and a program or instruction stored in the memory 809 and executable on the processor 810. When the program or instruction is executed by the processor 810, each process of the above-mentioned image data processing method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be described here.
[0149] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by the processor 810, each process of the above-mentioned image data processing method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0150] The processor 810 is the processor 810 in the electronic device described in the above embodiment. The readable storage medium includes a computer-readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.
[0151] An embodiment of the present application also provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned image data processing method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0152] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.
[0153] It should be noted that, in this article, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the statement "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device comprising the element. In addition, it should be noted that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in the opposite order according to the functions involved. For example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.
[0154] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), including a number of instructions for enabling a terminal (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods described in each embodiment of the present application.
[0155] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of this application, ordinary technicians in this field can also make many forms without departing from the purpose of this application and the scope of protection of the claims, all of which are within the protection of this application.
Claims
1. A method for processing image data, characterized in that: The method comprises: Acquire a first image captured by a camera, where the first image includes a facial image area of a target user; When the degree of matching between the first image and the display content of the first image on the interface of the target application is less than or equal to a target value, performing privacy processing on the first image or outputting a prompt message; The performing privacy processing on the first image includes: performing privacy processing on a portion of the first image that is not displayed on the interface of the target application; After performing privacy processing on the first image or outputting prompt information, the method further includes: A second image obtained based on the first image is transmitted to a target application, and the target application performs corresponding business processing based on the second image.
2. The method according to claim 1, characterized in that Before performing privacy processing on the first image or outputting prompt information when the matching degree between the first image and the displayed content of the interface is less than or equal to a target value, the method further includes: Get the display content of the interface; An image content comparison is performed on the first image and the display content to determine a matching degree between the first image and the display content.
3. The method according to claim 1, characterized in that The first image further includes: other image areas except the face image area of the target user; The performing privacy processing on the first image includes: performing image replacement processing on the target image area in the other image areas; The transmitting the second image obtained based on the first image to the target application includes: generating a second image of the target user based on the other image regions after image replacement and the facial image region of the target user; The second image is transmitted to a target application.
4. The method according to claim 3, characterized in that The performing image replacement processing on the target image area in the other image areas includes: Determine a target image area in the other image areas, where the target image area includes: the other image areas, or an image area in the other image areas that is not displayed on the interface; Based on a preset image, image replacement processing is performed on the target image area.
5. The method according to claim 1, characterized in that The output prompt information includes: The first image is displayed in a floating window to prompt the target user to adjust the posture based on the first image.
6. The method according to claim 5, characterized in that After outputting the prompt information, the following steps are also included: Upon receiving a confirmation input indicating that the position adjustment of the target user is complete, acquiring a third image captured by the camera; The third image is transmitted to a target application.
7. An electronic device, characterized in that: The electronic device comprises: A first image acquisition module is configured to acquire a first image captured by a camera, wherein the first image includes a facial image area of a target user; a first image processing module, configured to perform privacy processing on the first image or output a prompt message when the degree of matching between the first image and the display content of the first image on the interface of the target application is less than or equal to a target value; The performing privacy processing on the first image includes: performing privacy processing on a portion of the first image that is not displayed on the interface of the target application; The electronic device further includes: The second image transmission module is configured to transmit a second image obtained based on the first image to a target application, and the target application performs corresponding business processing based on the second image.
8. The electronic device according to claim 7, wherein: The electronic device further includes: Interface content acquisition module, used to obtain the display content of the interface; The image comparison module is used to perform image content comparison between the first image and the display content to determine a matching degree between the first image and the display content.
9. The electronic device according to claim 7, wherein: The first image further includes: other image areas except the face image area of the target user; The first image processing module is specifically configured to: performing image replacement processing on the target image area in the other image areas; The second image transmission module is specifically configured to: generating a second image of the target user based on the other image regions after image replacement and the facial image region of the target user; The second image is transmitted to a target application.
10. The electronic device according to claim 9, characterized in that The first image processing module is further specifically configured to: Determine a target image area in the other image areas, where the target image area includes: the other image areas, or an image area in the other image areas that is not displayed on the interface; Based on a preset image, image replacement processing is performed on the target image area.
11. The electronic device according to claim 7, wherein: The first image processing module is further specifically configured to: The first image is displayed in a floating window to prompt the target user to adjust the posture based on the first image.
12. The electronic device according to claim 11, wherein: The electronic device further includes: A third image acquisition module is configured to acquire a third image captured by the camera upon receiving a confirmation input indicating that the position adjustment of the target user is complete; The third image transmission module is configured to transmit the third image to a target application.
13. An electronic device, characterized in that: include: A processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the method for processing image data according to any one of claims 1 to 6.
14. A readable storage medium, characterized in that The readable storage medium stores a program or instruction, and when the program or instruction is executed by a processor, the steps of the image data processing method according to any one of claims 1 to 6 are implemented.
Citation Information
Patent Citations
Video background processing method and device as well as mobile terminal
CN107623817A
Image processing method and terminal equipment
CN110719402A
Electronic privacy screen and viewer
WO1999047990A1