Shooting and displaying method and device

Abstract

This application provides a shooting and display method and device, applied to an electronic device. The electronic device includes a first side and a second side. The first side is provided with a first screen and a first camera, and the second side is provided with a second camera. The method includes: receiving a first operation input by a user; responding to the first operation, activating the second camera or opening an application that uses the second camera and calling the first camera to capture a first set of environmental images; if there is no first target person in front of the first screen, then securely processing the first screen; if a first distance between the first target person and the first screen is less than a first threshold and the first target person is not looking at the first screen, or if the first distance is greater than or equal to the first threshold, then blurring the content displayed on the first screen or controlling the first screen to turn off. This application can determine whether the screen is being used when the electronic device is shooting, and perform secure processing on the unused screen to prevent the leakage of user privacy.

Description

Technical Field

[0001] This application relates to the field of communication technology, and in particular to a method and device for capturing and displaying images. Background Technology

[0002] With the widespread adoption of smart devices, more and more users are paying attention to privacy and security issues during use. Existing smart devices can be broadly categorized into two types: single-screen devices and multi-screen devices. For single-screen devices, when a user takes a selfie using a mode like "wide-angle," the device uses the rear camera, while the main screen displays the image normally. The user cannot see the main screen, and its view is easily visible to others, leading to privacy leaks. For multi-screen smart devices, such as dual-screen devices, where the front screen includes an inner screen and the back screen includes an outer screen, existing dual-screen devices all have simultaneous inner and outer screen display functionality. When a user takes a selfie using the rear camera, they can observe their own movements in real-time on the outer screen to adjust their posture and angle. Simultaneously, the inner screen displays the same image as the outer screen, and since the inner screen is opposite the user, it can easily leak the user's privacy information. Summary of the Invention

[0003] This application discloses a shooting display method and device, which can determine whether the screen is being used when the electronic device is taking a picture, and perform security processing on the unused screen to prevent the leakage of user privacy information through the screen.

[0004] The first aspect of this application discloses a shooting and display method applied to an electronic device, the electronic device including a first side and a second side, the first side being provided with a first screen and a first camera, and the second side being provided with a second camera, the method including:

[0005] The user input is received as a first operation; the first operation is used to activate the second camera or to open an application that uses the second camera.

[0006] In response to the first operation, the electronic device activates the second camera and uses the first camera to capture a first set of environmental images;

[0007] The electronic device determines whether there is a first target person in front of the first screen based on the first environmental image set;

[0008] If the first target person is not in front of the first screen, then the first screen is safely processed;

[0009] If the first target person is in front of the first screen, obtain the first distance between the first target person and the first screen;

[0010] If the first distance is less than the first threshold and the first target is not looking at the first screen, or if the first distance is greater than or equal to the first threshold, then the first screen is safely processed.

[0011] The security processing of the first screen includes blurring the content displayed on the first screen or controlling the first screen to turn off.

[0012] In the first embodiment of the first aspect, the method further includes:

[0013] If the first distance is less than the first threshold and the first target person is looking at the first screen, then control the first screen to display normally.

[0014] In a first aspect, in a first embodiment, if the first target person is present in front of the first screen, the method further includes:

[0015] Whether the first target person is looking at the first screen when determining the first target person;

[0016] If the first target is not looking at the first screen, the first screen is safely processed.

[0017] In the first embodiment of the first aspect, the first surface and the second surface are disposed opposite to each other.

[0018] In a first aspect, in a first embodiment, the electronic device further includes a second screen disposed on the second surface, and the method further includes:

[0019] In response to the first operation, the electronic device also determines whether there is a second target person in front of the second screen based on the second environmental image set captured by the second camera;

[0020] If the second target is not in front of the second screen, proceed with the second screen safely.

[0021] The security processing of the second screen includes blurring the content displayed on the second screen or controlling the second screen to turn off.

[0022] In the first embodiment of the first aspect, the method further includes:

[0023] If the second target person is in front of the second screen, obtain the second distance between the second target person and the second screen;

[0024] Determine whether the second distance is less than the second threshold;

[0025] If the second distance is greater than or equal to the second threshold, the second screen is processed safely.

[0026] In the first embodiment of the first aspect, the method further includes:

[0027] If the second distance is less than the second threshold, determine whether the second target person is looking at the second screen;

[0028] If the second target is not looking at the second screen, safely handle the second screen.

[0029] In the first embodiment of the first aspect, the method further includes:

[0030] If the second target person is in front of the second screen, determine whether the second target person is looking at the second screen. If the second target person is not looking at the second screen, safely process the second screen.

[0031] In the first embodiment of the first aspect, the method further includes:

[0032] If the second target person is looking at the second screen, obtain the second distance between the second target person and the second screen and determine whether the second distance is less than the second threshold.

[0033] If the second distance is greater than or equal to the second threshold, the second screen is processed safely.

[0034] In the first embodiment of the first aspect, the method further includes:

[0035] If the second distance is less than the second threshold and the second target person is looking at the second screen, then control the second screen to display normally.

[0036] In a first aspect, in a first embodiment, the electronic device stores a plurality of second thresholds, and the method further includes:

[0037] Obtain the use case of the first operation;

[0038] Obtain the correspondence between the usage scenario and the multiple second thresholds;

[0039] The second threshold corresponding to the usage scenario is determined based on the usage scenario and the corresponding relationship.

[0040] In a first aspect, in a first embodiment, the first environmental image set includes images captured by the first camera within a preset time period, and determining whether the first target person is looking at the first screen includes:

[0041] The idle time is determined based on the first environmental image, and the idle time is the duration during which the first target person does not look at the first screen within a preset time.

[0042] Determine whether the idle time is greater than a time threshold;

[0043] If the idle time is greater than the time threshold, it is determined that the first target person is not looking at the first screen;

[0044] If the idle time is less than or equal to the time threshold, it is determined that the first target person is looking at the first screen.

[0045] The second aspect of this application discloses a computer-readable storage medium including computer instructions that, when executed on an electronic device, cause the electronic device to perform the image capture and display method as described in the first aspect.

[0046] The third aspect of this application discloses an electronic device, which includes a processor and a memory. The memory is used to store instructions, and the processor is used to call the instructions in the memory to cause the electronic device to perform the shooting and display method as described in the first aspect.

[0047] The fourth aspect of this application discloses a chip system applied to an electronic device; the chip system includes an interface circuit and a processor; the interface circuit and the processor are interconnected via a line; the interface circuit is used to receive signals from the memory of the electronic device and send signals to the processor, the signals including computer instructions stored in the memory; when the processor executes the computer instructions, the chip system performs the image capture and display method as described in the first aspect.

[0048] The fifth aspect of this application discloses a computer program product that, when run on a computer, causes the computer to perform the image capture and display method as described in the first aspect.

[0049] The sixth aspect of this application discloses an apparatus having the function of implementing the electronic device behavior described in the method of the first aspect. The function can be implemented in hardware or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the described function.

[0050] It should be understood that the computer-readable storage medium described in the second aspect, the electronic device described in the third aspect, the chip system described in the fourth aspect, the computer program product described in the fifth aspect, and the device described in the sixth aspect all correspond to the method described in the first aspect. Therefore, the beneficial effects they can achieve can be referred to the beneficial effects in the corresponding methods provided above, and will not be repeated here. Attached Figure Description

[0051] Figure 1A This is a schematic diagram illustrating an application scenario of the shooting and display method provided in one embodiment of this application.

[0052] Figure 1B This is a schematic diagram illustrating an application scenario of the shooting and display method provided in another embodiment of this application.

[0053] Figure 1C This is a schematic diagram of an electronic device provided in an embodiment of this application.

[0054] Figure 2 This is a flowchart of the shooting and display method provided in the embodiments of this application.

[0055] Figure 3 This is a schematic diagram illustrating an application scenario of the shooting and display method provided in another embodiment of this application.

[0056] Figure 4A This is a flowchart of a shooting and display method provided in another embodiment of this application.

[0057] Figure 4B This is a flowchart of the first scene shooting and display method provided in the embodiments of this application.

[0058] Figure 4C This is a flowchart of the first scene shooting and display method provided in the embodiments of this application.

[0059] Figure 4D This is a flowchart of the first scene shooting and display method provided in the embodiments of this application.

[0060] Figure 5 This is a schematic diagram of the structure of the electronic device provided in the embodiments of this application. Detailed Implementation

[0061] To facilitate understanding, some illustrations of concepts related to the embodiments of the present application are given for reference.

[0062] It should be noted that in this application, "at least one" means one or more, and "more than one" means two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The terms "first," "second," "third," "fourth," etc. (if present) in the specification, claims, and drawings of this application are used to distinguish similar objects, not to describe a specific order or sequence.

[0063] To better understand the shooting and display method and related equipment disclosed in the embodiments of this application, the application scenarios of the shooting and display method of this application will be described first below.

[0064] Figure 1A and Figure 1B This is a schematic diagram illustrating an application scenario of the image capture and display method provided in one embodiment of this application. Figure 1A An illustration of a user taking a selfie using a handheld electronic device. Figure 1B This is a diagram illustrating user A using a handheld electronic device to photograph user B. Figure 1A and Figure 1B The electronic devices in the system are smart terminals, which allow users to capture images.

[0065] Currently, it is known that rear cameras on electronic devices generally produce better image quality than front cameras, and some shooting functions are only available with rear cameras, such as "large aperture" shooting. When users use the rear camera for tasks such as... Figure 1A When taking a selfie, the screen of the electronic device is facing away from the user, so the user cannot see the screen; however, other people on the side of the screen can see the content displayed on the screen, such as WeChat notifications, which can easily lead to the leakage of the user's privacy information.

[0066] For example, some existing applications can perform skin detection for users of electronic devices. For instance, the AiSkin app uses the smart terminal's camera to create high-definition images and then quantifies the user's skin condition based on the resulting images. To ensure the accuracy of the skin detection, AiSkin recommends that users use the rear camera for the detection. When users use AiSkin for skin detection, the following two scenarios exist:

[0067] Scenario 1, such as Figure 1B As shown, user A holds a smart terminal and uses the rear camera to perform skin detection for user B; that is, user A is present in front of the smart terminal's screen, and user A is the user of the smart terminal, so there is no risk of user privacy leakage in scenario one.

[0068] Scenario 2, such as Figure 1A As shown, User A holds a smart terminal and uses the rear camera to perform skin detection on themselves. There is no user in front of the smart terminal screen, and the screen is facing away from User A, so User A cannot see the content displayed on the screen. However, if there is a passerby in front of the screen, the passerby can see the content displayed on the screen, resulting in a breach of user privacy.

[0069] It is evident that there is a risk of user privacy being leaked through the screen when users collect images using smart terminals.

[0070] like Figure 1C As shown, the image capture and display method provided in this application embodiment can be applied to electronic devices, such as... Figure 1CThe electronic device shown is a single-screen smart terminal 100. In this embodiment, the smart terminal 100 includes a first camera 10, a second camera 20, and a first screen 30. The smart terminal 100 has a first side A and a second side B, which are arranged opposite to each other. The first camera 10 and the first screen 30 are located on the first side A, and the second camera 20 is located on the second side B.

[0071] In this embodiment, the first camera 10 is a front-facing camera, and the second camera 20 is a rear-facing camera. The first camera 10 and the second camera 20 are used to capture images from both sides of the smart terminal 100, respectively. The first screen 30 is used to display the images captured by the front-facing camera and the rear-facing camera. Of course, the first screen 30 is also used to display other application interfaces of the smart terminal.

[0072] In this application, the electronic device can refer to a user device, access terminal, remote terminal, mobile device, user terminal, wireless communication device, user agent, or user equipment with shooting and display functions. A smart terminal can be a mobile phone, tablet, computer with wireless transceiver capabilities, session initiation protocol (SIP) phone, personal digital assistant (PDA), handheld device with wireless communication capabilities, computer or other processing device, augmented reality (AR) smart terminal, wireless terminal in a smart home, smart terminal in a future 5G network, or smart terminal in a future evolved public land mobile network (PLMN), etc. This application does not limit the scope of the electronic device; in the following embodiments, the electronic device is described using a smart terminal as an example.

[0073] For example Figure 1CThe single-screen terminal shown in this application provides a shooting and display method. When a user inputs a first operation to the smart terminal through a touch screen or operation button, causing the smart terminal to start shooting with the rear camera or open an application that uses the rear camera based on the first operation, the smart terminal determines whether there is a target person within a preset distance in front of the screen and whether the target person is looking at the screen. If there is a target person within the preset distance in front of the screen and the target person is looking at the screen, it is determined that the target person is the user of the smart terminal and the user is using the rear camera of the smart terminal to shoot, that is, the screen of the smart terminal is being used by the user; otherwise, it is determined that the screen of the smart terminal is not being used by the user, and the smart terminal blurs the content displayed on the screen or turns off the screen to avoid the leakage of user information through the screen during the shooting process.

[0074] It should be noted that the shooting and display method provided in this embodiment of the invention can be executed by an electronic device, or by the processor of the electronic device, or by the control module in the electronic device for executing the shooting and display method. This embodiment of the invention uses a smart terminal as an electronic device to illustrate the shooting and display method provided in this embodiment.

[0075] Figure 2 This is a flowchart of the shooting and display method provided in the embodiments of this application. The shooting and display method provided in the embodiments of this application is applied to a single-screen electronic device with shooting and display functions, such as... Figure 1C Electronic devices in the system.

[0076] For ease of understanding this application, Figure 2 In the illustrated embodiment, the first camera 10 is referred to as the front-facing camera, and the second camera 20 is referred to as the rear-facing camera.

[0077] like Figure 2 As shown, the user-captured display method provided in this application embodiment includes the following steps:

[0078] S201, the first operation of the electronic device receiving user input.

[0079] This first operation is used to activate the rear camera or to open an application that uses the rear camera.

[0080] If the electronic device activates the rear camera based on the first operation, the first operation is for the user to activate the rear camera of the smart terminal by touching the screen of the smart terminal or clicking a button on the smart terminal (e.g., pressing the volume button and the power button at the same time).

[0081] If the electronic device opens an application using the rear camera (such as a skin detection or sun protection detection application like the AiSkin APP) based on the first operation, the first operation can be for the user to open the application by touching the corresponding application icon on the touch screen.

[0082] S202, the electronic device responds to the first operation by activating the rear camera and calling the front camera to capture a first set of environmental images.

[0083] Optionally, after receiving the first operation from the rear camera, the smart terminal can, in addition to calling the rear camera, also call the front camera to collect a first set of environmental images.

[0084] In one embodiment, in order to save power of electronic devices, the smart terminal calls the front camera only after the rear camera is activated, so that the front camera can capture the environmental image set corresponding to the screen side of the smart terminal.

[0085] In one embodiment, after the smart terminal detects that the user has activated the rear camera, the smart terminal controls the front camera to periodically capture images, wherein the capturing period can be adjusted according to the actual scene, such as 3 seconds, 5 seconds, 7 seconds, etc.

[0086] In one embodiment, the first environmental image set is a set of images captured by the front-facing camera within a preset time period. The image set includes a preset number of images, such as 1, 2, or 5 images. The preset time period can be 3 seconds, 4 seconds, 5 seconds, etc.

[0087] Optionally, after detecting that a user has accessed the rear camera, the smart terminal captures images at preset intervals to obtain a preset number of images. For example, the preset interval is 60ms and the preset number is 5. After detecting that a user has accessed the rear camera, the electronic device captures images at 60ms, 120ms, 180ms, 240ms, and 300ms (here, the starting time of 0ms is the time when the presence of a user around the electronic device is detected), capturing 5 images to obtain an image set, which is the first environmental image set.

[0088] Of course, in other embodiments, the first image set may be a video stream captured by the front-facing camera within a preset time period.

[0089] In one embodiment, the front-facing camera has a shooting area for capturing images within that area, where the user is within an active area while using the smart terminal. The active area is smaller than the shooting area but located within it, ensuring that the user (specifically, the user's face) is within the shooting area when using the smart terminal. The smart terminal is only used to identify a first environmental image focusing shooting area. The range of the shooting area can be adjusted by changing the focal length of the smart terminal, thereby making the active area and the shooting area similar in size, reducing the shooting area of ​​the front-facing camera and the range of the smart terminal's recognition area (i.e., the shooting area).

[0090] S203, the electronic device determines whether there is a first target person in front of the screen based on the first environmental image set. If there is a first target person in front of the screen, proceed to step S204; if there is no first target person in front of the screen, proceed to step S205.

[0091] Specifically, the smart terminal identifies whether a target person exists in the environmental image, and determines whether a target person exists in front of the screen based on the identification result. That is, if a target person exists in the environmental image, it is determined that a target person exists in front of the screen; if a target person does not exist in the environmental image, it is determined that a target person does not exist in front of the screen.

[0092] The target person is a person present in the environmental image. This person can be a user of the smart terminal, an observer (for example, person A is using the smart terminal and person B is watching from the side), or a passerby (person C passes through the shooting area of ​​the front camera when the front camera is capturing the image).

[0093] Furthermore, the primary target can be one person or multiple people. For example, if two people are in front of the screen at the same time, the environmental image captured by the front-facing camera will include both people, and both of them will be the primary target.

[0094] In one embodiment of this application, the smart terminal can employ a user recognition model to identify whether a target person exists in an environmental image. The user recognition model is used to identify facial features in the environmental image to determine whether a target person exists. The user recognition model can be a neural network model.

[0095] In one embodiment, the first environmental image set includes multiple images captured by the front-facing camera within a preset time period. The smart terminal can determine whether the duration of no target person in front of the screen reaches a time threshold using the first environmental image set. If the duration reaches the time threshold, the smart terminal determines that no target person exists in front of the screen; if the duration does not reach the time threshold, the smart terminal determines that a target person exists in front of the screen. Furthermore, after determining that no target person exists in front of the screen, the smart terminal also controls the front-facing camera to continue capturing the first environmental image set and uses the newly captured images to further determine whether a target person exists in the environmental images. This process is repeated cyclically during the user's activation of the rear-facing camera to determine whether a target person exists in front of the screen.

[0096] Optionally, the smart terminal first determines whether a first target person exists in multiple images of the first environmental image set. If the first target person exists in at least some of the multiple images, the terminal determines the duration for which the first target person exists in the multiple images and determines whether the duration is greater than a first time threshold. If the duration is greater than the first time threshold, the terminal determines that the first target person exists in front of the first screen. If the duration is less than or equal to the first time threshold, the terminal determines that no target person exists in front of the first screen. The front-facing camera captures a preset number of images within a preset time. The existence of the target person in front of the screen can only be determined if the duration meets the first time threshold, thus preventing passersby from affecting the smart terminal's judgment.

[0097] For example, the first environmental image set is 10 images captured by the front camera in 5 seconds, and the first threshold is 3 seconds. If the target person is in 6 of the 10 images, the duration of the target person in front of the first screen is obtained based on the images. If there is no target person in front of the first screen for 3 seconds, it is determined that there is no target person in front of the first screen. If the duration of the absence of the target person in front of the first screen is less than or equal to 3 seconds, it is determined that there is no target person in front of the first screen.

[0098] In step S204, the electronic device determines the distance between the first target person and the screen. Then, step S206 is executed.

[0099] In one embodiment, the front-facing camera is a Time-of-Flight (TOF) camera, which measures the distance between a target person and the main screen. Specifically, the TOF camera sends a data signal and receives the data signal reflected by the target person, using the round-trip time of the data signal to measure the distance between the target person and the main screen. The time it takes for the TOF camera to send the data signal is denoted as Tt, and the time it takes for the TOF camera to receive the data signal reflected by the target person is denoted as Tr. The one-way flight time of the data signal between the TOF camera and the target person is Tf = (Tt - Tr) / 2. Therefore, the distance d between the TOF camera and the target person is d = c * Tf, where c represents the speed of electromagnetic wave propagation.

[0100] In one embodiment, the smart terminal determines the distance between the target person and the screen based on the environmental image. Specifically, it acquires the lens parameter information of the front-facing camera, such as the horizontal field of view being 'a'; acquires the sensor parameters of the front-facing camera, such as the resolution of the image captured by the sensor being (X, Y); and matches the acquired environmental image according to a preset face recognition algorithm to obtain the pixel size of the face in the environmental image as (X', Y'). Assuming the actual width of the face is C, the distance between the face and the camera is L, and W is the actual width corresponding to the horizontal field of view at that distance. Since C / W = X' / X and W / L = tan(a / 2), the following formula can be derived to calculate the distance between the face and the front-facing camera: L = (C*X) / (X'*tan(a / 2)). Since the main screen and the front-facing camera are roughly on the same plane, the distance between the screen and the target person can be calculated using the distance between the face and the front-facing camera. It is understood that the calculation of the distance between the target person and the main screen based on the environmental image is not limited to the calculation method provided in this application, and the determination of the distance between the target person and the screen is not limited to the calculation method provided in this application.

[0101] Step S205: Safe handling of the screen of the electronic device.

[0102] The security processing includes, but is not limited to, blurring the content displayed on the smart terminal's screen and controlling the smart terminal's screen to turn off. By security processing the screen, the content displayed on the screen cannot be clearly seen by passersby, thereby protecting the user's privacy from being leaked. The content of the security processing applies to various embodiments of this application.

[0103] Understandably, after the smart terminal's screen has been securely processed, the screen can still display normally when the user inputs operation commands, such as touching the screen or pressing the power button. Of course, after the screen is securely processed, the smart terminal can control the front-facing camera to capture images and perform this process in a loop. Figure 2The method shown indicates that if it is determined that there is a target person in front of the screen, the target person is looking at the screen and the distance between the target person and the screen is less than a first threshold, and the smart terminal controls the screen to display normally, otherwise, no action is taken and the screen continues to be processed safely.

[0104] S206, the electronic device determines whether the distance is less than a first threshold. If the distance is greater than or equal to the first threshold, proceed to step S205. If the distance is less than the first threshold, proceed to step S207.

[0105] The first threshold can be the distance between the user's face and the main screen when the user is using the smart terminal normally, for example, 60 centimeters.

[0106] Optionally, the first threshold can be adjusted according to the actual application environment, such as the brightness of the shooting environment. When the brightness of the shooting environment decreases, users often reduce the distance between themselves and the screen in order to see the screen clearly. In this way, the smart terminal can establish a relationship between the ambient brightness and the first threshold. For example, when the ambient brightness is within the brightness threshold range, the first threshold remains unchanged; when the ambient brightness is less than the threshold range, the first threshold is adjusted accordingly based on the decrease in ambient brightness.

[0107] Optionally, in response to a user's input command, the smart terminal presents a first threshold adjustment page, allowing the user to adjust the first threshold according to their own needs. For example, if the user is farsighted, the distance between the farsighted user's face and the screen of the smart terminal is larger than that of ordinary users and nearsighted users. Thus, the user can manually adjust the first threshold so that the smart terminal can accurately determine whether the user is using the screen of the smart terminal based on the user's usage habits.

[0108] Step S207: The electronic device determines whether the first target person is looking at the screen. If the target person is looking at the screen, proceed to step S208; if the target person is not looking at the screen, proceed to step S205.

[0109] In one embodiment, by identifying key features of a target person in an environmental image, it is determined whether the key features match pre-stored key features of the eyes. If they match, it is determined that the target person is looking at the screen; if they do not match, it is determined that the target person is not looking at the screen. It is understood that other methods can also be used to determine whether a target person is looking at the screen, and this application does not limit the method for determining whether a target person is looking at the screen.

[0110] In one embodiment, an idle time is determined based on the first environmental image, wherein the idle time is the duration during which the first target person does not look at the first screen within a preset time; it is determined whether the idle duration is greater than a time threshold; if the idle time is greater than the time threshold, it is determined that the first target person is not looking at the first screen; if the idle time is less than or equal to the time threshold, it is determined that the first target person is looking at the first screen.

[0111] For example, the first environmental image set includes multiple images captured sequentially by the smart terminal within a preset time period. For instance, the front-facing camera captures three images within 3 seconds, with the capture times of the three images being the 1st second, the 2nd second, and the 3rd second, respectively. The smart terminal determines whether the target person in the multiple images is looking at the screen. If the target person in all the multiple images is looking at the screen, it is determined that the target person is looking at the screen. If the target person in none of the multiple images is looking at the screen, it is determined that the target person is not looking at the screen. If some of the target person in the multiple images is looking at the screen and others are not looking at the screen, the capture time of each image is determined, and the duration of the target person not looking at the screen, i.e., the idle time, is determined based on the capture time. It is determined whether the idle time is greater than a time threshold. If the duration is greater than the time threshold, it is determined that the target person is not looking at the screen. If the duration is less than or equal to the time threshold, it is determined that the target person is looking at the screen.

[0112] For example, the smart terminal collects 5 images within 5 seconds, with 1 image collected every 1 second. In the first image, the target person is looking at the screen, while in the second to fifth images, the target person is not looking at the screen. The duration is 4 seconds. If the time threshold is 3 seconds and the duration is greater than the time threshold, it is determined that the target person is not looking at the screen.

[0113] Step S208: The electronic device controls the screen to display the image captured by the rear camera or to display the interface of an application using the rear camera.

[0114] Thus, when a user uses the rear camera of a smart terminal to take a picture or opens an application that uses the rear camera, the smart terminal controls the front camera to capture an image of the environment and determines whether a target person exists in the image. If a target person exists in the image and the distance between the target person and the screen is less than a first threshold and the target person is looking at the screen of the smart terminal, then it is determined that the user is using the screen of the smart terminal when using the rear camera to take a picture, and the smart terminal can control the screen to display the image captured by the rear camera or the interface of the application using the rear camera; otherwise, it is determined that the user is not using the screen when using the rear camera to take a picture, and the smart terminal performs security processing on the screen.

[0115] When a user takes a picture using the rear camera of a single-screen terminal, the smart terminal determines whether the screen is being used based on the front camera (e.g., based on the image or video stream captured by the front camera). If the screen is not being used, the screen is securely processed to prevent user privacy from being leaked through the screen.

[0116] Optionally, when a user of a smart terminal uses the rear camera to take a picture, the smart terminal uses the front camera to determine that the target person is not using the screen of the smart terminal. When the user wants to see the information or images displayed on the screen, they can manually touch the screen to wake up the screen of the smart terminal, so that the smart terminal can determine that the user is using the screen. The smart terminal then stops security processing of the screen and controls the screen to display normally.

[0117] It's understandable that when a smart device doesn't receive user input (such as touching the screen, pressing the power button, or volume buttons) within a preset time, the screen will enter a sleep state to conserve battery power. However, the preset waiting time for smart devices is generally quite long, such as 5 or even 10 minutes. If the preset waiting time is too short, users would need to tap the screen frequently, resulting in a poor user experience.

[0118] Figure 2 The illustrated shooting and display method involves the following steps: When the smart terminal determines that a target person exists in front of the screen based on a first environmental image, the smart terminal first obtains the distance between the target person and the screen and determines whether this distance is less than a first threshold. If the distance is less than the first threshold, the smart terminal then determines whether the target person is looking at the screen. If the distance is less than the first threshold and the target person is looking at the screen, it indicates that the target person is using the screen, and the smart terminal controls the screen to display normally. Otherwise, the screen is safely processed. In other embodiments, when the smart terminal determines that a target person exists in front of the screen based on a first environmental image, the smart terminal first determines whether the target person is looking at the screen. If the target person is looking at the screen, the smart terminal obtains the distance between the target person and the screen and determines whether this distance is less than a first threshold. If the distance is less than the first threshold and the target person is looking at the screen, it indicates that the target person is using the screen, and the smart terminal controls the screen to display normally. Otherwise, if the target person is not looking at the screen or the distance between the target person and the screen is greater than or equal to the first threshold, the screen is safely processed. In other embodiments of this application, when determining whether a user is using the screen of the smart terminal, the order between determining whether the target person is looking at the screen and determining whether the distance between the target person and the screen is less than a preset value is not limited. For ease of understanding, the implementation methods and effects provided in the above embodiments will not be repeated in subsequent embodiments to avoid redundancy.

[0119] Figure 3 A schematic diagram of a smart terminal according to another embodiment of this application.

[0120] It should be noted that, depending on different needs, the execution order of each step in the shooting and display method provided in this application embodiment can be changed, some steps can be omitted, and some steps can be changed.

[0121] like Figure 3 As shown, the shooting and display method provided in this application embodiment is applied to a dual-screen smart terminal 200, wherein the smart terminal 200 has a first side C and a second side D, the first side C is provided with a first screen 210 and a first camera 220, and the second side D is provided with a second screen 240 and a second camera 230, wherein the first side C and the second side D are arranged opposite to each other.

[0122] In this embodiment, the first camera 220 is a front-facing camera, and the first screen 210 is the main screen of the smart terminal 200; the second camera 230 is a rear-facing camera, and the second screen 240 is the auxiliary screen of the smart terminal 200.

[0123] In this embodiment, the size of the main screen is similar to the size of the first side and larger than the size of the auxiliary screen. It can be understood that in other embodiments, the size of the main screen may be the same as the size of the auxiliary screen. In this embodiment, the size relationship between the main screen and the auxiliary screen is not limited.

[0124] For ease of understanding, in the following embodiments, the first camera 220 is referred to as the front camera, the first screen 210 is referred to as the main screen, the second camera 230 is referred to as the rear camera, and the second screen 240 is referred to as the auxiliary screen.

[0125] Because existing dual-screen smart terminals have the function of displaying both the inner and outer screens simultaneously, when a smart terminal uses its rear camera to take a picture, it defaults to displaying the content captured by the rear camera on both the main screen and the secondary screen at the same time, which can lead to the leakage of user information. For example, when a user uses the rear camera to take a selfie, both the main screen and the secondary screen are simultaneously used by the smart terminal to display the image captured by the rear camera, and the main screen can also simultaneously display notification messages from other applications on the electronic device, making it easy for the user's privacy information to be leaked through the main screen.

[0126] To address the problems in the above scenarios, this application provides a shooting and display method, with an electronic device as the execution subject. This application uses a smart terminal as an example for illustration. When the rear camera of the smart terminal is invoked, the smart terminal determines whether there is a target person in front of the main screen and the auxiliary screen through the images or video streams captured by the rear camera and the front camera. If there is no target person in front of the main screen or the auxiliary screen, or if there is a target person in front of the main screen or the auxiliary screen but the target person is not looking at the corresponding screen, or if the distance between the target person and the corresponding screen is greater than or equal to a preset value, then the main screen or the auxiliary screen is subjected to security processing to prevent the information of the smart terminal from being leaked.

[0127] In one embodiment, such as Figure 4A As shown, the shooting and display method provided in this application embodiment includes the following steps:

[0128] S401, the electronic device responds to the rear camera call command input by the user of the electronic device by calling the front camera to collect a first set of environmental images and the rear camera to collect a second set of environmental images.

[0129] It is understandable that when a user actively uses the front-facing camera to take a picture, the smart terminal assumes that the user is taking a selfie. Therefore, the secondary screen of the smart terminal does not display the image captured by the front-facing camera synchronously with the main screen. Furthermore, when the user is taking a selfie, only the main screen displays the image normally, and the user can observe their own expression through the main screen. Therefore, the scenario of leaking user privacy through the main screen is not considered when the user uses the front-facing camera to take a picture.

[0130] The call command can be an operation input by the user, such as the user activating the rear camera or opening an application that uses the rear camera by touching the home screen or pressing the power or volume buttons on the smart terminal.

[0131] S402, the electronic device determines whether a first target person exists in front of the main screen based on the first environmental image set, and determines whether a second target person exists in front of the auxiliary screen based on the second environmental image set. Based on the determination results, steps S403, S405, S407, and S408 are executed respectively.

[0132] The method for determining whether there is a target person in front of the screen based on the environmental image in this embodiment is the same as step S202, and will not be described again here.

[0133] S403, the electronic device determines that there is no first target person in front of the main screen but there is a second target person in front of the secondary screen. Then it proceeds to step S404.

[0134] For example, users of smart devices take selfies using the rear camera.

[0135] S404, Main screen for secure handling of electronic devices.

[0136] Since there is no target person in front of the main screen, it can be determined that the main screen is not being used by the end user. By securely handling the main screen, user information can be prevented from being leaked through the main screen.

[0137] S405, the electronic device determines that there is a first target person in front of the main screen and no second target person in front of the secondary screen. Then it proceeds to step S406.

[0138] For example, users of smart devices use the rear camera to take pictures of scenery.

[0139] S406, auxiliary screen for electronic device safety processing.

[0140] Since there is no target person in front of the secondary screen, it is determined that the secondary screen is not being used by the user of the smart terminal or that the user of the smart terminal is not paying attention to the secondary screen when accessing the rear camera. By securely processing the secondary screen, user information can be prevented from being leaked through the secondary screen.

[0141] S407, the electronic device determines that there is a first target person in front of the main screen and a second target person in front of the secondary screen. Then it executes step S410.

[0142] For example, a user of a smart device takes a picture of a target person using the device's rear camera.

[0143] Since there are target figures in front of both the main screen and the secondary screen, both the main screen and the secondary screen may be used by the user. If the distance between the first target figure and the main screen is less than the first threshold and the first target figure is looking at the main screen, the main screen will be displayed normally. If the distance between the second target figure and the secondary screen is less than the second threshold and the second target figure is looking at the secondary screen, the secondary screen will be displayed normally. Otherwise, the main screen and the secondary screen will be handled with security measures.

[0144] S410: The electronic device determines that both the main screen and the secondary screen are being used by the user, and controls the main screen and the secondary screen to display normally.

[0145] If there is a target person in front of the main screen or the auxiliary screen, and the distance between the target person and the corresponding screen is less than a preset value, and the target person is looking at the corresponding screen, it means that the corresponding screen is being used by the user, and the main screen or the auxiliary screen can be controlled to display normally.

[0146] S408, the electronic device determines that there is no first target person in front of the main screen and no second target person in front of the secondary screen.

[0147] For example, a user of a smart terminal uses the timed shooting function and places the smart terminal in a preset position to take pictures of distant scenery, so that there is no target person in front of the main screen and the secondary screen of the smart terminal.

[0148] S409, Electronic device security handling of main screen and secondary screen.

[0149] Since there is no target person in front of either the main screen or the secondary screen, it is determined that neither the main screen nor the secondary screen is being used by the user. By securely handling the main screen and the secondary screen, user information can be prevented from being leaked.

[0150] In this way, by judging whether there is a target person in front of the main screen and the secondary screen through the environmental image, if there is no target person in front of the main screen or the secondary screen, it is determined that the screen is not being used by the user, and the screen can be securely processed to prevent the user's privacy from being leaked through the screen.

[0151] In one embodiment, please refer to Figure 4B After step S403, in addition to executing step S404, the method also includes the following steps:

[0152] S4031, the electronic device determines the distance between the auxiliary screen and the second target person.

[0153] S4032, the electronic device determines whether the distance is less than the second threshold.

[0154] If the distance is greater than or equal to the second threshold, step S4033 is executed, and the electronic device safely processes the auxiliary screen.

[0155] If the distance is less than the second threshold, step S4034 is executed, and the electronic device determines whether the second target person is looking at the auxiliary screen.

[0156] If the second target person is looking at the auxiliary screen, step 4035 is executed: the electronic device controls the screen to display normally and jumps to step S401, so that the front camera and the rear camera can capture images and continuously determine whether the main screen and the auxiliary screen are used.

[0157] If the second target is not looking at the auxiliary screen, step S4033 is executed, and the electronic device safely handles the auxiliary screen.

[0158] Thus, when a user uses the rear camera of a smart terminal to take pictures or videos, the smart terminal determines that there is a second target person in front of the secondary screen. By further determining that the distance between the second target person and the secondary screen is less than a second threshold and that the target person is looking at the secondary screen, it is determined that the user is using the secondary screen. Otherwise, it is determined that the target person is not using the secondary screen, and the secondary screen is securely processed to prevent the user's privacy information from being leaked.

[0159] like Figure 4B In the illustrated embodiment, when it is determined that a target person is in front of the auxiliary screen, the distance between the target person and the auxiliary screen is first obtained. If the distance is less than a second threshold, it is determined whether the target person is looking at the auxiliary screen. If the target person is looking at the auxiliary screen and the distance is less than the second threshold, the auxiliary screen is displayed normally; otherwise, the auxiliary screen is handled safely. It can be understood that in other embodiments, when it is determined that a target person is in front of the auxiliary screen, it is first determined whether the target person is looking at the auxiliary screen. If the target person is not looking at the auxiliary screen, the auxiliary screen is handled safely; if the target person is looking at the auxiliary screen, the distance between the target person and the auxiliary screen is obtained. If the distance is less than the second threshold, the auxiliary screen is displayed normally; otherwise, the auxiliary screen is handled safely. That is, when a target person is in front of the auxiliary screen, the order between determining whether the target person is looking at the auxiliary screen and determining whether the distance between the target person and the auxiliary screen is less than the second threshold is not limited.

[0160] Furthermore, when the smart terminal determines that the secondary screen or the main screen is in use, it also calls the front camera and the rear camera to capture a set of images, and continuously judges whether the secondary screen or the main screen is being used based on the set of images. When the user no longer uses the screen, the screen is processed for security to prevent user information from being leaked through the screen.

[0161] It is understandable that in the scenario of step S405, when the user calls the rear camera to take a picture, there is a target person in front of the main screen, but no target person in front of the secondary screen. A common scenario is that the user of the smart terminal uses the rear camera to take a normal picture, such as taking a picture of a distant landscape.

[0162] However, when a user places the smart terminal in a preset position and takes a picture via voice control (e.g., the user says "take a picture," and the smart terminal takes a picture according to the user's voice instruction) or via a selfie stick or other device, the main screen is not used by the user of the smart terminal. However, there may be passersby in front of the main screen. At this time, the user's private information may be seen by passersby. Therefore, in order to ensure that the user's private information is not leaked in similar scenarios, this application provides a detection and determination method in the scenario of step S405. By further determining whether the target person in front of the main screen is using the main screen, if the target person is not using the main screen (e.g., the target person is a passerby), the main screen is controlled to perform security processing to prevent the user information from being leaked. At this time, both the main screen and the secondary screen of the smart terminal are subjected to security processing.

[0163] Specifically, please see Figure 4C After step S405, in addition to performing step S406, the method further includes:

[0164] S4051, the electronic device determines the distance between the main screen and the first target person.

[0165] S4052, the electronic device determines whether the distance is less than the first threshold.

[0166] If the distance is greater than or equal to the first threshold, step S4053 is executed, and the electronic device securely processes the main screen.

[0167] If the distance is less than the first threshold, step S4054 is executed, and the electronic device determines whether the first target person is looking at the main screen.

[0168] If the target person is looking at the main screen, proceed to step S4055: the electronic device controls the main screen to display normally and jumps to step S401, so that the front camera and the rear camera can capture images and continuously determine whether the main screen and the auxiliary screen are being used.

[0169] If the target person is not looking at the main screen, proceed to step S4053.

[0170] Thus, when a user uses the front or rear camera of a smart terminal to take pictures or videos, the smart terminal determines that there is a target person in front of the main screen. By further determining that the distance between the target person and the main screen is less than a first threshold and the target person is looking at the main screen, it is determined that the target person is using the screen; otherwise, it is determined that the target person is not using the main screen, and the screen is blurred to prevent the user's privacy information from being leaked.

[0171] In the scenario described in S407, when a user calls the rear camera to take a picture, there is a target person in front of both the main screen and the secondary screen. However, it is impossible to determine whether the main screen or the secondary screen is being used by the corresponding target person. Therefore, further judgment is required. Based on the distance between the target person and the main screen or the secondary screen, and whether the target person is looking at the main screen or the secondary screen, it is determined whether the main screen or the secondary screen is being used. By performing security processing on the unused screen, user privacy information is prevented from being leaked through the screen.

[0172] In one embodiment, please refer to Figure 4D After step S407, the method further includes:

[0173] S4071, the electronic device determines a first distance between the main screen and the first target person and a second distance between the auxiliary screen and the second target person.

[0174] S4072a, the electronic device determines whether the first distance is less than the first threshold.

[0175] If the first distance is greater than or equal to the first threshold, step S4073a is executed, and the electronic device securely processes the main screen.

[0176] If the first distance is less than the first threshold, step S4074a is executed, and the electronic device determines whether the first target person is looking at the main screen.

[0177] If the first target person is looking at the main screen, control the main screen to display normally and jump to step S401, so that the front camera and the rear camera can capture images and continuously determine whether the main screen and the auxiliary screen are being used.

[0178] If the first target person is not looking at the main screen, proceed to step S4073a.

[0179] S4072b, the electronic device determines whether the second distance is less than the second threshold.

[0180] If the second distance is greater than or equal to the second threshold, step S4073b is executed, and the electronic device safely processes the auxiliary screen.

[0181] If the second distance is less than the second threshold, step S4074b is executed, and the electronic device determines whether the second target person is looking at the auxiliary screen.

[0182] If the second target person is looking at the auxiliary screen, control the auxiliary screen to display normally and jump to step S401, so that the front camera and the rear camera can capture images and continuously determine whether the main screen and the auxiliary screen are used.

[0183] If the second target is not looking at the auxiliary screen, proceed to step S4073b.

[0184] Thus, when a user uses the rear camera of a smart terminal to take pictures or videos, the smart terminal determines that there is a target person in front of both the main screen and the secondary screen. By further determining that the distance between the target person and the main screen is less than a first threshold and that the target person is looking at the screen, it is determined that the user is using the screen; otherwise, the unused screen is processed for security purposes to prevent the user's privacy information from being leaked.

[0185] It's understandable that the range of the second threshold varies depending on the user's use of the smart terminal's rear camera for different scenarios. For example, if the user uses the rear camera for skin detection, the distance between the rear camera and the face to be photographed should be less than 30 centimeters to obtain a clear image of the face; in this case, the second threshold could be 30 centimeters. If the user uses the rear camera's large aperture mode, the distance between the rear camera and the face to be photographed should be greater than 60 centimeters but less than 100 centimeters to capture more people or the environment; in this case, the second threshold could be 100 centimeters. Therefore, after receiving the user's command to use the rear camera, the smart terminal also obtains the usage scenario of the command and the correspondence between the usage scenario and the second threshold. Based on the specific usage scenario and the correspondence, it obtains the corresponding second threshold so that it can determine the appropriate second threshold for different usage scenarios.

[0186] Understandable. Figure 3 This is merely an embodiment of a dual-screen smart terminal provided in this application. The first and second sides of the smart terminal are arranged opposite to each other. It can be understood that the shooting and display method of this application can also be applied to other types of dual-screen smart terminals, such as foldable screen smart terminals. The foldable screen smart terminal can be folded vertically, that is, the smart terminal has screens on both the inside and outside; the foldable screen smart terminal can also be folded from both sides, that is, the smart terminal has screens on both the front and back.

[0187] Of course, the image capture and display method provided in this application can also be applied to other types of multi-screen smart terminals. For example, a smart terminal may have three sides, each with a screen and a camera. When the camera on one side of the smart terminal is activated, the smart terminal controls the cameras on all three sides to capture an image set, and determines whether the screen on that side is being used based on the image set. The determination method is as follows: Figure 2 The steps shown in Figure 4 will not be repeated here. When it is determined that the screen on a certain side is not in use, the screen is securely processed to prevent user information from being leaked through the screen; if it is determined that the screen on that side is being used by a user, the screen is displayed normally. It is understood that this embodiment only takes a three-sided screen smart terminal as an example. It is also understood that the smart terminal can also have four, five, or six screens.

[0188] Figure 5 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. For example... Figure 5As shown, electronic device 80 may include: processor 801, memory 802, wireless communication module 803, audio module 804, microphone 805, sensor 806, camera 807, screen 808, etc. It is understood that the structure illustrated in this embodiment does not constitute a specific limitation on electronic device 100. In other embodiments of this application, electronic device 80 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0189] Processor 801 may include one or more processing units. For example, processor 801 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, a display processing unit (DPU), and / or a neural network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0190] The processor 801 may include a memory for storing instructions and data. In some embodiments, the memory in the processor 801 is a cache memory. This memory can store instructions or data that the processor 801 has just used or that are used repeatedly. If the processor 801 needs to use the instruction or data again, it can directly retrieve it from this memory, avoiding repeated access, reducing the waiting time of the processor 801, and improving the efficiency of the electronic device 80.

[0191] In some embodiments, the processor 801 may include one or more interfaces. Interfaces may include inter-integrated circuit (I2C) interfaces, inter-integrated circuit sound (I2S) interfaces, pulse code modulation (PCM) interfaces, universal asynchronous receiver / transmitter (UART) interfaces, mobile industry processor interfaces (MIPI), general-purpose input / output (GPIO) interfaces, subscriber identity module (SIM) interfaces, and / or universal serial bus (USB) interfaces, etc. It is understood that the interface connection relationships between the modules illustrated in the embodiments of the present invention are merely illustrative and do not constitute a structural limitation on the electronic device 80. In other embodiments of this application, the electronic device 100 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.

[0192] Memory 802 can be used to store one or more computer programs, which include instructions. Processor 801 can cause electronic device 100 to perform relevant actions in the embodiments of this application by executing the instructions stored in memory 802. Memory 802 may include a program storage area and a data storage area. The program storage area may store the operating system; the program storage area may also store one or more application programs. The data storage area may store data (such as photos, contacts, etc.) created during the use of electronic device 80. In addition, memory 802 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc. In some embodiments, processor 801 can cause electronic device 80 to perform various functional applications and data processing by executing instructions stored in memory 802 and / or instructions stored in memory disposed in processor 801.

[0193] The wireless communication function of electronic device 80 can be implemented through wireless communication module 803. Wireless communication module 803 can provide solutions for wireless communication applications on electronic device 80, including wireless local area networks (WLAN), Bluetooth, global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technology. Wireless communication module 803 can be one or more devices integrating at least one communication processing module. In this embodiment, wireless communication module 803 is used to implement the transceiver function of the electronic device.

[0194] Electronic device 80 can implement audio functions, such as music playback and recording, through audio module 804, microphone 805, etc. Audio module 804 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. Audio module 804 can also be used for encoding and decoding audio signals. In some embodiments, audio module 804 can be located in processor 801, or some functional modules of audio module 804 can be located in processor 801. Electronic device 100 can be equipped with at least one microphone 805. In other embodiments, electronic device 80 can be equipped with two microphones 805, which, in addition to collecting sound signals, can also perform noise reduction. In other embodiments, electronic device 80 can be equipped with three, four, or more microphones 805, which can collect sound signals, reduce noise, identify sound sources, and perform directional recording, etc.

[0195] Sensor 806 may include a pressure sensor, a distance sensor, a proximity light sensor, etc. The pressure sensor is used to sense pressure signals and convert them into electrical signals. In some embodiments, the pressure sensor may be located on the screen 808, and the electronic device 80 detects the intensity of touch operations based on the pressure sensor. The distance sensor is used to measure distance. The electronic device can measure distance using infrared or laser. The proximity light sensor may include a light-emitting diode (LED) and a photodetector. The LED may be an infrared LED. The photodetector may be a photodiode. The electronic device 80 emits infrared light outward through the LED. The electronic device 80 uses the photodetector to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 80. When insufficient reflected light is detected, the electronic device 80 can determine that there is no object near the electronic device 80.

[0196] Electronic device 80 can perform shooting functions through camera 807, which may include a first camera 807a, a second camera 807b, and 807c. Additionally, electronic device 80 can perform display functions through screen 808. Screen 808 is used to display images, videos, etc. Screen 808 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Mini LED, MicroLED, Micro OLED, quantum dot light-emitting diodes (QLED), etc. In some embodiments, screen 808 includes a first screen 808a, a second screen 808b, and a third screen 808c. In some embodiments, the camera and screen are correspondingly arranged, that is, the electronic device has multiple surfaces, each surface having a corresponding screen and camera. In some embodiments, the electronic device has multiple cameras and multiple screens.

[0197] In this embodiment, a distance sensor and a proximity sensor can be used to detect whether a user is present around the electronic device 80, a camera can capture a set of images of the user, and a processor 801 is used to execute the actions described in the above embodiment. Based on Figure 5 The electronic device 80 shown can implement the image capture and display method in the above embodiments. It should be understood that... Figure 5 The structural description in the text is an example of an electronic device 80.

[0198] This embodiment also provides a computer storage medium storing computer instructions. When the computer instructions are executed on an electronic device, the electronic device performs the aforementioned method steps to implement the shooting and display method in the above embodiment.

[0199] This embodiment also provides a computer program product that, when run on an electronic device, causes the electronic device to perform the aforementioned related steps to realize the shooting and display method in the above embodiment.

[0200] In addition, embodiments of this application also provide an apparatus, which may specifically be a chip, component or module. The apparatus may include a connected processor and a memory; wherein the memory is used to store computer execution instructions, and when the apparatus is running, the processor may execute the computer execution instructions stored in the memory to cause the chip to execute the image capture and display methods in the above-described method embodiments.

[0201] In this embodiment, the electronic device, computer storage medium, computer program product or chip are all used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can be referred to the beneficial effects of the corresponding method provided above, and will not be repeated here.

[0202] Through the above description of the embodiments, those skilled in the art can clearly understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0203] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another device, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.

[0204] The unit described as a separate component may or may not be physically separate. The component shown as a unit can be one physical unit or multiple physical units, that is, it can be located in one place or distributed in multiple different places. Some or all of the units can be selected to achieve the purpose of the solution in this embodiment according to actual needs.

[0205] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0206] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solutions of the embodiments of this application, essentially or in other words, the parts that contribute to the prior art, or all or part of the technical solutions, can be embodied in the form of a software product. This software product is stored in a storage medium and includes several instructions to cause a device (which may be a microcontroller, chip, etc.) or processor to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0207] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any changes or substitutions within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A method for capturing and displaying images, applied to an electronic device, the electronic device comprising a first side and a second side, the first side being provided with a first screen and a first camera, and the second side being provided with a second camera, characterized in that, The method includes: The user input is received as a first operation; the first operation is used to activate the second camera or to open an application that uses the second camera. In response to the first operation, the electronic device activates the second camera and uses the first camera to capture a first set of environmental images; The electronic device determines whether there is a first target person in front of the first screen based on the first environmental image set. The first target person includes a person located in front of the first screen. If the first target person is not in front of the first screen, then the first screen is safely processed; If the first target person is in front of the first screen, obtain the first distance between the first target person and the first screen; if the first distance is less than a first threshold and the first target person is not looking at the first screen, or if the first distance is greater than or equal to the first threshold, then safely process the first screen, wherein the first threshold is the distance between the user's face and the first screen when using the electronic device; If the first distance is less than the first threshold and the first target person is looking at the first screen, then control the first screen to display normally; The security processing of the first screen includes blurring the content displayed on the first screen or controlling the first screen to turn off.

2. The shooting and display method as described in claim 1, characterized in that, The first surface and the second surface are positioned opposite to each other.

3. The shooting and display method as described in claim 1, characterized in that, The electronic device further includes a second screen disposed on the second surface, and the method further includes: In response to the first operation, the electronic device also determines whether there is a second target person in front of the second screen based on the second environmental image set captured by the second camera; If the second target is not in front of the second screen, proceed with the second screen safely. The security processing of the second screen includes blurring the content displayed on the second screen or controlling the second screen to turn off.

4. The image capture and display method as described in claim 3, characterized in that, The method further includes: If the second target person is in front of the second screen, obtain the second distance between the second target person and the second screen; Determine whether the second distance is less than the second threshold; If the second distance is greater than or equal to the second threshold, the second screen is processed safely.

5. The image capture and display method as described in claim 4, characterized in that, The method further includes: If the second distance is less than the second threshold, determine whether the second target person is looking at the second screen; If the second target is not looking at the second screen, safely handle the second screen.

6. The image capture and display method as described in claim 3, characterized in that, The method further includes: If the second target person is in front of the second screen, determine whether the second target person is looking at the second screen. If the second target person is not looking at the second screen, safely process the second screen.

7. The image capture and display method as described in claim 6, characterized in that, The method further includes: If the second target person is looking at the second screen, obtain the second distance between the second target person and the second screen and determine whether the second distance is less than the second threshold. If the second distance is greater than or equal to the second threshold, the second screen is processed safely.

8. The shooting and display method as described in claim 5 or 7, characterized in that, The method further includes: If the second distance is less than the second threshold and the second target person is looking at the second screen, then control the second screen to display normally.

9. The image capture and display method as described in claim 5 or 7, characterized in that, The electronic device stores multiple second thresholds, and the method further includes: Obtain the use case of the first operation; Obtain the correspondence between the usage scenario and the multiple second thresholds; A second threshold corresponding to the usage scenario is determined based on the usage scenario and the corresponding relationship.

10. The imaging and display method according to any one of claims 1 to 7, characterized in that, The first environmental image set includes images captured by the first camera within a preset time period, and the method further includes: The idle time is determined based on the first environmental image, and the idle time is the duration during which the first target person does not look at the first screen within a preset time. Determine whether the idle time is greater than a time threshold; If the idle time is greater than the time threshold, it is determined that the first target person is not looking at the first screen; If the idle time is less than or equal to the time threshold, it is determined that the first target person is looking at the first screen.

11. A computer-readable storage medium, characterized in that, It includes computer instructions that, when executed on an electronic device, cause the electronic device to perform the image capture and display method as described in any one of claims 1 to 10.

12. An electronic device, characterized in that, The electronic device includes a processor and a memory, the memory being used to store instructions, and the processor being used to invoke the instructions in the memory to cause the electronic device to perform the image capture and display method as described in any one of claims 1 to 10.

13. A chip system applied to an electronic device; the chip system includes an interface circuit and a processor; the interface circuit and the processor are interconnected via a circuit; the interface circuit is configured to receive signals from a memory of the electronic device and send signals to the processor, the signals including computer instructions stored in the memory; characterized in that, When the processor executes the computer instructions, the chip system performs the image capture and display method as described in any one of claims 1 to 10.

14. A computer program product, characterized in that, When the computer program product is run on an electronic device, it causes the electronic device to perform the image display method as described in any one of claims 1 to 10.

Images