Shooting method, electronic equipment and storage medium

Abstract

The embodiment of the invention relates to the field of terminals, in particular to a shooting method, electronic equipment and a storage medium. The method comprises the following steps: the electronic equipment displays a shooting preview interface; then, in the first shooting scene, in response to a first operation of a user, the electronic equipment shoots to obtain a first blurred image; next, in the first shooting scene, in response to a second operation of the user, the electronic equipment shoots to obtain a second blurred image; the blurring degree of the second blurring image is greater than that of the first blurring image; the first blurred image corresponds to first sensitivity, and the second blurred image corresponds to second sensitivity; the second sensitivity is greater than the first sensitivity. In the method, the electronic equipment can flexibly adjust the blurring degree of the blurring image according to the sensitivity. Furthermore, by using the method, the blurring effect of the blurred image shot by the electronic equipment can be improved, and the aesthetic feeling of the blurred picture is improved.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of terminals, and in particular to a shooting method, an electronic device and a storage medium. Background Art

[0002] With the development of terminal technology, users are using electronic devices more and more frequently. In order to meet the needs of users to record and share their lives anytime and anywhere, most electronic devices such as mobile phones and tablets have shooting functions, and electronic devices can use the shooting function to take photos, record videos, etc. At the same time, in order to improve the user's perception of photos, electronic devices can add a blur effect to photos, that is, electronic devices can take blurred photos.

[0003] Currently, how to flexibly adjust the blur degree of blurred photos is a problem to be solved. Summary of the invention

[0004] The embodiment of the present application provides a shooting method, an electronic device and a storage medium, in which the electronic device can blur an image to different degrees according to the light sensitivity of the electronic device, thereby the electronic device can flexibly adjust the blur degree of the blurred image.

[0005] To achieve the above objectives, the embodiments of the present application adopt the following technical solutions:

[0006] In a first aspect, a shooting method is provided, which can be applied to electronic devices such as mobile phones and tablet computers, and the electronic devices include cameras. The method includes: the electronic device displays a shooting preview interface. Thereafter, in a first shooting scene, in response to a first operation of a user, the electronic device shoots a first blurred image. Next, in the above-mentioned first shooting scene, in response to a second operation of the user, the electronic device shoots a second blurred image. The blurring degree of the second blurred image is greater than the blurring degree of the first blurred image; the first blurred image corresponds to a first sensitivity, and the second blurred image corresponds to a second sensitivity; the second sensitivity is greater than the first sensitivity.

[0007] Among them, the first blurred image corresponds to the first sensitivity, which can be understood as the first sensitivity is the sensitivity when the camera captures the original image corresponding to the first blurred image; the second blurred image corresponds to the second sensitivity, which can be understood as the second sensitivity is the sensitivity when the camera captures the original image corresponding to the second blurred image.

[0008] In this method, the electronic device can obtain blurred images with different blurring degrees according to the light sensitivity. In other words, the electronic device can flexibly adjust the blurring degree of the blurred image according to the light sensitivity.

[0009] Furthermore, in the above method, since the blur degree of the second blurred image is greater than that of the first blurred image, and the second sensitivity is greater than the first sensitivity, that is to say, the higher the sensitivity, the higher the blur degree of the blurred image captured by the electronic device. Then, the blur effect of the blurred image captured by the above method can be compared to the blur effect of the blurred image captured by a camera with a variable aperture function. Therefore, the above method can improve the blur effect of the blurred image captured by the electronic device and improve the beauty of the blurred photo.

[0010] In a possible design of the first aspect, the method further includes: in the second shooting scene, in response to a third operation of the user, the electronic device captures a third blurred image. The third blurred image corresponds to a third sensitivity, and the third sensitivity is the same as the second sensitivity; the second shooting scene is different from the first shooting scene, and the blurring degree of the third blurred image is different from the blurring degree of the second blurred image.

[0011] In this design, the electronic device can obtain blurred images with different blurring degrees according to the shooting scene. In other words, the electronic device can flexibly adjust the blurring degree of the blurred image according to the shooting scene, which can further improve the flexibility of adjusting the blurring degree of the blurred image.

[0012] In another possible design of the first aspect, the method further includes: in response to a fourth operation of the user, the electronic device captures a fourth blurred image; in response to a fifth operation of the user, the electronic device captures a fifth blurred image; the blurring degree of the fourth blurred image is greater than the blurring degree of the fifth blurred image. The fourth blurred image includes 1 face, and the fifth blurred image includes more than 1 face.

[0013] In this design, the electronic device can capture blurred images with different blur levels according to the number of faces included in the blurred image. In other words, the electronic device can flexibly adjust the blur level of the blurred image according to the number of faces, which can further improve the flexibility of adjusting the blur level of the blurred image.

[0014] In another possible design of the first aspect, the blurring degree of the second blurred image is greater than that of the first blurred image, including: the clarity of the background area of ​​the second blurred image is lower than the clarity of the background area of ​​the first blurred image.

[0015] In another possible design of the first aspect, the clarity of the background area of ​​the second blurred image is lower than the clarity of the background area of ​​the first blurred image, including: the equivalent aperture value of the second blurred image is smaller than the equivalent aperture value of the first blurred image.

[0016] In another possible design of the first aspect, the electronic device captures the first blurred image, including: the electronic device collects the original image through a camera; the electronic device reduces the clarity of the background area of ​​the original image based on the sensitivity of the camera when collecting the original image, so as to obtain the first blurred image; the non-background area of ​​the original image is the area where the focus target of the camera is located. The degree of reducing the clarity of the background area of ​​the original image is positively correlated with the sensitivity.

[0017] In this design, the electronic device can reduce the clarity of the background area of ​​the original image according to the sensitivity. Therefore, the electronic device can flexibly reduce the clarity of the background area of ​​the original image, that is, the electronic device can flexibly adjust the blur degree of the blurred image.

[0018] In another possible design of the first aspect, reducing the clarity of the background area of ​​the original image based on the sensitivity of the camera when capturing the original image includes: the electronic device performs face detection on the original image to obtain the number of faces included in the original image. When the number of faces included in the original image is greater than 0, the electronic device obtains a blur parameter of the original image based on the sensitivity. Next, the electronic device reduces the clarity of the background area of ​​the original image according to the blur parameter of the original image.

[0019] In another possible design of the first aspect, the above-mentioned obtaining the blur parameter of the original image based on the sensitivity includes: if the number of faces is 1, the electronic device obtains the first blur parameter according to the corresponding relationship between the sensitivity and the blur parameter under the single-person category and the sensitivity, and the single-person category is obtained based on the number of faces being 1. If the number of faces is greater than 1, the electronic device obtains the second blur parameter according to the corresponding relationship between the sensitivity and the blur parameter under the multi-person category and the sensitivity, and the multi-person category is obtained based on the number of faces being greater than 1. The above-mentioned reducing the clarity of the background area of ​​the original image based on the blur parameter of the original image includes: the electronic device reduces the clarity of the background area of ​​the original image at a first ratio according to the first blur parameter; or, the electronic device reduces the clarity of the background area of ​​the original image at a second ratio according to the second blur parameter. The first blur parameter is greater than the second blur parameter, and the first ratio is higher than the second ratio.

[0020] In this design, the electronic device can use different corresponding relationships to perform blurring according to the number of faces, such as reducing the blurring degree of the blurred image. In this way, the blurring degree of the blurred image can be flexibly adjusted. Furthermore, under the same sensitivity, for a blurred image with a number of faces greater than 1, its blurring degree is lower than that of a blurred image with a number of faces equal to 1; that is, the background of a blurred image with a number of faces equal to 1 will be more blurred than the background of a blurred image with a number of faces greater than 1. Since the background of the blurred image with a number of faces equal to 1 is relatively blurred, the foreground of the blurred image with a number of faces equal to 1 will be more prominent, which can enhance the blurring effect of the blurred image. And since the background of the blurred image with a number of faces greater than 1 is not very blurred, the focal plane of the blurred image with a number of faces greater than 1 will be wider, which can enhance the blurring effect of the blurred image.

[0021] In another possible design of the first aspect, the first blur parameter includes: a first sub-blur parameter, a second sub-blur parameter or a third sub-blur parameter. The electronic device obtains the first blur parameter according to the corresponding relationship between the sensitivity and the blur parameter under the single person category and the sensitivity: if the sensitivity is within a first interval, the electronic device obtains the first sub-blur parameter; if the sensitivity is within a second interval, the electronic device obtains the second sub-blur parameter; if the sensitivity is within a third interval, the electronic device obtains the third sub-blur parameter; the first interval, the second interval and the third interval are different.

[0022] In another possible design of the first aspect, the above-mentioned reduction of the clarity of the background area of ​​the original image based on the sensitivity of the camera when collecting the original image includes: the electronic device performs face detection on the original image to obtain the number of faces included in the original image. When the number of faces included in the original image is equal to 0, the electronic device performs content recognition on the original image to obtain a content tag of the original image, and the content tag is used to characterize the image content of the original image. The electronic device obtains the scene category of the original image based on the content tag. Afterwards, the electronic device obtains the blur parameter of the original image based on the correspondence between the sensitivity and the blur parameter under the scene category and the sensitivity reduction of the camera when collecting the original image. Next, the electronic device reduces the clarity of the background area of ​​the original image according to the blur parameter of the original image.

[0023] In this design, the electronic device can use different corresponding relationships to perform blurring according to the image content, such as reducing the blurring degree of the blurred image. Thus, the blurring degree of the blurred image can be flexibly adjusted.

[0024] In another possible design of the first aspect, the content tag includes a first content tag or a second content tag. And, the electronic device obtains the scene category of the original image according to the content tag, including: if the content tag includes a first content tag (such as a text content tag), the scene category of the original image is a first scene category (such as a multi-body scene category). If the content tag includes a second content tag (such as a green plant content tag), the scene category of the original image is a second scene category (such as an object scene category). The electronic device obtains the blur parameter of the original image according to the correspondence between the sensitivity and the blur parameter under the scene category, and the sensitivity, including: if the scene category of the original image is the first scene category, the electronic device obtains the third blur parameter according to the correspondence between the sensitivity and the blur parameter under the first scene category, and the sensitivity. If the scene category of the original image is the second scene category, the electronic device obtains the fourth blur parameter according to the correspondence between the sensitivity and the blur parameter under the second scene category, and the sensitivity. The above-mentioned reducing the definition of the background area of ​​the original image according to the blur parameter of the original image includes: the electronic device reducing the definition of the background area of ​​the original image according to the third blur parameter at a third ratio; or reducing the definition of the background area of ​​the original image according to the fourth blur parameter at a fourth ratio. The third blur parameter is different from the fourth blur parameter, and the third ratio is different from the fourth ratio.

[0025] In another possible design of the first aspect, the above-mentioned display of the shooting preview interface includes: the electronic device blurs the image captured in real time by the camera according to the sensitivity of the camera to obtain a blurred preview image; and displays the blurred preview image on the shooting preview interface.

[0026] In this design, the electronic device can display the blurred preview image in real time on the preview interface according to the sensitivity of the camera. Thus, the user can view the blurred preview image in real time on the preview interface, which can improve the user experience. At the same time, the electronic device can also flexibly display blurred preview images with different blurring degrees on the preview interface according to the blurred image.

[0027] In another possible design of the first aspect, the method further includes: the electronic device acquires a sixth image. Thereafter, the electronic device displays an image display interface for the sixth image, the image display interface including the sixth image and a blur control. Next, in response to a triggering operation on the blur control, the electronic device reduces the clarity of a background area of ​​the sixth image based on a corresponding sensitivity when the sixth image is captured, to obtain a sixth blurred image.

[0028] In this design, the electronic device also performs blur processing on the image according to the sensitivity in the image display interface to reduce the clarity of the background area of ​​the image. Thus, the blur degree of the blurred image can be flexibly reduced according to the sensitivity.

[0029] According to a second aspect, an electronic device is provided, comprising a memory and one or more processors, wherein the memory is coupled to the processor; wherein computer program code is stored in the memory, and the computer program code comprises computer instructions; when the computer instructions are executed by the processor, the electronic device executes the method provided by the first aspect and any possible design of the first aspect.

[0030] According to a third aspect, a computer-readable storage medium is provided, comprising computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the method provided by the first aspect and any possible design of the first aspect.

[0031] According to a fourth aspect, a computer program product comprising instructions is provided. When the computer program product is run on an electronic device, the electronic device can execute the method provided by the first aspect and any possible design of the first aspect.

[0032] In a fifth aspect, a chip system is provided, which is applied to an electronic device. The chip system includes one or more processors, which are used to call computer instructions so that the electronic device executes the method provided by the first aspect and any possible design of the first aspect.

[0033] Among them, the technical effects brought about by any design method in the second to fifth aspects can refer to the technical effects brought about by different design methods in the first aspect, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] Figure 1 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application;

[0035] Figure 2 A schematic diagram of the architecture of an electronic device provided in an embodiment of the present application;

[0036] Figure 3 A schematic diagram of the process of shooting method provided for the implementation of this application;

[0037] Figure 4 A schematic diagram of data flow provided for an embodiment of the present application;

[0038] Figure 5 A schematic diagram of a blur parameter-sensitivity function provided in an embodiment of the present application;

[0039] Figure 6 A schematic diagram of a user shooting process provided in an embodiment of the present application;

[0040] Figure 7 A schematic diagram of a group of user image interfaces provided by an embodiment of the present application;

[0041] Figure 8 A schematic diagram of another user shooting process provided in an embodiment of the present application;

[0042] Fig. 9 A schematic diagram of another user shooting process provided in an embodiment of the present application;

[0043] Fig.10 A schematic diagram of another user shooting process provided in an embodiment of the present application;

[0044] Fig.11 A schematic diagram of another user shooting process provided in an embodiment of the present application;

[0045] Fig.12 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

[0046] Fig.13 A schematic diagram of the structure of a chip system provided in an embodiment of the present application. DETAILED DESCRIPTION

[0047] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application. Among them, in the description of the present application, unless otherwise specified, " / " indicates that the objects associated before and after are in an "or" relationship, for example, A / B can represent A or B; "and / or" in the present application is only a kind of association relationship describing the associated objects, indicating that there can be three relationships, for example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. And, in the description of the embodiments of the present application, unless otherwise specified, "multiple" refers to two or more than two. "At least one of the following" or its similar expressions refers to any combination of these items, including any combination of single items or plural items. For example, at least one of a, b, or c can represent: a, b, c, ab, ac, bc, or abc, where a, b, c can be single or multiple. In addition, in order to clearly describe the technical solutions of the embodiments of the present application, in the embodiments of the present application, words such as "first" and "second" are used to distinguish the same items or similar items with substantially the same functions and effects. Those skilled in the art can understand that words such as "first" and "second" do not limit the quantity and execution order, and words such as "first" and "second" do not necessarily limit the difference.

[0048] Meanwhile, in the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a concrete manner for ease of understanding.

[0049] In the technical solutions disclosed in this application, the collection, storage, use, processing, transmission, provision and disclosure of user personal information involved are in compliance with the relevant laws and regulations and do not violate public order and good morals.

[0050] With the development of terminal technology, users are using electronic devices more and more frequently. In order to meet the needs of users to record and share their lives anytime and anywhere, most electronic devices such as mobile phones and tablets have shooting functions, and electronic devices can use the shooting function to take photos, record videos, etc. In order to improve the user's perception of photos, electronic devices can add blur effects to photos to blur the background of the photo, highlight the foreground of the photo, etc. Among them, photos with blur effects can be called blurred photos.

[0051] In some schemes, the electronic device can change the blur degree of the blurred photo taken by adjusting the aperture size of the electronic device when taking the photo. For example, the electronic device can obtain the blurred photo by taking a camera with a variable aperture function deployed therein. Among them, when the electronic device obtains the blurred photo by taking the camera, the electronic device can change the blur degree of the blurred photo by changing the aperture size of the camera. Generally speaking, the blurred photo taken with a variable aperture camera has a better blur effect, a higher user perception, and a higher aesthetic feeling.

[0052] However, in this solution, the price of the camera with the variable aperture function is relatively expensive, and the electronic device uses this method to change the blur degree of the blurred photo, which will cause the cost of the electronic device to be relatively high.

[0053] In other schemes, the electronic device can blur the photo to obtain a blurred photo. For example, the electronic device can separate the foreground and background of the photo by dividing the foreground and background of the photo. Next, the electronic device reduces the clarity of the background and / or improves the clarity of the foreground to obtain a blurred photo (hereinafter referred to as a blurred photo). It can be understood that since this scheme does not rely on a camera with a variable aperture function, this scheme can be applied to electronic devices equipped with a camera with a variable aperture function, and can also be applied to electronic devices without a camera with a variable aperture function.

[0054] When a user uses an electronic device to shoot a blurred image, the user can actively adjust the blur degree of the blurred image. For example, the user can trigger the electronic device to shoot through the shooting preview interface of the electronic device. When the user triggers the electronic device to shoot through the shooting preview interface of the electronic device, the user can set the aperture value of the electronic device for this shooting in the shooting preview interface. And by changing the aperture value of the electronic device for this shooting, the blur degree of the blurred image obtained by shooting can be changed.

[0055] It should be understood that, for electronic devices equipped with cameras with variable aperture functions, the above-mentioned "aperture value of the electronic device for this photo" can be understood as the actual aperture size of the camera, or as the aperture size virtualized by the electronic device through virtual aperture technology. And, for electronic devices that do not have cameras with variable aperture functions, the above-mentioned "aperture value of the electronic device for this photo" can be understood as the aperture size virtualized by the electronic device through virtual aperture technology.

[0056] However, in this solution, the user needs to actively set the aperture value in the shooting preview interface, and the adjustment of the blur degree of the blurred photo is not very flexible. In addition, if the user does not have relatively professional photography knowledge and photography skills, the blurred photo taken by the mobile phone based on the aperture value actively set by the user will have a poor blur effect and low aesthetics.

[0057] In summary, in the process of obtaining a blurred photo by blurring processing in an electronic device, how to flexibly adjust the blurring degree of the blurred photo is a problem to be solved. Furthermore, how to improve the blurring effect of the blurred photo is also a problem to be solved.

[0058] In view of this, an embodiment of the present application provides a shooting method, in which, in response to a user's shooting operation, an electronic device can shoot a blurred image; and in the process of shooting the blurred image, the electronic device can adaptively blur the image to different degrees according to the sensitivity of the electronic device and the shooting scene (such as the shooting content, the number of faces included in the image, etc.). For example, the electronic device can obtain the degree of blurring when blurring the image according to the sensitivity of the camera when shooting the image, and blur the image according to the degree of blurring to obtain a blurred image of the image; for another example, the electronic device can also obtain the degree of blurring when blurring the image according to the image content included in the image (such as a static single body, an artificial environment, a natural environment, etc.), and blur the image according to the degree of blurring to obtain a blurred image of the image. Among them, the above-mentioned sensitivity can also be referred to as the English abbreviation ISO.

[0059] In this method, since the electronic device obtains a blurred image through blurring processing, regardless of whether a camera with a variable aperture is deployed, a blurred image can be obtained through this blurring method. In other words, the cost of the electronic device can be saved through this method. Also, in the process of blurring processing of the electronic device, the electronic device can adjust the blurring degree of the blurred image without relying on the aperture value actively set by the user, and can conveniently and flexibly adjust the blurring degree of the blurred image, which can improve the user experience. Furthermore, in the process of blurring processing of the image, the electronic device can adaptively blur the image to different degrees according to the sensitivity of the electronic device, the shooting content, etc.; in this way, the blurred picture obtained by the electronic device through blurring processing can be comparable to the blurred image obtained by taking a variable aperture camera. The blurring effect of the blurred picture obtained through blurring processing can be improved, and the beauty of the blurred photo can be improved.

[0060] Among them, the above-mentioned image can be understood as a photo or a video frame. And, the degree of blurring of the above-mentioned image can be understood as the degree of reduction in the clarity of the background of the image. It can be understood that the degree of reduction in the clarity of the background of the image can be characterized by the equivalent aperture of the image; the equivalent aperture value is inversely proportional to the degree of blurring. For example, image A is blurred to obtain blurred image A. The greater the degree of blurring of blurred image A, the higher the degree of reduction in the clarity of the background of blurred image A compared to the background of image A, and the smaller the equivalent aperture value of blurred image A compared to image A.

[0061] It should be understood that in the embodiments of the present application, the foreground of an image and the background of an image are two relative concepts. The foreground of an image may also be referred to as the foreground area of ​​an image, and the background of an image may also be referred to as the background area of ​​an image. In some embodiments, the foreground may be understood as the area where the focus target of the camera is located when the camera of an electronic device captures the image. The background may be understood as the area in the image other than the area where the focus target of the camera is located when the camera of an electronic device captures the image. Among them, the focus target is the target corresponding to the focus of the camera of the electronic device.

[0062] Exemplarily, the technical solution provided in the embodiment of the present application can be applied to the process in which the user uses the shooting function of the electronic device. Among them, the above-mentioned electronic device can also be referred to as a terminal, terminal equipment, user equipment (UE), mobile station (MS), mobile terminal (MT), etc. The above-mentioned electronic device 100 can be a mobile phone, a tablet computer, a wearable device, a smart screen, an augmented reality (AR) / virtual reality (VR) device, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), and other electronic devices with a shooting function. The embodiment of the present application does not impose any restrictions on the product form of the electronic device.

[0063] Next, the hardware structure and architecture of the electronic device provided in the embodiments of the present application are introduced.

[0064] Figure 1 The schematic diagram of the hardware structure of the electronic device 100 is shown. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a camera 193, and a display screen 194.

[0065] It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0066] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0067] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0068] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0069] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, a mobile industry processor interface (MIPI), and / or a universal serial bus (USB) interface, etc.

[0070] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL).

[0071] The MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to implement the shooting function of the electronic device 100. The processor 110 and the display screen 194 communicate via the DSI interface to implement the display function of the electronic device 100.

[0072] The USB interface 130 is an interface that complies with USB standard specifications, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 may be used to connect a charger to charge the electronic device 100, and may also be used to transmit data between the electronic device 100 and a peripheral device.

[0073] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present invention is only a schematic illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0074] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0075] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0076] The electronic device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

[0077] ISP is used to process the data fed back by camera 193. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to ISP for processing and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. ISP can also optimize parameters such as exposure and color temperature during the shooting process. In some embodiments, ISP can be set in camera 193.

[0078] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0079] NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. Through NPU, applications such as intelligent cognition of electronic device 100 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.

[0080] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing music, video and other files in the external memory card.

[0081] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0082] After introducing the hardware structure of the electronic device provided in the embodiment of the present application, the architecture of the electronic device is introduced.

[0083] The architecture of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. TM Taking the system as an example, the architecture of the electronic device 100 is exemplified.

[0084] For example, see Figure 2 , the layered architecture can be divided into several layers, each with a clear role and division of labor. The layers communicate with each other through interfaces. In some embodiments, Android TM The system is divided into five layers, from top to bottom: application layer, application framework layer, hardware abstraction layer (HAL), kernel layer, and hardware layer.

[0085] The application layer can include a series of application packages.

[0086] like Figure 2 As shown, the application package may include applications such as a camera application, a gallery application, etc.

[0087] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0088] like Figure 2 As shown, the application framework layer may include a window manager, a content provider, a view system, a resource manager, and the like.

[0089] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0090] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0091] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

[0092] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0093] The application framework layer may further include a camera interface, and the camera interface is used to provide an API to the camera application, so that the camera application can interact with the camera module of the HAL layer by calling the API.

[0094] The hardware abstraction layer is an abstract structure between the hardware and the upper layer. It is used to provide a unified interface to the upper layer. It makes it unnecessary for the upper layer application to know how the lower layer hardware works, thus shielding the implementation details of the lower layer.

[0095] The hardware abstraction layer can provide a standard interface to display the device hardware functions to the higher-level application framework layer. The hardware abstraction layer contains multiple library modules, each of which implements an interface for a specific type of hardware component. The library module includes at least a camera module, etc. When the application framework layer requires access to the device hardware, the system will load the corresponding library module for the hardware component. Manufacturers can define interfaces in the hardware abstraction layer.

[0096] The camera module may include: a blur processing module, a blur decision module, a scene content perception module, an AE module, etc. In subsequent examples, the functions of the above modules will be described in detail.

[0097] The kernel layer is the layer between hardware and software, located below HAL. The kernel layer includes at least display driver, camera driver, etc.

[0098] The hardware layer includes at least the camera.

[0099] The following is an exemplary description of the hardware and software workflow of the electronic device during the shooting process.

[0100] For example, see Figure 2 , Figure 2 The transmission path of the control instructions (commands) is shown by sparse dotted lines. For example, when the camera application is running, it can send the relevant control commands issued by the user (for example, start shooting, stop shooting, zoom in, zoom out, etc.) to the camera interface of the framework layer, and send the control command to the camera module of the HAL layer through the camera interface. Next, the camera module drives the camera of the hardware layer to execute the actions corresponding to the above control instructions (for example, turn on the camera, turn off the camera, adjust the working parameters of the camera, etc.) by calling the camera driver of the kernel layer.

[0101] Next, see again Figure 2 , Figure 2 The transmission path of the image data is shown by a solid line in the figure. After the camera starts to collect image data, the camera transmits the collected image data to the camera module through the camera driver. For example, the camera transmits image data A to the scene content perception module of the camera module through the camera driver. Next, the scene content perception module performs scene detection on the image data A to obtain scene detection information, and sends the scene detection information to the blur decision module. After that, the blur decision module obtains the ISO of the camera when collecting image data A from the automatic exposure (AE) module. Next, the blur decision module obtains the blur parameters of image A based on the above ISO and scene detection information. Image A is the image corresponding to image data A. Then, the blur processing module blurs image A according to the above blur parameters to obtain a blurred image A. After that, the blur processing module sends the blurred image A to the camera application through the camera interface. As a result, the camera application can display the blurred image A in the shooting preview interface. Alternatively, the camera application can also send the blurred image A to the gallery application, and the gallery application stores the blurred image A.

[0102] It should be pointed out that Figure 2 The workflow of the AE module is output with dense dotted lines. When the camera collects image data, the AE module can obtain the image data from the camera driver, and control the camera's exposure-related parameters (such as the camera's ISO, the camera's shutter time, etc.) through the camera driver according to the image data and the preset AE algorithm. For example, the AE algorithm obtains the exposure-related parameters of the current frame through the previous frame of image data, and the camera collects the image data of the current frame according to the exposure-related parameters of the current frame. Afterwards, the AE algorithm can also send the ISO to the blur decision module. It should be understood that the AE algorithm can automatically adjust the exposure and gain according to the intensity of the external light to prevent overexposure or underexposure.

[0103] Next, the electronic device is a mobile phone, and the mobile phone has the above Figure 1 The hardware structure shown, and the above Figure 2 Taking the shown architecture as an example, the shooting method provided in the embodiment of the present application is introduced.

[0104] For example, see Figure 3 The shooting method provided in the embodiment of the present application may include steps S300-S304.

[0105] S300. The phone displays the shooting preview interface.

[0106] After the mobile phone displays the shooting preview interface, the camera of the mobile phone will continue to collect image data and display the image corresponding to the image data on the shooting preview interface. In other words, the shooting preview interface includes the image collected by the camera of the mobile phone in real time.

[0107] It should be understood that when a user uses a mobile phone, the user can trigger the mobile phone to display the shooting preview interface in a variety of ways. For example, the user can trigger the mobile phone to display the shooting preview interface by clicking the icon of the camera application. For another example, the user can trigger the mobile phone to display the shooting preview interface through voice commands. Specifically, it can be set according to actual usage needs, and the embodiment of the present application does not impose any restrictions on the method of triggering the mobile phone to display the shooting preview interface.

[0108] It is understandable that the acquisition of raw (RAW) images by the camera is a continuous process, so the camera will generate an image data stream, which can be referred to as a data stream. That is to say, during the shooting process of a mobile phone, the data stream of the RAW image collected by the mobile phone camera can be divided into multiple data streams, some of which are used to present the preview image on the preview interface of the mobile phone, some of which are used to generate photos, and some of which are used to assist shooting, such as guiding the camera to focus, adjusting the camera parameters, etc.

[0109] For example, see Figure 4 , the mobile phone can obtain a first data stream and a second data stream after preprocessing the data stream of the RAW image collected by the camera. Among them, the above preprocessing may include processing such as encoding conversion. The first data stream is used to present the preview image on the preview interface of the mobile phone, and the second data stream is used to generate shooting results, such as photos, videos, images, etc. In addition, the first data stream can also be downsampled to reduce the resolution of the first data stream to obtain a third data stream, and the third data stream is used to assist the mobile phone in shooting. Among them, the first data stream can also be called a preview stream, and the third data stream can also be called a tiny stream.

[0110] It should be noted that in some other embodiments, tiny can also be obtained by downsampling the second data stream, and the specific setting can be made according to actual usage requirements.

[0111] It should be understood that during the process of mobile phone shooting, the mobile phone may also have more data streams, which can be specifically set according to actual usage requirements. The embodiments of the present application do not impose any restrictions on this.

[0112] In some embodiments, the blur shooting function of the mobile phone may be always on; in other embodiments, the blur shooting function of the mobile phone may also be turned on in response to a user's operation, such as the user triggering the mobile phone to turn on the portrait shooting mode, or the user triggering the mobile phone to turn on the blur shooting mode, etc. Specifically, the method of turning on the blur shooting function can be set according to actual usage requirements, and the embodiments of the present application are not limited to this.

[0113] S301. The scene perception module performs face detection on the image to obtain the number of faces.

[0114] Among them, the image can be an image included in the tiny stream, or it can be an image included in the above-mentioned first data stream or second data stream. Alternatively, the image can also be a RAW image. Specifically, it can be set according to actual usage requirements, and the embodiments of the present application are not limited to this. In the following embodiments of the present application, face detection of images included in the tiny stream by the scene perception module will be used as an example for explanation.

[0115] In addition, the way in which the scene perception module performs face detection on an image can refer to related technologies. For example, the above image can be detected through a pre-trained artificial intelligence model related to face recognition to obtain a face detection frame, and then the scene perception module counts the number of face detection frames to obtain the number of faces. The embodiments of the present application do not impose any restrictions on this.

[0116] It should be pointed out that the above-mentioned number of faces can be understood as the number of faces included in the image, that is, the number of face detection frames obtained by the scene perception module when performing face detection on the image; and, the above-mentioned number of faces can also be understood as the number of faces included in the image whose size meets the preset size, that is, the number of face detection frames obtained by the scene perception module when performing face detection on the image and meeting the preset size.

[0117] For example, if the scene perception module performs face detection on an image and no face is detected, that is, no face detection frame is obtained, the number of faces obtained by the scene perception module is 0. For another example, if the scene perception module performs face detection on an image and detects a face, that is, a face detection frame is obtained, and the size of the face detection frame does not meet the preset requirements, the number of faces obtained by the scene perception module is 0.

[0118] The fact that the size of the face detection frame does not meet the preset value may be understood as that the percentage of the face detection frame in the image is less than a percentage threshold, and the percentage threshold may be 10%, 8%, 15% or the like.

[0119] After step S301, if the scene perception module obtains that the number of faces is 0, the mobile phone executes step S302.

[0120] S302. The scene perception module performs scene detection on the image to obtain the scene category.

[0121] Among them, the image for which the scene perception module performs scene detection in step S302 is the same as the image in the above step S301. And, the way in which the scene perception module performs scene detection on the image can refer to the relevant technology. For example, the content label of the image can be obtained by performing content recognition on the above image through a pre-trained artificial intelligence model related to content recognition. Among them, the content label may include: cat, dog, panda, blue sky, night view, fireworks, cloudy day, sunset, beach, snow, waterfall, stage, ancient building, text, food, flowers, green plants, car, bicycle, etc. Afterwards, the scene perception module can obtain the scene category of the image based on the correspondence between the content label and the scene category, and the number of scene categories is less than the number of content labels. It can be understood that since the scene perception module can define the content label to a scene category with a number less than the content label, the amount of data when the subsequent blur decision module obtains the blur parameter of the image can be reduced, thereby improving the performance of the mobile phone when blurring the image.

[0122] In some embodiments, the above scene categories may include: static monomer categories, artificial environment categories, natural environment categories and other categories. Among them, the static monomer category may include: cats, dogs, pandas, food, flowers, green plants, cars, bicycles and other content tags. And, the artificial environment category may include: fireworks, stage, ancient buildings, text and other content tags. And, the above natural environment category may include: blue sky, night view, cloudy day, sunset, beach, snow, waterfall and other content tags. The content tags included in other categories are content tags other than the content tags included in the above static monomer category, artificial environment category and natural environment category.

[0123] Alternatively, in other embodiments, the above scene categories may include: single scene categories (single scene categories include content tags such as cat, dog, panda, etc.), environmental scene categories (environmental scene categories include content tags such as blue sky, night scene, fireworks, cloudy day, sunset, beach, snow, waterfall, etc.), multi-body scene categories (multi-body scene categories include content tags such as stage, ancient building, text, etc.), object scene categories (object scene categories include content tags such as food, flowers, green plants, cars, bicycles, etc.) and other scene categories. The content tags included in other scene categories are content tags other than the content tags included in the above single scene categories, environmental scene categories, multi-body scene categories and object scene categories.

[0124] It should be understood that in some other embodiments, there may be more other tags, which can be specifically set according to actual usage requirements.

[0125] In some embodiments, the above-mentioned multi-body scene category can be called the first scene category, the above-mentioned object scene category can be called the second scene category, the above-mentioned environment scene category can be called the third scene category, the above-mentioned single body scene category can be called the fourth scene category, and the above-mentioned other scene categories can be called the fifth scene category.

[0126] After step S302, the mobile phone executes step S303; or, if the number of faces obtained by the scene perception module is not zero, the mobile phone executes step S303.

[0127] S303. The blur decision module obtains blur parameters of the image according to the ISO corresponding to the above image.

[0128] Among them, ISO can be used to reflect the sensitivity of the camera to light when the mobile phone camera collects image data corresponding to the image. The higher the ISO, the more sensitive the camera is to light. The blur decision module can obtain the ISO corresponding to the above image from the AE module, and the ISO is obtained by the AE module according to the AE algorithm. It should be understood that the value of ISO should be a positive integer. The blur parameter is used to control the degree to which the blur processing module reduces the clarity of the background of the image when the image is subsequently blurred, that is, the degree of blur of the blurred image generated by the blur processing module. The larger the blur parameter, the higher the degree to which the blur processing module reduces the clarity of the background of the image, that is, the higher the degree of blur of the blurred image obtained by the blur processing module, and vice versa.

[0129] As a possible implementation, the blur decision module may be configured with blur parameter relationships corresponding to different shooting scenes, wherein the shooting scenes may be divided according to the number of faces included in the image and the image content.

[0130] The blur parameter relationship is the correspondence between ISO and blur parameters. Next, if the number of faces obtained in the process of the above step S301 is 1, the blur parameters of the image are obtained according to the correspondence between ISO and blur parameters under the single-person category; if the number of faces obtained in the process of the above step S301 is greater than 1, the blur parameters of the image are obtained according to the correspondence between ISO and blur parameters under the multi-person category; if the number of faces obtained in the process of the above step S301 is 0, the blur parameters of the image are obtained according to the correspondence between ISO and blur parameters under the scene category of the image.

[0131] For example, a possible correspondence between ISO and blur parameter is shown in the following Table 1:

[0132] Table 1

[0133]

[0134] As another example, another possible correspondence relationship between ISO and blur parameter is shown in the following Table 2:

[0135] Table 2

[0136]

[0137] In some embodiments, the range of ISO in Table 1 or Table 2 above, such as [50,300] can be called the first interval, [301,600] can be called the second interval, [601,1200] can be called the third interval, and [1201,+∞] can be called the fourth interval. It can be seen from Table 2 above that in the single-person category, if the ISO is within the first interval, the blur parameter obtained is 50, that is, the first sub-blur parameter. And, in the single-person category, if the ISO is within the second interval, the blur parameter obtained is 60, that is, the second sub-blur parameter. And, in the single-person category, if the ISO is within the third interval, the blur parameter obtained is 70, that is, the third sub-blur parameter.

[0138] It should be understood that in some other correspondences between ISO and blur parameters, the ISO range can also be divided more finely. For example, the ISO range is divided into [50,150], [151,300], [301,450], [451,600], [601,900], [901,1200], [1201,+∞], etc. Specifically, it can be set according to actual usage requirements. And, in specific use, the correspondence between the above ISO and blur parameters can be set according to the ISO range of the camera. If the minimum ISO of the camera is 50, the minimum ISO in the correspondence between ISO and blur parameters can be 50; if the minimum ISO of the camera is 30, the minimum ISO in the correspondence between ISO and blur parameters can be 30.

[0139] As another possible implementation, during the above step S303, the blur decision module may also calculate the blur parameters of the image according to the ISO corresponding to the above image.

[0140] For example, taking a single-person scene as an example, the blur decision module can Figure 5 The corresponding ISO-blur parameter function calculates the blur parameter of the image.

[0141] After step S303, the mobile phone executes step S304.

[0142] S304. The blur processing module blurs the image according to the blur parameters of the image to obtain a blurred image.

[0143] Exemplarily, the blur processing module can perform foreground and background segmentation on the image to obtain the foreground of the image and the background of the image, and then reduce the clarity of the background of the image according to the blur parameter. For example, if the blur parameter is 60, the clarity of the background is reduced by 60%; if the blur parameter is 70, the clarity of the background area is reduced by 70%, and so on. Next, the blur processing module can merge the background and foreground with reduced clarity to obtain a blurred image.

[0144] It is understandable that the blur processing module can perform foreground and background segmentation on the image in a variety of ways. For example, the foreground and background segmentation can be achieved by calculating the depth of field by two cameras. For another example, the foreground and background segmentation can be achieved by an artificial model for foreground and background segmentation. Specifically, it can be designed according to actual usage requirements, and the embodiments of the present application are not limited to this.

[0145] It is understandable that in a scene with relatively low brightness in the shooting environment, if a variable aperture camera is used, the aperture of such camera will be relatively large, resulting in a relatively shallow depth of field of such camera. Using such a camera to shoot will result in a more blurred image.

[0146] In the solution provided in the embodiment of the present application, as can be seen from the correspondence between the above ISO and the blur parameter (such as shown in Table 1 and Table 2), the larger the ISO, the larger the blur parameter. And, a relatively large blur parameter can make the blur degree of the subsequently generated blurred image relatively high. That is to say, in the embodiment of the present application, the image degree of the blurred image is proportional to the ISO of the mobile phone camera when the image is captured. It can be understood that from the above description of the AE module, the ISO is obtained according to the AE algorithm. If the ISO is relatively large, it can be reflected that the brightness of the shooting environment is relatively low when the camera is shooting. In other words, when the ambient light brightness is relatively low, the shooting method provided in the embodiment of the present application is used to obtain a blurred image with a relatively high degree of blur. Therefore, the blurred image obtained using the solution provided in the embodiment of the present application has a similar blurring effect to the blurred image obtained by using the variable aperture camera; then the blurred image obtained using the solution provided in the embodiment of the present application can be compared to the blurred image obtained by using the variable aperture camera. Therefore, the mobile phone is obtained through the above Figure 3 The blurred image obtained by the corresponding process has a better blurring effect and is aesthetically pleasing.

[0147] In some embodiments, when the blur processing module performs blur processing on the image according to the blur parameters of the image, the blur processing module may also improve the clarity of the foreground of the image, thereby obtaining a blurred image.

[0148] It should be noted that in the process of step S304, the image processed by the blur processing module may be one or more images of the first data stream image, the second data stream image and the RAW image.

[0149] For example, if the blur processing module blurs the image of the first data stream according to the blur parameters of the image to obtain a blurred image in step S304, the mobile phone can display the blurred image on the preview interface after step S304. In this way, the user can see the blurred image after the preview image is blurred on the preview interface of the mobile phone.

[0150] In some embodiments, the above shooting method may not include step S300, that is, the mobile phone may start to execute the shooting method from step S301. For example, the mobile phone starts to execute the above shooting method from step S301, and the mobile phone may execute steps S301-S303 on the image of the tiny stream, and the mobile phone executes step S304 on the image of the second data stream to obtain a blurred image. Alternatively, the mobile phone may obtain an image from an album application, and execute steps S301-S304 on the image obtained from the album application.

[0151] In some implementations, the triggering timing of step S301 may be that the mobile phone executes step S301 in response to a user's shooting instruction. Next, after the mobile phone executes step S301, steps S302-S304 are executed, or steps S302 and S304 are executed. When the mobile phone executes step S304, the mobile phone blurs the image of the second data stream according to the blur parameter to obtain a blurred image, and the mobile phone's gallery application saves the blurred image.

[0152] Exemplarily, the above steps S301-S304 are described by taking the example that the blur processing module performs blur processing on both the image of the first data stream and the image of the second data stream in step S304. Figure 6 ,exist Figure 6 In the illustrated scenario, the user uses the mobile phone 100 to take a photo. When the user uses the mobile phone 100 to take a photo, the camera of the mobile phone collects image data of the real image 500 to generate a RAW image. Figure 6In the scene shown, the picture in the dotted box is a picture in the physical world, which can be called a real image 500. Next, the mobile phone generates a first data stream and a second data stream based on the original image, and downsamples the first data stream to obtain a third data stream, that is, a tiny stream. Afterwards, the mobile phone executes the above step S301 on the image included in the tiny stream. Since the real image 500 includes a face, the mobile phone executes step S303 after executing step S301 to obtain the blur parameter. Next, the mobile phone executes the above step S304 on the image of the first data stream to obtain a blurred image 1, and displays the blurred image A501 in the shooting preview interface 502. And, in response to the shooting trigger operation, the mobile phone executes the above step S304 on the second data stream to obtain and save the blurred image B503.

[0153] When the mobile phone executes step S304, the "people" in the real image 500 are segmented as the foreground, and the "trees" in the real image 500 are segmented as the background. Figure 6 The areas filled with diagonal lines in the image indicate that the definition is relatively low. For example, the definition of the "trees" in the blurred image A501 is lower than the definition of the "trees" in the real image 500; and the definition of the "trees" in the blurred image B503 is lower than the definition of the "trees" in the real image 500.

[0154] It can be understood that the above-mentioned shooting trigger operation can be a click operation on the shooting control 502B included in the shooting preview interface 502, or it can be other operations, such as the user's voice shooting command, etc., and the embodiment of the present application is not limited to this.

[0155] And, in some embodiments, in response to the shooting trigger operation, the mobile phone can also display a thumbnail of the blurred image B503 in the shooting result display control 502A.

[0156] It should be noted that, since the mobile phone uses the same blur parameter to perform the above step S304 for the first data stream and the second data stream in the above process, the blur degree of the blurred image displayed on the preview interface of the mobile phone and the blurred image saved by the mobile phone are the same; for example, the blur degree of blurred image A and blurred image B are the same. Therefore, the user can observe the blur degree of the blurred image after shooting in the preview interface of the mobile phone, and the user can grasp the blur degree of the blurred image shot in the preview interface, which can improve the user experience.

[0157] It should also be pointed out that due to the above Figure 6In the corresponding process, after the mobile phone executes step S301, if the number of faces is not 0, the mobile phone is triggered to execute step S303, that is, the mobile phone does not execute the above step S302. It can be seen that in the above method, if the face detection detects the presence of a face in the image, the image will not be subjected to scene detection. Thus, the efficiency of the mobile phone in generating blur parameters during the portrait shooting process can be improved, thereby improving the efficiency of the mobile phone in blurring processing. From the above description, it can be seen that in the shooting method provided in the embodiment of the present application, the priority of face detection is higher than the priority of scene detection; and, because the priority of face detection is higher than the priority of scene detection, the efficiency of blurring processing performed by the mobile phone can be improved.

[0158] In some other embodiments, the above-mentioned processes S301-S304 of the present application can also be used for post-processing of images.

[0159] For example, see Figure 7 , Figure 7 The clarity of the oblique line filled part is relatively low. The mobile phone displays a gallery preview interface 7000, which includes thumbnails of multiple images. Afterwards, in response to a click operation on the target image thumbnail 7001, the mobile phone displays an image display interface 7100, which includes a blur control 7101 and a target image 7102. Afterwards, in response to a click operation on the blur control 7101, the mobile phone displays a blurred target image display interface 7200, which includes a blurred target image 7201. The background clarity of the blurred target image 7201 is lower than the background clarity of the target image 7102. The blurred target image 7201 is obtained by the mobile phone executing the above steps S301-S304 on the target image 7102. For example, the mobile phone performs face extraction on the target image 7102 and obtains a face number of 1. Next, since the number of faces is not 0, the mobile phone obtains the target blur parameter according to the sensitivity corresponding to the target image 7102. Then, the mobile phone blurs the target image 7102 according to the target blur parameter to obtain the blurred target image 7201. Among them, the sensitivity corresponding to the target image 7102 can be obtained through the exchangeable image file format (EXIF) information of the target image 7102. It should be understood that the EXIF ​​information of the image records the relevant parameters of the camera when the camera captures the image, such as the sensitivity of the camera, the shutter time of the camera, etc.

[0160] The shooting method provided in the embodiment of the present application is introduced below in conjunction with the specific shooting process.

[0161] For example, see Figure 8 ,exist Figure 8In the image, the clarity of the oblique line filling part and the horizontal line filling part is relatively low, and the clarity of the horizontal line filling part is lower than the clarity of the oblique line filling part. Figure 8 In the illustrated process, the picture within the dotted box is a picture in the physical world, which can be called a real image 600 .

[0162] exist Figure 8 In the process shown, the user uses the mobile phone 100 to shoot. In the process of the user using the mobile phone 100 to shoot, the camera of the mobile phone collects image data of the real image 600 at the first sensitivity. Next, in response to the user's shooting operation, the mobile phone executes the above steps S301, S303 and S304, and the mobile phone obtains the first blurred image 601. That is, in the first shooting scene, in response to the user's first operation, the mobile phone shoots and obtains the first blurred image.

[0163] Afterwards, the camera of the mobile phone collects the image data of the real image 600 at the second sensitivity. Next, in response to the user's shooting operation, the mobile phone executes the above steps S301, S303 and S304, and the mobile phone obtains the second blurred image 602. That is, in the first shooting scene, in response to the user's second operation, the mobile phone captures the second blurred image.

[0164] It should be pointed out that since the second sensitivity is higher than the first sensitivity, the blur parameter 2 obtained when the mobile phone executes step S303 at the second sensitivity will be greater than the blur parameter 1 obtained when the mobile phone executes step S303 at the first sensitivity, which will make the blur degree of the second blurred image 602 higher than the blur degree of the first blurred image 601. For example, the clarity of the "trees" included in the second blurred image 602 is lower than the clarity of the "trees" included in the first blurred image 601; for another example, the equivalent aperture value of the second blurred image 602 is smaller than the equivalent aperture value of the first blurred image 601.

[0165] It can be understood that the second sensitivity being higher than the first sensitivity can be understood as the second sensitivity being higher than the sensitivity threshold and the first sensitivity being lower than the sensitivity threshold, wherein the sensitivity threshold can be the end point of the ISO range in the corresponding relationship between the ISO and the blur parameter. For example, the second sensitivity is 1000 and the first sensitivity is 500.

[0166] For example, see Fig. 9 , Fig. 9 In the image, the clarity of the oblique line filling part and the horizontal line filling part is relatively low, and the clarity of the horizontal line filling part is lower than the clarity of the oblique line filling part. Fig. 9 In the illustrated process, the images within the dashed boxes are images in the physical world, such as real image 700 and real image 702 .

[0167] exist Fig. 9 In the process shown, the user uses the mobile phone 100 to shoot a real image 700. During the process of the user using the mobile phone 100 to shoot, the camera of the mobile phone collects image data of the real image 700. Next, in response to the user's shooting operation, the mobile phone executes the above steps S301, S303 and S304, and the mobile phone obtains the third blurred image 701. That is, in response to the user's fourth operation, the mobile phone shoots and obtains the fourth blurred image.

[0168] Afterwards, the user uses the mobile phone 100 to shoot the real image 702. During the process of the user using the mobile phone 100 to shoot, the camera of the mobile phone collects image data of the real image 702. Next, in response to the user's shooting operation, the mobile phone executes the above steps S301, S303 and S304, and the mobile phone obtains the fourth blurred image 703. That is, in response to the user's fifth operation, the mobile phone shoots and obtains the fifth blurred image.

[0169] It should be noted that the ISO of the camera when the mobile phone 100 takes the real image 700 and the ISO of the camera when the mobile phone 100 takes the real image 702 are the same. Fig. 9 It can be seen that the number of faces included in the real image 700 is less than the number of faces included in the real image 702. In the above process, the mobile phone executes the above step S303 based on the real image 700 to obtain the third blur parameter, and the mobile phone executes the above step S303 based on the real image 702 to obtain the fourth blur parameter. Since the number of faces included in the real image 700 is less than the number of faces included in the real image 702, and the sensitivity of the mobile phone is the same when the mobile phone 100 shoots the real image 700 and when the mobile phone 100 shoots the real image 700, then the third blur parameter is higher than the fourth blur parameter, which will cause the blur degree of the third blurred image 701 to be higher than the blur degree of the fourth blurred image 703. For example, the clarity of the "trees" in the third blurred image 701 is lower than the "clarity of the trees" in the fourth blurred image 703.

[0170] For example, see Fig.10 , Fig.10 In the image, the clarity of the oblique line filling part and the horizontal line filling part is relatively low, and the clarity of the horizontal line filling part is lower than the clarity of the oblique line filling part. Fig.10 In the illustrated process, the images within the dashed boxes are images in the physical world, such as real image 1000 and real image 1002 .

[0171] exist Fig.10In the process shown, the user uses the mobile phone 100 to shoot a real image 1000. During the process of the user using the mobile phone 100 to shoot, the camera of the mobile phone collects image data of the real image 1000. Next, in response to the user's shooting operation, the mobile phone executes the above steps S301, S302, S303 and S304, and the mobile phone obtains the fifth blurred image 1001. Afterwards, the user uses the mobile phone 100 to shoot a real image 1002. During the process of the user using the mobile phone 100 to shoot, the camera of the mobile phone collects image data of the real image 1002. Next, in response to the user's shooting operation, the mobile phone executes the above steps S301, S302, S303 and S304, and the mobile phone obtains the sixth blurred image 1003.

[0172] It should be noted that the ISO of the camera when the mobile phone 100 takes the real image 1000 and the ISO of the camera when the mobile phone 100 takes the real image 1002 are the same. Fig.10 It can be seen that the real image 1000 does not include a human face. The real image 1000 includes green plants. Since the real image 1000 does not include a human face, the mobile phone executes step S301 to obtain the number of faces as 0, and the mobile phone executes step S302. Next, when the mobile phone executes step S302, it obtains the scene category as a static monomer category. Afterwards, when the mobile phone executes step S303, it obtains the fifth blur parameter according to the blur parameter relationship of the corresponding object scene category and the ISO of the camera. Next, the mobile phone executes step S304: obtains the fifth blurred image 1001 according to the fifth blur parameter. And, from Fig.10 As can be seen from the figure, the real image 1002 includes a face. Therefore, the real image 1002 includes a face, the mobile phone executes step S301 to obtain the number of faces as 1, and the mobile phone executes step S303. Afterwards, the mobile phone obtains the sixth blur parameter according to the blur parameter relationship corresponding to the single person and the ISO of the camera during the execution of step S303. Next, the mobile phone executes step S304: obtains the sixth blurred image 1003 according to the sixth blur parameter.

[0173] Among them, it can be seen from the correspondence between ISO and blur parameters shown in the above Table 2 that, since the blur parameter of the object scene category under the same ISO is greater than the blur parameter of the single person category, that is, the 5th blur parameter is higher than the 6th blur parameter, this will cause the blur degree of the 5th blurred image 1001 to be higher than the blur degree of the 6th blurred image 1003, for example, the blur degree of the "table" included in the 5th blurred image 1001 is higher than the blur degree of the "table" included in the 6th blurred image 1003.

[0174] For example, see Fig.11 , Fig.11In the image, the clarity of the oblique line filling part and the horizontal line filling part is relatively low, and the clarity of the horizontal line filling part is lower than the clarity of the oblique line filling part. Fig.11 In the illustrated process, the images within the dashed boxes are images in the physical world, such as real image 1100 and real image 1102 .

[0175] exist Fig.11 In the process shown, the user uses the mobile phone 100 to shoot a real image 1100. During the process of the user using the mobile phone 100 to shoot, the camera of the mobile phone collects image data of the real image 1100. Next, in response to the user's shooting operation, the mobile phone executes the above steps S301, S302, S303 and S304, and the mobile phone obtains the 7th blurred image 1101. Afterwards, the user uses the mobile phone 100 to shoot a real image 1102. During the process of the user using the mobile phone 100 to shoot, the camera of the mobile phone collects image data of the real image 1102. Next, in response to the user's shooting operation, the mobile phone executes the above steps S301, S302, S303 and S304, and the mobile phone obtains the 8th blurred image 1103.

[0176] It should be noted that the ISO of the camera when the mobile phone 100 takes the real image 1100 and the ISO of the camera when the mobile phone 100 takes the real image 1102 are the same. Fig.11 It can be seen that the real image 1100 does not include a face, and the real image 1100 includes text. Since the real image 1100 does not include a face, the mobile phone executes step S301 to obtain the number of faces as 0, and the mobile phone executes step S302. Next, when the mobile phone executes step S302, it obtains that the scene category is an artificial environment category. Afterwards, in the process of executing step S303, the mobile phone obtains the 7th blur parameter based on the blur parameter relationship corresponding to the artificial environment category and the ISO of the camera. Next, the mobile phone executes step S304: obtains the 7th blurred image 1101 according to the 7th blur parameter. And, from Fig.11 As can be seen from the figure, the real image 1102 includes a face. Since the real image 1102 includes a face, the mobile phone executes step S301 to obtain the number of faces as 1, and then executes step S303. Afterwards, the mobile phone obtains the eighth blur parameter according to the blur parameter relationship corresponding to the single person and the ISO of the camera during the execution of step S303. Next, the mobile phone executes step S304: obtains the eighth blurred image 1103 according to the eighth blur parameter.

[0177] Among them, it can be seen from the correspondence between ISO and blur parameters shown in the above Table 1 that, since the blur parameter of the artificial environment category is greater than the blur parameter of the single person category under the same ISO, that is, the 7th blur parameter is higher than the 8th blur parameter, this will cause the blur degree of the 7th blurred image 1101 to be higher than the blur degree of the 8th blurred image 1103, for example, the blur degree of the "table" included in the 7th blurred image 1101 is higher than the blur degree of the "table" included in the 8th blurred image 1103.

[0178] It should be noted that the personal information used in the technical solution of this application is limited to information for which the individual’s separate consent has been obtained, including but not limited to notifying and reminding the user to read the relevant user agreement (notification) and sign the agreement (authorization) including authorization of relevant user information before the user uses the function.

[0179] In combination with the algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to be beyond the scope of the present application.

[0180] In this embodiment, the electronic device can be divided into functional modules according to the above method example. For example, each functional module can be divided according to each function, or two or more functions can be integrated into one processing module. The above integrated module can be implemented in the form of hardware. It should be noted that the division of modules in this embodiment is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0181] The present application also provides an electronic device, such as Fig.12 As shown, the electronic device may include one or more processors 1801 , a memory 1802 and a communication interface 1803 .

[0182] The memory 1802 and the communication interface 1803 are coupled to the processor 1801. For example, the memory 1802, the communication interface 1803 and the processor 1801 may be coupled together via a bus 1804.

[0183] The communication interface 1803 is used for data transmission with other devices. The memory 1802 stores computer program code. The computer program code includes computer instructions. When the computer instructions are executed by the processor 1801, the electronic device executes the relevant method steps in the above method embodiment of the present application.

[0184] Among them, the processor 1801 can be a processor or a controller, for example, a central processing unit (CPU), a general processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. It can implement or execute various exemplary logic blocks, modules and circuits described in conjunction with the present disclosure. The processor can also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like.

[0185] The bus 1804 may be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus. The bus 1804 may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Fig.12 The fact that only one line is used in the diagram does not mean that there is only one bus or only one type of bus.

[0186] The present application also provides a chip system, such as Fig.13 As shown, the chip system 2000 includes at least one processor 2001 and at least one interface circuit 2002. The processor 2001 and the interface circuit 2002 can be interconnected via lines. For example, the interface circuit 2002 can be used to receive signals from other devices (such as a memory of an electronic device). For another example, the interface circuit 2002 can be used to send signals to other devices (such as processor 2001). Exemplarily, the interface circuit 2002 can read instructions stored in the memory and send the instructions to the processor 2001. When the instructions are executed by the processor 2001, the electronic device can execute the various steps in the above embodiments. Of course, the chip system can also include other discrete devices, which are not specifically limited in the embodiments of the present application.

[0187] An embodiment of the present application further provides a computer-readable storage medium, in which a computer program code is stored. When the processor executes the computer program code, the electronic device executes the relevant method steps in the method embodiment.

[0188] The embodiment of the present application also provides a computer program product. When the computer program product is run on a computer, it enables the computer to execute the relevant method steps in the above method embodiment.

[0189] Among them, the electronic device, computer-readable storage medium or computer program product provided in this application is used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method provided above, and will not be repeated here.

[0190] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0191] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0192] The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0193] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0194] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including several instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.

[0195] The above contents are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application shall be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A shooting method, characterized in that: The method is applied to an electronic device, wherein the electronic device includes a camera; the method includes: Display the shooting preview interface; In a first shooting scene, in response to a first operation of a user, a first blurred image is captured; In the first shooting scene, in response to a second operation of the user, a second blurred image is captured; the blurring degree of the second blurred image is greater than the blurring degree of the first blurred image; The first blurred image corresponds to a first sensitivity, and the second blurred image corresponds to a second sensitivity; the second sensitivity is greater than the first sensitivity.

2. The method according to claim 1, characterized in that The method further comprises: In the second shooting scene, in response to a third operation of the user, a third blurred image is captured; The third blurred image corresponds to a third sensitivity, and the third sensitivity is the same as the second sensitivity; the second shooting scene is different from the first shooting scene, and the blurring degree of the third blurred image is different from the blurring degree of the second blurred image.

3. The method according to claim 1 or 2, characterized in that: The method further comprises: In response to a fourth operation of the user, capturing a fourth blurred image; In response to a fifth operation of the user, a fifth blurred image is captured; the blurring degree of the fourth blurred image is greater than the blurring degree of the fifth blurred image; The number of faces included in the fourth blurred image is 1, and the number of faces included in the fifth blurred image is greater than 1.

4. The method according to any one of claims 1 to 3, characterized in that: The blurring degree of the second blurred image is greater than the blurring degree of the first blurred image, comprising: the clarity of the background area of ​​the second blurred image is lower than the clarity of the background area of ​​the first blurred image.

5. The method according to claim 4, characterized in that The definition of the background area of ​​the second blurred image is lower than the definition of the background area of ​​the first blurred image, including: The equivalent aperture value of the second blurred image is smaller than the equivalent aperture value of the first blurred image.

6. The method according to any one of claims 1 to 5, characterized in that: The capturing to obtain a first blurred image includes: Collecting original images through the camera; Based on the light sensitivity of the camera when acquiring the original image, the clarity of the background area of ​​the original image is reduced to obtain the first blurred image; the non-background area of ​​the original image is the area where the focus target of the camera is located; The degree of reducing the clarity of the background area of ​​the original image is positively correlated with the sensitivity.

7. The method according to claim 6, characterized in that The reducing the clarity of the background area of ​​the original image based on the light sensitivity of the camera when acquiring the original image includes: Performing face detection on the original image to obtain the number of faces included in the original image; When the number of faces included in the original image is greater than 0, obtaining a blur parameter of the original image based on the sensitivity; The clarity of the background area of ​​the original image is reduced according to the blur parameter of the original image.

8. The method according to claim 7, characterized in that The obtaining the blur parameter of the original image based on the sensitivity includes: If the number of faces is 1, obtaining a first blur parameter according to the corresponding relationship between the sensitivity and the blur parameter under the single person category and the sensitivity, and the single person category is obtained based on the number of faces being 1; If the number of faces is greater than 1, obtaining a second blur parameter according to the corresponding relationship between the sensitivity and the blur parameter under the multi-person category and the sensitivity, and the multi-person category is obtained based on the number of faces being greater than 1; The reducing the definition of the background area of ​​the original image according to the blur parameter of the original image includes: reducing the clarity of the background area of ​​the original image at a first ratio according to the first blur parameter; Alternatively, reducing the clarity of the background area of ​​the original image at a second ratio according to the second blur parameter; The first blur parameter is greater than the second blur parameter, and the first ratio is higher than the second ratio.

9. The method according to claim 8, characterized in that The first blur parameter includes: a first sub-blur parameter, a second sub-blur parameter or a third sub-blur parameter; The corresponding relationship between the sensitivity and the blur parameter in the single person category and obtaining the first blur parameter according to the sensitivity include: If the sensitivity is within the first interval, obtaining the first sub-blurring parameter; If the sensitivity is within the second interval, obtaining the second sub-blurring parameter; If the sensitivity is within a third interval, the third sub-blurring parameter is obtained; the first interval, the second interval and the third interval are different.

10. The method according to claim 6, characterized in that The reducing the clarity of the background area of ​​the original image based on the light sensitivity of the camera when acquiring the original image includes: Performing face detection on the original image to obtain the number of faces included in the original image; When the number of faces included in the original image is equal to 0, performing content recognition on the original image to obtain a content label of the original image; the content label is used to represent the image content of the original image; Obtaining a scene category of the original image according to the content label; Obtaining the blur parameter of the original image according to the corresponding relationship between the sensitivity and the blur parameter under the scene category and the sensitivity drop of the camera when acquiring the original image; The clarity of the background area of ​​the original image is reduced according to the blur parameter of the original image.

11. The method according to claim 10, characterized in that The content tag includes a first content tag or a second content tag; The obtaining the scene category of the original image according to the content label includes: If the content tag includes a first content tag, the scene category of the original image is a first scene category; If the content tag includes a second content tag, the scene category of the original image is a second scene category; The obtaining the blur parameter of the original image according to the corresponding relationship between the sensitivity and the blur parameter under the scene category and the sensitivity includes: If the scene category of the original image is the first scene category, obtaining a third blur parameter according to the corresponding relationship between the sensitivity and the blur parameter under the first scene category and the sensitivity; If the scene category of the original image is the second scene category, obtaining a fourth blur parameter according to the corresponding relationship between the sensitivity and the blur parameter under the second scene category and the sensitivity; The reducing the definition of the background area of ​​the original image according to the blur parameter of the original image includes: reducing the clarity of the background area of ​​the original image at a third ratio according to the third blur parameter; Alternatively, reducing the clarity of the background area of ​​the original image at a fourth ratio according to the fourth blur parameter; The third blur parameter is different from the fourth blur parameter, and the third ratio is different from the fourth ratio.

12. The method according to any one of claims 1 to 11, characterized in that: The displaying of the shooting preview interface includes: According to the sensitivity of the camera, the image collected by the camera in real time is blurred to obtain a blurred preview image; and the blurred preview image is displayed on the shooting preview interface.

13. The method according to any one of claims 1 to 12, characterized in that: The method further comprises: acquiring a sixth image; displaying an image display interface for the sixth image, wherein the image display interface includes the sixth image and a blur control; In response to a triggering operation on the blur control, the clarity of the background area of ​​the sixth image is reduced based on the corresponding sensitivity when the sixth image is taken, so as to obtain a sixth blurred image.

14. An electronic device, characterized in that: The electronic device includes a processor and a memory; the processor is coupled to the memory; the memory is used to store computer program code; the computer program code includes computer instructions, and when the processor executes the above-mentioned computer instructions, the electronic device executes the method described in any one of claims 1-13.

15. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes computer instructions, and when the computer instructions are executed on an electronic device, the electronic device executes the method according to any one of claims 1 to 13.

16. A chip system, characterized in that: The chip system is applied to an electronic device, and the chip system includes one or more processors, and the processor is used to call computer instructions so that the electronic device executes the method according to any one of claims 1-13.

17. A computer program product, characterized in that The computer program product includes instructions, and when the computer program product is run on an electronic device, the electronic device executes the method according to any one of claims 1 to 13.

Images