Shooting method, electronic device and medium
By adding a blurred shooting function in the real-life environment shooting application of electronic devices, users can select blurred shapes and shoot blurred images or videos in the blurred shooting interface, solving the problem that electronic devices cannot directly take blurred images and realizing the need for intelligent shooting.
Patent Information
- Application Number
- CN202310839728.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-07-10
- Publication Date
- 2025-04-22
- Estimated Expiration
- 2043-07-10
AI Technical Summary
Electronic devices cannot directly take blurred images, which cannot meet the needs of intelligent shooting.
By adding a blurring shooting function in the real-life environment shooting application of electronic devices, users can select blurring shapes in the blurring shooting interface and directly shoot or record blurring images or videos.
It enables electronic devices to directly capture blurred images and videos without using photo editing software, which meets the needs of intelligent shooting.
Smart Images

Figure CN116582743B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of image processing technology, and in particular to a shooting method, electronic equipment and medium. Background Art
[0002] At present, electronic devices mainly rely on photo editing software to obtain blurred images. When using photo editing software to blur the captured image, the electronic device can display the following Figure 1 In the photo editing interface shown, the electronic device imports the captured image 110 into the photo editing software. When it is detected that the user triggers the blur control 121 in the function bar 120 of the photo editing interface, the electronic device displays the blur shape control bar 131, and obtains the blur shape control selected by the user from the blur shape control bar 131, such as the circular blur shape control 131-1, the rectangular blur shape control 131-2, the square blur shape control 131-3, etc., and selects a partial area (for example, a portion of the image) from the image. Figure 1 The middle area 140) is displayed in the same shape as the blurred shape corresponding to the blurred shape control, the original clarity of the partial area is maintained, and the clarity of other areas in the image except the partial area is reduced, so as to implement the blurred processing of the image to obtain the blurred image 150. It can be seen that the electronic device cannot directly shoot the blurred image and cannot meet the requirements of intelligent shooting. Summary of the invention
[0003] In order to solve the problem that an electronic device cannot directly capture a blurred image and cannot meet the needs of intelligent photography, an embodiment of the present application provides a shooting method, an electronic device and a medium.
[0004] A first aspect of an embodiment of the present application provides a shooting method, which includes: detecting a first operation of a user; displaying a blurred shooting interface, wherein the blurred shooting interface includes at least one of the following: a blurred preview screen, the blurred preview screen including a first blurred area and a first real scene area; a blurred shooting image generated corresponding to a second operation of the user, the blurred shooting image including a second blurred area and a second real scene area; and a blurred video screen, the blurred video screen including a third blurred area and a third real scene area.
[0005] In an embodiment of the present application, by adding a blurred shooting function to the real-scene environment shooting application of the electronic device in advance, there is no need to use photo editing software to process the shot image to obtain a blurred image. The electronic device can directly shoot the blurred image, which can meet the needs of intelligent shooting.
[0006] In some optional instances, the first operation may refer to opening a camera application, such as clicking a camera control on the main interface of an electronic device, hereinafter referred to as the first trigger operation. The second operation may refer to clicking a shooting control on a blurred shooting interface. The blurred preview interface may refer to the screen presented by the blurred shooting interface of the electronic device when a user clicks on the camera control on the main interface of the electronic device, causing the main interface to switch to the blurred shooting interface, but the user does not click on the shooting control on the blurred shooting interface. The blurred shooting image may refer to the image presented by the blurred shooting interface of the electronic device when a user clicks on the camera control on the main interface of the electronic device, causing the main interface to switch to the blurred shooting interface, and when the user clicks on the shooting control on the blurred shooting interface.
[0007] In some optional instances, the first operation may be clicking a video shooting control in a camera application, or may be clicking a video shooting control in other applications with a video shooting function.
[0008] It can be understood that the clarity of the first real scene area is higher than that of the first blurred area, the clarity of the second real scene area is higher than that of the second blurred area, and the clarity of the third real scene area is higher than that of the third blurred area.
[0009] In a possible implementation of the first aspect, the defocused shooting interface includes a plurality of defocused shape controls; and displaying the defocused shooting interface includes: in response to a user selecting a first defocused shape control, displaying the defocused shooting interface, wherein the shapes of the first real scene area, the second real scene area, and the third real scene area correspond to the first defocused shape corresponding to the first defocused shape control. For example, the shapes of the first real scene area, the second real scene area, and the third real scene area are the same as the first defocused shape.
[0010] In some optional instances, when the user opens a camera application, such as clicking on the camera control on the main interface of the electronic device, the main interface switches to a blur shooting interface. The blur shooting interface can display multiple blur shape controls, such as a circular blur shape control, a rectangular blur shape control, a square blur shape control, a regular polygon blur shape control, and other blur shape controls corresponding to regular or irregular shapes.
[0011] In some optional instances, the user selecting the first blur shape control may refer to the user clicking on any one of the multiple blur shape controls displayed on the blur shooting interface, which is also referred to as the second trigger operation hereinafter.
[0012] In the embodiment of the present application, by pre-setting a variety of blur shape controls in the blur shooting interface for users to choose from, the diversity of picture blur or image blur can be enriched.
[0013] In a possible implementation of the first aspect, the shapes of the first real scene area, the second real scene area, and the third real scene area correspond to a default second blurred shape.
[0014] In some optional instances, the second blur shape can be a pre-set default blur shape. When the user opens a camera application, such as clicking on the camera control on the main interface of the electronic device, the main interface switches to a blur shooting interface. The blur shooting interface can blur the picture or image based on the pre-set default blur shape.
[0015] In the embodiment of the present application, by presetting a default blur shape, the picture or image can be directly blurred with the default blur shape after entering the blur shooting interface, which can improve the blur processing efficiency.
[0016] In a possible implementation of the first aspect described above, the multiple blur shape controls include at least one of the following: a circular blur shape control, a rectangular blur shape control, a square blur shape control, and a regular polygon blur shape control.
[0017] In a possible implementation of the first aspect above, a blurred shooting interface is displayed, including at least one of the following: the first real scene area is a real scene area manually selected by a user, and the first blurred area is a blurred area manually selected by the user; the second real scene area is a real scene area manually selected by the user, and the second blurred area is a blurred area manually selected by the user; the third real scene area is a real scene area manually selected by the user, and the third blurred area is a blurred area manually selected by the user.
[0018] In some optional examples, when the user clicks on any one of the multiple blur shape controls displayed on the blur shooting interface, the user can manually select a real scene area and / or a blur area in the area corresponding to the real scene environment on the blur shooting interface. For example, when the user clicks on a circular blur shape control on the blur shooting interface, a circle or a square can be manually drawn in the area corresponding to the real scene environment on the blur shooting interface, so that the electronic device can determine a circular real scene area and / or a circular blur area based on the selected circular blur shape control and the area where the circle or square is manually drawn. The real scene area is also referred to as a clear area or a non-blurred area hereinafter.
[0019] In a possible implementation of the first aspect above, the first real scene area is an automatically selected real scene area, and the first blurred area is an automatically selected blurred area; the second real scene area is an automatically selected real scene area, and the second blurred area is an automatically selected blurred area; the third real scene area is an automatically selected real scene area, and the third blurred area is an automatically selected blurred area.
[0020] In some optional examples, the first real scene area, the second real scene area, and the third real scene area may all refer to areas where preset objects are located in the blurred image. The preset objects may refer to people, animals, plants, etc. in the real scene environment, and the preset objects may also be referred to as shooting subjects. Generally, the subject may be determined based on the area where the user touches the blurred shooting interface to achieve focus, or the subject may be determined by the target detection function of the electronic device.
[0021] For example, when the preset object is a dog in a real-scene environment, the dog is in the upper left corner area of the virtual shooting interface of the electronic device, then the first real scene area, the second real scene area, and the third real scene area can all be the upper left corner area of the virtual image. When the dog is in the upper right corner area of the virtual shooting interface of the electronic device, then the first real scene area, the second real scene area, and the third real scene area can all be the upper right corner area of the virtual image. That is, the position of the real scene area in the virtual image is not fixed, and can change with the change of the position of the preset object in the virtual shooting interface.
[0022] In some optional examples, the first real scene area, the second real scene area, and the third real scene area may all be the area where the preset object is located and the surrounding area within a preset range of the area where the preset object is located. The surrounding area may refer to an area surrounding the area where the preset object is located. The area of the area where the preset object is located and the surrounding area within the preset range of the area where the preset object is located is greater than the area of the area where the preset object is located.
[0023] In some optional examples, the first real scene area, the second real scene area, and the third real scene area can all be preset areas. For example, when a user holds an electronic device to shoot a real scene environment, the middle area on the virtual shooting interface can be the area corresponding to the first real scene area, the second real scene area, and the third real scene area. That is, the position of the real scene area in the virtual image is fixed and does not change with the change of the position of the preset object in the virtual shooting interface. In this process, in order to achieve the correspondence between the real scene area and the area where the preset object is located, the electronic device can be moved to correspond the area where the preset object is located with the position of the real scene area.
[0024] In a possible implementation of the first aspect above, a blurred preview screen is generated in the following manner: a first screen, a second screen, and a third screen captured by an electronic device are obtained, wherein the clarity of the first screen is higher than that of the second screen, and the clarity of the second screen is higher than that of the third screen; a first area to be stitched, a second area to be stitched, and a third area to be stitched are respectively cropped out from the first screen, the second screen, and the third screen, wherein the first area to be stitched has the same size and corresponding position as the first real scene area, and the area to be stitched after the second area to be stitched and the third area to be stitched are merged has the same size and corresponding position as the first blurred area; the first area to be stitched, the second area to be stitched, and the third area to be stitched are merged to generate a blurred preview screen, wherein the second area to be stitched is located between the first area to be stitched and the third area to be stitched.
[0025] In a possible implementation of the first aspect, a fuzzy parameter corresponding to the second area to be stitched is smaller than a fuzzy parameter corresponding to the third area to be stitched.
[0026] For example, the preset fuzzy parameters may include a first fuzzy parameter (such as S n1 ), the second fuzzy parameter (such as S n2 ) and the third fuzzy parameter (such as S n3 ), where the first fuzzy parameter can be 0, and the second fuzzy parameter is less than the third fuzzy parameter, that is, S n1 <S n2 <S n3 Based on the preset blur parameters, multiple frames can be obtained, for example, a first frame a, a second frame b and a third frame c, the clarity of the first frame a is higher than that of the second frame b, and the clarity of the second frame b is higher than that of the third frame c. Then, a blurred preview frame can be generated based on the first frame a, the second frame b and the third frame c.
[0027] In a possible implementation of the first aspect above, a blurred captured image is generated in the following manner: a first image, a second image, and a third image captured by an electronic device are acquired, wherein the clarity of the first image is higher than that of the second image, and the clarity of the second image is higher than that of the third image; a first area to be stitched, a second area to be stitched, and a third area to be stitched are respectively cropped out from the first image, the second image, and the third image, wherein the first area to be stitched has the same size and corresponding position as the second real scene area, and the area to be stitched after the second area to be stitched and the third area to be stitched are merged has the same size and corresponding position as the second blurred area; the first area to be stitched, the second area to be stitched, and the third area to be stitched are merged to generate a blurred captured image, wherein the second area to be stitched is located between the first area to be stitched and the third area to be stitched.
[0028] In a possible implementation of the first aspect above, the first image, the second image and the third image are captured in the following manner: the camera of the electronic device is controlled to shoot the first image using the first preset aperture parameter; the camera of the electronic device is controlled to shoot the second image using the second preset aperture parameter; the camera of the electronic device is controlled to shoot the third image using the third preset aperture parameter.
[0029] For example, the preset aperture parameters include a first preset aperture parameter (such as f1.0), a second preset aperture parameter (such as f2.0) and a third preset aperture parameter (such as f4.0), and the multiple frames of images acquired based on the blurred shape include a first image a, a second image b and a third image c, the clarity of the first image a is higher than the clarity of the second image b, and the clarity of the second image b is higher than the clarity of the third image c.
[0030] In a possible implementation of the first aspect, corresponding to the first operation of opening a camera application, the blurred shooting interface displayed is a blurred preview screen.
[0031] In a possible implementation of the first aspect above, corresponding to the first operation being triggering a video shooting control in a camera application, the displayed blurred shooting interface is a blurred video screen.
[0032] In a second aspect, the present application provides an electronic device, comprising: a memory for storing instructions executed by one or more processors of the electronic device, and a processor, which is one of the one or more processors of the electronic device, for executing the shooting method mentioned in the present application.
[0033] In a third aspect, the present application provides a readable storage medium, on which instructions are stored. When the instructions are executed on an electronic device, the electronic device executes the shooting method mentioned in the present application. BRIEF DESCRIPTION OF THE DRAWINGS
[0034] Figure 1 According to some examples of the present application, a schematic diagram of obtaining a blurred image using photo editing software is shown;
[0035] Figure 2 According to some examples of the present application, a schematic diagram of blurring an area where a preset object is located is shown;
[0036] Figure 3 According to some examples of the present application, a schematic diagram of blurring an area where a preset object is located and surrounding areas within a preset range of the area where the preset object is located is shown;
[0037] Figure 4 According to some examples of the present application, a schematic diagram of splicing a clear area and a blurred area into a blurred image is shown;
[0038] Figure 5According to some examples of the present application, a schematic diagram of splicing a clear area, a transition area, and a blurred area into a blurred image is shown;
[0039] Figure 6 According to some examples of the present application, a flow chart of a method for obtaining a blurred image is shown;
[0040] Figure 7 According to some examples of the present application, a schematic diagram of an interface of a shooting method is shown;
[0041] Figure 8 According to some examples of the present application, a schematic diagram of a framework for obtaining a blurred image is shown;
[0042] Fig. 9 According to some examples of the present application, a schematic diagram of a process of obtaining a blurred image is shown;
[0043] Fig.10 According to some examples of the present application, a schematic diagram of performing rectangular blurring on a captured image is shown;
[0044] Fig.11 According to some examples of the present application, a schematic diagram of blurring a captured image into a square is shown;
[0045] Fig.12 According to some examples of the present application, a schematic diagram of blurring a captured image into a regular octagon is shown;
[0046] Fig.13 According to some examples of the present application, a schematic diagram of the hardware structure of an electronic device is shown. DETAILED DESCRIPTION
[0047] The illustrative embodiments of the present application include but are not limited to a photographing method, an electronic device, and a medium.
[0048] It can be understood that the shooting method provided in the embodiments of the present application can be executed by an electronic device. In practical applications, the electronic device can be any implementable mobile terminal such as a smart phone, a tablet computer, a smart wearable device or a personal digital assistant.
[0049] In order to solve the problem that electronic devices cannot directly shoot blurred images and cannot meet the needs of intelligent shooting, the embodiment of the present application provides a shooting method, which adds a blurred shooting function in the real-scene environment shooting application of the electronic device in advance. For example, a blurred shooting mode is added to the camera application. When a user uses an electronic device to shoot a real-scene environment, if a preset operation of the user on the electronic device is detected (such as a user triggering a blurred shape control among a plurality of blurred shape controls presented by the blurred shooting interface of the electronic device), the blurred shape corresponding to the preset operation is obtained, such as a circle, a rectangle, a square, a regular polygon, etc., and the preview screen captured is blurred based on the blurred shape to obtain a blurred preview screen, or when the user clicks to shoot, the captured image is blurred to obtain a blurred shot image. In the blurred preview screen or the blurred shot image and other blurred images, the shape of the clear area is the same as the blurred shape corresponding to the preset operation, and the remaining areas are blurred. In this way, the electronic device can directly shoot blurred images without using photo editing software, which can meet the needs of intelligent shooting.
[0050] In some optional instances, in a blurred image such as a blurred preview screen or a blurred captured image, an area outside a preset object or a preset area can be blurred so that the shape of the area where the preset object (such as a person, animal, plant, etc. in a real environment) is located or the shape of the preset area is the same as the blurred shape, and the clarity of the area where the preset object is located or the clarity of the preset area is higher than the clarity of other areas in the blurred image.
[0051] For example, Figure 2 As shown, when the user clicks the camera control 211 on the main interface 210 of the electronic device 200, the electronic device 200 may display a blur shooting interface 220. The blur shooting interface 220 may display a blur shape control bar 221. When the user clicks the circular blur shape control 221-1 in the blur shape control bar 221, the area where the dog is located in the blur image (i.e., the clear area, also referred to as the non-blurred area) presents a circular blur shape, and the clarity of the area where the dog is located in the blur image is higher than the clarity of other areas (i.e., the blur area) in the blur image.
[0052] In other optional instances, in a blurred image such as a blurred preview screen or a blurred captured image, a preset object and an area within a preset range of the preset object can be blurred, so that the shape of the area where the preset object is located and the surrounding area within the preset range of the area where the preset object is located are the same as the blurred shape, and the clarity of the area where the preset object is located and the surrounding area within the preset range of the area where the preset object is located is higher than the clarity of other areas in the blurred image.
[0053] For example, Figure 3As shown, when the user clicks the camera control 311 on the main interface 310 of the electronic device 300, the electronic device 300 can display the blur shooting interface 320. Among them, the blur shooting interface 320 can display a blur shape control bar 321, and when the user clicks the circular blur shape control 321-1 in the blur shape control bar 321, the area where the dog is located in the blur image (such as the area 330 in the dotted circle frame in the figure) and the surrounding area within the preset range of the area where the dog is located (such as the area 340 between the solid circle frame and the dotted circle frame) are both circular blur shapes, and the clarity of the area where the dog is located in the blur image and the clarity of the surrounding area within the preset range of the area where the dog is located are higher than the clarity of other areas in the blur image.
[0054] It can be understood that the method of obtaining the blurred image based on the blurred shape may include acquiring multiple frames of candidate pictures or multiple frames of candidate images based on the blurred shape, and acquiring the blurred image based on the multiple frames of candidate pictures or multiple frames of candidate images.
[0055] It can be understood that in some optional instances, the method of obtaining multiple candidate frames or multiple candidate images based on the blurred shape can be: when generating a blurred shot image, multiple candidate images can be generated based on multiple different preset aperture parameters corresponding to the blurred shape. The larger the preset aperture parameter, the lower the clarity of the obtained candidate image. When generating a blurred preview image, multiple candidate frames can be generated based on multiple different preset blur parameters corresponding to the blurred shape. The larger the preset blur parameter, the lower the clarity of the obtained candidate image.
[0056] It can be understood that in some optional examples, the method of obtaining a blurred image based on multiple candidate frames or multiple candidate images can be: obtaining a region to be spliced from each candidate frame or candidate image based on the blurred shape, and splicing the regions to be spliced obtained from each candidate frame or candidate image to obtain a blurred image. For example, an area with the same corresponding position as the area where the preset object is located can be selected from a candidate frame or candidate image with high definition as the region to be spliced corresponding to the clear area, and an area with the same corresponding position as other areas can be selected from a candidate frame or candidate image with low definition as the region to be spliced corresponding to the blurred area.
[0057] For example, Figure 4 As shown, when the blurred shape corresponding to the blurred shape control is a circle, the preset aperture parameters include a first preset aperture parameter (such as f1.0) and a second preset aperture parameter (such as f2.0), and the multiple candidate images obtained based on the blurred shape include a first image a and a second image b. The clarity of the first image a is higher than that of the second image b, and the image contents of the first image a and the second image b are the same. A clear area 401 is obtained from the first image a as the area to be stitched, and a blurred area 402 is obtained from the second image b as the area to be stitched, and a Figure 4 It can be seen that the position, area and shape of the area to be stitched obtained from the first image a in the first image a are the same as the position, area and shape of the area where the object is located in the blurred image c, and the inner edge of the area to be stitched 402 obtained from the second image b coincides with the outer edge of the area to be stitched 401 obtained from the first image a.
[0058] For example, Figure 5 As shown, when the blurred shape corresponding to the blurred shape control is a circle, the preset aperture parameters include a first preset aperture parameter (such as f1.0), a second preset aperture parameter (such as f2.0) and a third preset aperture parameter (such as f4.0), and the multiple candidate images obtained based on the blurred shape include a first image a, a second image b and a third image c, the clarity of the first image a is higher than that of the second image b, the clarity of the second image b is higher than that of the third image c, and the image contents of the first image a, the second image b and the third image c are the same. A clear area 501 is obtained from the first image a as the area to be stitched, a slightly blurred area 502 is obtained from the second image b as the area to be stitched, and a heavily blurred area 503 is obtained from the third image as the area to be stitched, and a clear area 501 is obtained from the first image a as the area to be stitched, a slightly blurred area 502 is obtained from the second image b as the area to be stitched, and a heavily blurred area 503 is obtained from the third image as the area to be stitched, and a slightly blurred area 504 is obtained from the third image as the area to be stitched. Figure 5 It can be seen that the position, area, and shape of the area to be stitched 501 obtained from the first image a in the first image a are the same as the position, area, and shape of the area where the object is located in the blurred image d. The inner edge of the area to be stitched 502 obtained from the second image b coincides with the outer edge of the area to be stitched obtained from the first image a, and the inner edge of the area to be stitched 503 obtained from the third image c coincides with the outer edge of the area to be stitched obtained from the second image b.
[0059] The following is an introduction to the shooting method mentioned in the embodiments of the present application. Figure 6 The present invention is a flowchart of a shooting method, which can be performed by an electronic device. In practical applications, the electronic device can be any implementable electronic device such as a smart phone, a tablet computer, a smart watch or a personal digital assistant. Figure 6 As shown, the shooting method may include:
[0060] 601: When a first trigger operation of the user is detected, a blur shooting interface is displayed.
[0061] In some optional examples, the first trigger operation may be to trigger the start of a shooting function. Figure 7A main interface 710 of an electronic device 700 is shown, and the main interface 710 may include a camera control 711. If it is detected that a user holds the electronic device to shoot a real scene environment and the shooting function is started, that is, it is detected that the user clicks the camera control 711 on the main interface 710, a defocused shooting interface 720 may be displayed on the main interface 710 of the electronic device, and a shooting control 721 and a plurality of defocused shape controls (such as 722-1 to 722-4) may be presented on the defocused shooting interface 720, such as a circular defocused shape control 722-1, a rectangular defocused shape control 722-2, a square defocused shape control 722-3, a regular polygonal defocused shape control 722-4, and other regular or irregular shapes.
[0062] 602: When a second trigger operation of the user is detected, a blurred shape corresponding to the second trigger operation is obtained.
[0063] It can be understood that the second trigger operation can be triggering a type of blur shape control (such as 722-1 to 722-4) presented by the blur shooting interface 720 of the electronic device, pressing the lock screen key of the electronic device, double-clicking the blur shooting interface of the electronic device, etc., which is not specifically limited in the embodiment of the present application. Figure 7 As shown, when the electronic device detects that the user triggers the circular blurred shape control 722-1 presented by the blurred shooting interface 720 of the electronic device, the circular blurred shape can be obtained.
[0064] In some optional examples, the virtualized shape corresponding to the second trigger operation may include regular or irregular shapes such as circles, rectangles, squares, regular polygons, etc., which are not specifically limited in the embodiments of the present application.
[0065] In some optional instances, the correspondence between the second trigger operation and the blurred shape may be preset. For example, the second trigger operation is a user triggering the circular blurred shape control 722-1 presented by the blurred shooting interface 720 of the electronic device, and the blurred shape corresponding to the second trigger operation is a circle. The second trigger operation is a user triggering the rectangular blurred shape control 722-2 presented by the blurred shooting interface 720 of the electronic device, and the blurred shape corresponding to the second trigger operation is a rectangle. The second trigger operation is a user pressing the lock screen key of the electronic device twice in a row, and the blurred shape corresponding to the second trigger operation is a circle. The second trigger operation is a user pressing the lock screen key of the electronic device three times in a row, and the blurred shape corresponding to the second trigger operation is a rectangle.
[0066] 603: blurring the captured image based on the blurred shape to obtain a blurred image, wherein the shape of the clear area in the blurred image is the same as the blurred shape.
[0067] In some embodiments, the blurred image may include a blurred preview screen, a blurred captured image, and a blurred video screen.
[0068] It can be understood that in the scenario of generating a blurred image, for example, when a user holds an electronic device to shoot a real scene and activates the shooting function to shoot, if the user clicks Figure 7 When the shooting control 721 in the blurred shooting interface 720 is used, the shot image can be blurred based on the blurred shape to obtain a blurred image.
[0069] In the scenario of generating a blurred preview screen, for example, when a user holds an electronic device to shoot a real scene environment but does not start the shooting function to shoot, if the user does not click Figure 7 When the shooting control 721 in the blur shooting interface 720 is used, the preview screen can be blurred based on the blur shape to obtain a blurred image. In the scenario of generating a blurred video screen, for example, when a user holds an electronic device to record a real scene, if the user clicks Figure 7 When the shooting control 721 in the blur shooting interface 720 is shown, the shot image can be blurred based on the blur shape to obtain a blurred image. The specific method of blurring the shot image or the preview screen based on the blur shape to obtain a blurred image is as follows: Figure 8 and 9 Described in detail in.
[0070] In some optional instances, the clear area in the blurred image is also referred to as the real scene area above. The clear area may be an area manually selected by the user, and the blurred area may also be an area manually selected by the user. Specifically, when the user clicks on any one of the blurred shape controls on the blurred shooting interface 720, the real scene area and / or the blurred area may be manually selected in the area corresponding to the real scene environment on the blurred shooting interface. For example, when the user clicks on the circular blurred shape control on the blurred shooting interface, a circle or square may be manually drawn in the area corresponding to the real scene environment on the blurred shooting interface, so that the electronic device can determine the circular real scene area and / or the circular blurred area according to the selected circular blurred shape control and the area where the circle or square is drawn.
[0071] In some optional examples, the clear area may be an automatically selected area, and the blurred area may also be an automatically selected area.
[0072] In some optional examples, the clear area in the blurred image can be the area of the preset object (such as a person, animal, plant, etc.) in the real scene environment in the blurred image, which can also be called the area where the object is located in the blurred image, and can also be called the area where the shooting subject is located. In general, the subject can be determined based on the area where the user touches the blurred shooting interface to achieve focus, or the subject can be determined by the target detection function of the electronic device. The clear area in the blurred image can also be a preset area in the real scene environment.
[0073] For example, when the preset object is a dog in a real scene environment, the dog is in the upper left corner area of the blurred shooting interface of the electronic device, then the clear area can be the upper left corner area of the blurred image. When the dog in the real environment is in the upper right corner area of the blurred shooting interface of the electronic device, then the clear area can be the upper right corner area of the blurred image. That is, the position of the clear area in the blurred image is not fixed, and can change with the change of the position of the preset object in the blurred shooting interface.
[0074] In some other optional examples, the clear area in the blurred image may include the area of the object in the real environment in the blurred image and the area of the surrounding environment of the object in the blurred image, which may also be referred to as the area where the object is located in the blurred image and the surrounding area where the object is located. For example, when a user uses an electronic device to shoot the real environment, the middle area of the real environment on the blurred shooting interface may be a clear area. That is, the position of the clear area in the blurred image is fixed and does not change with the change of the position of the preset object in the blurred shooting interface. In this process, in order to achieve the correspondence between the clear area and the area where the preset object is located, the electronic device can be moved to correspond the area where the preset object is located with the position of the clear area.
[0075] In an embodiment of the present application, when a user uses an electronic device to shoot a real scene environment, a blurred shot image or a blurred preview screen or other blurred images is directly generated. That is, the electronic device can directly shoot a blurred image without the use of photo editing software, thereby meeting the needs of intelligent shooting.
[0076] The specific method of blurring the captured image or the preview screen based on the blurred shape to obtain the blurred image is described in detail below.
[0077] Figure 8 FIG. 1 shows a schematic diagram of a framework for obtaining a blurred image. Figure 8 As shown, when it is detected that the user triggers the blur shooting function, a portion of the multiple frames of images obtained by shooting is blurred based on multiple preset blur parameters to obtain multiple frames of mask images, and then the clear area, transition area and blur area can be obtained from each mask image, and the clear area, transition area and blur area are spliced to obtain a blur preview screen. It is also possible to shoot multiple frames of mask images based on different preset aperture parameters of a camera with a variable aperture installed in an electronic device after detecting that the user triggers the blur shooting function, and then the clear area, transition area and blur area can be obtained from each mask image, and the clear area, transition area and blur area are spliced to obtain a blur shooting image.
[0078] Fig. 9 A schematic flow chart of a method for acquiring a blurred image is shown, and the acquisition method can be executed by an electronic device, such as Fig. 9 As shown, the acquisition method may include:
[0079] 901: Acquire multiple candidate image frames based on the blurred shape, wherein the clarity of each candidate image in the multiple candidate image frames is different.
[0080] It can be understood that multiple frames of candidate images can be obtained based on multiple preset aperture parameters corresponding to the blurred shape, wherein the smaller the preset aperture parameter, the higher the clarity of the obtained image, and the larger the preset aperture parameter, the lower the clarity of the obtained image. The candidate image can be the mask image mentioned above, i.e., the Mask image.
[0081] In some optional examples, the aperture parameter of the camera with a variable aperture installed in the electronic device is a first preset aperture parameter F n1 The first image is acquired when the aperture parameter is the second preset aperture parameter F n2 The first preset aperture parameter is smaller than the second preset aperture, that is, F n1 <F n2 , the clarity of the first image is higher than the clarity of the second image.
[0082] In some optional examples, the aperture parameter of the camera with a variable aperture installed in the electronic device is a first preset aperture parameter F n1 The first image is acquired when the aperture parameter is the second preset aperture parameter F n2 The second image is acquired when the aperture parameter is the third preset aperture parameter F n3 The first preset aperture parameter is smaller than the second preset aperture parameter, and the second preset aperture parameter is smaller than the third preset aperture parameter, that is, F n1 <F n2 <F n3 , the clarity of the first image is higher than that of the second image, and the clarity of the second image is higher than that of the third image.
[0083] It can be understood that multiple frames of candidate images can be obtained based on multiple preset blur parameters corresponding to the blurred shapes, wherein the smaller the blur parameter, the higher the clarity of the obtained image, and the larger the blur parameter, the lower the clarity of the obtained image.
[0084] In some optional examples, the first blur parameter S corresponding to the blurred shape may be n1 Obtain the first image, based on the second blur parameter S corresponding to the blurred shape n2 A second image is acquired, wherein the first blur parameter may be 0, the second blur parameter may be non-zero, and the clarity of the first image is higher than that of the second image.
[0085] In some optional examples, the first blur parameter S corresponding to the blurred shape may be n1Obtain the first image, based on the second blur parameter S corresponding to the blurred shape n2 Obtain the second image, based on the third blur parameter S corresponding to the blurred shape n3 The third image is obtained. The first fuzzy parameter can be 0, and the second fuzzy parameter is less than the third fuzzy parameter, that is, S n1 <S n2 <S n3 , the clarity of the first image is higher than that of the second image, and the clarity of the second image is higher than that of the third image.
[0086] In the embodiment of the present application, the candidate images can also be obtained when the aperture parameters of the camera with a variable aperture installed in the electronic device are other preset aperture parameters, that is, the number of candidate images in the multiple-frame candidate images is not specifically limited in the embodiment of the present application. The above-mentioned first image and second image as multiple-frame candidate images, and the first image, second image and third image as multiple-frame candidate images are only some examples listed in the embodiment of the present application, and do not represent all examples. Similarly, the candidate images can also be obtained based on other blur parameters corresponding to the blurred shape, which will not be repeated here.
[0087] 902: Obtain a blurred image based on multiple frames of candidate images.
[0088] It can be understood that the method of obtaining the blurred image based on multiple frames of candidate images is to obtain the area to be stitched from each candidate image to obtain multiple areas to be stitched, and then each area to be stitched in the multiple areas to be stitched can be stitched to obtain the blurred image.
[0089] like Figure 4 As shown, in some optional examples, when the multiple candidate images include the first image a and the second image b mentioned above, the first area to be stitched 401 can be obtained from the first image a, and the second area to be stitched 402 can be obtained from the second image b. Then, the first area to be stitched 401 and the second area to be stitched 402 can be stitched together to obtain a blurred image c.
[0090] Among them, the position, area, and shape of the first area to be stitched 401 in the first image a are the same as the position, area, and shape of the clear area in the blurred image c. The outer edge of the first area to be stitched 401 coincides with the inner edge of the second area to be stitched 402. The first area to be stitched 401 can be called a clear area, and the second area to be stitched 402 can be called a blurred area.
[0091] In an embodiment of the present application, a blurred image is obtained by taking the first image and the second image as candidate images and splicing the clear area obtained from the first image and the blurred area obtained from the second image. This can reduce the number of generated images and the amount of data processing by the electronic device in the process of directly shooting the blurred image.
[0092] like Figure 5 As shown, in some optional examples, when the multiple candidate images include the first image a, the second image b and the third image c mentioned above, the first region to be stitched 501 can be obtained from the first image a, the second region to be stitched 502 can be obtained from the second image b, and the third region to be stitched 503 can be obtained from the third image c. Then the first region to be stitched 501, the second region to be stitched 502 and the third region to be stitched 503 can be stitched together to obtain a blurred image d. Among them, the position, area and shape of the first region to be stitched 501 in the first image a are the same as the position, area and shape of the clear region in the blurred image d. The outer edge of the first region to be stitched 501 coincides with the inner edge of the second region to be stitched 502, and the outer edge of the second region to be stitched 502 coincides with the inner edge of the third region to be stitched 503. The first region to be stitched 501 can be called a clear area, the second region to be stitched 502 can be called a transition area, and the third region to be stitched 503 can be called a blurred area.
[0093] In an embodiment of the present application, a blurred image is obtained by taking the first image, the second image and the third image as candidate images, and splicing the clear area obtained from the first image, the transition area obtained from the second image and the blurred area obtained from the third image. In the process of directly shooting the blurred image, the transition area can be inserted between the clear area and the blurred area, which can avoid the blurred image directly crossing from the clear area to the blurred area, and can improve the blurring effect of the blurred image.
[0094] The method for obtaining a blurred image is further described below by taking the example of generating a blurred captured image by performing rectangular blurring on a captured image based on a blurred shape.
[0095] like Fig.10As shown, when the aperture parameter of the camera with a variable aperture installed in the electronic device is the first preset aperture parameter, the first image is obtained, when the aperture parameter is the second preset aperture parameter, the second image is obtained, and when the aperture parameter is the third preset aperture parameter, the third image is obtained. Then, the first area to be spliced 1001 can be obtained from the first image, the second area to be spliced 1002 can be obtained from the second image, and the third area to be spliced 1003 can be obtained from the third image. Then, the first area to be spliced 1001, the second area to be spliced 1002 and the third area to be spliced 1003 can be spliced to obtain a blurred image. Among them, the position, area and shape of the first area to be spliced 1001 in the first image are the same as the position, area and shape of the clear area in the blurred image, the outer edge of the first area to be spliced 1001 coincides with the inner edge of the second area to be spliced 1002, and the outer edge of the second area to be spliced 1002 coincides with the inner edge of the third area to be spliced 1003. The first area to be spliced 1001 may be referred to as a clear area, the second area to be spliced 1002 may be referred to as a transition area, and the third area to be spliced 1003 may be referred to as a blur area.
[0096] The following takes the example of generating a blurred captured image by blurring a captured image into a square shape based on a blurred shape as an example to describe in detail the method for obtaining a blurred image.
[0097] like Fig.11 As shown, when the aperture parameter of the camera with a variable aperture installed in the electronic device is the first preset aperture parameter, the first image is obtained, when the aperture parameter is the second preset aperture parameter, the second image is obtained, and when the aperture parameter is the third preset aperture parameter, the third image is obtained. Then, the first area to be stitched 1101 can be obtained from the first image, the second area to be stitched 1102 can be obtained from the second image, and the third area to be stitched 1103 can be obtained from the third image. Then, the first area to be stitched 1101, the second area to be stitched 1102 and the third area to be stitched 1103 can be stitched together to obtain a blurred image. Among them, the position, area and shape of the first area to be stitched 1101 in the first image are the same as the position, area and shape of the clear area in the blurred image, the outer edge of the first area to be stitched 1101 coincides with the inner edge of the second area to be stitched 1102, and the outer edge of the second area to be stitched 1102 coincides with the inner edge of the third area to be stitched 1003. The first area to be spliced 1101 may be referred to as a clear area, the second area to be spliced 1102 may be referred to as a transition area, and the third area to be spliced 1103 may be referred to as a blur area.
[0098] The following describes in detail a method for obtaining a blurred image by blurring a captured image into a regular octagon based on a blurred shape as an example.
[0099] like Fig.12As shown, when the aperture parameter of the camera with a variable aperture installed in the electronic device is the first preset aperture parameter, the first image is obtained, when the aperture parameter is the second preset aperture parameter, the second image is obtained, and when the aperture parameter is the third preset aperture parameter, the third image is obtained. Then, the first area to be stitched 1201 can be obtained from the first image, the second area to be stitched 1202 can be obtained from the second image, and the third area to be stitched 1203 can be obtained from the third image. Then, the first area to be stitched 1201, the second area to be stitched 1202 and the third area to be stitched 1203 can be stitched together to obtain a blurred image. Among them, the position, area and shape of the first area to be stitched 1201 in the first image are the same as the position, area and shape of the clear area in the blurred image, the outer edge of the first area to be stitched 1201 coincides with the inner edge of the second area to be stitched 1202, and the outer edge of the second area to be stitched 1202 coincides with the inner edge of the third area to be stitched 1203. . The first area to be spliced 1201 may be referred to as a clear area, the second area to be spliced 1202 may be referred to as a transition area, and the third area to be spliced 1203 may be referred to as a blur area.
[0100] The various embodiments of the mechanism disclosed in the present application can be implemented in hardware, software, firmware or a combination of these implementation methods. The embodiments of the present application can be implemented as a computer program or program code executed on a programmable system, which includes at least one processor, a storage system (including volatile and non-volatile memory and / or storage elements), at least one input device and at least one output device.
[0101] Program code can be applied to input instructions to perform the functions described in this application and generate output information. The output information can be applied to one or more output devices in a known manner. For the purposes of this application, a processing system includes any system having a processor such as, for example, a digital signal processor (DSP), a microcontroller, an application specific integrated circuit, or a microprocessor.
[0102] Program code can be implemented with high-level programming language or object-oriented programming language to communicate with the processing system. When necessary, program code can also be implemented with assembly language or machine language. In fact, the mechanism described in this application is not limited to the scope of any specific programming language. In either case, the language can be a compiled language or an interpreted language.
[0103] In some cases, the disclosed embodiments may be implemented in hardware, firmware, software, or any combination thereof. The disclosed embodiments may also be implemented as instructions carried or stored on one or more temporary or non-temporary machine-readable (e.g., computer-readable) storage media, which may be read and executed by one or more processors. For example, the instructions may be distributed over a network or through other computer-readable media. Therefore, machine-readable media may include any mechanism for storing or transmitting information in a form readable by a machine (e.g., a computer), including, but not limited to, floppy disks, optical disks, optical discs, read-only memories (CD-ROMs), magneto-optical disks, read-only memories (ROMs), random access memories (RAMs), erasable programmable read-only memories (EPROMs), electrically erasable programmable read-only memories (EEPROMs), magnetic or optical cards, flash memory, or a tangible machine-readable memory for transmitting information (e.g., carrier waves, infrared signals, digital signals, etc.) using the Internet in electrical, optical, acoustic, or other forms of propagation signals. Therefore, machine-readable media include any type of machine-readable media suitable for storing or transmitting electronic instructions or information in a form readable by a machine (e.g., a computer).
[0104] The following is an introduction to the hardware structure of electronic equipment. Fig.13 As shown, the electronic device 1300 may include a processor 1310, an external memory interface 1320, an internal memory 1321, a universal serial bus (USB) interface 1330, a charging management module 1340, a power management module 1341, a battery 1342, an antenna 1, an antenna 2, a mobile communication module 1350, a wireless communication module 1360, an audio module 1370, a speaker 1370A, a receiver 1370B, a microphone 1370C, an earphone interface 1370D, a sensor module 1380, a button 1390, a motor 1391, an indicator 1392, a camera 1393, a display screen 1394, and a subscriber identification module (SIM) card interface 1395, etc. The sensor module 1380 may include a pressure sensor 1380A, a gyroscope sensor 1380B, an air pressure sensor 1380C, a magnetic sensor 1380D, an acceleration sensor 1380E, a distance sensor 1380F, a proximity light sensor 1380G, a fingerprint sensor 1380H, a temperature sensor 1380J, a touch sensor 1380K, an ambient light sensor 1380L, a bone conduction sensor 1380M, and the like.
[0105] It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device. In other embodiments of the present application, the electronic device 1300 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.
[0106] The processor 1310 may include one or more processing units, for example, the processor 1310 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.
[0107] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.
[0108] The processor 1310 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 1310 is a cache memory. The memory may store instructions or data that the processor 1310 has just used or cyclically used. If the processor 1310 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 1310, and thus improves the efficiency of the system.
[0109] In some embodiments, the processor 1310 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.
[0110] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 1310 may include multiple groups of I2C buses. The processor 1310 may be coupled to the touch sensor 1380K, the charger, the flash, the camera 1393, etc. through different I2C bus interfaces. For example: the processor 1310 may be coupled to the touch sensor 1380K through the I2C interface, so that the processor 1310 communicates with the touch sensor 1380K through the I2C bus interface, thereby realizing the touch function of the electronic device 1300.
[0111] The I2S interface can be used for audio communication. In some embodiments, the processor 1310 can include multiple groups of I2S buses. The processor 1310 can be coupled to the audio module 1370 via the I2S bus to achieve communication between the processor 1310 and the audio module 1370. In some embodiments, the audio module 1370 can transmit an audio signal to the wireless communication module 1360 via the I2S interface to achieve the function of answering a call through a Bluetooth headset.
[0112] The PCM interface can also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 1370 and the wireless communication module 1360 can be coupled via the PCM bus interface. In some embodiments, the audio module 1370 can also transmit audio signals to the wireless communication module 1360 via the PCM interface to realize the function of answering calls via a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.
[0113] The UART interface is a universal serial data bus for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor 1310 and the wireless communication module 1360. For example, the processor 1310 communicates with the Bluetooth module in the wireless communication module 1360 through the UART interface to implement the Bluetooth function. In some embodiments, the audio module 1370 can transmit an audio signal to the wireless communication module 1360 through the UART interface to implement the function of playing music through a Bluetooth headset.
[0114] The MIPI interface can be used to connect the processor 1310 with peripheral devices such as the display screen 1394 and the camera 1393. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. In some embodiments, the processor 1310 and the camera 1393 communicate via the CSI interface to implement the shooting function of the electronic device 1300. The processor 1310 and the display screen 1394 communicate via the DSI interface to implement the display function of the electronic device 1300.
[0115] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 1310 with the camera 1393, the display 1394, the wireless communication module 1360, the audio module 1370, the sensor module 1380, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.
[0116] The USB interface 1330 is an interface that complies with the USB standard specification, and specifically can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 1330 can be used to connect a charger to charge the electronic device 1300, and can also be used to transfer data between the electronic device 1300 and a peripheral device. It can also be used to connect headphones to play audio through the headphones. The interface can also be used to connect other electronic devices, such as AR devices, etc.
[0117] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present invention is only a schematic illustration and does not constitute a structural limitation on the electronic device 1300. In other embodiments of the present application, the electronic device 1300 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.
[0118] The charging management module 1340 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 1340 may receive charging input from a wired charger through the USB interface 1330. In some wireless charging embodiments, the charging management module 1340 may receive wireless charging input through a wireless charging coil of the electronic device 1300. While the charging management module 1340 is charging the battery 1342, it may also power the electronic device through the power management module 1341.
[0119] The power management module 1341 is used to connect the battery 1342, the charging management module 1340 and the processor 1310. The power management module 1341 receives input from the battery 1342 and / or the charging management module 1340, and supplies power to the processor 1310, the internal memory 1321, the display screen 1394, the camera 1393, and the wireless communication module 1360. The power management module 1341 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 1341 can also be set in the processor 1310. In other embodiments, the power management module 1341 and the charging management module 1340 can also be set in the same device.
[0120] The wireless communication function of the electronic device 1300 can be implemented through antenna 1, antenna 2, mobile communication module 1350, wireless communication module 1360, modem processor and baseband processor.
[0121] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 1300 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.
[0122] The mobile communication module 1350 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the electronic device 1300. The mobile communication module 1350 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 1350 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 1350 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 1350 can be set in the processor 1310. In some embodiments, at least some of the functional modules of the mobile communication module 1350 can be set in the same device as at least some of the modules of the processor 1310.
[0123] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 1370A, a receiver 1370B, etc.), or displays an image or video through a display screen 1134. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 1310 and be set in the same device as the mobile communication module 1350 or other functional modules.
[0124] The wireless communication module 1360 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 1300. The wireless communication module 1360 can be one or more devices integrating at least one communication processing module. The wireless communication module 1360 receives electromagnetic waves via antenna 2, modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 1310. The wireless communication module 1360 can also receive the signal to be sent from the processor 1310, modulate the frequency, amplify it, and convert it into electromagnetic waves for radiation through antenna 2.
[0125] In some embodiments, the antenna 1 of the electronic device 1300 is coupled to the mobile communication module 1350, and the antenna 2 is coupled to the wireless communication module 1360, so that the electronic device 1300 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).
[0126] The electronic device 1300 implements the display function through a GPU, a display screen 1394, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 1394 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 1310 may include one or more GPUs that execute program instructions to generate or change display information.
[0127] The display screen 1394 is used to display images, videos, etc. The display screen 1394 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light emitting diode (QLED), etc. In some embodiments, the electronic device 1300 may include 1 or N display screens 1394, where N is a positive integer greater than 1.
[0128] The electronic device 1300 can realize the shooting function through an ISP, a camera 1393, a video codec, a GPU, a display screen 1394, and an application processor.
[0129] ISP is used to process the data fed back by camera 1393. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to ISP for processing and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, ISP can be set in camera 1393.
[0130] The camera 1393 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 1300 may include 1 or N cameras 1393, where N is a positive integer greater than 1.
[0131] The digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the electronic device 1300 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.
[0132] Video codecs are used to compress or decompress digital videos. The electronic device 1300 may support one or more video codecs. Thus, the electronic device 1300 may play or record videos in a variety of coding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.
[0133] NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. Through NPU, applications such as intelligent cognition of electronic device 1300 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.
[0134] The external memory interface 1320 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 1300. The external memory card communicates with the processor 1310 through the external memory interface 1320 to implement a data storage function, such as storing music, video and other files in the external memory card.
[0135] The internal memory 1321 can be used to store computer executable program codes, which include instructions. The internal memory 1321 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 1300 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 1321 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 1310 executes various functional applications and data processing of the electronic device 1300 by running instructions stored in the internal memory 1321 and / or instructions stored in a memory provided in the processor.
[0136] The electronic device 1300 can implement audio functions such as music playing and recording through the audio module 1370, the speaker 1370A, the receiver 1370B, the microphone 1370C, the headphone jack 1370D, and the application processor.
[0137] The audio module 1370 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signal. The audio module 1370 can also be used to encode and decode audio signals. In some embodiments, the audio module 1370 can be arranged in the processor 1310, or some functional modules of the audio module 1370 can be arranged in the processor 1310.
[0138] The speaker 1370A, also called a "speaker", is used to convert an audio electrical signal into a sound signal. The electronic device 1300 can listen to music or listen to a hands-free call through the speaker 1370A.
[0139] The receiver 1370B, also called a "earpiece", is used to convert audio electrical signals into sound signals. When the electronic device 1300 receives a call or voice message, the voice can be received by placing the receiver 1370B close to the human ear.
[0140] Microphone 1370C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to the microphone 1370C to input the sound signal into the microphone 1370C. The electronic device 1300 can be provided with at least one microphone 1370C. In other embodiments, the electronic device 1300 can be provided with two microphones 1370C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 1300 can also be provided with three, four or more microphones 1370C to collect sound signals, reduce noise, identify the source of sound, realize directional recording function, etc.
[0141] The earphone interface 1370D is used to connect a wired earphone and can be a USB interface 1330 or a 3.5 mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.
[0142] The pressure sensor 1380A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 1380A can be set on the display screen 1394. There are many types of pressure sensors 1380A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. A capacitive pressure sensor can be a parallel plate including at least two conductive materials. When a force acts on the pressure sensor 1380A, the capacitance between the electrodes changes. The electronic device 1300 determines the intensity of the pressure based on the change in capacitance. When a touch operation acts on the display screen 1394, the electronic device 1300 detects the touch operation intensity according to the pressure sensor 1380A. The electronic device 1300 can also calculate the touch position according to the detection signal of the pressure sensor 1380A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, an instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to a first pressure threshold acts on the short message application icon, an instruction to create a new short message is executed.
[0143] The gyro sensor 1380B can be used to determine the motion posture of the electronic device 1300. In some embodiments, the angular velocity of the electronic device 1300 around three axes (i.e., x, y, and z axes) can be determined by the gyro sensor 1380B. The gyro sensor 1380B can be used for anti-shake shooting. For example, when the shutter is pressed, the gyro sensor 1380B detects the angle of the electronic device 1300 shaking, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shaking of the electronic device 1300 through reverse movement to achieve anti-shake. The gyro sensor 1380B can also be used for navigation and somatosensory game scenes.
[0144] The air pressure sensor 1380C is used to measure air pressure. In some embodiments, the electronic device 1300 calculates the altitude through the air pressure value measured by the air pressure sensor 1380C to assist positioning and navigation.
[0145] The magnetic sensor 1380D includes a Hall sensor. The electronic device 1300 can use the magnetic sensor 1380D to detect the opening and closing of the flip leather case. In some embodiments, when the electronic device 1300 is a flip phone, the electronic device 1300 can detect the opening and closing of the flip cover according to the magnetic sensor 1380D. Then, according to the detected opening and closing state of the leather case or the opening and closing state of the flip cover, the flip cover can be automatically unlocked.
[0146] The acceleration sensor 1380E can detect the magnitude of the acceleration of the electronic device 1300 in all directions (generally three axes). When the electronic device 1300 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the electronic device and is applied to applications such as horizontal and vertical screen switching and pedometers.
[0147] The distance sensor 1380F is used to measure the distance. The electronic device 1300 can measure the distance by infrared or laser. In some embodiments, when shooting a scene, the electronic device 1300 can use the distance sensor 1380F to measure the distance to achieve fast focusing.
[0148] The proximity light sensor 1380G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 1300 emits infrared light outward through the light emitting diode. The electronic device 1300 uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 1300. When insufficient reflected light is detected, the electronic device 1300 can determine that there is no object near the electronic device 1300. The electronic device 1300 can use the proximity light sensor 1380G to detect that the user holds the electronic device 1300 close to the ear to talk, so as to automatically turn off the screen to save power. The proximity light sensor 1380G can also be used in leather case mode and pocket mode to automatically unlock and lock the screen.
[0149] The ambient light sensor 1380L is used to sense the ambient light brightness. The electronic device 1300 can adaptively adjust the brightness of the display screen 1394 according to the perceived ambient light brightness. The ambient light sensor 1380L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 1380L can also cooperate with the proximity light sensor 1380G to detect whether the electronic device 1300 is in a pocket to prevent accidental touches.
[0150] The fingerprint sensor 1380H is used to collect fingerprints. The electronic device 1300 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.
[0151] The temperature sensor 1380J is used to detect temperature. In some embodiments, the electronic device 1300 uses the temperature detected by the temperature sensor 1380J to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 1380J exceeds a threshold, the electronic device 1300 reduces the performance of a processor located near the temperature sensor 1380J to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the electronic device 1300 heats the battery 1342 to avoid abnormal shutdown of the electronic device 1300 due to low temperature. In other embodiments, when the temperature is lower than another threshold, the electronic device 1300 performs a boost on the output voltage of the battery 1342 to avoid abnormal shutdown caused by low temperature.
[0152] The touch sensor 1380K is also called a "touch control device". The touch sensor 1380K can be set on the display screen 1394, and the touch sensor 1380K and the display screen 1394 form a touch screen, also called a "touch control screen". The touch sensor 1380K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 1394. In other embodiments, the touch sensor 1380K can also be set on the surface of the electronic device 1300, which is different from the position of the display screen 1394.
[0153] The bone conduction sensor 1380M can obtain a vibration signal. In some embodiments, the bone conduction sensor 1380M can obtain a vibration signal of a vibrating bone block of the vocal part of the human body. The bone conduction sensor 1380M can also contact the human pulse to receive a blood pressure beat signal. In some embodiments, the bone conduction sensor 1380M can also be set in an earphone and combined into a bone conduction earphone. The audio module 1370 can parse out a voice signal based on the vibration signal of the vibrating bone block of the vocal part obtained by the bone conduction sensor 1380M to realize a voice function. The application processor can parse the heart rate information based on the blood pressure beat signal obtained by the bone conduction sensor 1380M to realize a heart rate detection function.
[0154] The key 1390 includes a power key, a volume key, etc. The key 1390 may be a mechanical key or a touch key. The electronic device 1300 may receive key input and generate key signal input related to user settings and function control of the electronic device 1300.
[0155] Motor 1391 can generate vibration prompts. Motor 1391 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 1394, motor 1391 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.
[0156] Indicator 1392 may be an indicator light, which may be used to indicate charging status, power changes, messages, missed calls, notifications, etc.
[0157] The SIM card interface 1395 is used to connect a SIM card. The SIM card can be connected to and separated from the electronic device 1300 by inserting it into the SIM card interface 1395 or pulling it out from the SIM card interface 1395. The electronic device 1300 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 1395 can support Nano SIM cards, Micro SIM cards, SIM cards, and the like. Multiple cards can be inserted into the same SIM card interface 1395 at the same time. The types of the multiple cards can be the same or different. The SIM card interface 1395 can also be compatible with different types of SIM cards. The SIM card interface 1395 can also be compatible with external memory cards. The electronic device 1300 interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the electronic device 1300 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 1300 and cannot be separated from the electronic device 1300.
[0158] In the accompanying drawings, some structural or method features may be shown in a specific arrangement and / or order. However, it should be understood that such a specific arrangement and / or order may not be required. Instead, in some embodiments, these features may be arranged in a manner and / or order different from that shown in the illustrative drawings. In addition, the inclusion of structural or method features in a particular figure does not mean that such features are required in all embodiments, and in some embodiments, these features may not be included or may be combined with other features.
[0159] It should be noted that the units / modules mentioned in the various device embodiments of the present application are all logical units / modules. Physically, a logical unit / module can be a physical unit / module, or a part of a physical unit / module, or can be implemented as a combination of multiple physical units / modules. The physical implementation method of these logical units / modules themselves is not the most important. The combination of functions implemented by these logical units / modules is the key to solving the technical problems proposed by the present application. In addition, in order to highlight the innovative part of the present application, the above-mentioned device embodiments of the present application do not introduce units / modules that are not closely related to solving the technical problems proposed by the present application, which does not mean that there are no other units / modules in the above-mentioned device embodiments.
[0160] It should be noted that in the examples and description of this patent, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "including one" do not exclude the existence of other identical elements in the process, method, article or device including the elements.
[0161] Although the present application has been illustrated and described with reference to certain preferred embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the scope of the present application.
Claims
1. A shooting method, applied to an electronic device, characterized in that: include: Detecting a first operation of a user, where the first operation is clicking a camera control on a main interface of the electronic device; In response to the first operation, displaying a blur shooting interface, wherein the blur shooting interface includes a preview screen and shooting controls; The step of generating the preview screen includes: In response to a user selecting a first blur shape control, shooting a first mask image based on a first preset aperture parameter of a camera, shooting a second mask image based on a second preset aperture parameter of the camera, and shooting a third mask image based on a third preset aperture parameter of the camera, wherein the clarity of the first mask image is higher than that of the second mask image, and the clarity of the second mask image is higher than that of the third mask image; Extracting a first clear area from the first mask image, extracting a first transition area from the second mask image, and extracting a first blurred area from the third mask image, wherein a shape of the first clear area is the same as a blurred shape corresponding to the first blurred shape control, an outer edge of the first clear area coincides with an inner edge of the first transition area, and an outer edge of the first transition area coincides with an inner edge of the first blurred area; Generate the preview image based on the first clear area, the first transition area and the first blur area; After the blur shooting interface is displayed, a second operation of the user is detected, where the second operation is clicking a shooting control of the blur shooting interface; A blurred captured image is generated and displayed, wherein the blurred captured image includes a second clear area, a second transition area, and a second blurred area.
2. The method according to claim 1, characterized in that The first blur shape control includes any one of the following: Circular blur shape control, rectangular blur shape control, square blur shape control, and regular polygon blur shape control.
3. The method according to claim 1, characterized in that The first clear area is a clear area manually selected by a user, and the first blurred area is a blurred area manually selected by a user; The second clear area is a clear area manually selected by a user, and the second blurred area is a blurred area manually selected by a user.
4. The method according to claim 1, characterized in that: The blurred image is generated by: Acquire a first image, a second image, and a third image captured by the electronic device, wherein the definition of the first image is higher than that of the second image, and the definition of the second image is higher than that of the third image; A first region to be stitched, a second region to be stitched, and a third region to be stitched are respectively cut out from the first image, the second image, and the third image, wherein: The first area to be stitched has the same size and corresponding position as the second clear area, the second area to be stitched has the same size and corresponding position as the second transition area, and the third area to be stitched has the same size and corresponding position as the second blur area; The first area to be stitched, the second area to be stitched, and the third area to be stitched are combined to generate the blurred captured image, wherein the second area to be stitched is located between the first area to be stitched and the third area to be stitched.
5. An electronic device, characterized in that: include: A memory, used to store instructions executed by one or more processors of the electronic device, and the processor, which is one of the one or more processors of the electronic device, is used to execute the shooting method described in any one of claims 1-4.
6. A readable storage medium, characterized in that: The readable storage medium stores instructions, and when the instructions are executed on the electronic device, the electronic device executes the shooting method according to any one of claims 1 to 4.
Citation Information
Patent Citations
Image processing method and device, storage medium and electronic equipment
CN111246092A
Image blurring method, terminal equipment and computer readable storage medium
CN112422813A
Image processing method and terminal equipment
CN115499577A
Display screen panel with image processing graphical user interface
CN306871273S