Shooting method and related device

Abstract

The present application discloses a photographing method and related apparatus. After an electronic device activates the "group photo" function for a selected picture containing object A, it starts the camera application, displays indication information of the picture in the preview interface, and simultaneously displays the image captured by the camera of the electronic device. Subsequently, the electronic device can receive a photographing instruction input by the user, and fit the picture and the image captured by the camera into a composite image that simultaneously contains object A and object B. This method can achieve a high-quality group photo of object A and object B without relying on other devices or other people.

Description

Technical Field

[0001] This application relates to the technical field of terminals, and in particular to a photographing method and related devices. Background Art

[0002] When multiple people go on an outing, there is usually a need to take group photos. The methods for taking group photos of multiple people include the following:

[0003] 1. Ask a passerby to help take a group photo. This method not only bothers others, but also may result in an average shooting effect due to the passerby's insufficient understanding of the shooting device.

[0004] 2. Use a selfie stick, a tripod, or directly place the shooting device on the ground to take a photo. However, the selfie stick increases the burden of the user's outing, cannot control the shooting distance, and the shooting clarity using the front camera is relatively low. The tripod also increases the burden and cannot provide real-time preview, and there is a risk of damage to the shooting device. Placing the shooting device on the ground for shooting cannot provide real-time preview and cannot control the shooting distance.

[0005] 3. Take separate photos of multiple people and then use photo software to generate a group photo later. The method of making a group photo later takes a long time, does not support real-time preview of the group photo situation, and the group photo effect is also average. Summary of the Invention

[0006] This application provides a photographing method and related devices, which can achieve high-quality group photos of multiple objects without relying on other devices or other people.

[0007] In a first aspect, an embodiment of this application provides a photographing method, which is applied to an electronic device. The method may include: The electronic device starts a gallery application and displays a first user interface, in which a first picture is displayed, and the first picture includes a first object; The electronic device receives a first operation on the first picture; The electronic device starts a camera application and displays a second user interface, in which a preview frame is displayed, and the image captured by the camera of the electronic device and the indication information of the first picture are displayed in the preview frame; The electronic device receives a second operation for taking a photo; The electronic device stores a second picture, which is obtained by fitting the image captured by the camera and the first picture, the image captured by the camera includes a second object, and the second picture includes the first object and the second object.

[0008] By implementing the method provided in the first aspect, the electronic device can call the camera application through the gallery application, and can complete the group photo of the first object and the second object without the help of other devices or other people, and can also preview and adjust the relative position between the first object and the second object in real time during the group photo, and can also flexibly adjust the shooting distance and the camera used for shooting to achieve high-quality group photo effects. In addition, the method has low operating difficulty, short time, convenient and fast, and can support continuous and large-scale group photo shooting.

[0009] In combination with the first aspect, in some implementations, the first object or the second object is any one of the following: a person, an animal, a landmark, a building, or a doll.

[0010] In combination with the first aspect, in some implementations, the number of the first object or the second object can be multiple.

[0011] In conjunction with the first aspect, in some embodiments, the indication information of the first picture displayed in the preview frame by the electronic device may be a transparent or blurred first picture. In this way, the user can see the first picture through the preview frame, and can also see the image captured by the camera displayed by the electronic device through the blurred or transparent first picture, so as to achieve the effect of real-time preview of the relative position between the object in the first picture and the object in the image captured by the camera.

[0012] In combination with the first aspect, in some implementations, after receiving the second operation, the electronic device may fit the second image in any of the following ways:

[0013] Method 1: Fitting the area where the second object is located in the image captured by the camera to the first image, thereby obtaining the second image.

[0014] In a specific implementation, the electronic device identifies a second object in an image captured by a camera; determines a main area containing the second object in the image captured by the camera, the main area being an area determined based on the second object; determines a co-location area in a first image, a portion outside the co-location area in the first image, and a portion outside the main area in the image captured by the camera having a correlation greater than a second value; and fits the main area to the co-location area in the first image to obtain a second image.

[0015] Method 2: Fitting the area where the first object in the first picture is located to the image captured by the camera to obtain the second picture.

[0016] The electronic device identifies a first object in a first picture; determines a main area in the first picture that contains the first object, where the main area is an area determined based on the first object; determines a corresponding area in the image captured by the camera, and the correlation between the part outside the corresponding area in the image captured by the camera and the part outside the main area in the first picture is greater than a second value; fits the main area to the corresponding area in the image captured by the camera to obtain a second picture.

[0017] In the above method 1 or method 2, the main area may be an area obtained by expanding a first value outward based on the corresponding object (such as the first object or the second object), or an area obtained by expanding around and having a similar or the same color or pixels as the corresponding object. Among them, the first value can be preset by the electronic device. The first value may be related to the camera model configured by the electronic device.

[0018] Determining the main area based on the corresponding object (such as the first object or the second object) can not only ensure the integrity of the object in the main area, but also avoid excessive expansion of the range, thereby ensuring the subsequent fitting effect.

[0019] In the above method 1 or method 2, the position of the corresponding area in the first picture is the same as the position of the main area in the image captured by the camera. In this way, the effect of the user's real-time adjustment according to the content in the preview frame can be directly applied to the final fitting effect, achieving the purpose of the user's real-time adjustment of the group photo effect.

[0020] In the above method 1 or method 2, the size and shape of the corresponding area in the first picture may be the same as or different from the size and shape of the main area in the image captured by the camera.

[0021] Combined with the first aspect, in some embodiments, the second picture is the frame of the synthesized image with the highest quality obtained by fitting each of the multiple frames of images captured by the camera with the first picture; the multiple frames of images captured by the camera include the images captured by the camera at the moment when the electronic device receives the second operation and the moments before that, and the number of the multiple frames of images is preset by the electronic device. This can ensure a high-quality group photo effect.

[0022] Combined with the first aspect, in some embodiments, the second picture is a frame of synthesized image obtained by fitting the image captured by the camera at the moment when the second operation is received with the first picture.

[0023] Combined with the first aspect, in some embodiments, a first control is displayed in the first user interface. Before the electronic device receives a first operation on the first picture, the method further includes: the electronic device receives a user operation on the first control; the electronic device displays a second control in the first user interface; the first operation includes a user operation on the second control.

[0024] In combination with the first aspect, in some embodiments, after the electronic device stores the second picture, the electronic device may receive a third operation for viewing the second picture and display the second picture. Equivalently, after taking a group photo of the first object and the second object, the user can also view the group photo on the electronic device.

[0025] In a second aspect, an embodiment of the present application provides a photographing method, which is applied to an electronic device. The method may include: the electronic device starts a gallery application and displays a first user interface, in which a first picture is displayed, and the first picture includes a first object; the electronic device receives a first operation on the first picture; the electronic device starts a camera application and displays a second user interface, in which a preview frame is displayed, and a composite image is displayed in the preview frame, the composite image is obtained by fitting an image captured by the camera of the electronic device and the first picture, and the image captured by the camera includes a second object; the electronic device receives a second operation for taking a photo; the electronic device stores a second picture, the second picture is the composite image displayed in the preview frame when the second operation is received, and the second picture includes the first object and the second object.

[0026] By implementing the method provided in the second aspect, the electronic device can call the camera application through the gallery application, can display the group photo effect for the user in real time in the preview frame, enabling the user to more intuitively feel the group photo effect, and can complete the group photo of the first object and the second object without relying on other devices or other people. And during the group photo process, the relative positions between the first object and the second object can be previewed and adjusted in real time, and the shooting distance and the camera used for shooting can also be flexibly adjusted to achieve a high-quality group photo effect. Moreover, this method has a low operation difficulty, short time, is convenient and fast, and can support continuous and large-scale group photo shooting.

[0027] In combination with the second aspect, in some embodiments, the first object or the second object is any one of the following: a person, an animal, a landmark, a building, a doll.

[0028] In combination with the second aspect, in some embodiments, the number of the first object or the second object can be multiple.

[0029] In combination with the second aspect, in some embodiments, the electronic device can obtain the composite image displayed in the preview frame by any one of the following methods:

[0030] Method 1: Fit the area where the second object is located in the image captured by the camera to the first picture, thereby obtaining the second picture.

[0031] Method 2: Fit the area where the first object is located in the first picture to the image captured by the camera, thereby obtaining the second picture.

[0032] For the specific implementation and technical effects of the above Method 1 and Method 2, reference may be made to the method for generating the second picture in the first aspect, which will not be elaborated here.

[0033] In combination with the second aspect, in some embodiments, a first control is displayed in the first user interface. Before the electronic device receives a first operation on the first picture, it may also receive a user operation on the first control and display a second control in the first user interface; the first operation includes a user operation on the second control.

[0034] In combination with the second aspect, in some embodiments, after the electronic device stores the second picture, the electronic device may receive a third operation for viewing the second picture and display the second picture. Equivalently, after taking a group photo of the first object and the second object, the user can also view the group photo on the electronic device.

[0035] In a third aspect, an embodiment of the present application provides a shooting method, which is applied to an electronic device. The method may include: the electronic device displays a second user interface, in which a preview frame and a third control are displayed, and an image captured by the camera of the electronic device is displayed in the preview frame; the electronic device detects a fourth operation on the third control; the electronic device displays one or more pictures; the electronic device detects a fifth operation on a first picture among the one or more pictures, and the first picture includes a first object; the electronic device displays, in the preview frame of the second user interface, the image captured by the camera of the electronic device and the indication information of the first picture; the electronic device receives a second operation for taking a photo; the electronic device stores a second picture, which is obtained by fitting the image captured by the camera and the first picture, the image captured by the camera includes a second object, and the second picture includes the first object and the second object.

[0036] When implementing the method provided in the third aspect, the electronic device can start the group photo function through the preview interface, and can complete a group photo of the first object and the second object without the help of other devices or other people. During the group photo process, the relative positions between the first object and the second object can be previewed and adjusted in real time, and the shooting distance and the camera used for shooting can also be flexibly adjusted to achieve a high-quality group photo effect. Moreover, this method has a low operation difficulty, short time, is convenient and fast, and can support continuous and large-scale group photo shooting.

[0037] In combination with the third aspect, the second user interface (i.e., the preview interface) can be provided by the camera application or an interface provided by other applications calling the camera interface. Other applications can be, for example, social applications, shopping applications, etc. Equivalently, the group photo function can be started through the camera application or other applications.

[0038] The indication information of the first object, the second object, and the first picture in the third aspect can all refer to the relevant descriptions in the first aspect.

[0039] Combined with the third aspect, in some embodiments, the method and technical effects of the electronic device fitting to obtain the second picture can refer to the relevant descriptions in the first aspect.

[0040] Combined with the third aspect, in some embodiments, the second picture is the frame of the synthesized picture with the highest quality among the synthesized pictures obtained by respectively fitting multiple frames of images collected by the camera with the first picture; the multiple frames of images collected by the camera include the images collected by the camera at the moment when the electronic device receives the second operation and the previous moments, and the number of the multiple frames of images is preset by the electronic device. This can ensure a high-quality group photo effect.

[0041] Combined with the third aspect, in some embodiments, the second picture is a frame of synthesized picture obtained by fitting the image collected by the camera at the moment when the second operation is received with the first picture.

[0042] Combined with the third aspect, in some embodiments, after the electronic device stores the second picture, the electronic device can receive a third operation for viewing the second picture and display the second picture. Equivalently, after the group photo of the first object and the second object is completed, the user can also view the group photo on the electronic device.

[0043] In a fourth aspect, an embodiment of the present application provides a photographing method, which is applied to an electronic device. The method may include: the electronic device displays a second user interface, in which a preview frame and a third control are displayed, and an image collected by the camera of the electronic device is displayed in the preview frame; the electronic device detects a fourth operation acting on the third control; the electronic device displays one or more pictures; the electronic device detects a fifth operation acting on the first picture among the one or more pictures, and the first picture includes a first object; the electronic device displays a synthesized picture in the preview frame of the second user interface, and the synthesized picture is obtained by fitting the image collected by the camera of the electronic device with the first picture, and the image collected by the camera includes a second object; the electronic device receives a second operation for taking a photo; the electronic device stores a second picture, and the second picture is the synthesized picture displayed in the preview frame when the second operation is received, and the second picture includes the first object and the second object.

[0044] Implementing the method provided in the fourth aspect, the electronic device can activate the group photo function through the preview interface, and can display the group photo effect for the user in real time in the preview frame, enabling the user to more intuitively feel the group photo effect, and can complete the group photo of the first object and the second object without the assistance of other devices or other personnel. And during the group photo process, the relative positions between the first object and the second object can be previewed and adjusted in real time, and the shooting distance and the camera used for shooting can also be flexibly adjusted to achieve a high-quality group photo effect. Moreover, this method has a low operation difficulty, short time, is convenient and fast, and can support continuous and large-scale group photo shooting.

[0045] In combination with the fourth aspect, in some embodiments, the second user interface (i.e., the preview interface) can be provided by the camera application or can be an interface provided by other applications calling the camera interface. Other applications can be, for example, social applications, shopping applications, etc. Equivalently, the group photo function can be activated through the camera application or other applications.

[0046] In combination with the fourth aspect, in some embodiments, the first object or the second object is any one of the following: a person, an animal, a landmark, a building, a doll.

[0047] In combination with the fourth aspect, in some embodiments, the number of the first object or the second object can be multiple.

[0048] In combination with the fourth aspect, in some embodiments, the electronic device can obtain the composite image displayed in the preview frame through any one of the following methods:

[0049] Method 1: Fit the area where the second object is located in the image collected by the camera into the first picture to obtain the second picture.

[0050] Method 2: Fit the area where the first object is located in the first picture into the image collected by the camera to obtain the second picture.

[0051] For the specific implementation and technical effects of the above Method 1 and Method 2, reference can be made to the generation method of the second picture in the first aspect, which will not be elaborated here.

[0052] In combination with the fourth aspect, in some embodiments, after the electronic device stores the second picture, the electronic device can receive a third operation for viewing the second picture and display the second picture. Equivalently, after completing the group photo of the first object and the second object, the user can also view the group photo on the electronic device.

[0053] Fifth aspect, an embodiment of the present application provides an electronic device, including: a memory, and one or more processors; the memory is coupled to the one or more processors, and the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the electronic device to execute the method of any one of the implementation manners executed by the electronic device in the first aspect or the second aspect or the third aspect or the fourth aspect.

[0054] Sixth aspect, an embodiment of the present application provides a computer-readable storage medium, including instructions, when the instructions run on an electronic device, enabling the electronic device to execute the method of any one of the implementation manners executed by the electronic device in the first aspect or the second aspect or the third aspect or the fourth aspect.

[0055] Seventh aspect, an embodiment of the present application provides a computer program product, when the computer program product runs on a computer, enabling the computer to execute the method of any one of the implementation manners executed by the electronic device in the first aspect or the second aspect or the third aspect or the fourth aspect.

[0056] Eighth aspect, an embodiment of the present application provides a chip system, the chip system includes at least one processor, for implementing the method of any one of the implementation manners executed by the electronic device in the first aspect or the second aspect or the third aspect or the fourth aspect.

[0057] By implementing the technical solution provided by the present application, the electronic device can complete the group photo of the first object and the second object without the help of other devices or other people, and during the group photo process, it can also preview in real time and adjust the relative position between the first object and the second object, and can also flexibly adjust the shooting distance and the camera used for shooting to achieve a high-quality group photo effect. Moreover, this method has a low operation difficulty, short time, is convenient and fast, and can support continuous and large-scale group photo shooting. BRIEF DESCRIPTION OF THE DRAWINGS

[0058] Figure 1A It is a schematic diagram of the hardware structure of the electronic device 100 provided by an embodiment of the present application;

[0059] Figure 1B It is a schematic diagram of a software structure of the electronic device 100 provided by an embodiment of the present application;

[0060] Figure 1C It is another schematic diagram of a software structure of the electronic device 100 provided by an embodiment of the present application;

[0061] Figures 2A - 2H It is a set of user interfaces for group photo provided for the electronic device 100 in an embodiment of the present application;

[0062] Figures 3A - 3FAnother set of user interfaces for taking group photos provided for the electronic device 100 in the embodiments of the present application;

[0063] Figures 4A - 4B The user interface provided by the gallery application after the electronic device 100 in the embodiments of the present application saves the fitted picture;

[0064] Figure 5 The flowchart of the shooting method provided by the embodiments of the present application;

[0065] Figures 6A - 6B Examples of several image processing processes provided by the embodiments of the present application. Detailed implementation manners

[0066] Next, the technical solutions in the embodiments of the present application will be clearly and elaborately described with reference to the accompanying drawings. Among them, in the description of the embodiments of the present application, unless otherwise specified, " / " means "or". For example, A / B may mean A or B; "and / or" in the text is only a description of the association relationship of the associated objects, indicating that there can be three relationships. For example, A and / or B may mean: A exists alone, A and B exist simultaneously, and B exists alone. In addition, in the description of the embodiments of the present application, "a plurality" means two or more than two.

[0067] Hereinafter, the terms "first" and "second" are only used for descriptive purposes and cannot be construed as implying or suggesting relative importance or implicitly indicating the quantity of the indicated technical features. Thus, the features defined with "first" and "second" may explicitly or implicitly include one or more of such features. In the description of the embodiments of the present application, unless otherwise specified, the meaning of "a plurality" is two or more than two.

[0068] The term "user interface (UI)" in the following embodiments of the present application is a media interface for interaction and information exchange between an application program or an operating system and a user, and it realizes the conversion between the internal form of information and the form acceptable to the user. The user interface is source code written in a specific computer language such as Java or Extensible Markup Language (XML). The interface source code is parsed and rendered on the electronic device and finally presented as content recognizable by the user. The common manifestation form of the user interface is the graphical user interface (GUI), which refers to the user interface related to computer operations displayed in a graphical manner. It can be visible interface elements such as text, icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and Widgets displayed on the display screen of the electronic device.

[0069] The following embodiments of the present application provide a shooting method and related devices. In this shooting method, an electronic device can activate the "group photo" function for a selected picture containing object A, then activate the camera application, display the picture with transparency or blurring in the preview interface provided by the camera application, and simultaneously display the image captured by the camera of the electronic device. After the image captured by the camera includes object B, the electronic device can receive a shooting instruction input by the user, and then fit the picture and the image captured by the camera to generate a composite image that simultaneously includes object A and object B.

[0070] The above object A or object B may include, but are not limited to: people, animals, landmarks, buildings, dolls, etc. The number of object A or object B can both be multiple.

[0071] The above shooting method can achieve a group photo of object A and object B. This method can complete the group photo without the help of other devices or other people, and during the group photo process, it can also preview in real time and adjust the relative positions of object B and object A, and can also flexibly adjust the shooting distance and the camera used for shooting to achieve a high-quality group photo effect. Moreover, this method has a low operation difficulty, short time, is convenient and fast, and can support continuous and large-scale group photo shooting.

[0072] The above shooting method can be applied to scenarios with a need for group photos, including but not limited to: multiple group photos of the same person at the same location; a new person taking a group photo with the person in an old photo to achieve a group photo of multiple people at the same location at different times.

[0073] In some embodiments, the electronic device can extract the area where object B is located in the image captured by the camera, and fit this area into the picture containing object A, and the rest of the picture remains unchanged to generate a composite image that simultaneously includes object A and object B. Through image fitting, object B can be smoothly and naturally integrated into the corresponding area of the picture containing object A, obtaining a natural and high-quality group photo effect. In other embodiments, the electronic device can also extract the area where object A is located in the picture, and fit this area into the image captured by the camera. For the specific method of generating the composite image, reference can be made to the detailed description of the subsequent method embodiments.

[0074] In some embodiments, the electronic device can select N frames of images taken by the camera at or before the moment of receiving the photo command, fit each of the N frames of images with the picture containing object A, obtain N frames of composite images, and then select the best quality frame from the N frames of composite images and store it as the photo result. In this way, the best frame can be selected from multiple frames of composite images as the photo result, achieving a high-quality photo effect. In addition, the method also takes into account the delay between the user seeing the photo effect on the preview interface and inputting the photo command, thereby avoiding using the composite image corresponding to the moment of receiving the photo command as the final photo effect.

[0075] In some implementations, after the electronic device starts the camera application, it can also directly fit the image captured by the camera and the selected picture containing the object A, and directly display the synthesized image in the preview interface provided by the camera application.

[0076] In the embodiment of the present application, the "combined shooting" function is provided by the electronic device, which supports the electronic device to display a transparent or blurred picture containing object A in the preview interface provided by the camera application, and simultaneously displays the image captured by the camera of the electronic device. The electronic device receives a photo taking instruction input by the user, fits the picture and the image captured by the camera, and generates a composite image containing both object A and object B. Alternatively, the "combined shooting" function supports the electronic device to directly fit the image captured by the camera and the picture containing object A, and directly display the composite image in the preview interface provided by the camera application.

[0077] The "group photo" function is only a term used in the embodiment of the present application. Its meaning has been recorded in the embodiment, and its name does not constitute any limitation to the embodiment. For example, the "group photo" function can also be called other terms, such as "group photo" function, multi-person group photo, multi-person group photo, etc.

[0078] The following first introduces the electronic device provided by the embodiments of the present application.

[0079] The electronic device provided in the embodiments of the present application is equipped with a camera, which may include but is not limited to a smart phone, a tablet computer, a special camera (such as a SLR camera, a compact camera), etc., an augmented reality (AR) device, a virtual reality (VR) device, an artificial intelligence (AI) device, a wearable device (such as a smart watch, smart glasses), a personal digital assistant (PDA), etc. Exemplary embodiments of electronic devices include but are not limited to devices equipped with A portable electronic device running Linux or other operating systems. The above-mentioned electronic device can also be other portable electronic devices, such as a laptop computer, etc.

[0080] Figure 1A The structural schematic diagram of an electronic device 100 provided by an embodiment of the present application is shown.

[0081] The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone interface 170D, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.

[0082] Among them, the sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0083] It can be understood that the structure schematically shown in the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than those shown in the figure, or combine certain components, or split certain components, or have different component arrangements. The components shown in the figure can be implemented in hardware, software, or a combination of software and hardware.

[0084] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units may be independent devices or integrated in one or more processors.

[0085] The controller may generate operation control signals according to the instruction operation code and timing signals to complete the control of fetching and executing instructions.

[0086] A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory may save the instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0087] In some embodiments, the processor 110 such as the controller or GPU can be used to perform transparency processing or blurring processing on the picture containing object A, and superimpose it with the image captured by the camera 193 to synthesize and display a preview image in the viewfinder.

[0088] In some embodiments, the processor 110 such as the controller or GPU can be used to fit the image captured by the camera and the picture containing object A to generate a preview image displayed in the viewfinder, so that the group photo effect can be presented to the user. For the specific implementation of the fitting operation executed by the processor 110, reference can be made to the detailed introduction in the subsequent method embodiments.

[0089] For convenience of use, the electronic device usually takes pictures in the user's hand-held mode, and the hand-held mode usually causes the captured picture to shake. In some embodiments, the processor 110 such as the controller or GPU can also be used to perform anti-shake processing on the image captured by the camera in a group photo scenario, and then superimpose or fit the anti-shake processed image corresponding to the camera with the picture containing object A to provide a preview image for display on the display screen 194.

[0090] The wireless communication function of the electronic device 100 can be implemented by antenna 1, antenna 2, the mobile communication module 150, the wireless communication module 160, the modulation and demodulation processor, and the baseband processor, etc.

[0091] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization rate of the antennas. For example, antenna 1 can be multiplexed as the diversity antenna of the wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0092] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc. applied to the electronic device 100. The mobile communication module 150 can include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves by antenna 1, filter, amplify, etc. the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor and convert it into electromagnetic waves through antenna 1 for radiation. In some embodiments, at least some functional modules of the mobile communication module 150 can be provided in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 can be provided in the same device.

[0093] The modulation and demodulation processor can include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. Subsequently, the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs a sound signal through an audio device (not limited to speaker 170A, receiver 170B, etc.), or displays an image or video through the display screen 194. In some embodiments, the modulation and demodulation processor can be an independent device. In some other embodiments, the modulation and demodulation processor can be independent of the processor 110 and be provided in the same device as the mobile communication module 150 or other functional modules.

[0094] The wireless communication module 160 may provide solutions for wireless communications applied to the electronic device 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite systems (GNSSs), frequency modulation (FM), near field communication (NFC), infrared (IR), etc. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, demodulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 may also receive signals to be sent from the processor 110, perform frequency modulation and amplification on them, and convert them into electromagnetic waves through the antenna 2 for radiation.

[0095] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, such that electronic device 100 can communicate with a network and other devices through wireless communication technologies. The wireless communication technologies may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. The GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), beidou navigation satellite system (BDS), quasi-zenith satellite system (QZSS), and / or satellite based augmentation systems (SBAS).

[0096] Electronic device 100 implements a display function through a GPU, display screen 194, and an application processor, etc. The GPU is a microprocessor for image processing, and is connected to display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or change display information.

[0097] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can adopt a liquid crystal display (LCD). The display panel can also adopt an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a miniLED, a microLED, a micro-OLED, a quantum dot light-emitting diode (QLED), etc. to manufacture. In some embodiments, the electronic device may include one or N display screens 194, where N is a positive integer greater than 1.

[0098] In some embodiments, in the co-shooting scenario, the display screen 194 can display the preview interface provided by the camera application, and display a picture containing object A with transparency or blurring in the preview interface, and at the same time display the image captured by the camera 193 of the electronic device.

[0099] In other embodiments, in the co-shooting scenario, the display screen 194 can display the composite image obtained by the processor 110 fitting the image captured by the camera and the picture containing object A, so that the group photo effect can be presented to the user.

[0100] The electronic device 100 can implement the shooting function through the ISP, the camera 193, the video codec, the GPU, the display screen 194, and the application processor, etc.

[0101] The ISP is used to process the data fed back by the camera 193. For example, when taking a photo, the shutter is opened, and the light passes through the lens and is transmitted to the camera photosensitive element. The optical signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. The ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. The ISP can also optimize parameters such as the exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.

[0102] The camera 193 is used to capture static images or videos. An object generates an optical image through a lens and projects it onto a photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in standard formats such as RGB and YUV. In some embodiments, the electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.

[0103] The electronic device 100 may have multiple cameras 193, such as a front camera and a rear camera. The number of both the front camera and the rear camera can be multiple. The types of the camera 193 may include but are not limited to a wide-angle camera, an ultra-wide-angle camera, a telephoto camera, etc.

[0104] The hardware configuration and physical location of the camera 193 may be different. Therefore, the size, range, content, clarity, etc. of the images captured by different cameras may be different.

[0105] The output image size of the camera 193 may be different or the same. The output image size of the camera refers to the length and width of the image captured by the camera. Both the length and width of the image can be measured in pixels. The output image size of the camera can also be called the image size, image dimension, pixel dimension, or image resolution. Common output image ratios of cameras may include: 4:3, 16:9, 3:2, etc. The output image ratio refers to the approximate ratio of the number of pixels in the length and width of the image captured by the camera.

[0106] The camera 193 may correspond to the same focal length or different focal lengths. The larger the focal length corresponding to the camera, the smaller the field of view (FOV) of the camera. The field of view refers to the angular range that the optical system can image.

[0107] The camera 193 can be disposed on two sides of the electronic device. The camera located on the same plane as the display screen 194 of the electronic device can be called a front camera, and the camera located on the plane where the back cover of the electronic device is located can be called a rear camera. The front camera can be used to capture an image of the photographer himself facing the display screen 194, and the rear camera can be used to capture an image of the subject (such as a person, a landscape, etc.) that the photographer is facing.

[0108] In some embodiments, the camera 193 can be used to collect depth data. For example, the camera 193 can have a time of flight (TOF) 3D sensing module or a structured light 3D sensing module for acquiring depth information. The camera used to collect depth data can be a front camera or a rear camera.

[0109] The digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the electronic device 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0110] Video codecs are used to compress or decompress digital videos. The electronic device 100 may support one or more video codecs. Thus, the electronic device 100 may play or record videos in a variety of coding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0111] NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. Through NPU, applications such as intelligent cognition of electronic device 100 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.

[0112] In some embodiments, in a co-photographing scenario, the processor 110 (e.g., a controller or a GPU) may fit the image captured by the camera and the picture containing the object A, and store the fitting result in a memory. The specific implementation of the fitting operation performed by the processor 110 may refer to the detailed description of the subsequent method embodiments. In this way, the composite image obtained by fitting contains both the object A and the object B captured by the camera, thereby realizing a co-photographing of multiple objects.

[0113] In some embodiments, the processor 110 (such as a controller or a GPU) can fit the moment when the electronic device 100 receives a photo-taking instruction and the N frames of images previously taken by the camera 193 with a picture containing object A to obtain N composite images, and then select the frame with the best quality from the N composite frames and store it in a memory as a group photo result.

[0114] In some embodiments, in a combined shooting scenario, the processor 110 (e.g., a controller or a GPU) may fit multiple frames of images captured by the camera with the picture containing object A, and store the fitting results in a memory. For example, the multiple frames of images captured by the camera and the picture containing object A are fitted into multiple images, and the video encoder in the processor 110 may encode the multiple composite images to generate a video file. In this way, each frame of the video file may contain object A and the object in the new image captured by the camera.

[0115] The internal memory 121 may include one or more random access memories (RAM) and one or more non-volatile memories (NVM). The internal memory 121 is used to store the fitting results of the processor 110 .

[0116] Random access memory may include static random-access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM, for example, the fifth generation DDR SDRAM is generally referred to as DDR5 SDRAM), etc.; non-volatile memory may include disk storage devices and flash memory.

[0117] Flash memory can be divided into NOR FLASH, NAND FLASH, 3D NAND FLASH, etc. according to the operating principle; single-level cell (SLC), multi-level cell (MLC), triple-level cell (TLC), quad-level cell (QLC), etc. according to the storage unit potential level; universal flash storage (UFS), embedded multi media card (eMMC), etc. according to the storage specification.

[0118] The random access memory can be directly read from and written to by the processor 110, and can be used to store the operating system or executable programs (such as machine instructions) of other running programs, and can also be used to store user and application data, etc.

[0119] The non-volatile memory can also store executable programs and store user and application data, etc., and can be pre-loaded into the random access memory for direct reading and writing by the processor 110.

[0120] The external memory interface 120 can be used to connect to an external non-volatile memory to expand the storage capacity of the electronic device 100. The external non-volatile memory communicates with the processor 110 through the external memory interface 120 to implement the data storage function. For example, files such as music and videos are saved in the external non-volatile memory.

[0121] The electronic device 100 can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor, etc. For example, music playback, recording, etc.

[0122] The touch sensor 180K, also known as the "touch control device". The touch sensor 180K can be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also known as the "touch control screen". The touch sensor 180K is used to detect touch operations acting thereon or nearby. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In some other embodiments, the touch sensor 180K can also be disposed on the surface of the electronic device 100, at a different position from the display screen 194.

[0123] The software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservices architecture, or a cloud architecture. In the embodiments of the present application, taking a mobile operating system with a layered architecture as an example, the software structure of the electronic device 100 is exemplarily described.

[0124] Figure 1B It is a software structure block diagram of the electronic device 100 in the embodiments of the present application.

[0125] The layered architecture divides the software into several layers, and each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the mobile operating system is divided into four layers, from top to bottom are the application layer, the program framework layer / kernel service layer, the underlying library and runtime, and the kernel layer.

[0126] The application layer can include a series of application program packages.

[0127] As Figure 1B shown, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc.

[0128] The program framework layer provides application programming interfaces (APIs) and programming frameworks for the applications in the application layer. The program framework layer includes some predefined functions.

[0129] As Figure 1B shown, the program framework layer may include window manager, content provider, view system, phone manager, resource manager, notification manager, etc.

[0130] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0131] The content provider is used to store and obtain data, and make this data accessible to applications. The data may include video, image, audio, dialed and answered calls, browsing history and bookmarks, phone book, etc.

[0132] The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, etc. The view system can be used to build applications. The display interface can be composed of one or more views. For example, a display interface including a short message notification icon may include a view for displaying text and a view for displaying pictures.

[0133] The phone manager is used to provide the communication function of the electronic device. For example, the management of call status (including connection, disconnection, etc.).

[0134] The resource manager provides various resources for applications, such as localized strings, icons, pictures, layout files, video files, etc.

[0135] The notification manager enables applications to display notification information in the status bar, can be used to convey notification-type messages, can disappear automatically after a short stay without user interaction. For example, the notification manager is used to inform that the download is completed, message reminder, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as the notification of a background running application, and can also be a notification that appears on the screen in the form of a dialogue window. For example, prompt text information in the status bar, emit a prompt sound, the electronic device vibrates, the indicator light flashes, etc.

[0136] The runtime can refer to all code libraries, frameworks, etc. required during program execution. For example, for the C language, the runtime includes a series of function libraries required for C program execution. For the Java language, in addition to the core libraries, the runtime also includes virtual machines required for Java program execution, etc. The above core libraries can include functional functions that the Java language needs to call.

[0137] The underlying libraries can include multiple functional modules. For example: surface manager, Media Libraries, 3D graphics processing libraries (such as OpenGL ES), 2D graphics engines (such as SGL), etc.

[0138] The surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications.

[0139] The media library supports the playback and recording of multiple common audio and video formats, as well as static image files, etc. The media library can support multiple audio and video coding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0140] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis, and layer processing, etc.

[0141] The 2D graphics engine is a drawing engine for 2D drawing.

[0142] The kernel layer is the layer between hardware and software. The kernel layer at least includes a display driver, a camera driver, an audio driver, and a sensor driver.

[0143] The following exemplarily illustrates the working processes of the software and hardware of the electronic device in combination with the capture and photo-taking scenario.

[0144] When the touch sensor 180K receives a touch operation, the corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the touch operation into a raw input event (including information such as touch coordinates and the timestamp of the touch operation). The raw input event is stored in the kernel layer. The application framework layer obtains the raw input event from the kernel layer and identifies the control corresponding to the input event. Taking the touch operation as a touch click operation and the control corresponding to the click operation as the control of the camera application icon as an example, the camera application calls the interface of the application framework layer to start the camera application, and then starts the camera driver by calling the kernel layer to capture a static image or video through the camera 193.

[0145] Figure 1C It is another software structure block diagram of the electronic device 100 provided by the embodiments of the present application.

[0146] As Figure 1CAs shown in the figure, the electronic device 100 includes: a gallery module, a camera module, a display module, an identification module, and a synthesis module. Among them:

[0147] The gallery module is used to store multiple pictures, including a picture containing object A. The gallery module can also provide an entry to enable the "group photo" function and can be used to store the fitting results of the electronic device 100.

[0148] The camera module is responsible for taking pictures.

[0149] The display module is used to display the picture with transparency or blur, and at the same time display the image captured by the camera module. Alternatively, the display module is used to display the composite image obtained by fitting the image captured by the camera module and the picture containing object A.

[0150] The identification module is used to identify the area where object B is located in the image captured by the camera module, and the background area except object B. Alternatively, the identification module is used to identify the area where object A is located in the picture containing object A, and the background area except the area where object A is located.

[0151] The synthesis module is used to fit the area where object B is located in the image captured by the camera module into the picture containing object A. Alternatively, the synthesis module is used to fit the area where object A is located in the picture containing object A into the image captured by the camera module.

[0152] The following introduces the user interface provided by the embodiments of the present application.

[0153] Figures 2A - 2H Exemplarily shows a set of user interfaces for group photos provided by the electronic device 100 in the embodiments of the present application.

[0154] Figure 2A Exemplarily shows an exemplary user interface 21 on the electronic device 100 for displaying installed application programs.

[0155] The user interface 21 displays: a status bar 201, a calendar and a time indicator 202, a weather indicator 203, a page indicator 204, a tray 205 with common application program icons, and other application program icons. Among them:

[0156] The status bar 201 may include: one or more signal strength indicators of mobile communication signals (also known as cellular signals), a Bluetooth indicator, one or more signal strength indicators of Wi-Fi signals, a battery status indicator, a time indicator, etc.

[0157] The calendar and time indicator 202 is used to indicate the calendar and the current time. The weather indicator 203 is used to indicate the weather.

[0158] The page indicator 204 can be used to indicate which page of application icons the user is currently browsing. In the embodiments of the present application, the application icons can be distributed on multiple pages, and the user can swipe left and right to browse the application icons on different pages.

[0159] The tray 205 with common application icons can display: phone icon, message icon, camera icon 205a, contacts icon, etc.

[0160] Other application icons can include, for example, icons of video applications, online meeting applications, calendar icons, game application icons, map application icons, settings application icons, gallery application icons 206a, etc.

[0161] Among them, the camera is an APP on the electronic device 100 used to call the camera to take pictures. The name of this application is not limited in this embodiment. The camera APP in the embodiments of the present application also provides a "group photo" function. The camera APP can be a system application provided by the electronic device 100 or a third-party application.

[0162] The gallery is an APP for picture management on electronic devices 100 such as smartphones and tablets, and can also be called an "album". The name of this application is not limited in this embodiment. This APP can support users to perform various operations on the pictures stored on the electronic device 100, such as browsing, editing, deleting, selecting, etc. That is, the object managed by the "gallery" is pictures. In some other cases, this APP can also support users to perform the above various operations on the pictures stored on the cloud server. It can be understood that in this embodiment, the pictures can be captured by the camera 193 of the electronic device 100, or obtained from other application programs or downloaded from the web. The gallery in the embodiments of the present application also provides an entry for the "group photo" function. The gallery can be a system application provided by the electronic device 100 or a third-party application.

[0163] Not limited to this, more applications can also be installed in the electronic device 100, and the icons of these applications can be displayed on the display screen. For example, shopping applications, ticket booking applications, etc. can also be installed in the electronic device 100. The shopping application can be used to purchase items online. The ticket booking application can be used to book various tickets, such as air tickets, train tickets, ship tickets, etc.

[0164] The names of the above-mentioned applications are only terms used in the embodiments of this application, and their meanings have been recorded in this embodiment. Their names do not impose any limitations on this embodiment.

[0165] Not limited to this, Figure 2A The shown user interface 21 may further include a navigation bar, a sidebar, and so on. In some embodiments, Figure 2A The exemplary shown user interface 21 may be referred to as a home screen.

[0166] Figure 2B An exemplary user interface 22 provided by the gallery APP of the electronic device 100 is shown.

[0167] Figure 2B It may be a user interface that is displayed in response to a user operation (such as a click operation or a touch operation) detected by the electronic device 100 acting on the Figure 2A icon 206a of the gallery application in the figure.

[0168] Such as Figure 2B As shown, the user interface 22 may include: a status bar, an application title bar, and a picture area 207. Among them:

[0169] The status bar may refer to the status bar 201 in the Figure 2A shown user interface 21, which will not be elaborated here.

[0170] The application title bar may include: a back key and a current page indicator. The back key is an APP-level back key and can be used to return to the previous level of the menu. Those skilled in the art can understand that the logical previous level of a page is fixed and has been determined during the application design. The current page indicator can be used to indicate the current page, such as the text information "Gallery". Not limited to text information, the current page indicator can also be an icon.

[0171] One or more pictures, such as picture 207a, may be displayed in the picture area 207. When the electronic device detects an upward or downward sliding operation in the picture area 207, in response to this sliding operation, the electronic device can update the pictures displayed in the picture area 207 so that the user can browse the pictures. That is to say, the user can slide up or down in the picture area 207 to browse more pictures. Not limited to upward or downward sliding operations, the user can also slide left or right in the picture area 207 to browse more pictures. The pictures displayed in the picture area 207 can be thumbnails. At this time, the original pictures corresponding to the pictures displayed in the picture area 207 can be stored on the electronic device or on the cloud server. Unless otherwise specified, the pictures referred to in the following embodiments can be stored in the electronic device or on the cloud server.

[0172] As shown Figure 2B in the figure, the electronic device 100 may detect a user operation (such as a click operation, a touch operation, etc.) on the picture 207a in the user interface 22. In response to this operation, the electronic device 100 may display a user interface 23 as shown Figure 2C in the figure.

[0173] As shown Figure 2C in the figure, the electronic device 100 may display the original picture corresponding to the picture 207a in a larger area in the user interface 23. The user interface 23 displays a picture 208, and the picture 208 may be the original picture of the picture 207a. In some embodiments, the picture 208 may be taken by the electronic device 100 at a certain location (such as location 1), or may be obtained by the electronic device 100 from the network. The picture 208 includes a human object and a background area. The human object may be referred to as object A, and the picture 208 may be referred to as a picture containing object A. The background area shows the location where the object A is located, such as Figure 2C the background area of the picture 208 shown in the figure shows coconut trees, seagulls, hillsides, and the sun. The user interface 23 may also display: a sharing control, a favorite control, an editing control, a deletion control, a more control 209, etc. Among them, the sharing control, the favorite control, the editing control, and the deletion control are used to monitor user operations, and the electronic device 100 may perform operations such as sharing, favoriting, editing, and deleting on the picture 208 in response to the user operation. The more control 209 may be used to monitor user operations (such as click operations, touch operations, etc.), and the electronic device 100 may display a function list 210 as shown Figure 2D in the figure.

[0174] As shown Figure 2D in the figure, the function list 210 displays a plurality of function controls, such as controls for copying the picture 208 to the album, moving it to the album, screen mirroring, printing, etc. Among the plurality of function controls displayed in the function list 210, there is a control 210a for enabling the "duet" function for the picture 208. The control 210a is used to monitor user operations (such as click operations, touch operations, etc.), and the electronic device 100 may start the "duet" function for the picture 208 in response to the user operation.

[0175] Through the above Figures 2B - 2D example, the user can click on the picture to view the picture, and then start the "duet" function for the picture through the entry provided by the user interface displaying the picture.

[0176] Not limited to clicking on the control 210a in the user interface displaying a single picture, the electronic device 100 may also start the "duet" function for the picture in response to other user operations. For example, the electronic device 100 may also be inFigure 2B After a long - press operation is received on the displayed picture 207a, the "duet" function for this picture is started. Alternatively, the electronic device 100 can also Figure 2B After a circle - drawing gesture is received on the displayed picture 207a, the "duet" function for this picture is started. Alternatively, the electronic device 100 can also Figure 2C After a long - press operation is received on the shown picture 208, the "duet" function for this picture is started. Alternatively, the electronic device 100 can also be a voice - control instruction. This application does not limit the specific implementation of the operation that triggers the electronic device 100 to start the "duet" function for pictures.

[0177] Not limited to the pictures in the "Gallery", the scenarios where the user triggers the "duet" function for pictures can also include triggering the "duet" function for a picture when the user views pictures on the network, triggering the "duet" function for pictures in application programs such as a file browser, and so on.

[0178] Figures 2E - 2H Exemplarily shown is a set of user interfaces provided by the camera application after the electronic device 100 enables the "duet" function for the picture 208.

[0179] After the electronic device 100 starts the "duet" function for the picture 208, the camera application can be automatically started.

[0180] Figure 2E It is the user interface 24 displayed after the electronic device 100 starts the camera application.

[0181] Figure 2E The exemplarily shown user interface 24 can be displayed after the electronic device 100 detects a user operation (such as a click operation, a touch operation, etc.) on a control such as Figure 2D shown. The user interface 24 can be the user interface of the default shooting mode of the camera application, and can be used for the user to take pictures through the default rear - facing camera.

[0182] Such as Figure 2E shown, the user interface 24 can include: an area 211, a shooting - mode list 212, controls 213, 214, and 215. Among them:

[0183] The area 211 can be called a preview frame 211 or a viewfinder frame 211. The preview frame 211 can be used to display the picture 208 with a certain transparency or blurred.

[0184] After the camera 193 of the electronic device is started and collects an image, the preview frame 211 can also display the image collected in real time by the camera 193. The electronic device 100 can refresh the display content in real time so that the user can preview the image currently collected by the camera 193. The electronic device 100 can overlay and display the image 208 with a certain degree of transparency or blur on the image collected in real time by the camera 193. Since the image 208 has a certain degree of transparency and / or blur, the user can not only see the image 208 in the preview frame 211, but also see the image collected in real time by the camera 193 under the image 208.

[0185] In some implementations, after the electronic device 100 starts the “take a photo” function and starts the camera application, the image 208 with a certain degree of transparency or blur can be displayed only in the preview frame 211, such as Figure 2E As shown, the camera 193 is then started and the real-time collected image is also displayed in the preview box 211, as shown in FIG. Figure 2F shown.

[0186] In other embodiments, after the electronic device 100 starts the "take a photo" function and starts the camera application, the camera 193 can be directly started to capture images. At this time, the electronic device 100 can directly display the picture 208 with a certain degree of transparency or blur and the image captured in real time by the camera 193 in the preview box 211. Figure 2E After the user operates on the control 210a, the Figure 2F The user interface shown does not need to be displayed Figure 2E The user interface shown.

[0187] One or more shooting mode options may be displayed in the shooting mode list 212. The one or more shooting options may include: a shooting mode option 212A, a video mode option 212B, a portrait mode option 212C, a panoramic mode option 212D, and more options 212E. The one or more shooting options may be displayed as text information on the interface, such as "shoot", "video", "portrait", "panoramic", "more". Not limited to this, the one or more shooting options may also be displayed as icons or other forms of interactive elements (IE) on the interface.

[0188] The control 213 can be used to monitor user operations that trigger shooting (taking pictures or recording videos). The electronic device can detect a user operation acting on the control 213 (such as a click operation on the control 213). In response to this operation, the electronic device 100 can save the image captured by the camera 193 and perform a fitting operation with the picture 208, thereby generating a picture in the picture gallery. When the user switches to the video recording mode, the control 213 can be changed to a corresponding video recording control. The electronic device can detect a user operation acting on the video recording control. In response to this operation, the electronic device 100 can save multiple frames of images captured by the camera 193 and perform fitting operations with the picture 208 respectively, thereby generating a video in the picture gallery. In addition, the electronic device 100 can also display a thumbnail of the saved image in the control 214. This image can be generated by the electronic device 100 after enabling the "group photo" function, or can also be generated when the "group photo" function is not enabled. That is to say, the user can click the control 213 or the video recording control to trigger shooting. Among them, the control 213 or the video recording control can be a button or other forms of controls. In this application, the control 213 can be referred to as a photo-taking control. The photo-taking control and the video recording control can be collectively referred to as shooting controls.

[0189] The control 215 can be used to monitor user operations that trigger flipping the camera. The electronic device 100 can detect a user operation acting on the control 215 (such as a click operation on the control 215). In response to this operation, the electronic device 100 can flip the camera, for example, switch the rear camera to the front camera.

[0190] The electronic device 100 can detect a user operation acting on the shooting mode option. This user operation can be used to select a shooting mode. In response to this operation, the electronic device 100 can enable the shooting mode selected by the user. In particular, when this user operation acts on the more shooting mode option 212E, the electronic device 100 can further display more other shooting mode options, such as the slow-motion shooting mode option, etc., and can show users richer camera functions. Not limited to Figure 2E As shown, the more shooting mode option 212E may not be displayed in the shooting mode list 212. The user can browse other shooting mode options by swiping left / right in the shooting mode list 212.

[0191] As Figure 2F As shown, both a lighter-colored image and a darker-colored image are simultaneously displayed in the preview frame 211. Among them, the lighter-colored image is a picture 208 with a certain transparency or blurred, and the darker-colored image is the image captured by the camera 193 in real time.

[0192] In the preview frame 211, the position of the image 208 with a certain degree of transparency or blur remains unchanged. At the same time, when the user uses the electronic device 100 to shoot, the framing of the currently used camera in the preview frame can be changed by moving the electronic device. That is, the user can change the framing of the camera 193 by moving the electronic device, thereby changing the image captured in real time by the camera 193 displayed in the preview frame 211. For example, the user can move the electronic device to the left or right or forward or backward, or walk around with the electronic device in hand. In some other embodiments, the user can also adjust the focal length of the currently used camera (such as electronic focus), or change the currently used camera (for example, replace the rear camera with the front camera), etc., so as to change the image captured by the camera displayed in real time in the preview frame 211. In some other embodiments, the position of the human object, animal object, etc. captured by the camera 193 can also be indicated to change, thereby adjusting the framing in the preview frame 211.

[0193] The preview frame 211 can show the user the relative positions of various objects in the image 208 and the image captured in real time by the camera 193. According to the content presented in the preview frame 211, the user can adjust the image captured by the camera displayed in real time in the preview frame 211, so that the image captured by the camera contains object B and the object B is in a relative position with the object A in the image 208 that the user is satisfied with. The object that needs to be photographed with object A is called object B.

[0194] like Figure 2F As shown, the picture 208 includes an object A and a background area, and the background area shows the location of the object A, for example Figure 2F The background area of ​​the picture 208 displayed in the preview frame 211 shows that the location of the object A includes coconut trees, seagulls, a hillside, and the sun.

[0195] In some embodiments, when there is a certain correlation between the position indicated by the background area of the real-time image captured by the camera displayed in the preview frame 211 and the position indicated by the picture 208 (such as, but not limited to, the position indicated by the background area of the picture 208), the control 213 can be activated. In other cases, even if the control 213 receives a user operation, the electronic device 100 will not perform subsequent responses. After the control 213 is activated, the user can make the image captured by the camera contain the object B and when the object B is in a satisfactory relative position with respect to the object A in the picture 208, click the control 213, thereby triggering the electronic device 100 to save the image captured by the camera 193 and perform a fitting operation on it and the picture 208. That is, only when there is a certain correlation between the position indicated by the picture 208 and the position indicated by the image captured in real time by the camera 193 of the current electronic device 100 can the user trigger the electronic device 100 to capture an image and perform subsequent fitting operations.

[0196] In some other embodiments, the control 213 can always be activated. As long as the user makes the image captured by the camera contain the object B and the object B is in a relative position that satisfies the user with respect to the object A in the picture 208, the user can click the control 213, thereby triggering the electronic device 100 to save the image captured by the camera 193 and perform a fitting operation on it and the picture 208.

[0197] Reference Figure 2F , in Figure 2F the image captured by the camera 193 contains a human object, and this human object can be the object B. Since the user is not very satisfied with the relative position between the object B and the object A in Figure 2F , the user adjusts the viewfinder of the camera 193 in the preview frame 211, thereby adjusting the object B and the object A in the preview frame 211 to a satisfactory relative position as shown in Figure 2G .

[0198] As shown in Figure 2G , the electronic device 100 can detect a user operation (such as a click operation, a touch operation, etc.) acting on the control 213. In response to this operation, the electronic device 100 can save the image captured by the camera 193 and perform a fitting operation on it and the picture 208, thereby generating a picture in the picture library. The specific implementation of this fitting operation can refer to the detailed introduction in the subsequent method embodiments. In addition, referring to Figure 2H , the electronic device 100 can also display the thumbnail of the picture generated after the fitting operation in the control 214 for the user to click and view.

[0199] In some embodiments, when the electronic device 100 fits the image captured by the camera 193 with the picture 208, it is possible that the fitting fails and the corresponding composite image cannot be generated. For example, when the correlation between the background area of the image captured by the camera 193 and the picture 208 is low, the electronic device 100 cannot successfully perform the fitting operation.

[0200] After the electronic device 100 takes a photo and performs a fitting operation in response to a user operation on the control 213, the electronic device 100 can continuously turn on the "group photo" function, so that the user can take multiple photos to achieve the purpose of taking multiple group photos. In some other embodiments, after the electronic device takes a photo and performs a fitting operation in response to a user operation on the control 213, it can also turn off the "group photo" function and enter the normal photo-taking mode.

[0201] Not limited to Figures 2E - 2G The shown photo-taking mode, the user can also select the video recording mode or other modes, and the electronic device 100 can also take pictures in the video recording mode or other modes to achieve the purpose of taking group photos in the video or other modes.

[0202] Figures 3A - 3F Exemplarily shows another set of user interfaces provided by the electronic device 100 in the embodiments of the present application for group photos.

[0203] Figures 3A - 3E and Figures 2A - 2G The difference is that the entry of the "group photo" function is different in the two group photo methods.

[0204] Figure 3A The shown user interface 31 and Figure 2A The shown user interface 21 are the same, and reference can be made to the foregoing Figure 2A And related descriptions.

[0205] Figure 3B Exemplarily shows the user interface 32 provided by the camera application of the electronic device 100.

[0206] Figure 3B It can be that after the electronic device 100 detects a user operation (such as a click operation, a touch operation) on the icon 205a of the camera application in Figure 3A , in response to the user operation, it starts the camera application and displays the user interface. The user interface 32 can be the user interface of the default photo-taking mode of the camera application, and can be used for the user to take photos through the default rear camera.

[0207] Such as Figure 3B As shown, the user interface 32 may include: an area 301, a shooting mode list 302, controls 303, controls 304 and control 305, and a control 306 for starting the "group photo" function. Among them:

[0208] The area 301 can be referred to as the preview frame 301 or the viewfinder 301. The preview frame 301 can be used to display the image captured in real time by the camera 193 of the electronic device 100. The electronic device 100 can refresh the display content therein in real time so as to facilitate the user to preview the image currently captured by the camera 193.

[0209] One or more shooting mode options can be displayed in the shooting mode list 302. These one or more shooting options can include: a photo shooting mode option 302A, a video recording mode option 302B, a portrait mode option 302C, a panoramic mode option 302D, and more options 302E.

[0210] The control 303 can be used to monitor the user operation that triggers shooting (taking a photo or recording a video). The electronic device can detect the user operation acting on the control 303 (such as a click operation on the control 303). In response to this operation, the electronic device 100 can save the image displayed in the preview frame 211. When the user switches to the video recording mode, the control 303 can be changed to the corresponding video recording control. The electronic device can detect the user operation acting on the video recording control. In response to this operation, the electronic device 100 can save the image displayed in the preview frame 211. In addition, the electronic device 100 can also display a thumbnail of the saved image in the control 304. That is to say, the user can click the control 303 or the video recording control to trigger shooting. Among them, the control 303 or the video recording control can be a button or other forms of controls. In this application, the control 303 can be referred to as the photo shooting control. The photo shooting control and the video recording control can be collectively referred to as the shooting control.

[0211] The control 305 can be used to monitor the user operation that triggers flipping the camera. The electronic device 100 can detect the user operation acting on the control 305 (such as a click operation on the control 305). In response to this operation, the electronic device 100 can flip the camera, for example, switch the rear camera to the front camera.

[0212] The electronic device 100 can detect the user operation acting on the shooting mode option. This user operation can be used to select a shooting mode. In response to this operation, the electronic device 100 can turn on the shooting mode selected by the user.

[0213] The control 306 can be used to monitor user operations (such as click operations, touch operations, etc.). The electronic device 100 can, in response to this user operation, display in the user interface 33 such as Figure 3CThe picture area 307 shown. One or more pictures may be displayed in the picture area 307, such as picture 307a. When the electronic device detects an upward or downward sliding operation in the picture area 307, in response to the sliding operation, the electronic device may update the pictures displayed in the picture area 307 so that the user can view the pictures. That is to say, the user can slide up or down in the picture area 307 to view more pictures. Not limited to the upward or downward sliding operation, the user can also slide left or right in the picture area 307 to view more pictures. The pictures displayed in the picture area 307 may be thumbnails. At this time, the original pictures corresponding to the pictures displayed in the picture area 307 may be stored on the electronic device or on the cloud server.

[0214] Prompt information 307b may also be displayed in the picture area 307. The prompt information 307b is used to prompt the user to select a picture from the pictures displayed in the picture area 307 as a group photo.

[0215] The electronic device 100 can detect a user operation (such as a click operation, a touch operation, etc.) acting on the picture 307a, and in response to the operation, start the "group photo" function for the original picture corresponding to the picture 307a, and display Figure 3D The user interface 34 shown.

[0216] As Figure 3D shown, after starting the "group photo" function, the electronic device 100 can change the display form of the control 306 (for example, can change its display color, change its display shape, or as Figure 3D shown change the hollow circle to a solid circle, etc.) to prompt the user that the "group photo" function of the current electronic device 100 has been enabled.

[0217] In Figure 3D the user interface 34 shown, after the electronic device 100 enables the "group photo" function, the preview frame 301 displays a picture 208 with a certain transparency or blurred, and the image captured by the camera 193 in real time. The picture 208 may be Figure 3C the original picture corresponding to the picture 307a shown. The electronic device 100 can refresh the display content therein in real time so that the user can preview the image captured by the camera 193 currently. The electronic device 100 can superimpose and display the picture 208 with a certain transparency or blurred on the image captured by the camera 193 in real time. Since the picture 208 has a certain transparency and / or is blurred, the user can not only see the picture 208 in the preview frame 211, but also see the image captured by the camera 193 under the picture 208.

[0218] Figure 3DThe functions of the preview frame 301, the shooting mode list 302, and the controls 304 - 305 in the user interface 34 can all be referred to Figure 2F for the functions of the corresponding controls. It can be considered that Figure 3D and Figure 2G except for the difference in the control 306, other areas or controls are the same.

[0219] Refer to Figure 3D , in Figure 3D , the image captured by the camera 193 contains a human object, and this human object can be object B. Since the user is not satisfied with the relative positions of object B and object A in Figure 3D , the user adjusts the viewfinder of the camera 193 in the preview frame 301, thereby adjusting object B and object A in the preview frame 301 to the satisfactory relative positions as shown in Figure 3E .

[0220] As shown in Figure 3E , the electronic device 100 can detect a user operation (such as a click operation, a touch operation, etc.) acting on the control 303. In response to this operation, the electronic device 100 can save the image collected by the camera 193 and perform a fitting operation with the original image corresponding to the picture 307a, thereby generating a picture in the gallery. The specific implementation of this fitting operation can be referred to the detailed introduction in the subsequent method embodiments. In addition, refer to Figure 3F , the electronic device 100 can also display the thumbnail of the picture generated after the fitting operation in the control 304 for the user to click and view.

[0221] In some embodiments, when the electronic device 100 fits the image collected by the camera 193 with the original image corresponding to the picture 307a, it is possible that the fitting fails and the corresponding composite image cannot be generated. For example, when the correlation between the background area of the image collected by the camera 193 and the original image corresponding to the picture 307a is relatively low, the electronic device 100 cannot successfully perform the fitting operation.

[0222] Figures 4A - 4B Exemplarily shows the user interface provided by the gallery application after the electronic device 100 in the embodiment of the present application saves the fitted picture.

[0223] Figure 4A It can be that after the electronic device 100 detects a user operation (such as a click operation, a touch operation) acting on Figure 2A or Figure 3A the icon 206a of the gallery application in Figure 4A , the user interface shown in Figure 2B is displayed in response to this user operation. The user interface shown in Figure 4AAs shown, a new picture 207b is added to the picture area 207 shown in the user interface 41. The picture 207b can be a thumbnail or the original picture of the fitted picture saved by the electronic device 100.

[0224] As Figure 4A shown, after the electronic device 100 detects a user operation (such as a click operation or a touch operation) on the picture 207b, it can respond to this operation and display the original picture corresponding to the picture 207b, such as picture 401, in a larger area in the Figure 4B shown user interface. In some other embodiments, Figure 4B the shown user interface 43 can also be displayed by the electronic device 100 in response to a user operation on the Figure 2H shown control 214, or, on the Figure 3F shown control 304.

[0225] In some embodiments, Figure 4A on the picture 207b shown in Figure 4B , or, on the picture 401 shown, a "group photo" identifier can also be displayed to indicate that this picture is taken by the electronic device 100 after the "group photo" function is turned on. The implementation form of this "group photo" identifier is not limited in the embodiments of the present application. For example, it can be text, an icon, etc.

[0226] Based on the electronic device 100 and the user interface implemented on the electronic device 100 introduced above, the shooting method provided by the embodiments of the present application will be introduced below.

[0227] Referring to Figure 5 , Figure 5 the process of this shooting method is exemplarily shown. Figure 5 The shown shooting method is described by taking a photo-taking scenario as an example.

[0228] As Figure 5 shown, this shooting method may include the following steps:

[0229] S101, the electronic device 100 detects a first operation for turning on the "group photo" function for a first picture.

[0230] S102, in response to this first operation, the electronic device 100 turns on the "group photo" function for the first picture, and the first picture includes object A.

[0231] Specifically, the first picture can be a picture taken by the camera 193 saved by the electronic device 100, or a picture downloaded by the electronic device 100 from the network, or a picture shared by other devices received. The first picture can be a photo taken a long time ago, or a picture just taken by the electronic device 100. The first picture contains the object that the user wants to take a group photo with, and this object can be called object A. The number of object A can be one or more. Object A can include, for example, but is not limited to: people, animals, landmarks, buildings, dolls, and so on. For example, the first picture can also be an old photo taken by a relative many years ago, and so on.

[0232] Exemplarily, the first picture can be, for example, Figure 2C the original picture corresponding to the shown picture 207a, Figure 2C the shown picture 208, Figure 3C the original picture corresponding to the shown picture 307a, or, Figure 3D the shown picture 301. Object A can be the human object in the above pictures.

[0233] The "group photo" function is provided by the electronic device 100. This function supports the electronic device 100 to display the first picture with transparency or blurring in the preview interface provided by the camera application, and at the same time display the image collected by the camera 193 of the electronic device 100. When the electronic device 100 receives the user input of the shooting instruction, it fits the first picture and the image collected by the camera to generate a composite image. After the "group photo" function is turned on, the electronic device will perform subsequent operations.

[0234] In some embodiments, referring to the foregoing Figures 2A - 2D and related descriptions, the first operation for turning on the "group photo" function for the first picture can be, for example, after the operation on the control 209 in the Figure 2C shown user interface 23 displaying the picture 208, the user operation on the control 210a in the function list 210 displayed on the electronic device 100. The control 209 can also be called the first control, and the control 210a can also be called the second control.

[0235] In some embodiments, the first operation for turning on the "group photo" function for the first picture can be, for example, the long-press operation received by the electronic device 100 on the Figure 2B shown picture 207a, or the circle-drawing gesture received by the electronic device 100 on the Figure 2B shown picture 207a, or the long-press operation received by the electronic device 100 on the Figure 2C shown picture 208.

[0236] In an embodiment of the present application, the user interface provided by the gallery application for displaying the first picture may be referred to as the first user interface. For example, Figure 2C , Figure 2D Both can be referred to as the first user interface.

[0237] In some embodiments, referring to the foregoing Figures 3A - 3C and related descriptions, the first operation for enabling the "duet" function for the first picture may be, for example, that after the electronic device 100 receives a user operation on the control 306 in Figure 3B , the user operation on the picture 307a in the picture area 307 displayed on the electronic device 100. The control 306 may also be referred to as the third control, the user operation on the control 306 may also be referred to as the fourth operation, and the user operation on the picture 307a may also be referred to as the fifth operation.

[0238] Among them, Figure 3B The user interface shown may not only be provided by the camera application, but also be the user interface provided by other applications (such as social applications, shopping applications, etc.) in the electronic device by calling the camera interface. Equivalently, other applications in the electronic device can call the camera interface, and then enable the "duet" function. The user interface provided by the camera application or by other applications calling the camera interface for enabling the "duet" function, such as Figure 3B , Figure 3C The user interface shown can be referred to as the second user interface.

[0239] Not limited to this, the first operation for enabling the "duet" function for the first picture can also be implemented as a voice control command, a gesture in the air command, a pressing operation on a physical button, and so on. The present application does not limit the specific implementation of the first operation.

[0240] S103. The electronic device 100 starts the camera application and displays the second user interface. The second user interface displays a preview frame, and the preview frame displays the first picture with transparency and / or blurring, and the image captured by the camera 193.

[0241] After the electronic device 100 enables the "duet" function for the first picture, it can automatically start the camera application. The camera application can be a system application installed in the electronic device 100 or a third-party application.

[0242] Specifically, after the electronic device 100 starts the camera application, it can display a second user interface provided by the camera application. The second user interface displays a preview frame, and the preview frame displays a first picture with transparency and / or blurring, as well as the image captured by the camera 193 in real time. Here, the second user interface can also be referred to as a preview interface. In some embodiments, the electronic device 100 can superimpose and display the first picture with transparency and / or blurring on the image captured by the camera 193 in real time.

[0243] Among them, if the first picture has transparency, the user can both see the first picture and see other content covered by the first picture with transparency on the electronic device 100 through it. The size of the transparency of the first picture can be preset, or can be adjusted by the user according to actual needs, or can be adjusted according to the light in the environment where the current electronic device 100 is located, or according to the brightness of the image captured by the current camera 193, and so on.

[0244] If the first picture is blurred, the electronic device 100 can first identify the outline or content of the first picture, depict its outline or content with a dotted line, or blur its content to obtain the blurred first picture. In this case, the user can also both see the first picture and see other content covered by the blurred first picture on the electronic device 100 through it.

[0245] The image captured by the camera 193 in real time displayed in the preview frame of the second user interface is refreshed in real time. When the user moves the electronic device 100 or changes the posture of the electronic device 100, changes the used camera, or the object captured by the current camera 193, such as a person or an animal, changes its location, etc., the image captured by the camera 193 will change in real time, and the changed image will be displayed in the preview frame in real time.

[0246] In addition, the image captured by the camera 193 in real time displayed in the preview frame can also be obtained after processing on the original image captured by the camera 193. For example, the electronic device 100 can perform anti-shake processing on the original image captured by the camera 193 and then send it to the display screen to be displayed in the preview frame. Another example is that if the user adjusts the focal length of the camera 193, the electronic device 100 will crop the original image captured by the camera 193 and send the cropped result to the display screen to be displayed in the preview frame. Another example is that the user can select the current shooting mode, and in different modes, the electronic device 100 can perform different processing on the original image captured by the camera 193. For example, in portrait mode, the background area is blurred, etc., and then the cropped result is sent to the display screen to be displayed in the preview frame.

[0247] Exemplarily, referring to Figures 2F - 2G , the second user interface may be, for example, Figures 2F - 2G the user interface 22 shown, and the preview box may be, for example, Figures 2F - 2G the preview box 211 in Figures 2F - 2G The lighter - colored picture 208 shown in

[0248] Exemplarily, referring to Figures 3D - 3E , the second user interface may be, for example, Figures 3D - 3E the user interface 34 shown, and the preview box may be, for example, Figures 3D - 3E the preview box 301 in Figures 3D - 3E The lighter - colored picture 208 shown in

[0249] It can be seen that the preview box in the second user interface can show the relative positions of the objects in the first picture and the images captured in real - time by the camera 193 to the user. The user can adjust the image captured by the camera and displayed in real - time in the preview box according to the content presented in the preview box, so that the relative positions of the objects included in the image captured by the camera and object A in the first picture meet the actual needs of the user. Among them, the ways for the user to adjust the image captured by the camera and displayed in real - time in the preview box may include, but are not limited to: the user moves the electronic device 100 or changes the posture of the electronic device 100, the user changes the camera used by the electronic device 100, or the user instructs the object (such as a person or an animal) captured by the current camera 193 to change its position, etc. Exemplarily, referring to Figures 2F - 2G or referring to Figures 3D - 3E , the user can adjust the relative position between the human object included in the image captured by the camera 193 and object A (i.e., the human object in the figure) in the first picture.

[0250] In the embodiments of the present application, in addition to displaying the first picture with transparency or blurring in the second user interface provided by the camera application to indicate the first picture, the electronic device 100 can also display the lines of the object included in the first picture, the location of the object in the first picture, the faded first picture, etc., so as to display the first picture in the preview frame, so that the user can know the relative position between the object in the first picture and the object in the image captured by the camera 193 in real time. The information used to prompt the relative position between the object in the first picture and the object in the image captured by the camera 193 in real time can be referred to as the indication information of the first picture. For example, the indication information of the first picture may include the first picture with transparency or blurring displayed in the preview frame, the lines of the object included in the first picture, the location of the object in the first picture, the faded first picture, etc. The embodiments of the present application do not limit this.

[0251] S104, the electronic device 100 receives a second operation.

[0252] S105, in response to the second operation, the electronic device 100 fits the first picture and the image captured by the camera 193 to generate a composite image.

[0253] The second operation may be a user operation for triggering the electronic device 100 to take a photo or record a video. The user operation for triggering the electronic device 100 to take a photo may also be referred to as a photo-taking instruction. The user operation for triggering the electronic device 100 to record a video may also be referred to as a video-recording instruction.

[0254] Exemplarily, referring to Figures 2F - 2G , for example, the second operation may be a user operation acting on the photo-taking control 213, or may also be a user operation acting on the video-recording control after the user selects the video-recording mode. Referring to Figures 3D - 3E , the second operation may also be a user operation acting on the photo-taking control 303, or a user operation acting on the video-recording control after the user selects the video-recording mode.

[0255] In some embodiments, only when the correlation between the position indicated by the image captured by the camera 193 displayed in the preview frame of the second user interface and the position indicated by the first picture is greater than a first value, will the electronic device 100 respond to the second operation. Among them, the correlation between pictures refers to the degree of similarity and matching in the relative positions of each picture. If the correlation between two pictures is large, it indicates that the content included in the two pictures is similar, and the two pictures may be taken from the same location with a similar perspective. The first value can be set in advance and is not limited here. For example, referring to the previous text Figures 2E - 2GRegarding the related description, when there is a certain correlation between the position indicated by the background area of the real-time image captured by the camera displayed in the preview box 211 and the position indicated by the picture 208 (such as but not limited to the position indicated by the background area of the picture 208), the control 213 can be activated. In other cases, even if the control 213 receives a user operation, the electronic device 100 will not perform subsequent responses.

[0256] In some other embodiments, after the electronic device 100 displays the second user interface, if it receives a second operation, it will immediately respond to the second operation. For example, referring to the related description above Figures 2E - 2G the control 213 can be always activated. As long as the object included in the image captured by the user's camera is in a relative position that satisfies the user and the object A in the picture 208, the user can click the control 213, thereby triggering the electronic device 100 to respond to the operation and perform subsequent steps.

[0257] The following will combine Figures 6A - 6B several image processing processes shown below to introduce how the electronic device 100 fits the first picture and the image captured by the camera 193 to generate a composite image. This process may specifically include the following steps:

[0258] Step 1. Identify the object in the image captured by the camera, and this object can be called object B.

[0259] Specifically, the electronic device 100 can identify relatively iconic objects such as people, animals, landmarks, buildings, dolls, etc. in the image captured by the camera as object B. In some other embodiments, the electronic device 100 can also identify the object closest to the camera as object B according to the distances between the objects in the image captured by the camera and the camera. In some other embodiments, the user can also select an object as the object B in the image captured by the camera displayed in the preview box. For example, the user can click on the position where the desired object is located in the preview box, and then the electronic device 100 can automatically circle the human body or scenery at this position, and the object B can be selected without the user manually drawing the outlines of people and objects.

[0260] In some embodiments, the electronic device 100 can identify the object B included in the image captured by the camera through an image recognition algorithm. The image recognition algorithm can be, for example, an artificial intelligence (AI) algorithm.

[0261] In the embodiments of the present application, the number of object Bs identified by the electronic device 100 can be one or multiple, and there is no limitation here.

[0262] Exemplarily, referring toFigures 6A - 6B , Figures 6A - 6B Each (a) in each of the above figures shows a frame of image captured by the camera of the electronic device 100. The object B in the image recognized by the electronic device 100 is a male character object as shown in the figure. Figure 6B The focal length used in (a) is greater than that used to collect Figure 6A The focal length used in (a).

[0263] Step 2: In the image captured by the camera, a main area including object B is determined based on object B.

[0264] In some implementations, the main area may be an area including the object B obtained by extending a distance M around the object B in the image captured by the camera.

[0265] M may be an empirical value obtained through testing. In some embodiments, the M value of the same electronic device may be the same, the M value of different electronic devices may be different, or the M value corresponding to different cameras on the same electronic device may be different. This ensures that a main area containing object B can be obtained in images captured by different electronic devices or different cameras.

[0266] Setting the M value through empirical values ​​can ensure that the electronic device finds an accurate main area, which can ensure the integrity of the object B in the main area and avoid excessive expansion of the range, thereby ensuring the effect of subsequent fitting.

[0267] In some embodiments, M may be a single value or a set of values. When M is a set of values, each value in the set of values ​​may be different, that is, the electronic device 100 may expand different distances around different positions based on the object B, thereby obtaining a main area including the object B.

[0268] For example, reference Figures 6A - 6B (b) in the figure, the area enclosed by the dotted line is a possible main area containing object B. Figures 6A - 6B The size and position of the contents contained in the images collected by the cameras may be different.

[0269] In other embodiments, the main area may be an area with a color or pixel similar to or the same as that of object B, which is expanded around object B in the image captured by the camera.

[0270] Step 3: Perform a correlation search for the main area in the first image to find a co-located area with a correlation greater than a second value.

[0271] Specifically, performing a correlation search for the main area in the first image means first finding the background area other than the main area in the image captured by the camera, and then identifying the area in the first image whose correlation with the background area is greater than the second value and / or the area with the highest correlation, and the rest of the first image excluding the area is the co-location area. This is equivalent to the correlation of the rest of the first image other than the co-location area and the rest of the image captured by the camera other than the main area being greater than the second value. The second value can be preset, and the embodiment of the present application does not limit this.

[0272] The present application does not limit the size, shape, and position of the co-location area in the first image. The position of the co-location area in the first image is the same as the position of the main area containing object B in the image captured by the camera. In this way, the relative positions of object A and object B presented to the user in the preview frame by the electronic device 100 are the same as the relative positions of object A and object B in the composite image after fitting, so that the user can adjust the group photo effect in real time according to the content in the preview frame. In some embodiments, the size and shape of the co-location area in the first image and the size and shape of the main area containing object B in the image captured by the camera can be the same or different.

[0273] For example, reference Figure 6A In (b) and (c), the size, shape, and position of the co-located area in the first image and the main area in the image captured by the camera are all the same.

[0274] For example, reference Figure 6B In (b) and (c), the co-located area in the first image and the main area in the image captured by the camera have the same shape and position, and the size of the co-located area in the first image is larger than the size of the main area in the image captured by the camera.

[0275] Through step 3, if the electronic device 100 can find the same location area corresponding to the main area in the first picture, it means that the geographical location where the first picture was taken is the same or similar to the geographical location where the current electronic device 100 takes the image, thus achieving a group photo at the same place or a similar place. In addition, since they are at the same place or a similar place, the light and background in the first picture are similar to the light and background of the image taken by the camera, which can greatly improve the fitting effect in the subsequent step 4, thereby achieving a better group photo effect. This distinguishes the shooting method provided in the embodiment of the present application from a simple cutout group photo, and this method can bring a more natural group photo effect.

[0276] In some embodiments, after the electronic device 100 displays the second user interface, if it immediately responds to the second operation upon receiving the second operation, the uncertainty of the image currently captured by the camera may cause step 3 to fail, that is, the electronic device 100 cannot find the corresponding co-location area in the first image. In this case, the electronic device 100 may output a prompt message to prompt the user that the current synthesis fails.

[0277] Step 4: Fit the main area to the co-located area of ​​the first image, keep the rest of the area of ​​the first image unchanged, and generate a composite image.

[0278] Specifically, the electronic device can enlarge or reduce the main area containing the object B captured by the camera, and then fuse the main area into the same area of ​​the first picture, and perform transitional smoothing on the fused boundary. This is equivalent to the electronic device replacing the same area in the first picture with the enlarged or reduced main area or the original main area, and also performing transitional smoothing on the boundary between the main area and the first picture, so that the final composite image looks natural.

[0279] For example, reference Figure 6A If the co-located area and the main area have the same size, the electronic device 100 replaces the co-located area in (c) with the main area and performs transitional smoothing on the boundary to generate a composite image as shown in (d).

[0280] For example, reference Figure 6B , the electronic device 100 enlarges the main area, uses the enlarged main area to replace the co-located area in (c), and performs transitional smoothing on the boundary to generate a composite image as shown in (d).

[0281] Through the above steps 1-4, object B can be smoothly and naturally integrated into the first picture containing object A, generating a composite object containing both object A and object B, thereby obtaining a natural and high-quality group photo effect.

[0282] When the electronic device 100 executes S104-S105 in the camera mode, the image captured at the moment of receiving the camera command and the first picture can be fitted to generate a composite image. In other embodiments, the electronic device 100 can save the moment of receiving the camera command and the N frames of images previously captured by the camera 193 in real time, and fit each of the N frames of images with the first picture to generate an N-frame composite image.

[0283] When the electronic device 100 executes S104 - S105 in the video recording mode, it can fit multiple frames of images captured by the camera 193 between the moment when the video recording instruction is received and the moment when the stop video recording instruction is received, respectively, with the first image to generate multiple synthesized images.

[0284] In the above process, the relative positions of object A and object B in the group photo are shown to the user in a superimposed display manner in the preview interface, and the fitting operation between the first picture and the images captured by the camera starts only after the first operation is received. This way can save the power consumption and processing capacity of the electronic device.

[0285] S106, the electronic device 100 saves the synthesized image.

[0286] If the electronic device 100 executes S104 - S105 in the photo-taking mode and only fits the image captured at the moment when the photo-taking instruction is received with the first picture to generate a synthesized image, then the electronic device 100 can save the generated single-frame synthesized image in the picture format to the memory. If the electronic device fits the moment when the photo-taking instruction is received and the N frames of images captured by the camera 193 before that, respectively, with the first picture to generate N frames of synthesized images, then the electronic device 100 can select the frame with the best quality from the N frames of synthesized images and save it in the picture format to the memory. Here, the electronic device 100 can select the frame with the best quality from the N frames of synthesized images by means of artificial intelligence learning. Among them, the quality of the synthesized image can be evaluated by any one or more of the following parameters: peak signal to noise ratio (PSNR) and mean square error (MSE), mean absolute error (MAE) and signal to noise ratio (SNR).

[0287] In some other embodiments, if the electronic device 100 executes S104 - S105 in the photo-taking mode and the electronic device fits the moment when the photo-taking instruction is received and the N frames of images captured by the camera 193 before that, respectively, with the first picture to generate N frames of synthesized images, then the user can select a satisfactory synthesized image from the N frames of synthesized images and store it in the memory, and delete the remaining synthesized images.

[0288] In the above embodiments, the synthesized image (i.e., the synthesized picture) maintained by the electronic device 100 when executing S104 - S106 in the photo-taking mode can also be referred to as the second picture.

[0289] If the electronic device 100 executes S104 - S105 in the video recording mode, multiple frames of synthesized images generated by respectively fitting multiple frames of images collected by the video recording device camera 193 with the first image can be stored in the memory in video format, that is, the multiple frames of synthesized images are saved as a video file.

[0290] After the electronic device 100 saves the synthesized image, it can view the synthesized image and can also perform operations such as editing, moving, and sharing on the synthesized image. The operation for viewing the synthesized image can also be referred to as the third operation.

[0291] Exemplarily, referring to Figures 4A - 4B , the electronic device 100 generates a synthesized image in the photo - taking mode, Figure 4B a thumbnail 207b of the synthesized image is shown in the picture area 207 provided by the gallery application as shown. After the electronic device 100 receives a user operation on the thumbnail 207b, it can display the original image of the thumbnail 207b as shown in Figure 4B , that is, the synthesized image generated by the electronic device 100.

[0292] In some embodiments, after generating the synthesized image, the electronic device 100 can also use the synthesized object as the first picture and execute the shooting method described in S101 - S106 above once or multiple times, so as to achieve the purpose of taking multiple group photos. For example, the same user can first use their own photo as the first picture, and then take multiple group photos of themselves and the self in the first picture, achieving multiple group photos of the same person at the same location.

[0293] In some embodiments, if the first picture is an old photo taken by a relative many years ago, then through the shooting method described in S101 - S106 above, the user can take a cross - time and space group photo with their relative at the same location at different times.

[0294] In steps 1 - step 4 specifically included in S105 above, the electronic device 100 specifically fits the area where object B is located in the image collected by the camera 193 to the first picture to obtain the synthesized image. Not limited to this, in some other embodiments of the present application, the electronic device 100 can also fit the area where object A is located in the first image to the image collected by the camera 193 to obtain the synthesized image. Specifically, this embodiment may include the following steps:

[0295] Step 1. Identify the object in the first picture, and this object can be called object A;

[0296] Step 2. In the first picture, determine the main area containing object A with object A as the reference;

[0297] Step 3. Perform a correlation search for the main area in the image captured by the camera to find the same location area whose correlation is greater than the second value;

[0298] Step 4: Fit the main area to the same area of ​​the image captured by the camera, keep the rest of the image captured by the camera unchanged, and generate a composite image.

[0299] The specific implementation of the above steps can refer to the implementation of the steps in S105 above, which will not be repeated here.

[0300] Through the above implementation, the area where object A in the first image is located is fitted into the image captured by camera 193 to obtain a composite image. If the first picture is an old photo, the object in the old photo can be extracted and integrated into the newly taken image to achieve the renovation of the old photo.

[0301] In the above-mentioned implementation manner of the present application, object A in the first picture may also be referred to as the first object, and object B in the image captured by the camera may also be referred to as the second object.

[0302] In the above Figure 5 In the shooting method shown, the electronic device 100 now superimposes and displays the first picture and the image collected by the camera in the preview interface, and then generates a composite image after receiving the first operation. Not limited to this, in some other embodiments of the present application, the electronic device 100 can also directly perform the operation of fitting and generating a composite image after starting the camera application, and directly display the composite image in the preview interface. Specifically, after the electronic device 100 executes S101-S103 of the above method, it starts the camera application, collects images in real time through the camera 193, and the electronic device 100 fits each frame of image collected in real time by the camera 193 with the first picture to obtain a multi-frame composite image, and displays the multi-frame composite image in the preview frame of the preview interface (i.e., the second user interface in the previous text) in chronological order. If a photo taking instruction is received afterwards, the composite image displayed in the preview frame is saved as a picture, and if a video recording instruction is received, the multi-frame composite image displayed in the preview frame during the video recording is saved as a video. This real-time synthesis and real-time display of the composite image requires the electronic device 100 to have a strong processing capability. This method can display the group photo effect to users in real time in the preview box, allowing users to experience the group photo effect more intuitively.

[0303] It should be understood that each step in the above method embodiment can be completed by an integrated logic circuit of hardware in a processor or by instructions in the form of software. The method steps disclosed in the embodiments of the present application can be directly embodied as being executed by a hardware processor, or by a combination of hardware and software modules in a processor.

[0304] The present application further provides an electronic device, which may include: a memory and a processor. Among them, the memory can be used to store computer programs; the processor can be used to call the computer programs in the memory, so that the electronic device executes the method of the electronic device 100 in any of the above embodiments.

[0305] The present application further provides a chip system, which includes at least one processor for implementing the functions involved in the electronic device 100 side in any of the above embodiments.

[0306] In a possible design, the chip system further includes a memory, which is used to store program instructions and data, and the memory is located inside or outside the processor.

[0307] The chip system can be composed of chips, or can include chips and other discrete devices.

[0308] Optionally, the processor in the chip system can be one or more. The processor can be implemented by hardware or by software. When implemented by hardware, the processor can be a logic circuit, an integrated circuit, etc. When implemented by software, the processor can be a general-purpose processor, which is implemented by reading the software code stored in the memory.

[0309] Optionally, the memory in the chip system can also be one or more. The memory can be integrated with the processor or can be separately arranged from the processor, which is not limited in the embodiments of the present application. Exemplarily, the memory can be a non-transitory processor, such as a read-only memory ROM, which can be integrated with the processor on the same chip or can be separately arranged on different chips. The embodiments of the present application do not make specific limitations on the type of the memory and the setting manner of the memory and the processor.

[0310] Exemplarily, the chip system may be a field programmable gate array (FPGA), may be an application specific integrated circuit (ASIC), may also be a system on chip (SoC), may also be a central processor unit (CPU), may also be a network processor (NP), may also be a digital signal processor (DSP), may also be a micro controller unit (MCU), may also be a programmable logic device (PLD), or other integrated chips.

[0311] The present application also provides a computer program product, which includes: a computer program (which may also be referred to as code, or instruction). When the computer program is run, it causes the computer to execute the method performed on the electronic device 100 side in any one of the above embodiments.

[0312] The present application also provides a computer-readable storage medium, which stores a computer program (which may also be referred to as code, or instruction). When the computer program is run, it causes the computer to execute the method performed on the electronic device 100 side in any one of the above embodiments.

[0313] The various embodiments of the present application can be combined arbitrarily to achieve different technical effects.

[0314] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions described in this application are generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (such as coaxial cable, optical fiber, digital subscriber line) or wireless (such as infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that the computer can access or a data storage device such as a server or data center that includes one or more integrated available media. The available medium can be a magnetic medium (such as a floppy disk, hard disk, magnetic tape), an optical medium (such as a DVD), or a semiconductor medium (such as a solid-state disk (SSD)), etc.

[0315] Those of ordinary skill in the art can understand that all or part of the processes in the above method embodiments can be completed by instructing relevant hardware with a computer program. The program can be stored in a computer-readable storage medium. When the program is executed, it can include the processes of the above method embodiments. The foregoing storage medium includes various media that can store program codes, such as ROM or random access memory RAM, magnetic disks, or optical discs.

[0316] In summary, the above description is only an embodiment of the technical solution of this application and is not used to limit the protection scope of this application. Any modifications, equivalent replacements, improvements, etc. made based on the disclosure of this application shall be included within the protection scope of this application.

Claims

1. A shooting method, characterized in that, The method includes: The electronic device starts the gallery application and displays a first user interface, in which a first picture is displayed, and the first picture contains a first object; The electronic device receives a first operation on the first picture; The electronic device starts the camera application and displays a second user interface, in which a preview frame is displayed, and the preview frame displays an image captured by the camera of the electronic device, as well as the first picture with transparency and / or the blurred first picture; The electronic device receives a second operation for taking a photo; When the correlation between the position indicated by the image captured by the camera and the position indicated by the first picture is greater than a first value, the electronic device stores a second picture in response to the second operation, and the second picture is obtained by fitting the image captured by the camera and the first picture. The image captured by the camera contains a second object, and the second picture contains the first object and the second object.

2. The method according to claim 1, wherein Before the electronic device stores the second picture after receiving the second operation, the method further includes: The electronic device identifies the second object in the image captured by the camera; Determine a main area in the image captured by the camera that contains the second object, and the main area is an area determined based on the second object; Determine a corresponding area in the first picture, and the correlation between the part outside the corresponding area in the first picture and the part outside the main area in the image captured by the camera is greater than a second value; Fit the main area to the corresponding area in the first picture to obtain the second picture.

3. The method according to claim 1, characterized in that Before the electronic device stores the second picture after receiving the second operation, the method further includes: The electronic device identifies the first object in the first picture; Determine a main area in the first picture that contains the first object, and the main area is an area determined based on the first object; Determine a corresponding area in the image captured by the camera, and the correlation between the part outside the corresponding area in the image captured by the camera and the part outside the main area in the first picture is greater than a second value; Fit the main area to the corresponding area in the image captured by the camera to obtain the second picture.

4. The method according to claim 2 or 3, characterized in that The position of the corresponding area in the first picture is the same as the position of the main area in the image captured by the camera.

5. The method according to claim 1, wherein The second picture is the frame of the composite image obtained by fitting each of multiple frames of images captured by the camera and the first picture, and it is the frame with the highest quality; The multiple frames of images captured by the camera include the images captured by the camera at the moment when the electronic device receives the second operation and at previous moments, and the number of the multiple frames of images is preset by the electronic device.

6. The method according to any one of claims 1-3 and 5, characterized in that, A first control is displayed in the first user interface. Before the electronic device receives the first operation on the first picture, the method further includes: The electronic device receives a user operation acting on the first control. The electronic device displays a second control in the first user interface; the first operation includes a user operation acting on the second control.

7. The method according to any one of claims 1-3 and 5, characterized in that, After the electronic device stores the second picture, the method further includes: The electronic device receives a third operation for viewing the second picture. The electronic device displays the second picture.

8. A shooting method, characterized in that, The method includes: The electronic device starts a gallery application and displays a first user interface, in which a first picture is displayed, and the first picture includes a first object. The electronic device receives a first operation on the first picture. The electronic device starts a camera application and displays a second user interface, in which a preview frame is displayed. When the correlation between the position indicated by the image captured by the camera of the electronic device and the position indicated by the first picture is greater than a first value, a composite image is displayed in the preview frame, and the composite image is obtained by fitting the image captured by the camera of the electronic device and the first picture, and the image captured by the camera includes a second object. The electronic device receives a second operation for taking a picture. The electronic device stores a second picture, and the second picture is the composite image displayed in the preview frame when the second operation is received, and the second picture includes the first object and the second object.

9. The method according to claim 8, characterized in that, Before the electronic device displays the composite image in the preview frame, the method further includes: The electronic device identifies the second object in the image captured by the camera. A main area including the second object is determined in the image captured by the camera, and the main area is an area determined based on the second object. A corresponding area is determined in the first picture, and the correlation between the part other than the corresponding area in the first picture and the part other than the main area in the image captured by the camera is greater than a second value. The main area is fitted to the corresponding area in the first picture to obtain the composite image.

10. The method according to claim 8, wherein Before the electronic device displays the composite image in the preview frame, the method further includes: The electronic device identifies the first object in the first picture. A main area including the first object is determined in the first picture, and the main area is an area determined based on the first object. A corresponding area is determined in the image captured by the camera, and the correlation between the part other than the corresponding area in the image captured by the camera and the part other than the main area in the first picture is greater than a second value. The main area is fitted to the corresponding area in the image captured by the camera to obtain the composite image.

11. The method according to claim 9 or 10, characterized in that, The position of the corresponding area in the first picture is the same as the position of the main area in the image captured by the camera.

12. The method according to any one of claims 8-10, characterized in that A first control is displayed in the first user interface. Before the electronic device receives the first operation on the first picture, the method further includes: The electronic device receives a user operation acting on the first control. The electronic device displays a second control in the first user interface; the first operation includes a user operation on the second control.

13. The method according to any one of claims 8 to 10, characterized in that, After the electronic device stores the second picture, the method further includes: The electronic device receives a third operation for viewing the second picture; The electronic device displays the second picture.

14. A shooting method, characterized in that, The method includes: The electronic device displays a second user interface, in which a preview frame and a third control are displayed, and an image captured by the camera of the electronic device is displayed in the preview frame; The electronic device detects a fourth operation on the third control; The electronic device displays one or more pictures; The electronic device detects a fifth operation on a first picture among the one or more pictures, and the first picture includes a first object; The electronic device displays, in the preview frame of the second user interface, the image captured by the camera of the electronic device, and the first picture with transparency and / or the blurred first picture; The electronic device receives a second operation for taking a picture; When the correlation between the position indicated by the image captured by the camera and the position indicated by the first picture is greater than a first value, the electronic device stores a second picture in response to the second operation, and the second picture is obtained by fitting the image captured by the camera and the first picture. The image captured by the camera includes a second object, and the second picture includes the first object and the second object.

15. The method according to claim 14, wherein Before the electronic device stores the second picture after receiving the second operation, the method further includes: The electronic device identifies the second object in the image captured by the camera; Determine a main area in the image captured by the camera that includes the second object, and the main area is an area determined based on the second object; Determine a corresponding area in the first picture, and the correlation between the part outside the corresponding area in the first picture and the part outside the main area in the image captured by the camera is greater than a second value; Fit the main area to the corresponding area in the first picture to obtain the second picture.

16. The method according to claim 14, wherein Before the electronic device stores the second picture after receiving the second operation, the method further includes: The electronic device identifies the first object in the first picture; Determine a main area in the first picture that includes the first object, and the main area is an area determined based on the first object; Determine a corresponding area in the image captured by the camera, and the correlation between the part outside the corresponding area in the image captured by the camera and the part outside the main area in the first picture is greater than a second value; Fit the main area to the corresponding area in the image captured by the camera to obtain the second picture.

17. The method according to claim 15 or 16, characterized in that, The position of the corresponding area in the first picture is the same as the position of the main area in the image captured by the camera.

18. The method according to claim 14, wherein The second picture is the frame of the synthesized image with the highest quality among the synthesized images obtained by fitting each of the multiple frames of images captured by the camera with the first picture; The multiple frames of images captured by the camera include: images captured by the camera at the moment when the electronic device receives the second operation and at previous moments, and the number of the multiple frames of images is preset by the electronic device.

19. The method according to any one of claims 14 - 16, characterized in that, After the electronic device stores the second picture, the method further includes: The electronic device receives a third operation for viewing the second picture; The electronic device displays the second picture.

20. A shooting method, characterized in that, The method includes: The electronic device displays a second user interface, in which a preview frame and a third control are displayed, and an image captured by the camera of the electronic device is displayed in the preview frame; The electronic device detects a fourth operation acting on the third control; The electronic device displays one or more pictures; The electronic device detects a fifth operation acting on a first picture among the one or more pictures, and the first picture includes a first object; When the correlation between the position indicated by the image captured by the camera and the position indicated by the first picture is greater than a first value, a synthesized image is displayed in the preview frame of the second user interface. The synthesized image is obtained by fitting the image captured by the camera of the electronic device with the first picture, and the image captured by the camera includes a second object; The electronic device receives a second operation for taking a photo; The electronic device stores the second picture, where the second picture is the synthesized image displayed in the preview frame when the second operation is received, and the second picture includes the first object and the second object.

21. The method according to claim 20, wherein Before the electronic device displays the synthesized image in the preview frame, the method further includes: The electronic device identifies the second object in the image captured by the camera; A main area including the second object is determined in the image captured by the camera. The main area is an area determined based on the second object; A corresponding area is determined in the first picture, and the correlation between the part outside the corresponding area in the first picture and the part outside the main area in the image captured by the camera is greater than a second value; The main area is fitted to the corresponding area in the first picture to obtain the synthesized image.

22. The method according to claim 20, wherein Before the electronic device displays the synthesized image in the preview frame, the method further includes: The electronic device identifies the first object in the first picture; A main area including the first object is determined in the first picture. The main area is an area determined based on the first object; A corresponding area is determined in the image captured by the camera, and the correlation between the part outside the corresponding area in the image captured by the camera and the part outside the main area in the first picture is greater than a second value; The main area is fitted to the corresponding area in the image captured by the camera to obtain the synthesized image.

23. The method according to claim 21 or 22, characterized in that, The position of the corresponding area in the first picture is the same as the position of the main area in the image captured by the camera.

24. The method according to any one of claims 20-22, characterized in that, After the electronic device stores the second picture, the method further includes: The electronic device receives a third operation for viewing the second picture; The electronic device displays the second picture.

25. An electronic device, characterized in that, The electronic device includes: a memory, one or more processors; the memory is coupled to the one or more processors, the memory is configured to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to cause the electronic device to execute the method according to any one of claims 1-7, or claims 8-13, or claims 14-19, or claims 20-24.

26. A computer-readable storage medium, comprising instructions, characterized in that, When the instructions run on the electronic device, the electronic device executes the method according to any one of claims 1-7, or claims 8-13, or claims 14-19, or claims 20-24.

27. A computer program product, characterized in that, The computer program product includes computer instructions, and when the computer instructions run on the electronic device, the electronic device executes the method according to any one of claims 1-7, or claims 8-13, or claims 14-19, or claims 20-24.

Images