Shooting methods, devices and electronic equipment

Abstract

This application discloses a shooting method, apparatus, and electronic device, belonging to the field of electronic device technology. The method includes displaying a first window in a shooting preview interface, the first window including a first preview image and a sticker material object superimposed on the first preview image; upon receiving a first input from a user, shooting a first image corresponding to the first window; during the rotation of the camera, displaying a second window in the shooting preview interface and superimposing the sticker material object on a second preview image in the second window; shooting a second image corresponding to the second window; and generating a panoramic image or panoramic video based on the first image and the second image.

Description

Technical Field

[0001] This application belongs to the field of electronic equipment technology, specifically relating to a shooting method, apparatus, and electronic equipment. Background Technology

[0002] With the rapid development of electronic device technology and mobile internet, sticker materials have become increasingly popular among users. More and more users are adding sticker materials to images through image editing applications on their electronic devices to obtain images that meet their needs.

[0003] However, the process of editing images to meet user needs is quite complex and requires users to spend a lot of time editing. This not only increases the number of operations users need to perform when editing images, but also makes it easy for sticker materials to obscure the original content of the image, resulting in poor image quality after editing. Summary of the Invention

[0004] The purpose of this application is to provide a shooting method, apparatus, electronic device, and storage medium that can improve the efficiency and image quality of acquiring images with sticker materials.

[0005] In a first aspect, embodiments of this application provide a shooting method, including:

[0006] The shooting preview interface displays a first window, which includes a first preview image and sticker material objects overlaid on the first preview image;

[0007] Upon receiving the user's first input, capture the first image corresponding to the first window;

[0008] As the camera rotates, a second window is displayed in the shooting preview interface, and the sticker material object is overlaid on the second preview image in the second window;

[0009] Capture the second image corresponding to the second window;

[0010] Based on the first image and the second image, generate a panoramic image or panoramic video.

[0011] Secondly, embodiments of this application provide a shooting device, including:

[0012] The display module is used to display a first window in the shooting preview interface. The first window includes a first preview image and sticker material objects superimposed on the first preview image.

[0013] The camera module is used to capture a first image corresponding to the first window upon receiving the user's first input.

[0014] The display module is also used to display a second window in the shooting preview interface during the camera rotation process, and to overlay the sticker material object on the second preview image in the second window;

[0015] The camera module is also used to capture a second image corresponding to the second window;

[0016] The generation module is used to generate panoramic images or panoramic videos based on the first image and the second image.

[0017] Thirdly, embodiments of this application provide an electronic device, which includes a processor, a memory, and a program or instructions stored in the memory and executable on the processor. When the program or instructions are executed by the processor, they implement the steps of the shooting method as described in the first aspect.

[0018] Fourthly, embodiments of this application provide a readable storage medium on which a program or instructions are stored, which, when executed by a processor, implement the steps of the shooting method as described in the first aspect.

[0019] Fifthly, embodiments of this application provide a chip, which includes a processor and a display interface, the display interface and the processor being coupled together, the processor being used to run programs or instructions to implement the steps of the shooting method as shown in the first aspect.

[0020] In a sixth aspect, embodiments of this application provide a computer program product stored in a storage medium, which is executed by at least one processor to implement the steps of the shooting method as described in the first aspect.

[0021] In this embodiment, a first window is displayed in the shooting preview interface. The first window includes a first preview image and a sticker material object superimposed on the first preview image. Upon receiving a first input from the user, a first image corresponding to the first window is captured. During the camera rotation, a second window is displayed in the shooting preview interface, and the sticker material object is superimposed on the second preview image in the second window. A second image corresponding to the second window is captured. Based on the first image and the second image, a panoramic image or panoramic video is generated. This allows users to add sticker materials when shooting panoramic images or videos, enabling them to capture panoramic images or videos with sticker materials. This eliminates the need for users to spend significant time post-editing the panoramic images using sticker materials, simplifying the process and reducing the difficulty of obtaining such images or videos. Furthermore, during the shooting process, users can view the display effect of the sticker materials in the preview image at any time, allowing them to adapt the preview to the window displaying the sticker materials, thus improving the overall display quality of the panoramic images or videos with sticker materials. Attached Figure Description

[0022] Figure 1 Flowcharts of shooting methods provided for some embodiments of this application;

[0023] Figure 2 One of the schematic diagrams of the interface for the shooting method provided in some embodiments of this application;

[0024] Figure 3 A second schematic diagram of the interface for a shooting method provided in some embodiments of this application;

[0025] Figure 4 A third schematic diagram of the interface for the shooting method provided in some embodiments of this application;

[0026] Figure 5 Fourth schematic diagram of the interface for the shooting method provided in some embodiments of this application;

[0027] Figure 6 Fifth schematic diagram of the interface of the shooting method provided for some embodiments of this application;

[0028] Figure 7 A schematic diagram of the interface for the shooting method provided in some embodiments of this application;

[0029] Figure 8Seventh schematic diagram of the interface for the shooting method provided in some embodiments of this application;

[0030] Figure 9 Eighth schematic diagram of the interface of the shooting method provided in some embodiments of this application;

[0031] Figure 10 Ninth schematic diagram of the interface of the shooting method provided for some embodiments of this application;

[0032] Figure 11 Schematic diagrams of the imaging device provided for some embodiments of this application;

[0033] Figure 12 Schematic diagrams of the structure of electronic devices provided for some embodiments of this application;

[0034] Figure 13 A schematic diagram of the hardware structure of an electronic device provided for some embodiments of this application. Detailed Implementation

[0035] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.

[0036] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such terms can be used interchangeably where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and the number of objects is not limited; for example, a first object can be one or more. Furthermore, in the specification and claims, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.

[0037] To address the problems in related technologies, embodiments of this application provide a shooting method, apparatus, and electronic device. The following, in conjunction with the appendix... Figures 1 to 13 The shooting method provided in this application will be described in detail through specific embodiments and application scenarios.

[0038] First, combined Figure 1 A shooting method provided in the embodiments of this application will be described in detail.

[0039] Figure 1 A flowchart illustrating a shooting method provided for some embodiments of this application.

[0040] like Figure 1 As shown, the shooting method provided in this application embodiment can be applied to electronic devices. Based on this, the shooting method may include steps 110 and 130, as detailed below.

[0041] Step 110: Display a first window in the shooting preview interface. The first window includes a first preview image and a sticker material object superimposed on the first preview image. Step 120: Upon receiving the user's first input, capture a first image corresponding to the first window. Step 130: While the camera is rotating, display a second window in the shooting preview interface and superimpose the sticker material object on the second preview image in the second window. Step 140: Capture a second image corresponding to the second window. Step 150: Generate a panoramic image or panoramic video based on the first and second images.

[0042] For example, receiving input from a user to activate the panoramic shooting mode of the camera application on the electronic device, such as... Figure 2 As shown, a shooting preview interface in the camera application can be displayed. This shooting preview interface 20 displays a first window, which includes a first preview image 201 and a sticker material object 202 superimposed on the first preview image 201. Next, upon receiving a first input from the user to shoot a panoramic image or video, a first image corresponding to the first window is captured. It is understood that the obtained first image may include the first preview image 201 and the sticker material object 202. Furthermore, when the user rotates the electronic device, the camera can rotate during the process, such as... Figure 3 As shown, a second window is displayed in the shooting preview interface. The sticker material object 202 is overlaid on the second preview image 203 in the second window, and the second image corresponding to the second window is captured. It can be understood that the obtained second image may include the second preview image 203 and the sticker material object 202. Then, upon receiving input from the user to stop capturing panoramic images or panoramic videos, as... Figure 4 As shown, a panoramic image or panoramic video carrying sticker material objects is generated based on the first image and the second image.

[0043] Therefore, sticker materials can be added when shooting panoramic images or videos, allowing users to capture panoramic images or videos with sticker materials. This eliminates the need for users to spend a lot of time editing the panoramic images with sticker materials in post-production, simplifying the process of obtaining panoramic images or videos with sticker materials, reducing the difficulty of obtaining them, and improving the efficiency. Moreover, during the shooting process, users can check the display effect of the sticker materials in the preview image at any time, which allows them to adapt the preview image according to the window displaying the sticker materials and the preview screen, thereby improving the display effect of the panoramic images or videos with sticker materials.

[0044] The steps described above are explained in detail below.

[0045] First, regarding step 110, the sticker material object in this embodiment can be pre-set or manually selected by the user. Based on this, in some embodiments of this application, the shooting method may further include steps 1601 and 1602 before step 110.

[0046] Step 1601: Receive the user's second input, which is the user's selection of a sticker material object. The sticker material object includes at least one of the following: sticker material image, sticker material video.

[0047] For example, such as Figure 5 As shown, this can be the second input for users to select sticker material objects, such as "stickers," in the shooting preview interface.

[0048] Step 1602, in response to the second input, overlay and display the sticker material object on the first preview image.

[0049] For example, such as Figure 6 As shown, sticker material object 202 can be overlaid on the first preview image.

[0050] Therefore, users can preview the display effect of sticker materials in the image before taking pictures or videos, eliminating the need for post-editing and improving the efficiency of capturing panoramic images or videos.

[0051] Specifically, in order to prevent the sticker material object from obscuring the subject in the first preview image, the display position of the sticker material object in the first preview image can be adjusted in the following way, that is, the above step 1602 can specifically include steps 16021 and 16022.

[0052] Step 16021: In response to the second input, based on the sticker material object, the image content in the first preview image is identified to obtain the first position in the first preview image that matches the sticker material object.

[0053] For example, refer to Figure 2 The sticker material object 202 is in a walking state. The first preview image includes the road in the foreground and the mountain peaks in the distance. At this time, the position of the road in the foreground can be used as the first position to match the sticker material object 202 in the walking state.

[0054] Step 16022: Display the sticker material object in the first display area corresponding to the first position.

[0055] For example, one can still refer to Figure 2 Sticker material object 202 can be displayed in the first display area where the nearby road is located.

[0056] This reduces the need for users to manually adjust the display position of sticker objects in the first preview image, reduces the number of operations required for users to capture panoramic images or videos with sticker objects, lowers the difficulty for users to capture panoramic images or videos with sticker objects, and improves the efficiency of capturing panoramic images or videos with sticker objects.

[0057] Secondly, regarding step 130, in some embodiments of this application, the sticker material object in the embodiments of this application may be different, that is, the sticker material object includes a first sticker material object and a second sticker material object, and the sticker material object on the first preview image is the first sticker material object.

[0058] Based on this, the step of overlaying the sticker material object onto the second preview image in the second window in step 130 may specifically include step 1301.

[0059] Step 1301: Overlay the second sticker material object onto the second preview image in the second window.

[0060] For example, the first sticker material object 1 can be overlaid on the first display preview image, and the first sticker material object 2 can be overlaid on the second display preview image.

[0061] In this way, different sticker material objects can be displayed in the same panoramic image or panoramic video, reducing the process of users repeatedly selecting paper material objects to take panoramic images or panoramic videos, reducing the operation of users taking panoramic images or panoramic videos with sticker material objects, reducing the difficulty of users taking panoramic images or panoramic videos with sticker material objects, and improving the efficiency of panoramic images or panoramic videos with sticker material objects.

[0062] In some embodiments of this application, the display area of ​​the sticker material object in the embodiments of this application may be different in different windows. That is, the step of superimposing the sticker material object on the second preview image in the second window in step 130 may specifically include steps 1302 and 1303, as shown below.

[0063] Step 1302: Based on the sticker material object, identify the content of the image in the second preview image to obtain the second position in the second preview image that matches the sticker material object.

[0064] For example, Figure 2 As the first window, Figure 3 This is the second window. At this point, the first position determined through steps 16021 and 16022 can be a relatively centered position. The second preview image is an image that is moved to the right from the first preview image as the base image. In order to indicate that the user is walking on the road, and to achieve... Figure 4 The panoramic image effect shown will re-identify the content of the scene in the second preview image based on the sticker material object, and obtain the second position, which can be the position near the edge of the first window (see details). Figure 3 (The location shown).

[0065] Step 1303: Overlay the sticker material object onto the second display area corresponding to the second position in the second preview image.

[0066] For example, refer to Figure 3 The sticker material object 202 can be overlaid and displayed in the lower right display area of ​​the screen.

[0067] Therefore, the position of the sticker material object in the preview screen can be dynamically adjusted based on changes in the content of the preview screen, reducing the need for users to manually adjust the sticker material object to adapt to the current preview screen every time the content of the preview screen changes, and improving the display effect of the sticker material object in the preview image.

[0068] In some embodiments of this application, in order to display the sticker material object continuously and without interruption in the panoramic image or panoramic video, the content of the first sticker material object and the content of the second sticker material object in the embodiments of this application are continuous content, that is, the sticker material object includes the first sticker material object and the second sticker material object. The sticker material object on the first preview image is the first sticker material object, and the content of the first sticker material object and the content of the second sticker material object are continuous content. Based on this, the above-mentioned step 1302 may specifically include step 13011 and step 13012.

[0069] Step 13011: Based on the second sticker material object, identify the content of the image in the second preview image to obtain the third position in the second preview image that matches the second sticker material object.

[0070] For example, you can still refer to Figure 2 and Figure 3 , Figure 2 As the first window, Figure 3 In the second window, if the first position determined through steps 16021 and 16022 is a relatively centered position, then the second preview image is an image that is moved to the right from the first preview image. If the third position in the second preview image that matches the second sticker material object is identified as a relatively centered position in the second preview image, then...

[0071] Step 13012: Based on the position of the first sticker material object in the first image, adjust the third position to obtain the second position in the second preview image that matches the second sticker material object.

[0072] For example, since the content of the first sticker material object and the content of the second sticker material object are continuous, in order to indicate that the user is walking on the road, to achieve the following: Figure 4 The panoramic image effect shown will re-identify the content of the scene in the second preview image based on the sticker material object, and obtain the second position, which can be the position near the edge of the first window (see details). Figure 3 (The location shown).

[0073] In this way, when shooting panoramic images or videos with sticker materials, the sticker materials can be displayed continuously in the panoramic image or video without the need for manual changes by the user in post-production, which helps to improve the display effect of panoramic images or videos with sticker materials.

[0074] It should be noted that, in this embodiment, the user may manually rotate the electronic device to cause the camera within the device to rotate, thereby triggering the display of a second window in the shooting preview interface to capture a second image corresponding to the second window. Alternatively, the electronic device may control the camera to rotate within a preset shooting angle range, thereby triggering the display of a second window in the shooting preview interface to capture a second image corresponding to the second window.

[0075] Furthermore, regarding step 140, in some embodiments of this application, the sticker material object is a dynamic sticker material object, which includes N frames of sticker material images. The N frames of sticker material images are displayed cyclically in the first window. Based on this, the first input is the input of capturing a first image and selecting a first sticker material image from the N frames of sticker material images. The first sticker material image is any frame of sticker material image displayed in the first window when the first input is received. The first image is an image that includes a first preview image and a first sticker material image.

[0076] For example, if no user input is received for N frames of sticker material images, the N frames of sticker material images are continuously played in the first sub-window. When the user inputs a first image corresponding to the first window, the sticker material image playing in the first window at the moment the input is received can be used as the first sticker material image, thus obtaining a first image including the first sticker material image and the first preview image.

[0077] It should be noted that in some embodiments, after capturing the first image, N frames of sticker material images can still be displayed cyclically in the second window. When the user inputs that they have captured a second image corresponding to the second window, the sticker material image in the second window at the moment the input is received is used as the second sticker material image, resulting in a second image including the second sticker material image and the second preview image. In other embodiments, after capturing the first image, the sticker material image following the first sticker material image in the N frames can be used as the sticker material image displayed in the second window. This application also provides users with optional entry points. Two methods for determining the sticker material object on the overlaid preview image are provided below.

[0078] In some embodiments of this application, the sticker material object is a dynamic sticker material object, which includes N frames of sticker material images. The shooting preview interface includes a first control. Based on this, after the aforementioned step 110, the shooting method may further include steps 1704 to 1705.

[0079] Step 1704: Upon receiving the user's third input to the first control, select the second sticker material image from the N frames of sticker material images based on the captured content in the first preview image.

[0080] For example, such as Figure 7 As shown, the first control can be an artificial intelligence (AI) control. When it receives a third input from the user to the AI ​​button, it can traverse N frames of sticker material images based on the captured content in the first preview image, such as mountain scenery, excluding sticker material images related to underwater scenery, indoor scenery, etc., to filter out a second sticker material image that matches the mountain scenery from the N frames of sticker material images. Step 1705: The second sticker material image is used as a sticker material object of at least one of the following: a sticker material object superimposed on the first preview image, or a sticker material object superimposed on the second preview image.

[0081] For example, the second sticker material image can be displayed separately as a sticker material object overlaid on the first preview image, or it can be displayed as a sticker material object overlaid on the second preview image after the first image is captured.

[0082] It should be noted that, in this embodiment, after capturing the first image, a third input from the user to the first control can be received. At this time, a second sticker material image can be selected from N frames of sticker material images based on the captured content within the second preview image. That is, this second sticker material image is the sticker material object superimposed on the second preview image. It should be understood that, in this embodiment, the second sticker material image is displayed separately as a sticker material object superimposed on the second preview image.

[0083] In this way, sticker material objects can be quickly matched based on the content in the preview screen without user input, which improves the efficiency of shooting panoramic images or panoramic videos with sticker material objects while reducing the user's input of selecting sticker material objects.

[0084] In other embodiments of this application, the sticker material object is a dynamic sticker material object, which includes N frames of sticker material images. The shooting preview interface also includes a second control to adjust the display progress of the N frames of sticker material images in the first window. After step 110, the shooting method may also include step 1707, in which, upon receiving a fourth input from the user to the second control, a third sticker material image corresponding to the fourth input is superimposed on the first preview image in the first window.

[0085] For example, one can still refer to Figure 7The second control can be a progress indicator line for the sticker progress bar. This allows the user to drag the progress indicator line as a fourth input, enabling the user to select the sticker image as the third sticker image, which is then overlaid on the first preview image.

[0086] It should be noted that in this embodiment, the third sticker material image can be displayed separately overlaid on the first preview image, or the third sticker material image can be displayed overlaid on the first preview image and the second preview image.

[0087] Based on this, step 120 may specifically include: upon receiving the user's first input, capturing a first image corresponding to the first window, wherein the first image is an image including a first preview image and a third sticker material image.

[0088] Based on this, after step 120, in order to facilitate the user in selecting the sticker material image to be overlaid and displayed in the second preview image, the shooting method may also include step 1708, in which N frames of sticker material images are displayed in a loop starting from the next frame of the sticker material image after the third sticker material image in the second window.

[0089] For example, users can continue to select sticker material images that are overlaid on the second preview image via the progress indicator line.

[0090] It should be noted that the various methods for determining sticker material images provided in the embodiments of this application can be used individually or in combination. For example, the user can click the AI ​​control to select one frame from N frames of sticker material images as the sticker material image to be overlaid in the first preview image, and the user can also click the AI ​​control to select one frame from N frames of sticker material images as the sticker material image to be overlaid in the second preview image; or, the user can click the AI ​​control to select one frame from N frames of sticker material images as the sticker material image to be overlaid in the first preview image, and the user can drag the progress indicator line to select the sticker material image to be overlaid in the second preview image.

[0091] Therefore, in order to allow users to easily view the display effect of sticker materials in the preview image at any time during the process of shooting panoramic images or panoramic videos with sticker materials, it is beneficial for users to adapt the preview image according to the window displaying sticker materials and the preview image.

[0092] Then, in step 150, in some embodiments of this application, the first image and the second image can be stitched together to obtain a panoramic image or panoramic video.

[0093] It should be noted that the sticker material object in this application embodiment can be at least one of the following: static sticker material object, dynamic sticker material object, or custom sticker material object.

[0094] In some embodiments of this application, the sticker material object can be a static sticker material object, which can be pre-stored in an electronic device or downloaded via a real-time network. The static sticker material object can be an image.

[0095] In other embodiments of this application, the sticker material object can be a dynamic sticker material object. This dynamic sticker material object can be pre-stored in the electronic device, just like a static sticker material object, or it can be downloaded via a real-time network. The difference from the aforementioned static sticker material object is that the sticker template provided by the dynamic sticker is an animated sticker; the shape of the sticker template in the captured photo varies depending on the angle, thereby improving the display effect of the panoramic image or video and providing a more realistic experience for the user. Here, if the sticker material object selected by the user, such as the first or second sticker material object, is a dynamic sticker material object, then the sticker material object can be looped within the first or second window. When the user confirms the capture, the shape of the sticker material object becomes the current shape of the sticker material object. Of course, this application also provides an entry point for optional shapes. At this time, refer to... Figure 7 As shown, select either the first sticker material object or the second sticker material object.

[0096] In some other embodiments of this application, the user can customize the sticker material object, such as... Figure 8 As shown, users can use, as Figure 8 The interface shown allows you to select a sticker material object. If you want to create a custom sticker material object, you can click the plus sign under "Custom Sticker Material Object" to trigger the display. Figure 9 The interface. Based on this, the method for obtaining the aforementioned custom sticker material object will be explained below.

[0097] In some embodiments of this application, a user image can be selected to generate a custom sticker material object. Based on this, before step 110, the shooting method may also include steps 2101 to 2104.

[0098] Step 2101: Display the user's image from the user's photo album application in the sticker material object selection interface.

[0099] Step 2102: Receive the fifth input from the user who selects the target user image from the user images.

[0100] Step 2103, in response to the fifth input, extract the subject image from the target user image.

[0101] Step 2104: Use the photographed subject image as a custom sticker material object.

[0102] For example, such as Figure 9 As shown, if a user selects a user image, artificial intelligence can be used to cut out the subject image from the user image and generate a custom sticker material object for the user to choose from. Here, it can be understood that the custom sticker material object in this embodiment can be a static sticker template.

[0103] In some other embodiments of this application, the custom sticker material object can be a dynamic sticker template. Based on this, before step 110, a user video can be selected to generate a custom sticker material object. Based on this, the shooting method may also include steps 2201 to 2206.

[0104] Step 2201: Display the user's video from the user's photo album application in the sticker material selection interface.

[0105] Step 2202: Receive the sixth input from the user, indicating that the user has selected the target user video from the user videos.

[0106] Step 2203: In response to the sixth input, identify the content in the target user's video to obtain the subject of the video.

[0107] Step 2204: Select the subject image in frame M from the target user's video.

[0108] Step 2205: Extract the subject image from each of the M frames of the subject images.

[0109] Step 2206: Use the subject image captured in frame M as the custom sticker material object.

[0110] For example, if a user selects a user video, the artificial intelligence in the electronic device will extract the subject being filmed in the user video, then extract the subject image where the subject is located, then perform a cutout operation on each frame of the subject image, and finally automatically generate a dynamic template of the subject in each frame for the user to choose from.

[0111] Therefore, sticker materials can be added when shooting panoramic images or videos, allowing users to capture panoramic images or videos with sticker materials. This eliminates the need for users to spend a lot of time editing the panoramic images with sticker materials in post-production, simplifying the process of obtaining panoramic images or videos with sticker materials, reducing the difficulty of obtaining them, and improving the efficiency. Moreover, during the shooting process, users can check the display effect of the sticker materials in the preview image at any time, which allows them to adapt the preview image according to the window displaying the sticker materials and the preview screen, thereby improving the display effect of the panoramic images or videos with sticker materials.

[0112] It should be noted that the shooting method provided in this application can be executed by electronic devices such as mobile phones, tablets, laptops, PDAs, and wearable devices. Some embodiments of this application use electronic devices as the executing entity to illustrate the shooting method provided in this application.

[0113] The shooting method provided in this application can be executed by a shooting device. This application uses a shooting device to illustrate the shooting method provided in this application as an example.

[0114] This application also provides a shooting device. (Specifically combined with...) Figure 11 Please provide a detailed explanation.

[0115] Figure 11 A schematic diagram of the imaging device provided for some embodiments of this application.

[0116] like Figure 11 As shown, the shooting device 110 can be applied to electronic devices, and the shooting device 110 may specifically include:

[0117] Display module 1101 is used to display a first window in the shooting preview interface. The first window includes a first preview image and a sticker material object superimposed on the first preview image.

[0118] The shooting module 1102 is used to capture a first image corresponding to the first window upon receiving a first input from the user;

[0119] The display module 1101 is also used to display a second window in the shooting preview interface during the camera rotation process, and to overlay the sticker material object on the second preview image in the second window;

[0120] The shooting module 1102 is also used to capture a second image corresponding to the second window;

[0121] The generation module 1103 is used to generate a panoramic image or panoramic video based on the first image and the second image.

[0122] The imaging device 110 in the embodiments of this application will be described in detail below.

[0123] In some embodiments of this application, the imaging device 110 may further include a receiving module; wherein,

[0124] The receiving module is used to receive a second input from the user, which is the user's input to select a sticker material object. The sticker material object includes at least one of the following: sticker material image, sticker material video;

[0125] Display module 1101 is used to display sticker material objects overlaid on the first preview image in response to a second input.

[0126] In some embodiments of this application, the shooting device 110 in the embodiments of this application may further include a recognition module, which is used to recognize the content of the screen in the first preview image based on the sticker material object in response to the second input, and obtain the first position in the first preview image that matches the sticker material object;

[0127] Display module 1101 is used to display sticker material objects in a first display area corresponding to the first position.

[0128] In some embodiments of this application, the display module 1101 may be used to overlay the second sticker material object onto the second preview image in the second window when the sticker material object includes a first sticker material object and a second sticker material object, and the sticker material object on the first preview image is the first sticker material object.

[0129] In some embodiments of this application, the shooting device 110 in the embodiments of this application may further include a recognition module, which is used to recognize the content of the screen in the second preview image based on the sticker material object, and obtain a second position in the second preview image that matches the sticker material object;

[0130] The display module 1101 can be used to overlay and display the sticker material object in the second preview image in the second display area corresponding to the second position.

[0131] In some embodiments of this application, the shooting device 110 in this application embodiment may further include an identification module, which is used to identify the content of the screen in the second preview image based on the second sticker material object when the sticker material object includes a first sticker material object and a second sticker material object, the sticker material object on the first preview image is the first sticker material object, and the content of the first sticker material object and the content of the second sticker material object are continuous content, so as to obtain a third position in the second preview image that matches the second sticker material object;

[0132] The shooting device 110 in this embodiment may further include an adjustment module for adjusting the third position based on the position of the first sticker material object in the first image, so as to obtain a second position in the second preview image that matches the second sticker material object.

[0133] In some embodiments of this application, the display module 1101 is configured to, when the sticker material object is a dynamic sticker material object, the dynamic sticker material object includes N frames of sticker material images, and the N frames of sticker material images are displayed cyclically in a first window, the first input is the input of capturing a first image and selecting a first sticker material image from the N frames of sticker material images, the first sticker material image is any frame of sticker material image displayed in the first window when the first input is received; the first image is an image including a first preview image and a first sticker material image.

[0134] In some embodiments of this application, the shooting device 110 in this application embodiment may further include a filtering module, which is used to filter a second sticker material image from the N frames of sticker material images when the sticker material object is a dynamic sticker material object, the dynamic sticker material object includes N frames of sticker material images, the shooting preview interface includes a first control, and a third input from the user to the first control is received;

[0135] Display module 1101 is used to display the second sticker material image as a sticker material object of at least one of the following: a sticker material object superimposed on the first preview image, or a sticker material object superimposed on the second preview image.

[0136] In some embodiments of this application, the display module 1101 is used to overlay a third sticker material image corresponding to the fourth input onto the first preview image in the first window when the sticker material object is a dynamic sticker material object, the dynamic sticker material object includes N frames of sticker material images, the shooting preview interface also includes a second control for adjusting the display progress of the N frames of sticker material images in the first window, and when a fourth input from the user to the second control is received, the third sticker material image corresponding to the fourth input is overlaid on the first preview image in the first window.

[0137] The shooting device 110 in this embodiment may further include a shooting module, which is used to capture a first image corresponding to the first window when a first input from the user is received. The first image is an image including a first preview image and a third sticker material image.

[0138] Display module 1101 is used to cyclically display N frames of sticker material images in a second window, starting from the next frame of the sticker material image after the third sticker material image.

[0139] In some embodiments of this application, the display module 1101 is used to display user images from the user's photo album application on the sticker material object selection interface when the sticker material object is a custom sticker material object;

[0140] The shooting device 110 in this application embodiment may further include a receiving module for receiving a fifth input from the user to select a target user image from the user image;

[0141] The shooting device 110 in this embodiment may further include an extraction module, which is used to extract the subject image from the target user image in response to the fifth input;

[0142] The shooting device 110 in this embodiment may further include a processing module for using the image of the subject being photographed as a custom sticker material object.

[0143] In some embodiments of this application, the display module 1101 is used to display user videos from the user's photo album application on the sticker material object selection interface when the sticker material object is a custom sticker material object;

[0144] The shooting device 110 in this embodiment may further include a receiving module for receiving a sixth input from the user to select a target user video from the user video;

[0145] The shooting device 110 in this application embodiment may further include an identification module, which is used to identify the content in the target user video in response to the sixth input, and obtain the subject of the target user video.

[0146] The shooting device 110 in this embodiment may further include a filtering module for filtering the M-frame image of the subject being shot from the target user video.

[0147] The shooting device 110 in this application embodiment may further include an extraction module for extracting the subject image from each of the M frames of the subject image.

[0148] The shooting device 110 in this embodiment may further include a processing module for using the M-frame captured subject image as a custom sticker material object.

[0149] The shooting device in this application embodiment can be an electronic device or a component of an electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices besides a terminal. For example, the electronic device can be a mobile phone, tablet computer, laptop computer, handheld computer, in-vehicle electronic device, mobile internet device (MID), augmented reality (AR) / virtual reality (VR) device, robot, wearable device, ultra-mobile personal computer (UMPC), netbook, or personal digital assistant (PDA), etc. It can also be a server, network attached storage (NAS), personal computer (PC), television (TV), ATM, or self-service machine, etc. This application embodiment does not specifically limit the scope.

[0150] The shooting device in this application embodiment can be a device with an operating system. The operating system can be Android, iOS, or other possible operating systems, and this application embodiment does not specifically limit it.

[0151] The imaging device provided in this application embodiment can achieve... Figures 1 to 13 The various processes implemented in the illustrated shooting method embodiment achieve the same technical effect, and will not be described again here to avoid repetition.

[0152] Based on this, the shooting device provided in this application embodiment can display a first window in the shooting preview interface, the first window including a first preview image and a sticker material object superimposed on the first preview image; upon receiving a first input from the user, a first image corresponding to the first window is captured; during the rotation of the camera, a second window is displayed in the shooting preview interface, and the sticker material object is superimposed on the second preview image in the second window; a second image corresponding to the second window is captured; and a panoramic image or panoramic video is generated based on the first image and the second image. This allows users to add sticker materials when shooting panoramic images or videos, enabling them to capture panoramic images or videos with sticker materials. This eliminates the need for users to spend significant time post-editing the panoramic images using sticker materials, simplifying the process and reducing the difficulty of obtaining such images or videos. Furthermore, during the shooting process, users can view the display effect of the sticker materials in the preview image at any time, allowing them to adapt the preview to the window displaying the sticker materials, thus improving the overall display quality of the panoramic images or videos with sticker materials.

[0153] Optional, such as Figure 12 As shown, this application embodiment also provides an electronic device 120, including a processor 1201 and a memory 1202. The memory 1202 stores a program or instructions that can run on the processor 1201. When the program or instructions are executed by the processor 1201, they implement the various steps of the above-described shooting method embodiment and can achieve the same technical effect. To avoid repetition, they will not be described again here.

[0154] It should be noted that the electronic devices in the embodiments of this application include the aforementioned mobile electronic devices and non-mobile electronic devices.

[0155] Figure 13 This is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application.

[0156] The electronic device 1300 includes, but is not limited to, the following components: radio frequency unit 1301, network module 1302, audio output unit 1303, input unit 1304, sensor 1305, display unit 1306, user input unit 1307, interface unit 1308, memory 1309, processor 1310, etc.

[0157] Those skilled in the art will understand that the electronic device 1300 may also include a power supply (such as a battery) for supplying power to various components. The power supply may be logically connected to the processor 1310 through a power management system, thereby enabling functions such as managing charging, discharging, and power consumption through the power management system.

[0158] Figure 13 The electronic device structure shown does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be elaborated here.

[0159] In this embodiment, the display unit 1306 is used to display a first window in the shooting preview interface. The first window includes a first preview image and a sticker material object superimposed on the first preview image. The processor 1310 is used to capture a first image corresponding to the first window upon receiving a first input from the user. The display unit 1306 is also used to display a second window in the shooting preview interface while the camera is rotating, and to superimpose the sticker material object on a second preview image in the second window. The processor 1310 is also used to capture a second image corresponding to the second window. The processor 1310 is also used to generate a panoramic image or panoramic video based on the first image and the second image.

[0160] The electronic device 1300 will be described in detail below.

[0161] In some embodiments of this application, the user input unit 1307 is used to receive a second input from the user, the second input being the user's input to select a sticker material object, the sticker material object including at least one of the following: sticker material image, sticker material video;

[0162] Display unit 1306 is used to display sticker material objects overlaid on the first preview image in response to a second input.

[0163] In some embodiments of this application, processor 1310 is configured to, in response to a second input, identify the content of the image in a first preview image based on a sticker material object, and obtain a first position in the first preview image that matches the sticker material object;

[0164] Display unit 1306 is used to display sticker material object in a first display area corresponding to the first position.

[0165] In some embodiments of this application, the display unit 1306 may be specifically used to overlay the second sticker material object onto the second preview image in the second window when the sticker material object includes a first sticker material object and a second sticker material object, and the sticker material object on the first preview image is the first sticker material object.

[0166] In some embodiments of this application, processor 1310 is used to identify the content of the screen in the second preview image based on the sticker material object, and obtain a second position in the second preview image that matches the sticker material object;

[0167] The display unit 1306 can be specifically used to overlay and display the sticker material object in the second preview image in the second display area corresponding to the second position.

[0168] In some embodiments of this application, the processor 1310 is configured to, when the sticker material object includes a first sticker material object and a second sticker material object, the sticker material object on the first preview image is the first sticker material object, and the content of the first sticker material object and the content of the second sticker material object are continuous, identify the screen content in the second preview image based on the second sticker material object to obtain a third position in the second preview image that matches the second sticker material object;

[0169] Processor 1310 is used to adjust the third position based on the position of the first sticker material object in the first image to obtain a second position in the second preview image that matches the second sticker material object.

[0170] In some embodiments of this application, the display unit 1306 is configured to, when the sticker material object is a dynamic sticker material object, the dynamic sticker material object includes N frames of sticker material images, and the N frames of sticker material images are displayed cyclically in a first window, the first input is the input of capturing a first image and selecting a first sticker material image from the N frames of sticker material images, the first sticker material image is any frame of sticker material image displayed in the first window when the first input is received; the first image is an image including a first preview image and a first sticker material image.

[0171] In some embodiments of this application, the processor 1310 can also be used to, when the sticker material object is a dynamic sticker material object, the dynamic sticker material object includes N frames of sticker material images, the shooting preview interface includes a first control, and a third input from the user to the first control is received, to filter a second sticker material image from the N frames of sticker material images based on the shooting content in the first preview image.

[0172] Display unit 1306 is used to display the second sticker material image as a sticker material object of at least one of the following: a sticker material object superimposed on the first preview image, or a sticker material object superimposed on the second preview image.

[0173] In some embodiments of this application, the display unit 1306 is used to overlay a third sticker material image corresponding to the fourth input onto the first preview image in the first window when the sticker material object is a dynamic sticker material object, the dynamic sticker material object includes N frames of sticker material images, the shooting preview interface also includes a second control for adjusting the display progress of the N frames of sticker material images in the first window, and a fourth input from the user to the second control is received.

[0174] The processor 1310 is also used to capture a first image corresponding to the first window upon receiving a first input from the user, the first image being an image including a first preview image and a third sticker material image;

[0175] Display unit 1306 is used to cyclically display N frames of sticker material images in a second window, starting from the next frame of the sticker material image after the third sticker material image.

[0176] In some embodiments of this application, the display unit 1306 is used to display user images from the user's photo album application on the sticker material object selection interface when the sticker material object is a custom sticker material object;

[0177] User input unit 1307 is used to receive a fifth input from the user who selects a target user image from the user image;

[0178] Processor 1310 is configured to extract the image of the photographed subject from the target user image in response to the fifth input;

[0179] Processor 1310 is used to use the photographed subject image as a custom sticker material object.

[0180] In some embodiments of this application, the display unit 1306 is used to display user videos from the user's photo album application on the sticker material object selection interface when the sticker material object is a custom sticker material object.

[0181] User input unit 1307 is used to receive a sixth input from the user selecting a target user video from the user video;

[0182] The processor 1310 is used to respond to the sixth input, identify the content in the target user's video, and obtain the subject of the video.

[0183] Processor 1310 is used to filter the M-frame image of the subject being photographed from the target user's video;

[0184] Processor 1310 is used to extract subject images from each of the M frames of subject images;

[0185] Processor 1310 is used to use the M-frame captured subject image as a custom sticker material object.

[0186] It should be understood that the input unit 1304 may include a graphics processing unit (GPU) 13041 and a microphone 13042. The GPU 13041 processes image data of still images or videos acquired by an image capture device (such as a camera) in video capture mode or image capture mode. The display unit 1306 may include a display panel, which may be configured in the form of a liquid crystal display, an organic light-emitting diode, or the like. The user input unit 1307 includes at least one of a touch panel 13071 and other input devices 13072. The touch panel 13071 is also called a touch screen. The touch panel 13071 may include a touch detection device and a touch display. Other input devices 13072 may include, but are not limited to, a physical keyboard, function keys (such as volume display buttons, power buttons, etc.), a trackball, a mouse, and a joystick, which will not be described in detail here.

[0187] The memory 1309 can be used to store software programs and various data. The memory 1309 may primarily include a first storage area for storing programs or instructions and a second storage area for storing data. The first storage area may store the operating system, application programs or instructions required for at least one function (such as sound playback, image playback, etc.). Furthermore, the memory 1309 may include volatile memory or non-volatile memory, or both. The non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct memory bus RAM (DRRAM). The memory 1309 in this embodiment includes, but is not limited to, these and any other suitable types of memory.

[0188] Processor 1310 may include one or more processing units; optionally, processor 1310 integrates an application processor and a modem processor, wherein the application processor mainly handles operations involving the operating system, user interface, and applications, and the modem processor mainly handles wireless display signals, such as a baseband processor. It is understood that the aforementioned modem processor may also not be integrated into processor 1310.

[0189] This application also provides a readable storage medium storing a program or instructions. When the program or instructions are executed by a processor, they implement the various processes of the above-described shooting method embodiments and achieve the same technical effect. To avoid repetition, they will not be described again here.

[0190] The processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes computer-readable storage media, such as computer read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.

[0191] In addition, this application embodiment provides another chip, which includes a processor and a display interface. The display interface and the processor are coupled. The processor is used to run programs or instructions to implement the various processes of the above-described shooting method embodiments and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0192] It should be understood that the chip mentioned in the embodiments of this application may also be referred to as a system-on-a-chip, system chip, chip system, or system-on-a-chip, etc.

[0193] This application provides a computer program product, which is stored in a storage medium and executed by at least one processor to implement the various processes of the above-described shooting method embodiments, and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0194] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0195] Furthermore, it should be noted that the scope of the methods and apparatus in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.

[0196] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a computer software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods of the various embodiments of this application.

[0197] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.

Claims

1. A shooting method, characterized in that, include: A first window is displayed in the shooting preview interface. The first window includes a first preview image and a sticker material object superimposed on the first preview image. The sticker material object is a dynamic sticker material object, which includes N frames of sticker material images. The shooting preview interface also includes a second control to adjust the display progress of the N frames of sticker material images in the first window. Upon receiving the user's first input, capture a first image corresponding to the first window; During the camera rotation, a second window is displayed in the shooting preview interface, and the sticker material object is superimposed on the second preview image in the second window; Capture a second image corresponding to the second window; Based on the first image and the second image, generate a panoramic image or panoramic video; After displaying the first window in the shooting preview interface, the method further includes: Upon receiving a fourth input from the user to the second control, the third sticker material image corresponding to the fourth input is overlaid and displayed on the first preview image in the first window; Upon receiving the user's first input, capturing a first image corresponding to the first window includes: Upon receiving the user's first input, a first image corresponding to the first window is captured, wherein the first image is an image including the first preview image and the third sticker material image; After capturing the first image corresponding to the first window, the method further includes: In the second window, the N frames of sticker material images are displayed in a loop, starting from the next frame of the sticker material image after the third sticker material image.

2. The method according to claim 1, characterized in that, Before displaying the first window in the shooting preview interface, the method further includes: The system receives a second input from the user, which is the user's selection of a sticker material object. The sticker material object includes at least one of the following: a sticker material image or a sticker material video. In response to the second input, the sticker material object is overlaid on the first preview image.

3. The method according to claim 2, characterized in that, The step of overlaying the sticker material object onto the first preview image in response to the second input includes: In response to the second input, based on the sticker material object, the image content in the first preview image is identified to obtain a first position in the first preview image that matches the sticker material object; The sticker material object is displayed in the first display area corresponding to the first position.

4. The method according to any one of claims 1-3, characterized in that, The sticker material object includes a first sticker material object and a second sticker material object, and the sticker material object on the first preview image is the first sticker material object; The step of overlaying the sticker material object onto the second preview image in the second window includes: The second sticker material object is overlaid and displayed on the second preview image in the second window.

5. The method according to any one of claims 1-3, characterized in that, The step of overlaying the sticker material object onto the second preview image in the second window includes: Based on the sticker material object, the content of the image in the second preview image is identified to obtain a second position in the second preview image that matches the sticker material object; The sticker material object is overlaid and displayed in the second preview image in the second display area corresponding to the second position.

6. The method according to claim 5, characterized in that, The sticker material object includes a first sticker material object and a second sticker material object. The sticker material object on the first preview image is the first sticker material object. The content of the first sticker material object and the content of the second sticker material object are continuous content. The step of identifying the content in the second preview image based on the sticker material object to obtain a second position in the second preview image that matches the sticker material object includes: Based on the second sticker material object, the content of the image in the second preview image is identified to obtain a third position in the second preview image that matches the second sticker material object; Based on the position of the first sticker material object in the first image, the third position is adjusted to obtain a second position in the second preview image that matches the second sticker material object.

7. The method according to claim 1, characterized in that, The sticker material object is a dynamic sticker material object, which includes N frames of sticker material images, and the N frames of sticker material images are displayed in a loop in the first window. The first input is the input of capturing the first image and selecting the first sticker material image from the N frames of sticker material images. The first sticker material image is any frame of sticker material image displayed in the first window when the first input is received. The first image is an image that includes the first preview image and the first sticker material image.

8. The method according to claim 1, characterized in that, The sticker material object is a dynamic sticker material object, which includes N frames of sticker material images; the shooting preview interface includes a first control; after displaying the first window in the shooting preview interface, the method further includes: Upon receiving a third input from the user to the first control, a second sticker material image is selected from the N frames of sticker material images based on the captured content within the first preview image; The second sticker material image is used as a sticker material object of at least one of the following: a sticker material object superimposed on the first preview image, or a sticker material object superimposed on the second preview image.

9. The method according to claim 1, characterized in that, The sticker material object is a custom sticker material object; Before displaying the first window in the shooting preview interface, the method further includes: Display the user's image from the user's photo album application in the sticker material selection interface; Receive a fifth input from the user who selects a target user image from the user images; In response to the fifth input, the subject image in the target user image is extracted from the target user image; The photographed subject image is used as the custom sticker material object.

10. The method according to claim 1, characterized in that, The sticker material object is a custom sticker material object; Before displaying the first window in the shooting preview interface, the method further includes: The sticker material selection interface displays user videos from the user's photo album application; Receive a sixth input from the user to select a target user video from the user videos; In response to the sixth input, the content in the target user video is identified to obtain the subject of the target user video; Filter the M-frame images of the subject being photographed from the target user's video; Extract the subject image from each of the M frames of subject images; Use the subject image captured in frame M as the custom sticker material object.

11. A shooting device, characterized in that, include: The display module is used to display a first window in the shooting preview interface. The first window includes a first preview image and a sticker material object superimposed on the first preview image. The sticker material object is a dynamic sticker material object, which includes N frames of sticker material images. The shooting preview interface also includes a second control to adjust the display progress of the N frames of sticker material images in the first window. The camera module is used to capture a first image corresponding to the first window upon receiving a first input from the user. The display module is also used to display a second window in the shooting preview interface during the camera rotation process, and to overlay the sticker material object on the second preview image in the second window. The shooting module is also used to capture a second image corresponding to the second window; The generation module is used to generate a panoramic image or panoramic video based on the first image and the second image; The display module is also used to, upon receiving a fourth input from the user to the second control, overlay a third sticker material image corresponding to the fourth input onto the first preview image in the first window; The shooting module is used to capture a first image corresponding to the first window when receiving a first input from the user. The first image is an image that includes the first preview image and the third sticker material image. The display module is also used to cyclically display the N frames of sticker material images in the second window, starting from the next frame of the sticker material image after the third sticker material image.

12. An electronic device, characterized in that, include: A processor, a memory, and a program or instructions stored in the memory and executable on the processor, wherein the program or instructions, when executed by the processor, implement the steps of the shooting method as described in any one of claims 1-9.

Images