Shooting method and device, electronic equipment and medium

Abstract

The invention discloses a shooting method and device, electronic equipment and a medium, and belongs to the technical field of image processing. The method comprises the following steps: in a dynamic photo shooting mode state, determining a scene detection result of a first shooting scene; receiving a first input; in response to the first input, a first video and a first dynamic image are obtained through shooting, and the first dynamic image is generated according to the scene detection result and the first video.

Description

Technical Field

[0001] The present application belongs to the field of image processing technology, and specifically relates to a shooting method, device, electronic equipment and medium. Background Art

[0002] Based on user needs and in the current era of rapid development of electronic devices, the dynamic photo shooting function, as a shooting mode that combines the characteristics of static photos and dynamic images, can capture dynamic images before and after the shooting moment, bringing users a more vivid shooting experience and is widely welcomed by users.

[0003] However, the current dynamic photo shooting function is limited to the content within a very short period of time before and after the shooting. If the user fails to press the shutter at the right moment due to slow reaction or misjudgment, they may miss the key scene or fail to capture the desired content, making it difficult to effectively supplement or correct the content afterward.

[0004] Therefore, it is currently unable to meet users' demand for high-quality shooting of dynamic images. Summary of the Invention

[0005] The purpose of the embodiments of the present application is to provide a shooting method, device, electronic device and medium that can solve the problem that the current user's demand for high-quality shooting of dynamic images cannot be met.

[0006] In a first aspect, an embodiment of the present application provides a shooting method, the method comprising:

[0007] In a dynamic photo shooting mode, determining a scene detection result of a first shooting scene;

[0008] receiving a first input;

[0009] In response to the first input, a first video and a first dynamic image are captured, where the first dynamic image is generated based on the scene detection result and the first video.

[0010] In a second aspect, an embodiment of the present application provides a photographing device, the device comprising:

[0011] a determination module, configured to determine a scene detection result of a first shooting scene in a dynamic photo shooting mode;

[0012] A receiving module, configured to receive a first input;

[0013] The shooting module is used to shoot a first video and a first dynamic image in response to the first input, where the first dynamic image is generated according to the scene detection result and the first video.

[0014] In a third aspect, an embodiment of the present application provides an electronic device comprising a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.

[0015] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

[0016] In a fifth aspect, an embodiment of the present application provides a chip, which includes a processor and a communication interface, the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the method described in the first aspect.

[0017] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and executed by at least one processor to implement the method described in the first aspect.

[0018] In an embodiment of the present application, in the dynamic photo shooting mode, the scene detection result of the first shooting scene is determined to provide a basis for subsequent shooting processing. In response to the first input, a first video and a first dynamic image are captured. The first dynamic image is generated based on the scene detection result and the first video. The first dynamic image can be intelligently generated based on the first video according to different shooting scenes, thereby improving the shooting quality and effect of the dynamic photo, so that the generated first dynamic image is visually more in line with the user's expectations and meets the user's shooting needs. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 This is a flowchart of a shooting method provided by an embodiment of the present application;

[0020] Figure 2 is a schematic diagram of a first dynamic image provided by an embodiment of the present application;

[0021] Figure 3 is a schematic diagram of an image processing process provided by an embodiment of the present application;

[0022] Figure 4 is a structural diagram of a photographing device provided in an embodiment of the present application;

[0023] Figure 5 This is one of the hardware structure diagrams of the electronic device according to the embodiment of the present application;

[0024] Figure 6 This is the second hardware structure diagram of the electronic device according to the embodiment of the present application. DETAILED DESCRIPTION

[0025] The following will be combined with the accompanying drawings of the embodiments of the present application to clearly describe the technical solutions of the embodiments of the present application. Obviously, the embodiments described are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments of the present application, all other embodiments obtained by ordinary technicians in this field are within the scope of protection of this application.

[0026] The terms "first," "second," and the like in the specification and claims of this application are used to distinguish similar objects, and are not used to describe a specific order or precedence. It should be understood that the terms used in this manner are interchangeable where appropriate, so that the embodiments of this application can be implemented in an order other than that illustrated or described herein, and that the objects distinguished by "first," "second," and the like are generally of the same type, and do not limit the number of objects; for example, the first object can be one or more. In addition, the term "and / or" in the specification and claims refers to at least one of the connected objects, and the character " / " generally indicates that the objects connected are in an "or" relationship.

[0027] The shooting method provided in the embodiment of the present application can be applied to at least the following application scenarios, which are described below.

[0028] In response to the problems arising from the related technologies, the embodiments of the present application provide a shooting method, device, electronic device and medium, which can solve the problem in the related technologies that the high-quality shooting needs of users for dynamic images cannot be met.

[0029] The following describes the shooting method provided in the embodiment of the present application in detail through specific embodiments and their application scenarios in conjunction with the accompanying drawings.

[0030] Figure 1 A flowchart of a shooting method provided in an embodiment of the present application.

[0031] like Figure 1 As shown, the shooting method may include steps 110 to 130, and the method is applied to a shooting device, as shown below:

[0032] Step 110, in the dynamic photo shooting mode, determining a scene detection result of a first shooting scene;

[0033] Live Photo mode: This mode, unlike traditional still photos, not only records static images but also captures dynamic images in the short period before and after the shot. Also known as Live Photo mode, when this mode is enabled, a 1.5-second video is recorded before and after the user presses the shutter button, and then combined with the captured photo to create a 3-second dynamic image with sound.

[0034] Scene detection results: Conclusions drawn by analyzing the characteristics of the shooting environment or object through the device's image recognition, sensor data, and other technical means. For example, the scene type identified is night scene, strong light, portrait, etc.

[0035] In the dynamic photo shooting mode, the scene detection results are saved in the background. On the one hand, they can be used to automatically optimize the shooting parameters during shooting, so that the cover frame and the entire dynamic photo shooting effect are more in line with the characteristics of the scene; on the other hand, they can also provide users with some reference information. For example, during post-editing, suitable filters or editing styles can be recommended based on the scene detection results.

[0036] In dynamic photo shooting mode, the electronic device uses its own image sensors, algorithm models, etc. to analyze the current shooting environment, such as detecting light intensity, color distribution, object type and other information, so as to determine the scene detection result of the first shooting scene and provide a basis for subsequent shooting processing.

[0037] Step 120, receiving a first input;

[0038] Specifically, when the first input to the video recording control is received, the first shooting scene is shot; when the user makes the first input to the video recording control, the electronic device calls the corresponding shooting parameters and algorithms based on the determined scene detection results, captures the image of the first shooting scene, and starts recording the picture information.

[0039] Step 130 : In response to the first input, a first video and a first dynamic image are captured, where the first dynamic image is generated based on the scene detection result and the first video.

[0040] After the shooting is completed, a video clip, namely the first video, is obtained. At the same time, based on the previous scene detection results, a specific algorithm is used to process the first video, extract keyframes and other information, and generate a first dynamic image, combining the dynamic video content with the static image characteristics.

[0041] It can intelligently adjust shooting parameters and generate dynamic photos based on different shooting scenarios, improving the quality and effect of dynamic photos. For example, in night scenes, it can optimize parameters such as exposure and noise reduction to make the generated dynamic images and videos more visually consistent with user expectations, enhance the user's shooting experience, and meet diverse shooting needs.

[0042] In a possible embodiment, step 130 includes:

[0043] In response to the first input, capturing the first video;

[0044] The first video is processed according to an image processing algorithm associated with the scene detection result to obtain the first dynamic image.

[0045] Image processing algorithms are a collection of mathematical algorithms that analyze, transform, enhance, restore, and compress images. Specific algorithms are used to match the detection results of different scenarios. For example, algorithms for noise reduction and exposure enhancement can be used for night scenes, while algorithms for beautification and skin tone optimization can be applied for portrait scenes.

[0046] When the video recording operation is stopped, the image sensor of the electronic device stops capturing images, and the continuous image frames recorded during this period are integrated to form a complete video stream data, that is, the first video is obtained.

[0047] Based on the previously determined scene detection results, the corresponding specific image processing algorithm is invoked. For example, if a bright light scene is detected, the image processing algorithm associated with the scene detection result will perform overexposure correction and color restoration on the image frames in the first video. For portrait scenes, beautification processing such as skin smoothing and face slimming will be performed. By applying these algorithmic operations to key frames or all frames in the video, image information is extracted and optimized, ultimately generating a first dynamic image that combines the characteristics of a static photo with dynamic elements.

[0048] By applying specific algorithms to video processing based on different scenarios, the resulting moving images are optimized in terms of image quality, color, and detail. For example, moving images generated in low-light scenes are not too dim or blurry, while those in bright light scenes are not overexposed or distorted, thereby improving image quality. This meets the user's shooting needs in diverse scenarios, allowing users to achieve relatively ideal moving photo effects without manually adjusting complex parameters, thereby enhancing user satisfaction with the device's shooting functions.

[0049] In a possible embodiment, before step 130, the following steps may be further included:

[0050] receiving a second input to the camera control;

[0051] In response to the second input, capturing a second dynamic image;

[0052] Step 130 may specifically include the following steps:

[0053] When the first input is an input to the video recording control, capturing a first video;

[0054] The second dynamic image is processed according to the scene detection result and the first video to obtain the first dynamic image.

[0055] Second dynamic image: After receiving the second input to the photo control, that is, clicking the photo operation, the device captures an image with dynamic characteristics, which includes dynamic information of the short time before and after the shooting moment.

[0056] The first dynamic image is a dynamic image obtained by further processing the second dynamic image in combination with the first video and other information after the video recording operation is completed.

[0057] When the user makes a second input to the camera control, the electronic device's image sensor quickly captures the instantaneous image information, simultaneously recording the dynamic scene immediately before and after the shot. Using image acquisition and processing technology, this information is integrated to generate a second dynamic image, which is then stored in the electronic device.

[0058] Based on the previously obtained scene detection results and combined with the dynamic information in the first video, the existing second dynamic image is processed. For example, continuous frames in the video are used to supplement the dynamic effect of the second dynamic image, or specific algorithms are used to optimize the color and clarity of the second dynamic image based on the scene type, ultimately generating the first dynamic image.

[0059] By processing the initial dynamic image in conjunction with video information, the final first dynamic image can have a richer and more coherent dynamic display effect, providing a better visual experience than simply shooting dynamic images. Processing based on scene detection results can ensure that dynamic images present better image quality and effects in different shooting scenarios, improving overall image quality, meeting users' diverse shooting needs, and enhancing the practicality and fun of shooting functions.

[0060] In a possible embodiment, after step 130, the following steps may be further included:

[0061] displaying the first dynamic image and a plurality of first image frames in the first video, wherein a time difference between shooting time of the plurality of first image frames and shooting time of the first dynamic image is less than a threshold;

[0062] receiving a third input of a plurality of second image frames among the plurality of first image frames;

[0063] In response to the third input, a third dynamic image is generated based on a plurality of the second image frames.

[0064] First image frame: a single static picture constituting the first video.

[0065] Threshold: A pre-set time difference standard used to measure the proximity between the capture time of the first image frame and the capture time of the first dynamic image.

[0066] Second image frame: a specific image frame selected from multiple first image frames, and a new dynamic image will be generated based on the second image frame.

[0067] The third dynamic image: a new dynamic image generated according to the operation on the second image frame, having a specific dynamic display effect.

[0068] After generating the first dynamic image and the first video, multiple first image frames whose shooting time difference with the first dynamic image is less than a threshold are screened out, and the multiple first image frames and the first dynamic image are displayed. Figure 2 As shown, when the second input to the video control 100 is received, a first video and a first dynamic image are captured, and the first dynamic image 200 and a plurality of first image frames 300 in the first video are displayed.

[0069] After viewing the displayed multiple first image frames, the user performs an operation on the multiple second image frames, such as selecting or marking them. The electronic device receives the user's operation instructions through a corresponding interactive interface. After receiving a third input, the electronic device generates a new dynamic image based on the multiple second image frames selected by the user, using a specific algorithm and processing logic, i.e., a third dynamic image.

[0070] Based on their needs and preferences, users can select specific second frames from multiple first frames to generate a third dynamic image, satisfying their personalized needs for dynamic images and enhancing the user experience. By selecting first frames captured close to the time of the first dynamic image and generating the third dynamic image based on the user-selected second frame, the generated third dynamic image achieves more accurate and natural temporal coherence and dynamic effects, enhancing the quality and viewing experience of the dynamic image. This feature also provides users with the ability to further edit the captured content, allowing them to select and manipulate captured frames, increasing the flexibility and editability of the shooting function.

[0071] In a possible embodiment, after step 130, the following steps may be further included:

[0072] displaying the first dynamic image and a plurality of image frames included in the first dynamic image;

[0073] receiving a fourth input of a third image frame among the plurality of image frames;

[0074] In response to the fourth input, the original cover frame of the first dynamic image is replaced with the third image frame to obtain a fourth dynamic image.

[0075] Original Cover Frame: The default still image displayed for the first live image, typically the first frame or keyframe at the moment of capture. In LivePhoto mode, a live image spans approximately three seconds, including 1.5 seconds before and after the shutter release. The Original Cover Frame is the frame within this live image selected for the still image display, typically the moment the shutter release was pressed.

[0076] Third image frame: a specific frame selected by the user from the multiple image frames included in the first dynamic image, used to replace the original cover frame.

[0077] The fourth dynamic image: a new dynamic image generated by replacing the original cover frame of the first dynamic image with the third image frame. The dynamic content of the new dynamic image remains unchanged, but the cover display effect is updated.

[0078] The data structure of the first dynamic image is parsed to extract all image frames contained therein, which may be consecutive frames within 1.5 seconds before and after the capture. The first dynamic image and its frames are visually displayed through an image preview interface, such as a timeline slider or a thumbnail grid, allowing a user to browse images at different time points.

[0079] The user selects the third image frame by touch, click or sliding, for example, selecting a picture with a better expression 2 seconds after shooting, and replaces the storage location of the original cover frame with the pixel data of the third image frame, keeping other frames and dynamic timestamps unchanged, and updating the metadata of the dynamic image, such as the cover frame index value, so that the fourth dynamic image displays the new cover during preview, but still presents the original dynamic content during playback.

[0080] For example, when photographing a pet or child, if the subject is moving quickly, the original cover image may capture moments like closed eyes or blur. Users can then select a frame with a clear expression from subsequent frames as the cover image. Replace the cover image to showcase the optimal lighting or cloud flow during the action, such as the moment the sun completely breaks the horizon at sunrise. In a group photo, select a frame with natural expressions from everyone as the cover image, avoiding issues like closed eyes and awkward expressions that can occur in traditional single-shot photography.

[0081] Users can flexibly adjust the cover frame of a Motion Picture, resolving issues with poorly timed capture, resulting in suboptimal expressions and composition. Replacing only the cover frame without affecting other frames ensures the original capture process is fully preserved, avoiding content loss caused by reshoots. The intuitive frame selection interface and instant preview feedback lower the barrier to entry, making it easy for even non-expert users to optimize Motion Pictures.

[0082] In a possible embodiment, after the above-mentioned step of displaying the first dynamic image and the multiple image frames included in the first dynamic image, the following steps may be further included:

[0083] receiving a fifth input of at least two adjacent fourth image frames among the plurality of image frames;

[0084] In response to the fifth input, deleting at least two of the fourth image frames from the plurality of image frames to obtain a plurality of fifth image frames;

[0085] generating a sixth image frame according to at least two of the fourth image frames;

[0086] A fifth dynamic image is generated based on the plurality of fifth image frames and the sixth image frames.

[0087] Fourth image frames: at least two adjacent image frames selected from the plurality of image frames included in the first dynamic image, which are selected by the user as objects for subsequent processing.

[0088] Fifth image frame: the image frame remaining in the first dynamic image after deleting the selected at least two adjacent fourth image frames.

[0089] Sixth image frame: a new image frame generated based on at least two selected adjacent fourth image frames, which may be processed by a specific algorithm, such as synthesis, optimization, etc.

[0090] The fifth dynamic image: a dynamic image finally generated by using the plurality of fifth image frames and the sixth image frames, which may have changed in content and effect compared to the original first dynamic image.

[0091] When viewing the displayed first dynamic image and the plurality of image frames contained therein, the user selects at least two adjacent fourth image frames through a fifth input, receives the user's selection operation, and records the position and related information of the selected image frames in the entire image frame sequence.

[0092] According to the received fifth input, at least two adjacent fourth image frames are located and deleted. After the deletion operation is completed, the remaining image frames are marked as fifth image frames to form a new image frame set.

[0093] The at least two selected adjacent fourth image frames may be processed by applying an image synthesis algorithm, an image enhancement algorithm, etc. For example, adjacent image frames may be merged, and color and contrast may be adjusted to generate a new sixth image frame.

[0094] The step of generating the sixth image frame based on at least two of the fourth image frames can be implemented in the following manner:

[0095] Input at least two of the fourth image frames into IFNet, and output an approximate intermediate stream. In a video or continuous image sequence, two adjacent frames contain information about the temporal changes of an object. IFNet is a model that inputs the two adjacent frames into IFNet.

[0096] Approximate intermediate flows are similar to optical flow. Optical flow is a method for calculating pixel motion in videos, estimating object motion by analyzing the displacement of pixels between adjacent frames. The "approximate intermediate flows" here are similar concepts, calculating the motion information between adjacent frames to describe the pixel changes between two images.

[0097] Then, backward warping is performed together with the image of the first frame of at least two fourth image frames to obtain two predicted images. Backward warping is an image transformation technology.

[0098] The "approximate intermediate flow" described above describes the pixel movement from the second frame to the first frame. This motion information is used to transform the first frame. Specifically, the pixels in the first frame are rearranged according to the direction and distance of pixel movement indicated by the "flow." This operation results in a predicted image, which is based on the first frame and the motion information.

[0099] Finally, the image and the second frame undergo a fusion process to produce a predicted image. The predicted image and the second frame are fed into a fusion process. The information from the predicted image and the second frame is combined, using methods such as weighted averaging or optimization algorithms. This combines their strengths to produce a more accurate intermediate frame prediction. This final output is the predicted intermediate frame between the first and second frames, reflecting the image content that occurs temporally between the first and second frames.

[0100] The obtained plurality of fifth image frames and the generated sixth image frame are integrated and rearranged according to the format and rules of a dynamic image. A dynamic display effect is added to the new image frame sequence according to preset dynamic effect parameters to finally generate a fifth dynamic image.

[0101] By deleting unnecessary frames, users can remove undesirable aspects of the dynamic image, such as blurry images or unnecessary motion, making the fifth dynamic image more refined and tailored to their needs. The generation of the sixth frame can be customized based on the user's selected frames to meet their personalized requirements for dynamic images, such as highlighting specific scenes or actions. By screening, deleting, and processing these frames, the overall quality of the fifth dynamic image, including image clarity and color reproduction, can be improved, enhancing the user's visual experience.

[0102] In an embodiment of the present application, in the dynamic photo shooting mode, the scene detection result of the first shooting scene is determined to provide a basis for subsequent shooting processing. In response to the first input, a first video and a first dynamic image are captured. The first dynamic image is generated based on the scene detection result and the first video. The first dynamic image can be intelligently generated based on the first video according to different shooting scenes, thereby improving the shooting quality and effect of the dynamic photo, so that the generated first dynamic image is visually more in line with the user's expectations and meets the user's shooting needs.

[0103] The following combination Figure 3 To explain: First, regarding the preview interface: After turning on the LivePhoto mode, the data is first "mixed into data frames" and then further saved to the general flash storage, while providing the user with a real-time preview interface to ensure that the captured content can be viewed immediately.

[0104] Secondly, the capture logic involves analyzing the scene detection results after the capture is initiated. Based on these results, the corresponding multi-frame algorithm, such as Night Mode or HDR Mode, is selected to optimize the capture effect. The data generated by the capture is directly written to the UFS, ensuring stable and efficient data storage. After the capture is completed, the process enters the content preservation phase.

[0105] Next, the content preservation logic is involved: the video content is saved in MP4 format to the album for regular viewing by users. Based on MP4 and related data, the first dynamic image is generated in the album to increase interactivity and fun. The original data is read from UFS, which may be used to further process the details of the photo and cooperate with multi-frame algorithms to improve image quality, such as HDR synthesis and night scene noise reduction. Through data storage, scene detection and multi-frame algorithm optimization, content preservation and generation, a complete closed loop from shooting to storage is achieved, ensuring the efficiency and intelligence of shooting effects and storage management.

[0106] Next, the content editing logic involves: at the start of the process, the video content begins to play. The user deletes unclear or unnecessary parts of the video, and determines whether the number of consecutive image frames deleted by the user is greater than or equal to 2.

[0107] If so, the automatic frame extraction module is entered to automatically extract frames from the video.

[0108] If not, the system proceeds directly to the user selection step, where the user manually selects the video content to retain. Based on the scene detection results, a specific raw-domain multi-frame algorithm is selected; alternatively, a Yuv-domain algorithm, such as beauty or blur, is applied to the video to further optimize the video effect and update the LivePhoto cover frame.

[0109] Finally, the content preservation logic is involved: when the user clicks the "LivePhoto button" displayed on the interface, LivePhoto file generation is triggered. The generated file supports functions such as playback, deletion, frame deletion, and cover change, providing flexible editing operations. The final LivePhoto file is saved, and useless files are deleted to optimize storage resources. The entire process, through two stages of content editing and content preservation, completes the entire process from video processing to LivePhoto file output, balancing user-initiated operations with automatic algorithm optimization to ensure the generation of high-quality LivePhoto files that meet requirements.

[0110] The shooting method provided in the embodiment of the present application can be executed by a shooting device. In the embodiment of the present application, the shooting method is executed by a shooting device as an example to illustrate the shooting device provided in the embodiment of the present application.

[0111] Figure 4 4 is a block diagram of a photographing device provided in an embodiment of the present application. The device 400 includes:

[0112] A determination module 410 is configured to determine a scene detection result of a first shooting scene in a dynamic photo shooting mode;

[0113] Receiving module 420, configured to receive a first input;

[0114] The shooting module 430 is configured to shoot a first video and a first dynamic image in response to the first input, where the first dynamic image is generated based on the scene detection result and the first video.

[0115] In a possible embodiment, the shooting module 430 is specifically configured to:

[0116] In response to the first input, capturing the first video;

[0117] The first video is processed according to an image processing algorithm associated with the scene detection result to obtain the first dynamic image.

[0118] In a possible embodiment, the receiving module 420 is further configured to receive a second input to the photo control;

[0119] The shooting module 430 is further configured to shoot a second dynamic image in response to the second input;

[0120] The shooting module 430 is specifically used to:

[0121] When the first input is an input to the video recording control, capturing a first video;

[0122] The second dynamic image is processed according to the scene detection result and the first video to obtain the first dynamic image.

[0123] In a possible embodiment, the device may further include:

[0124] A display module, configured to display the first dynamic image and a plurality of first image frames in the first video, wherein a time difference between shooting time of the plurality of first image frames and shooting time of the first dynamic image is less than a threshold;

[0125] The receiving module 420 is further configured to receive a third input of a plurality of second image frames in the plurality of first image frames;

[0126] The device may also include:

[0127] A generating module is configured to generate a third dynamic image based on a plurality of the second image frames in response to the third input.

[0128] In a possible embodiment, the display module is further configured to display the first dynamic image and a plurality of image frames included in the first dynamic image;

[0129] The receiving module 420 is further configured to receive a fourth input of a third image frame among the plurality of image frames;

[0130] The device may also include:

[0131] A replacement module is configured to replace the original cover frame of the first dynamic image with the third image frame in response to the fourth input, so as to obtain a fourth dynamic image.

[0132] In a possible embodiment, the receiving module 420 is further configured to receive a fifth input of at least two adjacent fourth image frames among the plurality of image frames;

[0133] The device may also include:

[0134] a deleting module, configured to delete at least two of the fourth image frames from the plurality of image frames in response to the fifth input, to obtain a plurality of fifth image frames;

[0135] The generating module is further configured to generate a sixth image frame based on at least two of the fourth image frames;

[0136] The generating module is further configured to generate a fifth dynamic image based on the plurality of the fifth image frames and the sixth image frames.

[0137] In an embodiment of the present application, in the dynamic photo shooting mode, the scene detection result of the first shooting scene is determined to provide a basis for subsequent shooting processing. In response to the first input, a first video and a first dynamic image are captured. The first dynamic image is generated based on the scene detection result and the first video. The first dynamic image can be intelligently generated based on the first video according to different shooting scenes, thereby improving the shooting quality and effect of the dynamic photo, so that the generated first dynamic image is visually more in line with the user's expectations and meets the user's shooting needs.

[0138] The shooting device in the embodiments of the present application can be an electronic device or a component of an electronic device, such as an integrated circuit or chip. The electronic device can be a terminal or other device other than a terminal. For example, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a mobile internet device (MID), an augmented reality (AR) / virtual reality (VR) device, a robot, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), etc. It can also be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), a teller machine, or a self-service machine, etc., and the embodiments of the present application do not specifically limit this.

[0139] The shooting device of the embodiment of the present application may be a device having an action system. The action system may be an Android action system, an iOS action system, or other possible action systems, which are not specifically limited in the embodiment of the present application.

[0140] The shooting device provided in the embodiment of the present application can implement each process implemented in the above method embodiment. To avoid repetition, it will not be described here.

[0141] Alternatively, as Figure 5As shown, an embodiment of the present application also provides an electronic device 510, including a processor 511, a memory 512, and a program or instruction stored in the memory 512 and executable on the processor 511. When the program or instruction is executed by the processor 511, each step of any of the above-mentioned shooting method embodiments is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be described here.

[0142] It should be noted that the electronic devices in the embodiments of the present application include the above-mentioned mobile electronic devices and non-mobile electronic devices.

[0143] Figure 6 A schematic diagram of the hardware structure of an electronic device implementing an embodiment of the present application.

[0144] The electronic device 600 includes but is not limited to components such as a radio frequency unit 601 , a network module 602 , an audio output unit 603 , an input unit 604 , a sensor 605 , a display unit 606 , a user input unit 607 , an interface unit 608 , a memory 609 , and a processor 610 .

[0145] Those skilled in the art will understand that the electronic device 600 may also include a power source (such as a battery) to power each component, and the power source may be logically connected to the processor 610 through a power management system, thereby implementing functions such as charging, discharging, and power consumption management through the power management system. Figure 6 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be repeated here.

[0146] The processor 610 is configured to determine a scene detection result of a first shooting scene in a dynamic photo shooting mode;

[0147] A user input unit 607, configured to receive a first input;

[0148] The processor 610 is further configured to capture a first video and a first dynamic image in response to the first input, where the first dynamic image is generated based on the scene detection result and the first video.

[0149] Optionally, the processor 610 is further configured to capture and obtain the first video in response to the first input;

[0150] The processor 610 is further configured to process the first video according to an image processing algorithm associated with the scene detection result to obtain the first dynamic image.

[0151] Optionally, the user input unit 607 is further configured to receive a second input to the photo control;

[0152] The processor 610 is further configured to capture a second dynamic image in response to the second input;

[0153] The processor 610 is further configured to capture a first video when the first input is an input to the video recording control;

[0154] The processor 610 is further configured to process the second dynamic image according to the scene detection result and the first video to obtain the first dynamic image.

[0155] Optionally, the display unit 606 is configured to display the first dynamic image and a plurality of first image frames in the first video, wherein a time difference between shooting time of the plurality of first image frames and shooting time of the first dynamic image is less than a threshold;

[0156] The user input unit 607 is further configured to receive a third input of a plurality of second image frames in the plurality of first image frames;

[0157] The processor 610 is further configured to generate a third dynamic image based on a plurality of the second image frames in response to the third input.

[0158] Optionally, the display unit 606 is further configured to display the first dynamic image and a plurality of image frames included in the first dynamic image;

[0159] The user input unit 607 is further configured to receive a fourth input for a third image frame among the plurality of image frames;

[0160] The processor 610 is further configured to, in response to the fourth input, replace the original cover frame of the first dynamic image with the third image frame to obtain a fourth dynamic image.

[0161] Optionally, the user input unit 607 is further configured to receive a fifth input of at least two adjacent fourth image frames among the plurality of image frames;

[0162] The processor 610 is further configured to, in response to the fifth input, delete at least two of the fourth image frames from the plurality of image frames to obtain a plurality of fifth image frames;

[0163] The processor 610 is further configured to generate a sixth image frame based on at least two of the fourth image frames;

[0164] The processor 610 is further configured to generate a fifth dynamic image based on the plurality of fifth image frames and the sixth image frames.

[0165] In an embodiment of the present application, in the dynamic photo shooting mode, the scene detection result of the first shooting scene is determined to provide a basis for subsequent shooting processing. In response to the first input, a first video and a first dynamic image are captured. The first dynamic image is generated based on the scene detection result and the first video. The first dynamic image can be intelligently generated based on the first video according to different shooting scenes, thereby improving the shooting quality and effect of the dynamic photo, so that the generated first dynamic image is visually more in line with the user's expectations and meets the user's shooting needs.

[0166] It should be understood that in an embodiment of the present application, the input unit 604 may include a graphics processing unit (GPU) 6041 and a microphone 6042, and the graphics processor 6041 processes image data of a static picture or video image obtained by an image capture device (such as a camera) in a video image capture mode or an image capture mode. The display unit 606 may include a display panel 6061, and the display panel 6061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 607 includes a touch panel 6071 and at least one of other input devices 6072. The touch panel 6071 is also called a touch screen. The touch panel 6071 may include two parts: a touch detection device and a touch controller. Other input devices 6072 may include but are not limited to a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and an action stick, which will not be repeated here. The memory 609 can be used to store software programs and various data, including but not limited to applications and action systems. The processor 610 may integrate an application processor and a modem processor, wherein the application processor mainly processes the action system, user pages and applications, and the modem processor mainly processes wireless communications. It is understandable that the modem processor may not be integrated into the processor 610.

[0167] The memory 609 can be used to store software programs and various data. The memory 609 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, applications or instructions required for at least one function (such as a sound playback function, an image playback function, etc.). In addition, the memory 609 may include a volatile memory or a non-volatile memory, or the memory x09 may include both volatile and non-volatile memory. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM), and a direct memory bus random access memory (DRRAM). The memory 609 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0168] Processor 610 may include one or more processing units. Optionally, processor 610 integrates an application processor and a modem processor. The application processor primarily handles operations related to the operating system, user interface, and application programs, while the modem processor primarily processes wireless communication signals, such as a baseband processor. It is understood that the modem processor may not be integrated into processor 610.

[0169] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned shooting method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0170] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0171] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned shooting method embodiment and achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0172] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0173] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned shooting method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0174] It should be noted that, in this article, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the statement "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device comprising the element. In addition, it should be noted that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in the opposite order according to the functions involved. For example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0175] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), including a number of instructions for enabling a terminal (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods described in each embodiment of the present application.

[0176] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of this application, ordinary technicians in this field can also make many forms without departing from the purpose of this application and the scope of protection of the claims, all of which are within the protection of this application.

Claims

1. A shooting method, characterized in that: The method comprises: In a dynamic photo shooting mode, determining a scene detection result of a first shooting scene; receiving a first input; In response to the first input, a first video and a first dynamic image are captured, where the first dynamic image is generated based on the scene detection result and the first video.

2. The method according to claim 1, characterized in that The step of capturing a first video and a first dynamic image in response to the first input includes: In response to the first input, capturing the first video; The first video is processed according to an image processing algorithm associated with the scene detection result to obtain the first dynamic image.

3. The method according to claim 1, characterized in that Before capturing the first video and the first dynamic image in response to the first input, the method further includes: receiving a second input to the camera control; In response to the second input, capturing a second dynamic image; The step of capturing a first video and a first dynamic image in response to the first input includes: When the first input is an input to the video recording control, capturing a first video; The second dynamic image is processed according to the scene detection result and the first video to obtain the first dynamic image.

4. The method according to claim 1, wherein After obtaining the first video and the first dynamic image in response to the first input, the method further includes: displaying the first dynamic image and a plurality of first image frames in the first video, wherein a time difference between shooting time of the plurality of first image frames and shooting time of the first dynamic image is less than a threshold; receiving a third input of a plurality of second image frames among the plurality of first image frames; In response to the third input, a third dynamic image is generated based on a plurality of the second image frames.

5. The method according to claim 1, characterized in that After obtaining the first video and the first dynamic image in response to the first input, the method further includes: displaying the first dynamic image and a plurality of image frames included in the first dynamic image; receiving a fourth input of a third image frame among the plurality of image frames; In response to the fourth input, the original cover frame of the first dynamic image is replaced with the third image frame to obtain a fourth dynamic image.

6. The method according to claim 5, characterized in that After displaying the first dynamic image and the plurality of image frames included in the first dynamic image, the method further includes: receiving a fifth input of at least two adjacent fourth image frames among the plurality of image frames; In response to the fifth input, deleting at least two of the fourth image frames from the plurality of image frames to obtain a plurality of fifth image frames; generating a sixth image frame according to at least two of the fourth image frames; A fifth dynamic image is generated based on the plurality of fifth image frames and the sixth image frames.

7. A photographing device, characterized in that: The device comprises: a determination module, configured to determine a scene detection result of a first shooting scene in a dynamic photo shooting mode; A receiving module, configured to receive a first input; The shooting module is used to shoot a first video and a first dynamic image in response to the first input, where the first dynamic image is generated according to the scene detection result and the first video.

8. The device according to claim 7, characterized in that The shooting module is specifically used for: In response to the first input, capturing the first video; The first video is processed according to an image processing algorithm associated with the scene detection result to obtain the first dynamic image.

9. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the shooting method according to any one of claims 1 to 6 are implemented.

10. A readable storage medium, characterized in that: The readable storage medium stores a program or instruction, and when the program or instruction is executed by a processor, the steps of the shooting method according to any one of claims 1 to 6 are implemented.

Images