Shooting method and device, electronic equipment and medium

Abstract

The invention relates to a shooting method and device, electronic equipment and a medium, and the method comprises the steps: collecting a plurality of first image frames in response to a first operation in a shooting process; displaying the plurality of first image frames and first marks, and displaying video capture areas in the plurality of first image frames by using the first marks; according to the method, the images of the video capture area in the plurality of first image frames serve as the images recorded in the shooting process, the proportion of the shot images is automatically adjusted, the recorded images are clearer, a user is helped to shoot more professional and natural high-quality videos, and the requirement of the user for video shooting is met.

Description

Technical Field

[0001] The present disclosure relates to the technical field of electronic equipment, and in particular to a shooting method, device, electronic equipment, and medium. Background Art

[0002] In the digital age, cameras have become an indispensable part of many people's lives. The functions of cameras in electronic devices are not limited to taking still photos, but can also be used to shoot videos and live streaming.

[0003] However, the shooting methods currently available in electronic devices are relatively simple, and generally the images captured by the camera are directly recorded as videos. However, the images captured by the camera may contain a variety of people, scenery, animals, etc., some of which are not the objects that users want to record videos, resulting in users being unable to capture the desired effect and having a poor shooting experience. Summary of the invention

[0004] In order to overcome the problems existing in the related art, the present disclosure provides a shooting method, device, electronic device and medium.

[0005] According to a first aspect of an embodiment of the present disclosure, a shooting method is provided, the shooting method comprising:

[0006] In response to a first operation, a plurality of first image frames are acquired, wherein the plurality of first image frames include a first object;

[0007] displaying the plurality of first image frames and a first mark, wherein the first mark is located in an area where the first object is located, and the first mark indicates that the area where the first mark is located in the plurality of first image frames is being used as a video capture area for generating a video;

[0008] A video is generated based on the images of the video capture area in the plurality of first image frames.

[0009] In some exemplary embodiments of the present disclosure, the shooting method further includes:

[0010] In response to the second operation, the first mark gradually moves from the area where the first object is located in the plurality of first image frames to the area where the second object is located.

[0011] In some exemplary embodiments of the present disclosure, the shooting method further includes:

[0012] A plurality of second image frames are displayed, wherein the plurality of second image frames show images of the region where the first mark is located in the plurality of first image frames.

[0013] In some exemplary embodiments of the present disclosure, the shooting method further includes:

[0014] When the first mark gradually moves from the area where the first object is located in the plurality of first image frames to the area where the second object is located, the images displayed in the plurality of second image frames change as the area where the first mark is located changes.

[0015] In some exemplary embodiments of the present disclosure, the shooting method includes:

[0016] In response to a third operation, a size of the first mark is adjusted.

[0017] In some exemplary embodiments of the present disclosure, the shooting method further includes:

[0018] The other regions in the multiple first image frames except the region where the first mark is located are displayed in a blurred manner.

[0019] In some exemplary embodiments of the present disclosure, before displaying the plurality of first image frames and the first mark, the method further includes:

[0020] displaying the plurality of first image frames and identifying a preset object in the first image frames;

[0021] A second mark is displayed, where the second mark indicates an area where a preset object is located in the plurality of first image frames.

[0022] In some exemplary embodiments of the present disclosure, the shooting method further includes:

[0023] changing a second mark indicating a region where the preset object with the highest priority among the plurality of first image frames is located to the first mark;

[0024] The first mark is different from the second mark.

[0025] In some exemplary embodiments of the present disclosure, the shooting method further includes:

[0026] When the preset object is not recognized in the plurality of first image frames, the first mark is displayed at a preset position of the plurality of first image frames.

[0027] In some exemplary embodiments of the present disclosure, before displaying the plurality of first image frames and the first mark, the method further includes:

[0028] In response to a sixth operation, canceling display of the second mark;

[0029] Based on the sixth operation being applied to the region of the plurality of first image frames, the first mark is displayed.

[0030] In some exemplary embodiments of the present disclosure, the shooting method further includes:

[0031] In response to a seventh operation, canceling display of the first mark;

[0032] A second mark is displayed, where the second mark indicates an area where a preset object is located in the plurality of first image frames.

[0033] In some exemplary embodiments of the present disclosure, the shooting method further includes:

[0034] Acquire a plurality of third image frames, wherein the plurality of third image frames are sequentially connected to the plurality of first image frames, the plurality of third image frames include a plurality of first frames acquired within a first duration period, the plurality of first frames include a second object but do not include the first object;

[0035] The first mark moves from an area where the first object is located in the plurality of first image frames to an area where the second object is located in the plurality of first frames.

[0036] In some exemplary embodiments of the present disclosure, the plurality of third image frames further include a plurality of second frames acquired during a second duration, the plurality of second frames are sequentially connected to the plurality of first frames, and the second frames include the first object and the second object;

[0037] The shooting method further includes:

[0038] When the first duration is less than or equal to a preset duration, the first mark is moved from the area where the second object is located in the plurality of second frames to the area where the first object is located.

[0039] In some exemplary embodiments of the present disclosure, the shooting method further includes:

[0040] The range of the first mark occupies an area greater than or equal to 1 / 2 of the plurality of first image frames.

[0041] According to a second aspect of an embodiment of the present disclosure, a photographing device is provided, the photographing device comprising:

[0042] A collection module, configured to collect a plurality of first image frames in response to a first operation, wherein the plurality of first image frames include a first object;

[0043] A display module, configured to display the plurality of first image frames and a first mark, wherein the first mark is located in an area where the first object is located, and the first mark indicates that the area where the first mark is located in the plurality of first image frames is being used as a video capture area for generating a video;

[0044] A generating module is used to generate a video according to the images of the video recording area in the multiple first image frames.

[0045] According to a third aspect of an embodiment of the present disclosure, an electronic device is provided, the electronic device comprising:

[0046] Camera;

[0047] processor;

[0048] a memory for storing processor-executable instructions;

[0049] Among them, the processor is configured to execute executable instructions in the memory to implement the shooting method provided in the first aspect of the present disclosure.

[0050] According to a fourth aspect of an embodiment of the present disclosure, a non-temporary computer-readable storage medium is provided, on which executable instructions are stored. When the executable instructions are executed by a processor, the shooting method provided by the first aspect of the present disclosure is implemented.

[0051] The above-mentioned method of the present invention has the following beneficial effects: during the video shooting process, the method of the present invention collects multiple first image frames in response to the first operation; displays multiple first image frames and first marks, uses the first mark to display the video capture area in the multiple first image frames, uses the image of the video capture area in the multiple first image frames as the image recorded during the shooting process, automatically adjusts the ratio of the shooting picture to make the recorded image clearer, and helps users shoot more professional, natural and high-quality videos to meet users' needs for video shooting.

[0052] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0054] Figure 1 is a flowchart of a shooting method according to an exemplary embodiment.

[0055] Figure 2-1 is a schematic diagram of a photographing method according to an exemplary embodiment.

[0056] Figure 2-2 is a schematic diagram of a photographing method according to an exemplary embodiment.

[0057] Figure 3 is a flowchart of a shooting method according to an exemplary embodiment.

[0058] Figure 4-1 is a schematic diagram of a photographing method according to an exemplary embodiment.

[0059] Figure 4-2 is a schematic diagram of a photographing method according to an exemplary embodiment.

[0060] Figure 4-3 is a schematic diagram of a photographing method according to an exemplary embodiment.

[0061] Figure 5-1 is a schematic diagram of a photographing method according to an exemplary embodiment.

[0062] Figure 5-2 is a schematic diagram of a photographing method according to an exemplary embodiment.

[0063] Figure 5-3 is a schematic diagram of a photographing method according to an exemplary embodiment.

[0064] Figure 6-1 is a schematic diagram of a photographing method according to an exemplary embodiment.

[0065] Figure 6-2 is a schematic diagram of a photographing method according to an exemplary embodiment.

[0066] Figure 6-3 is a schematic diagram of a photographing method according to an exemplary embodiment.

[0067] Figure 7 is a flowchart of a shooting method according to an exemplary embodiment.

[0068] Figure 8-1 is a schematic diagram of a photographing method according to an exemplary embodiment.

[0069] Figure 8-2 is a schematic diagram of a photographing method according to an exemplary embodiment.

[0070] Figure 8-3 is a schematic diagram of a photographing method according to an exemplary embodiment.

[0071] Fig. 9 is a flowchart of a shooting method according to an exemplary embodiment.

[0072] Figure 10-1 is a schematic diagram of a photographing method according to an exemplary embodiment.

[0073] Figure 10-2 is a schematic diagram of a photographing method according to an exemplary embodiment.

[0074] Figure 10-3is a schematic diagram of a photographing method according to an exemplary embodiment.

[0075] Figure 10-4 is a schematic diagram of a photographing method according to an exemplary embodiment.

[0076] Figure 10-5 is a schematic diagram of a photographing method according to an exemplary embodiment.

[0077] Fig.11 is a block diagram of a photographing device according to an exemplary embodiment.

[0078] Fig.12 is a block diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION

[0079] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0080] Note: The first to seventh operations involved in the present disclosure are only named for the convenience of describing the operations, have nothing to do with the importance of the operations and the order of operations, and are not intended to further limit the specific implementation methods of the operations.

[0081] At present, the camera functions of some electronic devices on the market support the control of focus position and zoom ratio through gestures, and some also support real-time tracking of the subject. Currently, the shooting methods provided by electronic devices are relatively simple, and they cannot shoot videos with movie-like visual effects, which cannot meet users' high demands for video recording effects, and users' shooting experience is not good.

[0082] The present disclosure provides a shooting method, in which a user can display a preview screen (i.e., a plurality of first image frames described below) on a display interface during a process of shooting a video using an electronic device, and a focus-emphasized object can be automatically captured in the preview screen, and the user can also set the focus-emphasized object according to his / her own wishes, and the focus-emphasized object will be highlighted by a first mark in the preview screen, so that the user can clearly know which object in the preview screen is being shot as the focus-emphasized object during the current shooting process, and during the shooting process, the entire preview screen will not be shot, but only the focus-emphasized object in the preview screen will be shot, so that the focus is always kept on the shooting object, and other objects in the preview screen may not be recorded, so that the recorded image is clearer and more accurate, and the shot screen has a movie recording effect. Since only the focus-emphasized object in the preview screen is shot during the recording process, in order to ensure the user's visual experience, the ratio of the shooting screen can be automatically adjusted during the subsequent playback process, helping the user to shoot a more professional, natural, high-quality video, and meet the user's needs for video shooting.

[0083] The exemplary embodiment of the present disclosure provides a shooting method, which is applied to an electronic device with a camera, and the electronic device can be a smart electronic device with a camera, such as a mobile phone, a tablet computer, and a laptop computer. Figure 1 As shown, the shooting method shown in the present disclosure includes:

[0084] S101, in response to a first operation, collecting a plurality of first image frames;

[0085] S102, displaying a plurality of first image frames and a first mark, wherein the first mark is located in an area where the first object is located, and the first mark indicates that the area where the first mark is located in the plurality of first image frames is being used as a video capture area for generating a video;

[0086] S103: Generate a video according to the images of the video recording area in the plurality of first image frames.

[0087] In step S101, the user can use touch commands, voice commands, gesture commands, etc. to make the electronic device enter the shooting function interface, and the electronic device starts the camera and uses the camera to frame. When the user triggers the electronic device to start the shooting function through a first operation such as touch, voice, gesture, etc., the electronic device collects multiple first image frames, which may include people, scenery, animals, objects, etc.

[0088] In one example, the first operation may be an operation of starting a camera application. The first operation may not need to trigger the shooting function of generating a video through the video capture area in the following text. It is only an operation of starting the camera application, and then the shooting function of generating a video through the video capture area is started through other operations. In another example, if the camera application is already started, the first operation is an operation that can directly start the shooting function of generating a video through the video capture area. For example, the first operation may be a single-click operation, a double-click operation, or a long-press operation of a shooting button (such as a shutter) by the user. For another example, the first operation may also be a voice command of "start movie mode recording" or "start video capture area recording" output by the user.

[0089] like Figure 10-1 As shown, the electronic device is currently in the desktop display interface. The user touches and clicks the camera application icon 13, and the electronic device enters the camera application interface. The camera is automatically turned on, and a menu bar of the shooting function and a camera framing picture are displayed on the screen, including a second person 3 and a landscape 2. Figure 10-2 As shown, at this time, the electronic device is only framing the current picture, but has not entered the shooting process. Only when the user clicks the recording button 9, the electronic device will start the actual shooting and recording process. Figure 10-4 Clicking the record button 9 can be regarded as the first operation. After receiving the operation, the camera starts to collect images and collects a plurality of first image frames.

[0090] In step S102, the electronic device displays the collected multiple first image frames as a preview screen, and all images captured by the camera are displayed in the preview screen. At the same time, in the preview screen, the electronic device can automatically identify and capture objects such as people and animals, and then identify the focus-emphasized object from these captured objects according to the preset rules pre-stored in the electronic device, and use it as the first object, that is, the focus request can be sent by the relevant sensor on the camera to the control device of the electronic device, for example, the person located in the center of the preview screen is used as the first object; for example, according to the depth of field information, the task or animal closest to the electronic device in the preview screen is used as the first object. Of course, the first object can also be set by the user. For example, there are multiple objects in the preview screen. The user can click on an object, animal or person in the preview screen to issue a focus-emphasized request, thereby setting the clicked object as the first object in the preview screen.

[0091] When there are multiple targets in the picture, that is, when there are faces, heads, bodies, animals such as cats and dogs, or other subjects in the picture at the same time, the user can touch to select the object they want to focus on and focus on it as the first object; or the electronic device can determine the first object to focus on according to the pre-stored focus tracking priority. The focus tracking priority is touch focus>people>pets>center (the middle of the picture). In order to ensure that the focus object will not be changed due to changes in the movements of the people in the preview picture during the shooting process, the electronic device uses an algorithm to associate and identify the face, head and body of the person, and output it as a focus object with the same ID, to avoid the situation where, for example, the person turns his head and the focus object is switched when the face cannot be recognized. When there are multiple human bodies in the preview picture, the electronic device will determine the focus tracking priority according to the size of the human body in the preview picture and the depth of field. For example, the person who is closer to the electronic device in the preview picture is set to the highest focus tracking priority, and the focus tracking priority of the person who is farther away from the electronic device is lowered.

[0092] Taking the example of a user setting a focus emphasis object by touch, when the user determines the first object, a focus emphasis request is triggered, and the electronic device responds to the focus emphasis request for the first object by displaying a first mark in the area where the first object is located, and the first mark indicates that the area where the first object is located in multiple first image frames is being used as a video capture area for generating a video. The first mark can be displayed on the screen in a shape such as a square frame, an elliptical frame, a triangular frame, etc., and the color of the first mark can be black, white, yellow, etc.

[0093] The first mark shows the range of the video capture area, and its range is determined by the size of the first mark. The size of the first mark can be adjusted by the user as needed, or used according to the default setting size of the electronic device, and can also be adjusted by the electronic device according to the size of the first object to be focused and emphasized. For example, if the first object to be focused is determined to be a person, if the user wants to emphasize the face of the person, the size of the first mark can be adjusted to be consistent with the face size of the person in the preview screen, and the first mark only shows the face of the first object; if the user wants to emphasize the entire human body, the size of the first mark can be adjusted to be consistent with the body size of the person in the preview screen, and the first mark not only shows the face and head of the first object, but also the body.

[0094] The multiple first image frames (i.e., preview images) displayed on the screen are not images recorded during the video shooting process. The multiple first image frames are displayed to let the user know the overall preview screen content, so that the user can determine the object to be focused and emphasized. The image range in the multiple first image frames defined by the first mark is the image recorded during the video shooting process, that is, the first mark has a cropping effect, and the image to be focused and emphasized is cropped from the multiple first image frames. It should be emphasized that the first mark and the multiple first image frames are not in the same display layer. It can be considered that the first image frame belongs to a first display layer, and the first mark belongs to the second display layer. In the process of displaying on the screen, the first display layer and the second display layer are superimposed and displayed. The final display effect is that the content in the first display layer and the second display layer are displayed without difference, giving the user the effect of overall display. Among them, the second display layer where the first mark is located is displayed above the first display layer, and the first mark is located in the area where the first object is located in the multiple first image frames. It is only used to highlight the first object in the multiple first image frames and mark the current video capture area. The existence of the first mark does not affect the screen content of the multiple first image frames.

[0095] like Figure 2-1 As shown, the first image frames taken by the electronic device using the camera include a first person 1, a landscape 2, and a second person 3. Figure 2-2 In the video, the user touches to select the first person 1 as the first object. In response to the focus emphasis on the first object, the electronic device displays a first mark 4 at the first person 1 in multiple first image frames on the screen. The first mark 4 is displayed in the form of a black square. The first mark 4 shows the facial area of ​​the first person 1, and the facial area of ​​the first person 1 in the first mark 4 is used as the image recorded during the video shooting process. If, during the video shooting process, the first object is always the first person 1, and the size of the first mark 4 remains unchanged, and the face of the first person 1 is always displayed, then the final recorded image only includes the face of the first person 1, which can clearly show the changes in facial expressions of the first person 1.

[0096] In step S103, if the electronic device has only a single camera, the electronic device uses the same camera to shoot the current screen and the images of the video capture area in the multiple first image frames, and generates a video according to the images of the video capture area in the multiple first image frames. It can be considered that the camera shoots multiple first image frames, and then cuts the first video frame through the area indicated by the first mark, and only records the video of the area indicated by the first mark. When the recorded video is played later, only the area indicated by the recorded first mark is played. If the electronic device includes two or more cameras, the electronic device can use one of the cameras (the first camera) to collect multiple first image frames, and after the user determines the focus emphasis object (the area where the first mark is located), use other cameras (the second camera) other than the first camera to shoot the image frames of the video capture area defined by the first mark, and the electronic device generates a video according to the image frames of the multiple video capture areas shot by the second camera. Of course, when the electronic device has multiple cameras, the electronic device can also use the same camera to shoot the current screen and the image of the video capture area, and then record the image of the video capture area to generate a video.

[0097] In order to better illustrate the shooting method involved in the present disclosure, the shooting process of the electronic device is described. Figure 3 This is a flow chart of the shooting process. The specific process is introduced below.

[0098] IFE refers to Image Front-End Processor, which is a core component of camera image processing. The main tasks of IFE include: reading raw data from CMOS image sensor, performing a series of front-end processing, such as denoising, color correction, white balance, lens distortion correction, noise reduction, sharpening, etc., and finally outputting high-quality image data for subsequent image processing and encoding. IFE is an important component in the camera. It improves the quality and clarity of the image through front-end processing of the raw image data, and provides high-quality data for subsequent image processing and encoding. BPS refers to Bayer Processing Segment. This hardware module is mainly used for bad pixel removal, phase focusing, de-mosaicing, downsampling, HDR processing and Bayer hybrid noise reduction processing of photographed image data. The processing of IFE and BPS is more inclined to the front end, that is, the most fundamental calibration compensation of the newly obtained image.

[0099] IPE refers to the Image Processing Engine. IPE includes Noise processing segment (NPS) and Post processing segment (PPS). IPE performs preliminary processing on images such as denoising and filtering. IPE can output YUV (color encoding) to preview and video, and can also output JPEG (static image) to Snapshot, so IPE can output Display, video or JPEG at a time.

[0100] exist Figure 3 In the flowchart, the first stream 30 is that during the shooting process, the electronic device uses the face recognition algorithm to identify the face in each video frame, records the coordinate information of the face position, and obtains the face metadata, thereby assisting the calibration of AE (Auto Exposure) and AWB (Automatic White Balance). The second stream 31 is to obtain the head metadata through the all-object tracking function (when the user double-clicks the detected object, the boundary range of the object that the user wants to track is automatically identified and locked), and the head metadata is used as the input information of the intelligent camera movement module in the third stream 32 to assist the intelligent camera movement (i.e., tracking the focus through the head of the person).

[0101] The third stream 32 includes an intelligent camera module and an EIS (Electrical Image Stabilization) module. The third stream 32 is divided into three streams, namely, a first sub-stream 320, a second sub-stream 321, and a third sub-stream 322. The first sub-stream 320 uses EIS technology and camera crop to display the camera frame (i.e., the first mark) currently being recorded. The second sub-stream 321 uses the EIS warping grid and IPE to select a suitable resolution (e.g., 1080p, 4K, etc.) for video preview display, that is, the image processed by the first sub-stream 320 and the second sub-stream 321 is used as the image displayed on the screen (i.e., multiple first image frames as preview images and multiple second image frames for recording and subsequent playback, which will be described in detail later). The results of the first sub-stream 320 and the second sub-stream 321 are simultaneously inputted and displayed on the screen of the electronic device, that is, the second sub-stream 321 outputs the video preview effect of the current appropriate resolution, and the first sub-stream 320 displays the content of the area where the first mark is located in the plurality of first image frames being focused and photographed as the video capture area (i.e. Figure 2-2The first mark 4 in the image). Since the magnification of the focused subject requires sacrificing image quality, in order to ensure that the final recorded image can have clear image quality, the initial main image (i.e., the image during the camera shooting process) needs to select a high resolution, so that the enlarged image (i.e., multiple second image frames) and the multiple first image frames used as preview images can also have relatively clear image quality. For example, the initial main image selects 4K resolution, and the image becomes 1080P after camera cropping. The electronic device displays multiple first image frames and multiple second image frames in the first mark at 1080P. The third sub-flow 322 is obtained through EIS, camera warping grid and IPE, and the recorded image with appropriate resolution after EIS and camera cropping is obtained, wherein the recorded image is the picture of the area where the first mark is located in the video preview.

[0102] In the present disclosure, the electronic device captures multiple first image frames in response to a first operation; displays the multiple first image frames and the first mark, and uses the first mark to show the video capture area in the multiple first image frames, guiding the user to select a shooting object, so that the focus is always kept on the shooting object that the user wants to emphasize, making the recorded image clearer, and according to the movie shooting effect, using the image of the video capture area as the image recorded during the shooting process, automatically adjusting the ratio of the shooting picture, helping the user to shoot more professional, natural and high-quality videos, and meeting the user's needs for video shooting.

[0103] In some embodiments, in response to the second operation, the first mark gradually moves from the area where the first object is located in the plurality of first image frames to the area where the second object is located.

[0104] During the shooting process, the user can change the focus object to be shot by a second operation such as touching the screen based on the shooting needs. In response to the second operation, the electronic device selects the object obtained by the second operation at the position of the multiple first image frames as the latest object to be focused on, that is, the second object, and gradually moves the first mark from the area where the first object is located in the multiple first image frames to the area where the second object is located. For example, the second operation can be a user clicking on the area where the second object is located in the multiple first image frames. For another example, the second operation can be a sliding touch operation in which the user presses a single finger on the area where the first object is located and slides to the area where the second object is located.

[0105] It should be noted that the process of the first mark moving from the area where the first object is located in multiple first image frames to the area where the second object is located is not an instantaneous action, but the first mark gradually moves from the area where the first object is located to the area where the second object is located. In the process of the first mark moving, the electronic device uses bokeh transition and autofocus technology to achieve a smooth transition of the bokeh effect (bokeh effect) according to the depth of field changes of the first object and the second object, that is, the first mark displays not only the first object before the movement and the second object after the movement, but also the picture content between the first object and the second object in multiple first image frames.

[0106] For example, the process in which the first mark gradually moves from the area where the first object is located in the plurality of first image frames to the area where the second object is located corresponds to Figure 4-1 to Figure 4-3 ,exist Figure 4-1 In the example, in response to the first operation, the first marker 4 in the multiple first image frames focuses on and emphasizes the first object (the first person 1), which may be the focus and emphasis object determined by the electronic device itself. The user selects a new focus and emphasis object for the second person 3, that is, the second object, by touching the screen (the second operation). In response to the second operation, the electronic device gradually moves the first marker 4 from the location of the first person 1 to the location of the second person 3. In the multiple first image frames, there is also a landscape 2 between the first person 1 and the second person 3. Therefore, during the movement of the first marker 4, the first marker 4 will move to the area where the landscape 2 is located. Figure 4-2 When the first marker 4 moves to the second person 3, the first marker 4 indicates that the area where the second object (the second person 3) is located is used as the video capture area for generating the video, as shown in FIG. Figure 4-3 shown.

[0107] In addition, the second operation can also be triggered by the electronic device based on the change of the captured picture. For example, the electronic device is in a fixed state, and the multiple first image frames captured by the camera include two objects, an adult and a child. At time t1, the electronic device focuses on the child closest to the camera as the first object. The child in the picture runs in the direction away from the camera. At time t2, the distance between the child and the camera exceeds the distance between the adult and the camera, triggering the second operation. At time t3, the electronic device focuses on the adult closest to the camera as the second object based on the second operation. The first mark gradually moves from the area where the first object is located to the area where the second object is located during the time period between time t2-t3.

[0108] During the video shooting process, in order to make the focus switching process appear more natural, the electronic device can automatically perform a smooth transition effect during the movement of the first mark based on the second operation. The focus switching and smooth transition can be achieved by one of the following technical methods:

[0109] First, a large amount of video material with annotated focus information is used to train a deep learning model, such as Convolutional Neural Networks (CNN) or Recurrent Neural Network (RNN). The deep learning model is used to identify the focus area and non-focus area in the video. During the training process, the deep learning model learns to extract visual features such as color, texture, and edges of the video frame, as well as depth information related to the focus. In the actual shooting situation, the electronic device obtains continuous video frames based on the camera sensor, inputs these video frames into the trained deep learning model, and performs focus recognition on each video frame. When the focus area is identified, the intelligent focus switching algorithm tracks the focus position and predicts the focus position of the next video frame. By calculating the smooth transition between focus positions, the consistency and naturalness of the focus switching process are ensured. At the same time, the intelligent focus switching algorithm can also automatically adjust the camera's shooting parameters, such as focus distance, exposure, and white balance, to adapt to different focus positions and scenes.

[0110] In the present disclosure, the electronic device gradually moves the first mark from the area where the first object is located to the area where the second object is located based on the second operation, thereby avoiding abrupt jumps between the first object and the second object in the shooting picture, providing a movie shooting effect, making the recorded video more stable and vivid, and realizing smooth movement of the field of view, making the video picture more comfortable, and improving the quality and attractiveness of the video.

[0111] In some embodiments, a plurality of second image frames are displayed, wherein the plurality of second image frames show images of the region where the first mark is located in the plurality of first image frames.

[0112] Since the multiple first image frames are not the images recorded during the video shooting process, the images in the area where the first mark is located in the multiple first image frames are the images recorded during the video shooting process. In order to enable the user to preview the recorded images, the images recorded during the video shooting process are displayed in the second area of ​​the screen, that is, the images in the video capture area in the multiple first image frames are displayed.

[0113] like Figure 5-1 to Figure 5-3 As shown, the first area 6 and the second area 5 occupy a part of the screen area respectively, the first area 6 displays a plurality of first image frames and a first mark 4, and the second area 5 displays a plurality of second image frames, which are images of the area where the first mark 4 is located in the plurality of first image frames, that is, images of the video capture area. The positions of the first area and the second area on the screen are not fixed, for example, Figure 5-1 to Figure 5-3The first area 6 is placed in the upper right corner of the screen, and the second area 5 is placed in the lower left corner of the screen. The user can also adjust the positions of the first area and the second area according to personal visual habits, placing the first area in the lower right corner of the screen and the second area in the upper left corner of the screen. In addition, the second area can also exist in the form of a floating window, such as Figure 6-1 to Figure 6-3 As shown, all display areas of the screen are the first area, that is, multiple first image frames are displayed in full-screen mode, and the second area 5 is always located on the upper layer of the first area, blocking part of the first area.

[0114] In some embodiments, in the process of gradually moving the first mark in the plurality of first image frames from the area where the first object is located to the area where the second object is located, the images displayed in the plurality of second image frames change with the change of the area where the first mark is located. In the case where the plurality of second image frames are displayed on the screen of the electronic device, since the plurality of second image frames are images of the area where the first mark is located in the plurality of first image frames, and the movement of the first mark from the area where the first object is located to the area where the second object is located is not an instantaneous action, in the case where the first mark gradually moves from the area where the first object is located to the area where the second object is located, the contents displayed in the plurality of second image frames on the second area will also change with the movement of the first mark.

[0115] like Figure 5-1 to Figure 5-3 As shown, the first area 6 displays a plurality of first image frames, wherein the first person 1 is the first object, the second person 3 is the second object, and the plurality of first image frames also include a landscape 2. Based on the second operation, the first mark 4 gradually moves from the first person 1 to the second person 3, that is, corresponding to Figure 5-1 to Figure 5-3 During the process, the second image frames in the second area 5 change with the movement of the first mark 4. Figure 5-1 In the second image frames, a plurality of second image frames show the first person 1; in Figure 5-2 In, a plurality of second image frames display scenery 2; in Figure 5-3 In the video recording, the second image frames show the second person 3. Thus, in the process of changing the focus emphasis object from the first object to the second object in the video recording, a smooth transition shooting effect is formed, and the image in the captured video is prevented from suddenly changing from the first object to the second object.

[0116] In the present disclosure, the screen displays the first area and the second area at the same time, with multiple first image frames displayed in the first area and images recorded during the video shooting process displayed in the second area, so that the user can preview the final recorded image, which is convenient for the user to adjust the image content in time according to needs, providing the user with a more convenient, efficient and intelligent shooting experience, and improving the quality of the video.

[0117] In some embodiments, in response to the third operation, the size of the first mark is adjusted.

[0118] The size of the first mark can be set when the electronic device leaves the factory. In response to the first operation, the electronic device will display the first mark in a default size on multiple first image frames. Since the area where the first mark is located is the video capture area in multiple first image frames, and the final video is generated according to the image of the video capture area, the size of the first mark determines the range of the video capture area, that is, determines the screen content of multiple second image frames, so the user can adjust the size of the first mark based on the demand for recording images. The user can adjust the size of the first mark using the touch command generated by the third operation, and can also adjust the size of the first mark using voice commands and gesture commands. When the user changes the range of the first mark through a third operation such as a touch drag command of multiple fingers, the electronic device changes the size of the first mark on multiple first image frames in response to the third operation. For example, the third operation can be that the user touches the area where the first mark is located with two fingers at the same time and the two fingers do an extrapolation movement to enlarge the size of the first mark. For another example, the third operation can be that the user touches the area where the first mark is located with three fingers at the same time and the three fingers do an inward movement to reduce the size of the first mark. For another example, a virtual control for adjusting the size of the first mark is displayed on the preset display interface, the first control is used to increase the size of the first mark, and the second control is used to reduce the size of the first mark. When the user touches the first control, the size of the first mark is enlarged, and when the user touches the second control, the size of the first mark is reduced. By touching the first control and the second control, the size of the first mark increased or reduced is the same each time. When the user long presses the first control, the size of the first mark increases continuously, and the user stops pressing the first control, and the size of the first mark is locked and no longer increases. When the user long presses the second control, the size of the first mark decreases continuously, and the user stops pressing the second control, and the size of the first mark is locked and no longer decreases.

[0119] For example, a user wants to take a picture of a pet dog playing, and takes the pet dog as the first object. A first mark is displayed on multiple first image frames on the screen of the electronic device, wherein the area where the first mark is located is the entire body shape of the pet dog in the multiple first image frames. After shooting for a period of time, the user wants to focus on and emphasize the face of the pet dog to record the mood of the pet dog, so a third operation is performed. For example, two fingers act on the area where the first mark is located and the two fingers move relative to each other. After the electronic device detects the third operation, it reduces the size of the first mark on the multiple first image frames so that the range defined by the first mark only includes the facial area of ​​the pet dog, and the face of the pet dog in the multiple first image frames is used as the video capture area.

[0120] In addition, the electronic device can also automatically change the size of the first mark by identifying the focus-emphasized object in the multiple first image frames. For example, if the first object is a person, the electronic device changes the size of the first mark from a default value to a size consistent with the human body according to the size of the human body in the multiple first image frames; if the second object is a pet dog, the electronic device changes the size of the first mark from a size consistent with the human body to a size consistent with the body size of the pet dog.

[0121] Since the area where the first mark is located is used as the video capture area, the images of the video capture area in multiple first image frames are used to generate a video, that is, the recorded image is cropped from the multiple first image frames according to the area where the first mark is located, so as to realize the zoom display of the focused object. Therefore, in order to ensure that the final recorded video has good image quality, the area occupied by the first mark in multiple first image frames needs to be greater than or equal to 1 / 2, and the VSR (Video Super Resolution) super-resolution algorithm is used to increase the image quality so that the final recorded video can be presented clearly.

[0122] In the present disclosure, the electronic device changes the size of the first mark on multiple first image frames based on the operation of changing the range of the first mark, automatically adjusts the proportion of the subject in the picture, performs a close-up magnification of the subject, and helps the user shoot high-quality videos to meet the user's shooting needs.

[0123] In some embodiments, other regions except the first mark in the plurality of first image frames are displayed in a blurred manner.

[0124] In order to highlight the image of the area where the first mark is located in the multiple first image frames, the other areas except the first mark in the multiple first image frames are blurred and displayed, and the multiple first image frames in the area where the first mark is located are always displayed in a clear state.

[0125] Optionally, the blurring of other areas in the first image frame except the first mark can be automatically triggered after the first mark is displayed, or it can be manually triggered based on the user's own needs. For example, the electronic device responds to the fourth operation and blurs the other areas in the multiple first image frames except the first mark; the fourth operation can be a voice operation sent by the user, or a touch operation of the user on the operation interface of the preset virtual control. For example, the electronic device can display a preset virtual control for triggering a virtual operation switch, and the electronic device detects a triggering operation on the preset virtual control (i.e., the fourth operation, such as clicking the preset virtual control), and the electronic device responds to the triggering operation to blur the other areas in the multiple first image frames except the first mark. For another example, the electronic device detects a preset gesture operation on the display interface (i.e., the fourth operation, such as long pressing the first mark or long pressing the area other than the first mark), and the electronic device responds to the preset gesture operation to blur the other areas in the multiple first image frames except the first mark.

[0126] like Figure 2-1 As shown, when the electronic device has not detected the fourth operation or when the electronic device has not detected the first object in the plurality of first image frames, all areas of the plurality of first image frames on the screen are clearly presented. Figure 2-2 In the example, when the user determines the first person 1 as the first object, the first person 1 within the first mark 4 is clearly displayed, while the scenery 2, the second person 3, etc. in other areas except the first mark 4 are blurred.

[0127] Among them, the blurred display is the depth of field effect, which blurs the background, highlights the clarity of the focused subject, and creates a movie-like picture effect. Electronic devices can achieve blurred display through the intelligent depth of field effect. The intelligent depth of field effect can be achieved through one of the following technical methods:

[0128] First, an image containing depth information is acquired through a dual-camera or multi-camera system. Since the multi-camera system captures images of the same scene at different locations, the depth information in the scene can be estimated through techniques such as parallax calculation or structured light to generate a depth map. Secondly, a deep learning model or image segmentation algorithm is used to separate the foreground and background in the image based on features such as color, texture, and edges. According to the depth map and image segmentation results, the positions of the foreground and background are determined. For the image of the background part, algorithms such as Gaussian blur or motion blur can be applied to simulate the depth of field effect of the background under a large aperture. The foreground part usually needs to remain clear, so it will not be blurred. In order to make the depth of field effect look more natural, the boundary between the foreground and background is processed using techniques such as gradient or hybrid blur, and the boundary area is smoothed to make the transition between the foreground and background more natural. In addition, some parameters are provided for users to make post-adjustments according to their needs, such as the depth of field intensity, the blur degree of the foreground and background boundary, etc.

[0129] According to an exemplary embodiment, Figure 7 As shown, the shooting method in this embodiment includes:

[0130] S701, displaying a plurality of first image frames and identifying preset objects in the first image frames;

[0131] S702, displaying a second mark, where the second mark indicates an area where a preset object is located in the plurality of first image frames;

[0132] S703, changing the second mark indicating the area where the preset object with the highest priority in the plurality of first image frames is located to the first mark;

[0133] S704: Generate a video according to the images of the video recording area in the plurality of first image frames.

[0134] Among them, step S704 is the same as the implementation in the above embodiment and will not be repeated here.

[0135] In step S701, the process of displaying multiple first image frames and identifying preset objects in the first image frames can be triggered based on a first operation. The first operation can be, for example, a touch operation on a shooting shutter. After pressing the shooting shutter, multiple first image frames are displayed in the display interface of the screen. After receiving the first operation, the automatic recognition process is automatically started to identify the preset objects in the multiple first image frames.

[0136] After displaying multiple first image frames based on the first operation, the recognition process of preset objects in the multiple first image frames can also be started based on the fifth operation applied by the user to the electronic device. The fifth operation can be a gesture operation of the user on the screen of the electronic device, or an operation input by the user through voice, or an operation input by the user through touch to select an option displayed on the display screen. When the user issues the fifth operation, the electronic device displays multiple first image frames on the screen based on the fifth operation and starts the automatic recognition process. For example, an automatic recognition control is displayed on the preset display interface. When the automatic recognition control receives a touch operation, it means that the user wants to start the automatic recognition process to recognize the preset images in the multiple first video frames.

[0137] During the automatic recognition process, multiple targets in multiple first image frames will be automatically recognized. During the recognition, face recognition can be used to automatically recognize human objects in multiple first image frames. A neural network model that can recognize preset objects such as people, animals, insects, and objects can also be pre-trained through a neural network, so that the preset objects in multiple first image frames can be automatically recognized using the neural network model. At the same time, the first object that is the focus-emphasized object can be automatically tracked, and even if the first object keeps moving in multiple first image frames, the first marker will always follow the first object.

[0138] In step S702, automatic recognition, that is, the electronic device displays the recognition results in multiple first image frames on the screen based on the object tracking function, and displays the second mark in the area where the recognition results are located. The object tracking function can be understood as a function of always tracking these preset objects during the continuous movement of the preset objects after the preset objects in the multiple first image frames are recognized. During the automatic recognition process, the electronic device recognizes the preset objects in the multiple first image frames, wherein the preset objects include people, animals, etc., and may also include other items set by the user for recognition. When the electronic device recognizes the preset objects, it will display a second mark in the area where each preset object is located. The second mark can be a geometric frame in white, black, yellow, etc. Figure 8-1 As shown, multiple first image frames include a first person 1, a landscape 2 and a second person 3. After the automatic recognition process recognizes the two preset objects, the first person 1 and the second person 3, a second mark 7 in a black dotted line style is displayed in the area where the first person 1 is located, and a second mark 8 in a black dotted line style is displayed in the area where the second person 3 is located.

[0139] In step S703, after automatically identifying the preset object, the electronic device uses the preset object with the highest priority in multiple first image frames as the object to be emphasized in focus according to the pre-stored focus priority, and displays a first mark in the area where the preset object with the highest priority is located. Among them, the focus priority has been explained in step S102 and will not be repeated here. After determining the object to be emphasized in focus, the area where the object to be emphasized is located is changed to display the first mark, and the second marks in the areas where other preset objects are located can be canceled or displayed together with the first mark. Since the first mark is different from the second mark, there will be no confusion even if the first mark and the second mark are displayed at the same time.

[0140] like Figure 8-2 As shown, according to the focus tracking priority, the first person 1 is determined as the object to be focused on, the second mark 7 in the area where the first person 1 is located is changed to display the first mark 4, and the second mark 8 displayed in the area where the second person 3 is located is cancelled, and the first mark 4 is displayed in the style of a black solid line. For another example, the first mark can also be displayed in a yellow box, and the second mark can be displayed in a white box.

[0141] In some embodiments, during the automatic recognition process, if a preset object is not recognized in the plurality of first image frames, a first mark is displayed at a preset position of the plurality of first image frames.

[0142] In the case where the electronic device cannot automatically identify the preset object in the multiple first image frames, the electronic device focuses at the preset position, and the camera fixes the current focus distance and no longer automatically adjusts the focus, wherein the preset position can select the center position (center) of the multiple first image frames, or can be determined based on the user's selection. After the position is determined, the preset position will no longer change. The electronic device uses the picture corresponding to the preset position as the focus object and displays a first mark at the preset position. For example, a user uses an electronic device to take a landscape picture, and the multiple first image frames include mountains, water, trees, grass and other contents. The center position of the multiple first image frames corresponds to a tree. Since there are no preset objects such as people and animals in the multiple first image frames, they cannot be automatically identified. The electronic device uses the preset positions of the multiple first image frames, that is, a tree in the multiple first image frames, as the focus object, and displays a first mark in the area where the tree is located.

[0143] In some embodiments, in response to the sixth operation, canceling the display of the second mark;

[0144] Based on the sixth operation being applied to the region of the plurality of first image frames, a first mark is displayed.

[0145] In addition to automatic identification, the focus object can also be selected manually by the user. When the user selects the focus object manually through the sixth operation (for example, double-clicking the focus object), the electronic device responds to the sixth operation by canceling the display of the second mark in the multiple first image frames, that is, canceling the second mark for the area where the preset object is located during the automatic identification process, and only displays the first mark in the area where the focus object affected by the sixth operation is located in the multiple first image frames. For example, if the user double-clicks the third object in the multiple first image frames (that is, the sixth operation), it means that the user wants to use the third object as the focus emphasis object, thereby canceling all the multiple second marks, and only displaying the first mark in the area where the third object is located, to emphasize that the third object is the focus emphasis object during the shooting process, and video capture is being performed on the area where the third object is located.

[0146] like Figure 8-1 to Figure 8-3 As shown, the plurality of first image frames captured by the electronic device include a first person 1, a landscape 2, and a second person 3. Figure 8-1 In the electronic device, the preset objects, first person 1 and second person 3, are identified in the automatic identification process, and a second mark 7 is displayed in the area where the first person 1 is located, and a second mark 8 is displayed in the area where the second person 3 is located. Since the object that the user wants to focus on is the scenery 2, not the first person 1 and the second person 3, the user manually selects to focus on the scenery 2. Figure 8-3 As shown, based on the sixth operation, the electronic device cancels the second mark 7 and the second mark 8 in the area where the first person 1 and the second person 3 are located, and displays the first mark 4 in the area where the scenery 2 is located.

[0147] In some embodiments, in response to the seventh operation, the first mark is canceled from being displayed;

[0148] A second mark is displayed, where the second mark indicates an area where a preset object is located in the plurality of first image frames.

[0149] When the electronic device displays the first mark on multiple first image frames, based on the received seventh operation, the first mark being displayed is canceled. The first mark can be triggered based on the first operation or based on the sixth operation. In addition, it should be noted that all the first marks and second marks mentioned in the present disclosure can be generated by multiple operations. For example, the second mark can be generated based on the seventh operation and the fifth operation, and is not limited to being generated by one operation. This will not be described in detail below.

[0150] Among them, when the user does not want to use the object currently emphasized by the first mark as the focus emphasis object, the focus emphasis on the first object can be canceled through the seventh operation. For example, the seventh operation can be that the user double-clicks the first mark to cancel the display of the first mark, that is, the user can no longer see the first mark on the screen. At the same time, when the first mark is canceled, the automatic recognition process will be started, the preset objects in multiple first image frames will be identified, and the second mark will be displayed in the area where each preset object is located, that is, the electronic device can switch from manual recognition to automatic recognition through the seventh operation. For another example, the user can cancel the first mark by long pressing the first mark, and the first mark is no longer displayed on the screen, and can further start the automatic recognition process by touching the automatic recognition control, and then display the second mark on the screen to identify the preset objects in multiple first image frames.

[0151] In some embodiments, the shooting method further includes:

[0152] Acquire a plurality of third image frames, wherein the plurality of third image frames are sequentially connected to the plurality of first image frames, the plurality of third image frames include a plurality of first frames acquired within a first duration period, the plurality of first frames include the second object but do not include the first object;

[0153] The first mark moves from an area where the first object is located in the plurality of first image frames to an area where the second object is located in the plurality of first frames.

[0154] Before implementing the shooting method in this embodiment, the user will start the function of recording the video capture area, that is, after receiving the first operation, the electronic device will automatically identify and determine the first object in multiple first image frames, and perform image tracking. Of course, the user can also manually click to determine the first object to be focused and emphasized according to his or her own video recording intention. After the first object is determined, the electronic device tracks the first object. In addition, after the electronic device starts the automatic recognition function, when it is recognized that there is a preset object in multiple first image frames, a second mark will be displayed, and the second mark user identifies the location of the preset object in multiple first video frames.

[0155] As the video recording process continues, the electronic device continues to collect multiple third image frames, and the multiple third image frames are sequentially connected with the multiple first image frames, that is, the multiple first image frames are first collected, and at the moment when the last first image frame is collected, the third image frames are started to be collected, and multiple third image frames are continuously collected in the first duration period. Among them, the multiple third image frames include multiple first frames collected in the first duration period, and the multiple first frames include the second object but not the first object. That is, during video recording, in the process of collecting multiple first image frames to multiple first frames, the first object slowly moves out of the viewfinder from the viewfinder, so the first object is no longer included in the collected multiple third image frames. At this time, since the object moves out of the viewfinder, the first object can no longer be used as the focus emphasis object, so the second object in the first frame can be automatically used as the focus emphasis object, so that the first mark moves from the area where the first object is located in the multiple first image frames to the area where the second object is located in the multiple first frames, so as to prompt the user to use the second object as the focus emphasis object at this time. Among them, after the first object moves out of the viewfinder, according to preset rules, an object located in the center of the picture, or closer to the electronic device, or a moving object can be selected from multiple preset objects identified in multiple first frames as the second object for focus.

[0156] Among them, the electronic device uses a machine learning algorithm to identify the first object and the second object, and continuously tracks the positions of the first object and the second object, on the one hand ensuring that when the first object is the focus object, the first object can always be clearly presented in the recorded video; on the other hand ensuring that when the first object moves out of the viewfinder during shooting, the focus emphasis object can be quickly switched to ensure the reliability of the video recording process.

[0157] Among them, auto focus and tracking can be achieved through one of the following technical methods:

[0158] Electronic devices are often equipped with phase focus or focus pixel sensors to measure the focus accuracy of different areas in the image. First, these sensors detect the contrast and phase differences in the image to determine the location of the focus. Then, using focus algorithms, such as focus mode selection, focus point selection, and focus area tracking, the data obtained by the sensors is analyzed and calculated to obtain the contrast and phase differences of different areas in the image and the optimal focus position. Once the optimal focus position is determined, the autofocus algorithm will achieve automatic focus by adjusting the lens position or focal length, that is, controlling the camera's motor or adjusting the optical elements to keep the focus and the subject being photographed clear and sharp. During the shooting process, the autofocus algorithm can track the movement of the subject being photographed and make automatic focus adjustments as needed, using predictive algorithms and continuous focus adjustments to ensure that the subject always remains clear. To more accurately track the position of the subject, the autofocus and tracking algorithms can also use computer vision techniques, such as feature detection and object recognition, to detect the unique features of the subject and track based on these features, so that the subject can be tracked even if it moves or is partially obscured in the image.

[0159] Taking the first object as an example, during the tracking process of the first object, if the first object moves out of the viewfinder (i.e., the first object is beyond the shooting range of the camera), the electronic device starts an automatic recognition process, recognizes the preset objects in multiple third image frames, and displays a second mark in the area where each preset object is located. For example, multiple first image frames include people and pet dogs. When the user manually selects the pet dog in multiple first image frames as the first object, the electronic device tracks the pet dog. Since the pet dog is in a running state, when the pet dog runs out of the shooting range of the camera (i.e., the pet dog runs out of the viewfinder), the electronic device can no longer track it. The electronic device continues to shoot multiple first frames without the pet dog. The multiple first frames only include people. The electronic device starts an automatic recognition process, recognizes the person, and displays a first mark in the area where the person is located, and uses the person as the focus emphasis object.

[0160] In some embodiments, the plurality of third image frames further include a plurality of second frames collected during the second duration period, the plurality of second frames are sequentially connected to the plurality of first frames, and the second frames include the first object and the second object; and the shooting method further includes:

[0161] When the first duration is less than or equal to the preset duration, the first mark is moved from the area where the second object is located in the plurality of second frames to the area where the first object is located.

[0162] As the video shooting process proceeds, the second frame shooting continues at the moment when the shooting of multiple first frames is completed, and multiple second frames are collected in the second duration period. During the second frame shooting process, the first object returns to the viewfinder, and the multiple second frames shot include both the first object and the second object.

[0163] When the first duration is less than or equal to the preset duration, the first mark is moved from the area where the second object is located in the plurality of second frames to the area where the first object is located, so as to continue to capture the video with the first object as the object to be emphasized in focus. Since the user originally intended to use the first object as the object to be emphasized in focus during the capture of the first image frame, but had to use the second object in the first frame as the object to be emphasized in focus because the first object moved out of the frame, but if the time the first object moved out of the frame was short, the user's intention would not change, and the user still wanted to use the first object as the object to be emphasized in focus. In this case, if the first object returns to the frame in the plurality of captured second frames, the second object will no longer be used as the object to be emphasized in focus, but the first object will continue to be recorded as the object to be emphasized in focus, so that the consistency of the object to be emphasized can be effectively maintained.

[0164] The preset duration can be set according to the camera performance of the electronic device, for example, 3s or 5s. For example, a plurality of first image frames include a person and a pet dog, and the user manually selects the pet dog in the plurality of first image frames as the first object, and the electronic device tracks the pet dog, and the pet dog is in a running state. The pet dog runs out of the camera's shooting range (i.e., the viewfinder) at time t5, and then the plurality of first frames are collected from time t5 to time t6. The plurality of first frames do not include the pet dog, and the electronic device can no longer track it, and can only focus on the person as the emphasized object. The pet dog runs back to the camera's shooting range at time t6, and the second frame is collected from time t6. Since the time between time t5 and time t6 does not exceed the preset duration of 3s, at time t6, the electronic device re-identifies the pet dog, and re-uses the pet dog as the emphasized object, cancels the first mark of the area where the person is located, and displays the first mark in the area where the pet dog is located.

[0165] In the present disclosure, the electronic device tracks the movement trajectory of the focus object in real time based on autofocus and tracking technology to ensure that the focus always remains on the object to be photographed, making the final recorded video clearer and keeping the focus object in the center of the picture, making the final recorded video more stable and vivid.

[0166] According to an exemplary embodiment, Fig. 9 As shown, the shooting method in this embodiment includes:

[0167] S901, displaying a plurality of first image frames and starting an automatic recognition process;

[0168] S902, displaying a second mark, where the second mark indicates an area where a preset object is located in the plurality of first image frames;

[0169] S903, changing the second mark indicating the area where the preset object with the highest priority in the plurality of first image frames is located to the first mark;

[0170] S904, recording images of the video recording area in the plurality of first image frames based on the received recording request;

[0171] S905 . Play the images of the video recording area in the plurality of first image frames based on the received playback request.

[0172] Among them, steps S901-S903 are the same as those in the above embodiment and will not be repeated here.

[0173] In step S904, when the electronic device turns on the camera to frame, the user can trigger a recording request through touch commands, voice commands, gesture commands, etc. When the electronic device receives the recording request, it will record the images of the video recording area in multiple first image frames. During the recording process, the camera can automatically track the object that is emphasized, smoothly move the field of view, and zoom in on the object that is emphasized. The user can also switch the object that is emphasized and adjust the size of the first mark. When the user selects a new object that is emphasized, the electronic device can achieve a smooth transition of the bokeh effect. Figure 10-3 As shown, the multiple first image frames include a landscape 2 and a second person 3. The electronic device automatically identifies the preset object, the second person 3, and displays a second mark 8 in the area where the second person 3 is located. Since only one preset object is automatically identified, the second person 3 is used as the object to be focused and emphasized. There is a recording button 9 on the screen. When the user clicks the touch recording button 9, as shown in FIG. Figure 10-4 As shown, the electronic device will record the second person 3 in the area where the first mark 4 is located, and the time mark 11 on the screen will record the length of the recorded video. The user can complete the recording process by clicking the stop button 10.

[0174] In step S905, the recorded video is saved in the storage chip of the electronic device. The user can find the corresponding video in the album or folder of the electronic device. The user can trigger a play request by clicking the corresponding video. After receiving the play request, the electronic device can play the corresponding video, that is, play the images of the video recording area in the multiple first image frames. The user can choose to play in horizontal or vertical mode based on personal viewing habits. Figure 10-5As shown, the screen displays video content recorded with the second person 3 as the object of focus emphasis, and the time mark 11 shows the playing time of the current video. The user can pause or play the corresponding video by clicking the pause / play button 12.

[0175] In the present disclosure, users can select objects to be focused on by themselves to meet their needs for video shooting. Electronic devices can also automatically identify objects to be focused on and guide the content of the screen, so that the electronic device can simultaneously achieve intelligent focus and automatic zoom in a fixed position, helping users to shoot more professional, natural and high-quality videos, allowing users to focus more on creating content, increasing the attractiveness of videos, and providing users with a more convenient, efficient and intelligent shooting experience.

[0176] An exemplary embodiment of the present disclosure provides a photographing device, such as Fig.11 As shown, a block diagram of a shooting device shown in the present disclosure.

[0177] The block diagram includes: an acquisition module 111, a display module 112, and a generation module 113. The acquisition module 111 is used to acquire multiple first image frames in response to a first operation, wherein the multiple first image frames include a first object; the display module 112 is used to display the multiple first image frames and a first mark, wherein the first mark is located in the area where the first object is located, and the first mark indicates that the area where the first mark is located in the multiple first image frames is being used as a video capture area for generating a video; the generation module 113 is used to generate a video according to the images of the video capture area in the multiple first image frames.

[0178] In an exemplary embodiment of the present disclosure, the display module 112 is further configured to: in response to a second operation, gradually move the first mark from the area where the first object is located in the plurality of first image frames to the area where the second object is located.

[0179] In an exemplary embodiment of the present disclosure, the display module 112 is further configured to: display a plurality of second image frames, wherein the plurality of second image frames display images of the region where the first mark is located in the plurality of first image frames.

[0180] In an exemplary embodiment of the present disclosure, the display module 112 is also used for: when a first mark in a plurality of first image frames gradually moves from an area where a first object is located to an area where a second object is located, the images displayed in a plurality of second image frames change with the change of the area where the first mark is located.

[0181] In an exemplary embodiment of the present disclosure, the display module 112 is further configured to: adjust the size of the first mark in response to a third operation.

[0182] In an exemplary embodiment of the present disclosure, the display module 112 is further configured to: perform blurring display on other regions of the plurality of first image frames except the region where the first mark is located.

[0183] In an exemplary embodiment of the present disclosure, the display module 112 is further configured to: display the plurality of first image frames and identify a preset object in the first image frames before displaying the plurality of first image frames and the first mark;

[0184] A second mark is displayed, where the second mark indicates an area where a preset object is located in the plurality of first image frames.

[0185] In an exemplary embodiment of the present disclosure, the display module 112 is further configured to: change a second mark indicating an area where a preset object with the highest priority in a plurality of first image frames is located into a first mark; wherein the first mark is different from the second mark.

[0186] In an exemplary embodiment of the present disclosure, the display module 112 is further configured to: display the first mark at a preset position of the plurality of first image frames when the preset object is not recognized in the plurality of first image frames.

[0187] In an exemplary embodiment of the present disclosure, the display module 112 is further configured to: before displaying the plurality of first image frames and the first mark, in response to a sixth operation, cancel displaying the second mark;

[0188] Based on the sixth operation being applied to the region of the plurality of first image frames, the first mark is displayed.

[0189] In an exemplary embodiment of the present disclosure, the display module 112 is further configured to: in response to a seventh operation, cancel display of the first mark; and display a second mark indicating an area where a preset object is located in the plurality of first image frames.

[0190] In an exemplary embodiment of the present disclosure, the display module 112 is further configured to: acquire a plurality of third image frames, wherein the plurality of third image frames are sequentially connected to the plurality of first image frames, wherein the plurality of third image frames include a plurality of first frames acquired within a first duration period, wherein the plurality of first frames include the second object but do not include the first object;

[0191] The first mark moves from an area where the first object is located in the plurality of first image frames to an area where the second object is located in the plurality of first frames.

[0192] In an exemplary embodiment of the present disclosure, the display module 112 is further configured to: the plurality of third image frames further include a plurality of second frames collected during a second duration, the plurality of second frames are sequentially connected to the plurality of first frames, and the second frames include the first object and the second object;

[0193] When the first duration is less than or equal to a preset duration, the first mark is moved from the area where the second object is located in the plurality of second frames to the area where the first object is located.

[0194] In an exemplary embodiment of the present disclosure, the range of the first mark occupies an area greater than or equal to 1 / 2 of the plurality of first image frames.

[0195] Regarding the video information processing device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0196] Fig.12 1 is a block diagram of an electronic device 1200 according to an exemplary embodiment. For example, the electronic device 1200 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0197] Reference Fig.12 , the electronic device 1200 may include one or more of the following components: a processing component 1202 , a memory 1204 , a power component 1206 , a multimedia component 1208 , an audio component 1210 , an input / output (I / O) interface 1212 , a sensor component 1214 , and a communication component 1216 .

[0198] The processing component 1202 generally controls the overall operation of the electronic device 1200, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 1202 may include one or more processors 1220 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 1202 may include one or more modules to facilitate the interaction between the processing component 1202 and other components. For example, the processing component 1202 may include a multimedia module to facilitate the interaction between the multimedia component 1208 and the processing component 1202.

[0199] The memory 1204 is configured to store various types of data to support operations on the electronic device 1200. Examples of such data include instructions for any application or method operating on the electronic device 1200, contact data, phone book data, messages, pictures, videos, etc. The memory 1204 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0200] The power supply component 1206 provides power to the various components of the electronic device 1200. The power supply component 1206 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 1200.

[0201] The multimedia component 1208 includes a screen that provides an output interface between the electronic device 1200 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 1208 includes a front camera and / or a rear camera. When the electronic device 1200 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0202] The audio component 1210 is configured to output and / or input audio signals. For example, the audio component 1210 includes a microphone (MIC), and when the electronic device 1200 is in an operation mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 1204 or sent via the communication component 1216. In some embodiments, the audio component 1210 also includes a speaker for outputting audio signals.

[0203] I / O interface 1212 provides an interface between processing component 1202 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0204] The sensor assembly 1214 includes one or more sensors for providing various aspects of status assessment for the electronic device 1200. For example, the sensor assembly 1214 can detect the open / closed state of the electronic device 1200, the relative positioning of components, such as the display and keypad of the electronic device 1200, and the sensor assembly 1214 can also detect the position change of the electronic device 1200 or a component of the electronic device 1200, the presence or absence of user contact with the electronic device 1200, the orientation or acceleration / deceleration of the electronic device 1200, and the temperature change of the electronic device 1200. The sensor assembly 1214 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 1214 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 1214 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0205] The communication component 1216 is configured to facilitate wired or wireless communication between the electronic device 1200 and other devices. The electronic device 1200 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 1216 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 1216 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0206] In an exemplary embodiment, the electronic device 1200 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above methods.

[0207] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 1204 including instructions, and the instructions can be executed by the processor 1220 of the electronic device 1200 to complete the above-mentioned shooting method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0208] A non-transitory computer-readable storage medium, when instructions in the storage medium are executed by a processor of an electronic device, enables a processing device of the electronic device to execute a shooting method provided by an exemplary embodiment of the present disclosure.

[0209] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the disclosure disclosed herein. The present disclosure is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are to be considered exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0210] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A shooting method, characterized in that: The shooting method comprises: In response to a first operation, a plurality of first image frames are acquired, wherein the plurality of first image frames include a first object; displaying the plurality of first image frames and a first mark, wherein the first mark is located in an area where the first object is located, and the first mark indicates that the area where the first mark is located in the plurality of first image frames is being used as a video capture area for generating a video; A video is generated based on the images of the video capture area in the plurality of first image frames.

2. The shooting method according to claim 1, characterized in that: The shooting method further includes: In response to the second operation, the first mark gradually moves from the area where the first object is located in the plurality of first image frames to the area where the second object is located.

3. The shooting method according to claim 1 or 2, characterized in that: The shooting method further includes: A plurality of second image frames are displayed, wherein the plurality of second image frames show images of the region where the first mark is located in the plurality of first image frames.

4. The shooting method according to claim 3, characterized in that: The shooting method further includes: When the first mark gradually moves from the area where the first object is located in the plurality of first image frames to the area where the second object is located, the images displayed in the plurality of second image frames change as the area where the first mark is located changes.

5. The shooting method according to claim 1, characterized in that: The shooting method comprises: In response to a third operation, a size of the first mark is adjusted.

6. The shooting method according to claim 1, characterized in that: The shooting method further includes: The other regions in the multiple first image frames except the region where the first mark is located are displayed in a blurred manner.

7. The shooting method according to claim 1, characterized in that: Before displaying the plurality of first image frames and the first mark, the method further comprises: displaying the plurality of first image frames and identifying a preset object in the first image frames; A second mark is displayed, where the second mark indicates an area where a preset object is located in the plurality of first image frames.

8. The shooting method according to claim 7, characterized in that: The shooting method further includes: changing a second mark indicating a region where the preset object with the highest priority among the plurality of first image frames is located to the first mark; The first mark is different from the second mark.

9. The shooting method according to claim 7, characterized in that: The shooting method further includes: When the preset object is not recognized in the plurality of first image frames, the first mark is displayed at a preset position of the plurality of first image frames.

10. The shooting method according to claim 7, characterized in that: Before displaying the plurality of first image frames and the first mark, the method further comprises: In response to a sixth operation, canceling display of the second mark; Based on the sixth operation being applied to the region of the plurality of first image frames, the first mark is displayed.

11. The shooting method according to claim 1, characterized in that: The shooting method further includes: In response to a seventh operation, canceling display of the first mark; A second mark is displayed, where the second mark indicates an area where a preset object is located in the plurality of first image frames.

12. The shooting method according to claim 1, characterized in that: The shooting method further includes: Acquire a plurality of third image frames, wherein the plurality of third image frames are sequentially connected to the plurality of first image frames, the plurality of third image frames include a plurality of first frames acquired within a first duration period, the plurality of first frames include a second object but do not include the first object; The first mark moves from an area where the first object is located in the plurality of first image frames to an area where the second object is located in the plurality of first frames.

13. The shooting method according to claim 12, characterized in that: The plurality of third image frames further include a plurality of second frames acquired during a second duration, the plurality of second frames are sequentially connected to the plurality of first frames, and the second frames include the first object and the second object; The shooting method further includes: When the first duration is less than or equal to a preset duration, the first mark is moved from the area where the second object is located in the plurality of second frames to the area where the first object is located.

14. The shooting method according to claim 1, characterized in that: The shooting method further includes: The range of the first mark occupies an area greater than or equal to 1 / 2 of the plurality of first image frames.

15. A photographing device, characterized in that: The photographing device comprises: A collection module, configured to collect a plurality of first image frames in response to a first operation, wherein the plurality of first image frames include a first object; A display module, configured to display the plurality of first image frames and a first mark, wherein the first mark is located in an area where the first object is located, and the first mark indicates that the area where the first mark is located in the plurality of first image frames is being used as a video capture area for generating a video; A generating module is used to generate a video according to the images of the video capturing area in the multiple first image frames.

16. An electronic device, characterized in that: The electronic device comprises: Camera; processor; a memory for storing processor-executable instructions; The processor is configured to execute executable instructions in the memory to implement the shooting method according to any one of claims 1 to 14.

17. A non-transitory computer-readable storage medium having executable instructions stored thereon, characterized in that: When the executable instruction is executed by the processor, the shooting method according to any one of claims 1 to 14 is implemented.

Images