File processing method, file processing device, electronic device, and medium
By receiving user input to update the resolution of the target image frame in the video file, and replacing the low-resolution area with the high-resolution area, the problem of monotonous image display in video files is solved, enabling personalized focusing and efficient editing.
Patent Information
- Application Number
- CN202111574206.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-12-21
- Publication Date
- 2025-10-21
- Estimated Expiration
- 2041-12-21
AI Technical Summary
In existing technologies, the image display effect of video files is fixed and monotonous, which cannot meet users' personalized focusing needs for target objects, and requires the use of professional software for post-editing, resulting in low file editing efficiency.
By receiving user input, the image sharpness of a local area of the target image frame in the video file is updated. The image of the high-resolution area in the target replacement frame is used for focusing. The low-resolution area of the target image frame is replaced directly or after preprocessing, thus achieving personalized focusing and editing.
It enables personalized focus on target objects in video files, simplifies image processing operations, improves file editing efficiency, and requires no professional software support.
Smart Images

Figure CN114237800B_ABST
Abstract
Description
Technical Field
[0001] The present application belongs to the field of image processing, and specifically relates to a file processing method, a file processing device, an electronic device and a medium. Background Art
[0002] At present, with the popularization of smart terminals, smart terminals have been integrated into all aspects of life. Among them, the shooting function of smart terminals has been widely used. People can use the shooting function of smart terminals to record the scenes they want to capture in the form of multimedia files such as video images, which is convenient for users to watch later. However, the image display effects in multimedia files such as videos currently captured are relatively fixed and single. Summary of the Invention
[0003] The purpose of the embodiments of the present application is to provide a file processing method, a file processing device, an electronic device and a medium, which can achieve targeted focusing processing on any target object in the local image area of at least one image frame in the video file after the video file is recorded, thereby meeting the user's personalized focusing needs for the target object in the video file, and then meeting the user's personalized display needs for the picture content at a certain moment in the video file; and in the process of re-editing the local image area in at least one image frame of the recorded target file, there is no need to rely on professional software specifically used for post-video editing, which makes the user's image processing operations in the target file more convenient and further improves the file editing efficiency.
[0004] In a first aspect, an embodiment of the present application provides a file processing method, the method comprising:
[0005] receiving a first input from a user;
[0006] In response to the first input, updating the clarity of an image in a first area of a target image frame in a target file;
[0007] The target file includes at least two image frames, and the target image frame includes at least one image frame of the target file.
[0008] In a second aspect, an embodiment of the present application provides a file processing device, the device comprising:
[0009] A first receiving module, configured to receive a first input from a user;
[0010] a first processing module, configured to update the clarity of an image in a first area of a target image frame in a target file in response to the first input;
[0011] The target file includes at least two image frames, and the target image frame includes at least one image frame of the target file.
[0012] In a third aspect, an embodiment of the present application provides an electronic device comprising a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the file processing method described in the first aspect are implemented.
[0013] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the file processing method described in the first aspect are implemented.
[0014] In a fifth aspect, an embodiment of the present application provides a chip, which includes a processor and a communication interface, the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the file processing method described in the first aspect.
[0015] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the file processing method as described in the first aspect.
[0016] In an embodiment of the present application, a first input from a user is received; in response to the first input, the clarity of the image of a first area of a target image frame in a target file is updated; wherein, the target file includes at least two image frames, and the target image frame whose clarity is to be updated includes at least one image frame of the target file; therefore, after generating the target file, the user can input a first input on the user interface of the electronic device according to actual needs, and after receiving the first input, the electronic device updates the clarity of the image of any area in at least one target image frame in the target file, so as to achieve the effect of refocusing the target object contained in the any area, so that after the video file is recorded, any target object in the local image area of at least one image frame in the video file can be refocused in a targeted manner, thereby meeting the user's personalized focus requirements for the target object in the video file, and then meeting the user's personalized display requirements for the picture content at a certain moment in the video file; and in the process of re-editing the local image area in at least one image frame of the recorded target file, there is no need to rely on professional software specifically for post-video editing, which makes the user's image processing operations in the target file more convenient and further improves the file editing efficiency. BRIEF DESCRIPTION OF THE DRAWINGS
[0017] Figure 1 A schematic diagram of a first flow chart of a file processing method provided in an embodiment of the present application;
[0018] Figure 2A second flowchart of the file processing method provided in an embodiment of the present application;
[0019] Figure 3 A schematic diagram of a first display interface of the file processing method provided in an embodiment of the present application;
[0020] Figure 4 A schematic diagram of a second display interface of the file processing method provided in an embodiment of the present application;
[0021] Figure 5 A third flow chart of the file processing method provided in an embodiment of the present application;
[0022] Figure 6a A schematic diagram of a third display interface of the file processing method provided in an embodiment of the present application;
[0023] Figure 6b A schematic diagram of a fourth display interface of the file processing method provided in an embodiment of the present application;
[0024] Figure 6c A fifth display interface diagram of the file processing method provided in an embodiment of the present application;
[0025] Figure 7 A fourth flow chart of the file processing method provided in an embodiment of the present application;
[0026] Figure 8 A sixth display interface diagram of the file processing method provided in an embodiment of the present application;
[0027] Figure 9 A fifth flow chart of the file processing method provided in an embodiment of the present application;
[0028] Figure 10a A seventh display interface diagram of the file processing method provided in an embodiment of the present application;
[0029] Figure 10b This is a schematic diagram of an eighth display interface of the file processing method provided in an embodiment of the present application;
[0030] Figure 10c A ninth display interface diagram of the file processing method provided in an embodiment of the present application;
[0031] Figure 10d A schematic diagram of the tenth display interface of the file processing method provided in an embodiment of the present application;
[0032] Figure 11a This is a schematic diagram of the eleventh display interface of the file processing method provided in an embodiment of the present application;
[0033] Figure 11bA schematic diagram of a twelfth display interface of the file processing method provided in an embodiment of the present application;
[0034] Figure 11c This is a schematic diagram of the thirteenth display interface of the file processing method provided in an embodiment of the present application;
[0035] Figure 11d This is a schematic diagram of the fourteenth display interface of the file processing method provided in an embodiment of the present application;
[0036] Figure 12 A schematic diagram of a fifteenth display interface of the file processing method provided in an embodiment of the present application;
[0037] Figure 13 This is a schematic diagram of the sixteenth display interface of the file processing method provided in an embodiment of the present application;
[0038] Figure 14 A schematic diagram of the seventeenth display interface of the file processing method provided in an embodiment of the present application;
[0039] Figure 15 This is a schematic diagram of the eighteenth display interface of the file processing method provided in an embodiment of the present application;
[0040] Figure 16a A schematic diagram showing the composition of the first module of the file processing device provided in an embodiment of the present application;
[0041] Figure 16b A schematic diagram of the second module of the file processing device provided in an embodiment of the present application;
[0042] Figure 17 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;
[0043] Figure 18 A schematic diagram of the hardware structure of an electronic device implementing an embodiment of the present application. DETAILED DESCRIPTION
[0044] The following will be combined with the accompanying drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the embodiments described are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field are within the scope of protection of this application.
[0045] The terms "first," "second," and the like in the specification and claims of this application are used to distinguish similar objects, and are not used to describe a specific order or precedence. It should be understood that the terms used in this manner are interchangeable where appropriate, so that the embodiments of this application can be implemented in an order other than that illustrated or described herein, and that the objects distinguished by "first," "second," and the like are generally of the same type, and do not limit the number of objects; for example, the first object can be one or more. In addition, the term "and / or" in the specification and claims refers to at least one of the connected objects, and the character " / " generally indicates that the objects connected are in an "or" relationship.
[0046] The file processing method provided in the embodiment of the present application is described in detail below through specific embodiments and their application scenarios in conjunction with the accompanying drawings.
[0047] Figure 1 A specific flow chart of the file processing method provided in the embodiment of the present application, the file processing method may be an electronic device, such as Figure 1 As shown, the file processing method mainly includes:
[0048] Step 102, receiving a first input from a user;
[0049] Among them, the above-mentioned first input may include: the user's click input on the target file displayed on the file display interface, the user's click input on the user interface of the electronic device or the designated control displayed on the file display interface, the user's voice command, and the user's specific gesture. The specific one can be determined according to actual usage requirements, and the embodiment of the present application does not limit this.
[0050] It should be noted that the specific gesture in the embodiment of the present application can be any one of a single-click gesture, a sliding gesture, a drag gesture, a pressure recognition gesture, a long press gesture, an area change gesture, a double-press gesture, and a double-click gesture; the click input in the embodiment of the present application can be a single-click input, a double-click input, or any number of click inputs, etc., and can also be a long press input or a short press input.
[0051] Step 104 , in response to the first input, updating the clarity of the image of the first area of the target image frame in the target file;
[0052] Among them, the above-mentioned target file includes at least two image frames, and the above-mentioned target image frame includes at least one image frame of the target file; the above-mentioned target file can be an original file captured by a camera in an electronic device, or it can be a composite file generated based on the original files captured by at least two cameras. The composite file can be a composite video file, or it can be a dynamic image file containing multiple image frames. The clarity of at least one image frame in the composite file meets the clarity requirements of most users. Then, in order to meet the personalized needs of different users for the image clarity of any area in certain image frames, after generating the target file, the user can also be provided with the function of focusing the image of the first area of the target image frame.
[0053] The file processing method of the embodiment of the present application can be applied to scenarios where it is necessary to re-edit a local image area in at least one image frame of a recorded target file. After generating the target file, the user can input a first input on the user interface of the electronic device according to actual needs. After receiving the first input, the electronic device updates the clarity of the image of any area in at least one target image frame in the target file. In this way, after the video file is recorded, any target object in the local image area of at least one image frame in the video file can be refocused in a targeted manner, thereby meeting the user's personalized focus needs on the target object in the video file, and then meeting the user's personalized display needs for the picture content at a certain moment in the video file; and in the process of re-editing the local image area in at least one image frame of the recorded target file, there is no need to rely on professional software specifically for post-video editing, which makes the user's image processing operations in the target file more convenient, further improving the file editing efficiency.
[0054] Specifically, the above-mentioned target image frame is an image frame determined based on the user's first input, and the image frame includes the target area (i.e., the above-mentioned first area) whose clarity is to be updated; wherein, the above-mentioned target image frame can be an image frame that partially includes the target area in the target file, or can be all image frames that include the target area in the target file, that is, the above-mentioned target image frame includes at least one image frame of the target file.
[0055] Specifically, after receiving the first input, a target replacement frame is first determined from multiple candidate image frames, wherein the target replacement frame can be determined based on the user's selection input, that is, the target replacement frame is determined from multiple candidate image frames based on the user's selection input, or it can be automatically determined according to a preset target replacement frame determination method, that is, the target replacement frame is automatically determined from multiple image frames. For example, the image frame with the highest image clarity among the multiple image frames can be automatically determined as the target replacement frame, and then based on the clarity of the image of the second area in the target replacement frame, the image clarity of the first area of the target image frame is updated. Specifically, the image of the first area in the target image frame can be directly replaced with the image of the second area in the target replacement frame, or the image of the second area in the target replacement frame can be preprocessed first, and then the image of the first area in the target image frame is replaced with the preprocessed image of the second area. Since the clarity of the image of the second area in the target replacement frame can be higher than the clarity of the image of the first area in the target image frame, the effect of focusing the target object contained in the first area of the target image frame can be achieved.
[0056] In the process of updating the clarity of the image of the first area of the target image frame in the target file, the above step 104 of updating the clarity of the image of the first area of the target image frame in the target file includes:
[0057] updating the image of the first area in the target image frame based on the image of the second area in the target replacement frame;
[0058] Among them, the above-mentioned second area is the area corresponding to the first area in the target replacement frame, and the clarity of the image of the second area is higher than the clarity of the image of the first area; specifically, the first object contained in the first area and the second object contained in the second area can be the same shooting object. Since the image clarity of the same shooting object may be different in different image frames, based on the image of the second area where the target object is located in the target replacement frame and with relatively high clarity, the image of the first area where the target object is located in the target image frame and with relatively low clarity is updated, thereby achieving the effect of refocusing the image of the first area in the target image frame; correspondingly, the first object contained in the first area and the second object contained in the second area can also be different shooting objects. For example, two subjects belong to the same type. When the user needs to replace the image of subject A in the target image frame whose clarity is less than a first preset value with the image of subject B in the target replacement frame whose clarity is greater than a second preset value, where the second preset value is greater than the first preset value, and subjects A and B belong to the same type, such as subject A is a white pillow and subject B is a red pillow, if the clarity of the image of the required area of subject A in all image frames is not ideal, the clarity of the image of the first area where the target object is located in the target image frame can be updated based on the clarity of the image of the second area where subject B is located in the target replacement frame, thereby achieving the effect of refocusing the image of the first area in the target image frame.
[0059] The file processing method of the embodiment of the present application can be applied to a scenario where it is necessary to refocus a local image area in at least one image frame of a recorded video file, and the image of the first area of the target image frame is updated by using the image of the second area in the target replacement frame, thereby achieving the effect of refocusing the image of the first area in the target image frame; and in the process of updating the clarity of the image of the first area of the target image frame, considering that there may be a certain difference in the image size of the first area and the second area, instead of directly replacing the image, the image of the second area in the target replacement frame is first preprocessed, and then the image of the first area in the target image frame is replaced with the image of the preprocessed second area, so that not only the target object contained in the first area of the target image frame can be refocused, but also it can be ensured that there are no traces of image replacement in the target image frame after the clarity is updated, thereby improving the naturalness of the picture of the target image frame after the clarity is updated.
[0060] Specifically, for the case where the above-mentioned target file is an original file captured by a camera in an electronic device, the above-mentioned target replacement frame is an image frame in the original file captured by the camera; correspondingly, for the case where the above-mentioned target file is a composite file generated based on original files captured by at least two cameras in an electronic device, at this time, it is necessary to save not only the composite file, but also the original files captured by at least two cameras (for example, the first file captured by the first camera, the second file captured by the second camera), and the above-mentioned target replacement frame is an image frame in the original file captured by at least two cameras; wherein the above-mentioned target replacement frame is determined based on the image clarity of the second area from the multiple image frames contained in the original file, specifically, it can be determined based on the user's selection input, or it can be automatically determined according to a preset target replacement frame determination method.
[0061] In a specific implementation, for a case where the target replacement frame is determined based on a user's selection input, multiple candidate image frames are determined from multiple image frames in the first file and the second file, wherein the image of the second area of each candidate image frame in the multiple candidate image frames and the image of the first area of the target image frame may include the same object, and the clarity of the image of each second area is higher than the clarity of the image of the first area, and then the target replacement frame is determined from the multiple candidate image frames based on the user's selection input, and then the image of the first area in the target image frame is updated based on the image of the second area in the target replacement frame; correspondingly, for a case where the target replacement frame is automatically determined according to a preset target replacement frame determination method, the target replacement frame is automatically determined from multiple image frames in the first file and the second file, for example, the target replacement frame with the highest image clarity in the second area is automatically selected from the multiple image frames, wherein the image of the second area of the target replacement frame and the image of the first area of the target image frame may include the same object.
[0062] Specifically, after determining the target replacement frame, the image of the first area in the target image frame can be directly replaced with the image of the second area in the target replacement frame, thereby achieving the effect of refocusing the target object contained in the first area of the target image frame; further, considering that there may be a certain difference between the image size of the second area in the target replacement frame and the image size of the first area in the target image frame, in order to ensure the naturalness of the target image frame after the clarity is updated, the image of the second area in the target replacement frame can be preprocessed first to obtain the image of the preprocessed second area, wherein the preprocessing may include: at least one adjustment process of area size, image clarity, image brightness, and image saturation; and then the image of the first area in the target image frame is replaced with the image of the preprocessed second area, so that not only the target object contained in the first area of the target image frame can be refocused, but also it can be ensured that there are no traces of image replacement in the target image frame after the clarity is updated, thereby improving the naturalness of the picture of the target image frame after the clarity is updated.
[0063] In a specific implementation, taking the target replacement frame determined based on the user's selection input or according to the preset target replacement frame determination method as the 5th image frame in the target file as an example, the image of the first area in the target image frame can be directly replaced with the image of the second area in the 5th image frame; further, the image of the second area in the 5th image frame can be preprocessed to obtain the image of the second area in the preprocessed 5th image frame, wherein the preprocessing may include: adjusting at least one of the area size, image clarity, image brightness, and image saturation; and then replacing the image of the first area in the target image frame with the image of the second area in the preprocessed 5th image frame to obtain the target image frame with updated clarity of the local image area.
[0064] Specifically, for the case where the above-mentioned target file is a composite file generated based on the original file captured by two cameras in the electronic device, the framing difference between the first camera and the second camera can be less than a preset threshold, and the multiple image frames (i.e., the first file and the second file) captured synchronously by the first camera and the second camera contain image areas with the same framing but different clarity, that is, the multiple image frames of the first file and the second file include at least one identical photographed object, but the clarity of the photographed object presented in different image frames is different. Therefore, a target replacement frame can be selected from the multiple image frames of the first file and the second file, and the image of the first area in the target image frame of the target file is updated based on the image of the second area in the target replacement frame, that is, the clarity of the image of the first area in the target image frame of the target file is updated based on the clarity of the image of the second area in the target replacement frame, wherein the image of the second area in the target replacement frame can have a framing difference with the image of the first area of the target image frame that is less than the preset threshold, and include the same photographed object (i.e., the second area is the area corresponding to the first area in the target replacement frame).
[0065] Among them, considering that different users may have different requirements for updating image clarity, in order to further meet the user's personalized focus requirements on the target object in the video file, multiple candidate image frames are provided to the user to improve the user's selection flexibility, that is, for the case where the target replacement frame is determined based on the user's selection input, such as Figure 2 As shown, the above step 102, receiving the first input from the user, specifically includes:
[0066] Step 1022: receiving a first sub-input from a user on a first region in the first image frame while the first image frame is displayed on the file display interface of the target file;
[0067] Among them, the above-mentioned first image frame is any image frame in the target file. For example, when the target file is a video file, when the video file is played on the file display interface, the user's first sub-input for the first area in the currently played first image frame is received; for another example, when the target file is a dynamic image file containing multiple image frames, when the dynamic image file is displayed frame by frame on the file display interface, the user's first sub-input for the first area in the currently displayed first image frame is received.
[0068] Among them, the above-mentioned first sub-input may include: any one of: a user's click input on the first area in the first image frame displayed on the file display interface, a user's click input on a designated control displayed on the file display interface, a voice command input by the user, and a specific gesture input by the user. The specific input can be determined according to actual usage requirements, and the embodiment of the present application does not limit this.
[0069] Step 1024: In response to the first sub-input, at least one preview identifier is displayed; each preview identifier indicates a candidate image frame, wherein the image clarity of a third region in the candidate image frame is higher than the image clarity of a first region in the first image frame, and the third region is the region in the candidate image frame corresponding to the first region. Identifiers in this application are used to indicate text, symbols, images, etc. of information, and can be used as a control or other container as a carrier for displaying information, including but not limited to text identifiers, symbol identifiers, and image identifiers.
[0070] Correspondingly, the above step 104, updating the clarity of the image in the first area of the target image frame in the target file, includes:
[0071] Step 1042: Based on the candidate image frame indicated by the at least one preview identifier, update the clarity of the image in the first area of the target image frame in the target file.
[0072] The file processing method of the embodiment of the present application can be applied to the scenario of how to determine a target replacement frame from multiple candidate image frames during the process of refocusing a local image area in a recorded video file. After receiving the first sub-input of the user for the first area in the first image frame, at least one preview identifier is displayed, so that the user can, based on the at least one preview identifier, select a candidate image frame as the target replacement frame from the corresponding multiple candidate image frames in a targeted manner according to actual needs, and then update the clarity of the image of the first area in the target image frame based on the clarity of the image of the third area in the candidate image frame selected by the user, thereby achieving flexibility in updating the clarity of the image of the first area in the target image frame and further meeting the user's personalized setting needs for image clarity.
[0073] Specifically, after receiving the first sub-input, the first image frame is determined as the target image frame, and the first area in the first image frame is the target area for which image clarity is to be updated. The target image frame may include only the first image frame, or may also include, in addition to the first image frame, other image frames in the target file, for example, other image frames of the subject in the image that also includes the first area. Then, multiple candidate image frames corresponding to the first area in the first image frame are determined, and preview identifiers corresponding to each candidate image frame are displayed on a file display interface. A candidate image frame selected by a user from at least one preview identifier is determined as the target replacement frame, and then, based on the clarity of the image of the third area in the candidate image frame selected by the user, the clarity of the image of the first area in the target image frame is updated. The clarity of the image of the first area in the target image frame before the update is higher than the clarity of the image of the first area in the target image frame after the update, that is, the clarity of the image of the first area in the target image frame after the update is higher than the clarity of the image of the first area in the target image frame before the update, thereby achieving refocusing of the image of the first area of the target image frame in the recorded video file, so that the image of the first area in the target image frame viewed by the user is clearer than the image areas outside the first area.
[0074] Specifically, taking the above-mentioned target file as an example of a synthetic file generated based on the original file captured by two cameras in an electronic device, the above-mentioned candidate image frame may include all image frames in the first file and the second file whose clarity meets the preset requirements, that is, the clarity of the image of the third area in the above-mentioned candidate image frame is higher than the clarity of the image of the first area in the first image frame; wherein, the image of the third area in the above-mentioned candidate image frame and the first area of the target image frame may include the same shooting object (in this case, the third area can be determined as the area corresponding to the first area in the candidate image frame); in addition, the image of the third area in the above-mentioned candidate image frame and the first area of the target image frame may include different shooting objects, for example, two shooting objects of the same type (in this case, the third area can also be determined as the area corresponding to the first area in the candidate image frame). The specific correspondence between the third area in the candidate image frame and the first area in the first image frame can be set according to actual needs, and is within the protection scope of this application.
[0075] In a specific implementation, multiple file identifiers (for example, file 1 to file n) are displayed on a video viewing interface of an electronic device, each file identifier indicates a candidate file, a fifth sub-input from a user for a candidate file is received, and in response to the fifth sub-input, the candidate file targeted by the fifth sub-input is determined as a target file; on a file display interface of the target file, when a first image frame is displayed, a first sub-input from a user for a first area in the first image frame is received, and in response to the first sub-input, at least one preview identifier (for example, preview identifier 1 to preview identifier i) is displayed, each preview identifier indicates a candidate image frame, the clarity of an image in a third area in the candidate image frame is higher than the clarity of an image in the first area in the first image frame, the third area being an area in the candidate image frame corresponding to the first area, for example, the image of the third area and the image of the first area contain the same photographed object.
[0076] For example, Figure 3 As shown, the user's fifth sub-input for file 3 on the video viewing interface is received, and in response to the fifth sub-input, the file 3 targeted by the fifth sub-input is determined as the target file; when file 3 is played on the file display interface, when the playback reaches the 5th second, the user's first sub-input for the area (i.e., the first area) where object A is located in the image frame (i.e., the first image frame) corresponding to the 5th second is received, and in response to the first sub-input, i preview identifiers are displayed below the playback progress bar, each preview identifier indicating a candidate image frame containing object A, wherein the clarity of object A contained in each candidate image frame is higher than the clarity of object A in the image frame corresponding to the 5th second in file 3.
[0077] Furthermore, in order to simplify the user's operation steps, the above-mentioned video viewing interface and file display interface can both be user interfaces of the target application, and the target application can be an application for managing target files (for example, a file manager or gallery application on an electronic device), that is, after receiving the user's fifth sub-input for a candidate file, if it is determined that the user has an image clarity update requirement, the candidate file targeted by the fifth sub-input is determined as the target file, and the target file is opened. After receiving the user's first sub-input for the first area of the first image frame in the target file, a preview icon is directly displayed on the file display interface. In this way, the focus processing of any object in a certain image frame can be completed directly under the application for managing the target file, without moving the target file to other specific image processing applications. This can not only improve the focus processing efficiency of any object in a certain image frame and enhance the user experience, but also reduce the memory resources occupied by the electronic device due to the installation of too many applications with low usage frequency.
[0078] Among them, after receiving the first sub-input of the user for the first area in the first image frame, the method may further include: displaying the clarity value of the candidate image frame indicated by at least one preview identifier; in a specific implementation, during the process of displaying the at least one preview identifier, only the image of the third area in the candidate image frame may be displayed, or the clarity value of the image of the third area in the candidate image frame may be displayed simultaneously with the image of the third area in the candidate image frame, and a recommendation identifier may be displayed below the candidate image frame with the highest clarity value, so that the user can more intuitively and quickly select a candidate image frame whose image clarity meets their respective needs from the candidate image frames as a target replacement frame based on the clarity value; Figure 4 As shown in the above Figure 3 On this basis, below each preview mark, the clarity value of the candidate image frame indicated by the preview mark is displayed, such as "xxx" represents the clarity value, and the recommendation mark is displayed below the candidate image frame with the highest clarity indicated by preview mark 2.
[0079] In addition, in the process of displaying at least one preview identifier, the clarity values of all candidate image frames containing the target area can be displayed, or only the preview identifiers corresponding to the candidate image frames whose clarity is higher than that of the first image frame can be displayed, that is, image frames whose clarity is lower than that of the first image frame are filtered out. This can reduce the user's selection difficulty and enable the user to quickly select a candidate image frame with satisfactory image clarity that meets their respective needs as the target replacement frame.
[0080] Furthermore, in the case where two cameras are used to shoot synchronously and obtain a target file, the target file may be a composite file obtained by shooting synchronously with the two cameras within a preset time, so that the target file includes at least two composite image frames that continuously change with time; wherein each camera can shoot at least one original image frame per second, and the original image frames shot by each camera within the preset time are stored respectively, that is, at least two original image frames shot by the first camera are stored as a first file, and at least two original image frames shot by the second camera are stored as a second file, and a target file (i.e., a composite file) containing at least two composite image frames is generated based on the original image frames in the first file and the original image frames in the second file. ); specifically, for the application scenario of dual-camera recording, a first video file is recorded using a first camera, and a second video file is recorded using a second camera, wherein the first video file includes multiple first original image frames continuously shot within a preset recording time, and the second video file includes multiple second original image frames continuously shot within the above-mentioned preset recording time; the first original image frames in the first video file and the second original image frames in the second video file are synthesized to obtain synthesized image frames, wherein the synthesized first original image frame and the second original image frame are two original image frames with the same shooting time; based on the synthesized multiple synthesized image frames corresponding to the shooting times, a synthesized video file is generated.
[0081] In a specific implementation, preferably, the above-mentioned target file is a composite file, which is synthesized from a first file and a second file, the first file is shot by the first camera, and the second file is shot by the second camera; correspondingly, the above-mentioned target image frame is an image frame in the composite file, and the candidate image frame indicated by the above-mentioned preview identifier is an image frame in the first file or the second file.
[0082] The file processing method of the embodiment of the present application can be applied to the scenario where the target file is obtained by photographing with two cameras. Not only the composite file obtained based on the first file and the second file photographed by the two cameras is stored, but also the first file photographed by the first camera and the second file photographed by the second camera need to be stored, so as to display the composite file to the user on the file display interface to ensure that each image frame meets the preset clarity requirements, and multiple original image frames in the first file and the second file are used as candidate image frames, and the preview identifier corresponding to each candidate image frame is displayed. In this way, since the candidate image frames come from the first file and the second file photographed by the two cameras, it can be ensured that the displayed preview identifier contains more candidate image frames with higher image clarity, thereby improving the user's selectivity of candidate image frames as target replacement frames.
[0083] Specifically, considering that the focal lengths of the two cameras used in dual-camera recording are different, the field of view angles of the two cameras are different, which may produce a certain focus difference, and the distance between each camera and the subject will change over time, which may also produce a certain focus difference. The focus difference in the dual-camera recording process will cause a certain difference in the clarity of the multiple image frames captured by the first camera and the second camera. Therefore, when the framing difference between the two cameras is less than a preset threshold, there are image areas with the same framing and different clarity in the multiple image frames (that is, the multiple image frames in the first file and the second file) captured synchronously by the two cameras within a preset time, that is, the multiple image frames of the first file and the second file may include at least one identical target object, but the target object is not represented in the same image frames in different image frames. The clarity of the presentation is different. Based on this, the clarity difference of the target object in multiple image frames of the first file and the second file can be used to update the clarity of the image of the first area where the target object is located in the target image frame of the target file, that is, based on the image of the second area where the target object is located in a certain original image frame (that is, the target replacement frame) of the first file or the second file and with relatively high clarity, the image of the first area where the target object is located in at least one synthetic image frame (that is, the target image frame) of the synthetic file and with relatively low clarity is updated, so that the clarity of the image of the first area where the target object is located in the updated target image frame is higher than the clarity before the update, thereby achieving the effect of personalized focus on the target object in certain synthetic image frames in the shot target file, so as to meet the user's demand for personalized display of the picture content at a certain moment in the video.
[0084] Among them, the specific process of displaying a preview mark to the user so that the user can select a target replacement frame based on the candidate image frame corresponding to the preview mark is as follows: Figure 5 As shown, the above step 1024, in response to the first sub-input, displays at least one preview indicator, specifically including:
[0085] Step 10242: In response to the first sub-input, the first image frame is maintained in the first area of the file display interface, and at least one preview indicator is displayed in the second area of the file display interface.
[0086] Specifically, after receiving the first sub-input from the user to the first area in the first image frame, the target file being played is paused, so that the first image frame remains displayed in the first area of the file display interface, that is, the playback screen stays in the first image frame, and at least one preview identifier is displayed in the second area of the file display interface. For example, at least one preview identifier is displayed in sequence below the playback screen of the target file, so that the user can select a target replacement frame from the candidate image frames corresponding to the at least one preview identifier.
[0087] Correspondingly, in step 1024, after displaying at least one preview indicator in response to the first sub-input, the method further includes:
[0088] Step 1026: receiving a second sub-input of the user for a target preview identifier among the at least one preview identifier;
[0089] Among them, the above-mentioned second sub-input may include: any one of the following: a user's click input on any preview icon displayed on the file display interface, a user's click input on a designated control displayed on the file display interface, a voice command input by the user, and a specific gesture input by the user. The specific input can be determined according to actual usage requirements, and the embodiment of the present application does not limit this.
[0090] Correspondingly, the above step 1042, based on the candidate image frame indicated by the at least one preview identifier, updates the image clarity of the first region of the target image frame in the target file, specifically including:
[0091] Step 10422: in response to the second sub-input, based on the target candidate image frame indicated by the target preview identifier, update the clarity of the image in the first area of the target image frame;
[0092] Among them, the above-mentioned target candidate image frame is the above-mentioned target replacement frame. Specifically, the above-mentioned target candidate image frame is an image frame used to update the clarity of the image in the first area of the target image frame, that is, the target candidate image frame selected by the user based on at least one preview identifier is determined as the target replacement frame, and the clarity of the image in the third area of the target candidate image frame is used to update the clarity of the image in the first area of the target image frame.
[0093] Specifically, with regard to the process of updating the clarity of the image in the first area of the target image frame, consideration is given to the fact that there may be a certain difference between the image size of the third area in the candidate image frame and the image size of the first area in the target image frame, that is, consideration is given to the fact that the third area in the candidate image frame with high clarity in the preview image below in the file display interface may be inconsistent in size with the first area in the first image frame in the playback screen above. In order to ensure the naturalness of the target image frame after clarity update, the image of the third area in the target candidate image frame may be preprocessed first to obtain the preprocessed image of the third area, and then the image of the first area in the target image frame may be replaced with the preprocessed image of the third area, thereby achieving the effect of updating the clarity of the image in the first area of the target image frame.
[0094] The file processing method of the embodiment of the present application can be applied to a scenario where a target replacement frame is determined from multiple candidate image frames based on a user input operation during the process of refocusing a local image area in a recorded video file. During playback of the target file, after receiving a first sub-input from the user for a first area in a first image frame, the first image frame remains displayed and at least one preview indicator is displayed for the user. Then, after receiving a second sub-input from the user for a target preview indicator, the target candidate image frame corresponding to the target preview indicator is determined as the target replacement frame. The clarity of the image of the first area in the first image frame is then updated based on the clarity of the image of the second area in the target replacement frame, so that the user can view the updated image clarity in real time. In this way, by pausing playback of the target file, displaying at least one preview indicator for the user to select, and displaying the target image frame with updated clarity to the user, the target object is refocused. This not only improves the user's selection flexibility, but also ensures that the user can adjust the ultimately selected target candidate image frame based on the actual focus effect, facilitating the user to personally select the desired focus effect for the target object.
[0095] In a specific embodiment, assuming that the first camera and the second camera each capture an image frame per second and the capture time is 10 seconds, the first file and the second file each include 10 original image frames, wherein the target file is a composite file obtained by preliminarily optimizing and synthesizing the original image frames in the first file and the second file. The composite file may include 10 composite image frames generated based on 20 original image frames, that is, based on one original image frame in the first file and one original image frame in the second file captured every second, a composite image frame corresponding to each second is generated, and each composite image frame in the composite file meets the preset clarity requirements.
[0096] In specific implementation, Figure 6aAs shown, during the playback of a composite file on the file display interface, assuming that it is necessary to focus on object A in the first image frame displayed at the 5th second, when the composite file is played to the 5th second, a first sub-input from the user is received for the target area where object A is located in the first image frame displayed at the 5th second. In response to the first sub-input, the first image frame corresponding to the 5th second is kept displayed on the file display interface of the target file (i.e., the playback of the target file is paused at the 5th second), and at least one preview identifier is displayed in the second area of the file display interface (e.g., below the playback progress bar of the target file) (e.g., i preview identifiers are displayed), each preview identifier indicates a candidate image frame, which is any original image frame in the first file or the second file, and the clarity of the image of the area where object A is located in the candidate image frame is higher than the clarity of the image of the area where object A is located in the image frame displayed at the 5th second. After displaying the preview identifier, the clarity value of the image of the third area in the candidate image frame can also be displayed below the preview identifier for indicating each candidate image frame. Furthermore, as Figure 6b As shown, a second sub-input of a target preview identifier among at least one preview identifier is received from the user, and a target candidate image frame (i.e., a target replacement frame) corresponding to the target preview identifier is determined from a plurality of candidate image frames. For example, a second sub-input of preview identifier 2 (i.e., a target preview identifier) is received from the user, and the candidate image frame indicated by preview identifier 2 is determined as the target candidate image frame (i.e., a target replacement frame); then, as shown in FIG. Figure 6c As shown, based on the clarity of the image of the area where object A is located in the target candidate image frame, the clarity of the image of the area where object A is located in the target image frame in the target file is updated. For example, the clarity of the image of the area where object A is located in the candidate image frame indicated by preview identifier 2 is used to update the clarity of the image of the area where object A is located in the image frame corresponding to the 5th second.
[0097] Furthermore, considering that the target file may include multiple objects that can be focused, in order to achieve more intelligent selection of candidate focus objects in the target image frame of the target file, the object identifiers of all the shooting object pairs contained in the target file can be displayed to the user, so that the user can select the focus object that needs to be focused during the display of the target file based on the displayed object identifiers. Based on this, Figure 7 As shown, before the above step 102, receiving the first input from the user, the following steps are also included:
[0098] Step 110: displaying at least one object identifier on a file display interface of the target file, wherein each object identifier is used to indicate an object in any image frame of the target file;
[0099] Specifically, object recognition is first performed on at least two image frames in the target file, multiple identified objects are deduplicated, all objects contained in the target file are determined, and object identifiers corresponding to each object are displayed on the file display interface in a preset display mode.
[0100] Correspondingly, the above step 102, receiving the first input from the user, specifically includes:
[0101] Step 1028: receiving a third sub-input of the user for at least one object identifier, wherein the third sub-input is an input for selecting at least one candidate object identifier from the at least one object identifier, and the at least one candidate object identifier indicates at least one candidate focus object;
[0102] The third sub-input may include any one of: a click input by a user on an object identifier displayed on the file display interface, a click input by a user on a designated control displayed on the file display interface, a voice command input by a user, and a specific gesture input by a user. The specific input may be determined according to actual usage requirements and is not limited in the present embodiment of the application.
[0103] Specifically, the candidate object identifier is an object identifier selected by the user from multiple object identifiers, and the object corresponding to the candidate object identifier is used as the candidate focus object. Correspondingly, the image frame including the candidate focus object in the target file is determined as the target image frame.
[0104] Correspondingly, the above step 104, updating the clarity of the image in the first area of the target image frame in the target file, specifically includes:
[0105] Step 1044 , in response to the third sub-input, updating the clarity of the image of the first area where the target focus object is located in the target image frame; wherein the target focus object includes part or all of the at least one candidate focus object.
[0106] Specifically, considering that the target image frame may only contain some candidate focus objects, or the user may only need to focus on some candidate focus objects in a certain target image frame, and focus on other candidate focus objects in another target image frame, that is, for a certain target image frame, not all candidate focus objects are focused on. Therefore, it is necessary to first determine the target focus object among multiple candidate focus objects, and then update the clarity of the image of the first area where the corresponding target focus object is located in the target image frame based on the clarity of the image of the second area in the target replacement frame.
[0107] The file processing method of the embodiment of the present application can be applied to the process of refocusing a local image area in a recorded video file. In the scenario of how to set at least one target object that needs to be refocused in the target image frame, all objects that can be focused can be identified from at least two image frames in the target file, and the object identifier corresponding to each object can be displayed in the file display interface of the target file. In this way, the user can select the focus object that needs to be focused during the display of the target file based on the displayed object identifier according to actual needs, thereby making the process of selecting the target focus object in the target image frame of the target file more intelligent, thereby improving the efficiency of selecting the focus object that the user expects to be focused.
[0108] In specific implementation, Figure 8 As shown, at least two image frames of the target file include object A, object B, object C, object D, and object E, and object identifiers corresponding to object A, object B, object C, object D, and object E are displayed on the file display interface, each object identifier indicates an object in the target file, and a third sub-input of at least one object identifier is received from the user (for example, the user selects object A, object B, object C), then object A, object B, and object C are determined as candidate focus objects, and subsequently, for a certain target image frame, the target focus object can be determined among object A, object B, and object C.
[0109] Furthermore, considering that a certain image frame may contain multiple candidate focus objects, the user can set the focus processing to only some of the candidate focus objects according to actual needs. Therefore, different focus types can be pre-set for the user to select the focus type corresponding to the actual desired focus display effect, thereby achieving more flexible focus on some of the candidate focus objects in the target image frame, thereby making the focus effect more interesting during the display of the target file. Based on this, Figure 9 As shown, in the above step 1044, before updating the clarity of the image of the first area of the target image frame in the target file in response to the third sub-input, the method further includes:
[0110] Step 1046, receiving the fourth sub-input of the user;
[0111] Among them, the fourth sub-input may include: a user click input on a control corresponding to a focus type identifier displayed on the file display interface, a user input of a specific track drawn on the file display interface, a voice command input by the user, or a specific gesture input by the user. The specific input may be determined according to actual usage requirements, and the embodiment of the present application is not limited thereto.
[0112] Step 1048 , in response to the fourth sub-input, determining the target focus type according to the fourth sub-input;
[0113] Specifically, the above-mentioned fourth sub-input can be the user's selection input of the control corresponding to the displayed focus type identifier. Correspondingly, after receiving the fourth sub-input, the target focus type is determined based on the focus type identifier selected by the user indicated by the fourth sub-input; the above-mentioned fourth sub-input can also be the user's input indicating the target focus type selected by the user by drawing a first trajectory. Correspondingly, after receiving the fourth sub-input, the target focus type is determined based on the drawing trajectory indicated by the fourth sub-input.
[0114] Correspondingly, in the above Figure 9 As shown in , the above step 1044, in response to the third sub-input, updates the clarity of the image of the first area where the target focus object is located in the target image frame, specifically including:
[0115] Step 10442: In response to the third sub-input, determine a target focus object from at least one candidate focus object based on the target focus type.
[0116] Specifically, for each target image frame, based on the above-mentioned target focus type, among at least one candidate focus object, the target focus object that needs to be focused in the target image frame is selected, that is, in the currently displayed target image frame, only the clarity of the image of the first area where the target focus object corresponding to the target focus type is located is updated, and no processing is performed on other candidate focus objects except the target focus object.
[0117] Step 10444: Update the clarity of the image of the first area where the target focus object is located in the target image frame.
[0118] Specifically, after determining the corresponding target focus object for the target image frame, the clarity of the image of the first area where the corresponding target focus object is located in the target image frame is updated based on the clarity of the image of the second area in the target replacement frame.
[0119] The file processing method of the embodiment of the present application can be applied to the process of refocusing a local image area in a recorded video file. In the scenario of how to determine the target focus type and the target focus object in each target image frame, multiple optional focus objects and multiple focus types can be automatically displayed to the user, so that the user can select the candidate focus object to be focused and the target focus type to be used based on the actual focus needs. In this way, the user can select the focus type corresponding to the actual desired focus display effect, thereby realizing personalized settings to focus only on some candidate focus objects in a certain target image frame, so as to achieve more flexible focusing on some candidate focus objects in the target image frame, thereby making the focus effect more interesting during the display of the target file.
[0120] Specifically, in the process of determining the target focus type, for the case where the fourth sub-input is the user's input by drawing a first trajectory, a candidate focus object sequence can be displayed on the file display interface, wherein the candidate focus object sequence is used to indicate the identifiers of the candidate focus objects respectively contained in each target image frame, receive the user's input of a selection trajectory for the identifiers of the candidate focus objects, and determine the target focus type based on the selection trajectory; further, a preset control indicating the object attribute information of the candidate focus objects in each target image frame (for example, a control for indicating depth of field information or priority) can also be displayed to receive the user's selection input of the preset control and the input of the selection trajectory for the identifiers of the candidate focus objects, and determine the target focus type based on the selection trajectory and the selection input of the preset control.
[0121] In specific implementation, Figure 10a As shown, below the playback progress bar of the target file, a candidate focus object sequence, controls a, and controls b corresponding to the target video frames from seconds 5 to 8 in the target file are displayed. The candidate focus object sequence includes candidate focus object identifiers corresponding to multiple target image frames in the target file. Control a is used to indicate the depth of field order of the multiple candidate focus objects in each target image frame (for example, ↓ represents a depth of field from deep to shallow), and control b is used to indicate the priority order of the multiple candidate focus objects in each target image frame (for example, ↑ represents increasing priority). In addition, to facilitate the user to quickly identify the target focus object actually required to be focused on in each target image frame, thumbnails corresponding to each target image frame may also be displayed. Then, based on the thumbnails, user input of a line trajectory connecting the multiple candidate focus object identifiers in the candidate focus object sequence is received. For example, the user sequentially draws a line trajectory connecting ACBA, i.e., the target focus objects selected by the user in adjacent target image frames are different. It can be seen that the fourth sub-input is an object selection trajectory input for indicating different candidate focus objects in at least two target image frames, and the target focus type is determined to be object rotation focus.
[0122] For example, Figure 10b As shown, the user clicks control a (i.e., selects control a). At this time, for each target image frame, multiple candidate focus object identifiers displayed below the target image frame are sorted according to the depth of field size. If the user draws the connection trajectory of the BCAA in sequence, that is, the user's input of the connection trajectory of the candidate focus object identifiers at the bottom of the multiple target image frames is received, then the target focus type is determined to be the first focus type (e.g., preferably focusing on close objects).
[0123] For example, Figure 10cAs shown, the user clicks control b (i.e., selects control b). At this time, for each target image frame, the multiple candidate focus object identifiers displayed below the target image frame are sorted according to priority, that is, the priority decreases from top to bottom. If the user draws the connection trajectory of BCBC in sequence, that is, the user input of the connection trajectory of the candidate focus object identifiers in the first row of multiple target image frames is received, then the target focus type is determined to be the third focus type (such as preferentially focusing on objects with high priority); therefore, the corresponding target focus type can be determined based on the different drawing trajectories input by the user, so that the user can set the target focus type desired to be selected by drawing a specific trajectory on the file display interface, thereby improving the flexibility of setting the target focus type.
[0124] Specifically, in the process of determining the target focus type, for the case where the fourth sub-input is the user's selection input for the displayed focus type identifier, based on a plurality of preset focus types, not only the object identifier but also at least one focus type identifier may be displayed on the file display interface, and then the user's fourth sub-input for the at least one focus type identifier is received, wherein the fourth sub-input is an input for selecting at least one target focus type identifier from at least one focus type identifier, and the at least one target focus type identifier indicates at least one target type, that is, the target focus type identifier is the focus type identifier selected by the user from the plurality of focus type identifiers, and the focus type corresponding to the target focus type identifier is used as the target focus type; in specific implementation, such as Figure 10d As shown, the focus type identifiers corresponding to the first focus type, the second focus type, and the third focus type are displayed on the file display interface, for example, focus type 1, focus type 2, and focus type 3. If the user selects focus type 1, focus type 1 is determined as the target focus type. Furthermore, the user can also select at least two focus type identifiers at the same time. If the user selects focus type 1 and focus type 2, the combination of focus type 1 and focus type 2 is determined as the target focus type.
[0125] Furthermore, considering that the candidate focus objects and target focus types can be set before the target file is played, or the target file can be paused at any time during the playback of the target file, the candidate focus objects and target focus types can be set, so that the user can adjust the candidate focus objects and target focus types in real time based on the actual displayed focus effect. Specifically, in the file display interface of the target file, when the third image frame is displayed, the user's fifth sub-input is received; in response to the fifth sub-input, at least one focus object identifier and focus type identifier are displayed; the user's sixth sub-input for at least one focus object identifier and focus type identifier is received; in response to the sixth sub-input, the candidate focus objects and target focus type are determined, and then based on the above-mentioned target focus type, the target focus object among the at least one candidate focus objects is determined, and the clarity of the image of the first area where the target focus object is located in the target image frame is updated.
[0126] Further, in the process of determining the target focus object to be focused in each target image frame based on the target focus type, wherein the target focus type may include: a first focus type, a second focus type, a third focus type and a combined focus type, wherein the combined focus type corresponds to a combination of at least two focus types;
[0127] Correspondingly, the above-mentioned determining the target focus object among at least one candidate focus object based on the target focus type specifically includes:
[0128] When the target focus type is the first focus type, determining the target focus object based on depth of field information of at least one candidate focus object;
[0129] When the target focus type is the second focus type, for each adjacent first target image frame and second target image frame, determining a second target focus object in the second target image frame based on a first target focus object in the first target image frame, where the first target focus object and the second target focus object are different;
[0130] When the target focus type is the third focus type, determining the target focus object based on a display order of at least one candidate focus object;
[0131] In a case where the target focus type is a combined focus type, the target focus object is determined based on target object determination methods corresponding to at least two focus types corresponding to the combined focus type.
[0132] The file processing method of the embodiment of the present application can determine the target focus object in each target image frame based on the target focus type in the process of refocusing the local image area in the recorded video file. After determining the candidate focus object selected by the user and the target focus type to be used, the target focus object in the target image frame can be determined based on the target focus type. In this way, since the user selects the focus type corresponding to the actual desired focus display effect, personalized settings can be automatically implemented to focus only on some candidate focus objects in a certain target image frame, thereby achieving more flexible focusing on some candidate focus objects in the target image frame, thereby making the focus effect more interesting during the display of the target file.
[0133] In a specific implementation, (1) when the target focus type is the first focus type, the target focus object is determined based on the depth of field information of at least one candidate focus object;
[0134] Specifically, the depth of field information is used to characterize the shooting distance between the focus object and the camera. For example, if the first focus type is to prioritize focusing on close-range objects, the candidate focus object corresponding to the minimum depth of field value among at least one candidate focus object contained in the target image frame is determined as the target focus object, that is, the shooting object closest to the camera during shooting is taken as the target focus object from at least one candidate focus object; for another example, if the first focus type is to prioritize focusing on long-range objects, the candidate focus object corresponding to the maximum depth of field value among at least one candidate focus object contained in the target image frame is determined as the target focus object, that is, The object farthest from the camera during the shooting of at least one candidate focus object is selected as the target focus object. For another example, if the first focus type is to prioritize focusing on objects at intermediate distances, then the candidate focus object with an intermediate depth of field among the at least one candidate focus object contained in the target image frame is determined as the target focus object. That is, from the at least one candidate focus object, the object at the intermediate distance from the camera during the shooting is selected as the target focus object. In other words, the at least one candidate focus object is sorted in descending order of depth of field, and the candidate focus object sorted in the intermediate position is determined as the target focus object. In a specific implementation, the target focus object in the target image frame can be determined based on the relationship between the target focus type and the depth of field between the candidate focus objects.
[0135] like Figure 11aAs shown, for the case where the target focus type is the first focus type, taking the candidate focus objects including: object A, object B, object C, and the first focus type as an example of preferably focusing on close-range objects, for example, image frame 5 corresponding to the 5th second in the target file, image frame 5 includes object A and object B. If the depth of field of object A is less than the depth of field of object B, object A is determined as the target focus object, that is, the image of the area where object A is located in image frame 5 is blurred before focusing, and the image of the area where object A is located in image frame 5 is clear after focusing; for another example, image frame 6 corresponding to the 6th second in the target file, image frame 6 includes For example, the image frame 6 includes objects B and C. If the depth of field of object C is smaller than the depth of field of object B, object C is determined as the target focus object, that is, before focusing, the image of the area where object C is located in image frame 6 is blurred, and after focusing, the image of the area where object C is located in image frame 6 is clear; for another example, image frame 7 corresponding to the 7th second in the target file includes objects A, object B, and object C. If the depth of field of object A is the smallest, object A is determined as the target focus object, that is, before focusing, the image of the area where object A is located in image frame 7 is blurred, and after focusing, the image of the area where object A is located in image frame 7 is clear.
[0136] In the embodiment provided in the present application, the user can choose to determine which candidate focus object in the target image frame to refocus on based on the depth of field information of the candidate focus object. This can automatically prioritize the candidate focus object at a close distance in the target image frame, or prioritize the candidate focus object at a middle distance in the target file, or prioritize the candidate focus object at a long distance in the target file, thereby realizing intelligent focus processing according to the depth of field information of the candidate focus object.
[0137] (2) when the target focus type is the second focus type, for each adjacent first target image frame and second target image frame, determining a second target focus object in the second target image frame based on the first target focus object in the first target image frame, the first target focus object and the second target focus object being different;
[0138] Specifically, the second focus type can correspond to rotation focus. In specific implementation, when the user selects the second focus type, the candidate focus objects that were not focused on in the previous target image frame can be prioritized according to the order in which multiple candidate focus objects appear in the target file, so that the target focus objects in each adjacent first target image frame and second target image frame are different.
[0139] like Figure 11bAs shown, for the case where the target focus type is the second focus type, taking the candidate focus objects including: object A, object B, and object C as an example, for example, image frame 5 corresponding to the 5th second in the target file, image frame 5 includes object A and object B. At this time, image frame 5 is regarded as the first first target image frame, and the candidate focus objects appearing in image frame 5 are all determined as target focus objects, that is, object A and object B are both determined as target focus objects in image frame 5 (that is, the first target focus object in the first target image frame), that is, before focusing, the image of the area where object A and object B are located in image frame 5 is blurred, and after focusing, the image of the area where object A and object B are located in image frame 5 is clear.
[0140] Image frame 6 corresponding to the 6th second in the target file includes object B and object C. At this time, image frame 6 is regarded as the first second target image frame. Since object C is a candidate focus object that is not focused in image frame 5, object C can be determined as the target focus object in image frame 6 (that is, the second target focus object in the second target image frame). That is, before focusing, the image of the area where object C is located in image frame 6 is blurred, and after focusing, the image of the area where object C is located in image frame 6 is clear.
[0141] Image frame 7 corresponding to the 7th second in the target file includes object A, object B, and object C. At this time, image frame 6 is regarded as the second first target image frame, and image frame 7 is regarded as the second second target image frame. Since object A and object B in image frame 6 are both candidate focus objects that are not focused, object A and object B can be determined as the target focus objects in image frame 7 (that is, the second target focus objects in the second target image frame). That is, before focusing, the image of the area where object A and object B are located in image frame 7 is blurred, and after focusing, the image of the area where object A and object B are located in image frame 7 is clear.
[0142] In the embodiment provided in the present application, the user can choose to automatically rotate the focus processing of different candidate focus objects in adjacent target image frames, so that the target focus objects in two adjacent target image frames are different, allowing the user to view a more dynamic focus effect.
[0143] (3) when the target focus type is the third focus type, determining the target focus object based on the display order of at least one candidate focus object;
[0144] Specifically, the third focus type may correspond to focusing according to priority, wherein the earlier the display order of the candidate focus object is, the higher the priority of the candidate focus object. Specifically, the display order of multiple candidate focus objects may be pre-set, that is, determined based on a default sorting method. In addition, the display order of multiple candidate focus objects may also be set by the user in combination with actual needs, that is, determined based on the sorting method selected by the user. For example, if the user selects the topic tag sorting method, the closer the distance to the camera is when shooting, the higher the priority, that is, the frontmost object in the target image frame is determined as the target focus object.
[0145] like Figure 11c As shown, for the case where the target focus type is the third focus type, the candidate focus objects include: object A, object B, object C, and the display order is: object C, object B, object A, for example, that is, the priority from high to low is: object C, object B, object A. For example, the image frame 5 corresponding to the 5th second in the target file includes object A and object B. If the priority of object B is higher than the priority of object A, object B is determined as the target focus object, that is, the image of the area where object B is located in image frame 5 is blurred before focusing, and the image of the area where object B is located in image frame 5 is clear after focusing; for another example, the image frame 5 corresponding to the 6th second in the target file For example, image frame 6 includes object B and object C. If the priority of object C is higher than that of object B, object C is determined as the target focus object, that is, before focusing, the image of the area where object C in image frame 6 is located is blurred, and after focusing, the image of the area where object C in image frame 6 is located is clear; for another example, image frame 7 corresponding to the 7th second in the target file includes object A, object B, and object C. If object C has the highest priority, object C is determined as the target focus object, that is, before focusing, the image of the area where object C in image frame 7 is located is blurred, and after focusing, the image of the area where object C in image frame 7 is located is clear.
[0146] In the embodiment provided in the present application, the user can choose to determine which candidate focus object in the target image frame to refocus on based on the display order of the candidate focus objects. This can automatically prioritize the candidate focus objects with higher attention in the target image frame, thereby realizing intelligent focus processing according to the priority order of the candidate focus objects.
[0147] (4) When the target focus type is a combined focus type, the target focus object is determined based on target object determination methods corresponding to at least two focus types corresponding to the combined focus type.
[0148] Specifically, taking the target focus type being a combination of the second focus type and the third focus type as an example, that is, the combined focus type includes the second focus type and the third focus type, the target object determination method corresponding to the combined focus type is: for a target image frame containing multiple candidate focus objects, the target focus objects in each adjacent first target image frame and second target image frame are different, and the target focus object in the target image frame is determined based on the display order of the candidate focus objects; for another example, taking the target focus type being a combination of the first focus type and the second focus type as an example, that is, the combined focus type includes the first focus type and the second focus type, the target object determination method corresponding to the combined focus type is: for a target image frame containing multiple candidate focus objects, the target focus objects in each adjacent first target image frame and second target image frame are different, and the target focus object in the target image frame is determined based on the depth of field information of the candidate focus objects.
[0149] In specific implementation, Figure 11d As shown, for the case where the target focus type is a combination of the second focus type and the third focus type, that is, the combined focus type includes the second focus type and the third focus type, the target object determination method corresponding to the combined focus type is: for a target image frame containing multiple candidate focus objects, the target focus objects in each adjacent first target image frame and second target image frame are different, and the candidate focus object with a higher display order is determined as the target focus object; specifically, the candidate focus objects include: object A, object B, object C, and the display order is: object C, object B, object A. For example, the priorities from high to low are: object C, object B, object A. For example, image frame 5 corresponding to the 5th second in the target file includes object A and object B. At this time, image frame 5 is regarded as the first first target image frame, and the priority of object B is higher than the priority of object A. Then, object B with high priority is determined as the target focus object in image frame 5 (that is, the first target focus object in the first target image frame), wherein the image of the area where object B is located in image frame 5 is blurred before focusing, and the image of the area where object B is located in image frame 5 is clear after focusing.
[0150] Image frame 6 corresponding to the 6th second in the target file includes object B and object C. At this time, image frame 6 is regarded as the first second target image frame. Since object C is a candidate focus object that is not focused in image frame 5, and the priority of object C is higher than that of object B, object C can be determined as the target focus object in image frame 6 (that is, the second target focus object in the second target image frame). That is, before focusing, the image of the area where object C is located in image frame 6 is blurred, and after focusing, the image of the area where object C is located in image frame 6 is clear.
[0151] Image frame 7 corresponding to the 7th second in the target file includes object A, object B, and object C. At this time, image frame 6 is regarded as the second first target image frame, and image frame 7 is regarded as the second second target image frame. Since object A and object B in image frame 6 are both candidate focus objects that are not focused, and the priority of object B is higher than that of object A, object B can be determined as the target focus object in image frame 7 (that is, the second target focus object in the second target image frame). That is, before focusing, the image of the area where object B is located in image frame 7 is blurred, and after focusing, the image of the area where object B is located in image frame 7 is clear.
[0152] In the embodiment provided in the present application, the user can choose to determine which candidate focus object in the target image frame to refocus on based on the target object determination method corresponding to at least two focus types. In this way, only when the candidate focus object meets the constraints of the target object determination method corresponding to at least two focus types will it be determined as the target focus object in the target image frame, so that the target focus object selected from multiple candidate focus objects is more targeted.
[0153] In specific implementation, in order to improve the combination flexibility of focus types and thus increase the diversity of combination methods of combined focus types, considering that users may have the need to more flexibly combine multiple focus types, corresponding options can be set according to the minimum focus type; for example, the user can select the second focus type and the third focus type at the same time (that is, the target focus object in the second target image frame is the candidate focus object that is not focused in the first target image frame and has the highest priority), or, can also select the first focus type and the second focus type at the same time (the target focus object in the second target image frame is the candidate focus object that is not focused in the first target image frame and whose depth of field information meets the preset conditions, such as the candidate focus object that is not focused in the first target image frame and has the largest or smallest depth of field). In this way, arbitrary combination of minimum focus types can be achieved, thereby improving the combination flexibility of focus types.
[0154] The process of obtaining the target file by using dual-camera recording may further include the following steps before receiving the first input from the user in step 102:
[0155] Controlling the first camera and the second camera to shoot synchronously;
[0156] When the shooting is completed, generating a first file shot by the first camera, a second file shot by the second camera, and a composite file obtained by combining the first file and the second file;
[0157] The first camera and the second camera have different focal lengths; and the target file is a synthesized file.
[0158] The file processing method of the embodiment of the present application can be applied to the scenario where the target file is obtained by dual-camera recording. By controlling the two cameras to shoot synchronously, due to the different focal lengths of the first camera and the second camera, there are image frames with different clarity in the first file generated by shooting with the first camera and the second file generated by shooting with the second camera, and the first file and the second file are stored separately. In this way, the image frames in the first file and the second file whose image clarity meets the preset requirements can be used as candidate image frames, and the preview mark corresponding to each candidate image frame is displayed, so as to provide the user with more abundant image clarity options and improve the user's selectivity of candidate image frames as target replacement frames.
[0159] Specifically, the specific process for controlling the first camera and the second camera to shoot synchronously can be: the processor in the electronic device simultaneously sends shooting instructions to the first camera and the second camera, and after receiving the shooting instruction, the first camera frames and shoots according to the first focal length to obtain a first file, and after receiving the shooting instruction, the second camera frames and shoots according to the second focal length to obtain a second file, and then the first file and the second file are synthesized to obtain a synthesized file (i.e., the target file); wherein, considering that there may be a certain difference in the time when the first camera and the second camera respectively receive the shooting instructions, the shooting process between the second camera and the second camera may be slightly delayed. As long as the delay time is less than a preset threshold, the first camera and the second camera can be regarded as shooting synchronously.
[0160] Specifically, after synchronously shooting with the first camera and the second camera to obtain the first file and the second file, the first file and the second file are synthesized to generate a synthesized file, in which each synthesized image frame meets the preset clarity requirements; and not only the synthesized file needs to be saved, but also the first file and the second file need to be saved, so as to subsequently determine the candidate image frames from the first file and the second file.
[0161] Furthermore, considering that the user may have a requirement not only to focus on the target object in the target image frame but also to blur a fourth area in at least one image frame of the target file, the file processing method further includes:
[0162] Step 1: receiving a second input from a user on a fourth area in the second image frame while the second image frame is displayed on the file display interface of the target file;
[0163] Among them, the above-mentioned second input may include: any one of: a user's click input on the second image frame in the target file, a user's click input on a designated control on the file display interface, a voice command input by the user, and a specific gesture input by the user. The specific input can be determined according to actual usage requirements, and the embodiment of the present application does not limit this.
[0164] Step 2: displaying a blur adjustment control in response to a second input;
[0165] Specifically, after receiving the second input, the blur adjustment control is displayed at a designated position on the file display interface. For example, the blur adjustment control can be displayed at a position adjacent to the second area.
[0166] Step 3: receiving a third input from the user on the blur adjustment control;
[0167] Among them, the above-mentioned third input may include: any one of: a user's click input on the blur adjustment control, a user's voice command, and a user's specific gesture. The specific input can be determined according to actual usage requirements, and the embodiment of the present application does not limit this.
[0168] Step 4: In response to the third input, blurring the image of the fourth area based on the blurring degree corresponding to the third input.
[0169] Specifically, after receiving the third input, the blurring degree indicated by the third input is determined, the image of the fourth area in the second image frame is blurred based on the blurring degree, and the blurred second image frame is displayed on the file display interface.
[0170] The file processing method of the embodiment of the present application can be applied to a scenario where it is necessary to blur a local image area in a recorded video file. After receiving the second input from the user for the fourth area in the second image frame, if it is determined that the user needs to blur an object in the second image frame, the corresponding blur adjustment control is automatically displayed to allow the user to set the degree of blur of the blurred object through the blur adjustment control, thereby achieving blurring of any image frame of the target file during video playback, thereby improving the diversity of personalized image editing of the target file and meeting the different image editing needs of different users for recorded video files.
[0171] like Figure 12As shown, during the playback of the target video file, a second input (e.g., a double-click input) from the user is received on the image frame 10 corresponding to the 10th second, the image frame 10 is kept displayed, a control c (i.e., a blur adjustment control) is displayed, a third input from the user on the blur adjustment control is received, and the blur degree indicated by the third input is determined; wherein the control c may be a blur adjustment control including a slider, and the user can adjust the blur degree by moving the position of the slider, for example, a double-click input from the user on the object B in the image frame 10 corresponding to the 10th second is received, the image frame 10 is kept displayed, and the blur adjustment control c is displayed in the area where the object B is located, and the blur adjustment control c is received from the user The third input of the slider d on the control c can further determine the degree of blur of the image of the area where the object B is located, that is, before blurring, the image of the area where the object B is located in the image frame 10 is clear, and after focusing, the image of the area where the object B is located in the image frame 10 is blurred, or determine the degree of blur of the images of other areas except the area where the object B is located, that is, before blurring, the images of other areas except the area where the object B is located in the image frame 10 are clear, and after focusing, the images of other areas except the area where the object B is located in the image frame 10 are blurred; the control c can also include an information input box, and the user can adjust the degree of blur by entering a certain value in the information input box.
[0172] In a specific implementation, in the case where the user selects multiple blurred objects in the second image frame, only one blur adjustment control can be displayed on the file display interface, so that the user can drag the blur adjustment control to the area where the object to be blurred is located, thereby achieving the purpose of blurring the blurred object; or a blur adjustment control can be displayed in the area where each blurred object in the second image frame is located, so that multiple blurred objects can be blurred at the same time, and the blur effects of multiple blurred objects can be compared.
[0173] Wherein, regarding the process of blurring the object in the target file using the displayed blur adjustment control, the blur adjustment control may include a slider, and correspondingly, the third input is an input of the user moving the slider to the first position;
[0174] Correspondingly, in the above step 4, before blurring the image of the fourth area in response to the third input and based on the blurring degree corresponding to the third input, the method further includes:
[0175] In response to a third input, determining a blur level according to a first position of a slider in the blur adjustment control;
[0176] Among them, the above-mentioned first position can be any position on the blur adjustment control to which the slider is moved, and the first position indicates the degree of blurring of the image in the fourth area. Specifically, the user can adjust the degree of blurring by moving the position of the slider according to actual needs. For example, moving the slider upward indicates increasing the degree of blurring, and correspondingly, moving the slider downward indicates decreasing the degree of blurring. In specific implementation, the correspondence between the position of the slider and the degree of blurring can be preset, and then the degree of blurring of the image in the fourth area is determined based on the first position of the slider and the correspondence.
[0177] Correspondingly, in the above step 4, after blurring the image of the fourth area in response to the third input based on the blurring degree corresponding to the third input, the method further includes:
[0178] Displaying a first processing mark at a second position on the playback progress bar of the target file, and displaying a second processing mark at a third position on the playback progress bar;
[0179] Among them, the second position is the position of the target image frame corresponding to the playback progress bar, and the first processing identifier indicates that the clarity of the image in the first area of the target image frame has been updated; the third position is the position of the second image frame corresponding to the playback progress bar, and the second processing identifier indicates that the second image frame has completed a blurring process.
[0180] Specifically, the focus position and blur position are marked on the playback progress bar of the target file, that is, the first processing identifier is displayed at the playback moment of the target image frame whose clarity has been updated, and the second processing identifier is displayed at the playback moment of the second image frame that has completed a blurring process, so that users can quickly locate the positions of the image frames whose clarity has been updated and the image frames that have completed a blurring process in the target file.
[0181] The file processing method of the embodiment of the present application can be applied to the scenario where the clarity of the first area in the target image frame is updated and the fourth area in the second image frame is blurred, and the position of the image frame that has completed focusing and the position of the image frame that has completed blurring are marked on the playback progress bar of the target file. That is, by marking the image frame whose clarity has been updated and the image frame that has completed blurring on the playback progress bar, the user can quickly locate the position where the image frame whose clarity has been updated and the image frame that has completed blurring appear in the target file.
[0182] like Figure 13As shown, the target file is a video file with a playback time of 20 seconds. If the 3rd, 5th, 6th, 8th, 12th, and 18th frames in the video file are target image frames whose clarity has been updated, and the 4th, 9th, 10th, and 16th frames are second image frames that have completed a blurring process, then a first processing mark (such as ↑) is displayed at the playback time of the 3rd, 5th, 6th, 8th, 12th, and 18th frames, and a second processing mark (such as ↓) is displayed at the playback time of the 4th, 9th, 10th, and 16th frames.
[0183] Furthermore, considering that the image frames whose definition has been updated and the blurring process has been completed can be extracted from the target file to generate a clip file, the purpose of quickly clipping the segments that the user is interested in and improving the viewing interest can be achieved. Based on this, the first processing indicator is displayed at the second position on the playback progress bar of the target file, and after the second processing indicator is displayed at the third position on the playback progress bar, the following is also included:
[0184] extracting at least one target image frame indicated by at least one first processing identifier and at least one second image frame indicated by at least one second processing identifier;
[0185] A clipping file is generated based on the extracted at least one target image frame and the at least one second image frame.
[0186] Specifically, the focused and / or blurred image frames can be saved in the form of a single image, or the optimized segments containing the focused and / or blurred image frames can be saved in the form of a video clip, and automatic editing can be achieved so that the user can directly use the edited image frames or video clips.
[0187] The file processing method of the embodiment of the present application can be applied to the scenario where the focus and blur of image frames are completed in a recorded video file. By marking the image frames that have completed the focus and the image frames that have completed the blurring process with corresponding processing identifiers, the image frames that have completed the focus and / or blurring process in the target file can be extracted based on the processing identifier, and the corresponding editing files can be generated, thereby achieving the purpose of quickly editing the clips that the user is interested in, thereby enhancing the viewing interest.
[0188] In a specific implementation, the collection of at least one extracted target image frame and at least one second image frame can be directly determined as a clipping file; or an image frame thumbnail can be displayed, in which each icon indicates a target image frame or a second image frame, and a second trajectory drawn by the user on the image frame thumbnail is received, and a clipping file is generated based on the target image frame and / or the second image frame contained in the second trajectory. That is, the user can draw a second trajectory on the user interface displaying the image frame thumbnail, and the second trajectory is used to indicate the target image frame and / or the second image frame selected by the user, and then generate a clipping file based on the target image frame and / or the second image frame contained in the second trajectory, thereby further improving the flexibility of clipping file generation and further meeting the user's personalized video clipping needs.
[0189] like Figure 14 As shown in the above Figure 13 On the basis of this, if the 3rd, 5th, 6th, 8th, 12th and 18th frames in the video file are target image frames whose clarity has been updated, and the 4th, 9th, 10th and 16th frames are second image frames that have completed a blurring process, thumbnails of the multiple image frames that have been focused and / or blurred are displayed in sequence on the user interface. In order to facilitate the user to distinguish the processing type corresponding to each image frame, a processing identifier can be displayed at a preset position of each icon in the thumbnail. For example, the first processing identifier corresponding to the focus process (i.e., the clarity has been updated) is "↑", and the processing identifier corresponding to the blurring process is "↑". The second processing identifier corresponding to the process (i.e., the blurring process has been completed once) is "↓"; then, if the user inputs a connection track of 3-5-12-16, a clipping file is generated based on the 3rd, 5th, 12th, and 16th frames of images in the video file; in a specific implementation, thumbnails of the 3rd, 5th, 6th, 8th, 12th, and 18th frames of images can also be displayed on the first area of the user interface, and thumbnails of the 4th, 9th, 10th, and 16th frames of images can be displayed on the second area of the user interface, and then the corresponding clipping file is generated based on the connection track input by the user.
[0190] Furthermore, considering that the user may have a need to transfer the clipping file, in order to improve the file transfer efficiency, after generating the clipping file based on the extracted at least one target image frame and the at least one second image frame, the method further includes:
[0191] Step 1: receiving a fourth input from the user to the file sending control;
[0192] Step 2: In response to the fourth input, display a recipient list, where the candidate recipient list includes a plurality of candidate recipients;
[0193] Step 3: receiving a fifth input from the user regarding the recipient list, wherein the fifth input is an input for selecting a target recipient from a plurality of candidate recipients;
[0194] Step 4: Send the clip file to the target recipient corresponding to the fifth input.
[0195] Among them, the above-mentioned recipient list can be determined based on the historical behavior data of the user within a preset time period; specifically, the above-mentioned recipient list is determined based on at least one record of the user's application usage record, chat record, and wireless signal connection record within the preset time period; in specific implementation, based on the user's historical behavior data within the preset time period, the file recipient that the user wishes to transfer files to is automatically identified, and the identified file recipient is used as a candidate recipient and displayed in a preset position on the user interface of the target application in the form of a list. For example, the candidate recipient can be a network disk that the user has frequently used recently, several friends that the user has frequently contacted in a certain instant messaging application recently, or an electronic device that has established a wireless communication connection, and the above-mentioned candidate recipients are displayed in a preset position on the user interface of the target application in the form of a list.
[0196] The file processing method of the embodiment of the present application can be used in a scenario where it is determined that the user has a file transfer requirement, and a list of recipients can be displayed to the user directly in the application that manages the target file. This allows the user to quickly select the target recipient to which the file is actually to be sent, thereby further simplifying the user's clip file sending steps and making the file transfer process faster, more convenient and concise.
[0197] like Figure 15 As shown, on the clip file display interface, drag the clip file 1 to the location of friend 1 under the communication application in the recipient list, and determine the friend 1 as the target recipient, transfer the clip file 1 selected by the user to the friend 1, and jump to the communication chat interface with the friend 1. Specifically, after determining that the clip file 1 needs to be transferred to friend 1, call the associated application where friend 1 is located, and transfer the file through the associated application.
[0198] In the file processing method provided in the embodiment of the present application, a first input from a user is received; in response to the first input, the clarity of the image of a first area of a target image frame in a target file is updated; wherein the target file includes at least two image frames, and the target image frame whose clarity is to be updated includes at least one image frame of the target file; therefore, after generating the target file, the user can input the first input on the user interface of the electronic device according to actual needs, and after receiving the first input, the electronic device updates the clarity of the image of any area in at least one target image frame in the target file, so as to achieve the effect of refocusing the target object contained in the any area. In this way, after the video file is recorded, any target object in the local image area of at least one image frame in the video file can be refocused in a targeted manner, thereby meeting the user's personalized focus requirements for the target object in the video file, and further meeting the user's personalized display requirements for the picture content at a certain moment in the video file; and in the process of re-editing the local image area in at least one image frame of the recorded target file, there is no need to use professional software specifically for post-video editing, making the user's image processing operations in the target file more convenient and further improving the file editing efficiency.
[0199] The file processing method provided in the embodiment of the present application can be executed by a file processing device. In the embodiment of the present application, the file processing device provided in the embodiment of the present application is described by taking the file processing method executed by the file processing device as an example.
[0200] Specifically, corresponding to the above-mentioned file processing method, such as Figure 16a As shown, the file processing device provided in the embodiment of the present application includes:
[0201] A first receiving module 1602 is configured to receive a first input from a user;
[0202] A first processing module 1604 is configured to update the clarity of an image in a first region of a target image frame in a target file in response to the first input;
[0203] The target file includes at least two image frames, and the target image frame includes at least one image frame of the target file.
[0204] In the embodiment provided in the present application, after generating the target file, the user can, according to actual needs, input a first input on the user interface of the electronic device. After receiving the first input, the electronic device updates the clarity of the image of any area in at least one target image frame in the target file, so as to achieve the effect of refocusing the target object contained in any area. In this way, after the video file is recorded, any target object in the local image area of at least one image frame in the video file can be refocused in a targeted manner, thereby meeting the user's personalized focus requirements for the target object in the video file, and then meeting the user's personalized display requirements for the picture content at a certain moment in the video file; and in the process of re-editing the local image area in at least one image frame of the recorded target file, there is no need to rely on professional software specifically for post-video editing, which makes the user's image processing operations in the target file more convenient and further improves the file editing efficiency.
[0205] Optionally, the first processing module 1604 is specifically configured to:
[0206] updating the image of the first area in the target image frame based on the image of the second area in the target replacement frame;
[0207] The second area is an area in the target replacement frame corresponding to the first area, and the definition of the image in the second area is higher than the definition of the image in the first area.
[0208] Optionally, the first receiving module 1602 is specifically configured to:
[0209] In a case where a first image frame is displayed on a file display interface of the target file, receiving a first sub-input from a user on a first area in the first image frame;
[0210] like Figure 16b As shown, the above device further includes: a first display module 1606, which is used to:
[0211] In response to the first sub-input, at least one preview identifier is displayed, each of the preview identifiers indicating a candidate image frame, the clarity of an image of a third area in the candidate image frame being higher than the clarity of an image of a first area in the first image frame, the third area being an area in the candidate image frame corresponding to the first area.
[0212] Optionally, the target file is a composite file, which is obtained by combining a first file and a second file, where the first file is shot by a first camera and the second file is shot by a second camera;
[0213] The target image frame is an image frame in the synthesized file, and the candidate image frame indicated by the preview identifier is an image frame in the first file or the second file.
[0214] Optionally, the apparatus further includes: a second display module 1608, configured to display a definition value of the candidate image frame indicated by at least one preview identifier.
[0215] Optionally, the first display module 1606 is specifically configured to:
[0216] In the first area of the file display interface, the first image frame is kept displayed, and in the second area of the file display interface, at least one preview mark is displayed;
[0217] The apparatus further includes: a second receiving module 1610, configured to receive a second sub-input of a user for a target preview identifier in the at least one preview identifier;
[0218] The first processing module 1604 is further specifically configured to:
[0219] In response to the second sub-input, updating the clarity of the image of the first area of the target image frame based on the target candidate image frame indicated by the target preview identifier;
[0220] The target candidate image frame is a target replacement frame.
[0221] Optionally, the device further includes: a third display module 1612, configured to display at least one object identifier on a file display interface of the target file, wherein the object identifier is used to indicate an object in any image frame of the target file;
[0222] A third receiving module 1614 is configured to receive a third sub-input from a user regarding the at least one object identifier before updating the clarity of the first area of the target image frame in the target file, the third sub-input being an input for selecting at least one candidate object identifier from the at least one object identifier, the at least one candidate object identifier indicating at least one candidate focus object;
[0223] The first processing module 1604 is further specifically configured to:
[0224] Updating the clarity of an image of a first area where a target focused object is located in a target image frame;
[0225] The target focus object includes part or all of the at least one candidate focus object.
[0226] Optionally, the device further includes:
[0227] The fourth receiving module 1616 is configured to receive a fourth sub-input from the user;
[0228] A first determining module 1618 is configured to determine a target focus type in response to the fourth sub-input and according to the fourth sub-input;
[0229] The first processing module 1604 is further specifically configured to:
[0230] determining a target focus object among the at least one candidate focus object based on the target focus type;
[0231] The clarity of the image of the first area where the target focus object is located in the target image frame is updated.
[0232] Optionally, the target focus type includes: a first focus type, a second focus type, a third focus type and a combined focus type, wherein the combined focus type corresponds to a combination of at least two focus types;
[0233] The first processing module 1604 is further specifically configured to:
[0234] When the target focus type is the first focus type, determining a target focus object based on depth of field information of the at least one candidate focus object;
[0235] When the target focus type is the second focus type, for each adjacent first target image frame and second target image frame, determining a second target focus object in the second target image frame based on a first target focus object in the first target image frame, where the first target focus object and the second target focus object are different;
[0236] In a case where the target focus type is the third focus type, determining a target focus object based on a display order of the at least one candidate focus object;
[0237] In a case where the target focus type is a combined focus type, the target focus object is determined based on target object determination methods corresponding to the at least two focus types.
[0238] Optionally, the device further includes:
[0239] The camera control module 1620 is used to control the first camera and the second camera to shoot synchronously;
[0240] A first generating module 1622 is configured to generate, when shooting is completed, a first file shot by the first camera, a second file shot by the second camera, and a composite file obtained by combining the first file and the second file;
[0241] The first camera and the second camera have different focal lengths; and the target file is the synthesized file.
[0242] Optionally, the device further includes:
[0243] A fifth receiving module is configured to receive a second input from a user on a fourth area in the second image frame when the second image frame is displayed on the file display interface of the target file;
[0244] a fourth display module, configured to display a blur adjustment control in response to the second input;
[0245] a sixth receiving module, configured to receive a third input from a user on the blur adjustment control;
[0246] The second processing module is configured to, in response to the third input, perform blurring processing on the image of the fourth area based on a blurring degree corresponding to the third input.
[0247] Optionally, the blur adjustment control includes a slider, and the third input is an input of the user moving the slider to a first position;
[0248] The device further comprises:
[0249] a second determining module, configured to determine a blurring degree according to the first position;
[0250] a fifth display module, configured to display a first processing identifier at a second position on the playback progress bar of the target file, and to display a second processing identifier at a third position on the playback progress bar;
[0251] Among them, the second position is the position of the target image frame corresponding to the playback progress bar, and the first processing identifier indicates that the clarity of the image in the first area of the target image frame has been updated; the third position is the position of the second image frame corresponding to the playback progress bar, and the second processing identifier indicates that the second image frame has completed a blurring process.
[0252] Optionally, the device further includes:
[0253] an image frame extraction module, configured to extract at least one target image frame indicated by at least one first processing identifier and at least one second image frame indicated by at least one second processing identifier;
[0254] The second generating module is configured to generate a clipping file based on the extracted at least one target image frame and the at least one second image frame.
[0255] In the file processing device provided in the embodiment of the present application, a first input from a user is received; in response to the first input, the clarity of the image of a first area of a target image frame in a target file is updated; wherein the target file includes at least two image frames, and the target image frame whose clarity is to be updated includes at least one image frame of the target file; therefore, after generating the target file, the user can input the first input on the user interface of the electronic device according to actual needs, and the electronic device, after receiving the first input, updates the clarity of the image of any area in at least one target image frame in the target file, so as to achieve the effect of refocusing the target object contained in the any area. In this way, after the video file is recorded, any target object in the local image area of at least one image frame in the video file can be refocused in a targeted manner, thereby meeting the user's personalized focus requirements for the target object in the video file, and further meeting the user's personalized display requirements for the picture content at a certain moment in the video file; and in the process of re-editing the local image area in at least one image frame of the recorded target file, there is no need to rely on professional software specifically for post-video editing, making the user's image processing operations in the target file more convenient and further improving the file editing efficiency.
[0256] The file processing device in the embodiment of the present application can be an electronic device or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other device other than a terminal. For example, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a mobile Internet device (MID), an augmented reality (AR) / virtual reality (VR) device, a robot, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a personal digital assistant (PDA), etc. It can also be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), a teller machine or a self-service machine, etc., and the embodiment of the present application does not specifically limit it.
[0257] The file processing device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.
[0258] The file processing device provided in the embodiment of the present application can achieve Figures 1 to 15 To avoid repetition, the various processes implemented in the method embodiment are not described here.
[0259] Alternatively, as Figure 17 As shown, an embodiment of the present application also provides an electronic device 1700, including a processor 1701 and a memory 1702, wherein the memory 1702 stores a program or instruction that can be run on the processor 1701. When the program or instruction is executed by the processor 1701, the various steps of the above-mentioned file processing method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0260] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.
[0261] Figure 18 A schematic diagram of the hardware structure of an electronic device implementing an embodiment of the present application.
[0262] The electronic device 1800 includes but is not limited to components such as a radio frequency unit 1801 , a network module 1802 , an audio output unit 1803 , an input unit 1804 , a sensor 1805 , a display unit 1806 , a user input unit 1807 , an interface unit 1808 , a memory 1809 , and a processor 1810 .
[0263] Those skilled in the art will understand that the electronic device 1800 may also include a power source (such as a battery) to power each component, and the power source may be logically connected to the processor 1810 through a power management system, thereby implementing functions such as charging, discharging, and power consumption management through the power management system. Figure 18 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be repeated here.
[0264] The user input unit 1807 is configured to receive a first input from a user;
[0265] Processor 1810 is configured to update the clarity of an image in a first area of a target image frame in a target file in response to the first input;
[0266] The target file includes at least two image frames, and the target image frame includes at least one image frame of the target file.
[0267] In an embodiment of the present application, therefore, after generating the target file, the user can, according to actual needs, input a first input on the user interface of the electronic device. After receiving the first input, the electronic device updates the clarity of the image of any area in at least one target image frame in the target file, thereby achieving the effect of refocusing the target object contained in any area. In this way, after the video file is recorded, any target object in the local image area of at least one image frame in the video file can be refocused in a targeted manner, thereby meeting the user's personalized focus requirements for the target object in the video file, and then meeting the user's personalized display requirements for the picture content at a certain moment in the video file; and in the process of re-editing the local image area in at least one image frame of the recorded target file, there is no need to rely on professional software specifically for post-video editing, which makes the user's image processing operations in the target file more convenient, further improving the file editing efficiency.
[0268] Optionally, the processor 1810 is configured to update the clarity of the image in the first area of the target image frame in the target file, including:
[0269] updating the image of the first area in the target image frame based on the image of the second area in the target replacement frame;
[0270] The second area is an area in the target replacement frame corresponding to the first area, and the definition of the image in the second area is higher than the definition of the image in the first area.
[0271] Optionally, the user input unit 1807 is configured to receive the first input from the user, including:
[0272] In a case where a first image frame is displayed on a file display interface of the target file, receiving a first sub-input from a user on a first area in the first image frame;
[0273] Display unit 1806 is used to display at least one preview identifier in response to the first sub-input, each preview identifier indicating a candidate image frame, the clarity of the image of a third area in the candidate image frame being higher than the clarity of the image of the first area in the first image frame, and the third area being the area in the candidate image frame corresponding to the first area.
[0274] Optionally, the target file is a composite file, which is obtained by combining a first file and a second file, where the first file is shot by a first camera and the second file is shot by a second camera;
[0275] The target image frame is an image frame in the synthesized file, and the candidate image frame indicated by the preview identifier is an image frame in the first file or the second file.
[0276] Optionally, after receiving a first sub-input from a user on a first area in the first image frame, the method further includes:
[0277] The display unit 1806 is configured to display a definition value of the candidate image frame indicated by at least one preview identifier.
[0278] Optionally, the display unit 1806 is configured to display at least one preview identifier, including:
[0279] In the first area of the file display interface, the first image frame is kept displayed, and in the second area of the file display interface, at least one preview mark is displayed;
[0280] After displaying at least one preview identifier, the method further includes:
[0281] The user input unit 1807 is configured to receive a second sub-input from the user for a target preview identifier in the at least one preview identifier;
[0282] The processor 1810 is configured to update the clarity of the image in the first area of the target image frame in the target file, including:
[0283] In response to the second sub-input, updating the clarity of the image of the first area of the target image frame based on the target candidate image frame indicated by the target preview identifier;
[0284] The target candidate image frame is a target replacement frame.
[0285] Optionally, before receiving the first input from the user, the method further includes:
[0286] A display unit 1806 is configured to display at least one object identifier on a file display interface of the target file, where the object identifier is used to indicate an object in any image frame of the target file;
[0287] The user input unit 1807 is configured to receive the first input from the user, including:
[0288] receiving a third sub-input of the at least one object identifier from a user, the third sub-input being an input for selecting at least one candidate object identifier from the at least one object identifier, the at least one candidate object identifier indicating at least one candidate focus object;
[0289] The processor 1810 is configured to update the clarity of the image in the first area of the target image frame in the target file, including:
[0290] Updating the clarity of an image of a first area where a target focused object is located in a target image frame;
[0291] The target focus object includes part or all of the at least one candidate focus object.
[0292] Optionally, before updating the clarity of the image of the first area of the target image frame in the target file, the method further includes:
[0293] The user input unit 1807 is used to receive a fourth sub-input from the user;
[0294] The processor 1810 is configured to determine, in response to the fourth sub-input, a target focus type according to the fourth sub-input;
[0295] The processor 1810 is configured to update the clarity of the image of the first area where the target focused object is located in the target image frame, including:
[0296] determining a target focus object among the at least one candidate focus object based on the target focus type;
[0297] The clarity of the image of the first area where the target focus object is located in the target image frame is updated.
[0298] Optionally, the target focus type includes: a first focus type, a second focus type, a third focus type and a combined focus type, wherein the combined focus type corresponds to a combination of at least two focus types;
[0299] The processor 1810 is configured to determine, based on the target focus type, a target focus object among the at least one candidate focus object, including:
[0300] When the target focus type is the first focus type, determining a target focus object based on depth of field information of the at least one candidate focus object;
[0301] When the target focus type is the second focus type, for each adjacent first target image frame and second target image frame, determining a second target focus object in the second target image frame based on a first target focus object in the first target image frame, where the first target focus object and the second target focus object are different;
[0302] In a case where the target focus type is the third focus type, determining a target focus object based on a display order of the at least one candidate focus object;
[0303] In a case where the target focus type is a combined focus type, the target focus object is determined based on target object determination methods corresponding to the at least two focus types.
[0304] Optionally, before receiving the first input from the user, the method further includes:
[0305] Processor 1810, configured to control the first camera and the second camera to shoot synchronously;
[0306] Processor 1810 is configured to generate, when shooting is completed, a first file shot by the first camera, a second file shot by the second camera, and a composite file obtained by combining the first file and the second file;
[0307] The first camera and the second camera have different focal lengths; and the target file is the synthesized file.
[0308] Optionally, the user input unit 1807 is further configured to receive a second input from the user on a fourth area in the second image frame when the file display interface of the target file displays the second image frame;
[0309] A display unit 1806 is configured to display a blur adjustment control in response to the second input;
[0310] A user input unit 1807 is configured to receive a third input from the user on the blur adjustment control;
[0311] The processor 1810 is configured to, in response to the third input, perform blurring processing on the image of the fourth area based on a blurring degree corresponding to the third input.
[0312] Optionally, the blur adjustment control includes a slider, and the third input is an input of the user moving the slider to a first position;
[0313] Before blurring the image of the fourth area based on the blurring degree corresponding to the third input, the method further includes:
[0314] Processor 1810, configured to determine a blurring degree according to the first position;
[0315] After blurring the image of the fourth area based on the blurring degree corresponding to the third input, the method further includes:
[0316] The display unit 1806 is configured to display a first processing identifier at a second position on the playback progress bar of the target file, and to display a second processing identifier at a third position on the playback progress bar;
[0317] Among them, the second position is the position of the target image frame corresponding to the playback progress bar, and the first processing identifier indicates that the clarity of the image in the first area of the target image frame has been updated; the third position is the position of the second image frame corresponding to the playback progress bar, and the second processing identifier indicates that the second image frame has completed a blurring process.
[0318] Optionally, after displaying the first processing identifier at the second position on the playback progress bar of the target file and displaying the second processing identifier at the third position on the playback progress bar, the method further includes:
[0319] Processor 1810, configured to extract at least one target image frame indicated by at least one first processing identifier and at least one second image frame indicated by at least one second processing identifier;
[0320] The processor 1810 is configured to generate a clipping file based on the extracted at least one target image frame and the at least one second image frame.
[0321] An electronic device provided in an embodiment of the present application receives a first input from a user; in response to the first input, updates the clarity of an image in a first area of a target image frame in a target file; wherein the target file includes at least two image frames, and the target image frame whose clarity is to be updated includes at least one image frame of the target file; therefore, after generating the target file, the user can input a first input on a user interface of the electronic device according to actual needs, and after receiving the first input, the electronic device updates the clarity of an image in any area of at least one target image frame in the target file, thereby achieving the effect of refocusing the target object contained in the any area. In this way, after recording the video file, any target object in a local image area of at least one image frame in the video file can be refocused in a targeted manner, thereby meeting the user's personalized focus requirements for the target object in the video file, and further meeting the user's personalized display requirements for the picture content at a certain moment in the video file; and in the process of re-editing the local image area in at least one image frame of the recorded target file, there is no need to rely on professional software specifically for post-video editing, making the user's image processing operations in the target file more convenient and further improving the file editing efficiency.
[0322] It should be understood that in embodiments of the present application, the input unit 1804 may include a graphics processing unit (GPU) 18041 and a microphone 18042. The GPU 18041 processes image data of a still image or video obtained by an image capture device (e.g., a camera) in video capture mode or image capture mode. Specifically, the image capture device may include a first camera and a second camera, and the GPU 18041 generates a composite file (i.e., a target file) based on a first file captured by the first camera and a second file captured by the second camera. The display unit 1806 may include a display panel 18061, which may be configured in the form of a liquid crystal display, an organic light-emitting diode, or the like. The user input unit 1807 includes a touch panel 18071 and at least one of other input devices 18072. The touch panel 18071 is also called a touch screen. The touch panel 18071 may include two parts: a touch detection device and a touch controller. Other input devices 18072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, on / off keys, etc.), a trackball, a mouse, and a joystick, which will not be described in detail here.
[0323] The memory 1809 can be used to store software programs and various data. The memory 1809 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, applications or instructions required for at least one function (such as a sound playback function, an image playback function, etc.). In addition, the memory 1809 may include a volatile memory or a non-volatile memory, or the memory 1809 may include both volatile and non-volatile memory. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. Volatile memory can be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct RAM bus random access memory (DRRAM). The memory 1809 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.
[0324] Processor 1810 may include one or more processing units. Optionally, processor 1810 integrates an application processor and a modem processor. The application processor primarily handles operations related to the operating system, user interface, and application programs, while the modem processor primarily processes wireless communication signals, such as a baseband processor. It is understood that the modem processor may not be integrated into processor 1810.
[0325] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned file processing method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0326] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.
[0327] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned file processing method embodiment and achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0328] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.
[0329] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned file processing method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0330] It should be noted that, in this article, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the statement "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device comprising the element. In addition, it should be noted that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in the opposite order according to the functions involved. For example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.
[0331] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), including a number of instructions for enabling a terminal (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods described in each embodiment of the present application.
[0332] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of this application, ordinary technicians in this field can also make many forms without departing from the purpose of this application and the scope of protection of the claims, all of which are within the protection of this application.
Claims
1. A file processing method, characterized in that: The method comprises: receiving a first input from a user; In response to the first input, updating the clarity of an image in a first area of a target image frame in a target file; Wherein, the target file includes at least two image frames, and the target image frame includes at least one image frame of the target file; In a case where the file display interface of the target file displays the second image frame, receiving a second input from the user on a fourth area in the second image frame; In response to the second input, displaying a blur adjustment control; the blur adjustment control includes a slider; receiving a third input from the user to the blur adjustment control; the third input being an input from the user moving the slider to the first position; In response to the third input, determining a blurring degree based on the first position; Based on the blur degree, blurring the image of the fourth area; A first processing identifier is displayed at the second position on the playback progress bar of the target file, and a second processing identifier is displayed at the third position on the playback progress bar; wherein, the second position is the position of the target image frame corresponding to the playback progress bar, and the first processing identifier indicates that the clarity of the image in the first area of the target image frame has been updated; the third position is the position of the second image frame corresponding to the playback progress bar, and the second processing identifier indicates that the second image frame has completed a blurring process.
2. The method according to claim 1, characterized in that Updating the clarity of the image in the first area of the target image frame in the target file includes: updating the image of the first area in the target image frame based on the image of the second area in the target replacement frame; The second area is an area in the target replacement frame corresponding to the first area, and the definition of the image in the second area is higher than the definition of the image in the first area.
3. The method according to claim 1, characterized in that The receiving a first input from a user includes: In a case where a first image frame is displayed on a file display interface of the target file, receiving a first sub-input from a user on a first area in the first image frame; In response to the first sub-input, at least one preview identifier is displayed, each of the preview identifiers indicating a candidate image frame, the clarity of an image of a third area in the candidate image frame being higher than the clarity of an image of a first area in the first image frame, the third area being an area in the candidate image frame corresponding to the first area.
4. The method according to claim 3, characterized in that The target file is a composite file, which is obtained by synthesizing a first file and a second file, wherein the first file is shot by a first camera and the second file is shot by a second camera; The target image frame is an image frame in the synthesized file, and the candidate image frame indicated by the preview identifier is an image frame in the first file or the second file.
5. The method according to claim 3, characterized in that After receiving the first sub-input of the user on the first area in the first image frame, the method further includes: The definition value of the candidate image frame indicated by at least one preview identifier is displayed.
6. The method according to claim 3, characterized in that The displaying of at least one preview indicator includes: In the first area of the file display interface, the first image frame is kept displayed, and in the second area of the file display interface, at least one preview mark is displayed; After displaying at least one preview identifier, the method further includes: receiving a second sub-input from the user regarding a target preview identifier among the at least one preview identifier; Updating the clarity of the image in the first area of the target image frame in the target file includes: In response to the second sub-input, updating the clarity of the image of the first area of the target image frame based on the target candidate image frame indicated by the target preview identifier; The target candidate image frame is a target replacement frame.
7. The method according to claim 1, characterized in that Before receiving the first input from the user, the method further includes: Displaying at least one object identifier on a file display interface of the target file, wherein the object identifier is used to indicate an object in any image frame of the target file; The receiving a first input from a user includes: receiving a third sub-input of the at least one object identifier from a user, the third sub-input being an input for selecting at least one candidate object identifier from the at least one object identifier, the at least one candidate object identifier indicating at least one candidate focus object; Updating the clarity of the image in the first area of the target image frame in the target file includes: Updating the clarity of an image of a first area where a target focused object is located in a target image frame; The target focus object includes part or all of the at least one candidate focus object.
8. The method according to claim 7, characterized in that Before updating the clarity of the image of the first area of the target image frame in the target file, the method further includes: receiving a fourth sub-input from the user; In response to the fourth sub-input, determining a target focus type according to the fourth sub-input; The updating of the clarity of the image of the first area where the target focused object is located in the target image frame includes: determining a target focus object among the at least one candidate focus object based on the target focus type; The clarity of the image of the first area where the target focus object is located in the target image frame is updated.
9. The method according to claim 8, characterized in that The target focus type includes: a first focus type, a second focus type, a third focus type and a combined focus type, wherein the combined focus type corresponds to a combination of at least two focus types; The determining, based on the target focus type, a target focus object among the at least one candidate focus object includes: When the target focus type is the first focus type, determining a target focus object based on depth of field information of the at least one candidate focus object; When the target focus type is the second focus type, for each adjacent first target image frame and second target image frame, determining a second target focus object in the second target image frame based on a first target focus object in the first target image frame, where the first target focus object and the second target focus object are different; In a case where the target focus type is the third focus type, determining a target focus object based on a display order of the at least one candidate focus object; In a case where the target focus type is a combined focus type, the target focus object is determined based on target object determination methods corresponding to the at least two focus types.
10. The method according to claim 1, characterized in that Before receiving the first input from the user, the method further includes: Controlling the first camera and the second camera to shoot synchronously; When the shooting is completed, generating a first file shot by the first camera, a second file shot by the second camera, and a composite file obtained by combining the first file and the second file; The first camera and the second camera have different focal lengths; and the target file is the synthesized file.
11. The method according to claim 1, wherein After displaying the first processing mark at the second position on the playback progress bar of the target file and displaying the second processing mark at the third position on the playback progress bar, the method further includes: extracting at least one target image frame indicated by at least one first processing identifier and at least one second image frame indicated by at least one second processing identifier; A clipping file is generated based on the extracted at least one target image frame and the at least one second image frame.
12. A file processing device, characterized in that: The device comprises: A first receiving module, configured to receive a first input from a user; a first processing module, configured to update the clarity of an image in a first area of a target image frame in a target file in response to the first input; Wherein, the target file includes at least two image frames, and the target image frame includes at least one image frame of the target file; A fifth receiving module is configured to receive a second input from a user on a fourth area in the second image frame when the second image frame is displayed on the file display interface of the target file; a fourth display module, configured to display a blur adjustment control in response to the second input; the blur adjustment control comprising a slider; a sixth receiving module, configured to receive a third input from the user to the blur adjustment control; the third input being an input from the user moving the slider to the first position; a second processing module, configured to determine a blurring degree according to the first position in response to the third input; and perform blurring processing on the image of the fourth area based on the blurring degree; The fifth display module is used to display a first processing identifier at a second position on the playback progress bar of the target file, and to display a second processing identifier at a third position on the playback progress bar; wherein the second position is the position of the target image frame corresponding to the playback progress bar, and the first processing identifier indicates that the clarity of the image in the first area of the target image frame has been updated; the third position is the position of the second image frame corresponding to the playback progress bar, and the second processing identifier indicates that the second image frame has completed a blurring process.
13. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the file processing method according to any one of claims 1 to 11 are implemented.
14. A readable storage medium, characterized in that The readable storage medium stores a program or instruction, and when the program or instruction is executed by a processor, the steps of the file processing method according to any one of claims 1 to 11 are implemented.
Citation Information
Patent Citations
Video processing method and terminal device
CN109819188A
Video processing method and device, electronic equipment and readable storage medium
CN111698553A
Video processing method and device, electronic equipment and medium
CN112929748A