Image processing method and electronic equipment

Abstract

The invention provides an image processing method and electronic equipment, relates to the technical field of image processing, and is used for generating more different types of images in a shooting scene. The method is applied to the electronic equipment comprising a camera, and comprises the following steps: in response to a shooting instruction, obtaining N source images collected by the camera for a shot object; wherein N is a positive integer greater than or equal to 2. The N source images comprise a reference photo and at least one of the following items: an empty scene photo, a plurality of auxiliary photos and a live photo. And determining a first transformation track corresponding to the N source images. According to the first transformation track, carrying out fusion processing on the N source images to obtain a first target image; the first target image can dynamically display the shot object at different viewing angles and / or different zooming degrees according to the first transformation track.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of image processing technology, and in particular to an image processing method and electronic device. Background Art

[0002] With the development of technology, electronic devices such as smartphones and tablets have gradually become commonly used photography tools for more and more users.

[0003] In conventional photography, electronic devices typically capture only a single static image in response to a user's capture command, and the image presented to the user is also static. Therefore, there is an urgent need for a method that can generate more diverse images in different shooting scenarios, such as images with dynamically changing perspectives. Summary of the Invention

[0004] Embodiments of the present application provide an image processing method and electronic device for generating more different types of images in shooting scenarios, such as images with dynamically changing perspectives.

[0005] To achieve the above objectives, the embodiments of the present application adopt the following technical solutions:

[0006] In a first aspect, an image processing method is provided, which is applied to an electronic device including a camera, comprising:

[0007] In response to a capture command, N source images of a subject are acquired via a camera. N is a positive integer greater than or equal to 2. The N source images include a reference photo and at least one of the following: an empty space photo, multiple auxiliary photos, and a live photo. If the source images include multiple and diverse types, richer image features can be extracted when fused to obtain a target image, thereby improving image quality. A first transformation trajectory corresponding to the N source images is then determined. Based on the first transformation trajectory, the N source images are fused to obtain a first target image. The first target image can dynamically display the subject at different perspectives and / or zoom levels according to the first transformation trajectory. Before and after a user triggers a capture command, the electronic device and / or the subject may typically move. In this solution, multiple source images are acquired in response to the capture command, and the multiple source images may include multiple perspectives of the subject. Furthermore, the transformation trajectory is determined when generating the target image. Image fusion is performed according to the transformation trajectory to obtain a target image that displays the subject at different perspectives and / or zoom levels. The target image has a dynamic display effect, which can increase the fun and attraction of taking photos.

[0008] In a possible implementation of the first aspect, the acquiring of N source images in response to the shooting instruction is performed after a preset photo-taking function is turned on in the electronic device.

[0009] In a possible implementation manner of the first aspect, the first transformation trajectory corresponds to a transformation sequence representing a viewing angle and / or a zoom degree.

[0010] In a possible implementation of the first aspect, when the first target image dynamically displays the photographed object according to the first transformation trajectory, the viewing angle is sequentially transformed in one direction, so that the display effect of the first target image is better.

[0011] In a possible implementation of the first aspect, when the first target image dynamically displays the photographed object according to the first transformation trajectory, the zoom level is transformed in order of size, so that the display effect of the first target image is better.

[0012] In a possible implementation of the first aspect, when the first target image dynamically displays the photographed object according to the first transformation trajectory, the viewing angle is sequentially transformed in one direction, and the zoom level is sequentially transformed in order of size. This provides a better display effect of the first target image.

[0013] In one possible implementation of the first aspect, the N source images include multiple auxiliary photos, and the subjects in the multiple auxiliary photos correspond to different perspectives. Fusing the N source images according to a first transformation trajectory to obtain a first target image may include fusing the N source images according to the first transformation trajectory to obtain the first target image. Because the source images include different perspectives of the subject, directly fusing the source images can obtain a target image that dynamically displays the subject from different perspectives according to the first transformation trajectory.

[0014] In a possible implementation of the first aspect, N source images include multiple auxiliary photos, and the subjects in the multiple auxiliary photos correspond to the same perspective; fusing the N source images according to a first transformation trajectory to obtain a first target image may include: generating multiple intermediate images of the subject from different perspectives according to the first transformation trajectory and the N source images. Fusing the multiple intermediate images according to the first transformation trajectory to obtain the first target image. Since the source images do not include multiple perspectives of the subject, a related algorithm can be first used based on the N source images to generate intermediate images of the subject from different perspectives, and then fusing the intermediate images. In this way, a target image that can dynamically display the subject from different perspectives according to the first transformation trajectory can also be obtained.

[0015] In one possible implementation of the first aspect, if the first transformation trajectory includes a scaling transformation, when performing a fusion process on N source images according to the first transformation trajectory, some of the source images may be scaled to obtain scaled images. The source images and the scaled images are then fused again according to the first transformation trajectory to obtain a first target image. In this manner, a target image capable of displaying the subject at different scales can be obtained.

[0016] In one possible implementation of the first aspect, the photographed subject includes a foreground and a background; the first transformation trajectory includes a foreground transformation trajectory and a background transformation trajectory. The aforementioned fusing of N source images according to the first transformation trajectory to obtain a first target image may specifically include: fusing the foreground in the N source images according to the foreground transformation trajectory to obtain the first target image; and the background in the first target image remains stationary. That is, during the fusion process, the foreground is fused according to the foreground transformation trajectory, and the obtained target image shows the foreground dynamically displaying different perspectives and / or different zoom levels, while the background remains stationary.

[0017] In one possible implementation of the first aspect, the photographed subject includes a foreground and a background; the first transformation trajectory includes a foreground transformation trajectory and a background transformation trajectory. The aforementioned fusing of N source images according to the first transformation trajectory to obtain a first target image may specifically include: fusing the backgrounds in the N source images according to the background transformation trajectory to obtain the first target image; and the foreground in the first target image remains stationary. That is, during the fusion process, the background is fused according to the background transformation trajectory, resulting in a target image in which the background dynamically displays different perspectives and / or different zoom levels, while the foreground remains stationary.

[0018] In a possible implementation of the first aspect, the photographed object includes a foreground and a background; the first transformation trajectory includes a foreground transformation trajectory and a background transformation trajectory. The above-mentioned fusing processing of N source images according to the first transformation trajectory to obtain a first target image may specifically include: fusing the foreground in the N source images according to the foreground transformation trajectory, and fusing the background in the N source images according to the background transformation trajectory to obtain the first target image. That is, when performing the fusion processing, the foreground is fused according to the foreground transformation trajectory, and then the background is fused according to the background transformation trajectory. The obtained target image shows that both the foreground and the background dynamically display different perspectives and / or different zoom levels.

[0019] In a possible implementation of the first aspect, the foreground transformation trajectory and the background transformation trajectory may be the same, so that the target image obtained by the fusion process appears as the foreground and background being dynamically displayed with the same transformation trajectory.

[0020] In a possible implementation of the first aspect, the foreground transformation trajectory and the background transformation trajectory may be different, so that the target image obtained by the fusion process shows that the foreground and background are dynamically displayed with different transformation trajectories.

[0021] Through the above-mentioned implementation methods, target images with more different display effects can be obtained.

[0022] In one possible implementation of the first aspect, before fusing the N source images according to the first transformation trajectory to obtain the first target image, the method further includes extracting depth information of the photographed subject from the N source images. Fusing the N source images according to the first transformation trajectory to obtain the first target image may specifically include fusing the N source images based on the depth information and the first transformation trajectory to obtain the first target image. Fusion processing combined with depth information can make the photographed subject appear more realistic in the generated target image, or can also give the photographed subject in the generated target image a three-dimensional effect.

[0023] In one possible implementation of the first aspect, determining a first transformation trajectory corresponding to N source images may specifically include: performing image recognition on one or more of the N source images to determine attribute information of the N source images. Searching for a transformation trajectory that matches the attribute information as the first transformation trajectory. The attribute information includes at least one of the following: the target scene corresponding to the N source images, the position of the subject in a reference photo, and the composition of the reference photo. In this way, the electronic device can automatically recommend a more appropriate transformation trajectory based on different shooting scenes and subjects.

[0024] In a possible implementation manner of the first aspect, determining the first transformation trajectory corresponding to the N source images may specifically include: acquiring a default transformation trajectory as the first transformation trajectory.

[0025] In one possible implementation of the first aspect, the method may further include: changing the default transformation trajectory in response to the modification operation. In this way, the electronic device allows the user to adjust the default transformation trajectory according to their preferences, thereby generating a target image that better suits the user's preferences when shooting.

[0026] In a possible implementation of the first aspect, after the N source images are fused according to the first transformation trajectory to obtain the first target image, the method further includes: saving the N source images. When a change operation is received, a second transformation trajectory is determined; wherein the second transformation trajectory is different from the first transformation trajectory. Finally, the N source images are re-fused according to the second transformation trajectory to obtain a second target image. The second target image can dynamically display the photographed object at different perspectives and / or different zoom levels according to the second transformation trajectory. In this solution, after generating the first target image, the electronic device supports the user to change the transformation trajectory of the first target image, thereby generating a target image with other dynamic display effects. Moreover, the target image 2 obtained by re-fusion processing based on the N source images is better.

[0027] In a possible implementation of the first aspect, the method further includes extracting and saving image features from N source images. After fusing the N source images according to a first transformation trajectory to obtain a first target image, the method further includes determining a second transformation trajectory upon receiving a change operation; the second transformation trajectory is different from the first transformation trajectory. Regenerating a second target image based on the second transformation trajectory and the image features. The second target image can dynamically display the photographed object at different perspectives and / or different zoom levels according to the second transformation trajectory. In this solution, after generating the first target image, the electronic device supports the user to change the transformation trajectory of the first target image, thereby generating a target image with other dynamic display effects. Furthermore, re-fusing based on the image features of the N source images improves processing efficiency. Moreover, compared to needing to save the N source images, saving the image features in the N source images can reduce storage space.

[0028] In a possible implementation of the first aspect, after a first target image is generated in response to a capture instruction, the first target image is directly displayed to a user. In response to receiving a change operation, a second transformation trajectory is determined, where the second transformation trajectory is different from the first transformation trajectory. Based on the second transformation trajectory, the N source images are re-fused to obtain a second target image.

[0029] The second target image can dynamically display the captured object at different viewing angles and / or zoom levels according to the second transformation trajectory. The first target image is switched to the second target image. This allows the user to determine the appropriate transformation trajectory immediately after shooting and generate the corresponding target image with dynamic display effects for viewing.

[0030] In one possible implementation of the first aspect, an interface displaying the first target image includes a change control. Upon receiving a user trigger operation on the change control, the electronic device may display candidate change trajectories in the interface. In response to a user trigger operation on one of the candidate change trajectories, the change operation is deemed to have been received. In this case, the electronic device determines the candidate change trajectory selected by the user as the second transformation trajectory.

[0031] In one possible implementation of the first aspect, after a first target image is generated in response to a capture instruction, the first target image is directly displayed to the user. The interface displaying the first target image further includes save and cancel controls. In response to a user triggering the save control, the first target image may be saved. In response to a user triggering the cancel control, the first target image may not be saved, but instead the display of the first target image may be canceled, and the capture interface may be displayed instead for re-capture.

[0032] In one possible implementation of the first aspect, after a camera captures N source images of a photographed subject, the method further includes: sending a reference photo from the source images to a server; receiving image features extracted from the reference photo returned by the server; and performing a fusion process by combining the image features with the N source images to obtain a first target image. Because the server can access a large amount of data, the extracted image features are better and richer. Thus, the electronic device generates a better target image by combining the image features extracted by the server.

[0033] In one possible implementation of the first aspect, after sending a reference photo in a source image to a server, the electronic device may also receive a transformation trajectory determined based on the reference photo from the server. The electronic device may then perform image fusion using the transformation trajectory determined by the server based on the reference photo. This allows the electronic device to generate a better target image by referencing the transformation trajectory determined by the server.

[0034] In a second aspect, the present application further provides an electronic device. The electronic device may include a camera, a processor, and a memory. The camera is configured to capture images. The camera and the memory are each coupled to the processor. The memory is configured to store computer-executable instructions. When the electronic device is in operation, the processor executes the computer-executable instructions stored in the memory, causing the electronic device to perform any of the image processing methods described in the first aspect.

[0035] In a third aspect, the present application provides a computer-readable storage medium having instructions stored therein, which, when executed on a computer, enables the computer to execute any one of the image processing methods in the first aspect.

[0036] In a fourth aspect, a computer program product comprising instructions is provided, which, when executed on an electronic device, enables the electronic device to execute any one of the image processing methods of the first aspect.

[0037] In a fifth aspect, a device (for example, a chip system) is provided, which includes a processor for supporting an electronic device to implement the functions involved in the first aspect above. In one possible design, the device also includes a memory for storing program instructions and data necessary for the electronic device. When the device is a chip system, it can be composed of a chip or include a chip and other discrete devices.

[0038] Among them, the technical effects brought about by any design method in the second to fifth aspects can refer to the technical effects brought about by different design methods in the first aspect, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] Figure 1 A schematic diagram of the operation interaction of a camera application provided in an embodiment of the present application;

[0040] Figure 2 A schematic diagram of an interface of a camera application provided in an embodiment of the present application;

[0041] Figure 3 A schematic diagram of an image effect provided in an embodiment of the present application;

[0042] Figure 4 A schematic diagram of an image effect provided in an embodiment of the present application;

[0043] Figure 5 A flowchart of an image processing method provided in an embodiment of the present application;

[0044] Figure 6A A schematic diagram of an image display interface provided in an embodiment of the present application;

[0045] Figure 6B A software framework diagram of a mobile phone provided in an embodiment of the present application;

[0046] Figure 7 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application;

[0047] Figure 8 A framework diagram of a chip system provided in an embodiment of the present application. DETAILED DESCRIPTION

[0048] The technical terms involved in this application are explained below.

[0049] The process of image fusion is defined as collecting all the important information from multiple images and incorporating it into fewer images, such as a single image.

[0050] An image with a dynamic display effect is an image captured and generated by an electronic device in response to a capture instruction after a preset camera function is activated. The image can display the subject at different perspectives and / or zoom levels within the image along a certain transformation trajectory.

[0051] The foreground usually refers to the people or objects closest to the camera lens. The background usually refers to the objects in the subject other than the foreground. For example, in a portrait photo, the person and the objects in front of them are considered the foreground, while the background refers to the objects other than the person, such as the landscape.

[0052] The reference photo is a photo captured when the electronic device receives a shooting instruction.

[0053] A skyscape photo is a photo that only contains the background. For example, when taking a portrait, the background scenery is taken before the portrait is in the frame.

[0054] In the embodiments of this application, auxiliary photos refer to photos, including foreground and background, other than the base photo, that are captured by the electronic device in response to a capture instruction. Supplementary photos typically include multiple photos from different perspectives. For example, in a portrait photo, auxiliary photos can be photos captured from multiple perspectives while the person moves within the frame or strikes different poses.

[0055] Live Photos represent dynamic photo resources generated by capturing photos taken within m seconds before and after the subject is captured. m can be set based on actual conditions, such as 1, 1.5, or 2.

[0056] The depth in an image refers to the distance between the object in the image and the camera. The farther the distance between the object and the camera, the greater the corresponding depth; conversely, the closer the distance between the object and the camera, the smaller the corresponding depth.

[0057] Currently, the camera function implemented on smart electronic devices such as smartphones and tablets mostly responds to the user's shooting command and captures a static photo within the current camera's viewing range. Figure 1 As shown, mobile phone 100 opens the camera application in response to a user clicking on camera application icon 101 on the desktop interface. The phone then displays camera application interface 102, which includes a preview box 103 and a photo control 104. Preview box 103 displays the content within the current camera's field of view. Photos captured by mobile phone 100 in response to a user's capture command are typically still photos. With the advancement of electronic device technology, electronic device manufacturers are adding a variety of photo-taking features to increase the appeal of electronic devices to users.

[0058] The present application provides an image processing method that fuses multiple photos captured by an electronic device to produce a single image. Furthermore, the fused image can display the photographed subject at different perspectives and / or zoom levels within the image, following a certain transformation trajectory. In the present application, the image can be recorded as an image with a dynamic display effect.

[0059] The image processing method proposed in the embodiments of the present application can be applied to electronic devices equipped with a camera and a camera application. The camera application has a preset photo function for collecting multiple source images in response to a shooting instruction, and performing image fusion processing using the multiple source images to obtain the above-mentioned image with dynamic display effect. In some embodiments, after the electronic device turns on the preset photo function, in response to the shooting instruction, the multiple source images collected will be cached for generating the above-mentioned image with dynamic display effect.

[0060] In some embodiments, the electronic device may be a mobile phone, a tablet computer, a personal computer (PC), a smart screen, a desktop, a laptop, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a smart watch and other wearable devices, an artificial intelligence (AI) speaker and an in-vehicle device, or various teaching aids (such as learning machines, early childhood education machines), smart toys, portable robots, personal digital assistants (PDAs), augmented reality (AR) and virtual reality (VR) devices, media players and other devices, or devices with mobile office functions, devices with smart home functions, devices with audio and video entertainment functions, devices that support smart travel, etc. The embodiments of the present application do not impose any special restrictions on the specific form of the device.

[0061] In some examples, the electronic device can be configured to disable the preset photo function by default when the camera function is activated. Subsequently, the electronic device can enable the preset photo function in response to a user's operation. In other examples, the electronic device can also be configured to enable the preset photo function by default when the camera application is activated. It is understood that after the preset photo function is enabled, the electronic device, in response to the user's shooting instruction, captures and generates images that are the aforementioned images with dynamic display effects. When the preset photo function is disabled, the electronic device, in response to the user's shooting instruction, captures and generates conventional static images.

[0062] As can be seen from the above description, in the image processing method proposed in the embodiment of the present application, the electronic device needs to collect multiple source images and then perform fusion processing on the multiple source images. Usually when the user triggers the shooting command, the content within the viewing range of the camera of the electronic device is the image that the user wants to shoot. For example, Figure 1 Taking the interface shown as an example, when the user sees the content displayed in the preview box 103 corresponding to the moment when fireworks burst, he can click the photo control 104 (i.e., issue a shooting instruction). For another example, when the user sees a pedestrian walking into the viewing range corresponding to the preview box 103, he can click the photo control 104. In the related art, the electronic device responds to the shooting instruction, saves the content currently displayed in the preview box 103, and obtains a photo. When processing an image with a dynamic display effect, the processing should be based on the photo. Therefore, after the electronic device turns on the preset photo function, the photo obtained when the user clicks the shooting control is processed based on other cached source images to obtain an image with a dynamic display effect.

[0063] In actual applications, the preset photo function can be named differently, such as dynamic shooting, dynamic photo, fun photo or three-dimensional (3D) photo. Figure 2 As shown, the camera application interface 105 of the mobile phone 100 includes more options 106. In response to the user clicking on more options 106, the mobile phone 100 displays a more function interface 107. This more function interface 107 includes multiple functions not displayed in the camera application interface 105, such as short movies, time-lapse photography, panorama, document scanning, watermarks, dynamic photos, and light stream shutter. In response to the user clicking on the dynamic photo icon 108, the mobile phone 100 activates the dynamic photo function and displays the dynamic photo function interface 109. This interface 109 includes a control 110 for indicating that the dynamic photo function is currently in use.

[0064] In some embodiments, the electronic device may cache multiple source images captured within a period of time before and after receiving the capture instruction. For example, the electronic device may cache source images captured within 2 seconds (or 1 second, 1.5 seconds, or 2.5 seconds, etc.) before and after receiving the capture instruction.

[0065] In other embodiments, the electronic device may also start caching the source images captured by the electronic device after turning on the preset photo-taking function and detecting that the electronic device meets certain conditions. Generally, when taking pictures, the more stable the electronic device is, the clearer the image effect obtained. Therefore, users usually try to keep the electronic device in a relatively stable state before taking pictures. In some embodiments, the electronic device can use a sensor to detect whether the electronic device is in a stationary state, and then determine whether the collected source images need to be cached. For example, after the electronic device detects that the electronic device is in a stationary state and continues for a period of time (such as a stationary state for more than 3 seconds), it can start caching the source images collected by the electronic device.

[0066] Alternatively, when taking photos such as portraits, the subject, i.e., the person, usually remains motionless or strikes a specific pose. In some embodiments, after turning on the preset photo-taking function, the electronic device can analyze the content in the preview box, and after detecting a person and the person remains stable for a period of time, start caching the collected source image. Alternatively, the electronic device can also start caching the collected source image after detecting that the person strikes a specific pose. Similarly, the electronic device can stop caching the source image after receiving a shooting instruction or a period of time after receiving the shooting instruction. In this way, the electronic device can cache multiple source images. The more source images, the richer the image features that can be extracted. This can then help the fusion processing obtain images with better dynamic display effects.

[0067] In other embodiments, the electronic device may also cache all source images captured by the electronic device after turning on the preset photo-taking function, and stop caching the source images until a photo-taking instruction is received or a period of time after receiving the photo-taking instruction.

[0068] However, in actual use, after turning on the preset photo-taking function, the user may wait for a suitable time before clicking the shooting control to take a picture. In this way, there will be a long interval between turning on the preset photo-taking function and the user triggering the shooting instruction. If the electronic device caches the collected images from the time the preset photo-taking function is turned on, there may be a large number of cached images, and some of the images may not be of much use in fusing and obtaining an image with a dynamic display effect. Therefore, in order to avoid the problem of caching too many source images and occupying storage space when shooting an image with a dynamic display effect, in some embodiments, the electronic device can set a time threshold. The timing starts from the time point when the source image is cached. If the timing time exceeds the time threshold, the electronic device deletes part of the source image. Alternatively, the electronic device can set a quantity threshold. When it detects that the number of cached source images is greater than the quantity threshold, the electronic device deletes part of the source image.

[0069] Next, how the electronic device selects the source image to be deleted in the above situation is described.

[0070] Generally, the closer the time to when the user triggers the capture command, the more stable the electronic device and the subject being photographed. Consequently, the image within the electronic device's framing will be more similar to the content within the framing range when the user triggers the capture command. Based on this, the electronic device can be configured to delete cached source images in chronological order when the timer exceeds a threshold; for example, the five source images with the oldest cached time. This reduces the storage space occupied by source images on the electronic device.

[0071] In order to make the dynamic display effect of the generated image better, a variety of different types of source images can be collected. In some embodiments, the source image includes a reference photo and at least one of the following categories: an empty scene photo, a plurality of auxiliary photos, and a live photo (or video), etc. When collecting source images, all the above types of source images can be collected, or some types of source images can be collected. Based on this, in some embodiments, when the timing time exceeds the time threshold or the source image exceeds the number threshold, the electronic device can select some source images for deletion after performing image recognition on the cached source images. Exemplarily, after the electronic device performs image recognition on the source image, the source image can be divided into different categories. Then, for each type of source image, you can choose to keep one or several, and delete the other source images.

[0072] Furthermore, the electronic device can also classify the types of source images into different importance levels, and then the electronic device can filter the source images to be retained and deleted based on the importance level. The higher the importance level of the category, the more source images can be retained, and the lower the importance level of the category, the fewer source images can be retained. For example, the empty scene photos usually do not change much when taking pictures, so the importance level of the empty scene photos can be set to a lower level, such as setting the importance level to 1. Multiple auxiliary photos, as well as live photos and videos, can be set to a higher importance level; such as setting the importance level to 2. In other words, the importance level of multiple auxiliary photos, live photos and videos can be set to be greater than the importance level of the empty scene photos. Exemplarily, the electronic device detects that among the 20 frames of cached source images, 10 frames are empty scene photos and 10 frames are auxiliary photos. For each category, the electronic device can choose to retain one or more source images, while deleting the other source images, such as retaining 2 frames of empty scene photos and 8 frames of auxiliary photos.

[0073] In other embodiments, the electronic device may also determine the source images that need to be deleted based on the similarity between multiple source images. The specific implementation method of calculating the image similarity can refer to the description in the relevant technology and will not be repeated in the embodiments of this application. Exemplarily, the electronic device may retain only a few source images with a similarity greater than a threshold value and delete the others. In this way, while retaining the source images required to generate images with dynamic display effects, the source images cached by the electronic device can be reduced, thereby reducing the storage space occupied. Moreover, while ensuring the type of source images and the effect of the image obtained by the fusion processing, reducing the number of source images can reduce the amount of calculation during the fusion processing of the electronic device.

[0074] The above-mentioned electronic device chooses to delete part of the source images when detecting that the timing time exceeds the time threshold, or chooses to delete part of the source images when detecting that the number of source images exceeds the number threshold, which can be performed when the electronic device has not received a shooting instruction. In other embodiments, the electronic device may not delete the source image when it has not received a shooting instruction, but after receiving the shooting instruction, it checks the timing time of the cached source image or the number of source images to determine whether it exceeds the corresponding conditions. If so, the electronic device deletes part of the source image. The way in which the electronic device selects the source image to be deleted can refer to the description of the above embodiment. Thereby, under the premise of ensuring the source image and image effect required for the fusion processing, the storage space occupied by the source image cached by the electronic device is reduced.

[0075] It is understandable that when the electronic device does not receive a shooting instruction, the cached source image can be used for image fusion processing when the shooting instruction is received. Therefore, the source image captured when the shooting instruction is not received is a pre-cached image. In some embodiments, after receiving the shooting instruction, the electronic device can save the source image that has been cached before receiving the shooting instruction to a designated path. When the electronic device uses multiple source images for fusion processing, it can obtain the source image from the designated path to achieve it. Alternatively, after receiving the shooting instruction, the electronic device can also directly obtain multiple source images from the cache path for processing.

[0076] Alternatively, after turning on the preset photo function, the user may exit the preset photo function or the camera application without taking a photo. In this case, if the electronic device does not receive the capture command, it needs to delete the cached source image. Therefore, in some embodiments, after the electronic device turns on the preset photo function, if it detects that the user has exited the preset photo function or the camera application, the electronic device deletes the cached source image.

[0077] Afterwards, the electronic device, in response to receiving the capture instruction, performs a fusion process on the cached source images. In an embodiment of the present application, the electronic device can extract image features from multiple cached source images, and then combine the extracted image features to perform image fusion processing on the multiple source images to obtain an image with a dynamic display effect.

[0078] When it is necessary to shoot dynamic videos or images in actual applications, common shooting techniques include: pushing (pushing the lens forward), pulling (pulling the lens backward), shaking (rotating and shaking the lens), shifting (moving and shooting), and lifting and lowering (raising or lowering the lens), etc. Different shooting techniques correspond to different dynamic display effects in the generated videos or images. For example, when pushing the lens forward during shooting, the corresponding video or image will show a dynamic display effect of gradually enlarging the subject. For another example, when shaking the lens from left to right during shooting, the corresponding video or image will show a dynamic display effect of showing different perspectives from left to right. In an embodiment of the present application, when generating an image with a dynamic display effect, one or more images of these dynamic display effects can be generated.

[0079] When generating images with different dynamic display effects, the electronic device needs to fuse multiple images according to the corresponding transformation trajectory. Exemplarily, the photographed object presents a dynamic display effect of gradually enlarging, and the corresponding transformation trajectory is that the zoom degree changes from small to large. The photographed object presents a dynamic display effect of moving from left to right, and the corresponding transformation trajectory can be: the photographed object changes the perspective from left to right. The photographed object presents a dynamic display effect of rotating clockwise, and the corresponding transformation trajectory can be: the photographed object changes the perspective in a clockwise direction. In other embodiments, different transformation trajectories can also be directly represented by shooting techniques such as pushing, pulling, shaking, moving, and lifting.

[0080] Before an electronic device fuses multiple source images, it may first determine a transformation trajectory for the fused image. In some embodiments, the electronic device may pre-set a default transformation trajectory. Upon receiving a capture instruction, the electronic device fuses the cached source images according to the default transformation trajectory, thereby generating an image that is dynamically displayed according to the default transformation trajectory.

[0081] Figure 3 The image transformation trajectory is a dynamic display effect of the zoom level from small to large. Figure 3 a、 Figure 3 b to Figure 3 In some embodiments, if the electronic device automatically loops the dynamic display effect, the electronic device can be changed in accordance with the order of c, wherein the zoom degree of the photographed object changes from small to large. Figure 3 a、 Figure 3 b to Figure 3 c, then Figure 3 a is played in sequence in a loop.

[0082] Figure 4 The figure shows the dynamic display effect of the image transformation trajectory corresponding to the left and right transformation of the viewing angle. Figure 4 a、 Figure 4 b to Figure 4 In some embodiments, if the electronic device automatically loops to play the dynamic display effect, the electronic device can be displayed in the order of c. Figure 4 a、 Figure 4 b to Figure 4 c, then Figure 4 a、 Figure 4 b to Figure 4 In other embodiments, when the electronic device automatically plays the dynamic display effect in a loop, it can also play the dynamic display effect in a loop according to the following steps: Figure 4 a、 Figure 4 b to Figure 4 c, then Figure 4 b to Figure 4 a,…are played in sequence in a loop.

[0083] The electronic device may also combine the attribute information of the N source images to select a matching transformation trajectory and then generate an image that displays the photographed object according to the matching transformation trajectory. The specific implementation process of the electronic device determining the attribute information of the N source images and selecting a matching transformation trajectory based on the attribute information will be described in detail in subsequent embodiments.

[0084] Furthermore, the electronic device allows the user to change the transformation trajectory, thereby generating an image with a dynamic display effect that suits the user's preferences.

[0085] The image processing method proposed in the embodiment of the present application will be described below with reference to the accompanying drawings.

[0086] Figure 5 Specific implementation steps of the image processing method in some embodiments are shown. In this embodiment, the electronic device is a mobile phone, and when the mobile phone starts the camera application, the default preset photo taking function is turned off as an example.

[0087] S201. In response to a camera startup operation, start a camera application.

[0088] like Figure 2 As shown, the mobile phone starts the camera application in response to the user clicking the icon of the camera application. It can be understood that in other embodiments, the mobile phone can also start the camera application in response to other operations.

[0089] S202. In response to operation 1, open the preset photo-taking function.

[0090] In some examples, such as Figure 2 As shown, in response to the user clicking the dynamic photo icon, the mobile phone can open the preset photo function. Operation 1 corresponds to the user clicking the dynamic photo icon.

[0091] S203. In response to the shooting instruction, obtain N source images captured by the camera.

[0092] In some embodiments, when the electronic device detects that the user clicks on a shooting control on a camera application interface, it receives a corresponding shooting instruction.

[0093] In other embodiments, the electronic device may also take a photo in response to a user's voice control instruction. In this embodiment, when the electronic device receives a voice photo-taking instruction, it also receives a corresponding photo-taking instruction.

[0094] In other embodiments, the electronic device may also take a photo when it detects a specific feature within the viewing range. For example, the specific feature may be a user's palm or a scissors hand gesture. In this embodiment, the electronic device receives a corresponding shooting instruction when it detects the specific feature within the viewing range.

[0095] In response to a capture instruction, the mobile phone may acquire source images within a period of time before and after the capture instruction, recorded as N source images. Specifically, upon detecting a capture instruction, the mobile phone may determine the time corresponding to the capture instruction. The mobile phone then acquires source images within a period of time before and after the capture instruction. For example, the mobile phone may acquire source images within a period of time, such as 2 seconds, 3 seconds, or 5 seconds before and after the capture instruction. In some embodiments, after S203, the mobile phone may save the N acquired source images.

[0096] The mobile phone may also obtain source images from the time when the preset photo-taking function is turned on to the time when the photo-taking command is received, or obtain source images from the time when the preset photo-taking function is turned on to the time when the photo-taking command is received, in response to the photo-taking command.

[0097] In order for the mobile phone to be able to obtain the source image before receiving the shooting instruction when receiving the shooting instruction, the mobile phone can pre-cache the image captured by the camera before receiving the shooting instruction. In this way, when the mobile phone receives the shooting instruction, it can obtain the source image from the cache path. Alternatively, when the mobile phone receives the shooting instruction, it can obtain the source image from the cache path and save it, and then obtain the source image from the saved path and use it for subsequent image fusion processing. The timing of when the electronic device starts caching the source image can refer to the description of the above embodiment.

[0098] As can be seen from the above description, in the embodiments of the present application, multiple image types can be pre-set. When shooting and generating an image with a dynamic display effect, the electronic device can obtain as many types of source images as possible in response to the shooting instruction. Exemplarily, the source image includes a reference photo and at least one of the following types: an empty scene photo, multiple auxiliary photos, and a live photo (or video), etc. The electronic device obtains more types of source images in response to the shooting instruction, which facilitates the extraction of more image features, thereby achieving better results when fusing and generating images.

[0099] S204. Determine the transformation trajectory 1 corresponding to the N source images.

[0100] Transformation trajectory 1 is used to determine the order of transformation of the perspective or zoom level of the subject in the image when performing image fusion processing on N source images. In some embodiments, transformation trajectory 1 can be recorded as the first transformation trajectory. In some embodiments, transformation trajectory 1 corresponds to continuous transformation of the perspective in a fixed direction, for example, transformation trajectory 1 corresponds to continuous transformation of the perspective from left to right, clockwise / counterclockwise transformation of the perspective, or change of the perspective from bottom to top. In other embodiments, the zoom level in transformation trajectory 1 corresponds to transformation in order of size; for example, transformation trajectory 1 corresponds to transformation of the zoom level from large to small, or from small to large, etc.

[0101] For example, if the subject is displayed as a dynamic display effect of gradually enlarging, the corresponding transformation trajectory may be a zoom level change from small to large. If the subject is displayed as a dynamic display effect of moving from left to right, the corresponding transformation trajectory may be: the subject changes perspective from left to right. If the subject is displayed as a dynamic display effect of rotating clockwise, the corresponding transformation trajectory may be: the subject changes perspective clockwise. In other embodiments, different transformation trajectories may also be represented by shooting techniques such as push, pull, shake, shift, and lift.

[0102] As can be seen from the above description, in some embodiments, the mobile phone may also select a default transformation trajectory as transformation trajectory 1 corresponding to the N source images. In this embodiment, S204 may specifically include obtaining the default transformation trajectory as transformation trajectory 1. Furthermore, the mobile phone supports users modifying the default transformation trajectory in the camera application. In some embodiments, the mobile phone changes the default transformation trajectory in response to the user's modification of the default transformation trajectory. In this way, the mobile phone can prioritize the generation of images with dynamic display effects corresponding to the transformation trajectory according to the user's preferences.

[0103] In other embodiments, S204 may specifically include: the mobile phone performing image recognition on one or more of the N source images to obtain attribute information corresponding to the N source images. Then, the mobile phone determines transformation trajectory 1 based on the attribute information. The attribute information of the N source images may include at least one of the following: the target scene corresponding to the N source images, the position of the subject of the photographed object in the reference photo, and the composition of the N source images.

[0104] The mobile phone can select a transformation trajectory in combination with the scenes of the N source images. In this embodiment, the above S204 may specifically include: the mobile phone performs image recognition on one or more of the N source images to determine the corresponding target scene. Select a matching transformation trajectory in combination with the target scene. Specifically, the mobile phone can store the correspondence between multiple scenes and multiple transformation trajectories. When determining the matching transformation trajectory, the mobile phone can search for the target transformation trajectory that matches the target scene corresponding to the N source images in the stored correspondence. Exemplarily, when the mobile phone detects that the scene is an outdoor environment, it can choose to shake or move the transformation trajectory corresponding to different perspectives. In this way, the generated image can be shaken or moved in a preset direction to display different perspectives of the photographed object.

[0105] In some embodiments, the mobile phone can pre-set multiple scenes and set the correspondence between multiple different scenes and transformation trajectories. For example: scene 1 corresponds to transformation trajectory 1, scene 2 corresponds to transformation trajectory 2, ... scene n corresponds to transformation trajectory n. When the mobile phone receives the shooting instruction, it first performs scene recognition based on the source image. After determining the scene corresponding to the source image, the matching transformation trajectory is selected based on the pre-set correspondence between the scene and the transformation trajectory. Finally, the source image is fused based on the matching transformation trajectory. In this solution, the mobile phone can automatically adapt the transformation trajectory in combination with the scene corresponding to the image. In this way, the mobile phone can automatically recommend a suitable transformation trajectory to the user, generate an image with a dynamic display effect that is more in line with the scene in which it is located, and the image effect is better. Among them, the specific implementation method of the mobile phone performing scene recognition on the source image can refer to the description in the relevant technology and will not be repeated in the embodiments of this application.

[0106] The mobile phone can also perform image recognition on one or more of the N source images to determine the position of the main body of the photographed object in the reference photo. Then, a matching transformation trajectory is selected based on the position. For example, if the main body of the photographed object is located at the top in the reference photo, the mobile phone can select a transformation trajectory that changes the perspective from top to bottom / shakes the perspective clockwise as transformation trajectory 1. Specifically, the mobile phone can set the positions of multiple subjects in the photo, as well as the correspondence between multiple positions and transformation trajectories. In this way, the mobile phone responds to the shooting instruction, and after determining the position of the main body of the photographed object in the reference photo, it selects a matching transformation trajectory based on the correspondence between the pre-set position and the transformation trajectory.

[0107] Alternatively, the mobile phone can also perform image recognition on one or more of the N source images to determine the composition of the reference photo. A matching transformation trajectory is then selected based on the composition. For example, if the composition of the reference photo is symmetrical, the mobile phone can select a transformation trajectory that involves shaking to change the viewing angle as the transformation trajectory. The mobile phone can be configured with multiple composition modes and correspondences between multiple composition modes and transformation trajectories. Thus, in response to a capture instruction, the mobile phone, after determining the composition of the reference photo, selects a matching transformation trajectory based on the pre-set correspondence between the composition mode and the transformation trajectory.

[0108] In other embodiments, the mobile phone may further select a transformation trajectory based on the proportion of the photographed subject in the source image. For example, when the mobile phone detects that the proportion of the photographed subject in the source image is less than a preset proportion threshold, it may select a transformation trajectory that zooms from small to large as Transformation Trajectory 1. When the mobile phone detects that the proportion of the photographed subject in the source image is within a preset proportion range, it may select a transformation trajectory that shakes or moves the perspective as Transformation Trajectory 1.

[0109] S205 . Based on the transformation trajectory 1 , perform image fusion processing on the N source images to obtain a target image 1 having a dynamic display effect according to the transformation trajectory 1 .

[0110] The target image 1 can dynamically display the photographed object at different viewing angles and / or different zoom levels according to the transformation trajectory 1. In some embodiments, the target image 1 can be recorded as a first target image.

[0111] In some embodiments, S205 may specifically include extracting image features from N source images, and fusing the N source images based on the image features and transformation trajectory 1 to obtain target image 1. The image features may include image texture, color, depth information, and resolution. The specific implementation of fusing the N source images based on the image features and transformation trajectory 1 can be found in the description of related art.

[0112] The source image can usually be divided into foreground and background. Taking the image feature including the depth information of the photographed object as an example, extracting the depth information of the photographed object from N source images can specifically include: extracting the foreground depth information of the foreground and the background depth information of the background from the N source images respectively. Figure 3 Taking the image shown as an example, the foreground may include people, and the background may include white clouds and the sun. During the fusion process, the foreground may be fused based on the foreground depth information, and the background may be fused based on the background depth information, so that the obtained image has a more realistic and better effect.

[0113] Based on transformation trajectory 1, the specific dynamic effects to be included in the target image to be generated can be determined. When determining, based on transformation trajectory 1, that a subject capable of displaying different perspectives needs to be generated, the N source images can be first examined to determine whether they include multiple perspectives of the subject. If the N source images include multiple auxiliary photos, and the subjects in these auxiliary photos correspond to different perspectives, then when generating target image 1, the N source images can be directly fused to obtain the target image that includes the subject from different perspectives.

[0114] Furthermore, if the source image has fewer perspectives of the subject, then in order to obtain more perspectives of the subject, the mobile phone can combine the source image with the relevant algorithm to generate one or more intermediate images of the subject that include other perspectives. Then, when performing the fusion process, the mobile phone will fuse one or more intermediate images with the N source images. In this way, the obtained target image can display more perspectives of the subject. Alternatively, in order to increase the duration of the dynamic effect of the obtained target image, the mobile phone can also reuse the source image of the same perspective during the fusion process. For example, the source image includes perspective 1 and perspective 2 of the subject. When the mobile phone performs the fusion process, it can choose to fuse the source image according to the transformation trajectory of perspective 1-perspective 2-perspective 1-perspective 2.

[0115] Continuing with the example of determining, based on transformation trajectory 1, that a target image capable of transforming to different perspectives needs to be generated, if multiple auxiliary photos are included in N source images, and the subject in each of these auxiliary photos corresponds to the same perspective, the mobile phone can first process the source images to obtain intermediate images that include the subject from different perspectives. In some embodiments, S205 described above may specifically include extracting image features from the N source images. Based on these image features, multiple intermediate images are generated that include the subject from different perspectives. The mobile phone then fuses these multiple intermediate images according to transformation trajectory 1 to generate target image 1 that displays the subject from different perspectives.

[0116] In other embodiments, if it is determined according to the transformation trajectory 1 that a target image capable of being transformed to different zoom levels needs to be generated, the mobile phone may select some images for zoom processing before fusing them when fusing N source images.

[0117] Alternatively, in some other embodiments, if it is determined according to the transformation trajectory 1 that a target image capable of transforming to different viewing angles and different zoom levels needs to be generated, the following situations may occur:

[0118] In the first case, the source image includes multiple auxiliary photos corresponding to different perspectives. The phone can select M source images for scaling, obtaining M scaled images; where M is a positive integer and M ≤ N. When M < N, the phone fuses the M scaled images with (NM) source images (the unscaled source images) according to transformation trajectory 1 to obtain target image 1. When M = N, the phone fuses the M scaled images according to transformation trajectory 1 to obtain target image 1.

[0119] In the second case, the source image includes multiple auxiliary photos corresponding to the same perspective. The phone can first generate one or more intermediate images based on the N source images, including the subject from different perspectives. Then, it selects a portion of the intermediate images and performs scaling processing to obtain scaled intermediate images. Finally, the phone fuses the scaled intermediate images with the unscaled intermediate images according to transformation trajectory 1 to obtain target image 1.

[0120] In the technical solution proposed in the embodiment of the present application, the dynamic effect of the target image to be generated can be determined based on the transformation trajectory 1, and then the fusion processing method can be determined. This ensures that the generated target image can dynamically display the photographed object at different perspectives and / or different zoom levels according to the transformation trajectory 1.

[0121] In the above embodiment, extracting image features from N source images may specifically include: extracting the foreground and background from the source images based on the N source images. Furthermore, calculating foreground depth information of the foreground and background depth information of the background. Then, based on the foreground depth information and the background depth information, generating multiple intermediate images of the subject at different perspectives and / or different zoom levels. Figure 3 Taking the image shown as an example, the foreground may include people, and the background may include white clouds and the sun.

[0122] Based on N source images, the mobile phone extracts the foreground and background in the source image, which can be achieved in any of the following ways: distinguishing the foreground and background based on color difference; distinguishing the foreground and background based on texture difference; distinguishing the foreground and background based on shape difference; extracting the foreground and background based on a deep learning algorithm. The specific implementation process of extracting the foreground and background in the above-mentioned way can refer to the description in the relevant technology. In other embodiments, the mobile phone can also use other methods to extract the foreground and background in the source image. The mobile phone calculates the foreground depth information of the foreground and the background depth information of the background respectively, which can be achieved in any way, for example, an AI algorithm can be used to perform depth estimation to obtain foreground depth information and background depth information.

[0123] The foreground depth information and background depth information extracted and calculated by the mobile phone from the source image can be used to generate images with different effects when generating intermediate images. When generating intermediate images, you can choose to process only the foreground or the background, such as performing scaling and / or perspective conversion on the foreground or background. If only the foreground is processed, then only the foreground in the final image has a dynamic display effect; if the background remains static, the foreground changes perspective or scale. You can also choose to process only the background, and then generate a target image with a dynamic display effect for the background; if the foreground remains static or changes scale. Of course, the mobile phone can also choose to perform the same processing on both the foreground and background, generating a target image with the same dynamic display effect for the foreground and background. Alternatively, you can choose to perform different processing on the foreground and background, generating a target image with different dynamic display effects for the foreground and background.

[0124] In some embodiments, the photographed object includes a foreground and a background; the transformation trajectory 1 includes a foreground transformation trajectory and a background transformation trajectory. The above S205 may specifically include: fusing the foreground of the N source images according to the foreground transformation trajectory to obtain a first target image; the background in the first target image remains stationary.

[0125] In some other embodiments, the photographed object includes a foreground and a background; the transformation trajectory 1 includes a foreground transformation trajectory and a background transformation trajectory. The above S205 may specifically include: fusing the backgrounds in the N source images according to the background transformation trajectory to obtain a first target image; and the foreground in the first target image remains stationary.

[0126] Alternatively, in some other embodiments, the photographed object includes a foreground and a background; and the transformation trajectory 1 includes a foreground transformation trajectory and a background transformation trajectory. S205 may specifically include: fusing the foreground of the N source images according to the foreground transformation trajectory, and fusing the background of the N source images according to the background transformation trajectory, to obtain a first target image.

[0127] In the above embodiment, the foreground transformation trajectory and the background transformation trajectory can be the same, such as both transforming the viewing angle clockwise. The foreground transformation trajectory and the background transformation trajectory can also be different, such as the foreground transformation trajectory transforming the viewing angle clockwise and the background transformation trajectory transforming the zoom degree in ascending order.

[0128] In the technical solution proposed in the embodiment of the present application, when performing fusion processing, the mobile phone can choose to process the foreground or background separately, or can choose to perform the same or different processing on the foreground and background. In this way, more target images with different dynamic display effects can be generated.

[0129] In addition, the foreground depth information and background depth information extracted and calculated by the mobile phone from the source image can also be used to generate an intermediate image with a three-dimensional stereo effect. In this way, in the target image with a dynamic display effect generated based on the intermediate image, the photographed object also has a three-dimensional stereo effect, making the image display more realistic and further improving the richness and attractiveness of the image display. Among them, the specific implementation process of the mobile phone generating an image with a three-dimensional stereo effect based on the foreground depth information and background depth information in the image can be referred to in the relevant technology and will not be repeated in the embodiments of this application.

[0130] Usually, when viewing the same photographed object from different perspectives, the range of the visible background may be different. Therefore, when generating intermediate images from different perspectives, it may be possible that some of the background holes in the intermediate images are missing. In this case, the background parts that are indeed empty need to be completed. In some embodiments, relevant algorithms can be used to fill and repair based on the image features around the missing parts. In other embodiments, multiple source images can also be combined to fill and repair the background of the missing parts. It can be seen from the description of the above embodiments that in some embodiments, the source images may include empty scene photos, auxiliary photos, and live photos, etc. When generating one of the intermediate images, the information in multiple source images can be combined to fill and repair the background information of the missing parts. In this way, it can be ensured that the foreground and background of the generated intermediate image are complete and not missing, thereby ensuring that the target image with dynamic display effect that is finally generated is also complete.

[0131] In the technical solution provided in the embodiments of this application, after the preset camera function is activated, the mobile phone captures multiple source images in response to a capture command. Furthermore, when fusing a target image with a dynamic display effect, the data source includes multiple source images. Thus, the more source images there are, the more image features can be extracted during the fusion process, resulting in a better dynamic display effect for the resulting image.

[0132] After the mobile phone generates the target image with dynamic display effects, it can directly display the target image with dynamic display effects to the user for viewing. In some embodiments, after the above S205, the above image processing method further includes: the mobile phone displays the target image 1. In this way, it is convenient for the user to check whether the image is satisfactory and whether the target image with dynamic display effects needs to be saved in time. In some embodiments, if the user views the image and finds that the shooting is not satisfactory, he or she may choose not to save the target image with dynamic display effects. In this embodiment, after the mobile phone displays the target image with dynamic display effects, it receives operation 2 to cancel the saving of the target image with dynamic display effects. Operation 2 is used to indicate the cancellation of saving the target image. As Figure 6A The image display interface 300 shown is used for displaying a generated target image with dynamic display effects on a mobile phone. In this example, operation 2 may correspond to a user clicking on a "cancel" control 301 in the image display interface 300 .

[0133] In other embodiments, if the user chooses to view the image and finds that the image effect is satisfactory, the user may choose to save the target image 1 with dynamic display effect. In this embodiment, after S205, the mobile phone receives operation 3 after displaying the target image 1 with dynamic display effect, and saves the target image 1 with dynamic display effect. Operation 3 is used to instruct to save the target image. Figure 6A As shown, operation 3 may correspond to a user clicking operation on the “save” control 302 in the image display interface 300 .

[0134] In other embodiments, if the user chooses to view an image and finds that they are dissatisfied with the dynamic display effect of the generated image, they can manually change the image's transformation trajectory to regenerate a target image with a different dynamic display effect. After the mobile phone displays target image 1 with a dynamic display effect, if operation 4 is received, the mobile phone responds to operation 4 by changing the transformation trajectory from transformation trajectory 1 to transformation trajectory 2, regenerating target image 2. At this point, the mobile phone switches from displaying target image 1 to displaying target image 2. Transformation trajectory 2 is different from transformation trajectory 1. In some embodiments, transformation trajectory 2 can be recorded as a second transformation trajectory, target image 2 can be recorded as a second target image, and operation 4 can be recorded as a change operation.

[0135] Furthermore, after the mobile phone saves target image 1 in response to operation 3, it can still support the user to change the transformation trajectory. After saving target image 1, if the mobile phone receives operation 5, it will respond to operation 5 and determine transformation trajectory 2 (transformation trajectory 2 is different from transformation trajectory 1). The mobile phone can then generate target image 2 corresponding to transformation trajectory 2. Operation 5 can be recorded as a change operation.

[0136] When the mobile phone changes the transformation trajectory of the image, it can re-perform the fusion process based on the source image to obtain the target image 2. Alternatively, the mobile phone can perform the fusion process based on the image features extracted from the source image to obtain the target image 2.

[0137] After the mobile phone generates target image 1 in response to a capture instruction, when the transformation trajectory is changed in response to operation 4, the mobile phone can directly perform the re-fusion process using the N source images or image features extracted from the N source images. In the embodiment where the mobile phone changes the transformation trajectory in response to operation 5 after saving target image 1, the mobile phone also needs to save the N source images or image features extracted from the N source images after generating target image 1.

[0138] In an implementation where a mobile phone stores N source images, the mobile phone can store the target image for the generated dynamic display effect in correspondence with the N source images. In some embodiments, the mobile phone can simultaneously store the N source images corresponding to the target image while the target image is stored on the mobile phone. This allows the user to change the transformation trajectory at any time to obtain target images with different dynamic display effects. Furthermore, because the source images are stored, the regenerated image based on them has better quality.

[0139] When users capture a target image with dynamic display effects, they typically confirm the desired dynamic display effects within a relatively short period of time. Within a period of time after capturing the target image, the user may need to change the target image's transformation trajectory. However, after this period, the user typically no longer changes the target image's transformation trajectory. Based on this, in other embodiments, the mobile phone can be configured to save the source image corresponding to the target image 1 with dynamic display effects for a preset period of time starting from the time the target image 1 with dynamic display effects is generated. For example, N source images corresponding to the target image 1 are saved for three days after the target image 1 is generated. If the current time exceeds the preset time, the mobile phone deletes the source image corresponding to the target image 1 and only saves the target image 1 with dynamic display effects. In this embodiment, the mobile phone can check at regular intervals whether the source images corresponding to the images with dynamic display effects in the gallery have exceeded the corresponding preset time; if so, the source images corresponding to the images are deleted. This solution allows the mobile phone to regenerate other target images with dynamic display effects based on the source image within a period of time after capturing the target image with dynamic display effects, while also avoiding the problem of source images occupying excessive storage space.

[0140] In the implementation method where the mobile phone stores image features extracted from N source images, when the mobile phone changes the transformation trajectory in response to operation 5, it directly processes the image features already extracted by the mobile phone, thereby improving processing efficiency. It will be appreciated that the specific implementation process for generating target image 2 described above can refer to the description of generating target image 1 in the above embodiment.

[0141] After the mobile phone generates a target image with a dynamic display effect, when displaying the target image to the user, it can automatically play the dynamic display effect, or display the image dynamic effect according to the user's operation, or the mobile phone can also display the image dynamic effect in combination with the position and posture of the mobile phone.

[0142] The mobile phone automatically plays the dynamic display effect of the target image, and specifically, the mobile phone automatically plays the corresponding dynamic display effect according to the transformation trajectory used when generating the target image. For example, the mobile phone automatically moves from left to right to dynamically display the photographed object from different perspectives.

[0143] In an embodiment in which a mobile phone displays a dynamic image effect according to a user operation, a static image may be displayed by default when the target image is displayed. In response to a user's gesture operation on the static image, the mobile phone starts to display the dynamic effect corresponding to the target image. The static image displayed by the mobile phone by default may be a frame of an image with a dynamic display effect. In some embodiments, the static image displayed by default may be a reference photo in the source image. In other embodiments, the static image displayed by default may also be a frame selected after the mobile phone recognizes the generated image. In some embodiments, the user's gesture operation on the image may specifically be: a long press operation, a double-click operation, a triple-click operation, or other gesture operations.

[0144] Taking the transformation trajectory of the image corresponding to the transformation trajectory of shaking the lens clockwise as an example, the mobile phone combines the current position and posture of the mobile phone to display the dynamic effect of the image, which can be specifically achieved in the following way: the mobile phone senses that the mobile phone is being shaken clockwise, and the mobile phone can display the photographed object at the corresponding angle in the image according to the shaking position and posture of the mobile phone. Taking the transformation trajectory of the image corresponding to the transformation trajectory of the perspective from left to right as an example, when the mobile phone detects that the user turns the phone to the left, it can display the perspective of the right (or left) side of the photographed object in the image; when it detects that the user turns the phone to the right, it can display the perspective of the left (or right) side of the photographed object in the image. It can be understood that the above-mentioned method of displaying the dynamic effect of the image in combination with the current position and posture of the mobile phone is only an example. In other embodiments, the mobile phone can also realize the image display method in other ways. In the technical solution proposed in this embodiment, the mobile phone combines the current position and posture of the mobile phone to display the dynamic effect of the image, which can increase the interactivity with the user when the image is displayed and enrich the image display method.

[0145] For the target image with dynamic display effects generated by the above method, the mobile phone also supports setting the target image as wallpaper, background or avatar (including contact avatars in the address book, avatars of personal application accounts, etc.). In some embodiments, the mobile phone can still display dynamic effects after setting the image as wallpaper, background or avatar. This can enrich the display methods of wallpapers, backgrounds and avatars, etc., and increase the interest of image display. Furthermore, after setting the target image as wallpaper, background or avatar, the wallpaper, background or avatar can also display dynamic effects in combination with the current position and posture of the mobile phone. Furthermore, in some embodiments, when setting the target image as an avatar or uploading it to the Internet, device attributes can be set for the target image. The device attributes can be used to limit the server of the corresponding application to display the dynamic display effects of the target image only to electronic devices belonging to a specific category. When electronic devices that do not fall within the scope of the device attribute definition view the avatar or target image, they see a static photo.

[0146] The mobile phone also supports converting the image with dynamic display effect generated by the above method into a video output. In some embodiments, the mobile phone receives a video output instruction and converts the image with dynamic display effect into a video.

[0147] As can be seen from the above embodiments, if a wider variety of source images can be captured, a more effective target image can be generated. Therefore, in some embodiments, after the mobile phone activates the preset camera function, it can issue prompts to guide the user to capture multiple types of source images, such as prompting the user to capture the subject from multiple perspectives. These prompts can be provided through user interface text prompts, voice prompts, and other means.

[0148] In some embodiments, the above image processing method can be performed on a mobile phone. In this way, when processing images, since the entire process is performed on the mobile phone itself, the processing time is short and the processing efficiency is high.

[0149] In other embodiments, the above-mentioned image processing method can also be performed jointly by the mobile phone and the server. For example, the mobile phone can upload a photo taken in response to a shooting instruction to the server. After receiving the photo, the server extracts image features (such as foreground and background, as well as foreground depth information and background depth information, etc.) from the photo, and then returns the extracted image features to the mobile phone. The mobile phone combines the image features extracted by the server and the image features extracted by the mobile phone itself to perform image fusion processing to obtain a target image with a dynamic display effect. The server can obtain a large number of image features. In the process of extracting image features from the image, the server has more experience data and can extract more and better image features. In this solution, when the mobile phone obtains the target image with a dynamic display effect through fusion processing, it combines the image features obtained by the server through image extraction, so as to obtain an image with a better effect.

[0150] In some embodiments, please refer to Figure 6B , the above-mentioned mobile phone can be divided into the following modules: a shooting processing module, a depth estimation module, a transformation trajectory determination module, a fusion processing module and an output module. Among them, the shooting processing module can be used to obtain N source images, which may include reference photos, empty scene photos, auxiliary photos and / or live photos. The depth estimation module can be used to extract the foreground and background of the N source images, and estimate the foreground depth information and background depth information. The transformation trajectory determination module can be used to determine the transformation trajectory to be adopted. The fusion processing module can be used to perform fusion processing on the N source images to obtain a target image. The output module can be used to save the target image, and use the target image as an avatar, wallpaper, etc.

[0151] Figure 7 A schematic diagram of the hardware structure of an electronic device in some embodiments is shown.

[0152] like Figure 7 FIG2 is a schematic diagram of the structure of an electronic device 500 provided in an embodiment of the present application. The electronic device 500 may include a processor 510, an external memory interface 520, an internal memory 521, a universal serial bus (USB) interface 530, a charging management module 540, a power management module 541, a battery 542, an antenna 1, an antenna 2, a mobile communication module 550, a wireless communication module 560, an audio module 570, a sensor module 580, a button 590, a motor 591, a camera 592, a display 593, and a subscriber identification module (SIM) card interface 594. The sensor module 580 may include a pressure sensor 580A, a touch sensor 580B, and the like.

[0153] It should be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the electronic device 500. In other embodiments of the present application, the electronic device 500 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0154] The processor 510 may include one or more processing units, for example, the processor 510 may include an application processor (AP), a modem processor, a graphics processor, an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU). Among them, different processing units can be independent devices or integrated into one or more processors. For example, the processor 510 is used to execute the image processing method in the embodiment of the present application.

[0155] The controller may be the nerve center and command center of the electronic device 500. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0156] Processor 510 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 510 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 510. If processor 510 needs to use the same instruction or data again, it can directly access it from the memory. This avoids duplicate accesses, reduces processor 510 latency, and thus improves system efficiency.

[0157] The USB interface 530 is an interface that complies with USB standards, and may be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 530 may be used to connect a charger to charge the electronic device 500, and may also be used to transfer data between the electronic device 500 and peripheral devices.

[0158] The external memory interface 520 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 500. The external memory card communicates with the processor 510 via the external memory interface 520 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.

[0159] The internal memory 521 can be used to store computer executable program code, which includes instructions. The processor 510 executes various functional applications and data processing of the electronic device 500 by running the instructions stored in the internal memory 521. The internal memory 521 can include a program storage area and a data storage area. Among them, the program storage area can store an operating system and at least one application required for a function (such as a sound playback function, an image playback function, etc.).

[0160] In addition, the internal memory 521 may include a high-speed random access memory and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0161] The charging management module 540 is configured to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 540 may receive charging input from the wired charger via the USB interface 530.

[0162] The power management module 541 is used to connect the battery 542, the charging management module 540, and the processor 510. The power management module 541 receives input from the battery 542 and / or the charging management module 540 to provide power to the processor 510, the internal memory 521, the external memory, the display 593, the camera 592, and the wireless communication module 560.

[0163] In some other embodiments, the power management module 541 may also be provided in the processor 510. In some other embodiments, the power management module 541 and the charging management module 540 may also be provided in the same device.

[0164] The wireless communication function of the electronic device 500 can be implemented through the antenna 1, the antenna 2, the mobile communication module 550, the wireless communication module 560, the modem processor and the baseband processor.

[0165] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 500 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.

[0166] The mobile communication module 550 can provide wireless communication solutions, including 2G / 3G / 4G / 5G, for the electronic device 500. The mobile communication module 550 may include at least one filter, a switch, a power amplifier, a low-noise amplifier (LNA), and the like. The mobile communication module 550 can receive electromagnetic waves from the antenna 1, filter and amplify the received electromagnetic waves, and transmit them to the modem processor for demodulation. The mobile communication module 550 can also amplify the signals modulated by the modem processor and convert them into electromagnetic waves for radiation via the antenna 1.

[0167] The wireless communication module 560 can provide wireless communication solutions including wireless local area networks (WLAN) (such as Wi-Fi networks), Bluetooth, global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (IR), etc. applied to the electronic device 500. The wireless communication module 560 can be one or more devices integrating at least one communication processing module. The wireless communication module 560 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 510. The wireless communication module 560 can also receive the signal to be sent from the processor 510, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0168] In some embodiments, antenna 1 of electronic device 500 is coupled to mobile communication module 550 , and antenna 2 is coupled to wireless communication module 560 , so that electronic device 500 can communicate with the network and other devices through wireless communication technology.

[0169] The electronic device 500 can implement audio functions such as music playback and recording through the audio module 570 and the application processor.

[0170] The audio module 570 is used to convert digital audio signals into analog audio signals for output, and is also used to convert analog audio input into digital audio signals. The audio module 570 can also be used to encode and decode audio signals. In some embodiments, the audio module 570 can be provided in the processor 510, or some functional modules of the audio module 570 can be provided in the processor 510.

[0171] The pressure sensor 580A is used to sense pressure signals and convert them into electrical signals. In some embodiments, the pressure sensor 580A can be provided on the display screen 593. There are many types of pressure sensors 580A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. A capacitive pressure sensor can be a device comprising at least two parallel plates having a conductive material. When a force acts on the pressure sensor 580A, the capacitance between the electrodes changes. The electronic device 500 determines the intensity of the pressure based on the change in capacitance. When a touch operation is applied to the display screen 593, the electronic device 500 detects the intensity of the touch operation based on the pressure sensor 580A. The electronic device 500 can also calculate the position of the touch based on the detection signal of the pressure sensor 580A.

[0172] Touch sensor 580B, also known as a "touch panel," can be disposed on display screen 593. Touch sensor 580B and display screen 593 form a touch screen, also known as a "touch screen." Touch sensor 580B is used to detect touch operations applied thereto or in the vicinity thereof. The touch sensor can transmit the detected touch operations to an application processor to determine the type of touch event. Visual output related to the touch operations can be provided via display screen 593. In other embodiments, touch sensor 580B can also be disposed on the surface of electronic device 500, at a location different from that of display screen 593.

[0173] Keys 590 include a power button, a volume button, and the like. Keys 590 may be mechanical keys or touch-sensitive keys. Electronic device 500 may receive key inputs and generate key signal inputs related to user settings and function control of electronic device 500.

[0174] Motor 591 can generate vibration prompts. Motor 591 can be used for incoming call vibration prompts and can also be used for touch vibration feedback.

[0175] The camera 592 is used to capture still images or videos. In some embodiments, the electronic device 500 may include 1 or N cameras 592, where N is a positive integer greater than 1.

[0176] Electronic device 500 implements display functionality through a GPU, display screen 593, and an application processor. The GPU is a microprocessor for image processing that connects display screen 593 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 510 may include one or more GPUs that execute program instructions to generate or modify display information.

[0177] The display screen 593 is used to display images, videos, etc. In some embodiments, the electronic device 500 may include 1 or N display screens 593 , where N is a positive integer greater than 1.

[0178] SIM card interface 594 is used to connect a SIM card. A SIM card can be connected to or disconnected from electronic device 500 by inserting or removing it from SIM card interface 594. Electronic device 500 may support one or N SIM card interfaces, where N is a positive integer greater than one.

[0179] The image processing methods in the above embodiments can all be implemented in the electronic device 500 having the above hardware structure.

[0180] Some other embodiments of the present application provide a computer device (such as a mobile phone). The computer device may include: a display screen, a memory, one or more processors, and a computer program stored in the memory. The display screen and the memory are respectively coupled to the processor. When the processor executes the computer program, the computer device can perform the various functions or steps performed by the mobile phone in the above method embodiment. The structure of the computer device can refer to Figure 7 The structure of the electronic device 500 is shown.

[0181] The present application also provides a chip system. Figure 8 As shown, the chip system 600 includes at least one processor 601 and at least one interface circuit 602. The processor 601 and the interface circuit 602 can be interconnected via lines. For example, the interface circuit 602 can be used to receive signals from other devices (such as a computer memory). For another example, the interface circuit 602 can be used to send signals to other devices (such as the processor 601). Exemplarily, the interface circuit 602 can read instructions stored in the memory and send the instructions to the processor 601. When the instruction is executed by the processor 601, the computer device can execute the various steps in the above embodiments. Of course, the chip system can also include other discrete devices, which is not specifically limited in the embodiments of the present application.

[0182] An embodiment of the present application also provides a computer-readable storage medium, which includes computer instructions. When the computer instructions are executed on the above-mentioned computer device (such as a mobile phone), the computer device executes the various functions or steps executed by the mobile phone in the above-mentioned method embodiment.

[0183] The present application also provides a computer program product that, when executed on a computer device, enables the computer device to execute the functions or steps executed by the mobile phone in the above method embodiment.

[0184] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0185] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of modules or units is only a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0186] Units described as separate components may or may not be physically separate, and components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0187] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0188] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for enabling a device (which can be a single-chip microcomputer, chip, etc.) or a processor to execute all or part of the steps of the method of each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0189] The above content is only a specific embodiment of this application, but the scope of protection of this application is not limited to this. Any changes or replacements within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. An image processing method, characterized in that: The method is applied to an electronic device including a camera, and the method includes: In response to a capture instruction, obtain N source images of the captured object captured by the camera, wherein N is a positive integer greater than or equal to 2; the N source images include a reference photo and at least one of the following: an empty photo, a plurality of auxiliary photos, and a live photo; Determining a first transformation trajectory corresponding to the N source images; According to the first transformation trajectory, the N source images are fused to obtain a first target image; the first target image can dynamically display the photographed object at different viewing angles and / or different zoom levels according to the first transformation trajectory.

2. The method according to claim 1, characterized in that When the first target image dynamically displays the photographed object according to the first transformation trajectory, the viewing angle is sequentially changed in one direction; and / or, When the first target image dynamically displays the photographed object according to the first transformation trajectory, the zoom degree is transformed in sequence according to the size.

3. The method according to claim 1 or 2, characterized in that The N source images include a plurality of auxiliary photos, and the photographed objects in the plurality of auxiliary photos correspond to different perspectives; and fusing the N source images according to the first transformation trajectory to obtain a first target image, including: The N source images are fused according to the first transformation trajectory to obtain the first target image; the first target image can dynamically display the photographed object at different viewing angles according to the first transformation trajectory.

4. The method according to claim 1 or 2, characterized in that The N source images include multiple auxiliary photos, and the photographed objects in the multiple auxiliary photos correspond to the same perspective; The step of performing fusion processing on the N source images according to the first transformation trajectory to obtain a first target image includes: generating a plurality of intermediate images of the photographed object at different perspectives according to the first transformation trajectory and the N source images; According to the first transformation trajectory, the multiple intermediate images are fused to obtain the first target image; the first target image can dynamically display the photographed object at different perspectives according to the first transformation trajectory.

5. The method according to any one of claims 1 to 4, characterized in that The photographed object includes a foreground and a background; the first transformation trajectory includes a foreground transformation trajectory and a background transformation trajectory; The step of fusing the N source images according to the first transformation trajectory to obtain a first target image includes: performing fusion processing on the foreground in the N source images according to the foreground transformation trajectory to obtain the first target image; the background in the first target image remains stationary; or, performing fusion processing on the backgrounds in the N source images according to the background transformation trajectory to obtain the first target image; the foreground in the first target image remains stationary; or, The foregrounds in the N source images are fused according to the foreground transformation trajectory, and the backgrounds in the N source images are fused according to the background transformation trajectory to obtain the first target image.

6. The method according to any one of claims 1 to 5, characterized in that Before performing fusion processing on the N source images according to the first transformation trajectory to obtain a first target image, the method further includes: Extracting depth information of the photographed object from the N source images; The step of fusing the N source images according to the first transformation trajectory to obtain a first target image includes: The N source images are fused according to the depth information and the first transformation trajectory to obtain the first target image.

7. The method according to any one of claims 1 to 6, characterized in that The determining of a first transformation trajectory corresponding to the N source images includes: performing image recognition on one or more source images from the N source images to determine attribute information of the N source images, wherein the attribute information includes at least one of the following: a target scene corresponding to the N source images, a position of a main body of the photographed subject in the reference photograph, and a composition of the reference photograph; searching for a transformation trajectory that matches the attribute information as the first transformation trajectory; or, A default transformation trajectory is obtained as the first transformation trajectory.

8. The method according to any one of claims 1 to 7, characterized in that After performing fusion processing on the N source images according to the first transformation trajectory to obtain a first target image, the method further includes: Saving the N source images; Upon receiving the change operation, determining a second transformation trajectory; the second transformation trajectory is different from the first transformation trajectory; According to the second transformation trajectory, the N source images are re-fused to obtain a second target image; the second target image can dynamically display the photographed object at different viewing angles and / or different zoom levels according to the second transformation trajectory.

9. The method according to any one of claims 1 to 7, characterized in that The method further comprises: Extracting and saving image features from the N source images; After performing fusion processing on the N source images according to the first transformation trajectory to obtain a first target image, the method further includes: Upon receiving the change operation, determining a second transformation trajectory; the second transformation trajectory is different from the first transformation trajectory; Based on the second transformation trajectory and the image features, a second target image is regenerated; the second target image can dynamically display the photographed object at different viewing angles and / or different zoom levels according to the second transformation trajectory.

10. The method according to any one of claims 1 to 7, characterized in that After performing fusion processing on the N source images according to the first transformation trajectory to obtain a first target image, the method further includes: displaying the first target image; In response to receiving the change operation, determining a second transformation trajectory, the second transformation trajectory being different from the first transformation trajectory; re-fusing the N source images according to the second transformation trajectory to obtain a second target image; the second target image can dynamically display the photographed object at different viewing angles and / or different zoom levels according to the second transformation trajectory; Switch from displaying the first target image to displaying the second target image.

11. An electronic device, characterized in that: include: A camera, a processor, a memory, and a computer program stored in the memory; the camera is used to capture images; The camera and the memory are respectively coupled to the processor; When the electronic device is running, the processor executes the computer program to implement the method according to any one of claims 1 to 10.

12. A computer-readable storage medium, characterized in that A computer program is stored, and when the computer program is executed by a processor of a computer device, the method according to any one of claims 1 to 10 is implemented.

13. A computer program product, characterized in that The invention comprises a computer program, which, when executed by a processor, implements the method according to any one of claims 1 to 10.

Images