Image expansion method and electronic equipment

Abstract

The invention provides an image expansion method and electronic equipment, and the method mainly comprises the steps: removing a watermark in an image before the image is expanded, and carrying out the image expansion on the image after the watermark removal on the basis, thereby avoiding the problems that only a watermark region is expanded, the watermark is blurred, the watermark position is abnormal and the like in the image expansion process, and improving the image expansion efficiency. And after image expansion is completed, adding the watermark into the expanded image again to obtain a final image. According to the scheme, various abnormal problems possibly occurring when the image containing the watermark is subjected to the image expansion operation can be fundamentally solved, and the image expansion effect of the image containing the watermark is improved.

Description

Technical Field

[0001] This application relates to the field of image processing technology, and in particular to an image expansion method and electronic device. Background Technology

[0002] Artificial intelligence (AI) image augmentation is an operation that uses artificial intelligence algorithms to expand and optimize images. AI image augmentation can deeply analyze factors such as the subject, background, color, and lighting in a photograph, intelligently generating new content consistent with the style of the original image, thus seamlessly expanding the image's background and enhancing its visual effect.

[0003] Currently, the process of enlarging watermarked images presents problems such as only expanding the watermark area and abnormal watermark display. Therefore, improving the enlargement effect of watermarked images is a technical problem that needs to be solved. Summary of the Invention

[0004] This application provides an image enlargement method and electronic device that can improve the image enlargement effect of watermarked images.

[0005] In a first aspect, embodiments of this application provide an image enlargement method, which is applied to an electronic device, comprising: in response to an instruction to enlarge a first image, acquiring position information and element information of a first watermark in the first image; removing the first watermark at a first position in the first image according to the element information of the first watermark to obtain a second image, wherein the first position is the position indicated by the position information of the first watermark; enlarging the second image to obtain a third image; and supplementing a second watermark at a second position in the third image according to the element information of the first watermark to obtain a fourth image.

[0006] In this technical solution, the watermark in the image is removed before image enlargement. Then, the watermark-free image is enlarged, avoiding problems such as only the watermark area being expanded, watermark blurring, or abnormal watermark position during the enlargement process. After enlargement, the watermark is re-added to the enlarged image to obtain the final image. This solution fundamentally solves various abnormal problems that may occur when enlarging watermarked images, improving the enlargement effect.

[0007] It should be noted that this application is only applicable to image enlargement processing of images carrying watermarks. If an image enlargement instruction is received for a certain image and it is determined that the image does not carry a watermark, the acquisition of the corresponding location information and element information of the image and subsequent steps will not be performed.

[0008] Optionally, in one possible implementation of the first aspect, the method further includes: in response to a user's shooting operation, acquiring an original image and saving the watermark information of the original image, the watermark information of the original image including the position information and element information of a first watermark; adding a first watermark at a first position in the original image according to the element information of the first watermark to obtain a first image. Specifically, the electronic device first captures a watermark-free original image using a camera, then generates corresponding watermark information for the original image. The watermark information may include position information and element information, and may also include information such as device model, shooting time, shooting location, and shooting parameters. Finally, the original image and the watermark information are combined to generate a watermarked first image.

[0009] Optionally, in another possible implementation of the first aspect, the method further includes: cropping the original image to obtain and save a first patch, wherein the position of the first patch in the original image is the first position indicated by the position information of the first watermark, and the first patch does not include the first watermark; removing the first watermark at the first position in the first image based on the element information of the first watermark to obtain a second image includes: covering a second patch in the first image with the first patch to obtain a second image, wherein the second patch includes the first watermark, and the second patch has the same size as the first patch. Since the watermark in the first image needs to be removed before expanding the first image, and the watermark removal function usually requires the use of a watermark position background image (an example of the first patch), this application needs to save the watermark position background image corresponding to the first image at the same time as the first image is generated, and then cover the corresponding position of the first image (i.e., the second patch) with the watermark position background image to achieve image watermark removal.

[0010] Optionally, in another possible implementation of the first aspect, the above-mentioned expansion of the second image to obtain the third image includes: expanding the second image along N preset directions to obtain the third image, wherein the size of the third image in the nth preset direction is greater than the size of the second image in the nth preset direction, n ≤ N and N and n are positive integers. The expansion direction may include top, bottom, left, right and / or diagonal directions, etc., and this application embodiment does not limit this.

[0011] Optionally, in another possible implementation of the first aspect, the above-mentioned method of supplementing the second watermark at the second position in the third image based on the element information of the first watermark to obtain the fourth image includes: determining the target size of the second watermark based on the size of the third image; determining the second position based on the size of the third image and the position information of the first watermark; and supplementing the second watermark at the second position in the third image according to the target size to obtain the fourth image. Specifically, after image enlargement, watermark supplementation is required. The watermark supplementation process first requires enlarging the size of each watermark to fit the enlarged size of the third image, then determining the position of each watermark in the third image, and finally, based on the position information, supplementing the enlarged watermarks into the third image to obtain the fourth image, thus completing the watermark supplementation process.

[0012] Optionally, in another possible implementation of the first aspect, the above-mentioned method of supplementing the second watermark at the second position in the third image according to the target size to obtain the fourth image includes: receiving watermark resources of the second watermark of the target size from a cloud device; and supplementing the second watermark at the second position in the third image according to the watermark resources of the second watermark of the target size to obtain the fourth image. Since watermarks of fixed sizes are prone to distortion when their size is changed, this application selects cloud watermark resources of appropriate size from the cloud device according to the enlarged size of the watermark and uses them for supplementing the watermark in the third image.

[0013] Optionally, in another possible implementation of the first aspect, the method further includes: during the generation of the third image, cropping the third image at a second position to obtain a third image patch and saving it; the third image patch is used to expand the fourth image. Wherein, after obtaining the third image, a watermark location background image (an example of the third image patch) is saved, so that if further expansion is needed after obtaining the fourth image, the newly saved watermark location background image can be used for the corresponding expansion processing.

[0014] Optionally, in another possible implementation of the first aspect, the size of the second watermark in the fourth image is greater than or equal to the size of the first watermark in the first image. Generally, after image enlargement, the image size increases, and the watermark also increases accordingly to fit the size of the enlarged image. However, in one possible implementation scenario, taking the watermark at the bottom of the image as an example, assuming the image enlargement is only upward, since the size of the left and right sides of the image does not change, the size of the new watermark can be the same as the size of the old watermark.

[0015] Optionally, in another possible implementation of the first aspect, the third image includes a first region and a second region, wherein the first region is the region corresponding to the second image, and the second region is a new image region added through image expansion.

[0016] Secondly, embodiments of this application provide a mapping expansion apparatus, which includes a unit composed of software and / or hardware for performing the mapping expansion method of the first aspect.

[0017] Thirdly, embodiments of this application provide an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the electronic device is able to implement any of the methods described in the first aspect above.

[0018] Fourthly, embodiments of this application provide a chip system applied to an electronic device. The chip system includes one or more processors, which are used to invoke computer instructions to enable the electronic device to execute any of the methods described in the first aspect.

[0019] Optionally, the chip system may also include a memory electrically connected to the processor.

[0020] Optionally, the chip system may also include a communication interface.

[0021] Fifthly, embodiments of this application provide a computer-readable storage medium including instructions that, when executed on an electronic device, enable the electronic device to perform any of the methods described in the first aspect.

[0022] In a sixth aspect, embodiments of this application provide a computer program product, which includes a computer program. When the computer program is executed by an electronic device, the electronic device is able to implement any of the methods described in the first aspect above. Attached Figure Description

[0023] To more clearly illustrate the technical solutions in the embodiments of this application, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0024] Figure 1 It is a flowchart illustrating a map expansion process;

[0025] Figure 2 It is a before-and-after comparison image of an image with a bar watermark;

[0026] Figure 3 It is a before-and-after comparison image of a bordered watermarked image;

[0027] Figure 4 It is a before-and-after comparison image of an image with an embedded watermark.

[0028] Figure 5 This is an example diagram illustrating the execution process of a map expansion method provided in an embodiment of this application;

[0029] Figure 6 This is a schematic diagram of the preprocessing flow in the process of acquiring a watermarked image provided in an embodiment of this application;

[0030] Figure 7 This is an example image of image cropping provided in an embodiment of this application;

[0031] Figure 8 This is a schematic diagram of the underlying implementation of a preprocessing procedure provided in an embodiment of this application;

[0032] Figure 9 This is a data interaction diagram of a preprocessing procedure provided in an embodiment of this application;

[0033] Figure 10 This is a data interaction diagram of a map expansion process provided in an embodiment of this application;

[0034] Figure 11 This is a data interaction diagram illustrating a watermark supplementation process provided in an embodiment of this application;

[0035] Figure 12 This is a schematic diagram of the processing flow of an image expansion method provided in an embodiment of this application;

[0036] Figure 13 This is a flowchart illustrating a mapping method provided in an embodiment of this application;

[0037] Figure 14 This is a schematic diagram of the structure of a mapping device provided in an embodiment of this application;

[0038] Figure 15 This is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0039] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the embodiments of this application will be further described in detail below with reference to the accompanying drawings.

[0040] Artificial intelligence (AI) image augmentation is an operation that uses artificial intelligence algorithms to expand and optimize images. AI image augmentation can deeply analyze factors such as the subject, background, color, and lighting in a photograph, intelligently generating new content consistent with the style of the original image. This seamlessly expands the image's background, enhancing its visual effect. Through image augmentation, the image may expand in at least one direction, determined by the AI ​​algorithm. Within the expanded area, the AI ​​algorithm may combine image content to generate an intelligent background.

[0041] Figure 1 A flowchart illustrating a map expansion process is shown. For example... Figure 1 As shown, the image is uploaded to the image expansion service through the image expansion interface. After receiving the image, the image expansion service does not perform any special processing on the image and directly expands it.

[0042] A watermark is a mark added to an image, document, or video, typically used to indicate copyright, ownership, or provide additional information. Watermarks come in various styles, such as embedded watermarks, horizontal watermarks, and framed watermarks. Watermark information includes location information and element information. Location information may include the starting position, width, and height. Different watermark styles contain different watermark elements; common watermark elements include device model, shooting time, shooting location, shooting parameters (focal length, ISO, etc.), special graphics, and special stamps. The specific watermark elements included may differ between different watermark styles.

[0043] Currently, during the image enlargement process for watermarked images, issues arise such as only expanding the watermark area and abnormal watermark display. The following explains some potential problems that may occur when enlarging watermarked images for different watermark types.

[0044] Figure 2 This image shows a before-and-after comparison of an image with a bar watermark before and after enlargement. The image to be processed is as follows: Figure 2 As shown in (a), the gray area at the bottom is the watermark area for the bar watermark. This bar watermark contains three watermark elements: device model, shooting parameters, and shooting time. Figure 2 The image obtained by expanding the image shown in (a) is as follows: Figure 2 As shown in (b), the dashed lines are used to indicate the positions of the top, bottom, left, and right edges of the image to be processed. It can be clearly seen that only the bottom watermark area is expanded, and the content of the image itself is not expanded, resulting in a poor image expansion effect.

[0045] For example, Figure 2Shooting parameters can include focal length, ISO sensitivity, etc. For example, 57mm and ISO 1000 indicate that the focal length of the electronic device's camera is 57mm and the ISO sensitivity is 1000.

[0046] Figure 3 This image shows a before-and-after comparison of an image with a bordered watermark. The image to be processed is as follows: Figure 3 As shown in (a), the gray area around the image to be processed is the watermark area of ​​the border-type watermark. Figure 3 The image obtained by expanding the image shown in (a) is as follows: Figure 3 As shown in (b), the dashed lines are used to indicate the edge positions of the image to be processed. It can be clearly seen that only the watermark area corresponding to the border watermark is expanded, and the content of the image itself is not expanded, resulting in a poor image expansion effect.

[0047] Figure 4 This image shows a before-and-after comparison of an image with an embedded watermark. The image to be processed is as follows: Figure 3 As shown in (a), the embedded watermark includes three watermark elements: device model, shooting time, and shooting location, all displayed at the bottom of the image to be processed. Figure 4 The image obtained by expanding the image shown in (a) is as follows: Figure 4 As shown in (b), the dashed lines are used to indicate the edge position of the image to be processed. It can be clearly seen that the watermark font has become blurry and there is an abnormal watermark height. After the image is enlarged, the watermark should also be displayed at the bottom of the image.

[0048] It should be understood that, in combination Figures 2 to 4 As can be seen, image expansion is not a simple stretching and enlarging of the image to be processed, but rather a further expansion based on the original image to generate new image content.

[0049] In view of this, this application provides an image enlargement method, which mainly involves removing the watermark from the image before enlargement, and then enlarging the watermark-free image. This avoids problems such as only the watermark area being expanded, watermark blurring, or abnormal watermark position during the enlargement process. After enlargement, the watermark is re-added to the enlarged image to obtain the final image. This solution fundamentally solves various abnormal problems that may occur when enlarging watermarked images, improving the image enlargement effect.

[0050] Reference Figure 5 The diagram illustrates the execution process of a graph expansion method provided in an embodiment of this application. Figure 5 Taking a bar watermark image as an example, the processing procedure for other watermark types is similar and will not be elaborated further. The image to be processed is as follows: Figure 5As shown in (a), the gray area at the bottom is the watermark area of ​​the bar watermark, which contains three watermark elements: device model, shooting parameters, and shooting time. For ease of understanding, the first image will be used to represent it in the following images. Figure 5 The image to be processed is shown in (a). First, upon receiving an image enlargement instruction for the first image, the watermark information of the watermark in the first image is obtained. Then, the watermark in the first image is removed based on the watermark information to obtain the second image as shown. Figure 5 As shown in (b). Next, the second image is enlarged to obtain the third image as shown. Figure 5 As shown in (c). Finally, a watermark is added to the third image to obtain the fourth image as shown. Figure 5 As shown in (d), the position of the watermark in the fourth image corresponds to the position of the watermark in the first image, both being located at the bottom of the image.

[0051] Figure 6 This diagram illustrates a preprocessing step in the watermarked image acquisition process according to an embodiment of this application. The following section... Figure 6 The steps shown will be explained.

[0052] Step 601: Obtain the original image by taking a picture.

[0053] Among them, electronic devices can capture watermark-free original images using a camera.

[0054] Step 602: Generate watermark information.

[0055] The watermark information may include watermark elements such as device model, shooting time, shooting location, shooting parameters, special graphics and / or special stamps, as well as watermark location information. The specific details are determined based on the actual application scenario and requirements, and this application does not impose any restrictions on this.

[0056] Step 603: Combine the original image and watermark information to generate a watermarked image.

[0057] This involves adding each watermark to the original image according to its corresponding position information, thereby generating a watermarked image. Optionally, the watermarked image can be, for example,... Figure 5 The first image shown in (a) is shown in the middle.

[0058] Steps 601-603 above describe a common watermark image generation process. Since the watermark needs to be removed from the image before subsequent image enlargement processing, for example... Figure 5 The process in (a)-(b) is described. However, achieving watermark removal typically requires utilizing a background image of the watermark location. Therefore, in this embodiment, the following steps are also performed during the acquisition of the watermarked image.

[0059] Step 604: Extract the original image based on the watermark location information to obtain the background image of the watermark location corresponding to the watermark image.

[0060] The background image corresponding to the watermark location of the watermarked image is used for subsequent watermark removal from the watermarked image.

[0061] For example, Figure 7 This illustration shows an example of image cropping according to an embodiment of this application. The original image to be cropped is as follows: Figure 7 As shown in (a), the watermarked image is generated by combining the original image with the bottom bar watermark. Based on this, the original image is cropped according to the watermark position information corresponding to the bottom bar watermark (i.e., the bottom area of ​​the original image), resulting in the watermark position background image as shown below. Figure 7 As shown in (b).

[0062] Step 605: Encode the background image of the watermark location.

[0063] Image coding, also known as image compression, refers to the technique of representing an image or the information contained in an image with a smaller number of bits while meeting certain quality requirements (signal-to-noise ratio requirements or subjective evaluation scores). Image coding and storage can optimize storage and transmission efficiency while ensuring image quality and compatibility.

[0064] Step 606: Read the image supplementary information of the watermarked image.

[0065] In one embodiment, the watermark information of a watermarked image includes image supplementary information, which may be stored in the form of an image file directory (IFD) data structure. An IFD is a structure used to store metadata for image files, commonly found in image files of the tag image file format (TIFF) and the exchangeable image file format (ExIF). An IFD contains multiple tags, each storing specific image information, such as 0th IFD, ExIF IFD, Global Positioning System (GPS) IFD, Interop IFD, 1st IFD, etc. The 0th IFD contains the basic information of the image, including some common image attributes such as image width, height, and color space. The ExIF IFD contains metadata related to camera settings and shooting conditions, such as shutter speed, aperture, ISO, and shooting time; this information is usually automatically recorded by the camera during shooting. The GPS IFD contains geographic location information related to the image, such as longitude, latitude, and altitude; this information is typically available in images taken on GPS-enabled electronic devices. Interop IFDs are used to store interoperability information related to other formats (such as TIFF), which is typically used to ensure compatibility between different devices and software. The 1st IFD is the first additional information section of an image file, usually used to store additional image data.

[0066] Step 607: Add the encoding result of the watermark location background image to the image supplementary information.

[0067] In one embodiment, the encoding result of the watermark location background image can be stored within the Exif file of the image attachment information. It should be understood that the encoding result of the watermark location background image can also be stored in other locations within the image attachment information, depending on the specific application scenario and requirements. Optionally, the encoding result of the watermark location background image can be written after the 0x9001 tag in the Exif file; the area after the 0x9001 tag is typically used to store some additional information.

[0068] Step 608: Save the encoding results of the watermarked image and the corresponding background image at the watermark location.

[0069] The preprocessing flow in the watermarked image acquisition process provided in the above embodiments of this application mainly takes into account that before expanding the watermarked image, it is necessary to remove the watermark from the watermarked image. The function of removing watermarks usually requires the use of the watermark position background image. Therefore, this application needs to save the watermark position background image corresponding to the first image at the same time as the first image is generated, in order to prepare for the subsequent watermark removal process.

[0070] To better understand the preprocessing process provided in the embodiments of this application, the underlying implementation process of the above preprocessing process is described below.

[0071] For example, Figure 8 This is a schematic diagram illustrating the underlying implementation of a preprocessing procedure provided in this application embodiment. The hardware abstraction layer (HAL) is an interface layer located between the operating system kernel layer and the hardware circuitry of an electronic device. Its purpose is to abstract the hardware. It hides the hardware interface details of a specific platform, providing the operating system with a virtual hardware platform, making it hardware-independent and portable across multiple platforms. From a software and hardware testing perspective, software and hardware testing can be performed separately based on the HAL, enabling parallel processing of software and hardware tests. The application layer can include a series of application packages, such as a gallery, and may also include applications such as calendar, map, WLAN, music, SMS, call, navigation, Bluetooth, and video.

[0072] like Figure 8As shown, the watermarking module in the HAL layer first utilizes the acquired raw image data in YUV format, Extensible Markup Language (XML) data, a watermark location background image, and at least one watermark. The YUV format image includes a luminance component Y and two chrominance components U and V. The luminance component Y represents brightness, i.e., grayscale value, while the chrominance components U and V represent image color and saturation. The XML data is metadata related to the raw image, such as shooting information and shooting parameters. Then, the above data is encoded and saved in the HAL layer to generate a fused JPG file. This JPG file includes the XML data, a portable network graphics (PNG) format watermark, and a JPG (Joint Photographic Experts Group) format watermark location background image. Finally, the fused JPG file is passed to the application layer's image library, where it is saved and all its contained information is accessible. In the gallery, images can respond to user actions, thereby enabling image editing functions, such as AI image enlargement. In other words, users can use the gallery, album, and other upper-level application functions as entry points to select the image to be processed for enlargement, which can correct problems such as poor composition of the original image and subject being too close to the edge.

[0073] In the above Figure 8 Based on the underlying implementation diagram shown, Figure 9 This illustration shows a data interaction diagram of a preprocessing procedure provided in an embodiment of this application, including the following steps: Step 901, capturing raw image data in YUV format. Step 902, obtaining watermark element information and watermark location background image, recording and writing them into the Exif file of the raw image. Step 903, encoding to obtain a fused JPG file, adding a watermark, and finally outputting the watermarked image.

[0074] The method for obtaining watermarked images has been detailed above. The following section describes the process of expanding watermarked images. First, before expanding, the watermark needs to be removed to obtain a watermark-free image (e.g., the second image). Figure 5 The process from (a) to (b) involves resizing the image after removing the watermark. This resizing process yields a new image (e.g., the third image) which is then output. Figure 5 The process of (b)-(c).

[0075] For details, please refer to Figure 10 This diagram illustrates a data interaction schematic of a map expansion process provided in an embodiment of this application. The following section discusses... Figure 10 The steps shown will be explained.

[0076] Step 1001: Obtain the watermark information corresponding to the watermarked image to obtain the background image of the watermark location.

[0077] In one embodiment, the watermark information can be generated and saved in advance through the aforementioned steps 601-607. The background image of the watermark location can be obtained by reading the image extension information of the watermarked image.

[0078] It should be noted that this application is only applicable to image enlargement processing of images carrying watermarks. If an image enlargement instruction is received for a certain image and it is determined that the image does not carry a watermark, then step 1001 and subsequent steps will not be executed.

[0079] Step 1002: Use the background image corresponding to the watermark position of the watermarked image to cover the watermark in the watermarked image to obtain a watermark-free image.

[0080] The watermark location background image is positioned within the watermarked image, corresponding to the watermark location information. In other words, the pre-saved watermark information includes a watermark location background image, which is then directly overlaid on the watermark location in the watermarked image to remove the watermark.

[0081] Step 1003: Expand the watermark-free image, output and save the expanded image of the new size (without watermark).

[0082] In one embodiment, the watermark-removed image is input into an image expansion interface to generate an expansion region. The expansion direction can be upward, downward, left, right, and / or diagonal, etc., and this embodiment does not limit this. The size of the expansion region is calculated by an AI algorithm based on the size of the watermark-removed image. The content filled in the expansion region is generated by an AI algorithm based on the content of the original image. That is, the watermark-removed image can be expanded along N preset directions to obtain a new size image, wherein the size of the new size image in the nth preset direction is greater than the size of the watermark-removed image in the nth preset direction, 1≤n≤N, and N and n are integers.

[0083] In one possible implementation, a watermark needs to be added after image enlargement, for example... Figure 5 The process from (c) to (d) involves watermark addition. First, the size of each watermark needs to be enlarged to fit the new image size. Next, the position of each watermark within the new image is determined. Finally, based on the position information, the enlarged watermarks are added to the new image to obtain the final image. For example... Figure 5The fourth image shown in (d) completes the watermarking process. In other words, the target size of each watermark is first determined based on the size of the new image; then, the target position of each watermark is determined based on the size of the new image and the watermark's position information; finally, new watermarks of corresponding target sizes are added to each target position in the new image according to the target size, resulting in the final image.

[0084] In one embodiment, since fixed-size watermarks are prone to distortion when their size is changed, this embodiment selects a suitable-sized cloud watermark resource from a cloud device based on the enlarged size of the watermark and uses it for supplementary watermark processing. That is, the watermark resource of the target size can be received from the cloud device first; based on the target-size watermark resource, a new watermark is added at a second position in the new-size image to obtain the final image. Optionally, the cloud device can be a cloud watermark resource library.

[0085] In one embodiment, after obtaining a new-sized image without a watermark, a background image of the watermark location corresponding to the new-sized image can be saved. This way, if there is a need to expand the image again after adding the watermark to the new-sized image, the newly saved background image of the watermark location can be used to repeat the above expansion process. In other words, during the generation of the new-sized image, the image can be cropped at the location where the watermark needs to be added, and the background image of the watermark location can be obtained and saved. This background image of the watermark location is used to expand the expanded image containing the watermark again.

[0086] To make it easier to understand, the following will be combined with... Figure 11 This diagram illustrates a detailed data interaction process for watermark replacement. Figure 11 It includes the following steps.

[0087] Step 1101: Input a new size image, and read the watermark information and the dimensions of the new size image.

[0088] The watermark information read here is the watermarked image from the aforementioned embodiments (e.g., Figure 5 The watermark information corresponding to the first image shown in (a).

[0089] Step 1102: Calculate the target size of the watermark.

[0090] The process involves reading the watermark information of the new-sized image after the image is expanded, determining the watermark elements needed for watermark supplementation and the image size after expansion, and calculating the target size of the watermark.

[0091] In one embodiment, the target size of the watermark needs to be adapted to the size of the enlarged image. Assuming the new image is 1.5 times larger than the original image, the target size of each watermark can also be 1.5 times the original size.

[0092] Step 1103: Download the new watermark from the cloud.

[0093] Since fixed-size watermarks are prone to distortion when their size is changed, this application embodiment selects cloud watermark resources of appropriate size from the cloud device based on the enlarged size of the watermark and uses them to supplement the watermark processing.

[0094] Step 1104: Calculate the target position of the new watermark.

[0095] The target position of the watermark in the new-size image should correspond to the position of the watermark in the original watermarked image before expansion, in order to avoid the problem of abnormal watermark position display after expansion.

[0096] Step 1105: Save the watermark location background image of the new-sized image.

[0097] In addition, after obtaining a new-sized image without watermark, the background image of the watermark position corresponding to the new-sized image can be saved. In this way, after the watermark is added to the new-sized image, if there is a need to expand the image again, the expansion process in the above embodiment can be repeated using the newly saved background image of the watermark position to achieve the expansion again.

[0098] Step 1106: Refresh watermark information.

[0099] Specifically, refreshing the watermark information transforms the watermark information of the original image into the watermark information of the expanded image. Optionally, refreshing the watermark information includes refreshing the watermark element information and refreshing the background image of the watermark position.

[0100] Step 1107: Paste the new watermark and output the expanded image with the watermark.

[0101] The process involves pasting and merging a new watermark to obtain an expanded image with the watermark. This expanded image carries the new watermark information, and subsequent secondary editing operations, such as further expansion of the expanded image with the watermark, will not be affected.

[0102] To make the solutions in the above embodiments clearer, a detailed diagram expansion process is provided below. (Refer to...) Figure 12 This is a schematic diagram illustrating the processing flow of an image expansion method provided in an embodiment of this application. Figure 12As shown, in the watermark information editing stage, the original image is captured, and the watermark information is saved simultaneously to obtain a watermarked image. After watermark information saving and processing, a watermark information index and a watermark location background image are obtained. These two types of data are saved as additional information along with the watermarked image. Next, the image enlargement process begins. The image's additional information indicates that it is a watermarked image. Then, the watermark location background image corresponding to the watermarked image is obtained through the watermark information index, and watermark removal processing is performed. Further enlargement is then performed on the watermark-removed image. Finally, watermark addition processing is applied to the watermark-removed image to obtain the final enlarged watermarked image.

[0103] Reference Figure 13 The diagram illustrates a flowchart of a mapping method provided in an embodiment of this application. For ease of understanding, Figure 13 by Figure 5 Taking the process from (a) to (d) as an example, this paper illustrates a method for expanding the first image to obtain the fourth image. The following section discusses... Figure 13 The steps shown will be explained.

[0104] Step 1301: In response to an instruction to expand the first image, obtain the position information and element information of the first watermark in the first image.

[0105] The watermark location information can include the watermark's starting position, width, and height. Watermark elements can include device model, shooting time, shooting location, shooting parameters (focal length, ISO, etc.), special graphics, special stamps, etc.

[0106] It should be understood that the first image can be, in addition to being, as shown in the example below. Figure 5 In addition to the image shown in (a), any image carrying a watermark may be used, and the same applies to the second, third, and fourth images. This application does not impose any restrictions on this.

[0107] It should be noted that the image expansion method in this application embodiment is only applicable to images carrying watermarks. If an image expansion instruction is received for a certain image and it is determined that the image does not carry a watermark, then step 1301 and subsequent steps will not be executed.

[0108] In one embodiment, before performing step 1301 above, the electronic device first captures a watermark-free original image using a camera. At this time, watermark information corresponding to the original image is generated. The watermark information may include location information and element information, and may also include information such as device model, shooting time, shooting location, and shooting parameters. Finally, the original image and watermark information are combined to generate a watermarked first image. That is, in response to a user's shooting operation, the original image is captured and its watermark information is saved. The watermark information of the original image includes the location information and element information of the first watermark. Based on the element information of the first watermark, the first watermark is added at a first position in the original image to obtain the first image.

[0109] It should be understood that the specific process of generating the first image can be referred to the aforementioned... Figure 6 The relevant descriptions will not be repeated here.

[0110] In one embodiment, since the watermark in the first image needs to be removed before subsequent image enlargement, and the watermark removal function usually requires the use of a watermark location background image (an example of a first image patch), this application needs to save the watermark location background image corresponding to the first image at the same time as the first image is generated. Therefore, the original image can be cropped to obtain and save the first image patch. The position of the first image patch in the original image is the first position indicated by the position information of the first watermark, and the first image patch does not include the first watermark.

[0111] It should be understood that the specific process of cropping the original image can be referred to the aforementioned... Figure 7 Related descriptions, such as Figure 7 The area shown in (b) is an example of the first tile.

[0112] Step 1302: Based on the element information of the first watermark, remove the first watermark at the first position in the first image to obtain the second image.

[0113] It should be noted that the first position is the position indicated by the position information of the first watermark.

[0114] In one embodiment, the watermark location background image can be used to cover the corresponding position (i.e., the second image patch) of the first image to remove the watermark. The above-described method of removing the first watermark at a first position in the first image based on the element information of the first watermark to obtain the second image includes: covering the second image patch in the first image with the first image patch to obtain the second image, wherein the second image patch includes the first watermark, and the second image patch has the same size as the first image patch.

[0115] Step 1303: Expand the second image to obtain the third image.

[0116] It should be noted that the third image includes the first region and the second region, where the first region is the region corresponding to the second image, for example... Figure 5 The area within the dashed line (c) is the second region, which is a new image region added through image expansion, for example... Figure 5 The area outside the dashed line (c).

[0117] In one embodiment, the second image can be expanded to obtain a third image, including: expanding the second image along N preset directions to obtain the third image, wherein the size of the third image in the nth preset direction is greater than the size of the second image in the nth preset direction, n ≤ N and N and n are positive integers. The expansion direction may include top, bottom, left, right and / or diagonal directions, etc., and this embodiment does not limit this.

[0118] In one embodiment, during the generation of the third image, the third image is cropped at a second position to obtain a third image patch, which is then saved. This third image patch is used to expand the fourth image. Specifically, after obtaining the third image, a background image of the watermark location (an example of the third image patch) is saved. This way, if further expansion is needed after obtaining the fourth image, the newly saved background image of the watermark location can be used for the corresponding expansion processing.

[0119] It should be understood that the aforementioned watermark removal process and image enlargement process can refer to the aforementioned... Figure 10 The relevant descriptions will not be repeated here.

[0120] Step 1304: Based on the element information of the first watermark, add the second watermark at the second position in the third image to obtain the fourth image.

[0121] In the fourth image, the position of the watermark corresponds to the watermark position information.

[0122] In one embodiment, the target size of the second watermark can be determined based on the size of the third image; the second position can be determined based on the size of the third image and the position information of the first watermark; and the second watermark can be added to the second position in the third image according to the target size to obtain the fourth image. Specifically, after image enlargement, watermark addition is required. Watermark addition processing first requires enlarging the size of each watermark to fit the enlarged size of the third image, then determining the position of each watermark in the third image, and finally, based on the position information, adding the enlarged watermarks to the third image to obtain the fourth image, thus completing the watermark addition processing.

[0123] In one embodiment, since fixed-size watermark elements are prone to distortion when their size is changed, this application selects a cloud watermark resource of a suitable size from a cloud device based on the enlarged size of the watermark element and uses it for supplementary watermark processing of the third image. Therefore, a second watermark can be added at a second position in the third image according to the target size to obtain a fourth image, including: receiving a watermark resource of the second watermark of the target size from a cloud device; and adding a second watermark at a second position in the third image according to the watermark resource of the second watermark of the target size to obtain the fourth image.

[0124] In one embodiment, the size of the second watermark in the fourth image is greater than or equal to the size of the first watermark in the first image. This is because, generally, after image enlargement, the image size increases, and the watermark also increases accordingly to fit the new image size. However, in one possible implementation scenario, taking the watermark at the bottom of the image as an example, assuming the enlargement is only upwards, since the left and right sides of the image do not change size, the new watermark size can be the same as the old watermark size.

[0125] It should be understood that the aforementioned process of supplementing watermarks can refer to the aforementioned process of... Figure 11 The relevant descriptions will not be repeated here.

[0126] The image enlargement method disclosed in the above embodiments of this application mainly removes the watermark from the image before enlargement. Then, it enlarges the watermark-free image, avoiding problems such as only the watermark area being expanded, watermark blurring, or abnormal watermark position during the enlargement process. After enlargement, the watermark is re-added to the enlarged image to obtain the final image. This solution fundamentally solves various abnormal problems that may occur when enlarging watermarked images, improving the image enlargement effect.

[0127] The methods of the embodiments of this application have been described above with reference to the accompanying drawings. It should be understood that although the steps in the flowcharts of the embodiments described above are shown sequentially, these steps are not necessarily executed in the order shown in the figures. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the embodiments described above may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least a portion of the steps or stages of other steps. The apparatus of the embodiments of this application will now be described with reference to the accompanying drawings.

[0128] Reference Figure 14This is a schematic diagram of a mapping device provided in an embodiment of this application. For ease of explanation, only the parts related to the embodiment of this application are shown. Figure 14 As shown, the mapping expansion device 1400 includes an acquisition unit 1401 and a processing unit 1402. The mapping expansion device 1400 can be integrated into an electronic device. For example, the mapping expansion device 1400 can also be used to perform... Figure 6 , Figure 8 , Figure 9 , Figure 10 , Figure 11 , Figure 12 or Figure 13 The process is shown.

[0129] The mapping device 1400 can be used to execute any of the methods described above. For example, the acquisition unit 1401 can be used to execute step 1301, and the processing unit 1402 can be used to execute steps 1302-1304.

[0130] The image enlargement device provided in this application mainly removes the watermark from the image before enlargement, and then enlarges the watermark-free image. This avoids problems such as only the watermark area being expanded, watermark blurring, or abnormal watermark position during the image enlargement process. After enlargement, the watermark is re-added to the enlarged image to obtain the final image. This solution fundamentally solves various abnormal problems that may occur when enlarging watermarked images, improving the image enlargement effect.

[0131] It should be noted that the foregoing explanation of the map expansion method embodiment also applies to the map expansion device 1400 of this embodiment, and will not be repeated here.

[0132] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is merely an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit. Furthermore, the specific names of the functional units and modules are only for easy differentiation and are not intended to limit the scope of protection of this application. The specific working process of the units and modules in the above system can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0133] Figure 15This is a schematic diagram of the hardware structure of an electronic device according to an embodiment of this application. Figure 15 As shown, the electronic device 1500 may include a central processing unit (CPU) 1510, an external memory interface 1520, an internal memory 1521, a universal serial bus (USB) interface 1530, a charging management module 1540, a power management module 1541, a battery 1542, antenna 1, antenna 2, a mobile communication module 1550, a wireless communication module 1560, an audio module 1570, a speaker 1570A, a receiver 1570B, a microphone 1570C, a headphone jack 1570D, a sensor module 1580, buttons 1590, a motor 1591, an indicator 1592, a camera 1593, a display screen 1594, and a subscriber identification module (SIM) card interface 1595, etc. The sensor module 1580 may include a pressure sensor 1580A, a gyroscope sensor 1580B, a barometric pressure sensor 1580C, a magnetic sensor 1580D, an accelerometer sensor 1580E, a distance sensor 1580F, a proximity sensor 1580G, a fingerprint sensor 1580H, a temperature sensor 1580J, a touch sensor 1580K, an ambient light sensor 1580L, a bone conduction sensor 1580M, etc. It should be understood that the steps in the foregoing method embodiments are executed by the processor 1510 of the electronic device.

[0134] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device 1500. In other embodiments of this application, the electronic device 1500 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0135] For example, Figure 15The processor 1510 shown may include one or more processing units, such as an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU). These different processing units may be independent devices or integrated into one or more processors.

[0136] The controller can serve as the central nervous system and command center of the electronic device 1500. The controller can generate operation control signals based on the instruction opcode and timing signals to control the fetching and execution of instructions.

[0137] The processor 1510 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 1510 is a cache memory. This memory can store instructions or data that the processor 1510 has just used or that are used repeatedly. If the processor 1510 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 1510, and thus improves the efficiency of the system.

[0138] In some embodiments, the MIPI interface can be used to connect the processor 1510 to peripheral devices such as the display screen 1594 and the camera 1593. The MIPI interface includes a camera serial interface (CSI) and a display serial interface (DSI). The processor 1510 and the display screen 1594 communicate via the DSI interface to realize the display function of the electronic device 1500.

[0139] In some embodiments, the GPIO interface can be configured via software. The GPIO interface can be configured as a control signal or a data signal. The GPIO interface can be used to connect the processor 1510 to a camera 1593, a display screen 1594, a wireless communication module 1560, an audio module 1570, a sensor module 1580, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0140] It is understood that the interface connection relationships between the modules illustrated in the embodiments of this application are merely illustrative and do not constitute a structural limitation on the electronic device 1500. In other embodiments of this application, the electronic device 1500 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.

[0141] Electronic device 1500 implements display functions through a GPU, a display screen 1594, and an application processor. The GPU is a microprocessor for image processing, connecting the display screen 1594 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 1510 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0142] Display screen 1594 is used to display images, videos, etc. Display screen 1594 includes a display panel. In some embodiments, electronic device 1500 may include one or N displays screens 1594, where N is a positive integer greater than 1.

[0143] Internal memory 1521 can be used to store computer executable program code, which includes instructions. Processor 1510 executes various functional applications and data processing of electronic device 1500 by running the instructions stored in internal memory 1521. Internal memory 1521 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of electronic device 1500 (such as audio data, phonebook, etc.). Furthermore, internal memory 1521 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.

[0144] Pressure sensor 1580A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 1580A can be disposed on display screen 1594. There are many types of pressure sensors 1580A, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor may include at least two parallel plates with conductive material. When force is applied to pressure sensor 1580A, the capacitance between the electrodes changes. Electronic device 1500 determines the pressure intensity based on the change in capacitance. When a touch operation is applied to display screen 1594, electronic device 1500 detects the intensity of the touch operation based on pressure sensor 1580A. Electronic device 1500 can also calculate the touch position based on the detection signal from pressure sensor 1580A. In some embodiments, touch operations applied to the same touch position but with different touch operation intensities can correspond to different operation commands. For example, when a touch operation with a touch operation intensity less than a first pressure threshold is applied to the SMS application icon, a command to view SMS messages is executed. When a touch operation with a strength greater than or equal to the first pressure threshold is applied to the SMS application icon, the instruction to create a new SMS message is executed.

[0145] Touch sensor 1580K, also known as a "touch panel," can be located on display screen 1594. The touch sensor 1580K and display screen 1594 together form a touchscreen, also known as a "touch screen." Touch sensor 1580K detects touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 1594. In other embodiments, touch sensor 1580K may also be located on the surface of electronic device 1500, in a different position than display screen 1594.

[0146] It should be noted that the information interaction and execution process between the above-mentioned devices / units are based on the same concept as the method embodiments of this application. For details on their specific functions and technical effects, please refer to the method embodiments section, and they will not be repeated here.

[0147] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is merely an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit. Furthermore, the specific names of the functional units and modules are only for easy differentiation and are not intended to limit the scope of protection of this application. The specific working process of the units and modules in the above system can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0148] This application also provides an electronic device comprising: one or more processors, a memory, and a computer program stored in the memory and executable on the one or more processors. When the one or more processors execute the computer program, the electronic device can perform the steps in any of the methods described above. This application also provides a computer-readable storage medium storing a computer program, which, when executed by an electronic device, can perform the steps in the various method embodiments described above.

[0149] The computer-readable medium may include at least: any entity or device capable of carrying computer program code to a photographic / electronic device, recording media, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signals, telecommunication signals, and software distribution media. Examples include USB flash drives, portable hard drives, magnetic disks, or optical discs. In some jurisdictions, according to legislation and patent practice, computer-readable media may not be electrical carrier signals or telecommunication signals.

[0150] This application provides a computer program product, which includes a computer program that, when executed by an electronic device, can implement the steps described in the various method embodiments above. The computer program includes computer program code, which may be in the form of source code, object code, executable file, or some intermediate form.

[0151] In the above embodiments, the descriptions of each embodiment have different focuses. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0152] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0153] In the embodiments provided in this application, it should be understood that the disclosed apparatus / devices and methods can be implemented in other ways. For example, the apparatus / device embodiments described above are merely illustrative. For instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0154] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0155] It should be understood that, when used in this application specification and the appended claims, the term "comprising" indicates the presence of the described features, integrals, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components and / or a collection thereof.

[0156] It should also be understood that the term “and / or” as used in this application specification and the appended claims means any combination of one or more of the associated listed items and all possible combinations, and includes such combinations.

[0157] Furthermore, in the description of this application and the appended claims, the terms "first," "second," "third," etc., are used only to distinguish descriptions and should not be construed as indicating or implying relative importance.

[0158] References to "one embodiment" or "some embodiments" as described in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0159] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be included within the protection scope of this application.

Claims

1. A mapping method applied to electronic devices, characterized in that, include: In response to an instruction to expand the first image, the location information and element information of the first watermark in the first image are obtained; Based on the element information of the first watermark, the first watermark at the first position in the first image is removed to obtain the second image, where the first position is the position indicated by the position information of the first watermark. The second image is enlarged to obtain the third image; Based on the element information of the first watermark, a second watermark is added at the second position in the third image to obtain the fourth image.

2. The method according to claim 1, characterized in that, The method further includes: In response to the user's shooting operation, the original image is captured and the watermark information of the original image is saved. The watermark information of the original image includes the position information and element information of the first watermark. Based on the element information of the first watermark, the first watermark is added at the first position in the original image to obtain the first image.

3. The method according to claim 2, characterized in that, The method further includes: The original image is cropped to obtain a first patch and saved. The position of the first patch in the original image is the first position indicated by the position information of the first watermark. The first patch does not include the first watermark. The step of removing the first watermark at a first position in the first image based on the element information of the first watermark to obtain the second image includes: The second image is obtained by overlaying the first image tile with the second image tile, wherein the second image tile includes the first watermark and the second image tile has the same size as the first image tile.

4. The method according to any one of claims 1-3, characterized in that, The process of enlarging the second image to obtain the third image includes: The second image is expanded along N preset directions to obtain the third image, wherein the size of the third image in the nth preset direction is greater than the size of the second image in the nth preset direction, n≤N and N and n are positive integers.

5. The method according to any one of claims 1-4, characterized in that, The step of supplementing the second watermark at the second position in the third image based on the element information of the first watermark to obtain the fourth image includes: The target size of the second watermark is determined based on the size of the third image; The second position is determined based on the size of the third image and the position information of the first watermark; According to the target size, the second watermark is added at the second position in the third image to obtain the fourth image.

6. The method according to claim 5, characterized in that, The step of adding the second watermark at the second position in the third image according to the target size to obtain the fourth image includes: Receive watermark resources of the second watermark of the target size from the cloud device; Based on the watermark resource of the second watermark of the target size, the second watermark is added at the second position in the third image to obtain the fourth image.

7. The method according to any one of claims 1-6, characterized in that, The method further includes: During the generation of the third image, the third image is cropped at a second position to obtain a third image block, which is then saved; the third image block is used to expand the fourth image.

8. The method according to any one of claims 1-7, characterized in that, The size of the second watermark in the fourth image is greater than or equal to the size of the first watermark in the first image.

9. The method according to any one of claims 1-8, characterized in that, The third image includes a first region and a second region. The first region is the region corresponding to the second image, and the second region is a new image region added through image expansion.

10. An electronic device, characterized in that, The electronic device includes: one or more processors, and memory; The memory is coupled to the one or more processors, the memory being used to store computer program code, the computer program code including computer instructions, the one or more processors invoking the computer instructions to cause the electronic device to perform the method as described in any one of claims 1 to 9.

11. A chip system, characterized in that, The chip system is applied to an electronic device, the chip system including one or more processors, the one or more processors being used to invoke computer instructions to cause the electronic device to perform the method as described in any one of claims 1 to 9.

12. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes instructions that, when executed on an electronic device, cause the electronic device to perform the method as described in any one of claims 1 to 9.

13. A computer program product, characterized in that, The computer program product includes a computer program that, when run on an electronic device, causes the electronic device to perform the method as described in any one of claims 1 to 9.

Images