Picture processing method and electronic device

By automatically generating text with smart photo frames and supporting user editing, the problem of cumbersome and poor results in adding text in the existing technology is solved, and efficient and high-quality text border effect image generation is achieved, improving user experience.

WO2025092101A9PCT designated stage expired Publication Date: 2025-07-31HONOR DEVICE CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2024/111211
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-11-23
Filing Date
2024-08-09
Publication Date
2025-07-31

AI Technical Summary

Technical Problem

In the prior art, users have cumbersome operations and poor results when adding text to photos, and cannot efficiently and high-quality text border effects.

Method used

Provides a picture processing method, automatically generates text while adding photo frames through intelligent photo frames, and supports user manual editing, including switching text, font type and style adjustments, to achieve efficient generation of text border effects.

Benefits of technology

Improve the user editing experience, and combine intelligent text and photo frames to efficiently and high-quality text border effects, enriching the visual experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024111211_31072025_PF_FP_ABST
    Figure CN2024111211_31072025_PF_FP_ABST
Patent Text Reader

Abstract

Provided are a picture processing method and an electronic device, wherein the function of an intelligent photo frame is provided in a picture editing process. The intelligent photo frame combines an intelligent caption with a photo frame, achieving rapid addition of a text to a picture. In response to an operation of a user tapping on a thumbnail of the intelligent photo frame, an electronic device applies the intelligent photo frame to a picture, and the picture to which the intelligent photo frame is applied not only comprises a photo frame, but also has a corresponding caption. Compared with an editing operation which can only add a photo frame or a text, in the embodiments of the present application, when adding a photo frame, a caption is generated for the picture and added to the photo frame, thereby achieving efficient and high-quality completion of a picture having a text border effect.
Need to check novelty before this filing date? Find Prior Art

Description

Image processing method and electronic device

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on November 3, 2023, with application number 202311461740.0 and application name “A method and electronic device for image processing”, as well as priority to the Chinese patent application filed with the State Intellectual Property Office on November 23, 2023, with application number 202311583536.6 and application name “A method and electronic device for image processing”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of image processing, and more particularly, to a method and electronic device for image processing. Background Art

[0003] With the increasing popularity of smart terminals and the increasing power of shooting functions, more and more users use smart terminals to take pictures to record their lives. After obtaining the pictures, users have the need to further edit the pictures to make them have the desired atmosphere.

[0004] In the prior art, users' photo processing operations include adding text to photos. However, the traditional processing method requires users to manually select text from a text library, which is cumbersome and the effect of adding text to photos is not good.

[0005] Summary of the Invention

[0006] In view of this, the present application provides a method for image processing, an electronic device, a computer-readable storage medium, and a computer program product. During the process of editing an image, it supports adding text and a photo frame to the image at the same time, completing the text border effect image efficiently and with high quality, thereby improving the user experience.

[0007] In a first aspect, a method for image processing is provided, comprising:

[0008] In response to a first operation by the user, displaying a first interface, the first interface including a first picture and a first display area, the first display area including at least a thumbnail of a first photo frame option;

[0009] In response to the user clicking on the thumbnail of the first photo frame option, a second interface is displayed, and the second interface includes a second picture; the second picture includes the first picture, the first photo frame and the first text, and the first text is located in the area corresponding to the first photo frame.

[0010] The above solution can be executed by an electronic device or a chip in an electronic device. Based on the above solution, during the process of editing a picture, the electronic device responds to the user clicking on the thumbnail of the smart photo frame and applies the smart photo frame to the picture. After applying the smart photo frame, the picture includes not only the photo frame but also the corresponding accompanying text. Compared to editing operations that can only add a photo frame or only add text, the embodiment of the present application generates accompanying text for the picture and adds it to the photo frame at the same time as adding the photo frame, thereby completing the text border effect picture efficiently and with high quality.

[0011] In a possible implementation, the first photo frame is a border area displayed after the first picture is applied with a photo frame effect corresponding to the first photo frame option; the first accompanying text is text generated based on the content of the first picture; the font style of the first accompanying text is generated based on the style of the first photo frame; the font type of the first accompanying text corresponds to the first photo frame option.

[0012] The caption in the picture is automatically generated based on the content of the picture (for example, the screen content). Compared to editing operations that can only add a frame or only add text, the smart photo frame in the embodiment of the present application intelligently generates captions for the picture while adding the frame, thus completing the text frame effect picture efficiently and with high quality.

[0013] In order to further enrich the user's editing experience, based on the smart photo frame, the embodiment of the present application also supports users to manually edit the text in the picture.

[0014] In a possible implementation, the second interface further includes an editing control; and the method further includes:

[0015] In response to a user clicking on the editing control, displaying a third interface, the third interface including the second image and a first window, the first window including a first option and a plurality of captions generated based on the first image, the plurality of captions including at least the first caption and the second caption;

[0016] In response to the user clicking on the second text, the text in the second picture is replaced with the second text.

[0017] Therefore, if the user is not satisfied with the text generated in the picture after applying the smart photo frame, he or she can manually switch the text, which improves the user's editing experience.

[0018] The present application also provides a control for changing the recommended captions. In one possible implementation, the first window further includes a first change control; in response to a user clicking the first change control, some or all of the multiple captions in the first window change.

[0019] Therefore, if the user is not satisfied with the recommended copy, then the user can choose to change the recommended copy. In this way, the user can select a satisfactory copy based on the multiple recommended copy after the change and apply it to the picture, providing the user with more choices.

[0020] The embodiment of the present application also provides a control for quickly changing the text in the picture.

[0021] In one possible implementation, the second interface further includes a second change control; in response to the user clicking the second change control, the text in the second picture is changed to any text among the multiple texts except the first text.

[0022] Therefore, if the user is not satisfied with the text generated in the picture after applying the smart photo frame, the text in the picture can be quickly replaced based on the second replacement control, thereby improving the user experience.

[0023] The embodiment of the present application also provides a function for switching text types. In one possible implementation, the first window also includes a second option; in response to the user clicking the second option, a fourth interface is displayed, the fourth interface including the second image and the second window, the second window including the first option, the second option, and multiple font type icons, the multiple font type icons including an icon of the first font type and an icon of the second font type; wherein the font type of the first accompanying text is the first font type;

[0024] In response to a user clicking on the icon of the second font type, the font type of the first accompanying text in the second picture is changed from the first font type to the second font type.

[0025] Therefore, if the user is not satisfied with the text type generated in the picture after applying the smart photo frame, then the user can choose to switch the text type in the picture.

[0026] It is understandable that the fonts in the font library may include local fonts and cloud fonts. If the user selects a cloud font, the cloud font is downloaded to provide the user with more font options.

[0027] In a possible implementation, the multiple font type icons further include an icon of a third font type, the icon of the third font type includes a pending download indicator, and the pending download indicator is used to indicate that the font corresponding to the third font type is in a pending download state;

[0028] In response to a user clicking on the icon of the third font type, downloading the third font type, and displaying the icon of the third font type excluding the to-be-downloaded identifier after the download is complete;

[0029] After the third font type is downloaded, the font type of the first accompanying text in the second picture is switched to the third font type.

[0030] The present application also provides a function for switching text styles. In one possible implementation, the first window further includes a third option; in response to a user clicking the third option, a sixth interface is displayed, the sixth interface including the second image and the third window; the third window includes the first option, the second option, the third option, and controls for parameters related to the font style, the parameters related to the font style including at least a color control and / or a transparency control;

[0031] In response to the user adjusting the color control, the font color of the first text in the second picture is changed from a first color to a second color;

[0032] In response to the user adjusting the transparency control, the font transparency of the first text in the second picture is changed from the first transparency to the second transparency.

[0033] Therefore, if the user is not satisfied with the text style generated in the picture after applying the smart photo frame, then the user can choose to adjust the text style in the picture, further enriching the user's editing experience.

[0034] In a possible implementation, the first display area further includes a thumbnail of a second photo frame option, wherein the second photo frame option and the first photo frame option are different photo frame options;

[0035] In response to a user clicking on the thumbnail of the second photo frame option, a fifth interface is displayed, wherein the fifth interface includes a third picture; the third picture is a picture generated after the second photo frame option is applied to the first picture, and the third picture includes the first picture, the second photo frame, and the third text; the second photo frame is different from the first photo frame; the third text is located in the area corresponding to the second photo frame; the font type and / or font style of the third text is different from that of the first text.

[0036] Optionally, the content of the third accompanying text is the same as or different from the content of the first accompanying text. Therefore, the embodiment of the present application can provide more smart photo frame options for users to choose from.

[0037] In a possible implementation, the first photo frame is a border area displayed after the first picture is applied with a photo frame effect corresponding to the first photo frame option; the first accompanying text is text generated based on the content of the first picture; the font style of the first accompanying text is generated based on the style of the first photo frame; the font type of the first accompanying text corresponds to the first photo frame option.

[0038] In a possible implementation, the thumbnail of the first photo frame option includes a first identifier, which is used to identify the smart text photo frame; the first display area also includes a thumbnail of a third photo frame option, which does not include the first identifier.

[0039] In a possible implementation, in response to the user clicking on the thumbnail of the third photo frame option, a seventh interface is displayed, where the seventh interface includes a third picture, and the third picture includes the first picture and the third photo frame.

[0040] Therefore, in order to better distinguish between ordinary photo frames and the smart photo frame of the embodiment of the present application, an identifier may be added to the thumbnail icon of the smart photo frame so that the user can quickly find the smart photo frame.

[0041] In a possible implementation, before displaying the second interface, the method further includes:

[0042] A scanning animation effect is displayed, where the scanning animation effect includes at least one picture frame, and each picture frame includes the first picture and a scanning line.

[0043] In a possible implementation, the first photo frame includes an upper frame area, a lower frame area, a left frame area, and a right frame area; and a size specification of each frame area of ​​the first photo frame is determined based on a preset rule.

[0044] In one possible implementation, the padding values ​​of the top border area, the left border area, and the right border area are a first ratio of the width of the second image; and the padding value of the bottom border area is a second ratio of the width of the second image. Optionally, the second ratio may be a first multiple of the first ratio.

[0045] In a second aspect, an electronic device is provided, comprising a unit for executing the method of any one of the implementations of the first or second aspects. The electronic device may be a terminal device or a chip within the terminal device. The electronic device includes an input unit, a display unit, and a processing unit.

[0046] When the electronic device is a terminal device, the processing unit may be a processor, the input unit may be a communication interface, and the display unit may be a graphics processing module and a screen; the terminal device may also include a memory for storing computer program code, and when the processor executes the computer program code stored in the memory, the terminal device executes the method in any one of the implementation modes of the first aspect.

[0047] When the electronic device is a chip in a terminal device, the processing unit may be a logic processing unit inside the chip, the input unit may be an input interface, pin or circuit, etc., and the display unit may be a graphics processing unit inside the chip; the chip may also include a memory, which may be a memory inside the chip (for example, a register, a cache, etc.) or a memory located outside the chip (for example, a read-only memory, a random access memory, etc.); the memory is used to store computer program code, and when the processor executes the computer program code stored in the memory, the chip executes the method in any one of the implementations of the first aspect.

[0048] In one implementation, the processing unit is configured to, in response to a first operation of the user, call the display unit to display a first interface, where the first interface includes a first picture and a first display area, where the first display area includes at least a thumbnail of a first photo frame option;

[0049] In response to a user clicking on the thumbnail of the first photo frame option, the display unit is called to display a second interface, the second interface including a second picture; the second picture includes the first picture, the first photo frame and the first text; the first text is located in the area corresponding to the first photo frame.

[0050] In one implementation, the second interface further includes an editing control; the processing unit is further configured to, in response to a user clicking the editing control, call the display unit to display a third interface, wherein the third interface includes the second image and a first window, wherein the first window includes a first option and a plurality of captions generated based on the first image, wherein the plurality of captions include at least the first caption and the second caption;

[0051] In response to the user clicking on the second text, the text in the second picture is replaced with the second text.

[0052] In one implementation, the first window further includes a second option; the processing unit is further configured to, in response to a user clicking on the second option, call the display unit to display a fourth interface, wherein the fourth interface includes the second image and the second window, and the second window includes the first option, the second option, and a plurality of font type icons, wherein the plurality of font type icons include an icon of a first font type and an icon of a second font type; wherein the font type of the first accompanying text is the first font type;

[0053] In response to a user clicking on the icon of the second font type, the font type of the first accompanying text in the second picture is changed from the first font type to the second font type.

[0054] In one implementation, the first window further includes a third option; the processing unit is further configured to, in response to a user clicking on the third option, call the display unit to display a sixth interface, wherein the sixth interface includes the second image and a third window, and the third window includes the first option, the second option, the third option, and controls for parameters related to font style, wherein the parameters related to font style include at least a color control and / or a transparency control;

[0055] In response to the user adjusting the color control, the font color of the first text in the second picture is changed from a first color to a second color;

[0056] In response to the user adjusting the transparency control, the font transparency of the first text in the second picture is changed from the first transparency to the second transparency.

[0057] It can be understood that the relevant technical effects can be referred to the description in the first aspect, and for the sake of brevity, they will not be repeated here.

[0058] It can also be understood that only some implementations of the processing unit and the display unit are illustrated here, and the processing unit and / or the display unit can also perform other implementations in the first aspect mentioned above.

[0059] In a third aspect, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores a computer program code. When the computer program code is executed by an electronic device, the electronic device executes the method in any one of the implementations of the first aspect.

[0060] In a fourth aspect, a computer program product is provided, comprising: a computer program code, which, when executed by an electronic device, enables the electronic device to execute the method in any one of the implementations of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0061] FIG1 is a schematic diagram of a hardware system of an electronic device applicable to the present application;

[0062] FIG2 is an example diagram of an interface of an application scenario of an embodiment of the present application;

[0063] FIG3A shows an example diagram of an interface of an application smart photo frame according to an embodiment of the present application;

[0064] FIG3B shows another example interface diagram of the smart photo frame according to an embodiment of the present application;

[0065] FIG4 shows an example interface diagram of a scanning animation effect when a smart photo frame is used according to an embodiment of the present application;

[0066] FIG5 shows an example diagram of an interface for switching text according to an embodiment of the present application;

[0067] FIG6 shows an example of an interface for changing recommended text according to an embodiment of the present application;

[0068] FIG7 shows another example of an interface for switching text according to an embodiment of the present application;

[0069] FIG8 shows an example of an interface for selecting a font type according to an embodiment of the present application;

[0070] FIG9 shows an example of an interface for selecting a font style according to an embodiment of the present application;

[0071] FIG10 shows a schematic flow chart of a method for processing an image according to an embodiment of the present application;

[0072] FIG11 shows a schematic diagram of the software architecture of the present application. DETAILED DESCRIPTION

[0073] The technical solutions in the embodiments of the present application will be described below with reference to the accompanying drawings.

[0074] In the embodiments of the present application, unless otherwise specified, “a plurality of” may mean two or more.

[0075] A method for image processing according to an embodiment of the present application can be applied to an electronic device. The electronic device has the function of processing images, or in other words, is installed with an application capable of processing images. In some embodiments, the electronic device is installed with a gallery application.

[0076] It is understood that the description here is only based on the gallery application as an example, and the embodiments of the present application are not limited thereto. In fact, the embodiments of the present application are also applicable to other applications that support image processing.

[0077] In some embodiments of the present application, the electronic device may be a mobile phone, a smart screen, a tablet computer, a wearable electronic device, an in-vehicle electronic device, an augmented reality (AR) device, a virtual reality (VR) device, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), a projector, and the like.

[0078] Figure 1 shows a schematic diagram of the structure of an electronic device 100 provided in an embodiment of the present application. Figure 1 shows a hardware system of an electronic device applicable to the present application.

[0079] The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0080] It should be noted that the structure shown in FIG1 does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than those shown in FIG1, or the electronic device 100 may include a combination of some of the components shown in FIG1, or the electronic device 100 may include sub-components of some of the components shown in FIG1. ​​The components shown in FIG1 may be implemented in hardware, software, or a combination of software and hardware.

[0081] The processor 110 may include one or more processing units. For example, the processor 110 may include at least one of the following processing units: an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and a neural-network processing unit (NPU). The different processing units may be independent devices or integrated devices.

[0082] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.

[0083] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.

[0084] In some embodiments, the processor 110 may include one or more interfaces. For example, the processor 110 may include at least one of the following interfaces: an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a SIM interface, and a USB interface. The connection relationship between the modules shown in Figure 1 is only a schematic illustration and does not constitute a limitation on the connection relationship between the modules of the electronic device 100. Optionally, the modules of the electronic device 100 may also adopt a combination of the multiple connection methods in the above embodiments.

[0085] In some embodiments, the processor 110 is used to call the display screen 194 to display a first interface in response to a first operation of the user, where the first interface includes a first picture and a first display area, and the first display area includes at least a thumbnail of a first photo frame option; in response to the user clicking on the thumbnail of the first photo frame option, the display screen 194 is called to display a second interface, where the second interface includes a second picture; the second picture includes the first picture, the first photo frame and the first text; the first text is located in the area corresponding to the first photo frame.

[0086] Electronic device 100 can implement display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0087] The display screen 194 can be used to display images or videos. The display screen 194 includes a display panel. The display panel can use a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a mini light-emitting diode (Mini LED), a micro light-emitting diode (Micro LED), a micro OLED (Micro OLED) or a quantum dot light emitting diode (QLED). In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1. As a possible implementation method, when a user views the discovery page of the gallery application, the display screen 194 can be used to display the first recommendation position, and display cards of photos of today in previous years or cards of moment videos in the first recommendation position.

[0088] The electronic device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.

[0089] The ISP processes data fed back by camera 193. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then passed to the ISP for processing and converted into a visible image. The ISP can perform algorithmic optimization on image noise, brightness, and color. It can also optimize parameters such as exposure and color temperature of the captured scene. In some embodiments, the ISP can be located within camera 193.

[0090] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard red, green, blue (RGB), YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0091] Digital signal processors are used to process digital signals. In addition to processing digital image signals, they can also process other digital signals.

[0092] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. This allows electronic device 100 to play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, and MPEG4.

[0093] The NPU is a processor that draws inspiration from biological neural network architecture, such as the transmission patterns between neurons in the human brain, to rapidly process input information and continuously learn. The NPU enables intelligent cognitive functions in electronic device 100, such as image recognition, face recognition, voice recognition, and text comprehension.

[0094] The external memory interface 120 may be used to connect an external memory card, such as a secure digital (SD) card, to expand the storage capacity of the electronic device 100 .

[0095] The internal memory 121 can be used to store computer executable program codes, which include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, and applications required for at least one function (for example, a sound playback function and an image playback function). The data storage area may store data created during the use of the electronic device 100 (for example, audio data and a phone book). In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as: at least one disk storage device, a flash memory device, and a universal flash storage (UFS). The processor 110 executes various processing methods of the electronic device 100 by running instructions stored in the internal memory 121 and / or instructions stored in a memory provided in the processor.

[0096] The electronic device 100 can implement audio functions, such as music playback and recording, through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0097] The touch sensor 180K is also referred to as a touch-sensitive device. The touch sensor 180K can be disposed on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also referred to as a touch screen. The touch sensor 180K is used to detect touch operations applied thereto or in the vicinity thereof. The touch sensor 180K can transmit the detected touch operations to an application processor to determine the type of touch event. Visual output related to the touch operations can be provided via the display screen 194. In other embodiments, the touch sensor 180K can also be disposed on the surface of the electronic device 100 and at a different location from the display screen 194.

[0098] The buttons 190 include a power button and a volume button. The buttons 190 may be mechanical buttons or touch buttons. The electronic device 100 may receive button input signals and implement functions related to the button input signals.

[0099] The technical solutions involved in the following embodiments can all be implemented in the electronic device 100 having the above hardware architecture.

[0100] In order to provide users with richer image processing functions, the embodiment of the present application provides a smart photo frame function. By combining smart text matching with the photo frame, text can be quickly added to the picture. Among them, "smart text matching" can be understood as intelligently recommending appropriate text (or copy) to the user based on the content of the picture. In addition, the style of the text added to the photo can be intelligently matched according to one or more of the content of the picture, the color of the picture, and the style of the border.

[0101] For ease of understanding, the following embodiments of this application will take an electronic device having the structure shown in Figure 1 as an example, and combine the figure and application scenarios to specifically explain the image processing method provided by the embodiment of this application. The embodiment of this application will take the electronic device as a mobile phone, and the mobile phone has a gallery application installed as an example to describe in detail a method for image processing in the embodiment of this application.

[0102] In some embodiments, the present application provides an entry to the smart photo frame in the photo editing page.

[0103] The photo editing page can be a page for editing a specific photo in the gallery application, or it can be a page in other applications with image editing functions. The embodiments of this application do not specifically limit how to access the photo editing page. For example, the photo editing page can be accessed in the gallery application. Of course, accessing the photo editing page through the gallery application is only an example. In fact, there are other ways to access the photo editing page to edit the photo. For ease of understanding, the following description is combined with the interface.

[0104] Referring to FIG2 , FIG2 shows a schematic diagram of a graphical user interface (GUI) of a smart photo frame entrance provided by an embodiment of the present application. As shown in FIG2 (1), the interface displays the desktop of the mobile phone, and the mobile phone displays the currently output interface content, and the interface displays multiple applications (applications, Apps). The interface includes an icon 201 of the gallery application and icons of other applications. In response to the user clicking on the icon 201 of the gallery application, the mobile phone displays the interface of the gallery application. For example, the interface of the gallery application may include a photo page of the gallery application, such as the interface 10 shown in FIG2 (2). The interface 10 is an example of a photo page. The interface 10 displays a thumbnail of at least one photo, and the thumbnail of at least one photo is displayed in order from the latest to the earliest date. The bottom of the interface 10 contains a photo option 21, an album option, a moment option, and a creation option (or a discovery option). The photo page is currently displayed in FIG2 (2). Due to the photo page displayed on the interface 10, the icon status of the photo option 21 is different from that of the other three options (album option, moment option and creation option). For example, the icon color of the photo option 21 may be darker than the icon colors of the other three options.

[0105] For example, (2) in FIG2 includes a thumbnail of a photo (or picture) 202. In response to the user clicking on the thumbnail of photo 202, the mobile phone displays the interface shown in (3) in FIG2. As shown in (3) in FIG2, the original image of photo 202 is displayed in the interface. For example, the shooting time of the original image of photo 202 is 10:50 am on February 14, 2022. The interface shown in (3) in FIG2 includes an editing control 101. Of course, in addition to the editing control 101, the interface also includes a sharing control, a collection control, a deletion control and more controls. In response to the user clicking on the sharing control, the mobile phone can share the photo 202. In response to the user clicking on the collection control, the mobile phone collects the photo 202 to the collection album. In response to the user clicking on the editing control, the mobile phone performs an editing operation on the photo 202. In response to the user clicking on the deletion control, the mobile phone deletes the photo 202. In response to the user clicking on the more controls, the mobile phone displays other operations for the photo 202 (eg, copy, move, rename, rotate, etc.).

[0106] In some embodiments, in response to a user clicking on the editing control 101 shown in (3) of FIG. 2 , the mobile phone enters an editing state for the photo 202, such as the editing interface shown in (1) of FIG. 3A . As shown in (1) of FIG. 3A , the editing interface includes the photo 202. Optionally, the photo 202 may include a grid to facilitate the user to perform editing operations on the photo 202 by referring to the grid. A first area, a second area, and a third area are displayed below the photo 202.

[0107] The first area is used to display the provided picture ratio options. For example, the ratio options displayed in the first area include: free ratio, original ratio (i.e., the original ratio of the photo), 9:16, 16:9, 3:4, 4:3, etc. For example, the ratio of the photo 202 currently shown in Figure 3A (1) is the original ratio. During the process of editing the photo 202, the user can manually select the ratio of the photo 202. After selecting a certain ratio, the option icon corresponding to the ratio selected by the user is displayed in the interface, which can be distinguished from other unselected ratios. For example, the icon of "original ratio" shown in Figure 3A (1) is displayed in bold, and the line is obviously thicker than the icons of other ratios. It can be understood that in actual implementation, other methods can be used to distinguish whether the ratio option is selected by the user, such as by different colors.

[0108] The second area is used to display the relevant controls for rotating the photo. In response to the user sliding left or right in the second area, the mobile phone changes the rotation angle of the photo 202.

[0109] The third area is used to display multiple options or controls for editing photos. The third area includes a photo frame control 102. The photo frame control is used to add a photo frame to the photo. In this embodiment of the application, the photo frame control 102 can be used to enter the smart photo frame page.

[0110] It can be understood that in addition to the photo frame control 102, other editing options can also be included in the editing page for photos. For example, the graffiti control, text control, mosaic control, watermark control and blur control in the interface shown in Figure 3A (1). Among them, in response to the user clicking the graffiti control, the mobile phone can display the relevant editing operations for graffiti on the photo. In response to the user clicking the text control, the mobile phone displays the relevant editing operations for manually adding text to the photo. In response to the user clicking the mosaic control, the mobile phone displays the relevant editing operations for performing mosaic processing on the photo. In response to the user clicking the watermark control, the mobile phone displays the relevant editing operations for adding or removing watermarks to the photo. In response to the user clicking the blur operation, the mobile phone displays the relevant editing operations for blurring the photo.

[0111] It is also understood that the various editing options in the third area shown in (1) of FIG3A are merely exemplary descriptions, and the embodiments of the present application are not limited thereto. For example, by sliding left or right at the bottom of the screen, the user can display other editing options that are not presented in the interface, such as the color retention control shown in (3) of FIG3A.

[0112] As shown in FIG3A (1), the editing interface also includes a return control 104 and a save control 103. In response to the user clicking the return control 104, the mobile phone can return to the interface before the editing state, such as the interface shown in FIG2 (3). In response to the user clicking the save control 103, the mobile phone can save the edited photo 202.

[0113] In some embodiments, in response to a user clicking on the photo frame control 102, the mobile phone displays the photo frame selection interface shown in (2) of FIG3A . As shown in (2) of FIG3A , the interface includes a photo frame area. The photo frame area is used to present thumbnails of different photo frame options.

[0114] In the embodiment of the present application, the photo frame area includes thumbnail icons of the smart photo frames provided in the embodiment of the present application, such as the thumbnail of smart photo frame 105-1 and the thumbnail of smart photo frame 105-2. For the photo frame thumbnails provided in the photo frame area, if the user selects a photo frame, the border line of the thumbnail corresponding to the selected photo frame can be thicker than that of other unselected photo frames to achieve the purpose of distinction. Of course, different colors can also be used to distinguish whether a photo frame is selected.

[0115] Optionally, the thumbnail of the smart photo frame 105-1 includes a logo 11 and a first font sample. The logo 11 is used to distinguish the smart photo frame from an ordinary photo frame. For example, the logo 11 can be an AI logo.

[0116] The first font example in the thumbnail of the smart photo frame 105-1 may be optional and is only used to illustrate the font type and / or style. It is understood that the text content of the first font example may also be preset, for example, "enjoy delicious food" in FIG3A , but the embodiments of the present application are not limited thereto.

[0117] It is understood that the photo frame area may also include icon 105-4. Icon 105-4 indicates that no photo frame has been added. In the first photo frame selection interface, photo 202 has no photo frame by default, that is, icon 105-4 is selected by default. It can be seen that the border lines of icon 105-4 shown in (2) in Figure 3A are thicker than the lines of other photo frame icons. This indicates that icon 105-4 is selected, that is, photo 202 currently has no photo frame added.

[0118] Of course, the photo frame area can also include thumbnail icons of traditional photo frames, such as traditional photo frame 105-3. The user can swipe left or right in the photo frame area to switch between different photo frames. The difference between traditional photo frames and the smart photo frame provided in the embodiments of the present application is that traditional photo frames cannot automatically add text to the photo frame.

[0119] The smart photo frame provided in the embodiment of the present application can add text and a photo frame to a picture at the same time; and the text content is intelligently matched based on the content of the picture. In some embodiments, after the mobile phone responds to the user clicking on the thumbnail of the smart photo frame 105-1, the smart photo frame 105-1 is applied to the photo 202, and the interface shown in (3) in Figure 3A can be displayed. As shown in (3) in Figure 3A, the picture 106 displayed in the interface is the effect after the smart photo frame 105-1 is applied to the photo 202, that is, the picture after adding text and a frame. The picture 106 includes the content of the photo 202, the photo frame (that is, the gray filled area of ​​the picture 106 shown in the figure) and the text (for example, "copy A*********" shown in the figure). Among them, the copy A can be a sentence, not just a single word or a single word. The meaning expressed by the copy A matches the content contained in the picture. The content contained in the picture here can refer to the content contained in the picture itself, not information such as the time or location of the picture. For example, if the photo 202 is a landscape photo, the text A may be a text related to the description of the landscape, or the text A may include the landscape elements included in the photo 202 .

[0120] The text in picture 106 is intelligently matched based on the content of the picture to ensure the overall effect of the picture and make the picture more beautiful. The font type and font style (e.g., color, transparency, etc.) of the text in picture 106 are determined based on the frame style of smart frame 105-1.

[0121] For unified explanation here, the embodiments of the present application do not limit the specific filling color and / or pattern of the photo frame corresponding to the smart photo frame. The gray filling area of ​​the photo frame in the figure is only for the convenience of illustration.

[0122] The present embodiment of the present application does not specifically limit the manner in which the style and / or type of text in image 106 is determined. Alternatively, in some embodiments, the style and / or type of text in image 106 may be related to a border style (or frame type) corresponding to the smart photo frame. For example, if the border style is a retro-style border (e.g., a border with a curled edge), the font color and / or style may match the border style.

[0123] When generating a copy for image 106 based on its content, multiple copy matching methods may be found in the copy library. To generate the most appropriate copy based on the image's content, the copy ultimately presented in the image may be determined based on the confidence parameters corresponding to each copy. For example, the copy with the highest confidence among multiple copies matching the image's content may be selected and presented in the framed image.

[0124] Optionally, the confidence parameter corresponding to each copy can be determined based on a priori values, or it can be determined based on the user's preference data collected during use. For example, after the user selects a smart photo frame, he reselects another copy by manually modifying the text as shown in Figure 5 below. The electronic device can then feed back the user's selection to the server for subsequent updating of copy-related data or learning models. Optionally, the number of characters corresponding to the text in picture 106 can be set to a preset number. For example, for full-width characters, the number of characters corresponding to the text in picture 106 does not exceed 15. For another example, for half-width characters, the number of characters corresponding to the text in picture 106 does not exceed 30.

[0125] Optionally, the format corresponding to the text in image 106 may be the default format corresponding to smart photo frame 105-1. The present embodiment of the application does not specifically limit the default format. For example, the default text alignment of smart photo frame 105-1 is center alignment. For another example, the default font size of smart photo frame 105-1 is xxdp. For another example, the default text font of smart photo frame 105-1 is You Ran Xiao Kai.

[0126] The embodiments of this application do not specifically limit the border specifications of the smart photo frame. In some embodiments, the padding value of the upper area of ​​the photo frame (which can be understood as the area between the upper border of photo 202 in image 106 and the upper border of image 106) can be a first ratio of the image width; the padding value of the left area of ​​the photo frame (which can be understood as the area between the left border of photo 202 in image 106 and the left border of image 106) can be a second ratio of the image width; and the padding value of the right area of ​​the photo frame (which can be understood as the area between the right border of photo 202 in image 106 and the right border of image 106) can be a third ratio of the image width. Optionally, the first ratio, the second ratio, and the third ratio can be the same or different, and this is not limited.

[0127] In some embodiments, the fill value of the lower region of the photo frame may be a first multiple of the fill value of the left region (or the right region or the upper region).

[0128] For example, if the original image has a ratio of 100*100, the design rule of the photo frame may be: the top border, the left border, and the right border are all 10% of the width of the original image; the bottom border is n times 10%, where n is an integer greater than or equal to 1.

[0129] In some embodiments, if the width of the original image is less than a first threshold, then after adding the smart photo frame, the width of the generated image can be expanded to the first threshold to obtain an image that meets the size specifications. It should be noted that when zooming in or out on an image, the original image's proportions are not changed, but rather the image is zoomed in or out proportionally based on the original image's proportions.

[0130] For example, if the original image has a scale of 50*50, then the original image is enlarged in equal proportion to obtain a 500*500 image, and then the frame area is determined based on the design rules of the frame.

[0131] It will be understood that the above-mentioned design rules regarding the frame specifications of the smart photo frame are merely exemplary descriptions, and the embodiments of the present application are not limited thereto.

[0132] Optionally, the interface shown in (3) of FIG3A further includes an edit text control 107. The edit text control 107 is used to provide the user with one or more of the following functions: editing the content of the text, editing the style of the text, and editing the font type of the text. This will be described later in conjunction with the interface diagrams shown in FIG5 to FIG9.

[0133] It is understood that after obtaining the image 106, the user can save the image 106. The save control 103 in the interface shown in (3) in Figure 3A can provide the function of saving the image 106. Optionally, in response to the user clicking the save control 103, the mobile phone displays a save option on the interface. The save option can include a save method of overwriting the original image and a save method of saving a separate image. The relevant save method can be referred to the implementation in the relevant technology and will not be repeated here.

[0134] Optionally, when the user selects the "Save Picture As" save method, the location where picture 106 is saved in the gallery application can be adjacent to the location where the original picture (photo 202) is saved in the gallery application. Optionally, the name of picture 106 can be determined by referring to the name of photo 202. For example, if photo 202 is named "Landscape", then picture 106 is named "Landscape 1".

[0135] Optionally, (4) in FIG. 3A shows an interface displayed by the mobile phone in response to the user's operation of viewing the picture 106 in the gallery application after the user saves the picture 106 shown in (3) in FIG. 3A .

[0136] Optionally, the photo frame area shown in (2) in FIG3A may include thumbnails of multiple smart photo frames. For example, the photo frame area also includes a thumbnail of smart photo frame 105-2, and smart photo frame 105-2 corresponds to a different photo frame effect than smart photo frame 105-1. Similarly, the thumbnail of smart photo frame 105-2 includes a logo 12 and a second font sample. Logo 12 is also used to distinguish smart photo frames from ordinary photo frames. Furthermore, the second font sample and the first font sample are different types of fonts, that is, smart photo frame 105-1 and smart photo frame 105-2 use different types of fonts. In some embodiments, smart photo frame 105-2 and smart photo frame 105-1 correspond to different photo frame effects, which can be manifested in one or more of the following: (1) different photo frame styles; (2) different font types; (3) different font styles. Optionally, different photo frame styles include one or more of the following: different photo frame shapes; different colors of photo frame fill areas; different textures or patterns filled in photo frame fill areas.

[0137] It should be noted that FIG3A is illustrated using photo 202 as an example, and the embodiments of the present application are not limited thereto. In addition, the frame style corresponding to the same smart photo frame, the font style and font type of the text generated for the picture can be fixed. For example, if the picture to be edited in FIG3A is a photo different from photo 202, then the picture obtained after applying smart photo frame 105-1, the style of the smart photo frame is the same as the frame style of picture 106 shown in (3) in FIG3A, the difference being that the content of the generated text is different. This is because the content of the generated text depends on the picture content of the picture itself, while the text type and / or text style of the text is related to the frame corresponding to the smart photo frame.

[0138] It should also be noted that for the same image, when different smart photo frames are used, the text generated for the image is based on the same copy library or the same text matching algorithm. Therefore, in some cases, the text added to the same image using different smart photo frames may be the same or different; however, the text type and / or style will be different. Of course, the style of the photo frame can also be different.

[0139] Optionally, based on the order of confidence of the texts, after applying different smart photo frames to the same picture, the content of the text added to the picture may be the same, that is, all are the texts with the highest confidence.

[0140] Referring to FIG3B , FIG3B shows an example of an interface for applying another smart photo frame. As shown in FIG3B (1), in response to the user clicking on the thumbnail of the smart photo frame 105-2, the mobile phone displays the interface shown in FIG3B (2) after applying the smart photo frame 105-2. The interface shown in FIG3B (1) is similar to the interface shown in FIG3A (2). For related descriptions, please refer to the description of FIG3A (2), which will not be repeated here. As shown in FIG3B (2), the picture 108 displayed in the interface is the effect after applying the smart photo frame 105-2 to the photo 202, that is, the picture after adding text and a border. The picture 108 includes the content of the photo 202, the border (that is, the gray filled area of ​​the picture 108 shown in FIG3B (2)) and the text (for example, the text A********* shown in the figure). Compared with the picture 106 shown in FIG3A (3), the border specifications (that is, the area of ​​the gray filled area) of the picture 108 and the picture 106 are different, and the font type in the text is different. Furthermore, the text styles of the two may also be different. For example, the different frame specifications may also include different frame shapes.

[0141] It should be understood that the interface shown in FIG. 3B is merely an example description of another smart photo frame, and the embodiments of the present application are not limited thereto.

[0142] It is understandable that the photo frame area shown in FIG. 3A or FIG. 3B may include thumbnails of more smart photo frames. The figure only uses smart photo frame 105 - 1 and smart photo frame 105 - 2 as examples for description, and the embodiments of the present application are not limited thereto.

[0143] When a user taps the Smart Frame, the phone automatically runs the relevant algorithms (including the Smart Text Algorithm and the Text Frame Algorithm). During this process, the algorithm scans and identifies the content of the photo, matching it with appropriate text. During the photo recognition process, animation effects can be displayed in the interface to enhance the user's visual experience.

[0144] In some embodiments, the mobile phone displays an animation effect of identifying a picture in response to a user clicking on a certain smart photo frame. For example, the mobile phone displays an animation effect composed of the picture frames shown in Figure 4 in response to a user clicking on a thumbnail of the smart photo frame 105-1. Taking the interface in Figure 3A as an example, the mobile phone will display an animation effect between the interface shown in Figure 3A (2) and the interface shown in Figure 3A (3). This animation effect can be understood as an animation effect of scanning the content in the picture.

[0145] For example, the interfaces shown in (1) to (3) in Figure 4 are partial frames of the animation effect. The frame includes a scan line, which can move from the bottom of the picture to the top, and then from the top to the bottom, scrolling back and forth up and down to achieve the animation effect of dynamic recognition of the picture. Of course, the display duration of the animation effect may depend on the computing power of the mobile phone. If the mobile phone takes a long time to run the algorithm, the animation effect will continue to scroll until the generated text and photo frame are applied to the picture, and the interface shown in (3) in Figure 3A is displayed. If the mobile phone runs the algorithm for a short time, the duration of the animation effect will be reduced accordingly, and the generated text and photo frame will be applied to the picture after the algorithm is completed, and the interface shown in (3) in Figure 3A is displayed.

[0146] It can be understood that the picture frames shown in Figure 4 (1) to Figure 4 (3) are only some examples of animation effects, and the embodiments of the present application are not limited thereto.

[0147] It is also understood that the scanning animation effect shown in FIG4 can also occur in other scenarios after selecting the smart photo frame, and the embodiments of the present application are not limited thereto. For example, between the interfaces shown in FIG3B (1) and FIG3B (2), the mobile phone will display the animation effect shown in FIG4.

[0148] The mobile phone automatically adds text and a frame to the picture in response to the user's selected smart frame. In order to further enhance the user experience, the embodiment of the present application also provides a function for editing the accompanying text to provide users with more independent choices.

[0149] In some embodiments, the mobile phone modifies or switches the text added through the smart photo frame in response to the user's operation.

[0150] FIG5 shows an example of an interface for manually modifying a text. As shown in FIG5 (1), the image 106 displayed in the interface is an example of a picture after the smart photo frame 105-1 is applied to the photo 202. Below the image 106, the interface also includes an edit text control 107. In response to the user clicking the edit text control 107, the mobile phone displays the interface shown in FIG5 (2).

[0151] As shown in (2) of FIG5 , the interface includes a picture 106 and a window 50. Window 50 includes a text input box, smart text options 501, font options 502, and style options 503. The text input box is used to display the text for picture 106. The text input box shown in (2) of FIG5 displays the text corresponding to smart photo frame 105-1.

[0152] The page of the smart text option 501 is displayed in the window 50 shown in (2) in Figure 5. The smart text option 501 provides five types of text: Text A; Text B; Text C; Text D; and Text E. The five types of text correspond to different contents. In response to the user manually clicking on Text E, the mobile phone displays the interface shown in (3) in Figure 5.

[0153] Optionally, the five types of text provided by the smart text option 501 can be intelligently recommended based on the content of the photo 202. The embodiment of the present application does not specifically limit the intelligent text matching algorithm. In some embodiments, the text generated based on the content of the picture may include the content of the elements in the picture. For example, the photo 202 includes landscape elements such as the sky, the sun, white clouds, and mountain peaks, and corresponding text can be generated based on these elements; accordingly, the text generated for the photo 202 may include one or more of the elements such as the sky, the sun, white clouds, and mountain peaks.

[0154] It can be understood that the five types of text shown in Figure 5 are only exemplary descriptions, and the embodiments of the present application are not limited thereto.

[0155] It is also understood that the embodiment of the present application does not specifically limit the number of recommended documents. For example, in addition to the five documents shown in (2) in FIG5 , the user can view other documents by sliding upward in window 50 .

[0156] Optionally, for different smart photo frames, when the user selects a smart photo frame to enter the smart text recommendation page of the edit text page, except for the default font type of the smart photo frame, the content of the rest of the text recommended to the user for the user to choose independently can be the same, and the arrangement order of the recommended texts can also be the same. For example, (2) in Figure 5 shows that after selecting the smart photo frame 105-1, the smart text recommendation page is entered through the edit text control 107 shown in (1) in Figure 5. If the smart photo frame 105-2 is selected and the smart text recommendation page is entered through the edit text control 107 shown in (2) in Figure 3B, the content of the recommended text can be the same as the text content shown in (1) in Figure 5, and the arrangement order can also be the same.

[0157] As shown in the interface (3) of Figure 5 , the text displayed in picture 106-1 is the text E selected by the user. Correspondingly, the text displayed in the text input box in window 50 is also changed to text E. It can be seen that the text in picture 106-1 has changed compared to picture 106, that is, the text displayed in picture 106-1 is the text manually selected by the user.

[0158] It is understandable that the interface shown in Figure 5 where the user manually selects text to modify the text in the picture is only an exemplary description, and the embodiments of the present application are not limited thereto. In fact, the user can select any text shown in the interface.

[0159] Of course, if the user can also manually enter text in the text input box, this embodiment of the present application does not limit this.

[0160] The interface shown in Figure 5 above is for users to manually select text. This embodiment of the application also provides a control for switching recommended text to achieve the function of quickly switching the recommended text displayed below the image. The following will be described in conjunction with the interface example of Figure 6.

[0161] FIG6 shows an example of an interface for manually switching text. The interface shown in (1) of FIG6 is similar to the interface shown in (1) of FIG5 . For related descriptions, please refer to the description shown in (1) of FIG5 , and no further description is given here. In response to the user clicking the edit text control 107, the mobile phone displays the interface shown in (2) of FIG6 .

[0162] As shown in (2) of Figure 6, the interface includes a picture 106 and a window 60. Window 60 includes a change control 601, a text input box, smart text options, font options, and style options. Window 60 also includes five types of text recommended based on the content of the picture, namely: Text A; Text B; Text C; Text D, and Text E. Among them, the text input box is used to display the text of the picture 106. The text input box shown in (2) of Figure 6 displays the text currently displayed in the picture 106 after applying the smart photo frame 105-1, for example, Text A. It can be seen that the window 60 shown in (2) of Figure 6 has an additional change control 601 compared to the window 50 shown in (2) of Figure 5. The change control 601 is used to switch the five types of text displayed below the picture 106.

[0163] It is understood that the replacement control 601 may also have other names, and the embodiments of the present application are not limited thereto, such as "Change Controls". It is also understood that the icon of the replacement control 601 may also have other forms, and the replacement control 601 shown in (2) of Figure 6 is only an example description, and the embodiments of the present application are not limited thereto.

[0164] In response to the user clicking the change control 601 shown in (2) of Figure 6, the mobile phone displays the interface shown in (3) of Figure 6. As shown in (3) of Figure 6, the five types of text displayed in the window 60 are switched to: Text 1; Text 2; Text 3; Text 4; Text 5. The contents of the five types of text shown in (3) of Figure 6 are different from the contents of the five types of text shown in (2) of Figure 6. Further, the mobile phone again responds to the user clicking the change control 601 shown in (3) of Figure 6 and displays the interface shown in (4) of Figure 6. As shown in (4) of Figure 6, the five types of text displayed in the window 60 are switched to: Text 6; Text 7; Text 8; Text 9; Text 10. The contents of the five types of text shown in (4) of Figure 6 are different from the contents of the five types of text shown in (3) of Figure 6.

[0165] It can be seen that based on the replacement control 601, it is possible to quickly switch to a variety of text recommendations for the picture, thereby providing users with more choices and improving the user experience.

[0166] The embodiment of the present application also provides a control for quickly switching text to realize the function of quickly switching the text in the picture. The following will be described in conjunction with the interface example in Figure 7. Referring to Figure 7, Figure 7 shows an example diagram of an interface for quickly changing the text in the picture.

[0167] In some embodiments, in response to a user clicking on the thumbnail of the smart photo frame (e.g., smart photo frame 105-1) shown in (2) of FIG3A , the mobile phone may display the interface shown in (1) of FIG7 . Compared to the interface shown in (3) of FIG3A , the interface shown in (1) of FIG7 not only includes the edit text control 107 but also adds a change control (or a swap control) 701.

[0168] In response to the user clicking the change control 701 shown in (1) of Figure 7, the mobile phone displays the interface shown in (2) of Figure 7. As shown in (2) of Figure 7, compared with the text A of the picture 106 shown in (1) of Figure 7, the text in the picture 106-4 has been replaced with the text B.

[0169] Furthermore, the mobile phone responds to the user clicking the change control 701 shown in (2) of Figure 7 again, and displays the interface shown in (3) of Figure 7. As shown in (3) of Figure 7, compared with the text B in the picture 106-4 shown in (2) of Figure 7, the text in the picture 106-5 has been replaced with the text C.

[0170] It can be seen that based on the replacement control 701, it is also possible to quickly switch the text in the picture, thereby improving the user experience.

[0171] In some embodiments, the font of text added to a picture via the smart photo frame can be manually changed or adjusted. This will be described below with reference to the example in FIG8 .

[0172] For example, in response to the user clicking on the font option 502 shown in (2) or (3) in FIG5 , or in response to the user clicking on the font option 602 shown in (2) or (3) or (4) in FIG6 , the mobile phone displays the interface shown in (1) in FIG8 . As shown in the interface in (1) in FIG8 , the interface includes a window 80 and a picture 106. Window 80 currently displays settings or parameters related to font types. For example, window 80 includes an icon 802-1 for the Honor font, an icon 802-2 for font type 1, and 14 other types of fonts. Among these 14 types of fonts, the font with a to-be-downloaded identifier (e.g., a downward arrow in the figure) in the icon indicates that the font is a cloud font. For example, font type 7, font type 9, and font type 11 are all to-be-downloaded fonts. The picture 106 shown in (1) in FIG8 defaults to the Honor font, i.e., the font corresponding to icon 802-1, after applying the smart photo frame 105-1.

[0173] In response to the user clicking on icon 802-2, the mobile phone displays the interface shown in (2) of Figure 8. As shown in (2) of Figure 8, the font type of the text in picture 106-6 is font type 1 corresponding to icon 802-2. In other words, after the user manually switches the font, the font type of the text in the picture will change accordingly.

[0174] In some embodiments, during the same photo editing process, if the user manually switches the font and then switches the border style, the font style will no longer automatically match. For example, suppose the default font for Smart Frame A is Font A, and the default font for Smart Frame B is Font B. When the user edits Photo 1 using Smart Frame A, if the user manually switches the font to Font B, then when the user selects Smart Frame B again, Font B will no longer automatically match.

[0175] It is understood that the fonts in the font library can generally be pre-installed. Optionally, the fonts in the font library are generally free commercial fonts, and may also include extended font libraries, etc. The fonts in the font library include local fonts and cloud fonts. Cloud fonts can be understood as fonts stored in a cloud server. For cloud fonts, the mobile phone performs a font download operation in response to the user clicking on the cloud font operation.

[0176] For example, the font type 9 shown in (2) in FIG8 is a cloud font. In response to the user clicking on the icon 802-3 corresponding to the font type 9, the mobile phone starts downloading the font type 9. During the font download process, the download process can be displayed by a dynamic icon. For example, the icon 802-3 shown in (3) in FIG8 displays a loading icon, indicating that the font type 9 is being downloaded. After the font type 9 is downloaded, the font type 9 is automatically applied to the text in the picture. The font type of the text in the picture 106-7 shown in (4) in FIG8 is consistent with the font type 9. In addition, after the font type 9 is downloaded, the icon 802-3 corresponding to the font type 9 no longer displays the pending download mark.

[0177] It can be understood that the various font types shown in FIG8 are merely exemplary descriptions, and the embodiments of the present application are not limited thereto.

[0178] It should be noted that for different smart photo frames, when the user selects a smart photo frame to enter the font type of the editing text page, except for the default font type of the smart photo frame, the font types recommended to the user for self-selection can be the same, and the sorting order of the recommended font types can also be the same. For example, (1) in Figure 8 shows that the font type recommendation page is entered through the editing text control 107 shown in (3) in Figure 3A. If the font type recommendation page is entered through the editing text control 107 shown in (2) in Figure 3B, then the content of the recommended font type can be the same as the font content shown in (1) in Figure 8, and its arrangement order can also be the same as the sorting order of the font types shown in (1) in Figure 8.

[0179] Furthermore, for cloud-based fonts, if the user has already downloaded the font after selecting a smart frame, then when the user subsequently accesses the font type recommendation page through other smart frames, there is no need to download it again, or in other words, the cloud-based font is already a local font. For example, after the font type 9 shown in (3) in Figure 8 is downloaded, when the user enters the font editing page again through smart frame 105-2, the icon corresponding to font type 9 no longer includes the pending download indicator, that is, font type 9 can be used directly.

[0180] In some embodiments, the style of text added to a picture by the smart photo frame can be manually changed or adjusted. This will be described below with reference to the example in FIG9 .

[0181] For example, in response to the user clicking on the style option 503 shown in (2) or (3) in FIG5 , or in response to the user clicking on the style option 603 shown in (2) or (3) or (4) in FIG6 , the mobile phone displays the interface shown in FIG9 . As shown in (1) in FIG9 , the interface includes a window 90 and a picture 106 . Window 90 currently displays settings or parameters related to the font style. For example, window 90 includes a font color setting control 901 and a font transparency adjustment control 902.

[0182] The color corresponding to the font color setting control 901 shown in (1) of FIG9 can be understood as the default color after applying the smart photo frame 105-1. The user can change or manually adjust the color of the text in the picture 106 through the font color setting control 901. For example, in response to the user's operation of adjusting the font color setting control 901, the mobile phone displays the interface shown in (2) of FIG9. It can be seen that compared with the interface shown in (1) of FIG9, the color of the text in the picture 106 shown in (2) of FIG9 has changed. It can be understood that due to the limitation that black and white pictures cannot illustrate specific colors, the example in FIG9 does not constitute a limitation on the scope of protection of the embodiment of the present application, and the specific color can be based on actual implementation.

[0183] The color corresponding to the font transparency adjustment control 902 shown in (1) of FIG9 can be understood as the default transparency parameter (e.g., 50) after applying the smart photo frame 105-1. The user can change or manually adjust the transparency of the text in the picture 106 through the font transparency adjustment control 902. For example, in response to the user's operation of adjusting the font transparency adjustment control 902, the mobile phone displays the interface shown in (3) of FIG9. It can be seen that compared with the interface shown in (1) of FIG9, the transparency parameter of the text in the picture 106 shown in (3) of FIG9 has changed, for example, the transparency parameter is 5.

[0184] It should be noted that for different smart photo frames, when a user selects a smart photo frame and enters the font style adjustment page of the edit text page, the controls displayed to the user for the user to adjust the font style independently can include color controls and / or transparency controls. For example, Figure 9 (1) shows that the font type recommendation page is entered through the edit text control 107 shown in Figure 3A (3). If the font type recommendation page is entered through the edit text control 107 shown in Figure 3B (2), then the recommended control for adjusting the font style can be the same as the control shown in Figure 9 (1).

[0185] It can be seen that based on the interface examples in Figures 8 and 9, users can flexibly choose to change the font and / or style of the text in the image to obtain the desired effect, which significantly improves the user experience.

[0186] It is understood that the interface diagrams shown in Figures 2 to 9 are only for ease of understanding and are not intended to limit the embodiments of the present application to the examples shown in the diagrams. In fact, those skilled in the art can perform equivalent transformations based on the examples in Figures 2 to 9 to obtain more implementation methods.

[0187] Please refer to Figure 10, which is a schematic flow chart of an image processing method provided in an embodiment of the present application. As shown in Figure 10, the method includes:

[0188] Step 910: In response to a first operation by the user, a first interface is displayed, where the first interface includes a first picture and a first display area, where the first display area includes at least a thumbnail of a first photo frame option.

[0189] For example, the first operation may be the user clicking the photo frame control 102 in FIG. 3A (1). The first interface may be the interface shown in FIG. 3A (2). The first display area may be the photo frame area shown in FIG. 3A (2). The thumbnail of the first photo frame option may be the thumbnail of the smart photo frame 105-1 shown in FIG. 3A (2).

[0190] Step 920: In response to the user clicking the thumbnail of the first photo frame option, a second interface is displayed. The second interface includes a second image; the second image includes the first image, the first photo frame, and the first caption; the first caption is located in the area corresponding to the first photo frame. The second image can be understood as the image generated by applying the first photo frame option to the first image.

[0191] Among them, the first photo frame is a border area displayed after the photo frame effect corresponding to the first photo frame option is applied to the first picture; the first accompanying text is text generated based on the content of the first picture; the font style of the first accompanying text is generated based on the style of the first photo frame; the font type of the first accompanying text corresponds to the first photo frame option.

[0192] For example, the second interface is the interface shown in (3) in Figure 3A. The second picture is picture 106 shown in (3) in Figure 3A. The first caption is the text in the gray filled area in picture 106. The first photo frame is the gray filled area in picture 106.

[0193] In an embodiment of the present application, by providing a smart photo frame function during the image editing process, smart text is combined with the photo frame, thereby enabling the rapid addition of text to the image. Compared to editing operations that can only add a photo frame or only add text, the smart photo frame in the embodiment of the present application intelligently generates text for the image while adding the photo frame, thereby efficiently and high-qualityly completing the text frame effect image. Furthermore, the text automatically generated based on the image content can be intelligently matched to the content, color, and border style of the image, thereby ensuring the overall picture effect of the image and enriching the visual experience.

[0194] Furthermore, the captions in the pictures in the embodiments of the present application are automatically generated based on the content of the pictures (e.g., the screen content). Compared to editing operations that can only add a frame or only add text, the smart photo frame in the embodiments of the present application intelligently generates captions for the pictures while adding the frame, thus efficiently and high-quality completing the text frame effect picture.

[0195] In order to further enrich the user's editing experience, based on the smart photo frame, the embodiment of the present application also supports users to manually edit the text in the picture.

[0196] In some embodiments, optionally, the second interface further includes an editing control; and the method further includes:

[0197] In response to a user clicking on the editing control, displaying a third interface, the third interface including the second image and a first window, the first window including a first option and a plurality of captions generated based on the first image, the plurality of captions including at least the first caption and the second caption;

[0198] In response to the user clicking on the second text, the first text in the second picture is replaced with the second text.

[0199] Exemplarily, the operation of the user clicking on the editing control is the operation of the user clicking on the editing text control 107 in Figure 5 (1). The third interface is the interface shown in Figure 5 (2). The first window is the window 50 shown in Figure 5 (2). The first option is the smart text option 501 shown in Figure 5 (2); the second option is the font option 502 shown in Figure 5 (2); and the third option is the style option 503 shown in Figure 5 (2). The first text is the text in the picture shown in Figure 5 (2), "Surrounded by green mountains and green waters, a casual shot is a landscape." The second text is the text in the window 50 shown in Figure 5 (2), "A sky as quiet and clear as an oil painting."

[0200] On the page for editing text, the electronic device can display multiple recommended texts to the user. If the user is not satisfied with the recommended text, they can choose to change the recommended text. The embodiment of the present application provides a control for changing the recommended text to provide users with more options.

[0201] Optionally, the first window further includes a first change control; in response to the user clicking the first change control, some or all of the multiple texts in the first window change.

[0202] For example, the first change control is the change control 601 shown in (2) of Figure 6. After the user clicks the change control 601, the recommended text in the window 60 changes.

[0203] If the user is not satisfied with the text generated in the picture after applying the smart photo frame, the text in the picture can be quickly replaced. The embodiment of the present application provides a control for quickly replacing the text in the picture.

[0204] Optionally, the second interface further includes a second change control; in response to the user clicking the second change control, the text in the second picture is changed to any text among the multiple texts except the first text.

[0205] For example, the second replacement control is the replacement control 701 described in (1) in FIG. 7 .

[0206] If the user is not satisfied with the text type generated in the picture after applying the smart photo frame, then the user can choose to switch the text type in the picture. The embodiment of the present application provides a function of switching text types.

[0207] Optionally, the first window further includes a second option; the method further includes: in response to a user clicking on the second option, displaying a fourth interface, the fourth interface including the second image and the second window, the second window including the first option, the second option, and a plurality of font type icons, the plurality of font type icons including an icon of a first font type and an icon of a second font type; wherein the font type of the first accompanying text is the first font type;

[0208] In response to a user clicking on the icon of the second font type, the font type of the first accompanying text in the second picture is changed from the first font type to the second font type.

[0209] For example, the second window is the window shown in (1) in Figure 8. The operation of the user clicking the icon of the second font type is the operation of the user clicking the icon 802-2.

[0210] It is understood that the fonts in the font library may include local fonts and cloud fonts. If the user selects a cloud font, the cloud font is downloaded to provide the user with more font options.

[0211] Optionally, the multiple font type icons further include an icon of a third font type, the icon of the third font type includes a pending download indicator, and the pending download indicator is used to indicate that the font corresponding to the third font type is in a pending download state;

[0212] In response to a user clicking on the icon of the third font type, downloading the third font type, and displaying the icon of the third font type excluding the to-be-downloaded identifier after the download is complete;

[0213] After the third font type is downloaded, the font type of the first accompanying text in the second picture is switched to the third font type.

[0214] For example, the icon of the third font type is icon 802 - 3 shown in ( 2 ) in FIG. 8 .

[0215] If the user is not satisfied with the text style generated in the picture after applying the smart photo frame, then the user can choose to adjust the text style in the picture. The embodiment of the present application provides a function of switching text styles.

[0216] Optionally, the first window further includes a third option; the method further includes: in response to a user clicking the third option, displaying a sixth interface, the sixth interface including the second image and a third window, the third window including the first option, the second option, the third option, and controls for parameters related to font style, the parameters related to font style including at least a color control and / or a transparency control;

[0217] In response to the user adjusting the color control, the font color of the first text in the second picture is changed from a first color to a second color;

[0218] In response to the user adjusting the transparency control, the font transparency of the first text in the second picture is changed from the first transparency to the second transparency.

[0219] For example, the sixth interface is the interface shown in (1) in Figure 9. The third window is window 90 shown in (1) in Figure 9. The color control is control 901 shown in (1) in Figure 9. The transparency control is control 902 shown in (1) in Figure 9.

[0220] It is understandable that the embodiments of the present application can provide more smart photo frame options for users to choose from.

[0221] Optionally, the first display area further includes a thumbnail of a second photo frame option, wherein the second photo frame option and the first photo frame option are different photo frame options;

[0222] In response to a user clicking on the thumbnail of the second photo frame option, a fifth interface is displayed, wherein the fifth interface includes a third picture; the third picture is a picture generated after the second photo frame option is applied to the first picture, and the third picture includes the first picture, the second photo frame, and the third text; the second photo frame is different from the first photo frame; the third text is located in the area corresponding to the second photo frame; the font type and / or font style of the third text is different from that of the first text.

[0223] Optionally, the content of the third text is the same as or different from that of the first text.

[0224] In other words, the difference between the third picture and the second picture includes one or more of the following: the first text and the second text correspond to different font types; the first photo frame and the second photo frame are different; the first text and the second text correspond to different font styles; the first text and the second text have different contents.

[0225] Optionally, the first photo frame option and the second photo frame option are different, which is reflected in one or more of the following: the first photo frame option and the second photo frame option correspond to different photo frame effects; the first photo frame option and the second photo frame option correspond to different font types; the first photo frame option and the second photo frame option correspond to different font styles.

[0226] In order to better distinguish between ordinary photo frames and the smart photo frame of the embodiment of the present application, an identifier may be added to the thumbnail icon of the smart photo frame so that the user can quickly find the smart photo frame.

[0227] Optionally, the thumbnail of the first photo frame option includes a first identifier, which is used to identify the smart text photo frame; the first display area also includes a thumbnail of a third photo frame option, which does not include the first identifier.

[0228] For example, the first identifier is the identifier 11 shown in (2) of Figure 3A, or the AI ​​identifier. The thumbnail of the third photo frame option is the photo frame 105-3 shown in (2) of Figure 3A.

[0229] Optionally, in response to the user clicking on the thumbnail of the third photo frame option, a seventh interface is displayed, wherein the seventh interface includes a third picture, and the third picture includes the first picture and the third photo frame. In other words, after selecting a normal photo frame, the picture generated after applying the normal photo frame does not include a caption.

[0230] Optionally, before displaying the second interface, the method further includes: displaying a scanning animation effect, where the scanning animation effect includes at least one picture frame, and each picture frame includes the first picture and a scan line.

[0231] For example, the partial picture frames of the scanning animation effect are the picture frames shown in FIG. 4 .

[0232] Optionally, the first photo frame includes an upper frame area, a lower frame area, a left frame area and a right frame area; and the size specifications of each frame area of ​​the first photo frame are determined based on preset rules.

[0233] Optionally, the filling values ​​of the upper border area, the left border area and the right border area are a first proportion of the width of the second image; and the filling value of the lower border area is a second proportion of the width of the second image.

[0234] For example, the specification of the first photo frame is the area corresponding to the gray filled region in the picture 106 shown in (3) in FIG3A .

[0235] Figure 11 is a schematic diagram of the software structure of the electronic device 100 according to an embodiment of the present application. The layered architecture divides the software into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system can be divided into five layers, from top to bottom: the application (APP) layer, the application framework layer (abbreviated as FWK), the system library, and the kernel layer.

[0236] The application layer can include a series of application packages. For example, as shown in Figure 11, the application layer includes a camera application and a gallery application.

[0237] It is understandable that the application layer may also include other applications, such as calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, browser, WeChat, Alipay, Taobao and other applications.

[0238] The application framework layer provides an application programming interface (API) and a programming framework for applications in the application layer. The application framework layer may include some predefined functions.

[0239] It is understandable that the application framework layer may also include other contents, such as a window manager, a content provider, a view system, a phone manager, a resource manager, and a notification manager.

[0240] The window manager is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, and take screenshots.

[0241] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, and phone books.

[0242] The view system includes visual controls, such as those for displaying text and images. The view system can be used to build applications. A display interface can consist of one or more views. For example, a display interface that includes a text notification icon can include a view for displaying text and a view for displaying images. The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files in the application layer and application framework layer as binary files. The virtual machine is responsible for performing functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.

[0243] As shown in FIG11 , the system library may include camera service functions.

[0244] The system library can also include multiple functional modules, such as: surface manager, media library, 3D graphics processing library (such as open graphics library for embedded systems (OpenGL ES)) and 2D graphics engine (such as skia graphics library (SGL)).

[0245] The surface manager is used to manage the display subsystem and provide the fusion of 2D layers and 3D layers for multiple applications.

[0246] The media library supports playback and recording of multiple audio and video formats, as well as still image files. It supports a variety of audio and video codecs, such as MPEG4, H.264, Moving Picture Experts Group Audio Layer III (MP3), Advanced Audio Coding (AAC), Adaptive Multi-Rate (AMR), Joint Photographic Experts Group (JPG), and Portable Network Graphics (PNG).

[0247] The 3D graphics processing library can be used to implement 3D graphics drawing, image rendering, compositing and layer processing.

[0248] A 2D graphics engine is a drawing engine for 2D drawings.

[0249] The kernel layer is the layer between hardware and software. As shown in Figure 11, the kernel layer can include driver modules such as the display driver and the camera driver. The camera driver is the driver layer for camera devices and is primarily responsible for interacting with the hardware.

[0250] For example, a gallery application in the application layer receives a user-triggered viewing operation for viewing a photo with a frame added, and displays the photo on a display screen by calling a display driver.

[0251] As can be seen from the above, the image processing method provided by this application adds access to the "Smart Photo Frame" function in the gallery application. By combining smart text with the photo frame, it is possible to quickly add text to images; and the text style can be intelligently matched according to the content, color, and border style of the image. In addition, the text automatically generated based on the image content allows users to quickly switch, and the text frame effect image is completed efficiently and with high quality, greatly improving the user experience.

[0252] The present invention provides a chip system comprising one or more processors configured to retrieve and execute instructions stored in a memory, thereby executing the method of the present invention. The chip system may be composed of a chip or may include a chip and other discrete devices.

[0253] Among them, the chip system may include an input circuit or interface for sending information or data, and an output circuit or interface for receiving information or data.

[0254] The present application also provides a computer program product, which, when executed by a processor, implements the method described in any method embodiment of the present application.

[0255] The computer program product can be stored in a memory and finally converted into an executable target file that can be executed by a processor through preprocessing, compilation, assembly and linking.

[0256] The present application also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a computer, implements the method described in any method embodiment of the present application. The computer program can be a high-level language program or an executable target program.

[0257] The computer-readable storage medium may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. The non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct rambus RAM (DR RAM).

[0258] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices and equipment and the technical effects produced can refer to the corresponding processes and technical effects in the aforementioned method embodiments, and will not be repeated here.

[0259] In the several embodiments provided in this application, the disclosed systems, devices and methods can be implemented in other ways. For example, some features of the method embodiments described above can be ignored or not executed. The device embodiments described above are merely schematic, and the division of units is only a logical function division. There may be other division methods in actual implementation, and multiple units or components may be combined or integrated into another system. In addition, the coupling between the units or the coupling between the components may be direct coupling or indirect coupling, and the above coupling includes electrical, mechanical or other forms of connection.

[0260] It should be understood that in the various embodiments of the present application, the size of the serial number of each process does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0261] Additionally, the terms "system" and "network" are often used interchangeably. The term "and / or" in this document simply describes a relationship between related objects, indicating that three possible relationships exist. For example, "A and / or B" can mean: A exists alone, A and B exist simultaneously, or B exists alone. Furthermore, the character " / " in this document generally indicates an "or" relationship between the related objects.

[0262] The terms (or numbers) "first", "second", ... etc. that appear in the embodiments of the present application are only used for descriptive purposes, that is, they are only used to distinguish different objects, such as different "pictures", etc., and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, the features defined as "first", "second", ... etc. may explicitly or implicitly include one or more features. In the description of the embodiments of the present application, "at least one (item)" refers to one or more. "Multiple" means two or more. "At least one of the following (item)" or similar expressions refers to any combination of these items, including any combination of a single (item) or plural (items).

[0263] In short, the above description is only a preferred embodiment of the technical solution of this application and is not intended to limit the scope of protection of this application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of this application shall be included in the scope of protection of this application.

Claims

1. A method for image processing, characterized in that, Including: In response to a first operation of the user, a first interface is displayed. The first interface includes a first picture and a first display area, and at least a thumbnail of a first photo frame option is included in the first display area; In response to an operation of the user clicking on the thumbnail of the first photo frame option, a second interface is displayed. The second interface includes a second picture; the second picture includes the first picture, a first photo frame, and a first caption; the first caption is located in the area corresponding to the first photo frame.

2. The method according to claim 1, wherein The second interface further includes an editing control; the method further includes: In response to an operation of the user clicking on the editing control, a third interface is displayed. The third interface includes the second picture and a first window, and a first option and a plurality of captions generated based on the first picture are included in the first window; at least the first caption and a second caption are included in the plurality of captions; In response to an operation of the user clicking on the second caption, the caption in the second picture is replaced with the second caption.

3. The method according to claim 2, wherein A first replacement control is further included in the first window; In response to an operation of the user clicking on the first replacement control, some or all of the captions in the plurality of captions in the first window change.

4. The method according to any one of claims 1 to 3, characterized in that, A second replacement control is further included in the second interface; In response to an operation of the user clicking on the second replacement control, the caption in the second picture is replaced with any caption other than the first caption in the plurality of captions.

5. The method according to any one of claims 2 to 4, characterized in that A second option is further included in the first window; the method further includes: In response to an operation of the user clicking on the second option, a fourth interface is displayed. The fourth interface includes the second picture and a second window, and the first option, the second option, and a plurality of font type icons are included in the second window. The plurality of font type icons include an icon of a first font type and an icon of a second font type; wherein, the font type of the first caption is the first font type; In response to an operation of the user clicking on the icon of the second font type, the font type of the first caption in the second picture is changed from the first font type to the second font type.

6. The method according to claim 5, characterized in that, The plurality of font type icons further include an icon of a third font type, and the icon of the third font type includes a to-be-downloaded identifier, and the to-be-downloaded identifier is used to indicate that the font corresponding to the third font type is in a to-be-downloaded state; The method further includes: In response to an operation of the user clicking on the icon of the third font type, the third font type is downloaded; After the download is completed, the icon of the third font type in the second window does not include the to-be-downloaded identifier; After the third font type is downloaded, the font type of the first caption in the second picture is switched to the third font type.

7. The method according to any one of claims 2 to 6, characterized in that, A third option is further included in the first window; the method further includes: In response to the user's operation of clicking the third option, a sixth interface is displayed, and the sixth interface includes the second picture and a third window. The third window includes the first option, the second option, the third option, and controls for parameters related to the font style. The parameters related to the font style at least include a color control and / or a transparency control; In response to the user's operation of adjusting the color control, the font color of the first caption in the second picture is changed from a first color to a second color; In response to the user's operation of adjusting the transparency control, the font transparency of the first caption in the second picture is changed from a first transparency to a second transparency.

8. The method according to any one of claims 1 to 7, characterized in that, The first display area further includes a thumbnail of a second photo frame option, where the second photo frame option is a different photo frame option from the first photo frame option; The method further includes: In response to the user's operation of clicking the thumbnail of the second photo frame option, a fifth interface is displayed, and the fifth interface includes a third picture; The third picture includes the first picture, a second photo frame, and a third caption; The second photo frame is different from the first photo frame; The third caption is located in the area corresponding to the second photo frame; The font type and / or font style of the third caption is different from that of the first caption.

9. The method according to claim 8, wherein The content of the first caption and the third caption may be the same or different.

10. The method according to any one of claims 1 to 9, characterized in that The thumbnail of the first photo frame option includes a first identifier for identifying an intelligent caption photo frame; The first display area further includes a thumbnail of a third photo frame option, and the thumbnail of the third photo frame option does not include the first identifier.

11. The method according to claim 10, characterized in that, The method further includes: In response to the user's operation of clicking the thumbnail of the third photo frame option, a seventh interface is displayed, and the seventh interface includes a third picture, and the third picture includes the first picture and a third photo frame.

12. The method according to any one of claims 1 to 11, characterized in that, The first photo frame is the border area displayed after applying the photo frame effect corresponding to the first photo frame option to the first picture; The first caption is the text generated based on the content of the first picture; The font style of the first caption is generated based on the style of the first photo frame; The font type of the first caption corresponds to the first photo frame option.

13. The method according to any one of claims 1 to 12, characterized in that, Before displaying the second interface, the method further includes: Displaying a scanning animation effect, which includes at least one frame, and each frame includes the first picture and a scanning line.

14. The method according to any one of claims 1 to 13, characterized in that The first photo frame includes an upper border area, a lower border area, a left border area, and a right border area; The size specifications of the respective border areas of the first photo frame are determined based on a preset rule.

15. An electronic device, characterized in that, Including a processor and a memory, the processor and the memory are coupled, and the memory is used to store a computer program. When the computer program is executed by the processor, the electronic device executes the method according to any one of claims 1 to 14.

16. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program. When the computer program is executed by a processor, the electronic device executes the method according to any one of claims 1 to 14.

17. A chip system, characterized in that, The chip system is applied to an electronic device, and the chip system includes one or more processors, and the processors are configured to call computer instructions so that the electronic device executes the method according to any one of claims 1 to 14.