Graffiti processing method and related apparatus

By providing a drawing processing method with a multi-functional primary toolbar and swipe operation on the terminal device, the problem of low flexibility in the image processing function of the terminal device is solved, and the convenience and experience of user operation are improved.

CN117891537BActive Publication Date: 2026-01-02HONOR DEVICE CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202211261760.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-10-14
Publication Date
2026-01-02
Estimated Expiration
2042-10-14

AI Technical Summary

Technical Problem

The image processing capabilities of existing terminal devices are not very flexible, making them inconvenient for users and resulting in a poor user experience.

Method used

This invention provides a method for processing graffiti by displaying a primary toolbar on the terminal device. This toolbar includes functions such as cropping, filtering, adjustment, beautification, graffiti, text, mosaic, watermark, frame, blurring, and color preservation. Users can select the desired function from the primary toolbar and slide to hide or show it, enabling one-click saving and convenient addition and erasure of graffiti.

Benefits of technology

It improves the convenience and flexibility of user operation, reduces the number of interface jumps, and enhances the user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117891537B_ABST
    Figure CN117891537B_ABST
Patent Text Reader

Abstract

Embodiments of the present application provide a scribbling processing method and related device. The method comprises: a terminal device displays a first picture; the terminal device receives a first operation; in response to the first operation, the terminal device displays a first layer of scribbling on an upper layer of the first picture; the terminal device receives a second operation; in response to the second operation, the terminal device adds a first type of element to the first picture, wherein the first type of element does not belong to scribbling; the terminal device receives a third operation; in response to the third operation, the terminal device displays a second layer of scribbling on an upper layer of the first picture; the terminal device receives an erasing operation, and a region affected by the erasing operation comprises the first layer of scribbling and the second layer of scribbling; in response to the erasing operation, the terminal device erases the region affected by the erasing operation in the first layer of scribbling, and erases the region affected by the erasing operation in the second layer of scribbling, to obtain a second picture. In this way, the flexibility and convenience of scribbling processing can be improved, and the user experience can be improved.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of terminals, and in particular to a scribbling processing method and related device. BACKGROUND

[0002] With the development of terminal technology, the image processing functions supported by terminal devices are increasingly rich, and users can process a target picture through an editing function in a gallery application of the terminal device.

[0003] However, when using the image processing function of the terminal device to process a picture, the flexibility of the processing is low, the convenience is poor, and the processing result of the picture can not meet the user's expectation, affecting the user's experience. SUMMARY

[0004] Embodiments of the present application provide a scribbling processing method and related device, applied to the technical field of terminals.

[0005] In a first aspect, an embodiment of the present application provides a scribbling processing method, which includes:

[0006] The terminal device displays a first picture; the terminal device receives a first operation; in response to the first operation, the terminal device displays a first layer of scribbling on an upper layer of the first picture; the terminal device receives a second operation; in response to the second operation, the terminal device adds an element to the first picture, wherein the element does not belong to scribbling; the terminal device receives a third operation; in response to the third operation, the terminal device displays a second layer of scribbling on the upper layer of the first picture; the terminal device receives an erasing operation, and a region affected by the erasing operation includes the first layer of scribbling and the second layer of scribbling; in response to the erasing operation, the terminal device erases the region affected by the erasing operation in the first layer of scribbling and the region affected by the erasing operation in the second layer of scribbling, to obtain a second picture. In this way, all added scribbling can be erased at one time, making the operation of the user more convenient and improving the user's experience.

[0007] In a possible implementation, the element includes one or more of the following: text, watermark, sticker, or mosaic.

[0008] In a possible implementation, after the terminal device displays the first picture, the method further includes: the terminal device receives a fourth operation for the first picture in the gallery application; and in response to the fourth operation, the terminal device displays a toolbar, wherein the toolbar includes a primary toolbar and does not include a secondary toolbar. In this way, the user can select the function to be used in the toolbar, without the need to expand the secondary toolbar, facilitating the user to find each function, reducing the number of interface jumps, and making the operation of the user more convenient.

[0009] In a possible implementation, the one-level toolbar includes one or more of the following functions: cropping, filters, adjustment, beautifying, doodling, text, mosaic, watermark, photo frame, blurring, color preservation, or stickers. In this way, all the picture processing functions are placed in one toolbar, the user can select the function to be used in the one-level toolbar, the user can easily find the functions, the number of interface jumps is reduced, and the user operation is more convenient.

[0010] In a possible implementation, some functions are displayed in the one-level toolbar, and the method further includes: when a sliding operation is received in the one-level toolbar, displaying the functions hidden in the sliding direction in the one-level toolbar based on the sliding direction of the sliding operation. In this way, all the picture processing functions are placed in one toolbar, the user can select the function to be used through the sliding operation, the second-level toolbar does not need to be expanded, the user can easily find the functions, the number of interface jumps is reduced, and the user operation is more convenient.

[0011] In a possible implementation, after the terminal device obtains the second picture, the method further includes: the terminal device receives a fifth operation; and in response to the fifth operation, the terminal device saves the second picture. In this way, the processed picture can be saved by one key, and the user operation is more simple and fast.

[0012] In a possible implementation, before the terminal device adds the element to the first picture, the method further includes: the terminal device receives a sixth operation; in response to the sixth operation, the terminal device displays a filter toolbar, the filter toolbar includes one or more filter options; when a trigger to a first filter option in the plurality of filter options is received, the terminal device adds a first filter corresponding to the first filter option to the first picture, and displays the first filter option in a selected state; and before the terminal device adds the element to the first picture, the method further includes: the terminal device receives a seventh operation; in response to the seventh operation, the terminal device displays the filter toolbar, and the first filter option is in the selected state in the filter toolbar; when a trigger to a second filter option in the plurality of filter options is received, the terminal device switches the first filter to a second filter corresponding to the second filter option, the second filter option is in the selected state and the first filter option is in the unselected state in the filter toolbar. In this way, the user operation is more convenient, and the user experience is improved.

[0013] In a possible implementation, before the terminal device adds the element to the first picture, the method further includes: receiving, by the terminal device, an eighth operation; in response to the eighth operation, adding, by the terminal device, a first text to the first picture; and before the terminal device adds the element to the first picture, the method further includes: receiving, by the terminal device, a ninth operation; in response to the ninth operation, displaying, by the terminal device, the first text in an editable state; receiving, by the terminal device, a tenth operation; and in response to the tenth operation, modifying, by the terminal device, the first text to a second text. In this way, the user can conveniently process the picture, and the user experience is improved.

[0014] In a possible implementation, before the terminal device receives the third operation, the method further includes: receiving, by the terminal device, an eleventh operation; in response to the eleventh operation, adding, by the terminal device, a photo frame to the periphery of the first picture; receiving, by the terminal device, a cropping operation, the cropping operation continuously acting on the interface of the terminal device; and when the cropping operation continuously acts on the interface of the terminal device, the terminal device does not display the photo frame; and when the cropping operation ends, obtaining, by the terminal device, a third picture, the periphery of the third picture including the photo frame. In this way, when the user crops the picture, the photo frame is not affected by the cropping, and the photo frame can be displayed again in the periphery of the cropped picture after the cropping is completed, the user's expectation of processing the picture is met, and the user experience is improved.

[0015] In a possible implementation, before the terminal device displays the first picture, the method further includes: displaying, by the terminal device, an interface of a photo gallery, the interface of the photo gallery including one or more pictures; receiving, by the terminal device, a twelfth operation; and in response to the twelfth operation, displaying, by the terminal device, the first picture. In this way, the user can process the picture through the photo gallery application in the terminal device, without the need to import the picture in a third-party picture processing software for processing, so that the picture processing is more convenient and fast.

[0016] In a second aspect, the embodiments of the present application provide a graffiti processing apparatus. The graffiti processing apparatus can be a terminal device, or a chip or chip system in the terminal device. The graffiti processing apparatus can include a processing unit and a display unit. The processing unit is configured to implement any method related to processing in the first aspect or any possible implementation of the first aspect. When the graffiti processing apparatus is a terminal device, the processing unit can be a processor. The display unit is configured to support the graffiti processing apparatus to display image information, etc. The graffiti processing apparatus can further include a storage unit, which can be a memory. The storage unit is configured to store instructions. The processing unit executes the instructions stored in the storage unit, so that the terminal device implements a method described in the first aspect or any possible implementation of the first aspect. When the graffiti processing apparatus is a chip or chip system in the terminal device, the processing unit can be a processor. The processing unit executes the instructions stored in the storage unit, so that the terminal device implements a method described in the first aspect or any possible implementation of the first aspect. The storage unit can be a storage unit (e.g., a register, a cache, etc.) in the chip, or a storage unit (e.g., a read-only memory, a random access memory, etc.) in the terminal device and located outside the chip.

[0017] For example, the display unit is configured to display the first picture; the processing unit is configured to receive a first operation; in response to the first operation, the display unit is further configured to display a first layer of graffiti on top of the first picture; the processing unit is further configured to receive a second operation; in response to the second operation, the processing unit is further configured to add an element to the first picture, wherein the element does not belong to graffiti; the processing unit is further configured to receive a third operation; in response to the third operation, the display unit is further configured to display a second layer of graffiti on top of the first picture; the processing unit is further configured to receive an erasing operation, wherein the erasing operation is performed on an area including the first layer of graffiti and the second layer of graffiti; in response to the erasing operation, the processing unit is further configured to erase the area in the first layer of graffiti and the area in the second layer of graffiti, to obtain a second picture.

[0018] In a possible implementation, the element includes one or more of the following: text, a watermark, a sticker, or a mosaic.

[0019] In a possible implementation, the processing unit is further configured to receive a fourth operation for the first picture in a gallery application; in response to the fourth operation, the display unit is further configured to display a toolbar, wherein the toolbar includes a primary toolbar and does not include a secondary toolbar.

[0020] In a possible implementation, the primary toolbar includes one or more of the following functions: cropping, a filter, adjustment, beautification, graffiti, text, a mosaic, a watermark, a photo frame, blurring, color preservation, or a sticker.

[0021] In a possible implementation, the display unit is further configured to display part of the functions in the first-level toolbar, and display the functions hidden in the first-level toolbar in a sliding direction based on a sliding operation when the sliding operation is received in the first-level toolbar.

[0022] In a possible implementation, the processing unit is further configured to receive a fifth operation, and in response to the fifth operation, the processing unit is further configured to save the second picture.

[0023] In a possible implementation, the processing unit is further configured to receive a sixth operation, and in response to the sixth operation, the display unit is further configured to display a filter toolbar, the filter toolbar including one or more filter options; the processing unit is further configured to add a first filter corresponding to a first filter option to the first picture when a trigger to the first filter option is received, and the display unit is further configured to display the first filter option in a selected state; the processing unit is further configured to receive a seventh operation, and in response to the seventh operation, the display unit is further configured to display the filter toolbar, the first filter option being in the selected state in the filter toolbar; the processing unit is further configured to switch the first filter to a second filter corresponding to a second filter option when a trigger to the second filter option is received, the second filter option being in the selected state and the first filter option being in an unselected state in the filter toolbar.

[0024] In a possible implementation, the processing unit is further configured to receive an eighth operation, and in response to the eighth operation, the processing unit is further configured to add a first text to the first picture; the processing unit is further configured to receive a ninth operation, and in response to the ninth operation, the display unit is further configured to display the first text in an editable state; the processing unit is further configured to receive a tenth operation, and in response to the tenth operation, the processing unit is further configured to modify the first text to a second text.

[0025] In a possible implementation, the processing unit is further configured to receive an eleventh operation, and in response to the eleventh operation, the processing unit is further configured to add a photo frame to a periphery of the first picture; the processing unit is further configured to receive a cropping operation, the cropping operation continuously acting on an interface of the terminal device; when the cropping operation continuously acts on the interface of the terminal device, the terminal device does not display the photo frame; and when the cropping operation ends, the processing unit is further configured to obtain a third picture, the periphery of the third picture including the photo frame.

[0026] In a possible implementation, the display unit is further configured to display an interface of a gallery, the interface of the gallery including one or more pictures; and the processing unit is further configured to receive a twelfth operation, and in response to the twelfth operation, the display unit is further configured to display the first picture.

[0027] In a third aspect, an electronic device is provided, including a processor and a memory. The memory is configured to store code instructions, and the processor is configured to execute the code instructions to perform the method described in the first aspect or any possible implementation manner of the first aspect.

[0028] In a fourth aspect, a computer readable storage medium is provided. The computer readable storage medium stores a computer program. The computer program is executed by a processor to implement the method of the first aspect.

[0029] In a fifth aspect, a computer program product is provided. The computer program product includes a computer program. When the computer program is executed, the computer program causes a computer to perform the method of the first aspect.

[0030] In a sixth aspect, a chip is provided. The chip includes a processor configured to invoke a computer program in a memory to perform the method of the first aspect.

[0031] It should be understood that the second aspect to the sixth aspect of the present application correspond to the technical solution of the first aspect of the present application, and the beneficial effects obtained by each aspect and the corresponding possible implementation manners are similar, and will not be repeated. BRIEF DESCRIPTION OF DRAWINGS

[0032] Figure 1 An illustrative diagram is added for a scribble in a possible implementation;

[0033] Figure 2 An illustrative diagram is added for an element in a possible implementation;

[0034] Figure 3 An illustrative diagram is added for picture cropping in a possible implementation;

[0035] Figure 4 An illustrative diagram is added for filter adding in a possible implementation;

[0036] Figure 5 An illustrative diagram is added for scribble erasing in a possible implementation;

[0037] Figure 6 An illustrative diagram is added for an editing process in a possible implementation;

[0038] Figure 7 A structural schematic diagram of a terminal device provided by an embodiment of the present application is shown;

[0039] Figure 8 A software architecture schematic diagram of a terminal device provided by an embodiment of the present application is shown;

[0040] Figure 9A A logical layer schematic diagram provided by an embodiment of the present application is shown;

[0041] Figure 9B A physical layer schematic diagram provided for an embodiment of the present application;

[0042] Figure 10 A toolbar schematic diagram provided for an embodiment of the present application;

[0043] Figure 11 A filter editing interface diagram provided for an embodiment of the present application;

[0044] Figure 12 A text editing interface diagram provided for an embodiment of the present application;

[0045] Figure 13 A picture cropping interface diagram provided for an embodiment of the present application;

[0046] Figure 14 A scribble erasing interface diagram provided for an embodiment of the present application;

[0047] Figure 15 A structure schematic diagram of a scribble processing device provided for an embodiment of the present application;

[0048] Figure 16 A hardware structure schematic diagram of a control device provided for an embodiment of the present application;

[0049] Figure 17 A structure schematic diagram of a chip provided for an embodiment of the present application. DETAILED DESCRIPTION

[0050] In order to clearly describe the technical solutions of the embodiments of the present application, the following briefly introduces some terms and technologies involved in the embodiments of the present application:

[0051] 1. Terms

[0052] In order to clearly describe the technical solutions of the embodiments of the present application, in the embodiments of the present application, the words such as "exemplary" or "for example" are used to represent as an example, illustration or description. Any embodiment or design scheme described as "exemplary" or "for example" in the present application should not be interpreted as more preferred or more advantageous than other embodiments or design schemes. Rather, the words such as "exemplary" or "for example" are intended to present the relevant concepts in a specific manner.

[0053] In the embodiments of this application, "at least one" means one or more, and "multiple" means two or more. The "and / or" describes the association relationship of the associated objects, which means that there can be three kinds of relationships, for example, A and / or B can represent: A exists alone, A and B exist together, and B exists alone, where A and B can be singular or plural. The character " / " generally represents a "or" relationship between the associated objects before and after. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or multiple items. For example, at least one of a, b, or c can represent: a, b, c, a-b, a-c, b-c, or a-b-c, where a, b, and c can be single or multiple.

[0054] It should be noted that "at the time" in the embodiments of this application can be at the moment when a certain condition occurs, or within a period of time after a certain condition occurs, which is not limited in the embodiments of this application. In addition, the display interface provided by the embodiments of this application is only an example, and the display interface can also include more or less content.

[0055] 2. Terminal device

[0056] The terminal device of the embodiments of the present application can also be any form of electronic device. For example, the electronic device can include a handheld device with image processing function, a vehicle-mounted device, etc. For example, some electronic devices are: a mobile phone, a tablet computer, a palm computer, a notebook computer, a mobile internet device (MID), a wearable device, a virtual reality (VR) device, an augmented reality (AR) device, a wireless terminal in industrial control, a wireless terminal in self driving, a wireless terminal in remote medical surgery, a wireless terminal in smart grid, a wireless terminal in transportation safety, a wireless terminal in smart city, a wireless terminal in smart home, a cellular phone, a cordless phone, a session initiation protocol (SIP) phone, a wireless local loop (WLL) station, a personal digital assistant (PDA), a handheld device with wireless communication function, a computing device or other processing device connected to a wireless modem, a vehicle-mounted device, a wearable device, a terminal device in a 5G network, or a terminal device in a future evolved public land mobile network (PLMN), etc. The embodiments of the present application are not limited thereto.

[0057] By way of example and not limitation, in the embodiments of the present application, the electronic device can also be a wearable device. The wearable device can also be referred to as a wearable smart device, which is a general term for devices that are designed and developed by applying wearable technology to daily wear, such as glasses, gloves, watches, clothing, and shoes, etc. The wearable device is a portable device that is directly worn on the body or integrated into the clothes or accessories of the user. The wearable device is not only a hardware device, but also has strong functions through software support and data interaction and cloud interaction. The general wearable smart device includes a device with full function and large size, which can realize complete or partial functions without relying on a smart phone, such as a smart watch or smart glasses, etc., and a device that focuses on a certain application function and needs to cooperate with other devices such as a smart phone, such as various smart wristbands and smart jewelry for monitoring vital signs, etc.

[0058] Furthermore, in this embodiment of the application, the electronic device can also be a terminal device in the Internet of Things (IoT) system. IoT is an important part of the future development of information technology. Its main technical feature is to connect objects to the network through communication technology, thereby realizing an intelligent network of human-machine interconnection and object-to-object interconnection.

[0059] The electronic devices in the embodiments of this application may also be referred to as: terminal equipment, user equipment (UE), mobile station (MS), mobile terminal (MT), access terminal, user unit, user station, mobile station, mobile station, remote station, remote terminal, mobile device, user terminal, terminal, wireless communication equipment, user agent, or user device, etc.

[0060] In this embodiment, the electronic device or various network devices include a hardware layer, an operating system layer running on top of the hardware layer, and an application layer running on top of the operating system layer. The hardware layer includes hardware such as a central processing unit (CPU), a memory management unit (MMU), and memory (also called main memory). The operating system can be any one or more computer operating systems that implement business processing through processes, such as Linux, Unix, Android, iOS, or Windows. The application layer includes applications such as browsers, address books, word processing software, and instant messaging software.

[0061] Understandably, in Figures 1-6 , Figures 10-14 In the corresponding embodiments, the terminal device is a mobile phone and the image processing application built into the terminal device is the gallery application in the mobile phone. This example does not constitute a limitation on the embodiments of this application.

[0062] For example, Figure 1 Add an illustration to one possible implementation of the graffiti.

[0063] like Figure 1 As shown in Figure a, the phone's gallery application (APP) can include one or more images. After the phone receives a user's selection of an image from the gallery application, such as image 101, the phone's display interface changes accordingly. Figure 1 Switch 'a' to Figure 1 b in the text.

[0064] like Figure 1As shown in Figure b, the phone's interface includes image 101, a share icon, a favorite icon, an edit icon 102, a delete icon, and more icons. When the phone receives a user's selection of an icon, it can perform the corresponding operation on image 101. When the phone receives a user's selection of the edit icon 102, the phone's display interface changes accordingly. Figure 1 Switch b in the middle to Figure 1 c in the text.

[0065] like Figure 1 As shown in Figure c, the mobile phone's interface includes image 101 and a primary toolbar 104. The primary toolbar 104 can include crop icons, filter icons, adjustment icons, and more icons 103. When the mobile phone receives a user's selection of an icon, it can process image 101 accordingly. When the mobile phone receives a user's selection of more icons 103, the mobile phone's display interface changes accordingly. Figure 1 Switching 'c' to Figure 1 d in the text.

[0066] like Figure 1 The interface shown in Figure d on the mobile phone screen includes image 101, a primary toolbar 104, and a secondary toolbar 105. (See figure d.) Figure 1 As shown in Figure d, the secondary toolbar 105 may include beauty icons, text icons, doodle icons 106, mosaic icons, watermark icons, and frame icons. In possible implementations, the secondary toolbar 105 may also include blur icons, color preservation icons, sticker icons, etc.

[0067] Understandably, given the limited screen size of terminal devices, the content of the secondary toolbar 105 may not be fully displayed. When the terminal device receives a user's swipe gesture on the secondary toolbar 105, the secondary toolbar 105 can display hidden content. For example, on a mobile phone interface, the displayed content of the secondary toolbar 105 includes beauty icons, text icons, doodle icons, mosaic icons, watermark icons, and frame icons, while the hidden content includes blur icons, color retention icons, and sticker icons. In response to the user's swipe gesture on the secondary toolbar, the mobile phone interface can display the hidden content of the secondary toolbar.

[0068] When the phone receives the user's selection of the doodle icon 106, the phone's display interface changes from... Figure 1 Switching d in Figure 1 The 'e' in the middle.

[0069] like Figure 1 The interface shown in Figure e includes image 101, doodle function bar 107, and doodle style bar 108.

[0070] In a possible implementation, users can adjust the thickness of the graffiti lines using the thickness function in the graffiti function bar 107; users can select the style of the graffiti pen using the pen shape function in the graffiti function bar 107; users can erase graffiti using the eraser function in the graffiti function bar 107; and users can select the color of the graffiti using the color function in the graffiti function bar 107.

[0071] In one possible implementation, users can select a graffiti style through the graffiti style bar 108. For example, users can choose a graffiti style such as a curve, a straight line, a straight line with an arrow, a rectangle, or a circle.

[0072] When the phone receives a user's action of drawing a trajectory on the phone screen, the phone responds to the user's action by adding doodles corresponding to the user's drawn trajectory to the image.

[0073] It is understood that in possible implementations, users can draw trajectories using input devices such as a mouse, or they can draw trajectories on a touchscreen using their fingers, styluses, etc. This application does not specifically limit this.

[0074] like Figure 1 As shown in f, the phone responds to the user's action of drawing the trajectory of the number "1" on the phone screen by adding a doodle with the content of the number "1" on image 101.

[0075] After the phone adds a doodle with the number "1" to image 101, it can continue to respond to the user's drawing of the trajectory, such as... Figure 1 As shown in 'g', the phone adds a doodle with the number "2" to image 101; as shown in 'g'. Figure 1 As shown in h, add a doodle with the number "3" to image 101.

[0076] When the phone receives the user's confirmation button 109, the phone completes the operation of adding doodles to image 101, and the phone's display interface changes. Figure 1 Switching h in the middle to Figure 1 The 'i' in the text.

[0077] like Figure 2 As shown in Figure i, the interface displayed by the mobile phone includes image 101, doodle 210 containing the text "123", and a save button 305. When the mobile phone receives the user's selection of the save button 305, the mobile phone can save the image 101 after adding the doodle.

[0078] After adding doodles to an image, the phone also supports adding other elements to the image, for example, Figure 2 Add a schematic diagram for one possible implementation of the element.

[0079] like Figure 2As shown in Figure a, the mobile phone's interface includes image 101, doodle 210, a primary toolbar 104, and a secondary toolbar 105. When the mobile phone receives a user's selection of text icon 202 in the secondary toolbar 105, the mobile phone's display interface changes accordingly. Figure 2 Switch 'a' to Figure 2 b in the text.

[0080] like Figure 2 As shown in Figure b, the mobile phone interface includes image 101 and a text adjustment overlay 203. Users can input text, letters, numbers, symbols, etc., using the keyboard in the text adjustment overlay 203. The mobile phone responds to the user's input by adding the user-inputted content onto the image. For example... Figure 2 As shown in b, the phone responds to the user's operation of inputting the word "text" through the keyboard in the text adjustment layer 203, and adds text 220 to image 101.

[0081] In a possible implementation, users can also select bubble styles and add bubbles to text through the bubble options in the text adjustment layer 203. Users can also select text styles and modify the font, color, size, etc. of the text through the style options in the text adjustment layer 203.

[0082] When the phone receives a confirmation option 204 from the user clicking on the text adjustment overlay 203, the phone completes the operation of adding text 220 to the image, and the phone's display interface changes from... Figure 2 Switch b in the middle to Figure 2 c in the text.

[0083] like Figure 2 As shown in Figure c, the phone's interface includes image 101, doodle 210, and text 220. When the phone receives a user's request to select the watermark function 205 and add a watermark to image 101, the phone can add the watermark to image 101. The watermark added by the user can be as follows: Figure 2 The watermark in the middle is shown as 250.

[0084] like Figure 2 As shown in the interface below (d), the image 101 displayed on the phone includes doodles 210, text 220, and a watermark 250. Responding to the user's swiping of the secondary toolbar, the phone interface can display the hidden blur function, color preservation function, and sticker function of the secondary toolbar. When the phone receives the user's selection of the sticker function 206 and the addition of a sticker to image 101, the added sticker can be displayed on image 101. The user-added sticker can be displayed as follows... Figure 2 The sticker number 260 in the middle is shown.

[0085] like Figure 3As shown in the interface, the image 101 displayed on the phone includes doodles 210, text 220, a watermark 250, and stickers 260. When the phone receives a user's request to select the frame function 207 and add a frame to image 101, the added frame can be displayed on image 101. The user-added frame can be displayed as follows: Figure 3 The frame 270 in the middle f is shown.

[0086] like Figure 3 The interface shown in Figure f displays an image 101 on the phone that includes doodles 210, text 220, watermarks 250, stickers 260, and frames 270.

[0087] After adding elements such as doodles, watermarks, stickers, and frames to an image, the phone can also crop the image. For example, Figure 3 This is a schematic diagram of a possible image cropping implementation.

[0088] like Figure 3 As shown in Figure a, the image 101 displayed on the phone includes doodles 210, text 220, watermark 250, stickers 260, and a frame 270. When the phone receives a user's selection of the cropping function 301, the phone's display interface changes. Figure 3 Switch 'a' to Figure 3 b in the text.

[0089] like Figure 3 As shown in Figure b, the interface displayed on the mobile phone may include image 101, a secondary cropping toolbar 302, and a cropping adjustment bar 303. Doodles 210, text 220, watermarks 250, stickers 260, and frames 270 added to the image are temporarily not displayed. Users can crop the image by manipulating the cropping box 304, such as zooming in or out. The cropping action continuously applies to image 101.

[0090] When the phone detects that the user has raised their hand away from the screen, the phone's display interface changes. Figure 3 Switch b in the middle to Figure 3 c. When the phone receives the user's confirmation button 109, the phone's display interface changes from... Figure 3 Switching 'c' to Figure 3 d in the text.

[0091] like Figure 3 As shown in Figure d, the cropped image 306 includes parts of the doodle and sticker content; the text, watermark, and frame have all been cropped. When the phone receives a user's click on the save button 305, it can save the cropped image 306.

[0092] In other words, during the cropping process, elements added to the image, such as text, doodles, watermarks, stickers, frames, and mosaics, are temporarily not displayed. Cropping can be applied to both the image and these elements. When the phone receives the user's operation to crop the image, the user cannot see the elements added to the image. As a result, the cropped image may not meet the user's expectations.

[0093] Understandably, in Figure 3 In the interface of d, the user can also trigger the undo button 307. In response to the user's undo operation, the interface displayed on the phone changes from... Figure 4 d switch to Figure 4 e. For example, Figure 4 As shown in e, the image displayed on the phone reverts to the original image 101 before cropping. Image 101 includes doodles 210, text 220, watermark 250, stickers 260, and a frame 270.

[0094] Furthermore, the phone can also support adding filters to images, for example, Figure 4 Add an illustration for one possible implementation of the filter.

[0095] like Figure 4 As shown in Figure a, when the mobile phone receives the user's operation of selecting the filter function 401 in the first-level toolbar 104, the mobile phone's display interface changes from... Figure 4 Switch 'a' to Figure 4 b in the text.

[0096] like Figure 4 As shown in Figure b, the mobile phone's interface includes image 101 and a filter function bar 402. When the mobile phone receives the user's operation of selecting filter 3 in the filter function bar 402, the mobile phone's display interface changes from... Figure 4 Switch b in the middle to Figure 4 c in the text.

[0097] like Figure 4 As shown in Figure c, filter 3 in the filter function bar is selected. The image 101 displayed on the phone screen is the image after the filter has been applied. The filter function applies to image 101 and all elements added to image 101. Among them, the elements added to image 101 include text, watermarks, stickers, doodles, and frames.

[0098] When the phone receives the user's selection of text 220, the phone does not respond to the operation, and the user cannot modify the text that has already been added.

[0099] When the phone receives the user's operation to select adjustment function 403, the phone's display interface changes from... Figure 4 Switching 'c' to Figure 4 d in the text.

[0100] likeFigure 5 The interface shown in d, the interface displayed by the phone includes the picture 101, the adjustment function bar 404. When the phone receives the operation of the user selecting the brightness function in the adjustment function bar 404, the brightness of the picture is adjusted through the parameter adjustment bar 405 in the adjustment function bar 404, and the brightness adjustment can act on the picture 101 and all elements added to the picture 101.

[0101] As shown in Figure 5 The picture displayed by the phone is the picture after brightness adjustment, and each element included in the picture is the element after brightness adjustment. When the phone receives the operation of the user selecting the filter function 401, the display interface of the phone is switched from e in Figure 5 to f in Figure 5 .

[0102] As shown in Figure 5 After the user adds a filter to the picture, the picture is further operated other than the filter, and when the phone receives the operation of the user selecting the filter function 401 again, the original picture in the filter function bar is in the selected state, and the gallery application cannot locate the filter added by the user as filter 3, that is, the gallery application cannot remember the filter added by the user to the picture.

[0103] After adding the graffiti in the picture, the phone can also support erasing the added graffiti. Exemplarily, Figure 5 is a schematic diagram of graffiti erasing in one possible implementation.

[0104] As shown in the interface of a in Figure 5 The picture 101 displayed by the phone includes the graffiti 210. When the phone receives the operation of the user selecting the graffiti icon 106, the display interface of the phone is switched from a in Figure 5 to b in Figure 5 .

[0105] As shown in b in Figure 5 The interface displayed by the phone can include the picture 101, the graffiti function bar 107, and the graffiti style bar 108. When the phone receives the operation of the user selecting the rectangular option in the graffiti style bar 108 and adding graffiti on the picture, the phone adds the rectangular graffiti to the picture 101.

[0106] As shown in c in Figure 5 The picture 101 displayed by the phone includes the graffiti 210 and the rectangular graffiti 230. When the phone receives the operation of the user selecting the eraser option in the graffiti function bar 107, the phone can erase the rectangular graffiti 230.

[0107] As shown in Figure 5As shown in d of FIG. 10, after the mobile phone receives the operation of the user erasing the rectangular doodle 230, the mobile phone can perform an erasing operation on the added rectangular doodle 230 according to the erasing track of the user, and the erasing operation does not act on the doodle 210. In response to the operation of the user selecting the confirmation button 109, the display interface of the mobile phone is switched from e of FIG. 10 to f of FIG. 10. Figure 5 As shown in d of FIG. 10, after the mobile phone receives the operation of the user erasing the rectangular doodle 230, the mobile phone can perform an erasing operation on the added rectangular doodle 230 according to the erasing track of the user, and the erasing operation does not act on the doodle 210. In response to the operation of the user selecting the confirmation button 109, the display interface of the mobile phone is switched from e of FIG. 10 to f of FIG. 10. Figure 5 As shown in d of FIG. 10, after the mobile phone receives the operation of the user erasing the rectangular doodle 230, the mobile phone can perform an erasing operation on the added rectangular doodle 230 according to the erasing track of the user, and the erasing operation does not act on the doodle 210. In response to the operation of the user selecting the confirmation button 109, the display interface of the mobile phone is switched from e of FIG. 10 to f of FIG. 10.

[0108] As shown in e of FIG. 10, the display interface of the mobile phone includes the picture 101, the doodle 210, the first-level tool bar 104, and the second-level tool bar 105. When the mobile phone receives the operation of the user selecting the doodle 210, the display interface of the mobile phone is switched from e of FIG. 10 to f of FIG. 10. Figures 1-5 As shown in e of FIG. 10, the display interface of the mobile phone includes the picture 101, the doodle 210, the first-level tool bar 104, and the second-level tool bar 105. When the mobile phone receives the operation of the user selecting the doodle 210, the display interface of the mobile phone is switched from e of FIG. 10 to f of FIG. 10. Figure 6 As shown in e of FIG. 10, the display interface of the mobile phone includes the picture 101, the doodle 210, the first-level tool bar 104, and the second-level tool bar 105. When the mobile phone receives the operation of the user selecting the doodle 210, the display interface of the mobile phone is switched from e of FIG. 10 to f of FIG. 10. Figures 1 to 5 As shown in e of FIG. 10, the display interface of the mobile phone includes the picture 101, the doodle 210, the first-level tool bar 104, and the second-level tool bar 105. When the mobile phone receives the operation of the user selecting the doodle 210, the display interface of the mobile phone is switched from e of FIG. 10 to f of FIG. 10.

[0109] As shown in f of FIG. 10, the display interface of the mobile phone includes the picture 101, the doodle function bar 107, and the doodle style bar 108. When the mobile phone receives the operation of the user selecting the eraser option in the doodle function bar 107, the mobile phone can erase the doodle 210. Figure 7 As shown in f of FIG. 10, the display interface of the mobile phone includes the picture 101, the doodle function bar 107, and the doodle style bar 108. When the mobile phone receives the operation of the user selecting the eraser option in the doodle function bar 107, the mobile phone can erase the doodle 210. As shown in g of FIG. 10, after the mobile phone receives the operation of the user erasing the doodle 210, the mobile phone can perform an erasing operation on the added doodle 210 according to the erasing track of the user, and the erasing operation does not act on the rectangular doodle 230.

[0110] As shown in g of FIG. 10, after the mobile phone receives the operation of the user erasing the doodle 210, the mobile phone can perform an erasing operation on the added doodle 210 according to the erasing track of the user, and the erasing operation does not act on the rectangular doodle 230. Figure 8 As shown in g of FIG. 10, after the mobile phone receives the operation of the user erasing the doodle 210, the mobile phone can perform an erasing operation on the added doodle 210 according to the erasing track of the user, and the erasing operation does not act on the rectangular doodle 230. As shown in g of FIG. 10, after the mobile phone receives the operation of the user erasing the doodle 210, the mobile phone can perform an erasing operation on the added doodle 210 according to the erasing track of the user, and the erasing operation does not act on the rectangular doodle 230.

[0111] In a possible implementation, in response to the operation of the user adding a doodle, the mobile phone sequentially adds the doodle 210 and the rectangular doodle 230 to the picture. In response to the operation of the user erasing a doodle, the mobile phone can erase the doodle that is added most recently, for example, the rectangular doodle 230. In response to the operation of the user selecting the doodle 210, the mobile phone can edit the doodle 210, for example, can erase the doodle 210. That is, the gallery application cannot support erasing multiple added doodles at one time, and the user needs to select multiple times when erasing a doodle, which is tedious.

[0112] That is, the picture editing process in the above Figure 8 has certain pain points. For example, Figure 8 FIG. 11 shows an editing flowchart of the picture editing process in the above Figure 9A , and illustrates the pain points in the editing process.

[0113] The mobile phone enters picture editing in response to the operation of the user selecting a picture and clicking an editing function.

[0114] Pain point one: in the scenario of the phone responding to the user's operation of adding graffiti to the picture, the user's expectation for the graffiti function is that the graffiti style is rich and the graffiti can be added quickly. However, in some implementations, the pain point of adding graffiti is that the graffiti function level is deep, it is not convenient to find and operate, and the operation efficiency is low.

[0115] Pain point two: in the scenario of the phone responding to the user's operation of adding text, mosaic, watermark, and sticker to the picture, the user's expectation for the above elements is that the style of each element is rich and each element can be added quickly. However, in some implementations, the pain point of adding the above elements is that the gallery application supports fewer styles of each element; the function level corresponding to each element is deep, it is not convenient to find and operate, and the operation efficiency is low.

[0116] Pain point three: in the scenario of the phone responding to the user's operation of adding a photo frame, the user's expectation for the photo frame is that the photo frame style is rich, the effect of the photo frame can be quickly previewed, and the photo frame can be quickly added. However, in some implementations, the pain point of adding a photo frame is that the type of the photo frame is few and not good-looking; the ratio of the picture may change after the photo frame is added.

[0117] Pain point four: in the scenario of the phone responding to the user's operation of cropping the picture, adjusting the length, width, and the like of the picture, the user's expectation for the cropping function is to be able to crop the picture to a target size and to be able to quickly crop the picture. However, in some implementations, the pain point of picture cropping is that when the size of the picture is adjusted, the cropping effect cannot be previewed in real time, and the content outside the user's expectation may be cropped.

[0118] Pain point five: in the scenario of the phone responding to the user's operation of adding a filter and adjusting the picture through the adjustment function, the user's expectation is that the filter is rich, the effect of adding the filter to the picture can be previewed, and the added filter and the completed picture adjustment can be modified. However, in some implementations, the pain point of the filter function is that there are too many filters and no classification, which is not convenient for the user to find a specified effect; the granularity of the adjustment bar is rough, and the adjustment effect is not delicate enough; adding a filter to the picture or adjusting the picture will change the color, brightness, saturation, and the like of the elements such as the photo frame, text, sticker, graffiti, mosaic, and watermark; the added filter or the completed adjustment cannot be modified.

[0119] It can be understood that when the phone receives the user's operation of changing the added mosaic, blur, or beauty on the picture, the user's expectation is to be able to repeatedly modify and edit the above elements. However, in some implementations, the pain point is that the above elements cannot be changed again.

[0120] Pain point six: when the mobile phone receives the operation of the user adjusting the text, the user's expectation is that the text can be repeatedly modified and edited, but the pain point in some implementations is that the style or content of the text cannot be modified again.

[0121] It can be understood that when the mobile phone receives the operation of the user changing the graffiti, watermark, sticker or photo frame, the user's expectation is that the above-mentioned elements can be repeatedly modified and edited, but the pain point in some implementations is that the above-mentioned elements cannot be changed again.

[0122] Pain point seven: when the mobile phone receives the operation of the user erasing the graffiti, the user's expectation is that all graffiti can be erased at one time, but the pain point in some implementations is that all added graffiti cannot be erased at one time, and only a certain graffiti selected by the user can be erased at one time.

[0123] Pain point eight: when the mobile phone receives the operation of the user clicking the save, the processed picture can be exported. The user's expectation is to quickly export the edited picture, but in some implementations, the pain point is that after editing the picture, the user needs to click the "confirm" button first, return to the primary toolbar, click the "save" button in the interface of the primary toolbar, and then save and export the processed picture.

[0124] Therefore, the embodiment of the present application provides a graffiti processing method:

[0125] In view of the pain points one, two and eight, the embodiment of the present application can provide a primary toolbar containing all picture processing functions, so that the user can select the function to be used in the primary toolbar, without the need to expand the secondary toolbar, and the processed picture can be saved at one click. In this way, the user can easily find each function of the picture processing, the number of page jumps is reduced, and the operation of the user is more convenient.

[0126] In view of the pain point four, when the user performs the cropping processing on the picture, a part of the elements on the picture is temporarily not displayed and cannot be cropped, and after the cropping is completed, the part of the elements can be displayed on the cropped picture according to the size, position and the like of the cropped picture; another part of the elements on the picture is displayed, and the user can intuitively see the part of the elements and crop the part of the elements during the cropping. In this way, the flexibility and convenience of the picture processing can be improved, the coordination of the picture can be improved, and the user experience can be improved.

[0127] For the fifth and sixth of the above pain points, the graffiti processing method provided in the embodiments of the present application can realize the function of adding filters by the memory user, and can change the filters added to the picture, and can also modify the added text, stickers, graffiti, watermarks, and photo frames, etc. After adding filters or adjusting to the picture, the filter function or the adjustment function does not act on the added elements such as photo frames, text, stickers, graffiti, mosaic, and watermarks. In this way, the user can conveniently process the picture, the operation of the user is more convenient, the result of the picture processing is more in line with the expectation of the user, and the use experience of the user is improved.

[0128] For the seventh of the above pain points, the graffiti processing method provided in the embodiments of the present application can realize the function of adding filters by the memory user, and can change the filters added to the picture, and can also modify the added text, stickers, graffiti, watermarks, and photo frames, etc. After adding filters or adjusting to the picture, the filter function or the adjustment function does not act on the added elements such as photo frames, text, stickers, graffiti, mosaic, and watermarks. In this way, the user can conveniently process the picture, the operation of the user is more convenient, the result of the picture processing is more in line with the expectation of the user, and the use experience of the user is improved.

[0129] In order to better understand the embodiments of the present application, the structure of the terminal device of the embodiments of the present application is introduced as follows.

[0130] Exemplarily, Figure 9B The structure schematic diagram of the terminal device 100 provided in the embodiments of the present application is shown in FIG. 1.

[0131] The terminal device 100 can include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charge management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a loudspeaker 170A, a receiver 170B, a microphone 170C, a headset interface 170D, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 can include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0132] It can be understood that the structural schematic of the embodiments of the present application does not constitute a specific limitation on the terminal device 100. In other embodiments of the present application, the terminal device 100 can include more or fewer components than the schematic, or combine certain components, or split certain components, or different component arrangements. The components shown can be implemented in hardware, software, or a combination of software and hardware.

[0133] The processor 110 can include one or more processing units. For example, the processor 110 can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units can be independent devices or integrated into one or more processors.

[0134] The controller can generate operation control signals according to instruction operation codes and timing signals, and complete the control of fetching and executing instructions.

[0135] The processor 110 can also be provided with a memory for storing instructions and data.

[0136] In some embodiments, the processor 110 can include one or more interfaces. The interfaces can include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0137] The charging management module 140 is configured to receive charging input from a charger.

[0138] The power management module 141 is configured to connect the battery 142, the charging management module 140 and the processor 110.

[0139] The wireless communication function of the terminal device 100 can be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor, etc.

[0140] The terminal device 100 implements the display function through the GPU, the display screen 194 and the application processor, etc. The GPU is a microprocessor for image processing, which is connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 can include one or more GPUs, which execute program instructions to generate or change display information.

[0141] The display screen 194 is configured to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flex light-emitting diode (FLED), a Miniled, a MicroLed, a Micro-oLed, a quantum dot light emitting diode (QLED), etc. In some embodiments, the terminal device 100 can include one or N display screens 194, and N is a positive integer greater than 1.

[0142] The terminal device 100 can implement the shooting function through the ISP, the camera 193, the video codec, the GPU, the display screen 194 and the application processor, etc.

[0143] The external memory interface 120 can be configured to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the terminal device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement the data storage function. For example, music, video, etc. Files are saved in the external memory card.

[0144] The internal memory 121 can be configured to store computer executable program codes, which include instructions. The internal memory 121 can include a program storage area and a data storage area.

[0145] The terminal device 100 can implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headset interface 170D, an application processor, and the like. For example, music playing, recording, and the like.

[0146] The software system of the terminal device 100 can adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture. Embodiments of the present application take an Android system with a layered architecture as an example to exemplarily illustrate the software structure of the terminal device 100.

[0147] Exemplarily, Figure 9A A software architecture schematic diagram of a terminal device provided by an embodiment of the present application.

[0148] The layered architecture divides software into several layers, each of which has a clear role and division of labor. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, an application layer, an application framework layer, an Android runtime and system library, and a kernel layer.

[0149] The application layer can include a series of application packages.

[0150] As Figure 9A shown, the application packages can include camera, gallery, calendar, call, WLAN, Bluetooth, music, video, short message, and the like. Exemplarily, the scribbling processing method provided by an embodiment of the present application can be implemented through the gallery.

[0151] The application framework layer provides application programming interfaces (APIs) and programming frameworks for the applications of the application layer. The application framework layer includes some pre-defined functions.

[0152] As Figure 9A shown, the application framework layer can include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0153] The window manager is used to manage window programs. The window manager can obtain the size of the display screen, determine whether there is a status bar, lock the screen, and intercept the screen, and the like.

[0154] The content provider is used to store and obtain data, and make the data accessible to the applications. The data can include videos, images, audios, dialed and received calls, browsing history and bookmarks, phone books, and the like.

[0155] The view system includes visual controls, such as controls that display text, controls that display pictures, and the like. The view system can be used to build an application. A display interface can be composed of one or more views. For example, a display interface that includes a short message notification icon can include a view that displays text and a view that displays a picture.

[0156] The telephony manager is used to provide the communication function of the terminal device 100. For example, the management of the call state (including the connection, hang-up, and the like).

[0157] The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and the like.

[0158] The notification manager enables the application to display notification information in the status bar, which can be used to convey a message of the notification type, which can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify the completion of the download, the message reminder, and the like. The notification manager can also be a notification that appears in the top status bar of the system in the form of a chart or a scrolling text, such as a notification of an application running in the background, and can also be a notification that appears on the screen in the form of a dialog window. For example, the text information is prompted in the status bar, a prompt sound is emitted, the electronic device is vibrated, the indicator light flashes, and the like.

[0159] The Android runtime includes the core library and the virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.

[0160] The core library includes two parts: one part is the function function that the java language needs to call, and the other part is the core library of Android.

[0161] The application layer and the application framework layer run in the virtual machine. The virtual machine executes the java file of the application layer and the application framework layer into a binary file. The virtual machine is used to perform the management of the object life cycle, the stack management, the thread management, the security and exception management, and the garbage collection, and the like.

[0162] The system library can include a plurality of functional modules. For example: the surface manager, the media library, the three-dimensional graphics processing library (for example: OpenGL ES), the 2D graphics engine (for example: SGL), and the like.

[0163] The surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for a plurality of applications.

[0164] The media library supports multiple commonly used audio, video format playback and recording, and static image files, etc. The media library can support multiple audio and video coding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0165] The three-dimensional graphics processing library is used to realize three-dimensional graphics drawing, image rendering, synthesis, and layer processing, etc.

[0166] The 2D graphics engine is a drawing engine for 2D drawing.

[0167] The kernel layer is a layer between hardware and software. The kernel layer at least contains display drivers, camera drivers, audio drivers, and sensor drivers.

[0168] Taking a graffiti processing method for realizing the embodiment of the application as an example, the gallery application can be divided into, for example, Figure 9A the logical layers as described above, and Figure 9B the physical layers as described above.

[0169] An exemplary Figures 1-5 logical layer diagram provided by the embodiment of the application.

[0170] As shown in Figures 1-5 , the logical layer can include, from top to bottom, a photo frame, color functions, superimposed materials, effect materials, and a content layer.

[0171] The photo frame is independently displayed on the periphery of the screen, so that the photo frame can not be affected by other materials or functions. For example, the mobile phone sequentially receives an operation of a user adding a photo frame to a picture, an operation of the user adding a filter to the picture, and the color of the photo frame is not affected by the filter and does not change.

[0172] The color functions can include a reserved color, and the action object of the color functions is all the colored content in the picture.

[0173] The superimposed materials can include text, watermarks, stickers, and / or graffiti, and the superimposed materials act on a part of the picture.

[0174] The effect materials can include mosaic, blur, filter, beautification, and / or adjustment. Among them, the action object of the adjustment function is the picture or video itself, for example, the user can adjust the brightness, saturation, etc. of the picture itself through the adjustment function. In addition to the adjustment function, the upper materials in other effect materials can affect the lower materials. For example, the mobile phone receives an operation of the user adding a mosaic to a picture to which a filter has been added, and the mosaic acts on the picture to which the filter has been added.

[0175] The content layer can include a picture and a canvas. Among them, the picture refers to the picture itself for picture processing.

[0176] exist Figures 1-5 In the logical layers shown, the materials or functions in the upper layer affect the materials or functions in the lower layer, but the materials or functions in the lower layer do not affect the materials or functions in the upper layer. This ensures that consistent image processing results are achieved regardless of the user's operation order. Taking filters and adjustments as an example, the phone sequentially receives the user's operation of adding a filter to the image, and then the user's operation of adjusting the image using the adjustment function. Since the adjustment function applies to the image layer in the logical layer, rather than the image after adding the filter, the above image processing result is consistent with the effect of adjusting the image using the adjustment function and then adding the filter.

[0177] like Figure 10 As shown, based on actual user needs, the cropping function is placed below text, watermarks, and stickers, and above doodles. When the phone receives a user's cropping command to crop the image, cropping can be applied to the lower-level doodle layer, effect materials, and content layer, but cannot be applied to the upper-level text, watermarks, sticker layers, color functions, or frames.

[0178] In other words, on the one hand, considering that the doodles and mosaics added by users to images may be strongly related to the content of the images—for example, when users add doodles or circle a word in an image, they don't want the relative position of the doodles and the image to change during the cropping process; or, when users add mosaics to cover faces in an image, they don't want the relative position of the mosaics and the image to change during the cropping process—the doodles and mosaics are placed at the bottom of the cropping layer. This ensures that the doodles and mosaics remain visible on the image throughout the cropping process, and their relative position remains unchanged. Users can see the doodles and mosaics intuitively and crop them according to their actual needs. On the other hand, considering that users don't want to partially or completely crop text, watermarks, and / or stickers added to the image during the cropping process, text, watermarks, and stickers are placed at the top of the cropping layer. This allows text, watermarks, and stickers to be temporarily hidden during the cropping process, and they can reappear on the cropped image after cropping. The cropping function does not affect text, watermarks, and stickers.

[0179] It is understandable that the content of each layer can be adjusted according to actual needs. For example, when a user adds text to an image to label the names of various items in the image, the user's requirement is that the relative position of the text and the image remain unchanged during the cropping process. To meet this user's needs, the text can be moved to the lower layer of the cropping. This application does not specifically limit this aspect.

[0180] Exemplarily, Figure 10 A physical layer diagram is provided for the embodiments of the present application. In the physical layer diagram, the order of the real layers corresponding to the picture processing functions in the picture processing process is shown.

[0181] Corresponding to the picture editing process of Figure 10 , the order of the physical layers from top to bottom can include: a photo frame physical layer, a reserved color physical layer, a superimposed material physical layer, a mosaic physical layer, a blurring physical layer, a filter physical layer, a beautifying physical layer, an adjustment physical layer, a picture physical layer, and a canvas physical layer.

[0182] The superimposed material can include text, graffiti, watermark, and / or sticker, etc. Corresponding to the picture editing process of Figure 1 , the superimposed material physical layer from top to bottom can include a graffiti rectangle layer, a sticker layer, a watermark layer, a text layer, and a graffiti 123 layer.

[0183] The order of the above-mentioned physical layers can be relatively fixed. One or more real layers can be added in each physical layer.

[0184] Exemplarily, taking the mosaic physical layer as an example, the mobile phone adds a first mosaic to the picture in response to the user's operation, and then a first real mosaic layer is added in the mosaic physical layer. After that, the mobile phone adds text to the picture in response to the user's operation, and then a real text layer is added in the text physical layer. After the text is added, the user returns to the mosaic function, and further, the mobile phone adds a second mosaic to the picture in response to the user's operation, and then a second real mosaic layer is added in the mosaic physical layer. That is, the first mosaic and the second mosaic are in the mosaic physical layer.

[0185] Similarly, for the text, graffiti, watermark, and sticker added by the terminal device in different times, new layers can be created for each element in the superimposed element physical layer according to the order of the user's addition. For example, the mobile phone adds a first graffiti to the picture in response to the user's operation, and then a first real graffiti layer is added in the superimposed material physical layer. After that, the mobile phone adds text to the picture in response to the user's operation, and then a real text layer is added in the superimposed material physical layer. After the text is added, the user returns to the graffiti function, and further, the mobile phone adds a second graffiti to the picture in response to the user's operation, and then a second real graffiti layer is added in the superimposed material physical layer. That is, the first graffiti layer, the text layer, and the second graffiti layer can be in the superimposed material physical layer in the order from bottom to top.

[0186] It can be understood that a real graffiti layer can be created for the first graffiti, regardless of how many graffiti contents are included in the first graffiti. For example, the content of the first graffiti is "123", although "1", "2", and "3" correspond to three different strokes, in the graffiti physical layer, "123" corresponds to a real layer, not three. The second graffiti is also processed similarly, and is not described in detail.

[0187] Based on the logical layer and the physical layer, the elements in each logical layer or physical layer can be processed by the embodiments of the present application, so that some elements can be displayed and some elements can not be displayed during cropping. The elements that are not displayed after cropping can be displayed on the cropped picture again, thereby solving the problem corresponding to pain point four; when adding effect materials to the picture, the elements such as frames, texts, stickers, graffiti, mosaics, and watermarks can not be affected, and the added effect materials can be modified, thereby solving the problem corresponding to pain point five; editing and modifying the elements such as frames, texts, stickers, graffiti, and watermarks that have been added to the picture can be realized, thereby solving the problem corresponding to pain point six; when erasing graffiti, the graffiti of multiple real layers in the physical layer can be erased at one time, thereby solving the problem corresponding to pain point seven. The specific solving methods will be described in detail in subsequent embodiments, and will not be described again.

[0188] The following will be described in combination with Figure 11 The order of use of each function in the gallery application, and the order of each pain point, illustrate the interface that the graffiti processing method of the embodiments of the present application can involve.

[0189] For example, for the problems of function level being too deep in pain points one and two, and the problem of not being able to one-key save in pain point eight, as shown in Figure 11 The embodiments of the present application provide a toolbar schematic diagram.

[0190] As shown in a of Figure 11 The toolbar 1001 can include all picture processing functions. In the case that the terminal device screen size is limited and only part of the content of the toolbar 1001 can be displayed, when the terminal device receives the operation of the user sliding the toolbar 1001, the toolbar can display the hidden other functions.

[0191] As shown in b of Figure 11 The picture processing functions included in the toolbar 1001 can include: cropping, filters, adjustment, beautification, graffiti, text, mosaic, watermark, frame, blur, color preservation, watermark, and sticker. The order of each picture processing function is not fixed. For the convenience of user use, the order of each picture processing function can be arranged from high to low according to the frequency of user use, and the embodiments of the present application do not make specific limitation.

[0192] It is understood that toolbar 1001 may include more or fewer functions, and this application embodiment does not specifically limit this.

[0193] Understandably, compared to Figure 11 As shown in Figure a, the primary toolbar 104 and the secondary toolbar 105, toolbar 1001 can include all the functions contained in the primary toolbar 104 and all the functions contained in the secondary toolbar 105. When the mobile phone receives a user's selection of a function contained in the original secondary toolbar in toolbar 1001, the interface displayed on the mobile phone can remain unchanged. After processing the image according to the user's selected function, the mobile phone can respond to the user's selection of the save button and save the processed image, realizing one-click saving.

[0194] Compared to pain points one, two, and eight, placing all image processing functions in a single toolbar allows users to select the desired function by swiping, eliminating the need to click the "more" button or expand secondary toolbars. This makes it easier for users to find functions, reduces page navigation, and enables one-click saving of processed images, making the user experience more convenient.

[0195] For example, regarding the issue of filters not being convenient for users to find specific effects (pain point five), Figure 4 This is a diagram of the filter editing interface provided in an embodiment of this application.

[0196] like Figure 11 As shown in Figure a, the mobile phone's interface includes image 101 and toolbar 1001. When the mobile phone receives a user's selection of filter function 401 in toolbar 1001, the mobile phone's display interface changes accordingly. Figure 11 Switch 'a' to Figure 11 b in the text.

[0197] like Figure 9A The interface shown in Figure b on the mobile phone includes a title bar 601, an image display area 602, and a filter function area 1101. Users can preview the processed image output in real time through the image display area 602. The filter function area 1101 includes a content area 603 and a parameter adjustment bar 604. The parameter adjustment bar 604 and... Figure 11 Compared to the filter parameter adjustment bar in the previous version, this new adjustment bar offers finer granularity, allowing for smoother parameter adjustments. When the phone receives a user's selection of the filter 3 option in the filter function bar, the phone's display interface changes from... Figure 11 Switch b in the middle to Figure 11 c in the text.

[0198] like Figure 11In the interface shown in C, filter 3 is selected. After adjusting the filter, the color, brightness, and other parameters of image 101 may change, but the color, brightness, and other parameters of the elements added to image 101 will not change. According to... Figure 4 As shown in the logical layer diagram, the filter is on top of the image and below the text, watermark, sticker, graffiti, and mosaic. Therefore, the filter only adjusts the image and does not adjust the text, watermark, sticker, graffiti, or mosaic added to the image.

[0199] When the mobile phone receives the user's operation to adjust function 403 in the toolbar 1001, the mobile phone's display interface changes from... Figure 11 Switching 'c' to Figure 9A d in the text.

[0200] like Figure 11 As shown in Figure d, the mobile phone's interface includes an image and an adjustment function bar 1102. When the mobile phone receives a user's selection of the brightness function in the adjustment function bar 1102 and adjustment of the image brightness via the brightness adjustment bar 1103, the mobile phone's display interface changes accordingly. Figure 11 Switching d in Figure 11 The 'e' in the text. Among them, the brightness adjustment bar 1103 and... Figure 9A Compared to the brightness parameter adjustment bar in the 405, the adjustment bar has a finer granularity, allowing for smooth parameter adjustment.

[0201] like Figure 12 The interface shown in Figure 'e' on the phone includes an image 101 with adjusted brightness and a toolbar 1001. Brightness adjustment only applies to image 101 itself and not to any elements added to image 101. According to... Figure 12 As shown in the logical layers, the adjustment is on top of the image and below the text, watermark, sticker, graffiti, and mosaic. Therefore, the adjustment only affects the image and not the text, watermark, sticker, graffiti, and mosaic added to the image.

[0202] When the phone receives the user's request to select filter function 401, the phone's display interface changes from... Figure 12 Switch 'e' to Figure 12 f in the text.

[0203] like Figure 12 The interface shown in Figure f is a filter function area 1101, in which the filter 3 option is selected.

[0204] In other words, after a user adds a filter to a picture and then performs other operations on the picture besides applying the filter, when the phone receives the user's request to return to the filter function, the gallery app can remember the filter the user added to the picture, such as filter 3, and can display that filter as selected in the filter function bar.

[0205] In one possible implementation, the phone could respond to the user's filter editing operation by adjusting the parameters of filter 3, or switching filter 3 to another filter, such as filter 4. This way, after adding a filter and performing other operations, the user can select the filter function again to modify and edit the filter again, meaning continuous editing of the filter is possible.

[0206] Similarly, in this embodiment of the application, the gallery application... Figure 12 All other effect-type materials shown can be edited continuously, such as mosaic, blur, beauty filters, and adjustments. These will not be elaborated upon here.

[0207] Compared to pain point five, in this embodiment, after a user adds a filter and performs other operations, the gallery application can remember the previously added filter when the user selects the filter function again. The user can locate the previously selected filter without comparing or searching for it, and can also modify and edit the filter. This makes it easier for users to process images and improves the user experience.

[0208] For example, regarding the issue of not being able to modify the style or content of text in pain point six, Figure 12 A text editing interface diagram provided for an embodiment of this application.

[0209] like Figure 12 As shown in Figure a, the mobile phone's interface includes image 101 and toolbar 1001. When the mobile phone receives the user's selection of text 220, the mobile phone's display interface changes accordingly. Figure 12 Switch 'a' to Figure 9A b. The user's selection of text 220 can be a single click, double click, long press, etc., and this embodiment does not specifically limit this.

[0210] like Figure 13 As shown in Figure b, the mobile phone's interface includes image 101, a text selection box 1201, and a text toolbar 1202. When the mobile phone receives a user's selection of an editing function in the text toolbar 1202, the mobile phone's display interface changes accordingly. Figure 13 Switch b in the middle to Figure 13 c in the text.

[0211] like Figure 13The interface shown in Figure c includes image 101, text adjustment overlay 203, confirmation option 204, text function option 1204, and title bar 1205. For example, if a user enters "read" in text adjustment overlay 203, the "text" in text 220 can be changed to "read". The image after text modification is shown below. Figure 13 As shown in d.

[0212] In other words, if a user adds text to an image and then performs other operations on the image besides adding text, when the phone receives the user's request to return to the text function, the gallery app can modify and edit the added text again. This means that continuous text editing is possible.

[0213] Similarly, in this embodiment of the application, the gallery application... Figure 13 Other overlay materials and frames shown can be edited continuously. Other overlay materials include stickers, watermarks, and graffiti. These will not be elaborated upon here.

[0214] Thus, compared to pain point six, in this embodiment of the application, after a user adds text and performs other operations, when the user selects the text added to the image again, they can switch to the text editing interface to modify and edit the text again, making it convenient for users to process images and improving the user experience.

[0215] For example, regarding the fourth pain point—the issue of potentially cropping unexpected content when cropping images— Figure 9A This is a diagram of the image cropping interface provided in an embodiment of this application.

[0216] like Figure 13 As shown in Figure a, the image displayed on the phone includes doodles 210, text 220, watermarks 250, stickers 260, and frames 270. When the phone receives a user's selection of the cropping function 301, the phone's display interface changes from... Figure 13 Switch 'a' to Figure 13 b in the text.

[0217] like Figure 13 As shown in Figure b, the mobile phone's interface can include an image, a secondary cropping toolbar 302, a cropping adjustment bar 303, and a cropping frame 304. Doodles 210 on the image are displayed, while text 220, watermarks 250, stickers 260, and frames 270 are temporarily hidden. Users can crop the image by manipulating the cropping frame 304, such as zooming in and out. Once the user has finished cropping and the phone detects the user lifting their hand off the screen, the phone's display changes from... Figure 9A Switch b in the middle to Figure 13 c in the text.

[0218] according toFigure 13 As shown in the logical layers, the cropping function is located above graffiti and mosaic, and below text, watermarks, and stickers. Therefore, the cropping function can only crop graffiti and mosaic, and cannot crop text, watermarks, or stickers added to the image.

[0219] like Figure 14 The interface shown in Figure c can include image 1301 and a save button 305. Image 1301 is a cropped version of image 101. Image 1301 includes part of the doodle 210, text 220, watermark 250, sticker 260, and frame 270.

[0220] In other words, after the cropping operation is completed, text, watermarks, stickers, frames, and other content that was temporarily not displayed will reappear on the image.

[0221] Understandably, text, watermarks, and stickers can automatically adapt to the cropped image's aspect ratio. The difference between the position of the text, watermark, or sticker in the cropped image and its position in the original image is less than a preset value. For example, if a watermark is located at 90% horizontally and 95% vertically in the original image, it will remain at the same position in the cropped image.

[0222] Understandably, the frame can automatically adjust its size based on the size of the cropped image. For example, if the original image is 30mm x 40mm, and the cropped image is 25mm x 30mm, the frame can automatically adjust its size to fill the entire frame.

[0223] When the phone receives a user's selection of the save button 305, the phone can save the image 1301.

[0224] In another possible implementation, when the phone receives the user's operation to select the cropping function 301, the phone's display interface can be changed by... Figure 14 Switch 'a' to Figure 14 d in the text.

[0225] like Figure 14 As shown in Figure d, the interface displayed on the mobile phone can include an image, a cropping secondary toolbar 302, a cropping adjustment bar 303, and a cropping frame 304. Among them, the text 220 on the image is displayed, while the doodles 210, watermarks 250, stickers 260, and frames 270 on the image are not displayed for the time being.

[0226] In other words, corresponding to Figure 14the logic layer in the picture, when the cropping function is in the upper layer of the text, mosaic, and in the lower layer of the graffiti, watermark, and sticker, in the cropping process, the text and the mosaic can be displayed and cropped; the graffiti, the watermark, and the sticker are temporarily not displayed and cannot be cropped. The user can crop the picture by operating the cropping frame 304, such as zooming in, zooming out, and the like. When the user finishes cropping and the phone detects that the user lifts the hand away from the screen, the display interface of the phone is switched from Figure 14 in a to Figure 14 in c.

[0227] In this way, compared to the pain point four, in the cropping process, the user can intuitively see the added mosaic, graffiti, and the like on the picture, which can effectively avoid cropping elements other than the user's expectation, and the text, the watermark, the sticker, and the frame are temporarily not displayed in the cropping process. After the cropping is completed, the above elements can automatically adapt to the cropped picture and adjust the position. In this way, the convenience and flexibility of picture processing can be improved, the user can preview the cropping effect in real time, the result of picture processing is more in line with the user's expectation, and the use experience of the user is improved.

[0228] For example, for the problem that all added graffiti cannot be erased at one time in the pain point seven, Figure 14 a graffiti erasing interface provided by the embodiment of the present application.

[0229] As shown in the interface of a in Figure 14 , the display interface of the phone includes the picture 1301 and the first tool bar 1001. When the phone receives the operation of the user selecting the graffiti icon 106 in the first tool bar 1001, the display interface of the phone is switched from a in Figure 14 to b in Figure 14 .

[0230] As shown in the interface of b in Figure 9A , the display interface of the phone includes the picture 1301, the graffiti function bar 107, and the graffiti style bar 108. When the phone receives the operation of the user selecting the rectangular graffiti in the graffiti style bar 108, the phone adds the rectangular graffiti to the picture 1301.

[0231] As shown in c in Figure 9B , the display interface of the phone includes the picture 1301, the graffiti 210, and the rectangular graffiti 230. When the phone receives the operation of the user selecting the eraser option in the graffiti function bar 107, the display interface of the phone is switched from c in Figure 14 to d in Figure 1 .

[0232] As shown in d in Figure 1As shown in Figure d, when the phone receives the user's erase operation, it can erase the rectangular doodles 230 and 210 according to the user's erasing trajectory. When the phone receives the user's selection of the save button 305, it can save the processed image 1301 with one click, and the phone's display interface changes accordingly. Figure 1 Switching d in Figure 1 The 'e' in the middle.

[0233] according to Figure 10 The logical layers shown and Figure 10 The physical layers shown correspond to different graffiti layers depending on the number of times the graffiti is added. For example, graffiti 210 can correspond to graffiti layers 123, and rectangular graffiti 230 can correspond to a rectangular graffiti layer. Different graffiti layers are located on the same physical layer, such as overlay material physical layers. In this embodiment, when the mobile phone performs an erase operation on the added graffiti, the user does not need to select the graffiti layer, but can erase graffiti from multiple graffiti layers in a single erase operation.

[0234] Understandably, in Figure 1 In the c interface, the user can also trigger the undo button to cancel the operation of adding rectangle doodle 230. After undoing, rectangle doodle 230 will no longer be displayed.

[0235] This allows all added graffiti to be erased at once, making the user operation more convenient and improving the user experience.

[0236] Based on the content described in the above embodiments, in order to better understand the various embodiments of this application, the graffiti processing method will be explained in detail below.

[0237] The specific steps of the graffiti processing method provided in this application embodiment may include:

[0238] S1501, The terminal device displays the gallery interface, and the terminal device receives the twelfth operation.

[0239] In this embodiment of the application, the gallery interface includes one or more images. The gallery interface can correspond to... Figure 1 The interface shown in Figure a.

[0240] In this embodiment of the application, the twelfth operation can be used to select the first image in the gallery interface. The twelfth operation can correspond to... Figure 1 In step a, the terminal device receives the user's operation of selecting image 101 from the gallery interface.

[0241] In this way, users can process images through the gallery application on their terminal devices without having to import images into third-party image processing software, making image processing more convenient and faster.

[0242] S1502, The terminal device displays the first image.

[0243] The first image can correspond to Figure 9B Image 101 in the text.

[0244] In this embodiment of the application, the terminal device can display the first image in response to the twelfth operation. For example, if the terminal device receives an operation from the user selecting image 101 in the gallery interface, the terminal device will display image 101 in response to this operation.

[0245] S1503, The terminal device receives a fourth operation on the first image in the gallery application; in response to the fourth operation, the terminal device displays the toolbar.

[0246] In this embodiment of the application, the fourth operation can be used to invoke the image editing function of the gallery application, and the fourth operation can correspond to Figure 1 As shown in b: The operation of the user selecting to edit icon 102 received by the mobile phone.

[0247] In response to the fourth operation, the terminal device's interface can display a toolbar, which includes a first-level toolbar but excludes second-level toolbars. The toolbar can correspond to... Figure 2 Toolbar 1001 is shown in section a.

[0248] In this way, users can select the functions they need from the toolbar without having to expand the secondary toolbar, making it easier for users to find the functions, reducing the number of times the interface needs to be switched, and making the operation more convenient for users.

[0249] Optionally, the primary toolbar may include one or more of the following functions: cropping, filters, adjustments, beautification, graffiti, text, mosaic, watermark, frames, blurring, color preservation, or stickers.

[0250] The first-level toolbar can correspond to Figure 14 Toolbar 1001 is shown in b.

[0251] It is understood that the first-level toolbar may also include image processing functions such as cutout and background removal, but this application embodiment does not specifically limit this.

[0252] In this way, all image processing functions are placed in one toolbar. Users can select the functions they need from the first-level toolbar, making it easier for them to find the functions, reducing the number of times they need to switch between interfaces, and making the operation more convenient.

[0253] Optionally, some functions are displayed in the first-level toolbar. The method also includes: when a swipe operation is received in the first-level toolbar, based on the swipe direction, displaying the functions that are hidden or displayed in the swipe direction in the first-level toolbar.

[0254] In the case that the interface size of the terminal device is limited, the primary toolbar can display part of the functions. The user can expand the hidden functions by sliding the primary toolbar. For example, the functions currently displayed by the primary toolbar include cropping, filters, adjustment, beautifying, and doodling. When the terminal device receives an operation of sliding the primary toolbar to the left by the user, the terminal device can display the hidden functions such as mosaic and text.

[0255] In this way, all the picture processing functions are placed in one toolbar, the user can select the function to be used through the sliding operation, and it is not necessary to expand the secondary toolbar, which facilitates the user to find each function, reduces the number of interface jumps, and makes the operation of the user more convenient.

[0256] S1504, the terminal device receives a first operation; in response to the first operation, the terminal device displays a first layer of doodling on the upper layer of the first picture.

[0257] In the embodiments of the present application, the first operation can be used to add doodling to the picture, and the first operation can correspond to Figure 9B f of FIG. 1, Figure 14 g of FIG. 1, and Figure 14 h of FIG. 1, the operation of the user drawing doodling received by the mobile phone.

[0258] Corresponding to the physical layer shown in Figure 14 , the mobile phone adds the first doodling to the picture in response to the operation of the user, and then adds the first real doodling layer, that is, the first layer of doodling, to the superimposed material physical layer. The first layer of doodling can correspond to the doodling 210 shown in i of FIG. 1. Figure 13

[0259] S1505, the terminal device receives a second operation; in response to the second operation, the terminal device adds an element to the first picture, wherein the element does not belong to doodling.

[0260] In the embodiments of the present application, the second operation can be used to add an element to the picture, and the second operation can correspond to the operation of the mobile phone adding an element such as text, watermark, sticker, and photo frame to the picture in addition to doodling. Figure 11

[0261] Optionally, the element includes one or more of the following: text, watermark, sticker, or mosaic.

[0262] S1506, the terminal device receives a third operation; in response to the third operation, the terminal device displays a second layer of doodling on the upper layer of the first picture.

[0263] In the embodiments of the present application, the third operation can be used to add doodling to the picture, and the third operation can correspond to Figure 11 ​​The user draws a rectangle in the picture.

[0264] The second layer of real graffiti can correspond to the rectangle graffiti 230 shown in c of FIG. 13B. Figure 11 The second layer of real graffiti can correspond to the rectangle graffiti 230 shown in c of FIG. 13B. Figure 2 The second layer of real graffiti can correspond to the rectangle graffiti 230 shown in c of FIG. 13B.

[0265] S1507, the terminal device receives an erasing operation, and an area affected by the erasing operation includes the first layer of graffiti and the second layer of graffiti; and in response to the erasing operation, the terminal device erases the area affected by the erasing operation in the first layer of graffiti and erases the area affected by the erasing operation in the second layer of graffiti, to obtain a second picture.

[0266] In the embodiments of the present application, the erasing operation can be used to erase all graffiti added to the picture. The erasing operation can correspond to Figure 12 The erasing operation received by the phone in d of FIG. 13D. The second picture can correspond to Figure 12 The picture 1301 corresponding to the erasing operation in e of FIG. 13E.

[0267] In this way, all added graffiti can be erased at one time, so that the operation of the user is more convenient, and the use experience of the user is improved.

[0268] S1508, the terminal device receives a fifth operation; and in response to the fifth operation, the terminal device saves the second picture.

[0269] In the embodiments of the present application, the fifth operation can be used to save the processed picture, and the fifth operation can correspond to Figure 2 The operation of the user selecting the save button 305 received by the phone in c of FIG. 13C.

[0270] When the terminal device processes the picture to obtain the second picture, the terminal device can save the second picture when receiving the fifth operation.

[0271] In this way, one-key saving of the processed picture can be implemented, so that the operation of the user is more simple and fast.

[0272] Optionally, before the terminal device adds the second type of element to the first picture, the terminal device further receives a sixth operation, in response to the sixth operation, the terminal device displays a filter toolbar, the filter toolbar includes one or more filter options, when receiving a trigger on a first filter option in the plurality of filter options, the terminal device adds a first filter corresponding to the first filter option to the first picture, and displays the first filter option in a selected state, and before the terminal device adds the second type of element to the first picture, the terminal device further receives a seventh operation, in response to the seventh operation, the terminal device displays the filter toolbar, in the filter toolbar, the first filter option is in the selected state, when receiving a trigger on a second filter option in the plurality of filter options, the terminal device switches the first filter to a second filter corresponding to the second filter option, in the filter toolbar, the second filter option is in the selected state, and the first filter option is in an unselected state.

[0273] In the embodiments of the present application, the sixth operation can be used to invoke the filter function, and the sixth operation can correspond to the operation of the user selecting the filter function 401 in the toolbar 1001 shown in FIG. 1. Figure 13 The seventh operation can be used to invoke the filter function, and the seventh operation can correspond to the operation of the mobile phone receiving the user selecting the filter function 401 shown in FIG. 1e. Figure 9A The seventh operation can be used to invoke the filter function, and the seventh operation can correspond to the operation of the mobile phone receiving the user selecting the filter function 401 shown in FIG. 1e.

[0274] The first filter option can correspond to the filter 3 in FIG. 1, and when the terminal device receives the operation of the user selecting the first filter option, the first filter option is in the selected state. Figures 10-14 The first filter option can correspond to the filter 3 in FIG. 1, and when the terminal device receives the operation of the user selecting the first filter option, the first filter option is in the selected state.

[0275] Optionally, after the terminal device adds the first filter corresponding to the first filter option to the first picture, the terminal device receives an operation of the user other than the filter processing, the terminal device processes the picture in response to the operation of the user, after the processing is completed, the terminal device receives an operation of the user invoking the filter function, the terminal device displays the filter toolbar, in the filter toolbar, the first filter option is in the selected state, and in response to the operation of the user switching the filter, the terminal device switches the filter added to the first picture to a second filter, the second filter option is switched to the selected state, and the first filter option is switched to the unselected state.

[0276] For example, after the terminal device adds filter 3 (option 3) to the first image, it receives a user's command to add text. The terminal device then adds text to the image in response. After the text is added, the terminal device receives a user's command to activate the filter function, displays the filter toolbar, and selects filter 3. Responding to the user's command to switch filters, the terminal device changes the filter from 3 to 4, making filter 4 selected and filter 3 unselected.

[0277] In other words, the gallery application on the terminal device can remember the filters selected by the user and modify the filters already applied to the image. Users can locate the previously selected filters without comparing or searching for them, making image processing more convenient. In this embodiment, it can also modify images that have already been pixelated, adjusted, blurred, or beautified. This makes the user's operation more convenient and improves the user experience.

[0278] Optionally, before the terminal device adds an element to the first image, the method further includes: the terminal device receiving an eighth operation; in response to the eighth operation, the terminal device adding first text to the first image; between the terminal device adding an element to the first image and the terminal device receiving the third operation, the method further includes: the terminal device receiving a ninth operation; in response to the ninth operation, displaying the first text as editable; the terminal device receiving a tenth operation; in response to the tenth operation, the terminal device modifying the first text to second text.

[0279] In this embodiment of the application, the eighth operation can be used to add text, and the eighth operation can correspond to Figure 15 The terminal device shown in Figure b receives the user's operation to add text 220. The ninth operation can be used to select the text added to the image; the ninth operation can correspond to... Figure 15 The mobile phone shown in Figure a receives the user's selection of text 220. Between the eighth and ninth operations, the terminal device can receive user operations on the image other than text processing. The tenth operation can be used to edit text, and the tenth operation can correspond to... Figure 15 The terminal device in c receives the user's operation to modify text 220.

[0280] The first character can correspond to character 220. When the terminal device receives the user's selection of the first character, the first character switches to an editable state, and the user can modify the content, style, etc. of the first character.

[0281] Optionally, after the terminal device adds the first text to the first image, it receives user operations other than filter processing. The terminal device then processes the image in response to the user's operation. After processing, the terminal device receives the user's operation to select the first text, and the first text becomes editable. In response to the user's operation to modify the first text, the terminal device changes the first text to the second text.

[0282] For example, after the terminal device adds text 220 with the content "text" to the first image, the terminal device receives a user's operation to crop the image. The terminal device responds to the user's operation by cropping the image. After cropping, the terminal device receives a user's operation to select text 220, and text 220 becomes editable. The terminal device then responds to the user's operation to modify the text, changing the first text to the second text with the content "read".

[0283] In other words, after a user adds text and performs other operations, when the user selects the text added to the image again, they can switch to the text editing interface to modify the text further. In this embodiment, added stickers, doodles, watermarks, and frames can also be modified. This makes it easier for users to process images and improves the user experience.

[0284] Optionally, before the terminal device receives the third operation, the method further includes: the terminal device receiving an eleventh operation; in response to the eleventh operation, the terminal device adding a frame around the first image; wherein, while the cropping operation continues to operate on the interface of the terminal device, the terminal device does not display the frame; when the cropping operation ends, the terminal device obtains the third image, the third image including the frame.

[0285] In this embodiment, the eleventh operation can be used to add a frame around the image. The eleventh operation can correspond to... Figure 16 As shown in image e: The mobile phone receives the user's selection of the frame function 207 and adds a frame to image 101. The third image can correspond to... Figure 16 In c, the image 1301 is obtained after cropping.

[0286] according to Figure 16 As shown in the logical layers, the frame is located on top of the cropping layer. Therefore, the cropping operation does not affect the frame. When the terminal device responds to the user's operation and crops the first image, the frame is temporarily not displayed. When the terminal device responds to the user's operation and completes the cropping operation, the third image is obtained, and the frame surrounds the third image. The size of the frame can be automatically adjusted according to the size of the third image.

[0287] In this way, when the user crops the picture, the photo frame is not affected by the cropping, and can be displayed again at the periphery of the cropped picture after the cropping is completed, meeting the picture processing expectation of the user and improving the use experience of the user.

[0288] It can be understood that, in the steps S1501-S1508, S1501, S1503, and S1508 are optional steps.

[0289] The method provided by the embodiment of the application is described above, and the device for executing the method is described below. As shown in Figure 16 The method provided by the embodiment of the application is described above, and the device for executing the method is described below. As shown in Figure 16 The structure diagram of the graffiti processing device provided by the embodiment of the application is shown in Figure 17 The structure diagram of the graffiti processing device provided by the embodiment of the application is shown in

[0290] As shown in Figure 17 The graffiti processing device 1500 can be used in a circuit, a hardware component, or a chip, and the graffiti processing device includes a processing unit 1510. The processing unit 1510 is configured to support the steps performed by the graffiti processing device, for example, the processing unit is configured to process the steps S1510-S1409.

[0291] In a possible implementation, the graffiti processing device can further include a storage unit 1530. The storage unit 1530 can include one or more memories, and the memory can be a device for storing programs or data in one or more devices or circuits.

[0292] The storage unit 1530 can exist independently and be connected to the processing unit 1510 through a communication bus. The storage unit 1530 can also be integrated with the processing unit 1510.

[0293] For example, the graffiti processing device can be a chip or a chip system of the terminal device in the embodiment of the application. The storage unit 1530 can store computer execution instructions of the method of the terminal device, so that the processing unit 1510 executes the method of the terminal device in the above embodiment. The storage unit 1530 can be a register, a cache, or a random access memory (RAM), and the storage unit 1530 can be integrated with the processing unit 1510. The storage unit 1530 can be a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, and the storage unit 1530 can be independent of the processing unit 1510.

[0294] In a possible implementation, the graffiti processing apparatus further includes a communication unit 1520. The communication unit 1520 is configured to support the graffiti processing apparatus to interact with other devices. For example, when the graffiti processing apparatus is a terminal device, the communication unit 1520 can be a communication interface or an interface circuit. When the graffiti processing apparatus is a chip or a chip system in a terminal device, the communication unit 1520 can be a communication interface. For example, the communication interface can be an input / output interface, a pin, or a circuit.

[0295] The apparatus of the embodiment can be used to perform the steps performed in the method embodiments described above, and the implementation principles and technical effects are similar, which will not be described here.

[0296] ​ A hardware structure schematic diagram of an electronic device provided by the embodiment of the present application is shown in FIG. 16. The electronic device includes a processor 1601, a communication line 1604, and at least one communication interface (for example, the communication interface 1603 is taken as an example for description). ​ ​

[0297] The processor 1601 can be a general central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling program execution of the solutions of the present application.

[0298] The communication line 1604 can include a circuit for transmitting information between the above components.

[0299] The communication interface 1603 uses any transceiver-like device, for example, to communicate with other devices or communication networks, such as an Ethernet, a wireless local area networks (WLAN), and the like.

[0300] Possibly, the electronic device can further include a memory 1602.

[0301] ​​The memory 1602 may be a read-only memory (ROM) or other type of static storage device capable of storing static information and instructions, random access memory (RAM) or other type of dynamic storage device capable of storing information and instructions, or electrically erasable programmable read-only memory (EEPROM), compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compressed optical discs, laser discs, optical discs, digital universal optical discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or any other medium capable of carrying or storing desired program code in the form of instructions or data structures and accessible by a computer, but not limited thereto. The memory may exist independently and be connected to the processor via communication line 1604. The memory may also be integrated with the processor.

[0302] The memory 1602 stores computer execution instructions for implementing the scheme of this application, and its execution is controlled by the processor 1601. The processor 1601 executes the computer execution instructions stored in the memory 1602 to implement the method provided in the embodiments of this application.

[0303] It is possible that the computer execution instructions in the embodiments of this application may also be referred to as application code, and the embodiments of this application do not specifically limit this.

[0304] In a specific implementation, as one example, the processor 1601 may include one or more CPUs, for example... ​ CPU0 and CPU1 in the CPU.

[0305] In a specific implementation, as one example, an electronic device may include multiple processors, for example... ​ Processors 1601 and 1605 are mentioned. Each of these processors can be a single-core (single-CPU) processor or a multi-core (multi-CPU) processor. Here, "processor" can refer to one or more devices, circuits, and / or processing cores used to process data (such as computer program instructions).

[0306] For example, ​ This is a schematic diagram of a chip structure provided in an embodiment of this application. Chip 1700 includes one or more (including two) processors 1720 and a communication interface 1730.

[0307] In some embodiments, the memory 1740 stores elements such as executable modules or data structures, or a subset of them, or an expanded set of them.

[0308] In the embodiments of the present application, the memory 1740 can include read-only memory and random access memory, and provide instructions and data for the processor 1720. A part of the memory 1740 can also include non-volatile random access memory (NVRAM).

[0309] In the embodiments of the present application, the memory 1740, the communication interface 1730 and the processor 1720 are coupled together through the bus system 1710. Among them, the bus system 1710 can include not only a data bus, but also a power bus, a control bus and a status signal bus, etc. For the convenience of description, all kinds of buses are marked as the bus system 1710 in the ​ embodiments of the present application.

[0310] The above-mentioned method described in the embodiments of the present application can be applied in the processor 1720 or implemented by the processor 1720. The processor 1720 can be an integrated circuit chip with processing capability. In the implementation process, each step of the above-mentioned method can be completed by the integrated logic circuit of the hardware in the processor 1720 or the instruction of the software form. The above-mentioned processor 1720 can be a general-purpose processor (for example, a microprocessor or a conventional processor), a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices or discrete hardware components, the processor 1720 can implement or execute the methods, steps and logic block diagrams disclosed in the embodiments of the present application.

[0311] The steps of the method disclosed in the embodiments of the present application can be directly embodied as hardware code processing executed by the processor, or executed by the combination of hardware and software modules in the code processing. Among them, the software module can be located in the storage medium mature in the art such as random access memory, read-only memory, programmable read-only memory or electrically erasable programmable read-only memory (EEPROM). The storage medium is located in the memory 1740, and the processor 1720 reads the information in the memory 1740, and combines the hardware to complete the steps of the above-mentioned method.

[0312] In the above embodiments, the instructions stored in the memory for execution by the processor can be implemented in the form of a computer program product. The computer program product can be written in advance into the memory, or downloaded into the memory in the form of software and installed.

[0313] The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the processes or functions according to the embodiments of the present application are generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another, for example, the computer instructions can be transmitted from one website, computer, server or data center to another website, computer, server or data center through a wired (such as coaxial cable, optical fiber, digital subscriber line (DSL) or wireless (such as infrared, wireless, microwave, etc.)) way. The computer-readable storage medium can be any available medium that the computer can store or be integrated into a data storage device such as a server, data center, etc. including one or more available media sets. For example, the available media can include magnetic media (such as floppy disk, hard disk or magnetic tape), optical media (such as digital versatile disc (DVD)), or semiconductor media (such as solid state disk (SSD)) and the like.

[0314] The embodiments of the present application also provide a computer-readable storage medium. The methods described in the above embodiments can be implemented by software, hardware, firmware or any combination thereof in whole or in part. The computer-readable medium can include computer storage medium and communication medium, and can also include any medium that can transfer a computer program from one place to another. The storage medium can be any target medium that can be accessed by a computer.

[0315] As a possible design, the computer readable medium can include compact disc read-only memory (CD-ROM), RAM, ROM, EEPROM, or other optical disk storage; the computer readable medium can include magnetic disk storage or other magnetic storage devices. Moreover, any connection line can also be appropriately referred to as a computer readable medium. For example, if software is transmitted from a website, server or other remote source using a coaxial cable, fiber optic cable, twisted pair, DSL or wireless technology (such as infrared, radio and microwave), the coaxial cable, fiber optic cable, twisted pair, DSL or wireless technology such as infrared, radio and microwave is included in the definition of the medium. As used herein, magnetic disks and optical disks include compact disks (CDs), laser disks, optical disks, digital versatile disks (DVDs), floppy disks and Blu-ray disks, wherein magnetic disks generally reproduce data magnetically and optical disks reproduce data optically using a laser.

[0316] The above combinations also should be included within the scope of the computer readable medium. The above specification, examples and data provide essential information for a person of ordinary skill in the art to make and use the present application. The general scope of the application is not to be limited based on the specific embodiments described above but rather based on the total scope of the claims submitted herewith.

Claims

1. A scribbling processing method characterized by, The method comprises the following steps: The terminal device displays a first picture; wherein in a logical layer of the first picture, a material or function in an upper layer has an influence on a material or function in a lower layer, and the material or function in the lower layer has no influence on the material or function in the upper layer; the logical layer is divided according to different processing functions in a gallery application of the terminal device; The terminal device receives a first operation; In response to the first operation, the terminal device displays a first layer of graffiti in the upper layer of the first picture; The terminal device receives a second operation; In response to the second operation, the terminal device adds an element to the first picture, wherein the element does not belong to graffiti; the element comprises one or more of the following: text, watermark, sticker or mosaic; The terminal device receives a third operation; In response to the third operation, the terminal device displays a second layer of graffiti in the upper layer of the first picture; The terminal device receives an erasing operation, and a region affected by the erasing operation comprises the first layer of graffiti and the second layer of graffiti; In response to the erasing operation, the terminal device erases the region affected by the erasing operation in the first layer of graffiti and erases the region affected by the erasing operation in the second layer of graffiti, to obtain a second picture; Before the terminal device receives the third operation, the method further comprises the following steps: The terminal device receives an eleventh operation; In response to the eleventh operation, the terminal device adds a photo frame to a periphery of the first picture; The terminal device receives a cropping operation, and the cropping operation continuously acts on an interface of the terminal device; wherein the cropping function is arranged in a lower layer of text, watermark and sticker, and the cropping function is arranged in an upper layer of graffiti and mosaic; When the cropping operation continuously acts on the interface of the terminal device, the terminal device displays the first layer of graffiti and does not display the photo frame; and when the element comprises the mosaic, the terminal device displays the mosaic; when the element comprises one or more of the text, watermark and sticker, the terminal device does not display the one or more of the text, watermark and sticker; When the cropping operation ends, the terminal device obtains a third picture, the periphery of the third picture comprises the photo frame, and the size of the photo frame is automatically adjusted according to the size of the third picture; and when the element comprises one or more of the text, watermark and sticker, the third picture comprises the one or more of the text, watermark and sticker, and the one or more of the text, watermark and sticker automatically adapt to the size of the cropped picture.

2. The method of claim 1, wherein, After the terminal device displays the first picture, the method further comprises the following steps: The terminal device receives a fourth operation for the first picture in the gallery application; In response to the fourth operation, the terminal device displays a tool bar, wherein the tool bar comprises a primary tool bar and does not comprise a secondary tool bar.

3. The method of claim 2, wherein, The primary tool bar comprises one or more of the following functions: cropping, filter, adjustment, beautifying, graffiti, text, mosaic, watermark, photo frame, blurring, color reservation or sticker.

4. The method of claim 3, wherein, Some functions are displayed in the primary tool bar, and the method further comprises the following steps: When a sliding operation is received in the primary toolbar, based on a sliding direction of the sliding operation, a function in the primary toolbar that is hidden in the sliding direction is displayed.

5. The method according to any one of claims 1 to 4, characterized in that, After the terminal device obtains the second picture, the terminal device further includes: The terminal device receives a fifth operation. In response to the fifth operation, the terminal device saves the second picture.

6. The method according to any one of claims 1 to 4, characterized in that, Before the terminal device adds the element to the first picture, the terminal device further includes: The terminal device receives a sixth operation. In response to the sixth operation, the terminal device displays a filter toolbar, the filter toolbar including one or more filter options. When a trigger to a first filter option in the plurality of filter options is received, the terminal device adds a first filter corresponding to the first filter option to the first picture, and displays the first filter option in a selected state. Before the terminal device adds the element to the first picture, the terminal device further includes: The terminal device receives a seventh operation. In response to the seventh operation, the terminal device displays a filter toolbar, the first filter option in the filter toolbar being in a selected state. When a trigger to a second filter option in the plurality of filter options is received, the terminal device switches the first filter to a second filter corresponding to the second filter option, the second filter option in the filter toolbar being in a selected state, and the first filter option being in a non-selected state.

7. The method according to any one of claims 1 to 4, characterized in that, Before the terminal device adds the element to the first picture, the terminal device further includes: The terminal device receives an eighth operation. In response to the eighth operation, the terminal device adds a first text to the first picture. Before the terminal device adds the element to the first picture, the terminal device further includes: The terminal device receives a ninth operation. In response to the ninth operation, the first text is displayed in an editable state. The terminal device receives a tenth operation. In response to the tenth operation, the terminal device modifies the first text to a second text.

8. The method according to any one of claims 1 to 4, characterized in that, Before the terminal device displays the first picture, the terminal device further includes: The terminal device displays an interface of a gallery, the interface of the gallery including one or more pictures. The terminal device receives a twelfth operation. In response to the twelfth operation, the terminal device displays the first picture.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, The processor executes the computer program, so that the electronic device performs the method in any one of claims 1-8.

10. A computer-readable storage medium, characterized in that, The computer readable storage medium stores a computer program, and the computer program is executed by the processor to implement the method in any one of claims 1-8.

11. A computer program product, characterised in that, The computer program is executed, so that the electronic device performs the method in any one of claims 1-8.

Citation Information

Patent Citations

  • A method and terminal for content editing

    CN109523609A

  • Device, method, and graphical user interface for annotating content

    CN110720087A