Image editing method and electronic device
By recommending a personalized editing menu based on the information of each thing in the picture in an electronic device, the problem that existing photo editing software cannot meet users' personalized needs is solved, and personalized editing of every thing in the picture is achieved.
Patent Information
- Application Number
- PCT/CN2024/096409
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-09-22
- Filing Date
- 2024-05-30
- Publication Date
- 2025-03-27
AI Technical Summary
Existing photo editing software uses fixed editing parameters in image editing, resulting in the generated pictures being the same and unable to meet the personalized needs of users.
By implementing the image editing method in an electronic device, a personalized editing menu is recommended based on the information of each thing in the picture, allowing the user to edit each thing separately.
It realizes personalized editing of every thing in the picture, meets the personalized needs of users, and improves the practicality of picture editing.
Smart Images

Figure CN2024096409_27032025_PF_FP_ABST
Abstract
Description
Picture editing method and electronic device
[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on September 22, 2023, with application number 202311240819.0 and application name “Picture Editing Method and Electronic Device”, the entire contents of which are incorporated by reference into this application. Technical Field
[0002] The embodiments of the present application relate to the field of image processing technology, and in particular to a picture editing method and an electronic device. Background Art
[0003] In daily life, users can take photos and share them through electronic devices. In order to make the photos on electronic devices look better, users will use photo editing software to edit the photos, such as erasing passers-by and obstacles in the photos, beautifying the faces of people in the photos, etc.
[0004] Existing photo editing software offers numerous editing features, such as one-click beautification. These features all come with pre-set, fixed editing parameters. This allows an electronic device to use the software to edit images, enhancing the image to a certain degree based on the pre-set parameters for each function. Furthermore, when using the software to edit images, users can save their own parameters as a template, which can then be applied to the user's image when editing.
[0005] However, when electronic devices use this photo editing software to edit pictures, they use fixed parameters for adjustment and adjust the overall picture, so that the pictures generated by the existing picture editing method are all the same and cannot meet the user's personalized needs for picture editing.
[0006] Summary of the Invention
[0007] The image editing method and electronic device provided in this application realize personalized photo editing and can meet the user's personalized needs for image editing.
[0008] In order to achieve the above objectives, this application adopts the following technical solutions.
[0009] In a first aspect, the present application provides a method for editing an image. The execution subject of the method may be an electronic device or a component located in the electronic device (for example, a chip, a chip system, or a processor, etc.). The following description is based on the execution subject being an electronic device. The method may include: the electronic device displays a first image, where the first image includes a first thing. The electronic device displays an editing menu for the first thing based on information about the first thing, and in response to an operation on the editing menu, the electronic device edits the first thing.
[0010] The information of the first object may include attribute information of the first object, characteristic information of the first object, and the primary and secondary status of the first object in the first image. The attribute information may include object type, such as animals, people, plants, buildings, and decorative objects. Feature information may include shape, size, color, and proportion in the image, etc., which is not specifically limited in this application.
[0011] The priority of the first thing in the first picture may be set in advance, or may be determined based on other information of the first thing, such as one or more of attribute information, characteristic information, and basic information.
[0012] In this way, the electronic device recommends an edit menu for an object in the image based on its information. When the user operates the edit menu, the electronic device edits the first object according to the function of the edit menu. In this way, the electronic device can edit each object in the image individually, enabling personalized editing of each object, meeting the personalized needs of each object, and providing high practicality.
[0013] In some design schemes, before displaying the editing menu of the first thing, the present application provides a picture editing method that also includes: the electronic device determines the editing menu of the first thing based on the information of the first thing, the priority of each information, and the correspondence between the information and the editing function items, and the editing menu includes at least one editing function item.
[0014] In this way, the electronic device recommends a targeted editing menu for each item based on its information, so that each item corresponds to a separate editing menu. When the user navigates to the editing menu, the electronic device edits the first item based on the function of the editing menu. This allows the electronic device to edit each item in the image individually, enabling personalized editing for each item, meeting the individual needs of each item and providing high practicality.
[0015] In some design schemes, before displaying the editing menu of the first thing, the present application provides a picture editing method further including: the electronic device determines the editing menu of the first thing based on the information of the first thing and the user's historical behavior information.
[0016] In this way, the electronic device combines the user's historical behavior information and the item information to recommend a targeted editing menu for the item, and can also recommend editing menus based on the user's preferences. When the user operates the editing menu, the electronic device edits the first item according to the function of the editing menu, which can meet the preferences and aesthetics of different users, provide convenience for users to edit items, and improve user experience.
[0017] In one design solution, the electronic device displays an edit menu for the first thing based on information about the first thing. Specifically, in response to receiving an operation on the first thing, the electronic device displays an edit menu for the first thing.
[0018] In one design, the method further includes: in response to receiving an operation on the first object, the electronic device marking and displaying the first object. The marking display may include: dotted line display, red display, bright light display, blurred display, etc. Of course, highlighting is not limited to the above. In this way, by highlighting objects in the image, the electronic device can facilitate user selection and editing of the objects, thereby facilitating subsequent editing of the objects by the user.
[0019] In one design scheme, the editing menu of the first thing includes at least one of the following items: deletion, beautification, background modification and AI photo editing.
[0020] In some design schemes, the first picture also includes a second thing. Before the electronic device displays an editing menu for the first thing based on information about the first thing, the present application provides a picture editing method that also includes: the electronic device determines, based on information about the first thing and information about the second thing, that the first thing is the main thing in the first picture and the second thing is the secondary thing in the first picture; or, the first thing and the second thing are both the main things in the first picture.
[0021] In some design schemes, the present application provides a picture editing method that also includes: when the first thing and the second thing are both the main things in the first picture, the electronic device displays an editing menu for the first thing, and a first prompt information for the second thing, and the first prompt information is used to prompt the user whether to edit the second thing. In this way, the electronic device can filter out the main things and the secondary things by determining the primary and secondary of each thing in the picture. Afterwards, the electronic device can uniformly recommend an editing menu for the main things, or recommend an editing menu for the main things separately, or recommend a menu for one main thing, and display a prompt information for other main things to prompt the user whether to edit. The electronic device can recommend deleting the editing menu for the secondary things. In this way, the electronic device can have a targeted recommendation menu, so that the image editing operation has primary and secondary, making the image editing operation easier.
[0022] In some design schemes, the present application provides a picture editing method further including: when the second thing is a secondary thing in the first picture, the editing menu of the second thing includes deletion.
[0023] In one design scheme, the editing menu of the first thing includes AI photo editing, and in response to the second operation on the editing menu, the electronic device edits the first thing, specifically: in response to the operation on the AI photo editing, the electronic device displays a first input box, and the first input box is an input box for the editing content of the first thing. The electronic device receives the editing content of the first thing input by the user in the first input box. The electronic device edits the first thing according to the editing content. The format of the editing content can be text format or audio format, which is not specifically limited in this application. In this way, the electronic device can realize automatic photo editing through AI photo editing, which simplifies the photo editing operation and makes photo editing more convenient and quick.
[0024] In one design scheme, the electronic device edits the first thing according to the edited content, which can be specifically: the electronic device reports the edited content and the information of the first thing to other devices, and the other devices edit the first thing according to the edited content and return the edited thing information. The electronic device displays the edited first thing based on the edited thing information. Among them, the other devices may include servers, cloud platforms, etc. In this way, the electronic device reduces the computing power of the electronic device and saves the resources of the electronic device by reporting the edited content and the information of the first thing to other devices, and having the other devices edit the first thing.
[0025] In one design solution, the electronic device displays the edited first object based on the edited object information. Specifically, the electronic device displays the edited first object using a preset display mode based on the edited object information. Preset display modes may include gradient display, fade-in display, flip display, blink display, etc., and need to be set according to actual needs during implementation. Thus, the electronic device displays the edited first object using the preset display mode, achieving a dynamic photo editing effect, allowing the user to perceive the changes before and after the photo editing, and improving the user's visual experience.
[0026] In some design schemes, before the electronic device displays the editing menu of the first thing based on the information of the first thing, the present application provides a picture editing method further including: the electronic device splits the first thing in the first picture. In this way, the electronic device can split the things in the picture. The electronic device recommends an editing menu for the thing based on the information of the thing. When the user operates the editing menu, the electronic device edits the first thing according to the function of the editing menu. In this way, the electronic device can edit the thing by splitting the thing in the picture, and can realize separate editing of each thing in the picture; the electronic device then recommends the editing menu of the thing based on the information of the thing, and can realize personalized editing of each thing, meet the personalized needs of each thing, and has high practicality.
[0027] In one design solution, the electronic device splits the first thing in the first picture, which may specifically be: the electronic device splits the first thing in the first picture according to the correlation of image features of the first thing in the first picture.
[0028] In one design solution, the electronic device splits the first thing in the first picture, which may specifically be: in response to an operation on the first thing, the electronic device splits the first thing in the first picture.
[0029] In a second aspect, the present application provides an electronic device comprising: a display module and an editing module, wherein the display module is configured to display a first image, the first image including a first object; the display module is configured to display an editing menu for the first object based on information about the first object; and the editing module is configured to edit the first object in response to a second operation on the editing menu.
[0030] The information of the first object may include attribute information of the first object, characteristic information of the first object, and the primary and secondary status of the first object in the first image. The attribute information may include object type, such as animals, people, plants, buildings, and decorative objects. Feature information may include shape, size, color, and proportion in the image, etc., which is not specifically limited in this application.
[0031] The priority of the first thing in the first picture may be set in advance, or may be determined based on other information of the first thing, such as one or more of attribute information, characteristic information, and basic information.
[0032] In this way, the electronic device recommends an edit menu for an object in the image based on its information. When the user operates the edit menu, the electronic device edits the first object according to the function of the edit menu. In this way, the electronic device can edit each object in the image individually, enabling personalized editing of each object, meeting the personalized needs of each object, and providing high practicality.
[0033] In some design schemes, the electronic device also includes: a determination module, wherein the determination module is used to determine the editing menu of the first thing based on the information of the first thing, the priority of each information, and the correspondence between the information and the editing function items, and the editing menu includes at least one editing function item.
[0034] In this way, the electronic device recommends a targeted editing menu for each item based on its information, so that each item corresponds to a separate editing menu. When the user navigates to the editing menu, the electronic device edits the first item based on the function of the editing menu. This allows the electronic device to edit each item in the image individually, enabling personalized editing for each item, meeting the individual needs of each item and providing high practicality.
[0035] In one design solution, the determination module is used to determine an edit menu for the first thing based on information about the first thing and historical behavior information of the user.
[0036] In this way, the electronic device combines the user's historical behavior information and the item information to recommend a targeted editing menu for the item, and can also recommend editing menus based on the user's preferences. When the user operates the editing menu, the electronic device edits the first item according to the function of the editing menu, which can meet the preferences and aesthetics of different users, provide convenience for users to edit items, and improve user experience.
[0037] In one design solution, the display module is configured to: in response to receiving an operation on the first thing, display an edit menu for the first thing.
[0038] In one design solution, the display module is configured to, in response to receiving an operation on the first object, mark and display the first object. The highlighted display may include: a dotted line display, a red mark display, a bright light display, a blurred display, etc. Of course, the highlighted display is not limited to the above. In this way, by highlighting objects in an image, the electronic device can facilitate user selection and editing of the objects, thereby facilitating subsequent editing by the user.
[0039] In one design scheme, the editing menu of the first thing includes at least one of the following items: deletion, beautification, background modification and AI photo editing.
[0040] In one design scheme, the first picture also includes a second thing, and the determination module is used to: determine, based on information about the first thing and information about the second thing, that the first thing is the main thing in the first picture and the second thing is the secondary thing in the first picture; or, that the first thing and the second thing are both the main things in the first picture.
[0041] In one design scheme, the display module is used to: when the first thing and the second thing are both the main things in the first picture, display an edit menu for the first thing and a first prompt message for the second thing, and the first prompt message is used to prompt the user whether to edit the second thing. In this way, the electronic device can filter out the main things and the secondary things by determining the primary and secondary of each thing in the picture. Afterwards, the electronic device can uniformly recommend an edit menu for the main things, or recommend an edit menu for the main things separately, or recommend a menu for one main thing and display a prompt message for other main things to prompt the user whether to edit. The electronic device can recommend deleting the edit menu for the secondary things. In this way, the electronic device can have a targeted recommendation menu, so that the image editing operation has primary and secondary, making the image editing operation easier.
[0042] In one design solution, the display module is configured to: when the second thing is a secondary thing in the first picture, the edit menu of the second thing includes a delete option.
[0043] In one design scheme, the editing menu of the first thing includes AI photo editing, and the editing module is used to: in response to the operation of the AI photo editing, display a first input box, the first input box being an input box for the editing content of the first thing; receive the editing content of the first thing input by the user in the first input box; and edit the first thing according to the editing content. The format of the editing content can be text format or audio format, which is not specifically limited in this application. In this way, the electronic device can realize automatic photo editing through AI photo editing, which simplifies the photo editing operation and makes photo editing more convenient and quick.
[0044] In one design, the editing module is configured to: report the edited content and information about the first item to another device; the other device edits the first item based on the edited content and returns the edited item information; and display the edited first item based on the edited item information. In this way, by reporting the edited content and information about the first item to another device, the electronic device can edit the first item, thereby reducing the electronic device's computational workload and conserving its resources.
[0045] In one design, the display module is configured to display the edited first item using a preset display mode based on the edited item information. Preset display modes may include gradient display, fade-in display, flip display, blink display, and the like, and may be set based on actual needs during implementation. Thus, the electronic device can display the edited first item using the preset display mode, achieving a dynamic image editing effect, allowing the user to perceive the changes before and after the image editing, and enhancing the user's visual experience.
[0046] In some design solutions, the electronic device further includes a splitting module, wherein the splitting module is configured to split the first object in the first picture. In this way, the electronic device can split the objects in the picture. Based on the object's information, the electronic device recommends an editing menu for the object. When the user operates the editing menu, the electronic device edits the first object according to the functions of the editing menu. In this way, the electronic device can edit the object by splitting it in the picture, enabling individual editing of each object in the picture. The electronic device then recommends an editing menu for the object based on the object's information, enabling personalized editing of each object, meeting the personalized needs of each object and providing high practicality.
[0047] In one design solution, the splitting module is configured to split the first object in the first picture according to the correlation of image features of the first object in the first picture.
[0048] In one design solution, the splitting module is configured to split the first thing in the first picture in response to an operation on the first thing.
[0049] In a third aspect, the present application provides an electronic device, comprising: one or more processors; and a memory, wherein the memory stores code; when the code is executed by the processor, the electronic device executes the method described in the first aspect.
[0050] In a fourth aspect, the present application provides a computer-readable storage medium comprising computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the method as described in the first aspect.
[0051] Among them, the specific implementation methods and corresponding technical effects of each of the above-mentioned second to fourth aspects can refer to the specific implementation methods and technical effects of the above-mentioned first aspect. BRIEF DESCRIPTION OF THE DRAWINGS
[0052] FIG1 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;
[0053] FIG2 is a schematic diagram of a software architecture of an electronic device provided in an embodiment of the present application;
[0054] FIG3 is a schematic diagram of a software architecture of an electronic device provided in an embodiment of the present application;
[0055] FIG4 is a schematic diagram of a flow chart of a picture editing method provided in an embodiment of the present application;
[0056] FIG5 is a schematic diagram of a gallery interface of a picture editing method provided in an embodiment of the present application in an application scenario;
[0057] FIG6 is a schematic diagram of a gallery interface of a picture editing method provided in an embodiment of the present application in an application scenario;
[0058] FIG7 is a schematic diagram of a gallery interface of a picture editing method provided in an embodiment of the present application in an application scenario;
[0059] FIG8 is a schematic diagram of a gallery interface of a picture editing method provided by an embodiment of the present application in an application scenario;
[0060] FIG9 is a schematic diagram of a gallery interface of a picture editing method provided in an embodiment of the present application in an application scenario;
[0061] FIG10 is a schematic diagram of a gallery interface of a picture editing method provided in an embodiment of the present application in an application scenario;
[0062] FIG11 is a schematic diagram of a gallery interface of a picture editing method provided in an embodiment of the present application in an application scenario;
[0063] FIG12-1 is a schematic diagram of a gallery interface of an image editing method provided in an embodiment of the present application in an application scenario;
[0064] FIG12-2 is a schematic diagram of a gallery interface of an image editing method provided in an embodiment of the present application in an application scenario;
[0065] FIG13 is a schematic diagram of a gallery interface of a picture editing method provided in an embodiment of the present application in an application scenario;
[0066] FIG14 is a schematic diagram of a gallery interface of an image editing method provided in an embodiment of the present application in an application scenario;
[0067] FIG15 is a schematic diagram of a gallery interface of a picture editing method provided in an embodiment of the present application in an application scenario;
[0068] FIG16 is a schematic diagram of a gallery interface of a picture editing method provided in an embodiment of the present application in an application scenario;
[0069] FIG17 is a schematic diagram of a gallery interface of a picture editing method provided in an embodiment of the present application in an application scenario;
[0070] FIG18 is a schematic diagram of a gallery interface of a picture editing method provided in an embodiment of the present application in an application scenario;
[0071] FIG19 is a schematic diagram of a gallery interface of an image editing method provided in an embodiment of the present application in an application scenario;
[0072] FIG20 is a schematic diagram of a gallery interface of a picture editing method provided in an embodiment of the present application in an application scenario;
[0073] FIG21 is a schematic diagram of a gallery interface of a picture editing method provided in an embodiment of the present application in an application scenario;
[0074] FIG22 is a schematic diagram of a gallery interface of a picture editing method provided in an embodiment of the present application in an application scenario;
[0075] FIG23 is a schematic diagram of a gallery interface of a picture editing method provided in an embodiment of the present application in an application scenario;
[0076] FIG24 is a schematic diagram of a gallery interface of a picture editing method provided in an embodiment of the present application in an application scenario;
[0077] FIG25 is a schematic diagram of a gallery interface of a picture editing method provided in an embodiment of the present application in an application scenario;
[0078] FIG26 is a schematic structural diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0079] To enhance the quality of images displayed on electronic devices, electronic devices can be installed with photo editing software. Users often use photo editing software to edit photos, such as removing pedestrians or obstacles from photos, beautifying the faces of people in photos, and so on. Specifically, photo editing software provides many photo editing functions, such as a one-click beautification function. These photo editing functions all have pre-set fixed editing parameters. Thus, when an electronic device uses this photo editing software to edit a picture, the photo editing software can beautify the edited picture to a certain extent based on the pre-set parameter values of different photo editing functions. In addition, when using photo editing software to edit a picture, the user can save their various parameters as a template, and when other users edit the picture, they can apply this template to the user's edited picture. However, photo editing software uses fixed editing parameters or templates to adjust the overall picture, making the modified pictures look the same and unable to meet the user's personalized needs for picture editing.
[0080] In order to solve the above problems, an embodiment of the present application provides a picture editing method, which is applied to an electronic device, which has a first application installed. The electronic device receives an operation on the first interface of the first application and displays a first picture, which includes a first thing. The electronic device splits the first thing in the first picture. The electronic device displays an editing menu for the first thing based on the first information of the first thing. In response to the operation on the editing menu, the electronic device edits the first thing according to the function of the editing menu. That is, the electronic device can split the things in the picture. The electronic device recommends an editing menu for the thing based on the information of the thing. When the user operates the editing menu, the electronic device edits the first thing according to the function of the editing menu. In this way, the electronic device can edit the thing by splitting the thing in the picture, and can realize separate editing of each thing in the picture; the electronic device then recommends the editing menu for the thing based on the information of the thing, and can realize personalized editing of each thing, meeting the personalized needs of each thing, and has high practicality.
[0081] The first information of the first object can be understood as attribute information, feature information, etc. of the first object. The attribute information may include object type, such as animals, people, plants, buildings, and decorative objects. Feature information may include shape, size, color, and proportion in the image. Of course, the embodiments of the present application are not limited to this.
[0082] FIG1 is a structural block diagram of the electronic device.
[0083] As shown in FIG1 , electronic device 100 may include a processor 110, a memory 120, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, a wireless communication module 150, a sensor module 160, a button 170, a display 180, and a camera 190. Sensor module 160 may include a pressure sensor 160A, a touch sensor 160B, and the like.
[0084] It is understood that the structures illustrated in the embodiments of the present application do not constitute specific limitations on the electronic device. In other embodiments of the present application, the electronic device may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0085] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.
[0086] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.
[0087] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.
[0088] The charging management module 140 is configured to receive charging input from a charger. The charger can be either a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input via the electronic device's wireless charging coil. While charging the battery 142, the charging management module 140 can also power the electronic device through the power management module 141.
[0089] The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 and provides power to the processor 110, the memory 120, the display 180, and the wireless communication module 150. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage, impedance). In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.
[0090] The wireless communication function of the electronic device can be implemented through the antenna 1, the wireless communication module 150, the modem processor and the baseband processor.
[0091] Antenna 1 is used to transmit and receive electromagnetic wave signals. Each antenna in an electronic device can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antenna can be used in conjunction with a tuning switch.
[0092] The wireless communication module 150 can provide wireless communication solutions for electronic devices, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc. The wireless communication module 150 can be one or more devices that integrate at least one communication processing module. The wireless communication module 150 receives electromagnetic waves via the antenna 1, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 150 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 1.
[0093] The electronic device implements its display functionality through a GPU, display screen 180, and an application processor. A GPU is a microprocessor for image processing that connects display screen 180 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.
[0094] Display screen 180 is used to display images, videos, and the like. Display screen 180 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLed, or a quantum dot light-emitting diode (QLED). In some embodiments, the electronic device can include one or N display screens 180, where N is a positive integer greater than one.
[0095] The electronic device can implement a shooting function through an ISP, a video codec, a GPU, a display screen 180, and an application processor.
[0096] The ISP processes data fed back by camera 190. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then passed to the ISP for processing and transformed into a visible image. The ISP can also perform algorithmic optimization on image noise and brightness. It can also optimize parameters such as exposure and color temperature of the captured scene. In some embodiments, the ISP can be located within camera 190.
[0097] The camera 190 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB (RGB represents red, green, and blue), YUV ("Y" represents brightness (Luminance or Luma), that is, grayscale value, and "U" and "V" represent chrominance (Chrominance or Chroma)) format. In some embodiments, the electronic device may include 1 or N cameras 190, where N is a positive integer greater than 1.
[0098] Digital signal processors (DSPs) are used to process digital signals. Besides digital image signals, they can also process other digital signals. For example, when an electronic device selects a frequency, the DSP performs a Fourier transform on the frequency energy.
[0099] Video codecs are used to compress or decompress digital video. Electronic devices may support one or more video codecs. This allows them to play or record videos in a variety of encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, and MPEG4.
[0100] The NPU is a neural network (NN) computing processor. Drawing on the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it rapidly processes input information and can continuously self-learn. The NPU enables intelligent cognitive applications in electronic devices, such as image recognition, face recognition, speech recognition, and text comprehension.
[0101] The memory 120 can be used to store computer executable program code, which includes instructions. The memory 120 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device (such as audio data, a phone book, etc.), etc. In addition, the memory 120 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the electronic device by running instructions stored in the memory 120, and / or instructions stored in a memory provided in the processor.
[0102] Pressure sensor 160A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 160A can be located on display screen 180. There are many types of pressure sensors 160A, such as resistive, inductive, and capacitive. A capacitive pressure sensor can include at least two parallel plates made of conductive material. When force acts on pressure sensor 160A, the capacitance between the electrodes changes. The electronic device determines the intensity of the pressure based on this change in capacitance. When a touch operation is applied to display screen 180, the electronic device detects the intensity of the touch operation based on pressure sensor 160A. The electronic device can also calculate the location of the touch based on the detection signal from pressure sensor 160A. In some embodiments, touch operations applied to the same touch location but with different touch operation intensities can correspond to different operation instructions. For example, when a touch operation with an intensity less than a first pressure threshold is applied to a short message application icon, an instruction to view short messages is executed. When a touch operation with an intensity greater than or equal to the first pressure threshold is applied to a short message application icon, an instruction to create a new short message is executed.
[0103] Touch sensor 160B, also known as a "touch-sensitive device," can be disposed on display screen 180. Touch sensor 160B and display screen 180 form a touch screen, also known as a "touch screen." Touch sensor 160B is configured to detect touch operations applied thereto or in the vicinity thereof. The touch sensor can transmit the detected touch operations to an application processor to determine the type of touch event. Visual output related to the touch operations can be provided via display screen 180. In other embodiments, touch sensor 160B can also be disposed on the surface of the electronic device, at a location different from that of display screen 180.
[0104] The buttons 170 include a power button, a volume button, and the like. The buttons 170 may be mechanical buttons or touch buttons. The electronic device may receive key inputs and generate key signal inputs related to user settings and function control of the electronic device.
[0105] Of course, the electronic device may also include other functional units, which is not limited in the embodiments of the present application.
[0106] The electronic device 100 is an electronic device with an image display function. For example, the electronic device 100 may be a mobile phone, a tablet computer, a laptop, a notebook computer, an ultra-mobile personal computer (UMPC), a handheld computer, a netbook, a personal digital assistant (PDA), a wearable electronic device, etc.
[0107] Refer to Figures 2 and 3, which are software structure block diagrams of the electronic device provided in the embodiments of the present application.
[0108] As shown in Figures 2 and 3, the layered architecture divides software into several layers, each with distinct roles and responsibilities. Layers communicate with each other via software interfaces. In some feasible implementations, the operating system of an electronic device can be divided, from top to bottom, into the following: application layer, application framework layer, Android runtime and system libraries, and kernel layer.
[0109] The application layer can include a series of application packages.
[0110] As shown in Figures 2 and 3, the application package may include account applications, Bluetooth, device management applications (applications with device management functions), navigation, memos, WLAN, short messages, gallery, camera, calendar, call and other applications (application, APP).
[0111] The application framework layer provides application programming interfaces and programming frameworks for applications in the application layer. The application framework layer includes some predefined functions.
[0112] As shown in Figures 2 and 3, the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like.
[0113] The window manager is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, take screenshots, etc.
[0114] Content providers are used to store and retrieve data and make it accessible to applications. Such data can include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.
[0115] The view system includes visual controls, such as those for displaying text and images. The view system is used to build applications. A display interface can consist of one or more views. For example, a display interface containing a text notification icon might include a view for displaying text and a view for displaying images.
[0116] The phone manager is used to provide communication functions for the device, such as managing call status (including answering, hanging up, etc.).
[0117] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.
[0118] The Notification Manager allows applications to display notifications in the status bar. These messages can be displayed briefly and then disappear automatically, without requiring user interaction. For example, the Notification Manager can be used to notify users of completed downloads, message reminders, and so on. The Notification Manager can also display notifications in the top status bar of the system as icons or scrolling text, such as notifications from background applications, or as dialog interfaces on the screen. Examples include text messages in the status bar, beeps, vibrations on electronic devices, and flashing indicator lights.
[0119] Android Runtime includes core libraries and a virtual machine. Android runtime is responsible for the scheduling and management of the operating system.
[0120] The core library consists of two parts: one is the function that needs to be called by the Java language, and the other is the core library.
[0121] The application layer and application framework layer run in a virtual machine. The virtual machine executes Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.
[0122] The system library can include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.
[0123] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.
[0124] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
[0125] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0126] A 2D graphics engine is a drawing engine for 2D drawings.
[0127] The core layer is the layer between hardware and software. It includes at least the display driver, camera driver, audio driver, and sensor driver. It also includes an image segmentation module, a menu module, an editing module, and a semantic understanding module. The image segmentation module separates the images of various objects in the image. The menu module recommends editing menus for each object. The editing module edits objects based on editing parameters. The semantic understanding module understands the objects in the image.
[0128] It should be noted that the modules shown in Figures 2 and 3 can be integrated into the application framework layer, or integrated into a specific application, such as the image library response in. This embodiment of the application does not make specific limitations.
[0129] In one example, the specific operating process based on the software architecture of the electronic device 100 shown in FIG. 2 may be as follows: Step 1: The electronic device 100 receives a user operation on the application icon of a first application. The electronic device 100 displays the interface of the first application, which displays a first image, which may include a first object. The image segmentation module of the electronic device 100 segments the first object in the first image. Step 2: The image segmentation module of the electronic device 100 sends information about the segmented first object to the semantic understanding module, which interprets the first object based on the information about the first object. Step 3: The semantic understanding module generates an instruction instructing the menu module of the electronic device 100 to recommend an edit menu for the first object. Step 4: The electronic device 100 displays the edit menu for the first object recommended by the menu module. Step 5: The electronic device 100 receives the user operation on the edit menu. Step 6: In response to the operation, the editing module of the electronic device 100 edits the first object according to the parameters of the edit menu. Step 7: The electronic device 100 displays the edited first image.
[0130] In another example, the specific operating process of the communication system and software architecture of the electronic device 100 shown in FIG. 3 may be as follows: The difference from the above is that, in step 5, the electronic device 100 receives a user operation on the edit menu, which may be AI editing. In response to this operation, the electronic device 100 displays an input box. After the user enters edit content in the input box, the electronic device 100 executes step 8, where the semantic understanding module understands the semantics expressed by the edit content. In step 9, the semantic understanding module uploads the understood semantics and information about the first object to another device, such as the server 200. The server 200 edits the first object based on the semantics understood by the semantic understanding module and the information about the first object, obtaining edited object information. In step 10, the server 200 sends the edited object information to the editing module. Then, in step 7, the editing module sends the edited object information to the application layer for display. At this point, the electronic device 100 displays the edited first image. Of course, when the user enters edit content for the first object in the first input box, the electronic device 100 can edit the first object based on the edit content. Specifically, the semantic understanding module of the electronic device 100 understands the semantics expressed by the editing content and sends the understood semantics to the editing module. The editing module can edit the first thing according to the semantics understood by the semantic understanding module. No specific limitation is made in the embodiments of this application.
[0131] FIG4 is a flow chart of a method for editing an image provided by an embodiment of the present application. As shown in FIG4 , the method may include: S400-S406 (some of which are optional). For details of S400-S406, please refer to the description of the following embodiment. Specifically, it may be:
[0132] S400: The electronic device starts a gallery application and displays a first interface of the gallery application.
[0133] In one example, as shown in FIG5 , a user clicks on interface 110 of electronic device 100 to display icon 111 of a gallery application. In response to the user's click, electronic device 100 launches the gallery application. The display interface of electronic device 100 jumps to interface 120 (i.e., interface 1) shown in FIG6 . Interface 120 includes multiple images, including a first image, such as image 121.
[0134] S401: The electronic device receives an operation 1 on the first interface of the gallery application, where the operation 1 is used to trigger display of a first picture on the second interface.
[0135] The operation may include a click operation, a press operation, a slide operation, etc.
[0136] In one example, operation 1 may be a click operation, and interface 1 may include thumbnails of multiple images. Accordingly, operation 1 on interface 1 of the gallery application can be understood as a click operation on the thumbnail of the first image. For example, a user clicks on image 121 (i.e., the thumbnail of the first image) as shown in FIG6 . The electronic device receives the user's click operation on image 121.
[0137] S402. In response to operation 1, the electronic device displays interface 2, where a first picture is displayed, and the first picture includes at least one thing.
[0138] Among them, things may include people, animals, buildings, decorations, etc. Of course, the things may also include others, such as plants, the sky, etc. This is not specifically limited in the embodiments of the present application.
[0139] In one example, continuing with the above example, in response to a user clicking on the picture 121 shown in FIG6 , the electronic device displays the interface 130 shown in FIG7 , which is a display interface of the first picture corresponding to the picture 121. The interface may include the picture 121, as well as controls for sharing the picture, controls for adding the picture to favorites, controls 131 for editing the picture, controls for deleting the picture, and the like.
[0140] In a specific implementation manner, S400-S402 may be specifically referred to step ① in FIG. 2 and FIG. 3 , and will not be described in detail here.
[0141] S403: The electronic device separates the first object in the first picture.
[0142] Here, splitting the first thing in the first picture can be understood as separating the first thing from other things in the first picture. In this way, when the user operates the first thing, it will not affect other things in the picture.
[0143] In a specific implementation manner, S403 can be specifically implemented as follows: S4031. The electronic device splits the first thing in the first picture according to the correlation of the image features of the first thing in the first picture. Specifically, the electronic device can use a segment anything model (SAM) to split the first thing in the first picture. Of course, the electronic device can split each thing in the first picture. Alternatively, the electronic device can also split several things in the first picture. This is not specifically limited in the embodiments of the present application, and needs to be determined according to actual conditions during specific implementation.
[0144] In a specific implementation manner, the timing for the electronic device to split the first object in the first picture may include the following:
[0145] At the first opportunity, when the electronic device captures the first picture, the electronic device separates the first thing in the first picture.
[0146] Opportunity 2: After the electronic device captures the first picture and is in an idle state, the electronic device separates the first thing in the first picture.
[0147] Opportunity three: when the electronic device displays the first picture, the electronic device separates the first thing in the first picture.
[0148] Opportunity four, when the electronic device receives the user's operation on the first picture, in response to the operation, the electronic device splits the first thing in the first picture. The operation may include a long press operation, and the long press operation can be understood as a press duration greater than a preset duration, for example, a long press operation is an operation of pressing for more than 3 seconds, or a long press operation is an operation of pressing for more than 5 seconds. In one example, when the electronic device receives the user's long press operation on the first thing in the first picture, in response to the operation, the electronic device splits the first thing in the first picture. Exemplarily, the electronic device receives a long press operation of the user clicking on the traffic cone A shown in Figure 7, and in response to the operation, the electronic device splits the traffic cone A in the first picture.
[0149] In a specific implementation manner, S403 may be specifically referred to step ② in FIG. 2 and FIG. 3 , and will not be described in detail here.
[0150] In this way, the electronic device can edit the object by splitting the object in the picture, and can edit each object in the picture separately without affecting other objects, so that each object can be personalized edited to meet the personalized needs of each object, which is highly practical.
[0151] S404: The electronic device highlights the first object in the first picture.
[0152] Among them, highlighting can be understood as marking display. The purpose of this highlighting is to inform the user that the highlighted item can be edited separately, etc. The form of this highlighting can include: dotted line display, red display, bright light display, blurred display, etc. Of course, highlighting is not limited to the above list and is not specifically limited in the embodiments of this application.
[0153] In one specific implementation, S404 may be implemented as follows: when the user operates the first object in the first image, the electronic device highlights the first object in the first image. For example, continuing with the above example, when the user clicks on the traffic cone A shown in FIG7 , the electronic device separates the traffic cone A from the other objects in the first image. At this time, the electronic device displays the interface 140 shown in FIG8 , on which the traffic cone A is highlighted, such as by displaying the outline of the traffic cone A in dotted lines, by displaying the traffic cone A in red, by displaying the area frame of the traffic cone A in dotted lines, or by displaying a mark on the traffic cone A.
[0154] In this way, the electronic device can split the objects in the picture and highlight the split objects, which makes it easier for users to select and edit the objects, providing convenience for users to edit the objects later.
[0155] In one specific implementation, when an electronic device receives a user's action on a first image, in response to the action, the electronic device highlights the first object. This action may include a long press, which can be understood as a press duration greater than a preset duration, such as a press duration exceeding 3 seconds or a press duration exceeding 5 seconds. Furthermore, while the electronic device highlights the first object, when the user actions a second object in the first image, the electronic device highlights the second object. This action on the second object may include a click, such as a single click. For example, continuing with the above example, as shown in FIG7 , when a user long presses traffic cone A, the electronic device highlights traffic cone A. At this point, the electronic device enters an object marking state. When the user clicks person B shown in FIG7 , the electronic device may display person B using a dotted line. That is, when the electronic device is in the object marking state, it can switch and highlight various objects based on the user's switching actions between them.
[0156] It should be noted that, in the embodiment of the present application, S404 may be an optional step.
[0157] S405: The electronic device displays an edit menu of the first thing on the second interface according to the information of the first thing.
[0158] In one example, information about a first object is used to characterize the first object. The information about the first object may include feature information or description information about the first object. The information about the first object may include type, attributes, and priority within the image. The priority of the object within the image may be predefined or determined based on the type and / or attributes of the first object, and is not specifically limited in this embodiment of the application.
[0159] In one example, the editing menu may include at least one of the following editing function items: deletion, beautification, background modification, and artificial intelligence (AI) retouching. Background modification may include at least one of background replacement, background blur, and background decolorization. Beautification may include at least one of one-click beautification, whitening, 3D, smoothing, and skin color. Of course, the embodiments of the present application are not limited to the above examples.
[0160] In one example, the editing menu is determined based on the information of the first thing, that is, the electronic device can intelligently recommend the editing menu corresponding to the first thing based on the information of the first thing. In a specific implementation method, S405 can specifically be: the electronic device determines the editing menu of the first thing based on the information of the first thing, the priority of each information, and the correspondence between the information and the editing function items. Exemplarily, it is assumed that: the priority of a person is greater than the priority of an object, the editing function items corresponding to the person are deletion, beautification, and modification of the background, and the editing function items corresponding to the object are deletion and modification of the background. Based on this, if the first thing is a person, the electronic device can determine that the editing menu of the first thing can include deletion, beautification, and modification of the background. If the first thing is an object, the electronic device can determine that the editing menu of the first thing can include deletion and modification of the background.
[0161] In an embodiment of the present application, the electronic device recommends a targeted editing menu for each object in the image based on its information, so that each object corresponds to a separate editing menu. When the user operates the editing menu, the electronic device edits the first object according to the function of the editing menu. In this way, the electronic device can edit each object in the image individually, enabling personalized editing of each object, meeting the personalized needs of each object, and having high practicality.
[0162] In another specific implementation, S405 may specifically include the electronic device determining an edit menu for the first object based on the information about the first object, the priority of each piece of information, the importance of the first object in the image, and the correspondence between the information and editing function items. The determination of the importance of objects in the image will be discussed below and will not be repeated here. For example, assume that the priority of a person is greater than the priority of an object, the person is the primary object in the image, and the object is the secondary object. The corresponding editing function items for the person are delete, beautify, and modify background, while the corresponding editing function items for the object are delete and modify background. Based on this, if the first object is a person, the electronic device may determine that the edit menu for the first object may include delete, beautify, and modify background. If the first object is an object, the electronic device may determine that the edit menu for the first object may include delete and modify background. For example, if the first object is a person and the first object is the primary object in the image, the electronic device may determine that the edit menu for the first object may include beautify. The electronic device may also further determine the blurriness / sharpness of objects in the image other than the person, and determine that the edit menu for the object may include background replacement, high-definition restoration, etc.
[0163] In another example, the editing menu is determined based on the user's historical behavior. That is, the electronic device can record the user's historical behavior and, based on this history, recommend an editing menu corresponding to the first item. The user's historical behavior can include the user's makeup style, the user's image editing behavior, the user's preferences, and so on. For example, assuming that a picture includes a user image, and the user's historical behavior includes the user's makeup style, such as an intellectual style, the electronic device can display an editing menu for the user image. This editing menu can include a one-touch beautification feature, and the editing parameters for this one-touch beautification feature are intellectual style photo editing parameters.
[0164] Of course, the editing menu may also be determined based on a combination of the information about the first object and the user's historical behavior. For example, assuming that the picture includes a user image and the user's historical behavior includes modifying the background of the picture, the electronic device may display an editing menu for the user image, and the editing menu may include modifying the background.
[0165] In the embodiments of the present application, the electronic device combines the user's historical behavior information and item information to recommend a targeted editing menu for the item, and can also recommend editing menus based on the user's preferences. When the user operates the editing menu, the electronic device edits the first item according to the function of the editing menu, which can meet the preferences and aesthetics of different users, provide convenience for users to edit items, and improve the user experience.
[0166] In one example, the electronic device may spontaneously display an edit menu for the first item on the second interface based on the information of the first item; or, the electronic device may display an edit menu for the first item on the second interface based on the information of the first item when triggered by the user. The following is a detailed description:
[0167] First, the electronic device spontaneously displays an editing menu for the first thing.
[0168] That is, the electronic device can spontaneously display an editing menu of the first thing on the second interface based on the information of the first thing.
[0169] In one specific implementation, S405 may include: the electronic device may display an edit menu for the first object on interface 2 based on the information about the first object. For example, assuming that object A is a traffic cone A and object B is a person B, the electronic device may display an edit menu for object A that is Delete and an edit menu for object B that is Beautify.
[0170] In another specific implementation, S405 may be: the electronic device may determine the main object among the objects based on the information of each object, and then display an edit menu for the main object on interface 2. That is, the electronic device may display an edit menu for at least one object on interface 2 based on the information of each object. In other words, when there are multiple main objects in the image, the electronic device may display an edit menu for each main object, or may display an edit menu common to all main objects or a comprehensive edit menu. It may also display an edit menu for a certain main object, and display prompt information for other main objects, wherein the prompt information is used to prompt the user whether to edit the object.
[0171] Exemplarily, S405 can be specifically implemented as follows: S4051. The electronic device determines that the first thing in the first picture is the main thing based on the information of each thing and its importance level. For example, assuming that the importance level of the person is 3, the importance level of the object is 2, the importance level of the thing size in the picture that is greater than the threshold is 2, the importance level of the thing size in the picture that is less than or equal to the threshold is 1, thing a is a person and its proportion in the picture is greater than the threshold, thing b is an object and its proportion in the picture is less than the threshold, then the importance level of thing a is 3+2=5, and the importance level of thing b is 2+1=3. If the importance level of thing a is greater than the importance level of thing b, then the electronic device determines that thing a is the main thing and thing b is the secondary thing. S4052. The electronic device displays the editing menu of the first thing on interface two. Exemplarily, continuing with the above example, the electronic device displays the editing menu of thing a.
[0172] Exemplarily, S405 can be specifically implemented as follows: S4053. The electronic device determines that the first and second objects in the first picture are both primary objects based on the information and importance levels of each object. For example, assuming that the importance level of a person is 3, the importance level of an object is 2, the importance level of an object whose size in the picture is greater than a threshold is 3, and the importance level of an object whose size in the picture is less than or equal to a threshold is 2. Object a is a person and its size in the picture is less than the threshold, and object b is an object and its size in the picture is greater than the threshold, then the importance level of object a is 3+2=5, and the importance level of object b is 2+3=5. If the importance level of object a is consistent with the importance level of object b, the electronic device determines that both object a and object b are primary objects. S4054. The electronic device displays an edit menu for the first object on interface 2 and displays prompt information for the second object. Exemplarily, continuing with the above example, the electronic device displays the edit menu for object a as beautification and background modification, and displays the prompt information for object b as "Do you want to edit object b?" For another example, as shown in FIG12-2 , in the first picture, both characters B and C are primary objects. The electronic device displays an edit menu for character B and prompt information 143 corresponding to character C. For example, prompt information 143 may read “Edit?” If the user clicks the “Yes” control, the electronic device displays an edit menu for character C. If the user clicks the “No” control, the electronic device determines that the user does not need to edit character C.
[0173] In an embodiment of the present application, the electronic device can filter out primary and secondary objects by determining the primary and secondary nature of each object in the image. The electronic device can then recommend a unified edit menu for the primary objects, or recommend edit menus for each primary object individually. Alternatively, the electronic device can recommend a menu for one primary object and display a prompt prompting the user whether to edit the other primary objects. The electronic device can also recommend a delete edit menu for the secondary objects. In this way, the electronic device can have targeted recommendation menus, making image editing operations prioritized and easier to use.
[0174] The second type is that the electronic device displays an editing menu for the first thing when triggered by the user.
[0175] That is, the electronic device can display an edit menu for the first item on interface 2 in response to a user operation based on the information of the first item. The user operation can be understood as an operation performed by the user on the first image, or an operation performed by the user on an item on the first image. The operation can include a click operation, a long press operation, etc. A long press operation can be understood as a press duration greater than a preset duration, for example, a long press operation is a press duration exceeding 3 seconds.
[0176] In one specific implementation, S405 may be: the electronic device receives a user operation on the first image, and in response to the operation, the electronic device displays an edit menu for the first object on interface 2 based on the information about the first object. For example, when the user clicks on the display area of the first image, the electronic device may display an edit menu for the first object based on the information about the first object in the first image.
[0177] In another specific implementation, S405 may be: the electronic device receives the user's operation on the first thing among the things, and in response to the operation, the electronic device displays the edit menu of the first thing on interface two based on the information of the first thing. Exemplarily, when the user clicks on the traffic cone A shown in FIG7 , the electronic device receives the user's click operation. In response to the operation, the electronic device displays the interface 140 shown in FIG8 , on which the edit menu 141 of the traffic cone A is displayed, and the edit menu 141 is delete. Exemplarily, when the user clicks on the character B shown in FIG10 , the electronic device receives the user's click operation. In response to the operation, the electronic device displays the interface 140 shown in FIG11 , on which the edit menu 142 of the character B is displayed, and the edit menu 142 includes delete, beautify, and modify background.
[0178] In a specific implementation manner, S405 may be specifically referred to steps ③ and ④ in FIG. 2 and FIG. 3 , which will not be described in detail here.
[0179] In this way, the electronic device can edit the object by splitting it in the picture, and can edit each object in the picture separately; the electronic device then recommends the editing menu of the object based on the information of the object, and can realize personalized editing of each object to meet the personalized needs of each object, which is highly practical.
[0180] In addition, electronic devices can also recommend editing menus for various items based on the user's historical behavior, which can meet the preferences and aesthetics of different users, provide convenience for users to edit items, and improve user experience.
[0181] S406: In response to the operation of the edit menu on the first thing, the electronic device edits the first thing according to the function of the edit menu.
[0182] The electronic device can edit the first thing locally, or upload the edited content of the first thing to the server, and the server edits the first thing.
[0183] In a specific implementable manner, the editing menu may include AI photo editing, and S406 may specifically be: in response to the AI photo editing operation corresponding to the first thing, the electronic device displays a first input box, which is the input box of the first thing. When the user enters the editing content of the first thing in the first input box, the electronic device edits the first thing according to the editing content. The format of the editing content may be a text format or an audio format, which is not specifically limited in the embodiment of the present application. Specifically, S406 may refer to steps ⑤ to ⑦ in FIG. 2 above, which will not be repeated here. In the embodiment of the present application, the electronic device can realize automatic photo editing through AI photo editing, which simplifies the photo editing operation and makes photo editing more convenient and quick.
[0184] In another specific implementation method, the editing menu may include AI photo editing, and S406 may specifically be: Compared with the above difference, when the user enters the editing content of the first thing in the first input box, the electronic device reports the editing content and the information of the first thing to other devices (such as servers, cloud platforms, etc.), and the other devices edit the first thing according to the editing content, and return the edited thing information. The electronic device displays the edited first thing based on the edited thing information. Among them, the information of the first thing may include the coordinate information of the first thing in the picture. Of course, the electronic device can also report the information of the first picture to other devices. Specifically, S406 can be specifically referred to steps ⑤, ⑧, ⑨, ⑩ and ⑦ in Figure 3 above, which will not be repeated here. In an embodiment of the present application, the electronic device reduces the computational complexity of the electronic device and saves the resources of the electronic device by reporting the editing content and the information of the first thing to other devices, and the other devices edit the first thing.
[0185] Different things have different corresponding editing menus. The following details different things, their corresponding editing menus, and their scenarios:
[0186] Scene 1: The scene of deleting objects.
[0187] In a specific implementation, as shown in FIG8 , the first thing is an object, and the edit menu is delete, then S406 can be specifically implemented as follows: in response to the delete operation on the first thing, the electronic device deletes the first thing. Exemplarily, as shown in FIG8 , the electronic device receives a user click operation on the edit menu (i.e., delete) 141 of traffic cone A. In response to this operation, the electronic device deletes the traffic cone A, and fills the area where the traffic cone A is located according to the image features outside the area. At this time, the interface of the electronic device changes from the interface 140 shown in FIG8 to the interface 140 shown in FIG9 , on which the traffic cone A has disappeared, and the area where the original traffic cone A is located is filled with the image features of the street along the edge of the area to obtain the picture shown in FIG9 .
[0188] Scene 2: Beautify the portrait.
[0189] In a specific implementation, as shown in Figure 11, the first thing is a person, and the editing menu includes deletion, beautification, background modification, etc. Then, S406 can be specifically implemented as follows: S4061. In response to the click operation on the beautification menu corresponding to the person, the electronic device displays interface three, which displays the image of the person and the function items of the beautification menu, including one-key beautification, smoothness, skin color, whitening and three-dimensional, etc. Of course, the function items of the beautification menu are not limited to the above-mentioned items, and can also include big eyes, which is not specifically limited in the embodiment of the present application. For example, as shown in Figure 11, the electronic device receives a user's click operation on the editing menu (i.e., beautification) of person B. In response to this operation, the electronic device displays the interface 140 shown in Figure 12-1, which includes the first function items such as one-key beautification, smoothness, skin color, whitening and three-dimensional. S4062. In response to the operation on the first function item, the electronic device edits the person according to the parameters of the function item. For example, as shown in Figure 12-1, the first function item is "Smooth." When the user clicks "Smooth," the electronic device performs a smoothing operation on person B's face based on the parameters of the "Smooth" function item. Similarly, if the first function item is "One-touch Beauty," the user clicks "One-touch Beauty," the electronic device performs a beauty operation on person B's face based on the parameters of the "One-touch Beauty" function item.
[0190] In another specific implementation, the difference from the above is that the electronic device receives a user operation on the character image on interface three, which may include a drag operation, a move operation, a zoom operation, etc. In response to the user's operation, the electronic device adjusts the position and size of the character image on interface three. When one or more sides of the character image exceed the display screen of the electronic device, the electronic device receives a combined operation of the user on the character image and the above-mentioned function items, which may include a long press operation on the character image and a click operation on the function item. In response to this operation, the electronic device adjusts the character image to the middle area of the display screen, that is, the electronic device displays the character image in the center of the display screen. For example, as shown in Figure 12-1, when the image of character B exceeds the display screen of the electronic device 100, the user long presses the image of character B and then clicks the one-click beauty function item. At this time, in response to this operation, the electronic device 100 displays the image of character B in the center of the display screen and performs the one-click beauty editing operation on the image of character B.
[0191] In another specific implementation method, the difference compared to the above is that the image of the person after one-click beautification and the function items of the beautification menu are displayed on interface three. That is, when the user operates the beautification editing menu, the electronic device performs the one-click beautification editing operation by default. For example, as shown in Figure 11, when the user clicks on the beautification editing menu, the electronic device 100 performs a one-click beautification operation on the image of person B and jumps to the interface 140 shown in Figure 12-1. The image of person B displayed on the interface 140 is the image after beautification. When the user is not satisfied with the image, the user can operate the smooth, skin color, whitening and three-dimensional function items on the interface 140 shown in Figure 12-1. The electronic device 100 can readjust the editing parameters of the image of person B according to the user's operation to re-edit the image of person B.
[0192] Scene three: the scene of modifying the background of the portrait.
[0193] In a specific implementation, as shown in FIG13 , the first thing is a person, and the editing menu includes deletion, beautification, background modification, etc. Then, S406 can be specifically implemented as follows: S4063. In response to a click operation on the background modification menu corresponding to the person, the electronic device displays interface four, which displays function items of the background modification menu, including background blur, background replacement, background decolorization, etc. Exemplarily, as shown in FIG13 , the electronic device receives a user click operation on the editing menu of person B (i.e., background modification). In response to this operation, the electronic device displays interface 140 shown in FIG14 , which includes second function items such as background blur, background replacement, and background decolorization. S4064. In response to the operation on the second function item, the electronic device edits the person according to the parameters of the function item.
[0194] Exemplarily, as shown in FIG14 , the second function item is background blur 144 . When the user clicks on background blur 144 , the electronic device blurs the area of the first picture excluding person B according to the parameters of background blur 144 . For example, the blurriness is displayed on the interface 140 shown in FIG15 . When the user selects a blurriness of 4, the electronic device blurs the area of the first picture excluding person B according to the blurriness, and obtains the blurred first picture shown in FIG15 . When the user selects a blurriness of 6, the electronic device blurs the area of the first picture excluding person B according to the blurriness, and obtains the blurred first picture shown in FIG16 . In another example, the electronic device may blur the area of the first picture excluding person B according to the spatial relationship.
[0195] Exemplarily, as shown in Figure 14, the second function item is background replacement 145. When the user clicks on background replacement 145, the electronic device replaces the background of the area other than character B in the first picture according to the parameters of background replacement 145. For example, when the user clicks on background replacement 144, the electronic device can jump to the gallery interface and select the picture to be replaced in the interface. At this time, the electronic device pastes the area where character B is located on the selected picture. For another example, when the user clicks on background replacement 145, the electronic device can display the background image of the area where character B is located on the interface 140, and the user can select the background image. It should be noted that in order to make the replaced background have no sense of incongruity with the first thing, the electronic device can recommend the background image to be replaced based on the image information of the first thing (such as the brightness, color and other image information of the first thing).
[0196] Exemplarily, as shown in FIG14 , the second function item is background decolorization 146 . When the user clicks on background decolorization 146 , the electronic device changes the area except for the character B in the first picture to grayscale according to the parameters of background decolorization 146 .
[0197] Scene 4: cropping of objects in the picture.
[0198] In one specific implementation, as shown in FIG17 , the first object is an object, and the editing menu includes cropping. Then, S406 may be specifically implemented as follows: S4065. In response to a click on the cropping menu corresponding to the object, the electronic device crops the object to interface five, which is the editing interface for the cropping menu. For example, as shown in FIG17 , the electronic device receives a user click on the edit menu (i.e., crop) 147 for object A. In response, the electronic device crops the traffic cone A shown in FIG17 and displays it on interface 150 shown in FIG18 , which includes third function items such as cropping, filtering, and adjusting. S4066. In response to the click on the third function item, the electronic device crops the object according to the parameters of the function item, obtaining a second image. S4067. The electronic device identifies image information in the second image. If the image information does not meet preset conditions, the electronic device corrects the image information. Specifically, the electronic device may adjust the image information of the traffic cone A based on the perspective relationship between the traffic cone A and the first image.
[0199] For example, if the second image contains a blurred image or blurred numbers, the electronic device can identify the image information of the image and determine that the image information is blurred. The electronic device corrects the image information. For example, if the second image contains blurred fonts, the electronic device can identify the fonts in the second image and overlay the clear fonts on the area where the original fonts were located.
[0200] Scene five, the sky turns blue.
[0201] In one specific implementation, as shown in FIG19 , if the first object is the sky and the edit menu includes "Blue Sky," then S406 may be specifically implemented as follows: S4068. In response to a click on the "Blue Sky" menu item, the electronic device edits the sky area in the image based on the image information of the object in the image and the parameters of the function item, thereby obtaining a second image. The image information of the object may include information such as brightness, color, and the relative position of the object with respect to the light source. For example, as shown in FIG19 , when the user clicks on the "Blue Sky" menu item 148, the electronic device may edit the sky area in the image based on information such as the brightness, color, and relative position of person B with respect to the light source, thereby obtaining the image with the sun and blue sky shown in FIG20 .
[0202] Scene six, high-definition restoration scene.
[0203] In a specific implementation, as shown in FIG21 , the first thing is an object and / or a person, and the editing menu includes high-definition restoration. Then, S406 can be specifically implemented as follows: S4069. In response to a click operation on the high-definition restoration menu, the electronic device uses an artificial intelligence deep learning model to identify the image information of each thing in the picture, and performs high-definition restoration on each thing to obtain a second picture. Exemplarily, as shown in FIG21 , when the user clicks the high-definition restoration menu 149 , the electronic device can input the picture shown in FIG21 into the artificial intelligence deep learning model and output the picture shown in FIG22 . The artificial intelligence deep learning model is used to identify blurred images and perform high-definition restoration of detailed features in the image.
[0204] Scene seven, AI photo editing scene.
[0205] In a specific implementation, as shown in Figure 23, the editing menu includes AI photo editing, then S406 can be specifically implemented as follows: S4070, in response to a click operation on the AI photo editing corresponding to the first thing, the electronic device displays a first input box, which is the input box for the first thing. Exemplarily, as shown in Figure 23, the first thing is character B, and the electronic device receives a click operation on the editing menu (i.e., AI photo editing) 151 of character B by the user. In response to this operation, the electronic device displays the first input box 152 shown in Figure 24. S4071, when the user enters the editing content of the first thing in the first input box, the electronic device edits the first thing according to the editing content. Exemplarily, as shown in Figure 24, when the user enters the editing content of "eyes become bigger, top becomes striped pattern" in the first input box 152, the electronic device enlarges character B's eyes and changes character B's top into a striped pattern according to the description. At this point, the electronic device obtains the edited picture shown in Figure 25. Of course, in the embodiment of the present application, the editing content can be arbitrary and is not limited to the above examples. For example, the editing content can also be "Change character B's top to red". In addition, the user can input in the first input box through voice recognition, text input, etc., and the present application does not limit the method of inputting in the first input box.
[0206] In another specific implementation method, the difference compared to the above is that, S4072, when the user enters the edited content of the first thing in the first input box, the electronic device reports the edited content to the server, and the server edits the first thing according to the edited content, and returns the edited thing information. S4073, the electronic device displays the edited first thing according to the edited thing information. Specifically, the electronic device uses a preset display mode to display the edited first thing according to the edited thing information. Among them, the preset display mode may include gradient display, fade-in display, flip display, blinking display, etc. The specific implementation needs to be set according to actual needs, and no specific limitation is made in the embodiment of the present application. In the embodiment of the present application, the electronic device uses a preset display mode to display the edited first thing, which can achieve a dynamic photo editing effect, allowing the user to feel the changes before and after the photo editing, and improve the user's visual experience.
[0207] Of course, the embodiments of the present application are not limited to the above-mentioned scenes, and may also include other scenes, such as weight loss scenes, makeup scenes, etc. The embodiments of the present application will not be listed one by one.
[0208] Unless otherwise specified or there is no logical conflict, the terms and / or descriptions between the various embodiments of the present application are consistent and can be referenced by each other. The technical features in different embodiments can be combined to form new embodiments based on their internal logical relationships.
[0209] The above description of the image editing method provided by the embodiment of the present application is described in detail in conjunction with Figures 4 to 25. The electronic device provided by the embodiment of the present application will be described in detail below in conjunction with Figures 1 to 4. It should be understood that the description of the device embodiment corresponds to the description of the method embodiment. Therefore, for matters not described in detail, please refer to the method embodiment above. For the sake of brevity, it will not be repeated here.
[0210] FIG26 shows a schematic block diagram of an electronic device 2600 provided in an embodiment of the present application. The electronic device 2600 includes: a display module 2601 and an editing module 2602, wherein:
[0211] The display module 2601 is configured to display a first image, wherein the first image includes a first object. For example, the display module 2601 may execute the steps S400-S402 described above. The display module 2601 may be the processor 110 and the display screen 180 shown in FIG1 .
[0212] The display module 2601 is used to display an edit menu of the first thing according to the information of the first thing. Exemplarily, the display module 2601 can execute the above step S405. The display module 2601 can be the processor 110 and the display screen 180 shown in FIG1 .
[0213] The editing module 2602 is configured to edit the first thing in response to the second operation on the editing menu. Exemplarily, the editing module 2602 may execute the above-mentioned step S406. The editing module 2602 may be the processor 110 shown in FIG1 .
[0214] In an embodiment of the present application, the electronic device recommends an edit menu for an object in an image based on its information. When the user clicks the edit menu, the electronic device edits the first object according to the function of the edit menu. In this way, the electronic device can edit each object in the image individually, enabling personalized editing of each object, meeting the personalized needs of each object, and providing high practicality.
[0215] In some embodiments, the electronic device 2600 further includes a determination module 2603, wherein the determination module 2603 is configured to determine an edit menu for the first item based on the information of the first item, the priority of each information item, and the correspondence between the information and the edit function item, where the edit menu includes at least one edit function item. Exemplarily, the determination module 2603 may execute the above-described step S405. The determination module 2603 may be the processor 110 shown in FIG1 .
[0216] In an embodiment of the present application, the electronic device recommends a targeted editing menu for each object in the image based on its information, so that each object corresponds to a separate editing menu. When the user operates the editing menu, the electronic device edits the first object according to the function of the editing menu. In this way, the electronic device can edit each object in the image individually, enabling personalized editing of each object, meeting the personalized needs of each object, and having high practicality.
[0217] In one embodiment, the determination module 2603 is configured to determine an edit menu for the first thing based on information about the first thing and historical behavior information of the user.
[0218] In the embodiments of the present application, the electronic device combines the user's historical behavior information and item information to recommend a targeted editing menu for the item, and can also recommend editing menus based on the user's preferences. When the user operates the editing menu, the electronic device edits the first item according to the function of the editing menu, which can meet the preferences and aesthetics of different users, provide convenience for users to edit items, and improve the user experience.
[0219] In one embodiment, the display module 2601 is configured to: in response to receiving an operation on the first thing, display an edit menu of the first thing.
[0220] In one embodiment, the display module 2601 is configured to, in response to receiving an operation on a first item, mark and display the first item. The marked display may include: a dotted line display, a red mark display, a bright light display, a blurred display, etc. Of course, highlighting is not limited to the above. By highlighting items in an image, the electronic device can facilitate user selection and editing of items, thereby facilitating subsequent editing of the items.
[0221] In one embodiment, the editing menu of the first thing includes at least one of the following: deletion, beautification, background modification, and AI photo editing.
[0222] In one embodiment, the first picture also includes a second thing, and the determination module 2603 is used to: determine, based on information about the first thing and information about the second thing, that the first thing is the main thing in the first picture and the second thing is the secondary thing in the first picture; or, that the first thing and the second thing are both the main things in the first picture.
[0223] In one embodiment, the display module 2601 is used to: when the first thing and the second thing are both the main things in the first picture, display the editing menu of the first thing and the first prompt information of the second thing, and the first prompt information is used to prompt the user whether to edit the second thing.
[0224] In one embodiment, the display module 2601 is configured to: when the second thing is a secondary thing in the first picture, the edit menu of the second thing includes a delete option.
[0225] In an embodiment of the present application, the electronic device can filter out primary and secondary objects by determining the primary and secondary nature of each object in the image. The electronic device can then recommend a unified edit menu for the primary objects, or recommend edit menus for each primary object individually. Alternatively, the electronic device can recommend a menu for one primary object and display a prompt prompting the user whether to edit the other primary objects. The electronic device can also recommend a delete edit menu for the secondary objects. In this way, the electronic device can have targeted recommendation menus, making image editing operations prioritized and easier to use.
[0226] In one embodiment, the editing menu of the first thing includes AI photo editing, and the editing module 2602 is used to: in response to the operation of AI photo editing, display a first input box, where the first input box is an input box for the editing content of the first thing; receive the editing content of the first thing input by the user in the first input box; and edit the first thing according to the editing content. The format of the editing content can be text format or audio format, which is not specifically limited in this application. In this way, the electronic device can realize automatic photo editing through AI photo editing, which simplifies the photo editing operation and makes photo editing more convenient and quick.
[0227] In one embodiment, the editing module 2602 is configured to: report the edited content and information about the first item to another device; the other device edits the first item based on the edited content and returns the edited item information; and display the edited first item based on the edited item information. The other device may include a server, a cloud platform, etc. In this way, by reporting the edited content and information about the first item to another device, the other device edits the first item, thereby reducing the computational workload of the electronic device and conserving its resources.
[0228] In one embodiment, display module 2601 is configured to display the edited first item using a preset display mode based on the edited item information. Preset display modes may include gradient display, fade-in display, flip display, blink display, and the like, and may be set based on actual needs during implementation. Thus, the electronic device can display the edited first item using the preset display mode, achieving a dynamic image editing effect, allowing the user to perceive the changes before and after the image editing, and enhancing the user's visual experience.
[0229] In some embodiments, the electronic device 2600 further includes a splitting module 2604, wherein the splitting module is configured to split the first object in the first image. Exemplarily, the splitting module 2604 may execute the above-mentioned step S404. The splitting module 2604 may be the processor 110 shown in FIG1 .
[0230] In an embodiment of the present application, an electronic device can separate objects in a picture. Based on the object's information, the electronic device recommends an edit menu for the object. When a user navigates to the edit menu, the electronic device edits the first object according to the function of the edit menu. In this way, the electronic device can edit the objects by separating them, enabling individual editing of each object in the picture. The electronic device then recommends an edit menu for each object based on its information, enabling personalized editing of each object, meeting the individual needs of each object and providing high practicality.
[0231] In one embodiment, the splitting module 2604 is configured to split the first object in the first picture according to the correlation of image features of the first object in the first picture.
[0232] In one embodiment, the splitting module 2604 is configured to split the first object in the first picture in response to an operation on the first object.
[0233] It should be noted that all relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional module and will not be repeated here.
[0234] An embodiment of the present application also provides a computer-readable storage medium, comprising instructions, which, when executed on a computer, enables the computer to execute any of the above methods.
[0235] An embodiment of the present application also provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute any of the above methods.
[0236] An embodiment of the present application also provides a chip, which includes a processor and an interface circuit, the interface circuit is coupled to the processor, the processor is used to run a computer program or instruction to implement the above method, and the interface circuit is used to communicate with other modules outside the chip.
[0237] All or part of any features or steps in the various embodiments of the present application may be freely combined, and the combined technical solutions are also within the scope of the present application.
[0238] In the description of this application, unless otherwise specified, " / " means "or", for example, A / B can mean A or B. "And / or" in this article is merely a description of the association relationship of associated objects, indicating that three relationships can exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, "at least one" means one or more, and "a plurality" means two or more. Words such as "first" and "second" do not limit the quantity and execution order, and words such as "first" and "second" do not limit them to be necessarily different.
[0239] In the description of this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of this application should not be construed as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.
[0240] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.
[0241] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the modules or units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0242] The units described as separate components may or may not be physically separate, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple places. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0243] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.
[0244] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for enabling a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.
[0245] The above content is only a specific embodiment of this application, but the scope of protection of this application is not limited to this. Any changes or replacements within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.
Claims
1. A method for editing a picture, characterized in that: The method comprises: Display a first picture, wherein the first picture includes a first thing; Displaying an edit menu for the first thing according to the information of the first thing; In response to an operation on the edit menu, the first thing is edited.
2. The method according to claim 1, characterized in that Before displaying the edit menu of the first thing, including: An edit menu of the first thing is determined according to the information of the first thing, the priority of each information, and the correspondence between the information and the edit function item, and the edit menu includes at least one edit function item.
3. The method according to claim 1 or 2, characterized in that: Before displaying the edit menu of the first thing, it also includes: An edit menu for the first thing is determined according to the information of the first thing and the user's historical behavior information.
4. The method according to any one of claims 1 to 3, characterized in that The step of displaying an edit menu of the first thing according to the information of the first thing includes: In response to receiving an operation on the first thing, an edit menu of the first thing is displayed.
5. The method according to claim 4, characterized in that Also includes: In response to receiving an operation on the first thing, marking displays the first thing.
6. The method according to any one of claims 1 to 5, characterized in that The editing menu of the first thing includes at least one of the following: deletion, beautification, background modification and AI photo editing.
7. The method according to any one of claims 1 to 6, characterized in that The first picture also includes a second thing, and before displaying an edit menu of the first thing according to the information of the first thing, further includes: According to the information of the first thing and the information of the second thing, it is determined that the first thing is the main thing in the first picture and the second thing is the secondary thing in the first picture; or, the first thing and the second thing are both the main things in the first picture.
8. The method according to claim 7, characterized in that Also includes: When the first thing and the second thing are both main things in the first picture, an editing menu for the first thing and first prompt information for the second thing are displayed, where the first prompt information is used to prompt the user whether to edit the second thing.
9. The method according to claim 7, characterized in that: Also includes: When the second thing is a secondary thing in the first picture, the editing menu of the second thing includes deletion.
10. The method according to claim 6, characterized in that The editing menu of the first thing includes AI photo editing, and in response to an operation on the editing menu, editing the first thing includes: In response to the operation of the AI photo editing, a first input box is displayed, where the first input box is an input box for editing content of the first thing; Receiving editing content of the first thing input by the user in the first input box; The first thing is edited according to the editing content.
11. The method according to claim 10, characterized in that The editing of the first thing according to the editing content includes: Reporting the edited content and information of the first thing to other devices, the other devices editing the first thing according to the edited content, and returning the edited thing information; According to the edited thing information, the edited first thing is displayed.
12. The method according to claim 11, characterized in that The step of displaying the edited first thing according to the edited thing information includes: According to the edited thing information, a preset display mode is adopted to display the edited first thing.
13. An electronic device, characterized in that: The electronic device comprises: a display module and an editing module, wherein: The display module is used to display a first picture, wherein the first picture includes a first thing; The display module is used to display an edit menu of the first thing according to the information of the first thing; The editing module is used to edit the first thing in response to an operation on the editing menu.
14. The electronic device according to claim 13, characterized in that: Also includes: Determine the module, where The determination module is used to determine an editing menu of the first thing according to the information of the first thing, the priority of each information, and the correspondence between the information and the editing function items, and the editing menu includes at least one editing function item.
15. The electronic device according to claim 14, characterized in that: The determination module is used for: An edit menu for the first thing is determined according to the information of the first thing and the user's historical behavior information.
16. The electronic device according to any one of claims 13 to 15, characterized in that: The display module is used for: In response to receiving an operation on the first thing, an edit menu of the first thing is displayed.
17. The electronic device according to claim 16, characterized in that: The display module is used for: In response to receiving an operation on the first thing, marking displays the first thing.
18. The electronic device according to any one of claims 13 to 17, characterized in that: The editing menu of the first thing includes at least one of the following: deletion, beautification, background modification and AI photo editing.
19. The electronic device according to any one of claims 14 to 18, characterized in that: The first picture also includes a second thing, and the determining module is used to: According to the information of the first thing and the information of the second thing, it is determined that the first thing is the main thing in the first picture and the second thing is the secondary thing in the first picture; or, the first thing and the second thing are both the main things in the first picture.
20. The electronic device according to claim 19, characterized in that The display module is used for: When the first thing and the second thing are both main things in the first picture, an editing menu for the first thing and first prompt information for the second thing are displayed, where the first prompt information is used to prompt the user whether to edit the second thing.
21. The electronic device according to claim 19, characterized in that: The display module is used for: When the second thing is a secondary thing in the first picture, the editing menu of the second thing includes deletion.
22. The electronic device according to claim 18, characterized in that: The editing menu of the first thing includes AI photo editing, and the editing module is used to: In response to the operation of the AI photo editing, a first input box is displayed, where the first input box is an input box for editing content of the first thing; Receiving editing content of the first thing input by the user in the first input box; The first thing is edited according to the editing content.
23. The electronic device according to claim 22, characterized in that: The editing module is used to: Reporting the edited content and information of the first thing to other devices, the other devices editing the first thing according to the edited content, and returning the edited thing information; According to the edited thing information, the edited first thing is displayed.
24. The electronic device according to claim 23, characterized in that: The display module is used for: According to the edited thing information, a preset display mode is adopted to display the edited first thing.
25. An electronic device, characterized in that: The electronic device comprises: one or more processors; and a memory, wherein codes are stored in the memory; when the codes are executed by the processor, the electronic device executes the method according to any one of claims 1 to 12.
26. A computer-readable storage medium, characterized in that: The method comprises computer instructions, which, when executed on an electronic device, cause the electronic device to execute the method according to any one of claims 1 to 12.
Citation Information
Patent Citations
Picture editing method and electronic equipment
CN119693240A
Image editing method and terminal
CN105139357A
Image beautification processing method, device, storage medium and terminal equipment
CN108491780A
Image editing method, image editing device and electronic equipment
CN112306347A
Image editing
US20230114270A1