Image processing method and device, electronic equipment, storage medium and chip

Abstract

The invention relates to an image processing method and device, electronic equipment, a storage medium and a chip, and the method comprises the steps: obtaining editing information for a target image, and the editing information comprises voice information or text information; and editing the target image according to the editing information. The function of editing the target image according to the voice information or the text information of the user can be achieved, the diversity and flexibility of image editing modes are improved, the editing operation is simpler, more convenient, more visual and more efficient, and therefore the operation efficiency and experience of the user are improved.

Description

Technical Field

[0001] The present disclosure relates to the field of image processing technology, and in particular to an image processing method, device, electronic device, storage medium and chip. Background Art

[0002] In the related art, when performing image editing on smart terminals such as smartphones, users usually edit pictures through touch operations. The method of image editing through touch operations completely relies on manual adjustments by users, including the selection of operation options, the selection of the position to be edited, and the selection of editing parameters, which all need to be completed manually. In addition, due to the thicker fingers, it is difficult to complete more sophisticated image editing and image marking operations without the aid of a stylus. Therefore, the method of image editing through touch operations may require users to spend more time and effort to achieve the desired editing effect. Therefore, the operation is more complicated and the editing efficiency is low, which limits the user's interactive experience with the application and the operating efficiency. Summary of the invention

[0003] In order to overcome the problems existing in the related art, the present disclosure provides an image processing method, device, electronic device, storage medium and chip.

[0004] According to a first aspect of an embodiment of the present disclosure, there is provided an image processing method, the method comprising:

[0005] Acquiring editing information for a target image, wherein the editing information includes voice information or text information;

[0006] The target image is edited according to the editing information.

[0007] Optionally, before acquiring the editing information for the target image, the method further includes:

[0008] Performing face detection on the target image;

[0009] When a face image is detected in the target image, a multimodal editing mode is entered, wherein the multimodal editing mode is an editing mode that supports editing the image by inputting voice or text;

[0010] In the multimodal editing mode, voice detection is performed to obtain the voice information, and / or text input detection is performed to obtain the text information.

[0011] Optionally, when a face image is detected in the target image, entering a multimodal editing mode includes:

[0012] When a face image is detected in the target image, obtaining a proportion of the face image in the target image;

[0013] When the ratio is greater than a set ratio threshold, the multimodal editing mode is entered.

[0014] Optionally, before acquiring the editing information for the target image, the method further includes:

[0015] In response to an operation of entering a multimodal editing mode, entering the multimodal editing mode, wherein the multimodal editing mode is an editing mode that supports editing an image by inputting a voice or inputting a text;

[0016] In the multimodal editing mode, voice detection is performed to obtain the voice information, and / or text input detection is performed to obtain the text information.

[0017] Optionally, the editing information is voice information, and editing the target image according to the editing information includes:

[0018] Performing voice recognition on the voice information to obtain a command text corresponding to the voice information;

[0019] Perform corresponding editing operations on the target image according to the instruction text.

[0020] Optionally, the editing information is text information, and editing the target image according to the editing information includes:

[0021] Performing text recognition on the text information to obtain the instruction text corresponding to the text information;

[0022] Perform corresponding editing operations on the target image according to the instruction text.

[0023] Optionally, performing a corresponding editing operation on the target image according to the instruction text includes:

[0024] According to the instruction text, searching for corresponding operation instructions in the image editing algorithm library;

[0025] When the operation instruction is found, an editing operation corresponding to the operation instruction is performed on the target image.

[0026] Optionally, the method further comprises:

[0027] In the case where the operation instruction is not found, requesting the server to detect whether the image editing algorithm library has been updated;

[0028] When there is an update to the image editing algorithm library, acquiring update content from the server to update the image editing algorithm library;

[0029] Searching for the operation instruction corresponding to the instruction text in the updated image editing algorithm library;

[0030] When the operation instruction is found, an editing operation corresponding to the operation instruction is performed on the target image.

[0031] Optionally, the method further comprises:

[0032] In the case where the operation instruction is not searched, a prompt message is output, where the prompt message is used to prompt the user that the operation instruction is not searched, and to prompt the user to edit the target image through a touch operation.

[0033] According to a second aspect of an embodiment of the present disclosure, there is provided an image processing apparatus, including:

[0034] An acquisition module, configured to acquire editing information for a target image, wherein the editing information includes voice information or text information;

[0035] The editing module is configured to edit the target image according to the editing information.

[0036] According to a third aspect of an embodiment of the present disclosure, there is provided an electronic device, including:

[0037] processor;

[0038] a memory for storing a processor computer program;

[0039] The processor is configured to execute the computer program in the memory to implement the steps of the image processing method provided in the first aspect of the present disclosure.

[0040] According to a fourth aspect of an embodiment of the present disclosure, a computer-readable storage medium is provided, on which computer program instructions are stored. When the program instructions are executed by a processor, the steps of the image processing method provided in the first aspect of the present disclosure are implemented.

[0041] According to a fifth aspect of an embodiment of the present disclosure, a chip is provided, comprising: a processor and an interface; the processor is used to read instructions to execute the steps of the image processing method provided in the first aspect of the present disclosure.

[0042] The technical solution provided by the embodiments of the present disclosure may include the following beneficial effects: In the above technical solution, by acquiring editing information for a target image, the editing information includes voice information or text information; and editing the target image according to the editing information. Through the above solution, the function of editing the target image can be realized by acquiring voice information or text information for the target image, thereby increasing the interaction mode between the user and the image editing application, improving the diversity of image editing methods and the flexibility of editing, making the editing operation more simple, intuitive and efficient, thereby improving the user's operating efficiency and experience.

[0043] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0045] Figure 1 The figure is a flowchart of an image processing method according to an exemplary embodiment.

[0046] Figure 2 is a flowchart of another image processing method according to an exemplary embodiment.

[0047] Figure 3 is a flowchart of another image processing method according to an exemplary embodiment.

[0048] Figure 4 is a flowchart of another image processing method according to an exemplary embodiment.

[0049] Figure 5 is a flowchart of another image processing method according to an exemplary embodiment.

[0050] Figure 6 is a flowchart of another image processing method according to an exemplary embodiment.

[0051] Figure 7 is a flowchart of another image processing method according to an exemplary embodiment.

[0052] Figure 8 is a flowchart of another image processing method according to an exemplary embodiment.

[0053] Fig. 9 is a block diagram of an image processing apparatus according to an exemplary embodiment.

[0054] Fig.10It is a block diagram of an electronic device according to an exemplary embodiment.

[0055] Fig.11 It is a block diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION

[0056] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0057] It should be noted that all actions of acquiring signals, information or data in the present disclosure are carried out in compliance with the relevant data protection laws and policies of the country where the device is located and with the authorization given by the owner of the corresponding device.

[0058] Figure 1 is a flowchart of an image processing method according to an exemplary embodiment. Figure 1 As shown, the image processing method comprises the following steps:

[0059] In step S11, editing information for a target image is acquired, where the editing information includes voice information or text information.

[0060] When the user browses the images through the terminal device, he can determine any image as the target image to be edited. After the user selects the target image, he can define the editing requirements for the target image according to his own needs, such as adjusting the brightness, cropping, whitening, skin smoothing and other operations.

[0061] By way of example, in an embodiment of the present disclosure, a terminal device may support a multimodal editing mode, which is an editing mode that supports editing images by inputting voice or text. It is understandable that traditional touch operation methods may also be supported in the multimodal editing mode. In an embodiment of the present disclosure, the method of editing images by inputting voice or text is used as an example to illustrate the main editing method. The editing information may include voice information or text information, that is, when a user edits the target image through an image editing application, the user's editing requirements may be intuitively input into the terminal device by inputting voice information or text information. After the application obtains the voice information or text information, it may obtain the user's editing requirements by identifying the voice information or text information. By way of example, the editing information may include one editing requirement of the user, or may include multiple editing requirements of the user.

[0062] In step S12, the target image is edited according to the editing information.

[0063] For example, the voice information or text information included in the editing information can be identified to determine the corresponding operation instructions, and then the target image can be edited according to the operation instructions. The image can be edited according to the user's expectations, thereby providing an editing effect that better meets the user's expectations.

[0064] In the above technical solution, by acquiring editing information for the target image, the editing information includes voice information or text information; and editing the target image according to the editing information. Through the above solution, the function of editing the target image can be realized by acquiring voice information or text information for the target image, thereby increasing the interaction between the user and the image editing application, improving the diversity of image editing methods and the flexibility of editing, making the editing operation more simple, intuitive and efficient, thereby improving the user's operating efficiency and experience.

[0065] In one implementation, the multimodal editing mode can be automatically entered by detecting a face image in the target image. Figure 2 is a flowchart of another image processing method according to an exemplary embodiment. Figure 2 As shown, before obtaining the editing information for the target image, the image processing method further includes the following steps:

[0066] In step S13, face detection is performed on the target image.

[0067] For example, when a user selects a target image in an application, face detection can be performed on the target image using a preset algorithm to determine whether the target image contains a face image. For example, the face detection algorithm can be used to identify the positions of facial features such as eyebrows, eyes, and mouth in the image to determine whether it contains a face image. If it is determined that a face image is contained, the area occupied by the face image in the target image can be determined.

[0068] In step S14, when a face image is detected in the target image, a multimodal editing mode is entered, which is an editing mode that supports editing of images by inputting voice or text.

[0069] For example, when it is determined through step S13 that there is a facial image in the target image, a multimodal editing mode is entered, wherein the multimodal editing mode is an editing mode that supports editing of images by inputting voice or text. It can be understood that in this editing mode, the user can communicate with the application or device through multiple channels such as inputting voice or text, thereby achieving a multimodal interaction effect between the user and the application.

[0070] Optionally, in the multimodal editing mode, the user can also edit the target image through touch operations.

[0071] In step S15, voice detection is performed in the multimodal editing mode to obtain voice information, and / or text input detection is performed to obtain text information.

[0072] For example, in the multimodal editing mode, voice information can be received through the microphone of the terminal device, and text information can be received through the virtual keyboard displayed on the display interface of the terminal device.

[0073] Figure 3 is a flowchart of another image processing method according to an exemplary embodiment. Figure 3 As shown, in the case where a face image is detected in the target image as described in the above step S14, entering the multimodal editing mode includes the following steps:

[0074] In step S141, when a face image is detected in the target image, the proportion of the face image in the target image is obtained.

[0075] For example, when a face image is detected in the target image, the face detection algorithm can determine the area occupied by the face image in the entire target image, so that the proportion of the face image in the entire target image can be calculated based on the size of the area, and whether the conditions for performing the multimodal editing mode are met is determined based on the proportion. The specific type of face detection algorithm is not limited in the embodiments of the present disclosure and can be selected according to actual needs.

[0076] In step S142, when the ratio is greater than the set ratio threshold, the multi-modal editing mode is entered.

[0077] For example, a ratio threshold may be preset. If the ratio threshold is set to 10%, and the ratio of the facial image acquired in step S141 is greater than 10%, it may be determined that the conditions for entering the multimodal editing mode are met, and the multimodal editing mode is entered.

[0078] In one implementation, when the face image ratio is less than a set ratio threshold, a touch editing mode can be entered, for example, the target image can be cropped, rotated, and the like. The operations that can be performed in the touch editing mode can be set by the application, and this disclosure does not limit them.

[0079] In another implementation, the multimodal editing mode may be entered manually by a user, and the terminal device enters the multimodal editing mode by responding to a specified operation performed by the user on the screen. Figure 4is a flowchart of another image processing method according to an exemplary embodiment. Figure 4 As shown, before obtaining the editing information for the target image, the image processing method further includes the following steps:

[0080] In step S16, in response to the operation of entering the multimodal editing mode, the multimodal editing mode is entered, and the multimodal editing mode is an editing mode that supports editing of images by inputting voice or inputting text.

[0081] For example, the operation of entering the multimodal editing mode can be performed by a preset touch operation, such as multiple clicks, or sliding a specific trajectory, or a button for entering the multimodal editing mode can be displayed on the display interface, for example, an option button for entering the multimodal editing mode is set in the image editing menu, and the multimodal editing mode can be entered by clicking the button; the multimodal editing mode has been introduced in the previous text, and the details can be referred to the corresponding method described in step S14, which will not be repeated here.

[0082] In step S17, voice detection is performed in the multimodal editing mode to obtain voice information, and / or text input detection is performed to obtain text information.

[0083] The method in the above step S17 has been introduced in the previous text. For details, please refer to the method in step S15, which will not be repeated here.

[0084] Figure 5 is a flowchart of another image processing method according to an exemplary embodiment. Figure 5 As shown, in the case where the editing information is voice information, the editing of the target image according to the editing information in the above step S12 includes the following steps:

[0085] In step S121, voice recognition is performed on the voice information to obtain the instruction text corresponding to the voice information.

[0086] In step S122, a corresponding editing operation is performed on the target image according to the instruction text.

[0087] For example, after receiving the user's language information, the voice information is recognized, the instruction text corresponding to the language information is obtained, and the target image is edited accordingly according to the instruction text. For example, the user sends a voice message "please reduce the face", and the key content "reduce the face" in the voice message is obtained through voice recognition, so the text instruction obtained can be "reduce the face", and the target image is edited according to the text instruction. The present disclosure does not limit the technical methods used by the voice recognition module.

[0088] Figure 6 is a flowchart of another image processing method according to an exemplary embodiment. Figure 6 As shown, in the case where the editing information is text information, the editing of the target image according to the editing information in the above step S12 includes the following steps:

[0089] In step S123, text recognition is performed on the text information to obtain the instruction text corresponding to the text information.

[0090] In step S124, a corresponding editing operation is performed on the target image according to the instruction text.

[0091] In the example, when receiving text input by the user through the screen, the text recognition function is used to obtain the instruction text corresponding to the text information, and the corresponding editing operation is performed on the target image according to the instruction text. For example, the user inputs the text information "Please reduce the face" through the input method keyboard, and the key content "reduce the face" in the text information is obtained through text recognition, so that the text instruction is obtained as "reduce the face", and the target image is edited to reduce the face according to the text instruction; the present disclosure does not limit the technical methods used by the text recognition module.

[0092] Figure 7 is a flowchart of another image processing method according to an exemplary embodiment. Figure 7 As shown, the corresponding editing operation on the target image according to the instruction text described in the above step S122 or S124 includes the following steps:

[0093] In step S1221, the corresponding operation instruction is searched in the image editing algorithm library according to the instruction text.

[0094] The image editing algorithm library may include one or more image editing algorithms, and the image editing algorithm may be implemented through an algorithm function.

[0095] In step S1222, when an operation instruction is found, an editing operation corresponding to the operation instruction is performed on the target image.

[0096] For example, according to the instruction text, the corresponding operation instruction is searched in the image editing algorithm library. When the corresponding operation instruction is found, the target image is edited using the editing operation corresponding to the operation instruction. For example, if the instruction text is "reduce the face", when the operation instruction for reducing the face is searched in the algorithm library, the target image is edited according to the operation instruction in the algorithm library to reduce the face in the target image. Regarding the amplitude of the editing operation, such as how much to reduce, the parameters of the corresponding operation instruction (such as the amplitude of the editing operation mentioned above) can be pre-set in the editing algorithm library, or can be set by the user. For example, when the user inputs voice information or text information, in addition to expressing the operation instruction, the degree of the operation can also be expressed at the same time. For example, if the voice information or text information includes "reduce the face by 10%, the corresponding instruction text generated is "reduce the face by 10%, so that when the operation instruction for reducing the face is executed, it can be reduced by 10%.

[0097] Optionally, for the edited target image, the user can choose to save or undo the modification according to the editing effect.

[0098] In one implementation, when no operation instruction is found in the image editing algorithm library, the server may detect whether the image editing algorithm library has been updated; Figure 8 is a flowchart of another image processing method according to an exemplary embodiment. Figure 8 As shown, the image processing method also includes the following steps:

[0099] In step S1223, if no operation instruction is found, a request is made to the server to detect whether there is any update to the image editing algorithm library.

[0100] For example, after searching for the corresponding operation instruction in the image editing algorithm library according to the instruction text as described in executing step 1221, when no operation instruction is found, a request can be sent to the server to detect whether there is an update to the image editing algorithm library; wherein the image editing algorithm library can be stored in the server, for example, it can be a server of the above-mentioned application, or it can also be a server separately set up to store the image editing algorithm library.

[0101] In one implementation, when no operation instructions are found, the default setting can be to directly send a request to the server to detect whether there is an update to the image editing algorithm library. Alternatively, a prompt message can be displayed to prompt the user whether to send a request to the server to detect whether there is an update to the image editing algorithm library. The user can choose whether to obtain the update through the server based on their network conditions or editing needs.

[0102] In step S1224, if there is an update to the image editing algorithm library, the update content is obtained from the server to update the image editing algorithm library.

[0103] For example, when there is an update to the image editing algorithm library, the corresponding update content is obtained from the server, and the local image editing algorithm library of the terminal device is updated with the update content.

[0104] In one implementation, when there is updated content of the image editing algorithm library in the server, a prompt message can be popped up on the display interface of the image editing application to prompt the user that there is an update to the image editing algorithm library, and the user can decide whether to perform the update.

[0105] In step S1225, the operation instruction corresponding to the instruction text is searched in the updated image editing algorithm library.

[0106] In step S1226, when an operation instruction is found, an editing operation corresponding to the operation instruction is performed on the target image.

[0107] The methods in the above steps S1225 to S1226 have been introduced in the previous text. For details, please refer to the methods described in steps S1221 to S1222, which will not be repeated here.

[0108] Optionally, the above-mentioned image processing method may further include, when no operation instruction is searched, outputting prompt information, the prompt information being used to prompt the user that no operation instruction is searched, and prompting the user to edit the target image through a touch operation.

[0109] For example, when no operation instruction is found in the image editing algorithm library, prompt information may be output, which may include information indicating that the search result shows that no operation instruction is found, and information prompting the user to edit the target image by touch operation.

[0110] In the above technical solution, by acquiring editing information for the target image, the editing information includes voice information or text information; and editing the target image according to the editing information. Through the above solution, the function of editing the target image can be realized by acquiring voice information or text information for the target image, thereby increasing the interaction between the user and the image editing application, improving the diversity of image editing methods and the flexibility of editing, making the editing operation more simple, intuitive and efficient, thereby improving the user's operating efficiency and experience.

[0111] Fig. 9 FIG. 1 is a block diagram of an image processing device according to an exemplary embodiment. Fig. 9 The device 900 includes an acquisition module 901 and an editing module 902.

[0112] The acquisition module 901 is configured to acquire editing information for a target image, where the editing information includes voice information or text information.

[0113] The editing module 902 is configured to edit the target image according to the editing information.

[0114] Optionally, the device 900 further includes a first detection module, an entry module and a second detection module.

[0115] The first detection module is configured to perform face detection on the target image before acquiring the editing information for the target image.

[0116] The entry module is configured to enter a multimodal editing mode when a face image is detected in a target image. The multimodal editing mode is an editing mode that supports editing an image by inputting voice or text.

[0117] The second detection module is configured to perform voice detection in the multimodal editing mode to obtain voice information, and / or perform text input detection to obtain text information.

[0118] Optionally, the entry module includes an acquisition submodule and an entry submodule.

[0119] The acquisition submodule is configured to acquire the proportion of the face image in the target image when a face image is detected in the target image.

[0120] The entry submodule is configured to enter the multimodal editing mode when the ratio is greater than a set ratio threshold.

[0121] Optionally, before acquiring the editing information for the target image, the apparatus 900 is further configured to:

[0122] In response to an operation of entering a multimodal editing mode, entering the multimodal editing mode, where the multimodal editing mode is an editing mode that supports editing an image by inputting a voice or inputting a text;

[0123] In the multimodal editing mode, voice detection is performed to obtain voice information, and / or text input detection is performed to obtain text information.

[0124] Optionally, the edited information is voice information, and the editing module 902 includes a recognition submodule and an editing submodule.

[0125] The recognition submodule is configured to perform speech recognition on the speech information and obtain the instruction text corresponding to the speech information.

[0126] The editing submodule is configured to perform corresponding editing operations on the target image according to the instruction text.

[0127] Optionally, the editing information is text information, and the recognition submodule is configured to perform text recognition on the text information to obtain the instruction text corresponding to the text information.

[0128] The editing submodule is configured to perform corresponding editing operations on the target image according to the instruction text.

[0129] Optionally, the editing submodule is configured as:

[0130] According to the instruction text, search for the corresponding operation instruction in the image editing algorithm library;

[0131] When the operation instruction is found, the editing operation corresponding to the operation instruction is performed on the target image.

[0132] Optionally, the device 900 further includes a request module, an update module and a prompt module.

[0133] The request module is configured to request the server to detect whether there is any update to the image editing algorithm library when no operation instruction is found.

[0134] The updating module is configured to obtain the updated content from the server to update the image editing algorithm library when there is an update in the image editing algorithm library.

[0135] The editing submodule is configured as:

[0136] Searching for operation instructions corresponding to the instruction text in the updated image editing algorithm library;

[0137] When the operation instruction is found, the editing operation corresponding to the operation instruction is performed on the target image.

[0138] The prompt module is configured to output prompt information when no operation instruction is found, and the prompt information is used to prompt the user that no operation instruction is found and to prompt the user to edit the target image through touch operation.

[0139] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0140] The present disclosure also provides a computer-readable storage medium on which computer program instructions are stored. When the program instructions are executed by a processor, the steps of the image processing method provided by the present disclosure are implemented.

[0141] In the above technical solution, by acquiring editing information for the target image, the editing information includes voice information or text information; and editing the target image according to the editing information. Through the above solution, the function of editing the target image can be realized by acquiring voice information or text information for the target image, thereby increasing the interaction between the user and the image editing application, improving the diversity of image editing methods and the flexibility of editing, making the editing operation more simple, intuitive and efficient, thereby improving the user's operating efficiency and experience.

[0142] Fig.10 1 is a block diagram of an electronic device 1000 according to an exemplary embodiment. For example, the device 1000 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0143] Reference Fig.10 , the device 1000 may include one or more of the following components: a processing component 1002 , a memory 1004 , a power component 1006 , a multimedia component 1008 , an audio component 1010 , an input / output interface 1012 , a sensor component 1014 , and a communication component 1016 .

[0144] The processing component 1002 generally controls the overall operation of the device 1000, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 1002 may include one or more processors 1020 to execute instructions to complete all or part of the steps of the above-mentioned image processing method. In addition, the processing component 1002 may include one or more modules to facilitate the interaction between the processing component 1002 and other components. For example, the processing component 1002 may include a multimedia module to facilitate the interaction between the multimedia component 1008 and the processing component 1002.

[0145] The memory 1004 is configured to store various types of data to support the operation of the device 1000. Examples of such data include instructions for any application or method operating on the device 1000, contact data, phone book data, messages, pictures, videos, etc. The memory 1004 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0146] The power supply component 1006 provides power to the various components of the device 1000. The power supply component 1006 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 1000.

[0147] The multimedia component 1008 includes a screen that provides an output interface between the device 1000 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 1008 includes a front camera and / or a rear camera. When the device 1000 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0148] The audio component 1010 is configured to output and / or input audio signals. For example, the audio component 1010 includes a microphone (MIC), and when the device 1000 is in an operating mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 1004 or sent via the communication component 1016. In some embodiments, the audio component 1010 also includes a speaker for outputting audio signals.

[0149] The input / output interface 1012 provides an interface between the processing component 1002 and the peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0150] The sensor assembly 1014 includes one or more sensors for providing various aspects of the status assessment of the device 1000. For example, the sensor assembly 1014 can detect the open / closed state of the device 1000, the relative positioning of components, such as the display and keypad of the device 1000, the sensor assembly 1014 can also detect the position change of the device 1000 or a component of the device 1000, the presence or absence of user contact with the device 1000, the orientation or acceleration / deceleration of the device 1000, and the temperature change of the device 1000. The sensor assembly 1014 can include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 1014 can also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 1014 can also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0151] The communication component 1016 is configured to facilitate wired or wireless communication between the device 1000 and other devices. The device 1000 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 1016 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 1016 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0152] In an exemplary embodiment, the apparatus 1000 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to perform the above-mentioned image processing method.

[0153] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 1004 including instructions, and the instructions can be executed by the processor 1020 of the device 1000 to complete the above-mentioned image processing method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0154] In addition to being an independent electronic device, the above-mentioned device can also be a part of an independent electronic device. For example, in one embodiment, the device can be an integrated circuit (IC) or a chip, wherein the integrated circuit can be an IC or a collection of multiple ICs; the chip can include but is not limited to the following types: GPU (Graphics Processing Unit), CPU (Central Processing Unit), FPGA (Field Programmable Gate Array), DSP (Digital Signal Processor), ASIC (Application Specific Integrated Circuit), SOC (System on Chip, SoC), etc. The above-mentioned integrated circuit or chip can be used to execute executable instructions (or codes) to implement the above-mentioned image processing method. The executable instructions can be stored in the integrated circuit or chip, or can be obtained from other devices or equipment, such as the integrated circuit or chip includes a processor, a memory, and an interface for communicating with other devices. The executable instruction may be stored in the memory, and when the executable instruction is executed by the processor, the above-mentioned image processing method may be implemented; alternatively, the integrated circuit or chip may receive the executable instruction through the interface and transmit it to the processor for execution, so as to implement the above-mentioned image processing method.

[0155] In another exemplary embodiment, a computer program product is also provided. The computer program product includes a computer program executable by a programmable device, and the computer program has a code portion for performing the above-mentioned image processing when executed by the programmable device.

[0156] Fig.11 1 is a block diagram of an electronic device 1100 according to an exemplary embodiment. For example, the device 1100 may be provided as a server. Fig.11 The apparatus 1100 includes a processing component 1122, which further includes one or more processors, and a memory resource represented by a memory 1132 for storing instructions executable by the processing component 1122, such as an application. The application stored in the memory 1132 may include one or more modules, each corresponding to a set of instructions. In addition, the processing component 1122 is configured to execute the instructions to perform the above-mentioned image processing method.

[0157] The device 1100 may also include a power supply component 1126 configured to perform power management of the device 1100, a wired or wireless network interface 1150 configured to connect the device 1100 to a network, and an input / output interface 1158. The device 1100 may operate based on an operating system stored in the memory 1132.

[0158] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the present disclosure. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are to be considered as exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0159] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. An image processing method, characterized in that: The method comprises: Acquiring editing information for a target image, wherein the editing information includes voice information or text information; The target image is edited according to the editing information.

2. The method according to claim 1, characterized in that Before acquiring the editing information for the target image, the method further includes: Performing face detection on the target image; When a face image is detected in the target image, a multimodal editing mode is entered, wherein the multimodal editing mode is an editing mode that supports editing the image by inputting voice or text; In the multimodal editing mode, voice detection is performed to obtain the voice information, and / or text input detection is performed to obtain the text information.

3. The method according to claim 2, characterized in that When a face image is detected in the target image, entering a multimodal editing mode includes: When a face image is detected in the target image, obtaining a proportion of the face image in the target image; When the ratio is greater than a set ratio threshold, the multimodal editing mode is entered.

4. The method according to claim 1, characterized in that: Before acquiring the editing information for the target image, the method further includes: In response to an operation of entering a multimodal editing mode, entering the multimodal editing mode, wherein the multimodal editing mode is an editing mode that supports editing an image by inputting a voice or inputting a text; In the multimodal editing mode, voice detection is performed to obtain the voice information, and / or text input detection is performed to obtain the text information.

5. The method according to claim 1, characterized in that The editing information is voice information, and editing the target image according to the editing information includes: Performing voice recognition on the voice information to obtain a command text corresponding to the voice information; Perform corresponding editing operations on the target image according to the instruction text.

6. The method according to claim 1, characterized in that The editing information is text information, and editing the target image according to the editing information includes: Performing text recognition on the text information to obtain the instruction text corresponding to the text information; Perform corresponding editing operations on the target image according to the instruction text.

7. The method according to claim 5 or 6, characterized in that: The performing a corresponding editing operation on the target image according to the instruction text includes: According to the instruction text, searching for corresponding operation instructions in the image editing algorithm library; When the operation instruction is found, an editing operation corresponding to the operation instruction is performed on the target image.

8. The method according to claim 7, characterized in that The method further comprises: In the case where the operation instruction is not found, requesting the server to detect whether the image editing algorithm library has been updated; When there is an update to the image editing algorithm library, acquiring update content from the server to update the image editing algorithm library; Searching for the operation instruction corresponding to the instruction text in the updated image editing algorithm library; When the operation instruction is found, an editing operation corresponding to the operation instruction is performed on the target image.

9. The method according to claim 7, characterized in that: The method further comprises: In the case where the operation instruction is not searched, a prompt message is output, where the prompt message is used to prompt the user that the operation instruction is not searched, and to prompt the user to edit the target image through a touch operation.

10. An image processing device, characterized in that: The device comprises: An acquisition module, configured to acquire editing information for a target image, wherein the editing information includes voice information or text information; The editing module is configured to edit the target image according to the editing information.

11. An electronic device, characterized in that: include: processor; a memory for storing a processor computer program; The processor is configured to execute the computer program in the memory to implement the steps of the method according to any one of claims 1 to 9.

12. A computer-readable storage medium having computer program instructions stored thereon, characterized in that: When the program instructions are executed by a processor, the steps of the method described in any one of claims 1 to 9 are implemented.

13. A chip, characterized in that: The method comprises a processor and an interface; the processor is used to read instructions to execute the method according to any one of claims 1 to 9.

Images