Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

892 results about "Image editing" patented technology

Image editing encompasses the processes of altering images, whether they are digital photographs, traditional photo-chemical photographs, or illustrations. Traditional analog image editing is known as photo retouching, using tools such as an airbrush to modify photographs, or editing illustrations with any traditional art medium. Graphic software programs, which can be broadly grouped into vector graphics editors, raster graphics editors, and 3D modelers, are the primary tools with which a user may manipulate, enhance, and transform images. Many image editing programs are also used to render or create computer art from scratch.

Using generative artificial intelligence to edit images based on contextual data

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for enabling artificial intelligence to generate new images based on contextual data and to generate digital components based on the images. In one aspect, a method includes receiving one or more queries from a client device of a user. A digital component is selected based on the one or more queries. A customized digital component is generated by obtaining an image of an object corresponding to the selected digital component and generating, using a language model, an image editing prompt for editing the image based on digital component data related to the digital component and query data including the one or more queries and contextual data. The image and the image editing prompt are provided to an image editing model. An edited image is received and used to generate the customized digital component.
Owner:GOOGLE LLC

Real scene image editing method based on hierarchically classified text guidance

Provided is a real scene image editing method based on hierarchically classified text guidance, including: firstly selecting a hierarchical multi-label text classification model and hierarchically classify an input style description text; obtaining a latent vector of an indoor scene image and dividing the latent vector; training latent space residual mappers which are divided into four groups for generating details of a layout, an object, an attribute, and a color in the scene image, and selectively training a mapping model with a secondary word obtained by a text classification model; inputting a tertiary word obtained by the text classification model to a contrastive language-image pre-training (CLIP) network and controlling training of the mapping network by utilizing a CLIP loss; hierarchically inputting the latent vector to the mapping network to obtain a bias vector, summing the bias vector with an original vector for inputting to the StyleGAN to obtain an edited image.
Owner:HANGZHOU DIANZI UNIV

Image editing method and device, storage medium and electronic equipment

The embodiment of the invention discloses an image editing method and device, a storage medium and electronic equipment, and the method comprises the steps: obtaining a to-be-edited image and an editing instruction; generating lexical elements of the target image based on the to-be-edited image and the editing instruction by using a pre-trained multi-modal large model; intercepting visual lexical elements of the target image from the lexical elements of the target image; the hidden space representation of the target image is generated by using a pre-trained diffusion model based on the hidden space representation of the to-be-edited image and the text lexical elements and the visual lexical elements corresponding to the editing instruction, and the pre-trained diffusion model has a multi-condition guide architecture; and decoding the hidden space representation of the target image to obtain the target image. According to the method, the visual lexical elements generated by the multi-modal large model are added to serve as constraint conditions, so that the generated target image is closer to an editing instruction of a user, and the image editing effect is improved.
Owner:BEIJING SHENGSHU TECH CO LTD

Picture editing method and system based on multi-modal condition adaptation

The invention provides a picture editing method and system based on multi-modal condition adaptation, and the method comprises the steps: obtaining a first text vector: obtaining a picture description corresponding to a picture through processing, processing the picture description through an editor, and obtaining a first text vector; obtaining a first text vector based on the picture information; a second text vector acquisition step: processing the used editing instruction to obtain a second text vector based on the editing instruction; a fusion feature acquisition step: fusing the first text vector and the second text vector through weight to obtain a fusion feature; an image potential feature code acquisition step; in the image editing step, the injected condition information is received, meanwhile, the received potential features and potential noise of the image are denoised, and the image desired by the user is gradually generated in the iterative denoising process under the guidance of the received condition information; and an image restoration step. According to the invention, the stability, controllability and accuracy of image editing can be improved.
Owner:SHENZHEN EMDOOR DIGITAL TECH

Three-dimensional model editing method and device based on multiple modes, equipment and medium

The invention relates to the technical field of computers, in particular to a multi-mode-based three-dimensional model editing method and device, equipment and a medium. The method comprises the following steps: acquiring a multi-modal fusion image personalized generation method and a source three-dimensional model; obtaining a personalized image generation network corresponding to the source three-dimensional model, and training the personalized image generation network; based on the reference image list and the corresponding text description, multi-modal embedded information is obtained after fusion; taking the trained personalized image generation network as a skeleton, and adding a multi-personalized learning module to obtain a multi-personalized image editing network; and editing the source three-dimensional scene image according to the multi-modal embedded information by using a multi-personalized image editing network to obtain a single-view-angle edited image. The multi-mode embedded information generated by the method allows a user to input prompt information of multiple modes such as texts, images, sketches and the like, complementarity of prompt of each mode is mined, so that controllability of editing is improved, and high-quality three-dimensional model editing is realized.
Owner:INSPUR SUZHOU INTELLIGENT TECH CO LTD

Non-destructive generative image editing

Systems and methods for non-destructive image editing are described. Embodiments are configured to obtain, via a document editor user interface, a selection input identifying a portion of a first image displayed in the document editor user interface. According to some aspects, the first image is part of a first layer of a multilayer document. Embodiments are further configured to: obtain an image generation text prompt; generate, using an image generation network, a second image based on the first image and the image generation text prompt; and present, via a multilayer window of the document editor user interface, a first element representing the first layer of the multilayer document and a second element representing a second layer of the multilayer document. The first element includes the first image and the second element includes the second image and a mask corresponding to the portion of the first image.
Owner:ADOBE INC

Multi-modal image editing

Systems and methods for multi-modal image editing are provided. In one aspect, a system and method for multi-modal image editing includes identifying an image, a prompt identifying an element to be added to the image, and a mask indicating a first region of the image for depicting the element. The system then generates a partially noisy image map that includes noise in the first region and image features from the image in a second region outside the first region. A diffusion model generates a composite image map based on the partially noisy image map and the prompt. In some cases, the composite image map includes the target element in the first region that corresponds to the mask.
Owner:ADOBE INC

Text-guided image editing by learning guidance scales via reinforcement learning

Certain aspects of the present disclosure provide techniques and apparatus for improved machine learning. In an example method, a first latent tensor generated during a first iteration of processing data using a denoising backbone of a diffusion machine learning model is accessed. A guidance scale is generated based on processing the first latent tensor using a guidance machine learning model. A second latent tensor is generated during a second iteration of processing data using the denoising backbone based on the first latent tensor and the first guidance scale, and an output from the diffusion machine learning model is generated based at least in part on the second latent tensor.
Owner:QUALCOMM INC

Instruction-driven personalized fashion image editing method

The invention discloses an instruction-driven personalized fashion image editing method. The method comprises the following steps: 1, defining categories of editing tasks, and constructing an original image-reference image-target image-text editing instruction quaternary data set for different editing tasks; 2, constructing a target semantic network, generating target image semantic information following an editing instruction and an original image, and taking the target image semantic information as human body semantic information of an editing model; 3, constructing a unified editing network, including constructing a semantic control network, adding a visual joint module and applying a low-rank fine tuning module, so that a plurality of editing tasks use the same framework to obtain corresponding editing capabilities; and 4, constructing a multi-task low-rank adjustment module, and enabling the framework to have the capability of aligning different editing instructions to different editing tasks through joint training. Finally, an independent and unified framework among different tasks is realized. According to the method, experiments are carried out on a constructed specific data set, and good results are obtained in both quantitative and qualitative aspects.
Owner:HANGZHOU DIANZI UNIV

Modal language model image editing technology fusing non-perpetual culture elements

The invention discloses a modal language model image editing technology fusing non-perpetual culture elements. The modal language model image editing technology comprises the steps that a model is selected and trained, an LLaMA model is selected as a basis, LoRA is introduced for adaptive fine adjustment, and in this way, the model is subjected to adaptive adjustment under the condition that original parameter freezing is kept; according to the method, the understanding and reasoning capabilities in instruction editing are enhanced by combining MLLM (such as LLaVA), the MLLM can perform collaborative learning across text and image modalities and extract deep semantic information, so that the model can not only process basic instructions, but also understand complex non-perpetual culture elements, and the method has great significance in improving the understanding of the model on the non-perpetual culture elements. An enhanced bidirectional interaction mechanism is designed, and the mechanism realizes deep interaction between image and text features through a cross attention mechanism, so that the image features can be used as query and key value pairs to perform bidirectional communication with the text features, and the expression of a model in a complex non-perpetual scene is improved.
Owner:BEIJING JIAOTONG UNIV

Image editing method and system based on diffusion model inversion and attention optimization

The invention discloses an image editing method and system based on diffusion model inversion and attention optimization, and relates to the technical field of image editing, and the method comprises the steps: mapping a source image to a potential space through a pre-trained automatic encoder, and obtaining an initial noise feature; an EF noise space inversion algorithm is adopted to process the initial noise features, a high-variance noise graph is generated, and an intermediate result under each time step is obtained through a decoder; constructing an improved U-Net network based on edit-friendly feature reweighting and an edit-friendly attention mechanism, fusing the target prompt information into a denoising process of the improved U-Net network through a cross attention mechanism, and performing feature optimization based on the improved U-Net network; and reconstructing the potential features through a U-Net decoder, and generating an edited image conforming to the target prompt information. On the low-cost premise that complex model fine tuning and retraining are not needed, the method is superior in text-guided controllable editing tasks, and the image generation quality is improved.
Owner:ZHEJIANG NORMAL UNIV +2

Image editing and model training method and device, storage medium and program product

The embodiment of the invention provides an image editing and model training method and device, a storage medium and a program product. In the embodiment of the invention, an image-text editing model is provided, image editing is carried out on a target text area of an original image from a font dimension and a style dimension, guarantee is provided for the accuracy of image editing through text coding features and character morphological features in the font dimension, and the consistency with a background is kept; in the style dimension, by injecting text style features, the original image style and additional styles are kept, and the availability rate of image editing is improved. Image editing is carried out from the two dimensions of font and style, and the image quality of the obtained image can be improved. Furthermore, in the layout dimension and model training process, local and transverse and longitudinal modification of various alignment modes is supported through a layout loss function and adaptive learning layout information, and the image quality is further improved.
Owner:阿里巴巴(中国)网络技术有限公司

Instance-aware trimap for image editing operations

An image editing system accesses an input image displayed via a user interface and generates an instance-aware trimap for the input image by applying an instance-aware image segmentation model to input data including the input image and a segmented image defining a segment of the input image including a first set of pixel values. The trimap defines a modified segment using a second set of pixels different from the first set of pixels. Applying the model includes detecting boundaries of an object depicted in the input image. The second set of pixels is located within the boundaries of the object. Responsive to receiving a request via the user interface, the system generates a modified image by performing an editing operation on the input image including editing a portion of the second set of pixels of the modified segment of the trimap. The system transmits, for display, the modified image.
Owner:ADOBE INC

Electronic device, method, and non-transitory computer-readable medium for image editing

Electronic devices, methods, and storage mediums for editing images are provided. An image editing method comprises receiving a first user input for a first image. The method comprises determining whether the first user input indicates an instruction to add a first object. The method comprises, when the first user input indicates an instruction to add the first object, generating a first preliminary object image for the first object. The method comprises displaying a second image including the first object, the second image being generated based on the first preliminary object image and being associated with the first image. The method comprises, when a second user input indicates an instruction related to the first object is received for the second image, displaying a third image in which at least one of a size or a location of the first object is changed according to the second user input.
Owner:SAMSUNG ELECTRONICS CO LTD

Picture editing method, related equipment and system

The embodiment of the invention provides a picture editing method, related equipment and a picture editing system. Editing types (such as deletion, dragging, replacement, addition, color adjustment and the like) and editing parameters (such as replaceable contents, dragging target positions, newly added contents, color adjustment numerical values and the like) are recommended to a user according to various features such as mask features, depth features, contour features, color features and the like of an editing area selected by the user, and an editing thought is provided for the user; moreover, whether the editing instruction is reasonably matched with the editing area selected by the user can be judged, so that the user is prompted that the editing instruction cannot be executed, the user can be recommended to select a new editing area, or the user is helped to modify the editing instruction, and the user experience is improved. The problem that the editing effect does not conform to the common sense logic due to the fact that the user randomly inputs the editing instruction is solved, so that the trial and error times when the user edits the picture can be reduced, and the picture output efficiency is remarkably improved.
Owner:HUAWEI TECH CO LTD

Image processing method and electronic equipment

PendingCN119031236AImaging processingRadiology
The embodiment of the invention provides an image processing method and electronic equipment, the electronic equipment can display a first editing interface, and the first editing interface comprises a thumbnail corresponding to a static image in a first dynamic image; in response to a user operation of selecting the thumbnail, displaying a static image corresponding to the thumbnail, and displaying the thumbnail in a selected state; and in response to a user operation for editing the static image, editing the static image, and further displaying an effect after the static image is edited. According to the method, any frame of static image of the dynamic image can be edited.
Owner:HONOR DEVICE CO LTD

Text-driven face image editing method

PendingCN119006662AEliminate modal gapsMaintain strong collinearitySemantic analysisBiological modelsPattern recognitionLinguistic model
The invention discloses a text-driven face image editing method, and belongs to the technical field of AIGC. The text-driven face editing method comprises the following steps: constructing a face attribute concept dictionary; a StyleGAN style space implicit vector is generated; encoding the face data and the attribute dictionary by using a CLIP encoder to obtain image and text implicit vector features and a mean value thereof; based on the implicit vector feature mean value, constructing a face attribute encoder through a convex optimization algorithm; encoding an input image by using a face attribute encoder to obtain an image feature implicit vector; constructing a loss function, minimizing the distance between an implicit vector difference value between random pairwise images and a style space implicit vector difference value, and training a mapping network; and reasoning an input text by using the trained mapping network to obtain a style space editing direction. According to the invention, the problem of inconsistent face identity information in text-driven face editing is effectively solved. The technology shows a wide application prospect of driving face image editing by a large language model in the AIGC era.
Owner:NORTHEASTERN UNIV AT QINHUANGDAO

Design compositing using image harmonization

Systems and methods are provided for image editing, and more particularly, for harmonizing background images with text. Embodiments of the present disclosure obtain an image including text and a region overlapping the text. In some aspects, the text includes a first color. Embodiments then select a second color that contrasts with the first color, and generate a modified image including the text and a modified region using a machine learning model that takes the image and the second color as input. The modified image is generated conditionally, so as to include the second color in a region corresponding to the text.
Owner:ADOBE INC

Image editing method and apparatus, device, and storage medium

Embodiments of the present disclosure provide an image editing method and apparatus, a device, and a storage medium. The image editing method comprises: acquiring an area to be edited in an original image and a target prompt word corresponding to said area, wherein the target prompt word is text information used for describing an expected effect of image editing; determining a target mask image on the basis of said area, and adding preset noise to said area on the basis of the target mask image by means of an image editing model to obtain a local noise image; and on the basis of the target prompt word and by means of the image editing model, performing noise prediction processing and image generation processing on an area to be edited in the local noise image, and outputting a target image on the basis of a noise prediction result and an image generation result. The embodiments of the present disclosure solve the problem that image editing methods in the related art cannot accurately modify and edit local areas, thereby improving image-text consistency and image generation quality.
Owner:BEIJING ZITIAO NETWORK TECH CO LTD

Image processing method and device, electronic equipment and medium

The invention discloses an image processing method and device, electronic equipment and a medium, and belongs to the technical field of image processing.The image processing method comprises the steps that under the condition that area selection input of a to-be-processed image is received, an image editing dialogue window is displayed; and under the condition that an image retouching prompt word input in the image editing dialogue window is received, image processing indicated by the image retouching prompt word is executed on an image in the to-be-edited image area selected by the area selection input.
Owner:VIVO MOBILE COMM CO LTD

Discovering and mitigating biases in large pre-trained multimodal based image editing

A method, apparatus, non-transitory computer readable medium, apparatus, and system for image processing include obtaining a text prompt and an input image depicting a person, generating a latent code based on the text prompt and the input image, wherein the latent code is optimized by an identity preserving loss, and generating, using an image generator of a machine learning model, a synthetic image based on the latent code, wherein the synthetic image includes an element of the text prompt and preserves an identity of the person in the input image.
Owner:ADOBE INC

Image editing through utilization of large language model

Some implementations are directed to editing a source image based on a user request to edit the source image. The source image and the user request to edit the source image can be processed, using an image-editing system, to generate one or more image editing instructions. The one or more image editing instructions can indicate an image mask that edit (or preserves) one or more portions of the source image and / or can indicate a target object to be present in the edited image to replace a source object in the source image. Based on the one or more image editing instructions and source image, an edited image that shares the one or more portions with the source image and that differs from the source image by replacing the source object in the source image with the target object can be generated.
Owner:GOOGLE LLC

Interactive point-based image editing

Embodiments of the disclosure relate to interactive point-based image editing. According to example embodiments of the present disclosure, a user edit input for a source image is obtained to indicate at least one handle point and at least one target point in the source image. A feature map is extracted from the source image using a diffusion model at an iteration step of an inverse denoising diffusion process performed on the source image. The feature map is then updated based on the user edit input. Then a target image is generated based on the updated feature map using the diffusion model through a denoising diffusion process performed on the updated feature map.
Owner:LEMON INC(GB)

Image inversion and editing using rectified flow neural networks

Systems and methods for performing image modification. In particular, the system can, using a rectified flow neural network, perform an image inversion and image editing process to generate a modified image that has been modified according to a conditioning input received by the system.
Owner:GOOGLE LLC

Proxy-guided image editing

A method, apparatus, non-transitory computer readable medium, and system for image processing include obtaining an input image and an input mask, wherein the input mask indicates a region of the input image to be modified and generating, using a first image generation model, an intermediate result based on the input image and the input mask, wherein the intermediate result modifies the region of the input image indicated by the input mask. A second image generation model generates a synthetic image based on the input image and the intermediate result, wherein the synthetic image depicts the input image with content from the modified region at a higher level of detail than the intermediate result.
Owner:ADOBE INC

Condition-based image editing

A computer system and a computer-implement method include obtaining a source image and a modification input that indicates a target edit to the source image and generating a modification encoding representing the target edit. An image generation model generates an output image that depicts the source image with the target edit based on the source image and the modification encoding. The image generation model is trained to perform a pose modification task and a part replacement task.
Owner:ADOBE INC

Network topology image editing method, device and equipment and readable storage medium

The invention discloses a network topology image editing method, device and equipment and a readable storage medium, and is applied to the technical field of network topology images, and the method comprises the steps: recognizing a to-be-edited network topology image and network topology editing demand information, and obtaining a target editing intention and editing parameter information; editing to-be-edited network topology information corresponding to the to-be-edited network topology image by using an editing agent based on the target editing intention and the editing parameter information to obtain edited network topology information; and generating a target topological image based on the edited network topological information, and generating a target network topological image corresponding to the target topological image. Compared with the current mode that the network topological image can only be edited manually, the method has the advantages that the target editing intention and the editing parameter information are intelligently recognized, so that the editing agent is utilized to perform intelligent editing according to the target editing intention and the editing parameter information, and the topological image editing efficiency and accuracy are greatly improved.
Owner:PURPLE MOUNTAIN LAB

Image editing and generating method and device, electronic equipment and storage medium

The embodiment of the invention discloses an image editing and generating method and device, electronic equipment and a storage medium, and relates to the technical field of image generation, and the method comprises the steps: obtaining a to-be-processed image and a target instruction, constructing an image description of the to-be-processed image according to a scene in the to-be-processed image, converting the image description into a text mark, and storing the text mark in the target instruction; the method comprises the steps of obtaining a to-be-processed image, embedding a text mark into a high-dimensional space through an embedding model to obtain text embedding, obtaining an element vector of the to-be-processed image according to the to-be-processed image and the text embedding through a diffusion model, designing an editing operator according to a target instruction, updating the element vector by using the editing operator, and generating a result image according to the updated element vector through the diffusion model. According to the method, efficient, accurate and flexible editing of the image is realized by combining the diffusion model and the editing operator, and the problems that the expression of the model on a specific target category cannot be improved, the problem of long tail distribution cannot be solved and data similar to a real scene cannot be generated in the prior art are solved.
Owner:SHENZHEN TIANHAI CHENGUANG TECH CO LTD

Image editing method and device based on neural radiation field, equipment and storage medium

The invention provides an image editing method and device based on a neural radiation field, equipment and a storage medium, and the method comprises the steps: obtaining a plurality of to-be-processed images, and carrying out the sampling processing of the to-be-processed images, so as to obtain the pixel information of a plurality of sampling points; pixel information of the sampling points is input into a preset neural radiation field optimization model, feature information corresponding to the sampling points is output through the preset neural radiation field optimization model, and radiation rotation invariant constraints are added into the preset neural radiation field optimization model; generating a target neural renderer according to the feature information corresponding to the sampling point; generating a three-dimensional neural point cloud segmentation mask according to the target neural renderer; in response to an editing request of a user, generating an edited image according to the three-dimensional neural point cloud segmentation mask; the technical effect of improving the image editing efficiency and editing controllability based on the neural radiation field is achieved.
Owner:BEIHANG UNIV