Document Image Prompt Conversion for Adding Generated Objects
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing automatic coloring devices can color objects in target images but struggle to add new image objects desired by users.
Innovation Solution
An image generating system that includes a target image acquiring unit, command detecting unit, user prompt converting unit, and process executing unit, which detects additional commands in a document image, determines user prompts and process areas, acquires keywords, and generates images using an image generation model to insert into the target image.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If an automatic coloring device is used to color objects in a target image, then the coloring function is achieved, but the ability to add new image objects desired by users is lost
Solution Approach 1:
The image processing system is enhanced to perform multiple functions: it can both color existing objects (original automatic coloring function) and generate new image objects based on user prompts (additional image generation function). This multi-functionality resolves the contradiction by making the system versatile without requiring separate devices for each function.
Solution Approach 2:
An image generation model acts as an intermediary component between the user prompt input and the target image output. This mediator processes the user's text prompts and generates appropriate image objects that are then integrated into the target image, enabling new object addition while maintaining the原有的 automatic coloring capability.
2Adaptability or versatility
If image generation models are integrated to generate new image objects, then the versatility of the system improves, but the device complexity increases
Solution Approach 1:
The image generation model functionality is merged with the existing automatic coloring system into a unified image processing apparatus. By combining these functions in one integrated system rather than separate systems, the patent achieves versatility improvement while managing complexity through consolidation rather than multiplication of components.
Data Source
AI summary
An image generating system includes a target image acquiring unit, a command detecting unit, a user prompt converting unit, and a process executing unit. The target image acquiring unit is configured to acquire as a target image a document image of a document. The command detecting unit is configured to (a) detect in the document image an additionally-written command additionally described to the document and (b) determine a user prompt and a process target area corresponding to the additionally-written command in the target image. The user prompt converting unit is configured to acquire a keyword in association with the user prompt, and add the keyword to the user prompt. The process executing unit is configured to (a) acquire using an image generation model a generated image corresponding to the user prompt added the keyword, and (b) insert the generated image to the process target area.