Real-Time Object Movement in Image Editing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users cannot interactively enhance image quality or apply effects to photos in real-time while taking pictures, as existing devices lack the capability to provide an interactive interface for moving objects within images during capture.

Innovation Solution

An image editing method and electronic device that captures and displays images, extracts and moves objects based on user-defined areas and detected object movements, allowing for real-time interaction and effect creation by determining object overlap and scene changes, with the processor handling object movement and scene combination.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If real-time object extraction and movement is implemented during image capture, then interactive image editing capability is improved, but device complexity increases

Engineering Contradiction:
Improveinteractive image editing capabilityVSAvoidprocessing complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system performs preliminary object extraction and tracking during the image capture phase rather than as a post-processing step. By detecting and tracking objects in real-time as the camera captures images, the system prepares the data structure and object masks in advance, enabling immediate interactive manipulation without requiring complex post-processing computations.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system creates a copy of the extracted object from the original image and manipulates this copy independently. When users interact with detected objects, the system generates object masks and copies that can be moved, rotated, or edited separately from the source image, reducing the computational burden on the original image data and simplifying the interaction process.

Inventive Principle:
Principle #26Copying

2Productivity

If object movement and scene combination is performed in real-time, then image processing speed is improved, but computational resource consumption increases

Engineering Contradiction:
Improveimage processing speedVSAvoidcomputational resource consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The system segments the image into distinct object regions and background regions using object extraction algorithms. By dividing the image processing task into separate object masks and background components, the system can independently process and manipulate each segment without requiring full-image computations, thereby reducing overall computational resource consumption while maintaining real-time processing capability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system extracts detected objects from the original image by generating object masks that separate foreground objects from the background. This extraction process isolates only the necessary pixel data for manipulation, removing unnecessary computational overhead associated with processing the entire image scene, and enabling efficient real-time object movement and scene combination.

Inventive Principle:
Principle #2Taking out (Extraction)

3Measurement precision

If multiple objects are detected and tracked across frames, then object interaction accuracy is improved, but detection complexity increases

Engineering Contradiction:
Improveobject detection accuracyVSAvoiddetection algorithm complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system maintains continuous tracking of detected objects across multiple image frames by preserving object identification data and spatial coordinates from frame to frame. This continuity allows the system to accurately determine object movements, interactions, and relationships over time without requiring complete re-detection in each frame, thereby improving detection accuracy while managing algorithmic complexity through efficient state maintenance.

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS9838615B2Image editing method and electronic device using the same
Publication Date: 2017.12.05 HTC CORP
  • US9838615B2 patent drawing
  • US9838615B2 patent drawing
  • US9838615B2 patent drawing

AI summary

An image editing method and an electronic device including a display unit are provided. In the method, a first image is captured and displayed on the display unit. A first object is extracted from the first image, and a second object in the first image is detected. A second image is captured and the second object in the second image is detected. A movement of the second object is obtained according to the first image and the second image, and the first object on the display unit is moved along with the movement of the second object. Accordingly, an object in a photo can be moved by using images.