Object-Tracked Graphic Elements for Interactive Camera Previews

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing electronic devices lack the capability to recognize objects in real-time preview images and dynamically add or track graphic elements corresponding to those objects, limiting interactive and personalized image display functionalities.

Innovation Solution

An electronic device is equipped with a processor that recognizes objects in a preview image, provides visual cues, allows for real-time drawing inputs, and tracks changes in the objects to variably display graphic elements accordingly.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If real-time object recognition and tracking is implemented in preview images, then user engagement and personalization are enhanced, but device complexity and processing requirements increase

Engineering Contradiction:
Improveinteractive display functionalityVSAvoidprocessing system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system performs preliminary object recognition and classification during the preview phase before final image capture. This allows graphic elements to be pre-positioned and tracked on identified objects (people, animals, things) in real-time, enabling interactive display functionality without adding complexity to the final capture process.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The processing system is segmented into specialized modules: object detection module, object classification module (people/animals/things), graphic element generation module, and tracking module. Each module handles specific tasks independently, reducing overall system complexity while enabling comprehensive interactive functionality.

Inventive Principle:
Principle #1Segmentation

2Adaptability or versatility

If graphic elements are dynamically added and tracked on objects in real-time, then image display personalization is improved, but processing time and computational resources increase

Engineering Contradiction:
Improvegraphic element customizationVSAvoidreal-time processing time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The system performs object recognition and graphic element updates at periodic intervals during the preview phase, rather than continuously. This periodic processing approach maintains real-time interactivity while reducing overall computational burden and processing time requirements.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system generates simplified graphic element representations (icons, labels, visual cues) that copy or represent the identified objects rather than processing full object data. This copying approach enables fast rendering and tracking of multiple objects without intensive computational resources.

Inventive Principle:
Principle #26Copying

3Ease of operation

If object recognition and visual cue provision are implemented, then user interaction capability is enhanced, but device functionality complexity increases

Engineering Contradiction:
Improveuser interaction capabilityVSAvoidfunctionality complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system introduces visual cues as intermediary elements between the user and the objects in the preview image. These visual cues (icons, labels, markers) mediate the interaction by clearly indicating detected objects and their categories, making the system easier to use without requiring complex user understanding of the underlying processing.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system uses color-coded visual cues to indicate different object categories (people, animals, things). This color differentiation provides intuitive visual feedback that enhances user interaction capability while maintaining simple system architecture through standardized visual encoding.

Inventive Principle:
Principle #32Color changes

Data Source

PatentEP3779660B1Apparatus and method for displaying graphic elements according to object
Publication Date: 2025.10.01 SAMSUNG ELECTRONICS CO LTD
  • EP3779660B1 patent drawingFigure 1
  • EP3779660B1 patent drawingFigure 2
  • EP3779660B1 patent drawingFigure 3

AI summary

An electronic device and a method of operating the same are provided. The electronic device includes a camera module, a display, a memory, and a processor configured to be operatively connected to the camera module, the display, and the memory, wherein the processor is further configured to display a preview image obtained from the camera module on the display, to recognize an object from the preview image, to detect a drawing input based on the object, to generate a graphic element by the detected drawing input, and to display the graphic element to correspond to the object by tracking the object. In addition, various embodiments are possible.