Mobile Terminal Camera Interface for Intuitive External Device Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing mobile terminal control methods for external devices are not intuitive and require separate applications, making them inconvenient for users.

Innovation Solution

A mobile terminal with a wireless communication module and controller that allows for direct control of external devices via a camera application, enabling pairing and control through a touch screen interface, including indicators for multiple devices aligned according to their location in the preview image, and allowing control signals to be generated through double-tap or knock-on inputs on the always-on display.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a separate application is used to control external devices, then control functionality is achieved, but user convenience and intuitiveness deteriorate

Engineering Contradiction:
Improveuser convenienceVSAvoidcontrol method complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent merges the external device control functionality with the camera application by detecting objects in the captured image and displaying control menus directly within the camera interface. This integration eliminates the need for users to switch to separate control applications, thereby improving ease of operation while maintaining control functionality.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The camera application is enhanced to perform multiple functions: capturing images, detecting objects in the image, identifying external devices, and providing control menus for those devices. This multi-functionality allows a single application to serve both photography and device control purposes, improving user convenience without requiring additional specialized applications.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If control menus are displayed for multiple external devices, then control capability is enhanced, but interface complexity increases

Engineering Contradiction:
Improvemulti-device control capabilityVSAvoidinterface complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments the control interface by displaying individual control menus for each detected external device separately within the camera interface. Each device receives its own dedicated control menu, allowing users to manage multiple devices independently without overwhelming the interface. This segmentation approach enables multi-device control while maintaining interface clarity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The control menus are positioned at locations corresponding to the detected external devices within the image display area. This spatial mapping provides local quality by associating each device's control interface with its visual representation in the image, making it intuitive which menu controls which device while managing interface complexity.

Inventive Principle:
Principle #3Local quality

Data Source

PatentEP3687144B1Mobile terminal
Publication Date: 2024.06.19 LG ELECTRONICS INC
  • EP3687144B1 patent drawingFigure 1
  • EP3687144B1 patent drawingFigure 2
  • EP3687144B1 patent drawingFigure 3

AI summary

A mobile terminal is disclosed to solve a problem of a control method of the related art for controlling an external device, which is not intuitive and inconvenient. The mobile terminal comprises a camera; a display unit outputting a preview image acquired by the camera; and a controller controlling the display unit to output a control menu corresponding to an external device included in the preview image and generating a control signal corresponding to a user input signal for the control menu if the user input signal is sensed.