Intelligent Camera Subject Distortion Correction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image correction technologies fail to accurately address distortion issues in photographs taken with wide-angle lenses, particularly in whole body and selfie modes, leading to unsatisfactory subject size and background representation.

Innovation Solution

An intelligent device and method that utilize a time-of-flight camera to measure distances and an artificial neural network classifier to determine distortion states, allowing for real-time correction of subject sizes and backgrounds, incorporating preview image information to fill blanks and generate appropriate backgrounds.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If a wide angle lens is used for photographing, then the field of view is expanded, but the body ratio and subject size representation become distorted

Engineering Contradiction:
Improvefield of viewVSAvoidsubject size representation
Core Design Contradiction:
Area of stationary objectVSManufacturing precision

Solution Approach 1:

The system changes parameters by measuring the actual distance to the subject using a time-of-flight camera and using machine learning to determine the subject's actual size. Based on these parameters, it calculates correction values that adjust the distorted subject size and body ratio caused by the wide angle lens, thereby resolving the contradiction between expanded field of view and accurate subject representation

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent replaces traditional mechanical/optical correction methods with electronic and computational approaches. Instead of using complex optical systems to correct distortion, it uses time-of-flight measurement, machine learning classification, and digital image processing to achieve accurate subject size representation while maintaining the wide angle lens's expanded field of view

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Manufacturing precision

If the subject size is corrected in whole body or selfie mode, then the body ratio is improved, but additional processing steps and complexity are introduced

Engineering Contradiction:
Improvebody ratioVSAvoidprocessing complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The system performs self-service by automatically measuring subject distance, classifying subject type and state using machine learning, and applying appropriate corrections without requiring manual user input. The device autonomously handles the entire correction process, from detection to correction application, reducing the perceived complexity for the user while maintaining accurate body ratio representation

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system performs preliminary actions by capturing a preview image before the actual photograph, using this preview to obtain background information and plan the correction strategy. This preliminary processing allows the system to prepare correction data and select appropriate correction methods in advance, streamlining the overall correction process and reducing real-time processing complexity

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If machine learning is used to determine distortion state, then the accuracy of subject size correction is improved, but processing time and computational resources increase

Engineering Contradiction:
Improvedistortion state detection accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system applies partial action by using machine learning selectively - it extracts key feature values from subject state information and inputs only these essential features into the trained classifier. This approach achieves sufficient detection accuracy for distinguishing distortion states without requiring the model to process all possible image details, thereby reducing processing time while maintaining the necessary precision for correction

Inventive Principle:
Principle #16Partial or excessive action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution enables automatic and precise correction of subject sizes and backgrounds, preventing distortion and enhancing image quality in both whole body and selfie photography modes.

Implementation Method 1

The camera may include a time of flight (TOP) camera for shooting light and measuring a time of reflected light to calculate a distance.

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Data Source

PatentUS11082610B2Artificial device and method of collecting image of the same
Publication Date: 2021.08.03 LG ELECTRONICS INC
  • US11082610B2 patent drawing
  • US11082610B2 patent drawing
  • US11082610B2 patent drawing

AI summary

Provided are an intelligent device and a method of correcting an image thereof. The intelligent device includes a camera received in a body; a processor for controlling to obtain subject state information from an image transmitted from the camera; and a memory for storing the subject status information, wherein the processor is configured to determine a distortion state of a size of a subject based on the obtained subject state information, to measure a distance between the camera and the subject when the distortion state of the size of the subject is recognized, to correct a size of the subject to correspond to a ratio of the measured distance, and to correct a blank of a subject background formed by the corrected size of the subject. The intelligent device may be connected to an Artificial Intelligence (AI) module, a drone (Unmanned Aerial Vehicle (UAV)), a robot, an augmented reality (AR) device, a virtual reality (VR) device, and a device related to a 5G service.