Face Tracking Dual Preview System for Smartphone Selfies

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional camera-enabled smartphones do not provide an automatic camera preview for subjects other than the user taking a selfie, making it difficult for them to position and pose correctly during image capturing events.

Innovation Solution

An electronic device with a controller that uses a second display device to provide a cropped camera preview, automatically identifying and tracking the primary face within the image stream and adjusting the preview to fit the different aspect ratio of the second display, ensuring the subject receives meaningful feedback on their positioning and pose.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a single main display is used to present the camera preview, then the device complexity is kept simple, but the subject cannot receive real-time feedback on their positioning and pose

Engineering Contradiction:
Improvesubject's ability to position and poseVSAvoiddisplay system complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The display system is segmented into two separate displays: a main display for the user and a secondary display for the subject. Each display serves a distinct function - the main display shows the full camera preview to the user, while the secondary display provides cropped, face-centered feedback to the subject. This segmentation resolves the contradiction by enabling subject feedback without requiring complex modifications to the overall device architecture.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

A processor acts as an intermediary between the camera and the displays. It receives the camera preview, identifies faces using facial recognition technology, crops the image to center on detected faces, and outputs the processed preview to the secondary display. This intermediary processing enables intelligent adaptation of the preview for the subject without requiring direct complex interaction between the camera and display systems.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of information

If the camera preview is cropped to center on the subject's face, then the subject receives meaningful feedback, but non-viewable picture areas are minimized

Engineering Contradiction:
Improveloss of viewable picture areaVSAvoidsubject's ability to position and pose
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The system extracts only the relevant portion of the camera preview - specifically, the region containing the subject's face - and displays it on the secondary display. By taking out and isolating the face-centered portion of the image, the system provides the subject with meaningful feedback about their positioning and pose without showing them the entire camera preview, thereby minimizing information loss while maintaining ease of operation.

Inventive Principle:
Principle #2Taking out (Extraction)

3Extent of automation

If facial recognition technology is implemented to track the subject's face, then real-time feedback is provided, but the device complexity increases

Engineering Contradiction:
Improveautomatic face tracking and preview adjustmentVSAvoidprocessing and control complexity
Core Design Contradiction:
Extent of automationVSDevice complexity

Solution Approach 1:

The system uses facial recognition technology to automatically detect, track, and center on the subject's face without requiring manual intervention. The processor autonomously analyzes the camera preview, identifies facial features, and adjusts the crop accordingly. This self-service capability provides high extent of automation while keeping device complexity manageable by leveraging existing facial recognition algorithms and processing power.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11722762B2Face tracking dual preview system
Publication Date: 2023.08.08 MOTOROLA MOBILITY LLC
  • US11722762B2 patent drawing
  • US11722762B2 patent drawing
  • US11722762B2 patent drawing

AI summary

An electronic device, computer program product, and method perform face tracking within an image stream captured by an image capturing device for preview on a second display device. At least one first display device presents a first preview image of the image stream via a first graphical user interface (GUI). The first GUI has a first aspect ratio. A controller of the electronic device tracks a primary face of a subject within the image stream. A second display device presents a second preview image via a second GUI. The controller generates the second preview image from the first preview image by cropping around the primary face to a second aspect ratio of the second GUI.