Screenshot Orientation Detection via OCR and Face Recognition

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional methods for verifying mobile application screenshots often fail to ensure correct orientation, leading to user experience issues and potential rejection of applications in app stores due to incorrectly oriented screenshots.

Innovation Solution

A system and method for screenshot orientation detection that performs initial image processing techniques such as OCR and face recognition, rotates the screenshot if necessary, and performs subsequent processing to determine the correct orientation, with options for developers to manually or automatically adjust the orientation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional verification methods are used for mobile application screenshots, then the verification process is simple and quick, but the orientation correctness cannot be ensured leading to user experience issues and potential rejection

Engineering Contradiction:

Improvescreenshot orientation correctnessVSAvoidverification system complexity

Core Design Contradiction:

ReliabilityVSDevice complexity

Solution Approach 1:

The system performs self-verification by automatically analyzing screenshot orientation using image processing techniques without requiring manual review, thereby ensuring orientation correctness while maintaining efficient automated operation

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

Manual verification of screenshot orientation is replaced with automated image processing techniques including OCR and face recognition algorithms, substituting human mechanical inspection with computational analysis to detect and correct orientation issues

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If multiple image processing techniques are performed on screenshots to detect orientation, then the orientation detection accuracy is improved, but the processing time and computational resources increase

Engineering Contradiction:

Improveorientation detection accuracyVSAvoidscreenshot processing time

Core Design Contradiction:

Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary orientation detection using quick image processing techniques before applying more intensive analysis methods, allowing early identification of obviously incorrect orientations without requiring full computational analysis

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The verification process is divided into multiple independent analysis stages including orientation detection, content analysis, and quality verification, allowing parallel processing of different aspects and optimizing resource allocation at each stage

Inventive Principle:

Principle #1Segmentation

Data Source

PatentUS9165207B2Screenshot orientation detection

Publication Date: 2015.10.20 GOOGLE LLC

AI summary

A method and/or system for screenshot orientation detection may include performing an initial optical character recognition (OCR) and/or an initial face recognition technique on a screenshot of an application. A determination of whether the screenshot orientation is correct may be made based on, for example, the initial OCR and/or the initial face recognition technique. In an event when the screenshot orientation is not correct, a determination of a correct screenshot orientation may be made. In this regard, the screenshot may be rotated (e.g., by a predetermined number of degrees). A subsequent OCR and/or a subsequent face recognition technique may be performed on the rotated screenshot. A determination may be made whether the screenshot orientation of the rotated screenshot is correct based on, for example, the subsequent OCR and/or the subsequent face recognition technique.