Display Interface Image Matching for Automated Screen Testing

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing display interface testing methods rely on manual testing, leading to low efficiency and accuracy.

Innovation Solution

An automated display interface testing method that calculates mean square errors and difference images between current and desired screen images to determine matching relationships, allowing for accurate testing of display functions, erasing, touch, and input functions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If manual testing is used for display interface, then testing can be performed, but testing efficiency is low and testing accuracy is low

Engineering Contradiction:

Improvetesting efficiencyVSAvoidtesting accuracy

Core Design Contradiction:

ProductivityVSMeasurement precision

Solution Approach 1:

The patent replaces manual mechanical testing operations with an automated image processing system. The testing apparatus captures display interface images and automatically compares them against reference images using mean square error calculation and difference image analysis, eliminating manual intervention and achieving both high efficiency and high accuracy simultaneously.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent creates a digital copy (reference image) of the expected display interface and compares it with the actual captured image. This copying approach enables automated, precise, and repeatable testing without manual involvement, resolving the contradiction between testing efficiency and accuracy.

Inventive Principle:

Principle #26Copying

2Measurement precision

If automated testing with multiple calculation methods is implemented, then testing accuracy is improved, but device complexity increases

Engineering Contradiction:

Improvetesting accuracyVSAvoidtesting system complexity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the image comparison process into two distinct modules: mean square error calculation for overall similarity assessment, and difference image calculation for detailed discrepancy analysis. This segmentation enables comprehensive accuracy testing while maintaining clear, modular system architecture that manages complexity effectively.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The testing apparatus performs multiple testing functions (display interface testing, erasing function testing, touch function testing, input function testing) using a unified image processing framework. This multi-functionality achieves high testing accuracy across various scenarios without proportionally increasing system complexity.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Data Source

PatentUS12578823B2Display interface testing method and apparatus, storage medium and electronic device

Publication Date: 2026.03.17 BOE TECHNOLOGY GROUP CO LTD

AI summary

A display interface testing method includes: obtaining a current screen image of a display terminal and a desired screen image corresponding to the current screen image; calculating a first mean square error between the current screen image and the desired screen image, and determining a first image matching relationship between the current screen image and the desired screen image according to the first mean square error; calculating a first difference image between the current screen image and the desired screen image, and determining a second image matching relationship between the current screen image and the desired screen image according to the first difference image; and testing a display interface of the display terminal according to the first image matching relationship and the second image matching relationship.