UI Digital Asset Placement Analysis via Image Scanning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for determining the placement of digital assets on user interfaces across different platforms are inefficient and impractical, often requiring manual data collection or HTML parsing that lacks scalability and accuracy, especially when access to published HTML is restricted.

Innovation Solution

A method and system that uses image scanning and processing by electronic devices to capture and analyze user interface data, identifying digital asset parameters and position information without user involvement or direct HTML access, employing AI for reliable and scalable compliance checking.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If crowd sourcing approach is used to collect user interface data, then user involvement is obtained, but scalability and data quality are compromised

Engineering Contradiction:
Improveuser involvementVSAvoidscalability
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The electronic device automatically performs UI scanning and data collection without requiring user action. The device's processor captures screenshots and extracts asset placement information autonomously, eliminating the need for users to manually navigate and capture screenshots while maintaining high scalability across multiple devices.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The manual mechanical process of users capturing screenshots is replaced with an automated electronic system. The device uses its camera or display buffer to capture UI images, then uses image processing algorithms to automatically extract asset placement data, replacing the mechanical human action with an electronic automation system.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If HTML parsing approach is used to access user interface data, then data access efficiency is improved, but accessibility to electronic devices is limited

Engineering Contradiction:
Improvedata access efficiencyVSAvoiddevice accessibility
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

Instead of directly accessing HTML code, the system uses screenshot images as an intermediary representation of the UI. The image processing system extracts asset placement information from these visual representations, allowing any electronic device with a display to be analyzed regardless of whether it provides HTML access.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system creates a visual copy of the UI through screenshots rather than accessing the source HTML code. This copied visual representation can be processed by any electronic device, making the approach universally applicable across different platforms and devices that may or may not provide HTML access.

Inventive Principle:
Principle #26Copying

3Measurement precision

If manual data collection is conducted to ensure data quality, then accuracy is improved, but time consumption increases

Engineering Contradiction:
Improvedata qualityVSAvoidtime consumption
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs continuous automated scanning and data extraction without interruption. The processor continuously captures UI images and processes them to extract asset placement information, eliminating the intermittent manual collection process while maintaining high accuracy through algorithmic consistency.

Inventive Principle:
Principle #20Continuity of useful action

Solution Approach 2:

Manual data collection processes are replaced with automated image processing algorithms. The system uses computer vision and pattern recognition to automatically identify and extract asset placement information from screenshots, replacing time-consuming manual analysis with rapid automated processing that maintains high accuracy.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS20240331427A1Method, system and device for analysing placement of digital assets in a user interface
Publication Date: 2024.10.03 BERTRAND LUCAS
  • US20240331427A1 patent drawing
  • US20240331427A1 patent drawing
  • US20240331427A1 patent drawing

AI summary

A method, carried out by one or more processors, for analysing the placement in a user interface, by an electronic device, of digital assets, the method comprising scanning image data of a user interface of an electronic device, capturing image data of an instance of the user interface of the electronic device, identifying a parameter of one or more digital assets in the captured image data.