Electronic Form Identification Using Spatial Bounding Regions

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing computing devices face challenges in accurately identifying and analyzing electronic forms on websites, particularly when input elements are mislabeled or lack identifying information, leading to incorrect identification or omission during automation processes.

Innovation Solution

The use of spatial information to determine the relationship between target input elements and label elements on a website, by expanding the bounding region of input elements and comparing text labels with keyword lists to increase confidence in identifying input element types and forming electronic forms.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If computer applications rely on fields to be labeled or linked to field data to identify a type of field, then the identification process can be automated, but input elements may be mislabeled or may not include identifying information, which causes incorrect identification or omission of fields

Engineering Contradiction:
Improveautomation of form identificationVSAvoidaccuracy of field identification
Core Design Contradiction:
Extent of automationVSReliability

Solution Approach 1:

The system performs preliminary analysis of the website structure and spatial relationships before attempting to identify form fields. By pre-processing the DOM tree and establishing spatial indexes of elements, the system prepares the data structure in advance to enable more reliable identification even when labels are missing or incorrect, thus maintaining automation while improving accuracy

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces spatial relationship analysis as an intermediary method between the automated identification system and the form fields. Instead of directly relying on potentially incorrect labels, the system uses spatial positioning and contextual relationships as a mediator to infer the correct field types, resolving the contradiction between automation and reliability

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If manual identification and analysis of electronic forms is performed, then accuracy of field identification can be maintained, but the process cannot be automated and requires user intervention

Engineering Contradiction:
Improveaccuracy of field identificationVSAvoidautomation of form identification
Core Design Contradiction:
ReliabilityVSExtent of automation

Solution Approach 1:

The system enables the website structure to self-identify form fields through automated spatial analysis and contextual inference. By analyzing the DOM tree structure, element positions, and relationships between components, the system allows the form to effectively identify itself without manual intervention, achieving both automation and maintained accuracy

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent implements feedback mechanisms where the system continuously refines its field identification based on spatial relationships and contextual information. The automated system uses feedback from the website structure analysis to correct and verify field identifications, maintaining reliability while achieving full automation

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11256912B2Electronic form identification using spatial information
Publication Date: 2022.02.22 SWITCH INC
  • US11256912B2 patent drawing
  • US11256912B2 patent drawing
  • US11256912B2 patent drawing

AI summary

This disclosure is generally directed to identifying electronic forms using spatial information of elements presented on a website. Identifying a type of an electronic form may include identifying particular input elements associated with the form, determining a bounding region of the input element, expanding the bounding region, and determining any intersections of the expanded bounding region with one or more label elements proximate to the input element. Keywords of the label elements can be analyzed to increase or decrease a confidence level that an input element is associated with a particular input type. A bounding region can be dynamically sized based on a number of intersecting elements. An electronic form can be identified based on the identified input elements. In some instances, the electronic forms may assist a user in accessing or updating remotely stored personal information, including payment information, across one or more third party electronic sites.