Automated Electronic Form Completion via Hierarchical Element Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems lack the ability to automatically recognize and complete electronic forms with varying hierarchical arrangements, requiring human intervention and resulting in inefficiencies in data processing and automation of business processes.

Innovation Solution

A visual relationship management server that creates digital models to detect and analyze hierarchical relationships among form elements, using neural networks to associate fields with group and field labels, enabling automatic completion of electronic forms across different arrangements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If manual completion of electronic forms is used, then accuracy of data entry is maintained, but productivity is reduced and time consumption increases

Engineering Contradiction:
Improveform completion speedVSAvoidtime for form completion
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system enables self-service by automatically detecting form elements, understanding their hierarchical relationships, and completing forms without human intervention. The digital model autonomously identifies fields, labels, and groupings, then populates them with appropriate data from available sources, eliminating the need for manual form filling while maintaining accuracy

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the mechanical process of manual form completion with an automated digital system. Neural networks and computer vision algorithms substitute human visual perception and manual data entry, using machine learning models to detect form structures and automatically transfer data between forms, thereby dramatically improving productivity and reducing time loss

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If automated form completion systems are implemented, then productivity increases, but adaptability to different form arrangements is reduced

Engineering Contradiction:
Improveform completion speedVSAvoidhandling of varying form arrangements
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The system employs dynamic adaptability through neural networks that can adjust to different form layouts and hierarchical arrangements. The digital model dynamically identifies relationships between form elements regardless of their position or structure, allowing the automated system to handle various form types and arrangements while maintaining high productivity across diverse scenarios

Inventive Principle:
Principle #15Dynamics

3Adaptability or versatility

If digital models with neural networks are used to recognize hierarchical relationships, then adaptability to different form arrangements is improved, but device complexity increases

Engineering Contradiction:
Improvehandling of varying form arrangementsVSAvoidcomplexity of recognition system
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements a universal digital model that performs multiple functions: detecting form elements, identifying hierarchical relationships, understanding field-label associations, and completing forms. This multi-functional system handles various form arrangements through a single adaptable framework, reducing the need for multiple specialized systems while maintaining high adaptability across different form types

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10395108B1Automatically identifying and interacting with hierarchically arranged elements
Publication Date: 2019.08.27 DECISION ENGINES INC
  • US10395108B1 patent drawing
  • US10395108B1 patent drawing
  • US10395108B1 patent drawing

AI summary

A computer-implemented method of managing hierarchically arranged elements is disclosed. The method comprising: receiving, by a processor, a digital image of an electronic form having at least one group of elements, including at least one field that is programmed to receive input data; detecting, by the processor, a set of objects represented in the digital image; identifying, for each object of the set of objects, values for multiple attributes, including a type and a position, a value of the type being a group label corresponding to a group label in the electronic form, a field label corresponding to a field label in the electronic form, or a field corresponding to a field in the electronic form; building a set of feature vectors, including a feature vector for each pair of objects in the set of objects such that a first object of the pair has a type of a field and a second object of the pair has a type of a group label or a field label, the feature vector including a first feature for the type of each of the pair of objects and a second feature for the position of each of the pair of objects; determining, for each object of the set of objects having a type of a field, an associated group label and an associated field label based on the set of feature vectors; searching, for each of at least one the set of objects having a type of a field, a database for field data for the object based on the associated group label and the associated field label; causing, by the processor, displaying each of the at least one objects having a type of a field in association with the corresponding field data, thereby automatically completing the electronic form.