Unstructured Data Structuring for Law Enforcement Analytics

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Law enforcement agencies face significant challenges in processing and analyzing large unstructured electronic data files from social media platforms, which can be time-consuming and result in stale or irrelevant information due to the manual processing required, and conventional data management systems struggle to handle files exceeding 500 Mb in size.

Innovation Solution

A system and method for structuring unstructured electronic data files by parsing and assigning object types and property types, storing the structured content in a database, and generating interactive data reports that allow for customizable exploration and visualization of the data, enabling quick and logical filtering of large datasets.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If manual processing of unstructured data is used, then data can be processed without specialized systems, but processing time increases significantly (weeks or months) and information becomes stale

Engineering Contradiction:
Improveprocessing system complexityVSAvoidprocessing time
Core Design Contradiction:
Device complexityVSLoss of time

Solution Approach 1:

The patent replaces manual mechanical processing with automated computer-based processing. The system uses software to automatically parse, structure, and analyze unstructured electronic data files, eliminating the need for manual review while dramatically reducing processing time from weeks/months to much faster automated operations.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system enables self-service processing where the computer automatically performs data parsing, structuring, and analysis without requiring manual intervention. The automated system serves itself by handling the entire processing workflow from raw unstructured data to structured analytical results.

Inventive Principle:
Principle #25Self-service

2Device complexity

If conventional data management systems are used, then system simplicity is maintained, but files exceeding 500 Mb cannot be viewed or searched

Engineering Contradiction:
Improvedata management system complexityVSAvoidfile size handling capability
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The patent segments large unstructured electronic data files into smaller manageable components that can be processed individually. By dividing the large file into discrete data elements, the system can handle files exceeding 500 Mb that would otherwise be impossible to view or search in conventional systems.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system transitions from handling data as a single large file to organizing it as structured data elements in a database. This dimensional change from file-based to database-based organization enables the system to manage and query data that exceeds the capacity limits of conventional file viewers.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Reliability

If unstructured data files are stored in original format, then data integrity is preserved, but data aggregation and report generation become difficult or impossible

Engineering Contradiction:
Improvedata integrityVSAvoiddata aggregation efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent changes the structural parameters of the data from unstructured format to structured format while preserving the underlying information. By transforming the data organization parameters (from free-form text to structured database fields), the system enables efficient aggregation and report generation while maintaining data integrity through accurate parsing and structuring.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS9984428B2Systems and methods for structuring data from unstructured electronic data files
Publication Date: 2018.05.29 PALANTIR TECHNOLOGIES INC
  • US9984428B2 patent drawing
  • US9984428B2 patent drawing
  • US9984428B2 patent drawing

AI summary

Computer implemented systems and methods are disclosed for structuring data from unstructured electronic data files. In accordance with some embodiments, an electronic data file including unstructured content associated with a legal process return is received and the unstructured content parsed. The unstructured content is parsed to identify one or more objects and properties based on a database ontology that are processed to generate an object model. A data report may be generated based on the identified objects and properties.