Reanalysis Ensemble Service for Climate Data Intercomparison

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current data analytics platforms lack the capability to efficiently operate over multiple disparate climate data collections, including reanalysis datasets and forward processing data products, and do not provide effective intercomparison tools among different data sets.

Innovation Solution

A Reanalysis Ensemble Service is developed, which includes conversion utilities to transform disparate climate data collections into a common format, a data analytics platform for storage and operation, and a service interface for mapping service requests to analytic operations, enabling dynamic data object creation and delivery.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a data analytics platform is designed to operate over multiple disparate climate data collections, then the capability to perform intercomparison analytics is improved, but the device complexity increases

Engineering Contradiction:

Improvecapability to operate over multiple disparate climate data collectionsVSAvoidplatform complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The platform is segmented into distinct functional modules: conversion utilities for data format transformation, a core data analytics platform for processing, and a service interface for user interaction. This modular architecture allows the system to handle multiple disparate climate data collections while managing complexity through clear separation of concerns.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

A service interface layer acts as an intermediary between users and the complex data analytics platform. This interface abstracts the underlying complexity and provides simplified access to intercomparison analytics capabilities, allowing users to query multiple climate data collections without directly interacting with the complex processing mechanisms.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Ease of operation

If conversion utilities are implemented to transform disparate climate data collections to common format, then the ease of operation is improved, but the loss of time increases

Engineering Contradiction:

Improveease of operating over multiple reanalysis collectionsVSAvoiddata conversion time

Core Design Contradiction:

Ease of operationVSLoss of time

Solution Approach 1:

Conversion utilities are configured to transform disparate climate data collections to a common format in advance, before analytics operations are performed. This preliminary conversion action ensures that data from multiple reanalysis collections and forward processing products are ready for immediate comparison, improving ease of operation while the conversion occurs beforehand.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system creates converted copies of climate data in a common format rather than requiring real-time transformation during analytics operations. These pre-converted data copies can be stored and readily accessed for intercomparison analytics, reducing the time penalty of format conversion during actual analysis.

Inventive Principle:

Principle #26Copying

3Productivity

If high performance operations are implemented on climate data, then the productivity is improved, but the device complexity increases

Engineering Contradiction:

Improveperformance of operations on climate dataVSAvoidsystem complexity

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

The system replaces traditional sequential data processing mechanics with parallel computing operations. High performance operations are implemented by dividing climate data processing into independent parallel tasks that can be executed simultaneously across multiple computational units, dramatically improving productivity while the parallel processing framework manages the complexity.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS11501394B1System and method for providing an improved earth observing system forward processing data analytic service

Publication Date: 2022.11.15 UNITED STATES OF AMERICA AS REPRESENTED BY THE ADMINISTRATOR NAT AERONAUTICS & SPACE ADMINISTRATION

AI summary

A reanalysis ensemble service includes a plurality of conversion utilities, each conversion utility configured to convert a specific one of a plurality of disparate climate data collections from different sources to common format files that are temporally and spatially registered, where the disparate climate data collections include reanalysis data sets and forward processing data products, a data analytics platform for storing and operating on the different sourced common format files, a service interface for mapping service requests to analytic operations performed on the different sourced common format files by the data analytics platform, and a services library that dynamically creates data objects from one or more of the different sourced common format files in response to the analytic operations, and delivers the data objects to the service interface.