Management System for Operational Load Testing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing performance testing techniques for systems in operational environments can adversely affect running services and are inefficient, as they often require duplicating all resources during testing, leading to potential bottlenecks and increased resource demands.

Innovation Solution

A management system that estimates resource requirements, acquires current resource usage, and calculates differential system components to apply loads using free and newly added resources, minimizing disruptions and optimizing resource allocation during testing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If a load is applied to the system in actual operation during performance testing, then test execution is enabled, but adverse effects occur on services running on the operational system

Engineering Contradiction:
Improvetest execution capabilityVSAvoidadverse effect on operational services
Core Design Contradiction:
ProductivityVSObject-affected harmful factors

Solution Approach 1:

The patent segments the system into operational components and test-specific components. Virtual machine instances are created specifically for testing purposes, separating test workloads from production services. This allows independent testing without interfering with operational services while maintaining resource sharing at the physical hardware level.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces virtualization technology as an intermediary layer between the physical operational system and test workloads. Virtual machines act as mediators that isolate test operations from the underlying operational system, enabling safe load application during testing while protecting production services from adverse effects.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If all resources are duplicated during testing, then complete system testing is enabled, but resource consumption and system complexity increase significantly

Engineering Contradiction:
Improvetesting completenessVSAvoidresource consumption
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent merges test environments with operational environments by sharing underlying physical infrastructure and common resources. Virtual machines for testing share physical hardware, storage, and network infrastructure with operational systems, eliminating the need to duplicate all resources while maintaining testing effectiveness.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent creates universal resource pools that serve multiple functions - the same physical infrastructure supports both operational services and test workloads. Virtualization enables resources to be dynamically allocated and shared between production and testing purposes, reducing overall resource consumption while maintaining testing completeness.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11099965B2Management system, test method and recording medium
Publication Date: 2021.08.24 NEC CORP
  • US11099965B2 patent drawing
  • US11099965B2 patent drawing
  • US11099965B2 patent drawing

AI summary

To provide a management system capable of providing a system enhancing an efficiency of an entire system while preventing an adverse effect on the system on an operational environment. A management system that conducts a test using a system in operation includes: simulation unit that estimates a system configuration and a used amount of a plurality of resources being required for executing the test singly; acquisition unit that acquires information about the used amount of the plurality of resources included in the system in operation; and management unit that calculates a differential system component different from the configuration of the system in operation for the estimated system configuration, and determines a free resource and a resource to be newly added in the system in operation, the free resource and the resource to be newly added being used for applying a load to the differential system component.