Autonomous System Self-Testing with Real-Data Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The complexity of autonomous systems with self-X properties makes software testing challenging due to unpredictable environmental changes and non-deterministic behavior, leading to difficulties in validating correct system behavior and ensuring error-free operation.

Innovation Solution

A monitoring and controlling unit that receives and compares test data from the virtual world with real data from the physical world, updating the test data with new information to generate executable tests that cover all possible and realistic system behaviors, allowing the autonomous system to self-test and validate its behavior.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the autonomous system uses flexible system configuration and self-X properties to adapt to unpredictable environmental changes, then the adaptability and versatility of the system are improved, but the ability to validate and verify correct system behavior through software testing deteriorates

Engineering Contradiction:
Improveadaptability to environmental changesVSAvoidvalidation of system behavior
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent applies preliminary action by continuously updating test data with real operational data before formal validation occurs. The monitoring and controlling unit collects real data during system operation and uses it to update test datasets, ensuring that validation tests reflect actual environmental conditions and system behaviors that may not have been predictable during initial test design

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements feedback by creating a closed-loop system where real operational data flows back into the test data generation process. The monitoring unit continuously monitors system behavior, captures real data, updates test datasets, and validates system behavior against these updated tests, creating an iterative improvement cycle that enhances validation reliability while maintaining adaptability

Inventive Principle:
Principle #23Feedback

2Ease of operation

If the system structure is made flexible to allow changes at any time, then the ease of operation and configurability are improved, but the difficulty of detecting and measuring correct behavior increases

Engineering Contradiction:
Improvesystem configurabilityVSAvoidbehavior validation difficulty
Core Design Contradiction:
Ease of operationVSDifficulty of detecting and measuring

Solution Approach 1:

The patent applies dynamics by making the test data generation process adaptive rather than static. The monitoring and controlling unit dynamically updates test data based on real operational conditions, allowing the validation framework to evolve with changing system configurations and environmental conditions, thereby maintaining the ability to detect and measure correct behavior despite system flexibility

Inventive Principle:
Principle #15Dynamics

3Measurement precision

If comprehensive test data covering all possible configurations is collected, then the measurement precision of system behavior is improved, but the quantity of data and device complexity increase

Engineering Contradiction:
Improvebehavior validation accuracyVSAvoidtesting system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies self-service by enabling the autonomous system to generate its own test data through the monitoring and controlling unit. The system uses its own operational data to create validation test cases, eliminating the need for external complex testing infrastructure to generate comprehensive test scenarios for all possible configurations

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent uses preliminary action by continuously preparing and updating test data in advance during normal operation. The monitoring unit collects and processes real data into updated test datasets that are ready for validation, ensuring comprehensive coverage is achieved progressively rather than requiring all test data to be prepared simultaneously, thus reducing immediate complexity requirements

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11262722B2Monitoring and controlling unit for use in an autonomous system with self-x properties
Publication Date: 2022.03.01 SIEMENS AG
  • US11262722B2 patent drawing

AI summary

Provided is a monitoring and controlling unit for use in an autonomous system with self-X properties, including a test data interface for receiving test data, a real data interface for receiving real data, wherein the test data is compared with the real data to determine whether there is a part of new data in the real data, if a part of new data is identified in the real data, the test data is updated with the part of new data and an output interface for sending the updated test data, which can be further processed into at least one executable test. Further, provided is an according autonomous device, an autonomous system, method of self-testing of an autonomous system and computer program.