Method for storing validation data for validating systems for processing large amounts of data

Abstract

Method for storing validation data (23) in a data storage system (12), wherein the validation data (23) are intended for validating systems for processing large amounts of data; wherein the data storage system (12) is configured to provide the validation data (23) for validating at least one system for processing large amounts of data; and wherein the validation data (23) comprise at least some data recorded by sensors (2); comprising the following steps: a) receiving the validation data; b) determining (7) at least one statistical property of the received validation data; c) performing compression (6) of the validation data to produce compressed validation data (11) using a lossy compression method; d) determining at least one statistical comparison property;e) Performing a comparison of the at least one statistical property with the at least one statistical comparison property, wherein the comparison checks whether a deviation between synthesized validation data (20) producible on the basis of the compressed validation data and the validation data received in step a) lies within a predetermined tolerance range, wherein the tolerance range is chosen such that deviations are detected which lie within a signal noise caused by properties of at least one sensor (2) with which validation data were recorded, wherein the tolerance range is further chosen such that the distance between validation data (20) synthesized on the basis of the compressed validation data (11) and the recorded reality is not greater than the distance between the validation data received in step a) from the same reality;and f) Storing the compressed validation data (11) in the data storage system (12) if, in step e), it was determined that the deviation is within the specified tolerance range.;

Images