Data management procedures, computer program and system

Abstract

The invention relates to a method (100) for data management of data (200) of at least one mobile device (1), which comprises at least two data types (201, 202) that differ in at least one predefined property (203) by which an authorization level of the respective data type (201, 202) is defined, wherein the method (100) comprises: acquiring (101) a data stream (200.1) of the data (200) of the device (1), and analyzing (102) data segments (210) of the data stream (200.1) with regard to the predefined property (203). The invention further relates to a computer program product and a system (4).

Description

The invention relates to a method for data management of data of at least one mobile device, to a computer program product and to a system.In the case of automatically driving and / or automated vehicles, the legislator, on account of its high complexity, is partly required to supplement the performance requirements and tests by additional documentation. This is intended to demonstrate that the automated vehicle does not cause disproportionate safety risks for vehicle occupants and other road users.For cost reasons, e.g. for hosting the data in the backend, it is of interest to keep the amount of storage in the backend low. At the same time, the collected data may include personal data such as license plates and / or faces. Depending on the purpose, the processing of the collected personal data may be permitted or prohibited. Permission may be available, for example, for legal requirements and / or documentation. Also, product enhancement, e.g., in the form of neural network training, may require processing of this data. Other purposes may require anonymization of the data.Thus, the collected data may be needed in the backend for multiple purposes, which on the one hand allow and / or require the processing of personal data and on the other hand prohibit it.It is an object of the present invention to at least partially eliminate the above disadvantages known from the prior art. In particular, it is an object of the present invention to facilitate anonymization and / or management of access rights in efficient data storage by improved data management.The above object is achieved by a method having the features of claim 1, a computer program product having the features of claim 10, and a system having the features of claim 11. Features and details which are described in connection with the method according to the invention naturally also apply in connection with the computer program product according to the invention and / or the system according to the invention and vice versa, so that with regard to the disclosure reference is or can always be made to the individual aspects of the invention in a mutual manner.According to a first aspect of the invention, a method for data management of data of at least one mobile device is provided. The data comprise at least two data types which differ in at least one predefined property by which an authorization level of the respective data type is defined. The method comprises, in particular in the form of method steps:acquiring a data stream of the data of the device, in particular by a first control unit of the device,analyzing data segments of the data stream with regard to the predefined property, in particular by the first control unit,identifying the data segments by metadata elements for, preferably permanent, classification of the data segments for the authorization level, i.e. in particular with regard to the authorization level and / or for assigning the data segments to an authorization level, as a function of the analysis of the data segments, in particular by the first control unit,sending the data segments with the metadata elements, in particular each data segment with the respective metadata element, to a server for provision for a retrieval process for retrieving the data segments depending on the authorization level and the metadata elements, in particular by sending from the second control unit to a third control unit of the server.The mobile device can be understood in particular as a movable device, in particular which can gather the data when the device is moved and / or at different locations. The server can advantageously be part of a cloud infrastructure. Preferably, the capturing, analyzing, and labeling may be performed for multiple devices to provide the data of the devices to the server and / or a base station.When the data stream of the data is detected, a ring memory and / or a bus, in particular a CAN bus, of the device can be read out, for example. The data stream can comprise, for example, sensor signals of a sensor system of the device and / or operating data of the device. The data segments can be formed, for example, by data packets, sub-regions and / or individual signals of the data stream.The data types can be divisible on the basis of the predefined property. Thus, a first data type of the two data types may have the property and a second data type of the two data types may not have the property. In particular, personal and non-personal data can be distinguished by the property.When analyzing the data segments, a check can be carried out for each data segment whether the data segment has the property. For example, it can be checked whether a face, an identification number, e.g. in the form of a number plate and / or a vehicle identification number, is present and / or recognizable in the data segment. This allows the respective data segment to be classified into personal and non-personal data. It is conceivable that the analysis of the data segments is carried out by an artificial intelligence, in particular in the form of a neural network.When the data segments are identified by the metadata elements, each data segment can be assigned a metadata element in order to classify the respective data segment. However, it is likewise conceivable that, when characterizing the data segments, only those data segments are assigned a metadata element which have the predefined property and / or are of the first or second data type. The assignment of one of the metadata elements to one of the data segments can be effected, for example, in tabular form and / or by a logical and / or storage-side link. In particular, the metadata elements can be formed by tags and / or list entries. It is conceivable that the data segments are identified when the data segments are transmitted. The method can preferably comprise buffering the data segments with the respective metadata element in the device, in particular before the transmission of the data segments is carried out.By transmitting the data segments, the data segments can be collected with the metadata element, in particular in a decentralized manner. The data segments can preferably be sent with the metadata elements via an Internet connection and / or a direct connection. In particular, the data segments can be transmitted at regular times and / or as a function of predefined boundary conditions in order to transmit the data to the server in a collected manner. It is conceivable that, depending on the authorization level, a visibility of the data segments and / or their contents is controlled.The retrieval operation may be performed by the server to provide the data segments to a user and / or a service. In this case, depending on the authorization level, access to the data segments themselves and / or to a local copy of the data segments can be made possible.By identifying the data segments with the metadata elements, the retrieval process can be adapted depending on the metadata elements. For example, it can be recognized on the basis of the metadata elements and the authorization level whether a user is allowed to completely see the data segments. As a result, it is not necessary to separate the data segments which contain sensitive information, for example, from the remaining data segments or to create a modified copy of the data. It has thus been recognized within the scope of the present invention that the identification of the data segments with the metadata elements enables an individualization of the retrieval process and / or a selective retrieval of the data segments during the retrieval process depending on the authorization level without a separate storage of the data segments being required for each authorization level. In particular, if, in the case of a large amount of data, such as a record of sensor data of the device, personal data are only partially contained, these can be recognized and filtered and / or modified on the basis of the metadata elements during the retrieval process. This allows unauthorized access to the personal information to be selectively allowed and prevented.It is furthermore conceivable in a method according to the invention that the analysis of the data segments of the data stream takes place as a function of a predefined triggering criterion for identifying a relevant part of the data stream. The predefined triggering criterion can be, for example, a predefined driving situation. A predefined driving situation is understood within the scope of the invention to mean a combination of vehicle parameters, such as, for example, operating parameters of the vehicle and / or ambient parameters of the vehicle. Operating parameters of the vehicle can be, for example, speed, acceleration, steering angle, direction of travel, engine speed, coolant temperature, braking torque, brake temperature, wheel slip, yaw, roll, pitch or the like. Environmental parameters can include, for example, a roadway width, roadway direction, roadway condition, roadway inclination, weather, precipitation, road users, obstacles, external temperature, or the like. A driving situation can be predefined, for example, by a ball rolling on the roadway in combination with a predefined minimum vehicle speed and vehicle direction on a collision course. If the predefined triggering criterion is detected, the data segments can be further processed and, in particular, protected from being deleted from a ring memory of the device. It can be provided that a determination process of specific vehicle data is initiated only when the predefined triggering criterion is present, such as, for example, the preparation and storage of a video sequence or the like. Furthermore, vehicle data already ascertained before and / or after the detection of the predefined triggering criterion can also be further processed after the detection of the predefined triggering criterion. Thus, a particularly meaningful and / or relevant data set can be provided by the triggering criterion.Furthermore, in a method according to the invention, it is conceivable that the mobile device is a vehicle, in particular for carrying out an autonomous driving function. The vehicle can preferably be a motor vehicle, for example in the form of an electric vehicle. Furthermore, the vehicle can be designed for fully autonomous driving, in particular with an automation level 4 or 5. Furthermore, the vehicle can be operated in a fleet for executing a service, for example a so-called mobility as a service (MaaS) and / or transport as a service (TaaS). In this case, the vehicles can return at a fixed point in time, e.g. in the evening, to a central node, in particular in the form of the base station, in order to load and provide the data from the vehicle to the server. Particularly during the operation of automated vehicles, large amounts of data can arise, the data storage of which represents a relevant cost factor. At the same time, during operation of the vehicle, data relating to persons can also be randomly recorded in the middle of relevant data. The data storage can be effected efficiently by the method and at the same time access to the data can be configured in accordance with law by the possibility of the retrieval process.It can furthermore be provided that the method comprises, in particular in the form of a method step:transmitting the data segments, preferably with the metadata elements, in particular each data segment with the respective metadata element, from the device to a base station for collecting the data, in particular by a transmission from the first control unit to a second control unit of the base station,wherein the transmission of the data segments with the metadata elements is effected by the base station to the server. The data segments can be identified by the base station and / or the device. The base station can in particular represent a decentralized node at which the data of the device can be stored. In particular, the base station can be configured to collect data from a plurality of devices in order to forward the data to the server in a preferably bundled manner. For example, the base station can be designed at a charging station for charging the device with electrical energy. It can be provided that the data segments are transmitted to the base station via a wireless data connection, preferably a WLAN connection and / or a radio connection, in particular a mobile radio connection. However, it is likewise conceivable for the data segments to be transmitted to the base station via a wired connection between the device and the base station. For transmitting the data segments to the server, the base station can advantageously be connected to the server via an optical connection. The base station can form a base for a fleet of multiple vehicles, for example. The base station can reliably transmit the data to the server, in particular independently of a constant Internet connection of the vehicle. The identification of the data items is preferably carried out by the device. However, it is likewise conceivable for the labeling of the data segments to be carried out by the base station, in particular the second control unit of the base station. This makes it possible to save a required computing capacity of the device.Furthermore, in a method according to the invention, it is conceivable that the device carries out the analysis of the data segments during operation of the device in order to carry out a safety-relevant function of the device independently of the metadata elements. The safety-relevant function can be, in particular, a driving function and / or a function for cartography of objects in a direct environment of the device. For example, for analyzing the data segments, object recognition of the device for the data segments can be carried out. On the basis of object recognition, the property in a data segment can be recognized and the identification of the data segment can be established. For example, object detection in the vehicle can be used to detect whether persons are depicted in the data in order to detect person-related data segments. This allows an existing vehicle function to be used to provide results for the analysis of the data segments. This allows an additional computing effort for the method to be reduced.Preferably, in a method according to the invention, it can be provided that the data stream comprises sensor data in the form of environmental data of the device, state data of the device and / or control parameters of the device. The environmental data can preferably comprise image data, in particular in the form of data of a camera, and / or data of a lidar system and / or a radar system of the device. The control parameters may comprise control and / or regulation signals for moving the device. For example, the control parameters can be operating data of a self-driving system of the vehicle. In particular, the control parameters can be used to execute the safety-relevant function. The state data can comprise, for example, a speed, an acceleration, a driving state and / or a maintenance state of the device. Furthermore, it is conceivable that the sensor data comprise static information, such as a vehicle identification number. It is conceivable that all these data are present in the data stream and are classified by the metadata elements. Thus, the method can identify a large amount of data and / or a plurality of data types in terms of the data type and prepare them for the retrieval operation.It is furthermore conceivable in a method according to the invention that, when analyzing the data segments, a recognition process for recognizing the predefined property and a localization process for detecting a position of the predefined property are carried out in the respective data segment, in particular wherein, when characterizing the data segments, information about the predefined property and about the position is assigned to the respective metadata element, i.e. in particular each metadata element or each metadata element, in the case of which a position was recognized. It is conceivable that the object recognition for the safety-relevant function carries out the recognition process and / or the localization process. The position may include, for example, coordinate data for locating the property in the respective data segment. For example, the position may include a position in image data and / or text data. For example, a face and / or license plate may be recognized and located in an image to make it later indistinguishable. As a result, the position can thus be used in the retrieval process to modify the data segments.In the context of the invention, it is also conceivable for the server to receive the data segments with the metadata elements and to carry out the retrieval process. The server can thus be incorporated into the method. During the retrieval process, the data can be retrieved from a memory of the server, i.e. in particular made accessible and / or transmitted. In the retrieval process, it can be checked whether the person executing the retrieval process has general access rights. For this purpose, at least one authentication mechanism, e.g. in the form of a checking of a PKI card, a dongle or a token management, can be checked during the retrieval process. On the basis of this, access to the data can be denied in the event of a negative check. In the case of a positive check, it is preferably possible to test whether the authorization level is sufficient to view the data in a raw and / or unmonnymized manner.Furthermore, in a method according to the invention, it can advantageously be provided that the retrieval process is carried out with a retrieval authorisation for defining the authorisation level, in particular the retrieval process, wherein in the retrieval process a local copy of at least a part of the data segments or of all data segments is provided, in which the predefined property is respectively modified as a function of the metadata elements, i.e. in particular the respective metadata element, and the retrieval authorisation by the server, in particular in order to make the predefined property unrecognizable and / or to anonymousize the data segments. By the modification, an anonymousization of the data segments can thus take place in order to eliminate and / or make a person reference indistinguishable. The retrieval authorization can, for example, identify an authorization level of the user. Depending on the retrieval authority, direct or modified access to the data may be granted. In a modified approach, it can be established on the basis of the metadata elements for each data segment whether it is transmitted directly for the local copy or is modified by an anonymousization and / or unhearning of the data. In particular, it can be provided that the position of the property is taken into account when modifying the data segments. In this case, the data segments can be modified, for example, only at the detected position. Thus, a storage space on the server can be reduced by storing the data only once. Only during the retrieval are the data segments modified according to their metadata elements, i.e. for example anonymousized, in order to take account of the authorization level and / or the retrieval authorization.According to a further aspect of the invention, a computer program product is provided. The computer program product comprises instructions which, when executed by a control system, cause the control system to execute a method according to the invention.Thus, a computer program product according to the invention brings with it the same advantages as have already been described in detail with reference to a method according to the invention. The method can be, in particular, a computer-implemented method. The computer program product may be implemented as computer readable instruction code. Furthermore, the computer program product can be stored on a computer-readable storage medium such as a data disk, a removable drive, a volatile or non-volatile memory, or a built-in memory / processor. Furthermore, the computer program product can be provided or provided in a network such as the Internet, from which it can be downloaded by a user or executed online if required. The computer program product can be realized both by means of software and by means of one or more special electronic circuits, i.e. in hardware or in any hybrid form, i.e. by means of software components and hardware components.According to another aspect of the invention, a system is provided. The system comprises a mobile device with a first control unit. The system further comprises a control system for carrying out a method according to the invention. At least the first control unit is integrated into the control system.Thus, a system according to the invention brings with it the same advantages as have already been described in detail with reference to a method according to the invention and / or a computer program product according to the invention. It can be provided that a server, in particular for carrying out a retrieval process, is part of the system. Furthermore, the system can have a base station with a second control unit, which is integrated into the control system for carrying out the method. Preferably, the control system for carrying out the method can additionally have a third control unit which is integrated into the server. The first, second and / or third control unit can each comprise a processor and / or a microprocessor. Furthermore, at least the first control unit can be at least partially or completely integrated into a central control device of the device. However, it is likewise conceivable for at least the first control unit to be at least partially or completely integrated into one or more decentralized control units of the apparatus. It is further conceivable that the system comprises a plurality of mobile devices, the data of which are collected by the base station.Further advantages, features and details of the invention will become apparent from the following description, in which exemplary embodiments of the invention are described in detail with reference to the drawings. The features mentioned in the claims and in the description can be essential to the invention individually or in any combination. They show schematically: FIG. 1 shows a system according to the invention for carrying out a method according to the invention, FIG. 2 shows a data stream of a device of the system having a plurality of data segments, FIG. 3 shows a data segment when carrying out the method, and FIG. 4 shows a sequence of the method.In the following description of some exemplary embodiments of the invention, the identical reference numerals are used for the same technical features even in different exemplary embodiments.FIG. 1 shows a system 4 according to the invention with a mobile device 1 in a first exemplary embodiment. Furthermore, the system 4 comprises a base station 2 for collecting the data 200 from the device 1 and a server 3. the mobile device 1 has a first control unit 11, the base station 2 has a second control unit 12 and the server 3 has a third control unit 13. The first control unit 11, the second control unit 12 and the third control unit 13 form a control system 10 for executing a method 100 according to the invention for data management of data 200 of the at least one mobile device 1. A sequence of the method 100 is shown schematically in FIG. 4.The device 1 is in particular a vehicle for carrying out an autonomous driving function. For example, the vehicle may be part of a fleet of vehicles having a plurality of vehicles. The base station 2 constitutes a node for collecting the data 200 of the vehicles to provide the data 200 to the server 3 in a collected manner. For this purpose, the base station 2 can be integrated, for example, into a charging station for charging the vehicles. The data 200 comprises at least two data types 201, 202 which differ in at least one predefined property 203. The property 203 furthermore defines an authorization level of the respective data type 201, 202. The property 203 can be, for example, a person-related property 203. For example, the two types of data 201, 202 can divide the data 200 into personal data segments 210 and non-personal data segments 210 by identifying a number plate, as shown in FIG. 3, or faces of passersby.In method 100, a data stream 200.1 of data 200 of device 1 is acquired 101. Data stream 200.1 may be part of a bus communication of device 1, for example. As shown in FIG. 2, the data stream 200.1 preferably comprises a plurality of data segments 210 with sensor data 200.2 in the form of environmental data of the device 1, state data 200.3 of the device 1 and / or control parameters 200.4 of the device 1. For example, the sensor data 200.2 can be acquired during autonomous driving of the vehicle. The data segments 210 can be data units of the data stream 200.1.An analysis 102 of data segments 210 of the data stream 200.1 is then carried out with regard to the predefined property 203. For example, FIG. 3 shows a data segment 210 in the form of an image of environment data of the device 1. Preferably, the analyzing 102 of the data segments 210 of the data stream 200.1 can take place depending on a predefined triggering criterion 204 for identifying a relevant part of the data stream 200.1. For example, the triggering criterion 204 may be defined by a predetermined event, such as a predefined deceleration of the vehicle. This can provide that only those data segments 210 are analyzed which are associated with the event.Furthermore, during the analysis 102 of the data segments 210, a recognition process for recognizing the predefined property 203 and a localization process for detecting a position 213 of the predefined property 203 in the respective data segment 210 take place. Position 213 may be characterized, for example, by coordinates within data segment 210. As shown in FIG. 3, the entire data segment 210 is not person-related here, but only the number plate of the road user driving ahead. This can be detected by the position 213 and marked by information for the further processing of the data segment 210.In order to make the property 203 recognizable during the later processing of the data segments 210, the data segments 210 are identified 103 by metadata elements 211 for classifying the respective authorization level as a function of the analysis 102 of the respective data segment 210. The metadata element 211 can preferably be a so-called tag, which is assigned to the data segment 210, for example in the form of text. Preferably, when identifying 103 the data segments 210, the respective metadata element 211 is assigned information about the predefined property 203 and about the position 213. Advantageously, the device 1 carries out the analysis 102 of the data segments 210 during the operation of the device 1 in order to carry out a safety-relevant function of the device 1 independently of the respective metadata element 211. For example, a driving function of the vehicle can be activated on the basis of the data segment 210 shown in FIG. 3.Before and / or after the labeling 103 of the data segments 210, the data segments 210 are preferably transmitted 104 with the metadata elements 211 from the device 1 to the base station 2 for collecting the data 200. The base station 2 then sends 105 the data segments 210 with the metadata elements 211 to the server 3, which receives the data segments 210 and provides them for a retrieval process 106 for retrieving the data segments 210 depending on the authorization level and the metadata elements 211.The retrieval process 106 can then be started, in particular depending on a user-controlled and / or service-controlled retrieval, so that the retrieval process 106 is carried out. In this case, the retrieval process 106 is carried out in particular with a retrieval authorization for defining the authorization level. Depending on the retrieval authorization and the metadata elements 211, a local copy 212 of at least a part of the data segments 210 of a first data type 201 having the property is furthermore provided in the retrieval process 106. In the local copy 212, the predefined property 203 for each copied data segment 210 is respectively modified depending on the metadata element 211 and the retrieval authorization by the server 3. When modifying the data segments 210, the predefined property 203 may be made indistinguishable, e.g., by inserting a blur at the location 213. Data segments 210 of second data type 202 may be provided unmodified.It is therefore not necessary to keep the data 200 available on the server 3 multiple times for different authorization levels. Rather, it is only during the retrieval process 106 that it is possible to determine, on the basis of the metadata elements 211, whether the data segments 210 are processed and / or visualized with or without modification.The foregoing explanation of the embodiments describes the present invention solely by way of examples. Of course, individual features of the embodiments can be freely combined with one another within the scope defined by the patent claims, insofar as technically expedient, without departing from the scope of the present invention.List of reference characters1 Device 2 Base station 3 Server 4 System 10 Control system 11 First control unit 12 Second control unit 13 Third control unit 100 Method 101 Detection 102 Analysis 103 Identification 104 Transmission 105 Transmission 106 Retrieval process 200 Data 200.1 Data stream 200.2 Sensor data 200.3 State data 200.4 Control parameter 201 Data type 202 Data type 203 Property 204 Triggering criterion 210 Data segments 211 Metadata element 212 Copy 213 Position

Claims

Method (100) for data management of data (200) of at least one mobile device (1) having at least two data types (201, 202) differing in at least one predefined property (203) by which an authorisation level of the respective data type (201, 202) is defined, wherein the method (100) comprises: - acquiring (101) a data stream (200.1) of the data (200) of the device (1), - analysing (102) data segments (210) of the data stream (200.1) with respect to the predefined property (203), - identifying (103) the data segments (210) by metadata elements (211) for classifying the data segments (210) for the authorisation level depending on the analysing (102) of the data segments (210), sending (105) the data segments (210) with the metadata elements (211) to a server (3) for provision for a retrieval process (106) for retrieving the data segments (210) depending on the authorization level and the metadata elements (211).Method (100) according to claim 1, characterized in that the analyzing (102) of the data segments (210) of the data stream (200.1) is performed depending on a predefined triggering criterion (204) for identifying a relevant part of the data stream (200.1).Method (100) according to claim 1 or 2, characterized in that the mobile device (1) is a vehicle for performing an autonomous driving function.Method (100) according to one of the preceding claims, characterized in that the method (100) comprises: - transmitting (104) the data segments (210) with the metadata elements (211) from the apparatus (1) to a base station (2) for collecting the data (200), wherein the transmission (105) of the data segments (210) with the metadata elements (211) is effected by the base station (2) to the server (3).Method (100) according to one of the preceding claims, characterized in that, when the device (1) is operated, the device (1) carries out the analysis (102) of the data segments (210) in order to carry out a safety-relevant function of the device (1) independently of the metadata elements (211).Method (100) according to one of the preceding claims, characterized in that the data stream (200.1) comprises sensor data (200.2) in the form of environmental data of the device (1), state data (200.3) of the device (1) and / or control parameters (200.4) of the device (1).Method (100) according to one of the preceding claims, characterized in that, during the analysis (102) of the data segments (210), a recognition process for recognizing the predefined property (203) and a localization process for detecting a position (213) of the predefined property (203) in the respective data segment (210) are carried out, wherein, during the labeling (103) of the data segments (210), information about the predefined property (203) and about the position (213) is assigned to the respective metadata element (211).Method (100) according to one of the preceding claims, characterized in that the server (3) receives the data segments (210) with the metadata elements (211) and carries out the retrieval process (106).Method (100) according to one of the preceding claims, characterized in that the retrieval process (106) is carried out with a retrieval authorisation for defining the authorisation level of the retrieval process (106), wherein in the retrieval process (106) a local copy (212) of at least part of the data segments (210) is provided, in which the predefined property (203) is respectively modified by the server (3) as a function of the metadata elements (211) and the retrieval authorisation in order to make the predefined property (203) indistinguishable.A computer program product comprising instructions which, when executed by a control system (10), cause the control system (10) to perform a method (100) according to any preceding claim.System (4) comprising a mobile device (1) with a first control unit (11) and a control system (10) for carrying out a method (100) according to one of claims 1 to 9, in which at least the first control unit (11) is integrated.

Images