Self-configuring recording device for image data of imaging sensor device

Abstract

To provide a recording device to simplify the configuration of a deserializer built into a recording device for serialized image data streams.SOLUTION: A recording device 2 comprises a first deserializer 9 for deserializing an image data stream and a configuration device 28 for configuring a first deserializer. In order to configure a second serializer 18 arranged in a sensor device 4, the configuration device records a configuration data stream transmitted by a receiving device 6, derives a configuration of the first deserializer by an analysis of the recording, specifies the configuration of the first deserializer, creates a deserializer configuration data stream 30 suitable for the first deserializer, and uses it to configure the first deserializer 9.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a data logger for recording image data of an imaging sensor. Such data loggers have recently become important in the automotive industry. In the context of increasing automation, vehicles are equipped with imaging sensor devices, such as camera, radar, LiDAR or ultrasonic sensors, as well as control devices for evaluating the image data generated by the aforementioned sensors. These control devices usually play a safety-critical role and can autonomously intervene in the control of the vehicle if necessary (automation level 2) or even take over control completely, at least temporarily (automation levels 3, 4 or 5). Therefore, these control devices require extensive evaluation before their practical use. [Background technology]

[0002] For this purpose, it is known in the prior art to record image data generated by the sensor device during a test drive of a test vehicle equipped with an imaging sensor device in a recording device, i.e. a data logger, so that the recorded image data can be used later to develop a computer algorithm that is configured in a control device to read in the image data, use the image data and drive the automated vehicle on the basis of the image data. For example, the recorded images can be used for a trial simulation of an algorithm, so that it can be checked whether the algorithm correctly estimates the traffic situation recorded in the image data and generates control commands that are suitable for the traffic situation. The image data can also be used for training or testing a neural network, which is configured to create an object list for the algorithm of objects that are identifiable in the image data. The image data can also be converted into a synthetic scenario that simulates the traffic situation shown in the image data as a computer simulation in order to test the algorithm or the control device safely in a virtual environment (software in the loop or hardware in the loop).

[0003] The transmission of image data from the sensor device to a receiving device, for example a control device, configured for processing the sensor data, is generally performed in serialized form. For this purpose, the sensor device contains a serializer, which converts the continuously arriving raw image data generated by the sensor device into a serial data stream and forwards this serial data stream to the receiving device via a data connection. The receiving device contains a deserializer, which receives the image data stream from the data connection, deserializes it and forwards the deserialized image data stream to downstream components of the receiving device, for example a processor unit for processing the image data. The main suppliers of serializers and deserializers suitable for this are Texas Instruments with their product series "FPD-Link" and Maxim Integrated with their product series "Gigabit Multimedia Serial Link" (GMSL).

[0004] A recording device configured for recording the image data stream, for example the above-mentioned data logger, can be configured as a "man-in-the-middle". Such a recording device is arranged between the sensor device and the receiving device so that it first records the image data stream on behalf of the receiving device, stores the recording of the image data stream in a storage device, and finally forwards the image data stream to the receiving device. In so doing, the recording device does not recognize itself to both communication partners, but instead appears to both as a direct communication with the respective configured communication partner, i.e. the sensor device or the receiving device. Alternatively, the recording device can be configured to record a copy of the image data stream from the signal splitter.

[0005] In both cases, the recording device needs its own deserializer to deserialize the intercepted image data stream before recording it and, in the man-in-the-middle embodiment, also needs its own serializer to serialize the image data stream back before forwarding it to the receiving device. After starting up, a configuration data stream is transmitted by the receiving device to configure the serializer in the sensor device. The recording device can intercept or sniff this configuration data stream and directly use it to configure its own serializer. However, the configuration of the deserializer built into the recording device is more complicated. The deserializer must reconstruct the image data stream serialized by the sensor device by its configuration, i.e. it must undo the serialization made by the sensor device, in order to put the image data transmitted by the image data stream into a readable and interpretable form. If the recording device is provided with its own serializer, the image data stream must also be identical to the image data stream output by the sensor device after passing through the serializer. The correct configuration of the deserializer to cause this can certainly be derived from the configuration data stream, but according to the prior art, this derivation is a cumbersome manual service that presupposes a high level of expertise and is time-consuming and costly. Summary of the Invention [Problem to be solved by the invention]

[0006] It is an object of the present invention to facilitate the configuration of a recording device for serialized image data streams, in particular of a deserializer integrated in the recording device. [Means for solving the problem]

[0007] For this purpose, according to the invention, a recording device is proposed for recording the serialized image data stream flowing from the sensor device to the receiving device. By sensor device, any sensor system configured to generate image data from which information about the spatial arrangement of objects in the surroundings of the sensor system can be reconstructed. The sensor device can be, for example, a radar system, a LiDAR system, a camera, a thermal imaging camera or a sonar system. By receiving device, any technical device for receiving image data output from the sensor system, for example a control device configured to generate control commands based on the image data, is understood.

[0008] The recording device includes a first data interface configured to establish a first data connection between the first data interface and the sensor device for transmitting the image data stream to the first data interface. The recording device further includes a first deserializer configured to deserialize the image data stream received at the first data interface, and the recording device further includes a storage device configured to record the image data stream deserialized by the first deserializer and store image data from the image data stream on a storage medium. In a preferred embodiment, the recording device includes a second data interface configured to establish a second data connection between the second data interface and the receiving device for transmitting the image data stream to the receiving device, and a first serializer configured to serialize the image data stream back after recording it with the storage device and output the serialized image data stream through the second data interface. The first serializer includes a plurality of input pins for receiving image data.

[0009] The recording device further comprises a configuration device, which is adapted to record a configuration data stream transmitted by the receiving device via the second data connection to the second data interface, the configuration data stream being adapted for configuring a second serializer originally arranged in the sensor device. The second serializer is arranged in the sensor device for serializing an image data stream output by the sensor and for supplying the serialized image data stream to the first data connection. The configuration device analyses the configuration data transmitted by the configuration data stream and, based on this analysis, determines the processing of the serialized image data stream by the second serializer. Based on information about the processing of the image data stream obtained by this analysis, the recording device finally determines the configuration of the first deserializer. This configuration of the first deserializer is performed in such a way that the image data stream output by the sensor is reconstructed by the deserializer configured according to said configuration, in other words the serialization of the image data stream performed by the second serializer is restored. The configuration device is further adapted, after determining the configuration of the first deserializer, to configure the first deserializer exactly according to this configuration.

[0010] If the recording device includes a second serializer for recording the image data stream by the storage device and then serializing it back and outputting it through the second data interface, the configuration device can specify, based on the analysis, for the first serializer how the image data stream should be processed and distributed to the input pins of the first serializer, where the configuration device configures the first deserializer such that the configuration sets the first deserializer to process and distribute the image data stream to the input pins of the first serializer as specified in the analysis.

[0011] The configuration of the serializers and deserializers, and in particular the first serializer and the first deserializer, is typically done using writeable registers in the serializer or deserializer, and the determined register configuration results in a particular technical functionality and way of behavior of the serializer or deserializer.

[0012] It is already known from the patent document DE 10 2019 132 476 A1 to automate the configuration of a serializer by reading configuration data from a configuration data stream that is originally intended for configuring a serializer of a certain model series and converting it into a technically identically functioning configuration of another serializer of another model series. The essential difference between the present invention and this prior art is the derivation from the configuration data stream for configuring the serializer of the configuration of the deserializer that is downstream of the newly configured serializer and which must be supplied with a correctly deserialized image data stream.

[0013] Preferably, the first serializer in the recording device and the second serializer in the sensor device belong to the same model series and are therefore identical in terms of their technical equipment and configuration. This is understood in particular to mean that all possible configurations of the second serializer are identically transferable to the first serializer and that the first and second serializers behave identically from a technical point of view if both are configured identically. For this purpose, the first serializer can be arranged on an exchangeable board, so that for each sensor device, a separate board can be installed in the recording device, on which a first serializer individually selected for each sensor device is arranged, where this first serializer belongs to the same model series as the second serializer installed in the respective sensor device. This embodiment is advantageous in that the recorded configuration data stream, which is originally configured for the configuration of the second serializer of the sensor device, can be directly used for the configuration of the first serializer. However, one disadvantage is the increased production costs caused by installing a separate first serializer for each sensor device.

[0014] Alternatively, the first and second serializers may belong to different model series. In this embodiment, the method described in DE 10 2019 132 476 A1 already cited above can be applied, whereby the configuration of the second serializer, which is predefined by the configuration data, can be transferred to the technically identically functional configuration of the first serializer and the second serializer can be configured according to the technically identically functional configuration. This embodiment is applicable if the main data channel of the first serializer, which is provided for transmitting payload data, i.e. in particular image data, to the receiving device, is compatible with the receiving device. If this is the case, this embodiment dispenses with the incorporation of an individually selected serializer, which further reduces the manufacturing costs of the recording device.

[0015] Preferably, the recording device is configured to intercept the configuration data stream, so that the configuration data stream intended for configuring the second serializer in the sensor device does not reach the sensor device, and the receiving device configures the first serializer instead of the second serializer with the configuration data stream. The receiving device can be configured to repeat the configuration process of the second serializer after a configuration attempt has failed, for example due to no confirmation signal being returned from the second serializer. The recording device is therefore particularly preferably configured to intercept the configuration data streams repeatedly transmitted by the receiving device, in particular all transmitted configuration data streams, until the configuration of the first deserializer is finished and thus the recording device is ready for use.

[0016] For the entire system consisting of the sensor device, the recording device and the receiving device to be ready for use, it must of course be ensured that the second serializer device in the sensor device is also configured in the end. The recording device is therefore preferably configured to transfer a configuration data stream repeatedly transmitted by the receiving device after the configuration of the first deserializer to the sensor device in order to configure the second serializer. Alternatively, the recording device may be configured to autonomously transmit a record of the configuration data to the sensor device via the first data connection after the configuration of the first deserializer has been completed, instead of waiting for a new configuration data stream from the receiving device. Furthermore, the recording device is preferably configured to receive in the first data interface and to transfer to the receiving device a confirmation signal transmitted by the sensor device after the configuration of the second serializer for confirming that the sensor device is ready for use.

[0017] The receiving device typically incorporates a second deserializer for deserializing the image data stream transmitted via the second data connection. The second deserializer may include an interface that can be read by means of the second data connection in order to read the existing configuration of the second deserializer. Knowledge of the current configuration of the second deserializer may be useful or even necessary for determining the configuration of the first deserializer. Advantageously, therefore, the configuration device is configured to read the existing configuration of the second deserializer via the second data connection for the analysis of the configuration data and to take it into account when determining the configuration of the first deserializer.

[0018] Besides the configuration of the second deserializer, there is other data, the evaluation of which by the configuration device is advantageous for determining the configuration of the first deserializer. For this purpose, the configuration device can be configured to take into account a netlist describing the data connections of the input pins of the first serializer for receiving image data and a number of internal data lines of the recording device for transmitting image data to the input pins. After the configuration device has determined how the image data stream should be distributed to the input pins of the first serializer, this configuration device can determine, based on the netlist, how the internal data lines of the recording device are connected to these input pins, and based on this information, the configuration of the first deserializer is configured such that the formatted image data is distributed by the first deserializer corresponding to the internal data lines so that the image data arrives at the input pins of the first serializer corresponding to the determined distribution.

[0019] In particular, if the recording device incorporates an individual first serializer belonging to the same model series as the second serializer, the netlist is important information, since in this embodiment the internal data lines of the recording device are indeed known in advance, but the image data input pins of the first serializer are not. The exchangeable board on which the first serializer is mounted must in this embodiment include an interface that connects the input pins, or the electrical data lines of the board that lead to the input pins, with the internal data lines of the recording device. This interface is, of course, as individual as the first serializer itself, and only on the basis of the associated netlist describing the respective interface can the configuration device determine which internal data lines lead to which input pins of the first serializer.

[0020] Preferably, the configuration device is further configured to consult a first abstraction mapping to identify the configuration of the first deserializer. The first abstraction mapping is a mapping that maps possible configurations of the first serializer (or of the second serializer, since they are interchangeable and the configuration data stream is applicable to both serializers, it is insignificant from a technical point of view whether the abstraction mapping is formally mapped to the first or the second serializer) to the technical functionality of the first serializer. The functionality of a component is understood to be a set of technical functions for which the respective component is configured to perform these technical functions. In other words, i.e. the first abstraction mapping contains, for each of the concrete configurations of the first serializer, a detailed description of the technical behavior of the first serializer resulting from each configuration. Advantageously, the first abstraction mapping is fully configured, i.e. the first abstraction mapping is configured in such a way that it maps a technical functionality to every possible configuration of the first serializer. The first abstraction mapping can be configured as a list of subconfigurations, which associate a technical function or functions with each subconfiguration, such that a specific configuration of the first serializer is obtained as a sum of the subconfigurations and the functionality associated with the specific configuration is obtained as a sum of the functions associated with each subconfiguration. A subconfiguration is understood to be a possible configuration of registers, which in one possible embodiment is a subset of all registers provided for the configuration of the first serializer.

[0021] In this embodiment, the configuration device is configured to determine the functionality of the first serializer by applying a first abstraction mapping to the configuration of the first serializer. Subsequently, a compatibility mapping is consulted by the configuration device, which maps each one of the functionality of the first deserializer to each possible functionality of the first serializer. The compatibility mapping is also preferably complete, i.e. maps each one of the functionality of the first deserializer to every possible functionality of the first serializer. Each of the functionalities of the first deserializer, which are mapped by the compatibility mapping, is configured such that the first deserializer implementing the respective functionality processes the image data stream and distributes it to the internal data lines of the recording device, so that the functionality determined by the first abstraction mapping can be performed by the first serializer as configured. The configuration device applies the compatibility mapping to the determined functionality of the first serializer in order to determine the functionality of the first deserializer. Depending on the embodiment of the invention, this determination of the functionality of the first deserializer can be performed directly, indirectly, or directly and indirectly.

[0022] After identifying the functionality of the first deserializer, a first instantiation mapping is consulted by the configuration device, the first instantiation mapping mapping a respective one of the configurations of the first deserializer to the functionality of the first deserializer. The configuration device applies the first instantiation mapping to the identified functionality of the first deserializer, thereby identifying a configuration of the first deserializer, and configuring the first deserializer corresponding to the identified configuration.

[0023] In one embodiment of the present invention, the compatibility mapping is configured as a functionality mapping, whereby a respective one of the functionalities of the first deserializer corresponds directly to a possible functionality of the first serializer.

[0024] In another embodiment, the compatibility mapping may include a second abstraction mapping and a second concrete mapping. The second abstraction mapping maps a respective one of the specifications of the image data stream to the possible functionality of the first serializer. The image data stream specification is understood here as a user-close description of the technical embodiment of the image data and the image data stream, which does not, however, contain any specific information about the technical means or measures for processing the image data or for routing the image data stream in order to process the image data and the image data stream in accordance with this description. The image data stream specification may, for example, directly or indirectly specify the source address and the destination address, but it cannot specify information about through which internal port or data connection the image data should be led in order to transmit the image data from the source address to the destination address. The image data stream specification may, for example, specify characteristic quantities for the image data and / or the image data stream, such as the transmission frequency or format, which are understandable to a person skilled in the art, but it cannot specify information about the settings to be made in order to set the image data according to the specification. The second instantiation mapping maps a respective one of the functionality of the first deserializer to a possible specification of the image data, each of the functionality mapped by the second instantiation mapping being configured to cause the first deserializer to process the image data and distribute it to the internal data lines of the recording device such that the image data stream output from the first deserializer meets the specified specification of the image data stream, and each of the functionality mapped by the second instantiation mapping is further configured to cause the first deserializer to record and process the image data stream meeting the specified specification in accordance with the specified functionality.

[0025] In summary, in an advantageous embodiment, the recording device is configured to convert the configuration of the first serializer, pre-set by the configuration data stream, into a more abstract and closer to the user technical description of the functionality of the first serializer using at least one special abstraction mapping, subsequently read a technical description of the functionality of the first deserializer, located at a similar abstraction level, from the at least one special compatibility mapping, which configures the first deserializer, process and distribute the image data stream to the input pins of the first serializer so that the first serializer can execute its technical functionality as configured, and finally convert the technical functionality of the first deserializer into the configuration of the first deserializer using the special instantiation mapping.

[0026] In the OSI reference model (Open Systems Interconnection model) this means that the first abstraction mapping converts a concrete configuration, in particular a register setting, into a technical description of a concrete configuration at a higher layer, in particular one or more of layers 2 to 5. The second abstraction mapping converts the technical description from the first abstraction mapping into another technical description at an even higher, closer to the user layer, in particular one or both of layers 6 and 7. The second instantiation mapping converts the technical description obtained from the second abstraction mapping into a list of technical functions of the first deserializer. This list of technical functions is a technical description of the functionality of the first deserializer, which functionality is again classified in the OSI reference model into at least one of the layers that are lower and closer to the hardware, in particular one or more of layers 2 to 5. The first instantiation mapping instantiates the existing information about the functionality of the first deserializer into a concrete configuration, in particular a register setting, of the first deserializer.

[0027] The invention will now be described in more detail with reference to the figures, in which: These figures and their following description generally illustrate exemplary embodiments of the invention. [Brief description of the drawings]

[0028] [Figure 1] FIG. 1 shows a typical arrangement with a sensor device, a recording device and a receiving device according to the invention. [Diagram 2] FIG. 11 is a diagram illustrating derivation of a configuration of a first deserializer in the first embodiment. [Diagram 3] FIG. 11 is a diagram illustrating derivation of a configuration of a first deserializer in the second embodiment. [Figure 4] FIG. 13 is a diagram illustrating derivation of a configuration of a first deserializer in the third embodiment. [Diagram 5] FIG. 2 illustrates an exemplary netlist. [Figure 6] FIG. 2 is a diagram showing the time flow of a configuration process according to the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0029] 1 shows a recording device 2 with a first data interface 8, a second data interface 10, a first serializer 11 and a first deserializer 9. A first data connection 12 adjacent to the first data interface 8 connects the recording device 2 to a sensor device 4, and a second data connection 14 adjacent to the second data interface 10 connects the recording device 2 to a receiving device 6. The sensor device 4 is an imaging sensor device and may be configured, for example, as a camera, an infrared camera, a LiDAR (Light Detection and Ranging) or a RADAR (Radio Detection and Ranging).

[0030] The sensor device 4 includes imaging optics 16, e.g. camera optics, for imaging the electromagnetic field into an image plane, and a sensor 20 arranged at the image plane for reconstructing a digitally coded image of the surroundings of the sensor device 4 from the electromagnetic field. The sensor 20 is arranged to convert the electromagnetic field into successive image data frames, each of which is a snapshot of the surroundings of the sensor device, and to successively transmit the image data frames as an image data stream 22 via an internal data line of the sensor device 4. The image data stream 22 is shown as a solid arrow throughout Fig. 1. A second serializer 18 is arranged in the sensor device 4 to record, serialize and output the serialized image data stream 22 to the first data connection 12.

[0031] A second deserializer 24 is arranged in the receiving device 6 for receiving the image data stream 22 from the second data connection 14, deserializing it and forwarding the deserialized image data stream 22 via internal data lines of the receiving device 6 to a processor unit 26 of the receiving device 6. The receiving device 6 can for example be configured as a control device, the processor unit 26 being configured with perception routines for identifying and classifying objects in the image data stream 22 and further with decision routines for generating control instructions based on the classified objects.

[0032] The recording device 2 is arranged between the sensor device 4 and the receiving device 6 in order to record the image data stream 22 output by the sensor device 4. In order to ensure the correct functioning of both the sensor device 4 and the receiving device 6, the recording device 2 is configured as man-in-the-middle. This means that the recording device 2 is not itself visible to the sensor device 4 or to the receiving device 6, even though all data exchanged between the sensor device 4 and the receiving device 6 flows through the recording device 2. In normal operation, the recording device 2 appears to the receiving device 6 as being in direct communication with the sensor device 4, and the recording device 2 appears to the sensor device 4 as being in direct communication with the receiving device 6. From the point of view of the sensor device 4 and the receiving device 6, the first data connection 12 and the second data connection 14 are just one direct data connection.

[0033] The first deserializer 9 is arranged and configured to receive the serialized image data stream 22 from the first data interface 8, deserialize it and forward the deserialized image data stream 22 to the first serializer 11 via internal data lines L1, ..., L10 of the recording device 2. The recording device 2 includes a storage device 5 configured to record the data stream deserialized by the first deserializer 9 and to store the recording of the image data stream 22 on a data carrier 7 inserted in a drive of the recording device.

[0034] The first serializer 11 is arranged and configured to receive the image data stream 22, which has been deserialized and recorded by the storage device 5, from the first deserializer 9, serialize it back and output it via the second data interface 10 and direct it to the second data connection 14.

[0035] The serializer and deserializer are normally configurable in their technical functionality by register settings. In normal mode, i.e. when the sensor device 4 and the receiving device 6 communicate with each other directly without the presence of the recording device 2, the second deserializer 24 is configured by the receiving device 6 during start-up and a configuration data stream 23 is sent to configure the second serializer 18 in the sensor device 4. The configuration data stream for configuring the serialization or deserialization is indicated by dashed arrows throughout Fig. 1.

[0036] The configuration data stream 23 defines the configuration or register settings of the second serializer 18, and the sensor device 4 is configured to receive the configuration data stream 23 and configure the second serializer 18 according to the settings in the configuration data stream. The configuration data stream 23 can be generated by the second deserializer 24 itself or by another component of the receiving device 6. Similarly, on the side of the sensor device 4, the second serializer 18 can receive the configuration data stream 23 itself and configure itself according to its settings, or can receive the configuration data stream 23 and configure the second serializer 18 by another component of the sensor device 4.

[0037] The first serializer 11 belongs to the same model series as the second serializer 18, i.e. they are identical in terms of their technical equipment and their technical design and are interchangeable with each other. Therefore, the configuration data stream 23 can be directly used to configure the first serializer 11, and the recording device 2 is configured to intercept the configuration data stream 23 originally intended for the second serializer 18 and use the configuration data stream 23 to configure the first serializer 11.

[0038] The technical functionality of the first serializer 11 therefore corresponds exactly to the provided technical functionality of the second serializer 18, since both serializers are of the same construction and the first serializer 11 is configured by the configuration data stream 23 configured for the second serializer 18. The first deserializer 9 must be configured to process the image data stream 22 provided by the sensor device 4 and distribute it to the internal data lines of the recording device 2 or to the input pins of the first serializer 11, so that the first serializer 11 can perform as configured its technical functionality, previously set by the configuration data stream 23. Finally, the first deserializer must be configured to deserialize the image data stream 22 performed by the second serializer 18 and reconstruct the image data stream output by the sensor 20. Unlike the configuration of the first serializer 11, this configuration of the first deserializer 9 cannot be performed directly, since the receiving device 6 does not provide it with a suitable configuration data stream for this.

[0039] To determine and perform such a configuration of the first deserializer 9, the recording device 2 includes a configuration device 28 configured to record the configuration data stream 23 and to analyze the recording of the configuration data. (If the configuration data stream 23 is converted into another configuration data stream according to the teachings of DE 102019132476 A1, the configuration device 28 now records the converted configuration data stream.) Using the information obtained as a result of the analysis, the configuration device 28 determines a configuration of the first deserializer 9, whereby the configuration device 28 configures the first deserializer 9 to distribute image data from the image data stream to the input pins of the first serializer 11 in a formatted manner expected by the configured first serializer 11. After the determination is completed, the configuration device 28 creates a deserializer configuration data stream 30 suitable for configuring the first deserializer 9 as determined in the analysis and configures the first deserializer 9 with the deserializer configuration data stream 30.

[0040] 1, the configuration device 28 is shown as an integrated component of the recording device 2, the configuration device 28 may likewise be arranged outside the recording device 2 as a virtual component, for example in the form of software stored in a personal computer (PC). The transmission of the configuration data stream 23 and the deserializer configuration data stream 30 can in this case take place via a suitable data interface, for example a USB cable, or a wireless data connection, WLAN or Bluetooth, etc. The configuration device 28 may also be configured in the form of a server contactable via the Internet, whereby the entire configuration process proceeds in the form of a firmware update of the recording device 2.

[0041] In Figures 2 to 4, the steps performed by the configuration device 28 for deriving the configuration of the first deserializer 9 are described in the form of a flow chart. In each of the three Figures 2 to 4, one of three possible embodiments of the automatic derivation of the configuration of the first deserializer 9 by the configuration device 28 is shown. The steps related to the first serializer 11 are respectively arranged under the heading "SER" on the left side of the figure. The steps related to the first deserializer 9 are respectively arranged under the heading "DES" on the right side of the figure.

[0042] As shown in Fig. 2, the first step is to determine a specific configuration of the first serializer 11. Assuming that the configuration of the first serializer 11 is determined by the register settings of the first serializer 11, the specific configuration corresponds to a specific register setting 40 of the first serializer 11. As already explained in the description of Fig. 1, the receiving device directly provides the register setting 40 of the first serializer 11 in the form of the configuration data stream 23, and the configuration device 28 directly reads the register setting 40 from the record of the configuration data stream 23.

[0043] In a second step, the configuration device 28 consults the first abstraction mapping 42, whereby a functionality 44 of the first serializer 11 is derived from the register settings 40 of the first serializer 11 based on the first abstraction mapping 42. The first abstraction mapping 42 is essentially a table-like list that contrasts the register settings of the first serializer 11 with the technical functionality of the first serializer 11 and is sufficiently comprehensive so that for every possible register setting of the first serializer 11, the resulting functionality of the first serializer can be read out from the respective register setting. Advantageously, the first abstraction mapping 42 lists individual register settings or sub-register settings, i.e. settings of small groups of registers, and maps each individual register setting and / or each sub-register setting to a function or sub-functionality of the first serializer 11, so that the functionality 44 of the first serializer 11 is obtained as a whole of functions and / or sub-functionalities.

[0044] The functionality 44 of the first serializer 11 is a list of the technical features of the first serializer 11, which is derived from the register settings 40 of the first serializer, but which is not related to the model or model series of the first serializer 11, and in particular is no longer related to a specific sub-configuration of the first serializer 11.

[0045] After deriving the functionality 44 of the first serializer 11, the configuration device 28 consults the first compatibility mapping 46 in order to derive a functionality 48 of the first deserializer from the functionality 44 of the first serializer 11 based on the first compatibility mapping 46. The compatibility mapping is a mapping that maps the functions and / or sub-functionalities of the first deserializer 9 to possible functions and / or sub-functionalities of the first serializer 11 that the first deserializer 9 must have in order, on the one hand, to make available to the storage device 5 a valid and interpretable image data stream 22 corresponding to the image data stream 22 output by the sensor 20, and, on the other hand, to be able to properly execute the respective function or sub-functionality by the first deserializer 9.

[0046] As an optional embodiment of the functionality 44 of the first serializer 11, the order in which the image data is output in the serialized image data stream is preset by the first serializer 11 or the second serializer 18. Naturally, the first deserializer must pay attention to this order in order to reconstruct a valid and readable stream of image data frames from the image data stream provided via the first data connection 12. According to the order preset by the configuration data stream 23, the configuration device 28 determines the configuration of the first deserializer 9, which then configures the first deserializer 9 to return the serialization of the image data stream 22 in exactly this order, so that the original image data frames are reconstructed from the serialized image data stream 22 as they were output by the sensor 20.

[0047] The first compatibility mapping 46 is configured as a functionality mapping, i.e. as a table-like mapping directly mapping the features and / or sub-functionalities and / or functionality 44 of the first serializer to the features and / or sub-functionalities and / or functionality of the first deserializer, such that the functionality 48 of the first deserializer can be directly derived from the functionality 44 of the first serializer 11 using the first compatibility mapping 46. The functionality 48 of the first deserializer 9 is described at the same abstraction level as the functionality 44 of the first serializer 11, i.e. the functionality 48 of the first deserializer 9 includes a list of technical features and / or sub-functionalities, regardless of a particular deserializer model series, a particular deserializer model or a concrete sub-configuration of the first deserializer 9.

[0048] The configuration device 28 finally derives a concrete configuration of the first deserializer 9, i.e. concrete register settings 52, from the functionality 48 of the first deserializer 9, and for this consults the first instantiation mapping 50. The first instantiation mapping 50 is similar in content to the first abstraction mapping 42, i.e. it associates in table form the registers and / or sub-register settings of the first deserializer 9 with the functions and / or sub-functionalities of the first deserializer 9, but in the reverse order, used by the configuration device 28. After the register settings 52 have been determined, the configuration device 28 creates the deserializer configuration 30, and configures the first deserializer 9 with the deserializer configuration data stream 30, such that the registers of the first deserializer 9 are set according to the determined register settings 52 of the first deserializer.

[0049] If the second deserializer 24 supports this feature, the configuration device 28 reads the configuration 55 of the second deserializer 24 via the second data connection 14 and takes the configuration 55 of the second deserializer 24 into account when determining the register settings 52 of the first deserializer 9. Since the first deserializer 9 and the second deserializer 24 process the serialized image data stream 22 in a similar manner, there is a high probability that some configuration features of the second deserializer 24 can be transmitted to the first deserializer 9 without modification.

[0050] When deriving the register settings 52 of the first deserializer 9 based on the first embodiment mapping 50, the configuration device 28 additionally consults a netlist 54 that relates the input pins PS1, ..., PS10 of the first serializer to the internal data lines L1, ..., L10 of the recording device 2. The netlist 54 is illustrated in FIG. 5. As previously explained, the first serializer 11 must emulate the functionality of the second serializer 18 and therefore advantageously belongs to the same model series as the second serializer 18. As a result, the first serializer 11 is arranged on a customer-specific and therefore replaceable board 74. The output pins PD1, ..., PD10 of the first deserializer 9, from which the deserialized image data stream 22 is output, are connected to the internal data lines L1, ..., L10 of the recording device 2. The internal data lines L1, ..., L10 themselves are connected to the interface 70 of the board 74. The interface 70 provides inputs for each internal data line L1, ..., L10, which are connected to the input pins PS1, ..., PS10 of the first serializer 11 via electrical connections 72 on the board 74. In this way, for each required output pin PD1, ..., PD10 of the first deserializer 9, a data connection is configured to the input pins PS1, ..., PS10 of the first serializer 11 for the transmission of image data from the first deserializer 9 to the first serializer 11. However, which data line L1, ..., L10 leads to which input pin PS1, ..., PS10 naturally depends on the model series of the first serializer 11 and the settings of the electrical connections 72. This information is required by the configuration device 28 to determine the register settings 52 of the first deserializer, which the configuration device 28 retrieves from the netlist 54. The netlist 54 is a table-type correspondence that makes it possible to extract which data lines L1, . . . , L10 or which output pins PD1, . . . , PD10 are connected to which input pins PS1, .

[0051] In figures 3 and 4 alternative embodiments of the automatic derivation of the register settings 52 of the first deserializer 9 are shown. In the following only the differences with respect to figure 2 are explained.

[0052] 3 shows how the first compatibility mapping 46 is replaced by a two-step second compatibility mapping 56, which introduces a further step of abstraction. The second compatibility mapping 56 includes a second abstraction mapping 58, which associates the possible functionality of the first serializer 11 with the specification of the image data stream 22 in a table-like enumeration. The configuration device 28 consults the second abstraction mapping 58 in order to derive a specification 60 of the image data stream 22 from the functionality 44 of the first serializer 11 based on the second abstraction mapping. This specification 60 is a technical description 60 of the image data stream from the user's point of view. The specification 60 includes general characteristic quantities of the image data stream, but does not include information about the technical means or settings of the hardware involved in the transmission of the image data stream 22, in particular about the functionality 44, 48 of the first serializer 11 or the first deserializer 9. Thus, the specification 60 is at a higher level of abstraction than the description of the two functionalities 44, 48 and cannot be uniquely mapped to either the first serializer 44 or the first deserializer 48. Possible examples of characteristics specified in the specification of an image data stream are the transmission frequency, formatting of the image data as well as the source or target addresses of the image data stream.

[0053] Furthermore, the second compatibility mapping 56 includes a second reification mapping 62. The configuration device 28 consults the second reification mapping 62 in order to derive the functionality 48 of the first deserializer from the specification 60 of the image data stream 22. The second reification mapping 62 is similar in content to the second abstraction mapping 58, i.e., the second reification mapping 62 associates the functionality of the first deserializer 9 with the specification of the image data stream 22, which specifications arise from these very functionalities, but which are used by the configuration device 28 in the reverse order. After creating the specification 60 of the image data stream 22, the configuration device 28 applies the second reification mapping 62 to the specification 60, thereby reading from the second reification mapping what functionality the first deserializer 9 must have in order to generate an image data stream 22 that meets these very specifications.

[0054] 4 shows a combined embodiment, in which both the first compatibility mapping 46 and the second compatibility mapping 56 are used by the configuration device 28 to derive the functionality 48 of the first deserializer 9. The determined functionality 48 of the first deserializer is obtained in this embodiment as the union of the features and / or sub-functionalities of the first deserializer 9 derived using the first compatibility mapping 46 and using the second compatibility mapping 56.

[0055] It is self-evident that in order to carry out the steps described above, the configuration device 28 needs access to the information necessary for this, namely the abstraction mappings 42, 58, the instantiation mappings 62, 50, the netlist 54 and possibly the functionality mapping 46. Advantageously, a database is made available with a number of abstraction mappings 42, 58, netlists 54 and possibly compatibility mappings 46 in order to be able to carry out the automatic configuration according to the invention of the first deserializer 9 for a number of possible model series of the first serializer 11. In the example presented here, since a uniform model series of the first deserializer 9 is provided, it is not necessary to make available different embodiments of the first instantiation mapping 50 and the second instantiation mapping 62. However, it is of course possible, if necessary, to extend the database by a number of instantiation mappings 50, 62 for different model series of the first deserializer 9. Information compatible with the first serializer 11 (at least the first abstraction mapping 42 and the netlist 54, and if necessary the second abstraction mapping 58 and / or the compatibility mapping 56) must be stored in a storage medium readable by the configuration device 28.

[0056] In Fig. 6 the signal flow and the working steps carried out by the configuration device 28 are shown on the time axis. At the beginning (bottom of the time axis), i.e. after switching on the recording device 2, the recording device 2 first goes into a configuration phase. During the configuration phase, the recording device 2 blocks the data flow on the second data connection 14, so that no communication can take place between the second deserializer 24 and the second serializer 18. The recording device 2 first puts the configuration device 28 into a recording mode 84, in which the configuration device 28 waits for a configuration data stream 23. After switching on the receiving device 6, the second deserializer 24 transmits the configuration data stream 23 to configure the second serializer 18. The recording device 2 intercepts the configuration data stream 23 so that the receiving device 6 configures the first serializer 11 instead of the second serializer 18. The second serializer 18 remains unconfigured for the time being and the configuration device 28 makes a recording of the configuration data stream 23 and stores this recording, thus completing the recording phase 84 .

[0057] After the configuration data stream 23 has been transmitted, the second deserializer 24 waits for an acknowledgement signal 82 to ensure that the sensor device 4 is fully configured and ready for use. If the acknowledgement signal 82 is not returned due to the second data connection 14 being blocked, then the second deserializer 24 makes a further attempt to configure the first serializer 18 by repeatedly transmitting the configuration data stream 23. Until the configuration phase is finished, all the repeatedly transmitted configuration data streams 23 are intercepted by the recording device 2, so that the repeated configuration attempts remain ineffective.

[0058] After storing the configuration data stream 23, the configuration device 28 goes into a configuration specification mode 86 in which the configuration device 28 performs the work steps previously described with respect to one of Figures 2, 3 or 4 for specifying the configuration or register settings of the first deserializer 9. After specifying the configuration, the configuration device 28 creates a deserializer configuration data stream 30 and transmits this configuration data stream 30 to the first deserializer 9 for configuring it.

[0059] After the configuration of the first deserializer 9 is finished and thus the recording device 2 is fully configured and ready for use, the recording device 2 ends the configuration phase and unblocks the second data connection 14. The recording device 2 goes into a normal mode in which it forwards all communication between the sensor device 4 and the receiving device 6 without modification. In the normal mode, the sensor device 4 and the receiving device 6 can exchange data as if the recording device 2 was not present. The first configuration data stream 23 transmitted by the second deserializer 24 after the configuration phase ends correctly reaches the second serializer 18. After the configuration of the second serializer 18 is completed, the sensor device 4 confirms that the sensor device is ready for use by transmitting a confirmation signal 82. After receiving the confirmation signal 82, the receiving device 6 also goes into a normal mode and the whole structure shown in FIG. 1 is subsequently ready for use.

Claims

1. A recording device (2) for recording a serialized image data stream (22) flowing from a sensor device (4) to a receiving device (6), comprising: The recording device (2) includes a first data interface (8), a first deserializer (9), and a storage device (5); - said first data interface (8) is adapted for setting up a first data connection (12) between said first data interface (8) and said sensor device (4) for transmitting said image data stream (22) to said first data interface (8); - the first deserializer (9) is configured to deserialize the image data stream (22) received at the first data interface (8); the storage device (5) is configured to record the image data stream (22) deserialized by the first deserializer (9) and to store image data from the image data stream (22) on a storage medium (7); the recording device (2) comprises a configuration device (28) for recording a configuration data stream (23) transmitted by the receiving device (6) in order to configure a serializer (18) arranged in the sensor device (4) for serializing an image data stream (22) output by a sensor (20) and for supplying the serialized image data stream (22) to the first data connection (12); analyzing the records of the configuration data stream (23) and determining, based on the analysis, a processing of the serialized image data stream (22) by the serializer (18) located in the sensor device (4); using information obtained as a result of the analysis to identify a configuration (52) for the first deserializer (9), the configuration (52) configuring the first deserializer (9) to reconstruct the image data stream (22) output by the sensor (20); configured to configure the first deserializer (9) according to the configuration (52) specified by the first deserializer (9), Recording device (2).

2. The recording device (2) includes a second data interface (10) and a first serializer (11); - said second data interface (10) is adapted for establishing a second data connection (14) between said second data interface (10) and said receiving device (6) for transmitting said image data stream (22) to said receiving device (6); the first serializer (11) is configured to serialize the image data stream (22) back after recording the image data stream (22) by the storage device (5) and to output the back serialized image data stream (22) through the second data interface (10), and the first serializer (11) comprises a number of input pins (PS1, ..., PS10) for receiving image data, the configuration device (28) records a configuration data stream (23) transmitted by the receiving device (6) via the second data connection (14) to the second data interface (10) in order to configure a second serializer (18) arranged in the sensor device (4) for serializing the image data stream (22) transmitted via the first data connection (12); analyzing the record of the configuration data stream (23) and determining, based on the analysis, how the image data stream (22) should be processed for the first serializer (11) and distributed to the input pins (PS1, ..., PS10) of the first serializer (11); and configuring the configuration (52) of the first deserializer (9) such that the configuration (52) of the first deserializer (9) configures the first deserializer (9) to process and distribute the image data stream (22) to the input pins (PS1, ..., PS10) of the first serializer (11) as specified in the analysis.

2. Recording device (2) according to claim 1.

3. the first serializer (11) and the second serializer (18) belong to the same model series, and the recording device (2) is configured to configure the first serializer (11) using the configuration data stream (23), or the first serializer (11) and the second serializer (18) belong to different model series, and the configuration device (28) is configured to transfer the configuration of the second serializer (18), which is preset by the configuration data stream (23), to a configuration (40) of the first serializer (11) having the same technical effect, and to configure the first serializer (11) according to the configuration having the same technical effect.

3. Recording device (2) according to claim 2.

4. the recording device (2) is adapted to intercept the configuration data stream (23) so that the configuration data stream (23) is used by the receiving device (6) to configure the first serializer (11) instead of the second serializer (18); Recording device (2) according to claim 3.

5. the recording device (2) is adapted to intercept the configuration data stream (23) repeatedly transmitted by the receiving device (6), in particular all the transmitted configuration data streams (23), until the end of the configuration of the first deserializer (9), Recording device (2) according to claim 4.

6. the recording device (2) is adapted to transfer a repeatedly transmitted configuration data stream (23) to the sensor device (4) after the configuration of the first deserializer (9) is completed in order to configure the second serializer (18), Recording device (2) according to claim 5.

7. the recording device (2) is configured to transfer to the receiving device (6) a confirmation signal (82) for confirming that the sensor device (4) is ready for use, the confirmation signal (82) being transmitted by the sensor device (4) after the configuration of the second serializer (18) is completed. Recording device (2) according to claim 6.

8. a configuration device (28) of the recording device (2) configured for said analysis to read an existing configuration of a second deserializer (24) incorporated in the receiving device (6) for deserializing the image data stream (22) transmitted via the second data connection (14) and to take it into account when determining the configuration (52) of the first deserializer (9), 3. Recording device (2) according to claim 2.

9. a configuration device (28) of the recording device (2) configured to take into account, during the specification of the configuration (52) of the first deserializer (9), a netlist (54) describing data connections between input pins (PS1, ..., PS10) of the first serializer (11) and a plurality of internal data lines (L1, ..., L10) of the recording device (2) in order to transmit image data to the input pins (PS1, ..., PS10); 3. Recording device (2) according to claim 2.

10. A configuration device (28) of the recording device (2) for identifying the configuration (52) of the first deserializer (9): - examining a first abstraction mapping (42) which maps each one of the technical functionality (44) of said serializer (11) to each of the possible configurations (40) of said serializer (11), in particular to all possible configurations (40) of said serializer (11); - determining the functionality (44) of said serializer (11) by applying said first abstraction mapping (42) to said configuration (40) of said serializer (11); - examining at least one compatibility mapping (46, 56) which maps each possible functionality (44) of said serializer (11), in particular all possible functionality (44) of said serializer (11), to a respective one functionality (48) of said first deserializer (9); - determining the functionality (48) of the first deserializer (9) by applying the compatibility mapping (46, 56) to the determined functionality (44) of the serializer (11); - examining a first instantiation mapping (50) that associates a respective one configuration (52) of said first deserializer (9) with a functionality (48) of said first deserializer (9), in particular with all the functionality (48) of said first deserializer (9); - determining the configuration (52) of the first deserializer (9) by applying the first instantiation mapping (50) to the determined functionality (48) of the first deserializer (9); It is configured as follows:

2. Recording device (2) according to claim 1.

11. the compatibility mapping is configured as a functionality mapping (46) by which a respective one functionality (48) of the first deserializer (9) is directly associated with a possible functionality (44), in particular with all possible functionality (44), of the first serializer (11) of the recording device (2); Recording device (2) according to claim 10.

12. Compatibility mappings include: a second abstraction mapping (58) for associating a respective one of the specifications (60) of the image data stream (22) with each possible functionality (44) of the serializer (11), in particular with all possible functionality (44) of the serializer (11); a second instantiation mapping (62) is included which maps a respective one of the functionality (48) of the first deserializer (9) to each possible specification (60) of the image data stream (22), in particular to all possible specifications (60) of the image data stream (22); Recording device (2) according to claim 10.

13. A configuration device (28) of the recording device (2) for specifying the functionality (48) of the first deserializer (9): looking up a first compatibility mapping (46) configured according to claim 11 and applying it to the identified functionality (44) of the first serializer (11) of the recording device (2); looking up a second compatibility mapping (56) configured according to claim 12 and applying it to the identified functionality (44) of the first serializer (11); It is configured as follows: Recording device (2) according to claim 10.

14. A computer-implemented method for configuring a first deserializer (9) of a recording device (2), the recording device (2) being configured to create a recording of a serialized image data stream (22) flowing from a sensor device (4) to a receiving device (6), the recording device (2) including the following components: a first data interface (8), a first deserializer (9) and a storage device (5); - said first data interface (8) is adapted for establishing a first data connection (12) between said first data interface (8) and said sensor device (4) for transmitting said image data stream (22); - the first deserializer (9) is configured to deserialize the image data stream (22) received at the first data interface (8); the storage device (5) is configured to record the image data stream (22) deserialized by the first deserializer (9) and to store image data of the image data stream (22) on a storage medium (7); The method includes the step of establishing the first data connection (12), the method comprises the step of recording a configuration data stream transmitted by the receiving device (6) via the second data connection (14), the configuration data stream (23) being configured to configure a serializer (18) arranged in the sensor device (4) for serializing an image data stream (22) output by a sensor (20) and supplying the serialized image data stream (22) to the first data connection (12), The method comprises: analyzing the record of the configuration data stream (23) and determining, based on the analysis, a processing step of the serialized image data stream (22) by the serializer (18) located in the sensor device (4); identifying a configuration (52) of the first deserializer (9) from information obtained by the analysis, the configuration (52) configuring the first deserializer (9) to reconstruct the image data stream output by the sensor (20); configuring the first deserializer (9) according to the identified configuration (52); The method according to claim 1, further comprising:

Images