Method for generating and processing image data

Abstract

In a method for generating image data by means of a camera comprising an image sensor having a plurality of photosensitive sensor units arranged in rows and columns and for processing the image data by means of an external image processing device, the following steps are provided: providing camera sample-specific data relating to determined characteristics of the camera, these characteristics can be different from camera model general characteristics of the camera; manipulating the image sensor to generate a corresponding image signal value as a function of the intensity of light incident on the sensor unit; reading the image signal values in the camera and generating preliminary image data from the image signal values; transmitting the preliminary image data and metadata to an external image processing device, wherein the metadata comprises camera sample specific data or at least allows distribution of the camera sample specific data to the preliminary image data; and generating processed image data by means of the external image processing device by applying a correction dependent on the camera sample-specific data to the preliminary image data.

Description

Technical Field

[0001] The invention relates to a method for generating image data and for subsequently processing the image data. Background Art

[0002] The image data can be generated by means of a camera, wherein the camera can in particular be a dynamic image camera, which generates a sequence of individual images as image data, which are recorded at a specific image refresh rate (also called frame rate). In this case, the camera can be designed as an electronic camera and include an image sensor, which has a plurality of light-sensitive sensor units arranged in rows and columns. The camera can also have a readout electronics (Ausleseelektronik). Depending on the intensity of the light incident on the sensor unit, the image sensor can generate corresponding image signal values, which can be read out and / or further processed by the readout electronics. Then, based on these image signal values, an image can be generated (in different ways), which, corresponding to the image sensor, can have a plurality of image points (pixels) arranged in rows and columns, each of which corresponds to one of these sensor units.

[0003] The image signal values ​​read from the image sensor are initially raw image data, which may not necessarily be directly displayed as high-quality images. For example, the image sensor can be equipped with a color filter matrix, which allows only light of a specific color spectrum range to pass through to reach each sensor unit according to a predetermined color pattern. Thus, according to the color filter matrix, each sensor unit of the image sensor is assigned to a corresponding color channel of a total of, for example, three or four different color channels, which are defined by the range of the color spectrum that the color filter allows to pass through. Here, the so-called Bayer filter is widely used, in which, in each of the four sensor units arranged in two rows and two columns, two sensor units arranged diagonally to each other are equipped with green transmission filters, and in the remaining two sensor units, one sensor unit is equipped with a red transmission filter and the other sensor unit is equipped with a blue transmission filter. Thus, for such raw image data, initially for each image point there is only a single image signal value assigned to a single color channel, wherein the image signal values ​​of adjacent image points are assigned to different color channels. In order to be able to display a real image based on these raw image data, further image signal values ​​must be determined for each image point by interpolation from the image signal values ​​of adjacent image points (so-called demosaicing), which are assigned to the remaining color channels to which the image signal value of the corresponding image point is not assigned.

[0004] For cameras of a particular camera model, the color filters used in the respective camera model are generally known as camera model-general characteristics of the camera or image sensor, and it can be assumed with certainty that the respective color filters are actually used in each camera of the respective camera model. However, other camera model-general characteristics should also be considered for generating high-quality images from image signal values ​​generated by the image sensor or from raw image data generated by the image sensor, and these other camera model-general characteristics are not determined with the same certainty.

[0005] For example, a fixed nominal relationship between the intensity of light incident on a respective sensor unit and the image signal value generated thereby by the respective sensor unit, which is the same for all sensor units, can be defined as a camera model-generic characteristic of a camera. This nominal relationship can be specified as a generic characteristic for a plurality of samples of a camera model (i.e. a type). However, due to manufacturing tolerances, for example, the actual relationship may deviate from this nominal relationship, or more precisely, in principle deviate from this nominal relationship to a different degree for each sensor unit. Furthermore, individual sensor units of the image sensor and / or individual amplifiers or parts of the readout electronics downstream of the respective camera sample may be defective. Such deviations of the actual characteristics from the camera model-generic characteristic can lead to interfering artifacts in the image data, and the goal is therefore to fully compensate for these deviations by corresponding corrections in the ideal case in order to generate a high-quality image from the image data.

[0006] Therefore, it is usually necessary to determine the actually existing characteristics of the camera, in particular the image sensor and / or the individual sensor units and / or the readout electronics, for each individual camera model, for example within the framework of a calibration, which characteristics may deviate from the general characteristics of the camera model. The result of such a calibration can be stored in the camera, for example, and can then be used to correct disturbances in the image data caused by deviations between the actual characteristics and the general characteristics of the camera model.

[0007] Electronic cameras usually include an integrated image processing device, which can be implemented by special software and / or hardware and is designed to carry out so-called interpolation and / or so-called correction in order to generate processed image data, which can then be displayed directly as a high-quality image (for example on a display unit arranged or connected to the camera), stored and / or output. However, such in-camera image processing requires a sufficiently high computing power of the camera, for which the camera must include correspondingly complex hardware and / or software. The computing effort increases with the quality requirements and with increasing parameters such as resolution (number of pixels) and image refresh rate, which always continue to increase in the course of technological progress and requirements. As a result, the complexity of the camera increases and therefore the cost of the camera as well as the performance requirements increase.

[0008] In order to avoid this, it is conceivable to remove those parts of the image processing which do not depend on camera sample-specific data, i.e. the deviations between the determined (actual) characteristics mentioned and the generic (nominal) characteristics of the camera model. The reason for this is that each camera sample of the respective camera model can then provide image data which can be processed in a uniform manner to generate a high-quality image. However, although the amount of computational work to be done in the camera is thereby reduced, the amount of computational work to be done is still relatively high, especially with regard to quality requirements, such as those imposed on the resulting image in professional film production, since the deviation correction described continues to be performed in the camera. Summary of the invention

[0009] The object of the present invention is to provide a method for generating and processing image data which is suitable for keeping the complexity of the data processing in the camera at a low level and for meeting high quality requirements for the resulting images.

[0010] This object is achieved by a method having the features of claim 1. Advantageous developments of the invention are apparent from the dependent claims, the description and the drawings.

[0011] The method according to the invention involves: generating image data, in particular moving image data, by means of a camera; and processing these image data by means of an external image processing device. In this case, the camera comprises: an image sensor, which (as described above) has a plurality of light-sensitive sensor cells arranged in rows and columns; and readout electronics downstream of the image sensor.

[0012] The method comprises providing camera sample-specific data about determined characteristics of a camera, which may differ from camera model-general characteristics of the camera. In particular, camera sample-specific data about the deviation of the determined characteristics from the camera model-general characteristics can be provided. The camera sample-specific data about the determined characteristics of a camera can relate to only a part of the camera, such as the image sensor itself, the individual sensor units of the image sensor, the integrated signal amplifier of the image sensor, the integrated analog-digital converter (A / D converter) of the image sensor, the camera's readout electronics itself or parts of the readout electronics. The camera's readout electronics can include various components, which are arranged outside the image sensor, for example, on a common circuit board or in a decentralized manner. The camera's readout electronics can include, for example, amplifiers, analog-digital converters or electronic components for signal processing or control, such as integrated circuits (ICs), microprocessors, central computing units (CPUs), graphics processing units (GPUs), application-specific integrated circuits (ASICs) and / or field programmable gate arrays (FPGAs).

[0013] The determined properties can in particular be actually existing properties of the camera (in particular the image sensor and the readout electronics) and not purely nominal properties of the camera (as described above). In this case, the determination of the properties does not necessarily have to be part of the method according to the invention, but can already be done beforehand, for example by a separate calibration method, which can, for example, already be carried out by the manufacturer of the camera after its manufacture. In principle, however, the method according to the invention can also include the determination of the (actual) properties, which is then carried out before the provision of the camera sample-specific data.

[0014] The mentioned properties of the camera can influence all data acquired by means of the image sensor, in particular at least substantially uniformly, or only a part of the acquired data, for example one or more corresponding rows or columns of sensor cells of the image sensor.

[0015] In some embodiments, the mentioned characteristics of the individual sensor units can be limited to influencing the data obtained by means of the respective sensor unit. The determined characteristics of the individual sensor units can be present in particular in the form of a (calibration) matrix, which has a number of rows and columns corresponding to the image sensor and comprises one or more correction parameters and / or status information (e.g. status information about whether the respective sensor unit is defective) for each sensor unit of the image sensor. By means of such a matrix, in particular, nonlinear characteristic curves of the sensor units can also be parameterized, as described below.

[0016] In particular, the camera sample-specific data can be provided by registering the camera sample-specific data in the camera, in an external database and / or in another memory. Advantageously, the camera sample-specific data are assigned identification information by means of which the respective camera sample or its associated components (in particular image sensors and / or readout electronics or parts thereof) to which the camera sample-specific data relate can be uniquely identified.

[0017] The method further comprises: controlling the image sensor to generate corresponding image signal values ​​as a function of the intensity of the light incident on the sensor unit. In particular, each of the sensor units, provided that it is not defective, generates an image signal value or (in sequence) a plurality of image signal values ​​as a function of the intensity of the light incident on the sensor unit. Preferably, the image sensor is controlled so that all sensor units generate image signal values ​​synchronously at a certain predetermined given image refresh rate.

[0018] The method further comprises reading image signal values ​​in the camera and generating preliminary image data from these image signal values. These image signal values ​​can be read substantially directly from the image sensor. This can include, in particular, digitizing an analog image signal generated in the image sensor by a sensor unit and, if necessary, amplified, which is the basis for the image signal values, by means of an A / D converter. Based on the read image signal values, image data are then generated, which may be erroneous, in particular due to possible deviations of the mentioned determined characteristics from the general characteristics of the camera model, and may contain artifacts, and are therefore referred to as preliminary image data.

[0019] The generation of these preliminary image data can in particular include: combining the image signal values ​​to form a sequence of individual images. In principle, a certain preprocessing of the image signal values ​​can already be carried out here, such as the application of a non-linear preamplification (pre-emphasis phase). In addition, in principle, an interpolation (demosaicing) of the type mentioned can also be carried out, wherein this is not necessarily the case and the interpolation can also be carried out at a later point in time, in particular outside the camera. However, preferably, when the preliminary image data are generated, errors and artifacts caused by the mentioned deviations have not yet been corrected.

[0020] However, in some embodiments, it is also possible that these preliminary image data are preliminary, in particular because at least one correction (of a possible plurality of prescribed corrections) was carried out but only incompletely. For example, in order to conceal deviations between amplifiers, in particular row or column amplifiers, of an image sensor, the image signals can be scrambled before they are amplified (so-called scrambling, which is described in more detail below), wherein the correction is then still incomplete until the scrambling is reversed again (descrambling) after amplification.

[0021] The method also includes transmitting the preliminary image data together with metadata to an external image processing device, the metadata including the camera sample-specific data or at least allowing the assignment of the camera sample-specific data to the preliminary image data. The image processing device is in particular an external image processing device, since it is not integrated into the camera.

[0022] In this case, the preliminary image data and metadata can be transmitted directly or indirectly (via one or more intermediate devices) from the camera to the external image processing device. The transmission can be wired or wireless, or also partially wired and partially wireless. It is also conceivable to transmit with the aid of one or more data carriers on which the data (preliminary image data and metadata) are stored, so that the transmission of the data can be decoupled in time from the recording. Even if the transmission does not take place via a data carrier but via a data connection, these data do not necessarily have to be transmitted immediately after their generation, but it can be provided that these data are first temporarily stored in the camera.

[0023] It can also be provided that these data are compressed, in particular for the corresponding transmission, wherein these data are then preferably first decompressed again before further processing.

[0024] The metadata can be specifically assigned to the image data, but are not part of the image data, but contain additional information beyond the image information contained in the image data, i.e. in particular the mentioned camera sample-specific data. However, the metadata can be integrated into the preliminary image data, since these metadata can be combined with the preliminary image data in a single file or a single data stream. As an alternative to this, however, the metadata can also be present separately from the preliminary image data and in this respect be transmitted separately. Thus, “preliminary image data are transmitted together with the metadata” does not necessarily mean that the preliminary image data and the metadata are transmitted in combination with one another, but in particular that the preliminary image data and the metadata are preferably transmitted simultaneously or at least successively in time to the external image processing device and are related to one another in this case, for example in that the metadata contain a reference to the preliminary image data and / or vice versa.

[0025] The metadata do not necessarily have to include camera sample specific data themselves. The reason is that it is sufficient, for example, for the metadata to include identification information about the camera (in particular the image sensor and / or the readout electronics or parts thereof), i.e. information by means of which the camera sample or its image sensor used for generating the preliminary image data can be uniquely identified. This identification information can then be used to assign camera sample specific data that are already present in the external image processing device to the preliminary image data, or to obtain the camera sample specific data from elsewhere, e.g. read from an external database (this is described in more detail below). In this way, the preliminary image data can therefore be assigned camera sample specific data by means of the metadata, without these camera sample specific data having to be contained in the metadata itself transmitted together with the preliminary image data.

[0026] The method further comprises the generation of processed image data by the external image processing device by applying a correction dependent on camera sample-specific data to the preliminary image data. Thus, processed image data are generated based on the transmitted preliminary image data, i.e., by applying a correction to the preliminary image data, which correction is used to eliminate errors and artifacts that may arise due to the mentioned deviations between the determined characteristics and the general characteristics of the camera model. The correction contains the camera sample-specific data, which are transmitted together with the preliminary image data or are assigned to the preliminary image data after the preliminary image data are already present in the external image processing device or have been obtained from elsewhere; for example, these camera sample-specific data can be contained as parameters in the corresponding correction. If a correction was already performed when the preliminary image data was generated, but this correction was only performed incompletely, the application of the correction dependent on the camera sample-specific data can also include the completion of this previously incomplete correction, wherein the mere completion also preferably still depends on the camera sample-specific data.

[0027] Here, "the correction applied to the preliminary image data depends on the camera sample-specific data" has the additional advantage that possession of the camera sample-specific data is a prerequisite for applying the correction. Therefore, if the metadata does not directly include the camera sample-specific data, but only includes identification information or otherwise allows the assignment of camera sample-specific data to the preliminary image data, it can be advantageously controlled by restricting access to the camera sample-specific data: who can apply the correction that depends on the camera sample-specific data in order to generate processed image data of the highest quality. For example, an access key (e.g. a license key) may be additionally required for access to the camera sample-specific data (possibly in addition to the identification information for calling up the correct data, i.e. data related to the respective camera). Or it can be ensured that the correction that depends on the camera sample-specific data can in principle only be performed by a limited number of authorized persons, in particular only by the camera manufacturer. Thus, the correction that depends on the camera sample-specific data can be performed with different authorizations and quality levels.

[0028] After the processed image data are generated, they may then be output by an external image processing device.

[0029] The generation of processed image data is not limited to the corrections mentioned that depend on the camera sample-specific data. Instead, the generation of processed image data can also additionally include image processing and image processing steps, which can be independent of the camera sample-specific data. In particular, if the image data include a plurality of color channels and the preliminary image data do not yet include values ​​in all color channels for each image point of the image data, the generation of processed image data can also include interpolation (demosaicing) in order to supplement the values ​​in those color channels for each image point in which no value is yet available for the respective image point. However, such interpolation can also already be performed in the camera within the framework of the generation of preliminary image data from the image signal values ​​and is therefore no longer necessary when generating processed image data. Furthermore, the processed image data can in principle still be non-interpolated, i.e., although having a plurality of color channels, for each image point (e.g. in accordance with the mentioned Bayer color filter) have a value in only one of these color channels.

[0030] By means of the method according to the invention, the camera advantageously needs to be set up to generate fully processed image data of the highest quality, so that the amount of computational work to be done by the camera can be kept relatively low. As a result, the complexity of the camera can be reduced compared to conventional cameras. However, by means of the metadata, it is simultaneously ensured that image processing can be performed or completed outside the camera, i.e. in an external image processing device, based on the camera sample-specific data required for this, in order to correct possible errors or artifacts caused by deviations between actual and nominal characteristics of a specific camera sample, and thus finally to obtain high-quality image data. Since the metadata, in particular the camera sample-specific data, are usually global here, i.e. apply to all image data recorded with the respective camera sample, or at least remain constant in time, for example over the duration of the respective recording sequence, the amount of these metadata is small compared to the amount of image data, so that no significant additional work is generated by the additional transmission of the metadata itself, even if the camera sample-specific data are directly contained in the metadata.

[0031] The corrections mentioned, applied to the preliminary image data, may include one or more types of corrections of the image data (if necessary raw image data). For example, an offset correction (so-called offset correction) and / or a gain factor correction (so-called gain correction) may be performed, wherein a gain that influences the reading of the image signal values ​​and / or the generation of the preliminary image data based on these image signal values ​​is corrected by a correction offset or correction factor, in particular a correction offset or correction factor that is predefined individually for each sensor unit.

[0032] More complex corrections can include correction factors that are signal-dependent. For example, the gain of the image signal values ​​of the individual sensor units can be corrected as a function of a nonlinear characteristic curve, wherein the parameters of this characteristic curve are preferably predefined individually for each sensor unit. The different image signal values ​​can then be transformed using the characteristic curve that is individual for the respective sensor unit.

[0033] A correction can also be performed by which defects of individual ones of the sensor units are compensated, for example by replacing the values ​​of the image points corresponding to the defective sensor units in the preliminary image data by estimated values, for example values ​​determined by interpolation based on the values ​​of adjacent image points.

[0034] In this respect, embodiments of the invention are advantageous in which the camera model-specific data include a gain correction offset of the sensor unit, a gain correction factor of the sensor unit, parameters of a nonlinear characteristic curve of the sensor unit and / or status information about a defective sensor unit. In this case, the gain correction offset or gain correction factor of the respective sensor unit is an offset or a factor for correcting a gain which has an influence on the reading of the image signal values ​​generated by means of the respective sensor unit or (in particular) on the generation of preliminary image data based on these image signal values ​​and which may be erroneous due to the mentioned possible deviations between the determined characteristics and the general characteristics of the camera model.

[0035] Instead of or in addition to applying a gain correction offset or a gain correction factor, a nonlinear correction can also be applied to the image signal values ​​by means of a characteristic curve, preferably a characteristic curve defined individually for each sensor unit. By this, a signal-dependent correction can be applied to the image signal values ​​of the image sensor or to the preliminary image data generated therefrom. Such a characteristic curve can respectively assign a modified image signal value to different image signal values ​​and in this respect corresponds to a (nonlinear) transformation of the image signal values. In this case, the corresponding characteristic curve can be defined, for example, as a function or a lookup table, which is preferably based on the calibration results of the corresponding image sensor. In order to be able to define individual characteristic curves for all sensor units and still keep the amount of camera sample-specific data small, the characteristic curve can be defined partially identically for all sensor units, for example by determining base points of the characteristic curve (for approximation of the calibration result), which base points are identical for all sensor units and the characteristic curves of these sensor units are thus "limited" to these base points, so to speak, to a certain extent. However, the characteristic curves are preferably also defined at least in part by sensor unit-specific parameters, by means of which the course of the respective characteristic curve between two respective base points can be predetermined in particular for each sensor unit individually.

[0036] In this case, the sensor unit-specific parameters of the gain correction offset and the gain correction factor or the nonlinear characteristic curve only need to be present for those sensor units which are not defective according to the mentioned state information. Preferably, for each sensor unit, the corresponding information is present separately, for example in the form of a matrix, which corresponds to the arrangement of the sensor units in the image sensor. Thus, in particular for each sensor unit it is known whether it is defective and, if the sensor unit is not defective, it is known with which gain correction offset and with which gain correction factor or according to which nonlinear characteristic curve the image signal values ​​generated by the respective sensor unit or the values ​​of the preliminary image data derived therefrom should be corrected.

[0037] According to a further advantageous embodiment, the metadata additionally comprises shot-specific data about operating conditions which were already present during the generation of the image signal values ​​and which are at least suitable for influencing the generation of the image signal values ​​or which actually influence the generation of the image signal values, wherein the aforementioned correction additionally depends on these shot-specific data. The metadata may in particular comprise shot-specific data about deviations of these operating conditions from standard conditions in relation to which the aforementioned universal (nominal) characteristics of the camera model are defined.

[0038] These acquisition-specific data may in particular be physical quantities which describe the generation of the image signal values. Examples of acquisition-specific data are, for example, the temperature during the generation of the image signal values, in particular the temperature of the image sensor and / or of the readout electronics, which may, for example, influence the noise of the image sensor and / or generally influence the relationship between the intensity of the light incident on the respective sensor unit and the image signal values ​​generated by the respective sensor unit in response thereto. Furthermore, the atmospheric pressure and / or mechanical stresses (static force application) and / or acceleration values ​​(dynamic force application) may also influence the generation of the image signal values.

[0039] According to another advantageous embodiment, providing the camera copy specific data comprises: registering the camera sample specific data in a database, wherein the metadata transmitted to the external image processing device comprises identification information about the camera or parts thereof, in particular the image sensor and / or the readout electronics. In this embodiment, the method comprises: the external image processing device reads the camera sample specific data from the database based on the identification information and assigns it to the transmitted preliminary image data. The identification information can be, for example, one or more serial numbers of the camera or its components, in particular the image sensor, the readout electronics and / or other electronic components of the camera, such as associated circuit boards.

[0040] In this case, the metadata therefore need not directly include camera sample-specific data, since these can be taken from the database. Specifically, based on the identification information transmitted as part of the metadata, the camera sample used to generate the preliminary image data or its image sensor or its reading electronics can be identified, so that the data specific to this camera sample can be read from the database and assigned to the preliminary image data. A correction depending on these camera sample-specific data can then subsequently be applied to the preliminary image data. The camera sample-specific data can in this case already be determined once, for example by the manufacturer of the camera, within the framework of a calibration for the respective camera sample and registered in the database.

[0041] According to an advantageous extension of this embodiment, reading the camera sample-specific data from the database requires evidence of a read authorization received within the framework of a user input. The external image processing device can be designed in particular to receive a user input in order to receive evidence of the read authorization in this way. However, the user input does not necessarily have to be entered directly at the external image processing device, but the external image processing device can also receive the user input via a transmission from another device on which the user input is entered. The evidence can be, for example, a password or a license key. In principle, however, it is also conceivable that knowledge of the aforementioned identification information about the camera, the image sensor and / or the read electronics is already regarded as evidence of the read authorization.

[0042] This proof can be received by the external image processing device as part of the user input. For example, the user input can be: first requesting the generation of processed image data and then entering the proof of authorization to read. However, the proof can also be pre-registered in the external image processing device and in this way be present within the framework of the later user input (request for processed image data).

[0043] For example, the read authorization can be checked directly in the external image processing device or in a database based on the evidence. In other words: the external image processing device can be designed to check the evidence of the read authorization and only read the camera sample-specific data from the database if the read authorization is confirmed by this check; alternatively or in addition to this, it can be provided that the evidence of the read authorization is (also) checked in the database and only if the read authorization is confirmed by this check, the camera sample-specific data is allowed to be read from the database. In this way, in particular, the generation of the highest quality (completely) processed image data can be linked to the evidence that the respective user has the read authorization. In this way, unauthorized use of at least high-quality image data can be advantageously prevented. However, at the same time, it can be provided that partially processed image data of lower quality can also be obtained without the mentioned evidence.

[0044] According to another advantageous embodiment, the method further comprises: generating partially processed image data in the camera or by an external image processing device. After generating the partially processed image data, these partially processed image data can be output by the camera or by the external image processing device.

[0045] The partially processed image data may be generated by applying a correction depending on the camera sample specific data to a portion of the preliminary image data. In contrast, the correction is not applied or at least incompletely applied to the remaining portion of the image data. The remaining portion may be added to the partially processed image data without the correction or with an incomplete correction, or may not even be added to the partially processed image data (i.e. simply be missing from the partially processed image data), wherein the latter is preferred.

[0046] For example, the correction may be limited to a subset of image points of a respective individual image of the image data. The subset may correspond to a segment, in particular a central segment, of the respective individual image. If the image data is motion image data comprising a sequence of a plurality of individual images, this may be the same segment for all individual images, i.e. the respective segment has the same position and the same size for each of these individual images.

[0047] The subset of image data to which the correction is applied can also be formed by spatial undersampling, in particular by correcting only every n-th row and every m-th column of the respective individual image, and the remaining image points are not corrected or are omitted (where n and m are positive integers and are preferably identical). These partially processed image data then - in the case of omitted image data - have a resolution that is reduced compared to the resolution of the (completely) processed image data or compared to the resolution with which these image data were recorded.

[0048] In the case of moving image data, the subset of image data to which the correction is applied can also be formed by temporal undersampling, in particular by correcting only every nth individual image and the remaining individual images being uncorrected or omitted (where n is a positive integer). These partially processed image data then - in the case of omitted individual images - have a frame rate that is reduced compared to the frame rate of the (completely) processed image data or compared to the frame rate used to record these image data.

[0049] In particular, in some embodiments, the preliminary image data may correspond to a motion image sequence comprising a sequence of a plurality of individual images, wherein the partially processed image data are generated by applying a correction depending on the camera sample specific data only to a portion of the preliminary image data corresponding to a subset of the plurality of individual images, while not applying such correction to the remaining portions of the preliminary image data corresponding to other individual images of the plurality of individual images. In such embodiments, the subset of the plurality of individual images may correspond to a first refresh rate of the motion image sequence, wherein all of the plurality of individual images correspond to a second, higher refresh rate of the motion image sequence. Thus, these partially processed image data may be reproduced, for example, at a monitor device at a relatively low refresh rate, whereas a complete processing of the image data according to the camera sample specific data is required in order to reproduce or further process the preliminary image data at a relatively high refresh rate.

[0050] It is also possible to combine two or more of these options. Thus, the partially processed image data may be limited to a fragment, have a reduced resolution and / or a reduced refresh rate compared to the (completely) processed image data.

[0051] Here, it is preferred that the part of the preliminary image data to which the correction is applied is adjustable, for example by being able to select from a plurality of predefined options or freely select the corresponding segment, resolution and / or refresh rate as default values ​​for these partially processed image data.

[0052] Preferably, the correction applied to a part of the preliminary image data to generate these partially processed image data is the mentioned correction depending on the camera sample specific data, which correction is also applied to the preliminary image data by the external image processing device to generate the (completely) processed image data. Thus, when generating the partially processed image data, this part of the preliminary image data is not corrected worse than when generating the (completely) processed image data, but the correction is comprehensive in both cases. The difference is at least essentially only that the correction is applied to the preliminary image data in one case and to only parts of the preliminary image data or is partially applied in the other case.

[0053] As long as partially processed image data are generated in the camera or by an external image processing device, the external image processing device can generate (completely) processed image data at a later point in time by applying a correction that depends on camera sample-specific data to the preliminary image data (in a form generated by the camera or in a partially processed form).

[0054] If partially processed image data have already been generated, the generation of the (completely) processed image data can advantageously be limited to also applying the correction to the remaining parts of the preliminary image data and combining the result with these partially processed image data in order to obtain (completely) processed image data overall. However, this need not be the case, since it is also conceivable that the (completely) processed image data are not generated using partially processed image data, but that the external image processing device applies the correction to all preliminary image data independently of these partially processed image data.

[0055] Compared to (completely) processed image data, partially processed image data can be generated with less computing effort, which is particularly advantageous for their generation in the camera. These partially processed image data can be used, for example, to evaluate the process or the result of recording the image data directly at the camera or at a display device connected thereto without excessive effort. The generation of the (completely) processed image data outside the camera can then be linked to evidence of authorization, in particular evidence of the aforementioned authorization for reading camera sample-specific data. In this way, the generation of high-quality image data can be made dependent on the presence of authorization, in particular in the form of a license key, without hindering the option of directly checking the authorization process or the result.

[0056] Alternatively or additionally to generating the partially processed image data by applying a correction to (only) a part of the preliminary image data, the partially processed image data can also be generated by applying to the preliminary image data a correction different from, in particular simpler than, that used to generate the (completely) processed image data (regardless of whether applied to all preliminary image data or only to a part thereof). The partially processed image data can in particular be generated in the camera or by an external image processing device by applying a simplified correction to the preliminary image data which is independent of the camera sample-specific data or which depends to a lesser extent on the camera sample-specific data than the correction mentioned which is applied to generate the (completely) processed image data.

[0057] In some embodiments, the simplified correction may be simplified in particular insofar as it is independent of camera sample specific data.

[0058] In other embodiments, the simplified correction can depend on camera sample-specific data to a lesser extent than the aforementioned (comprehensive) correction. The simplified correction can in particular depend on a smaller amount of camera sample-specific data than the aforementioned (comprehensive) correction. However, the simplified correction can also be simplified insofar as it is limited to corrections of lower complexity than the aforementioned (comprehensive) correction, for example by performing the correction with parameters of lower resulting quality and / or simply omitting one or more parts of the correction. In this case, the simplified correction can in principle contain all camera sample-specific data, which can also be contained overall in the aforementioned (comprehensive) correction.

[0059] Preferably, the degree to which this simplified correction depends on the camera sample-specific data to a lesser extent than the mentioned (full) correction is adjustable. In other words, in this case it can therefore be set how much of the partially processed image data should have been processed. The range here can extend from minimally partially processed to almost completely processed. In principle, it is also conceivable that it can be selectively provided that the image processing device directly generates completely processed image data. Depending on the correction method used, the mentioned degree of processing can be quasi-continuously or even continuously adjustable.

[0060] If the simplified correction is not even related to the camera sample-specific data, it can, for example, be limited to a simple interpolation (demosaicing), by which, for each image point of the image data, the values ​​in those color channels in which no values ​​are yet available for this image point are calculated from the values ​​of the neighboring image points.

[0061] The partially processed image data generated by this simplified correction usually have a lower quality than the (completely) processed image data due to the lack or less consideration of the camera sample-specific data. Compared to the (completely) processed image data, the partially processed image data generated by correcting only a part of the preliminary image data are also reduced in their quality, since in this case not all preliminary image data are (comprehensively) corrected. In this respect, these partially processed image data are usually not sufficient in both cases for the highest quality image to be generated in the end, for example for projection onto a power screen. However, the partially processed image data can be used, for example, to generate control images with a relatively low effort, which control images (for example as digital viewfinder images) can already be used during or shortly after the recording of the image data to check the image content, in particular for the successful achievement of visual design goals. In addition, the partially processed data can be used in the form of so-called proxies for pre-editing decisions, while the final editing is performed later on the basis of the highest quality (completely) processed image data.

[0062] If partially processed image data are generated, these partially processed image data can also be used for the mentioned generation of (completely) processed image data, in that a supplementary correction depending on camera sample-specific data is additionally applied to the partially processed image data generated by the simplified correction. The generation of the (completely) processed image data is then therefore divided into at least two stages, since the correction applied overall to the preliminary image data comprises at least on the one hand the simplified correction and on the other hand the supplementary correction. More than two stages can also be provided, wherein preferably the number of these stages is adjustable and / or the stage to which the simplified correction should extend is adjustable. Furthermore, the generation of the (completely) processed image data can in principle also be independent of the generation of the partially processed image data.

[0063] According to an advantageous development of the above-mentioned embodiment, the external image processing device is designed to receive user inputs, wherein the external image processing device generates processed image data in response to a first user input and / or (if these processed image data have been previously generated) outputs these processed image data, and generates the partially processed image data in response to a second user input different from the first user input and / or (if these processed image data have been previously generated) outputs these partially processed image data. Thus, depending on whether the external image processing device receives the first user input or the second user input, it generates and / or outputs: (completely) processed image data generated by a correction depending on the camera sample-specific data; or partially processed image data generated by a simplified correction that is independent of the camera sample-specific data or depends to a lesser extent on the camera sample-specific data.

[0064] Here, naming the user input as the first and second user input should not be understood in terms of time or in the sense of ranking, but rather serves to conceptually distinguish between the two user inputs that may differ in terms of their type and / or their content. Here, at least the first user input can include the mentioned evidence of the read authorization if necessary.

[0065] It is also possible to distinguish more than just the first and second user inputs, in response to which the external image processing device generates and / or outputs partially processed image data, respectively, and which differ from the second user input and from each other in that partially processed image data are generated and / or output to a respectively different extent, for example by applying a respective further simplification correction to the preliminary image data. These different simplification corrections can be distinguished in particular with regard to whether they depend on camera sample-specific data and, if so, which and / or how many camera sample-specific data they depend on. In this way, the degree of processing of the image data and thus the quality of the respectively generated image can be selectively adapted to the respective needs by means of the corresponding user inputs.

[0066] According to an advantageous embodiment, these partially processed image data are continuously generated (whether in the camera or by an external image data device) and output to a monitor device, where they are continuously displayed. In particular, preliminary image data can be continuously generated in the camera, and partially processed image data can be generated in the camera from these preliminary image data, or transmitted to an external image processing device, where partially processed image data are generated from these preliminary image data; these partially processed image data are then also continuously output to a monitor device, where they are finally displayed. The monitor device can be a device separate from the camera or can also be integrated into the camera, for example in the form of a digital viewfinder.

[0067] Due to the continuous processing of the image data, the image displayed on the monitor device can be a real-time (live) image, which enables monitoring and immediate control of the captured image content during the recording of a moving image sequence (i.e. a sequence of multiple individual images). Since the image data do not need to be completely processed for this purpose, it is sufficient to only continuously generate and output partially processed image data to the monitor device. In this case, the (completely) processed image data also do not need to be generated continuously, but can also be generated at a later point in time, for example within the framework of a general post-processing (post-production) of the image data.

[0068] Independently of the above-described embodiments, the method according to another advantageous embodiment may also include the continuous transmission of preliminary image data (from the camera) to the external image processing device, while other preliminary image data are continuously generated in the camera. In other words, during the recording of a moving image sequence (a sequence of a plurality of individual images), preliminary image data are continuously generated in the camera for the moving image sequence, which are continuously transmitted, in particular in real time, to the external image processing device. In this case, the preliminary image data may in particular be continuously transmitted to the external image processing device together with the aforementioned metadata, which metadata include camera sample-specific data or at least allow an assignment of camera sample-specific data to the preliminary image data. However, it may also be sufficient if these metadata are transmitted to the external image processing device only once during the recording of the moving image sequence, for example at the beginning of the recording.

[0069] According to another advantageous embodiment, the external image processing device comprises an on-site computer unit, which is connected to the camera via a local, preferably high-bandwidth data connection. Such a high-bandwidth data connection can be characterized, for example, by a data transmission rate of at least 1 Gbit / s, preferably at least 10 Gbit / s, in particular at least 100 Gbit / s, and can be provided, for example, by a local network (LAN; Local Area Network). The local network can be: a wired network, for example via Ethernet, a wireless network (WLAN; Wireless Local Area Network), for example according to one of the standards of the IEEE 802.11 standard series, or a partially wired and partially wireless network. In principle, however, the local, high-bandwidth data connection can also be realized by transmission via a storage medium, for example by "magazine exchange".

[0070] Advantageously, the on-site computing unit is located spatially close to the camera. In this respect, the on-site computing unit can be, in particular, an edge server. In particular, it can be a computing unit that is operated at the set. For the calculations performed by the on-site computing unit, in particular the application of the corrections mentioned, the on-site computing unit can include an integrated circuit (IC), a microprocessor, a central processing unit (CPU), a graphics processing unit (GPU), an application-specific integrated circuit (ASIC) and / or a field programmable gate array (FPGA), or at least be substantially formed thereof.

[0071] Here, it is preferred that the on-site computing unit generates and / or outputs processed image data. It can also be provided that, as an alternative or in addition, the on-site computing unit generates and / or outputs the mentioned partially processed image data or various (to varying degrees) partially processed image data. Here, the on-site computing unit can be designed to automatically generate and / or output processed and / or partially processed image data. However, it can also be provided that the on-site computing unit generates and / or outputs processed and / or partially processed image data in response to corresponding user inputs.

[0072] Another task of the on-site computing unit may be that the preliminary image data generated in the camera are temporarily stored in the on-site computing unit before the processed or partially processed image data are generated. At a later point in time, the processed or partially processed image data can then be generated from the temporarily stored preliminary image data, so that the generation of the processed or partially processed image data can be decoupled in time from the generation of the preliminary image data. At a later point in time, the preliminary image data temporarily stored in the on-site computing unit can also be transmitted to a computing unit and / or a memory of a cloud infrastructure (described in more detail below) in order to be further processed there, in particular processed or (temporarily) temporarily stored again.

[0073] According to a further advantageous embodiment, the external image processing device comprises a cloud infrastructure. Such a cloud infrastructure may in particular comprise a decentralized arrangement of image processing and storage devices (e.g. a plurality of decentralized servers), which contribute corresponding image processing or storage capacities to the cloud infrastructure. In this way, the image data, including metadata, can be transmitted to the cloud infrastructure, in which camera sample-specific data are determined on the basis of the metadata, in particular read from a memory (e.g. a database), and then used to generate processed image data. After this generation, the processed image data can finally be output or called up from the cloud infrastructure. In this case, the cloud infrastructure is arranged remote from the camera, i.e. at least spatially separated from the camera. However, in principle, at least a part of the cloud infrastructure can also be located at the production site where the image data are recorded.

[0074] Regardless of where the cloud infrastructure or different parts of the cloud infrastructure are located, the camera is connected to the cloud infrastructure in order to be able to transmit image data and, if necessary, other data, such as metadata, to the cloud infrastructure. The bandwidth of the connection can in particular be lower than the connection between the camera and the on-site computing unit mentioned above (if such an on-site computing unit is provided). Preferably, the camera is connected to the cloud infrastructure via a wide area network (WAN) or the Internet (GAN; Global Area Network). The corresponding network can be based on MPLS (Multiprotocol Label Switching) as a switching method and / or on IP (Internet Protocol) as a network protocol. The camera can be connected to the cloud infrastructure directly or indirectly, in particular via the local network mentioned above and, if necessary, via the on-site computing unit mentioned above. The cloud infrastructure can include one or more computing units (servers) as well as memories and / or databases. In particular, the cloud infrastructure can include the database mentioned above, in which the camera sample-specific data can be stored.

[0075] In this case, it is preferred that the cloud infrastructure comprises a computing unit which generates and / or outputs the processed image data. The computing unit can be designed as a cloud server, which can include an integrated circuit (IC), a microprocessor, a central computing unit (CPU), a graphics processing unit (GPU), an application-specific integrated circuit (ASIC) and / or a field programmable gate array (FPGA), or at least be substantially formed thereof. If the cloud infrastructure comprises a plurality of computing units, each of these computing units can be designed separately in this manner.

[0076] It can also be provided that, instead of or in addition to generating or outputting processed image data, the aforementioned computing unit of the cloud infrastructure generates and / or outputs the aforementioned partially processed image data or partially processed image data to a varying degree. Here, the computing unit can be designed to automatically generate and / or output processed or partially processed image data. However, it can also be provided that the computing unit generates and / or outputs processed or partially processed image data in response to corresponding user input.

[0077] According to another advantageous embodiment, the cloud infrastructure is connected to the local network via a wide area network or the Internet and to the on-site computing unit, in particular to the on-site computing unit via the local network. In this respect, the cloud infrastructure can also be connected to the camera in such a way that the cloud infrastructure is connected to the wide area network or the Internet and the camera is connected to the local network, wherein the local network is connected to the wide area network or the Internet.

[0078] According to a further advantageous embodiment, the preliminary image data are transmitted together with the metadata to a memory of the cloud infrastructure and stored therein and are read from the memory for generating processed image data and / or for generating partially processed image data. In other words, in this embodiment, the transmission of the preliminary image data together with the metadata to the external image processing device comprises: the preliminary image data together with the metadata are transmitted to the memory and stored therein; in this embodiment, the generation of processed image data or partially processed image data also comprises: the preliminary image data are first read from the memory, in particular again together with the metadata, and then the corresponding correction is applied thereto. The processed or partially processed image data can be generated in particular by means of the on-site computing unit mentioned, by means of the computing unit mentioned of the cloud infrastructure or by means of another computing unit of the external image processing device, wherein the preliminary image data are preferably read from the memory by the respective computing unit.

[0079] According to a further advantageous embodiment, the method further comprises that the preliminary image data are scrambled when they are generated according to the camera sample-specific data in such a way that the preliminary image data are brought into an irregular order relative to a regular order. The regular order can correspond, for example, to the arrangement of sensor cells along rows and / or columns of the image sensor, or to the arrangement of row amplifiers and / or column amplifiers of the image sensor, or to the arrangement of analog / digital converters of the image sensor or of a readout electronics separate therefrom. In such an embodiment, the metadata can include information about the scrambling, and the correction depending on the camera sample-specific data can include re-de-scrambling the preliminary image data in dependence on the information about the scrambling in such a way that the preliminary image data are brought from the irregular order into a regular order.

[0080] In principle, this scrambling, also called scrambling, can only take place in the external image processing unit, for example when it is used for an encryption. However, it is preferably carried out in the camera or in any case before transmission to the external image processing device, in particular when it is used to mask deviations between different components of the readout electronics, such as row or column amplifiers, i.e. amplifiers respectively assigned to an entire row or column of sensor cells of the image sensor.

[0081] The reason for this is that if individual row or column amplifiers amplify the image signal values ​​generated by the sensor cells in the respective row or column to a greater or lesser extent than the adjacent row or column amplifiers, these rows or columns may appear as brighter or darker stripes in the image than their surroundings. This can be avoided by scrambling in that the image signal values ​​of the respective row or column are shifted to (closer or further away) adjacent rows or columns depending on their position in the row or column, so that these image signal values ​​are amplified by means of the row or column amplifiers of the adjacent rows or columns and the rows or columns are "scrambled" in this respect (see, for example, DE 10 2007 058 973 A1 or DE 10 2007 027 463 A1). In the respective individual images, consecutive columns or rows are displaced relative to one another to different degrees (along their respective longitudinal direction) due to the scrambling, so that lighter or darker stripes running perpendicular to the displacement caused by deviations between the row or column amplifiers are distributed over a plurality of rows or columns after the displacement is cancelled (descrambling) and are blurred, so to speak, to a certain extent. In this way, the scrambling makes these deviations have a less perceptible effect on the image.

[0082] In particular, since the deviations between the row or column amplifiers are usually camera sample specific, the pattern in which the scrambling is performed (i.e. which row or which column is shifted how far) may also be camera sample specific. In this respect, the information mentioned about the scrambling may in particular comprise the respective pattern, which is then included as part of the camera sample specific data in a correction depending on the camera sample specific data, the correction comprising the descrambling. If the image data are motion image data, the pattern may also vary over time and thus may not necessarily be the same pattern for a plurality of consecutive individual images, wherein the temporal dependency of the pattern may also be camera sample specific and may therefore be part of the camera sample specific data.

[0083] In principle, it can also be provided that the described generation of partially processed image data also includes re-descrambling the preliminary image data in dependence on the information about the scrambling. Here (similar to what has already been described above), the corresponding correction can be limited to re-descrambling only a portion of the scrambled preliminary image data. In the case of moving image data, this can in particular mean that, as has already been described in a general manner, when generating partially processed image data, not all individual images are re-descrambled, but the descrambling is limited to a portion of the image data that is sufficient to play these image data at a refresh rate that is reduced compared to the refresh rate used to record the image data. For example, it can be provided that the image sensor is operated to generate image signal values ​​at a refresh rate of 60 fps (frames per second) or 120 fps, so that the preliminary image data generated therefrom and scrambled also have this refresh rate. Then, when generating partially processed image data, for example, only every second or fourth individual image of the preliminary image data is re-descrambled, while the remaining individual images do not have to be descrambled or are simply omitted, so that these partially processed image data have a correspondingly reduced refresh rate of, for example, 30 fps. Such partially processed image data with a reduced refresh rate can then be displayed on a monitoring device (for example in an electronic viewfinder or on a monitor) so that the exposure can be checked quickly with relatively little effort. BRIEF DESCRIPTION OF THE DRAWINGS

[0084] In the following, the invention is further explained by way of example only with reference to the accompanying drawings.

[0085] Figure 1 In a simplified schematic diagram, an image recording system is shown which is designed to carry out an embodiment of the method according to the invention.

[0086] Figure 2 The sequence of one specific embodiment of the method according to the invention is explained in a schematic diagram.

[0087] Reference numerals

[0088] 11 Image Recording System

[0089] 13 Camera

[0090] 15 Image Sensor

[0091] 17 Viewfinder

[0092] 19 Set

[0093] 21 External image processing device

[0094] 23 Field computing units

[0095] 25 Cloud Infrastructure

[0096] 27 Computational Units

[0097] 29 Database

[0098] 31 Memory

[0099] 33 Local Network

[0100] 35 Internet

[0101] 37-49 Methods and Steps DETAILED DESCRIPTION

[0102] exist Figure 1 1 shows an image recording system 11, with the aid of which image data can be generated and processed. The image data are generated with the aid of a camera 13 of the image recording system 11, which comprises an image sensor 15. The camera 13 also comprises an electronic viewfinder 17. The camera 13 is part of a set 19, on which a scene (not shown) is recorded, for example, with the aid of the camera 13. The image recording system 11 also comprises an external image processing device 21, which is designed to be separate from the camera 13.

[0103] In the embodiment shown, the external image processing device 21 comprises, on the one hand, an on-site computing unit 23 acting as an edge server, and, on the other hand, a cloud infrastructure 25, which for its part comprises one or more computing units 27, a database 29 and / or a memory 31. In this case, the on-site computing unit 23 is located on the set 19 and is connected to the camera 13 via a local network 33, so that it can receive image data from the camera 13 via the local network 33. In this case, the connection between the camera 13 and the on-site computing unit 23 via the local network 33 can be wired or wireless. In contrast, the cloud infrastructure 25 is designed to be remote from the set 19 and can also be distributed in different places, such as different computing centers. The cloud infrastructure 25 is connected to the on-site computing unit 23 via the Internet 35, wherein the connection can be in the form of: the cloud infrastructure 25 is connected to the local network 33 via the Internet 35. In this case, the connection between the camera 13 and the on-site computing unit 23 via the local network 33 has a higher bandwidth than the connection to the cloud infrastructure 25 via the Internet.

[0104] The image recording system 11 is designed to carry out the method according to the invention. Figure 2 A possible embodiment of the method according to the invention is explained in FIG. 1 , wherein the individual steps 37 - 49 of the method are shown as blocks.

[0105] In step 37 of the method, camera sample-specific data about the determined characteristics of the camera 13 (in particular the image sensor 15 of the camera 13, the individual sensor units of the image sensor 15 and / or the readout electronics) are provided, which characteristics may differ from the camera model-generic characteristics of the camera 13 (in particular the image sensor 15, the individual sensor units or the readout electronics). These camera sample-specific data can be provided, for example, by registering them in a database 29 of the cloud infrastructure 25. From this database, these camera sample-specific data can then be read out based on identification information about the respective camera sample, i.e. about the specifically used camera 13.

[0106] The method further comprises step 39, in which the image sensor 15 is operated to generate corresponding image signal values ​​according to the intensity of the light incident on the sensor unit. The method further comprises: step 41, in which the image signal values ​​are read in the camera 13; and step 43, in which preliminary image data are generated in the camera 13 from these image signal values.

[0107] In a further step 45 of the method, the preliminary image data are transmitted to the external image processing device 21, i.e. in the example shown anyway initially to the on-site computing unit 23, together with metadata, which metadata include camera sample-specific data or at least allow, for example in the form of the mentioned identification information, an assignment of the camera sample-specific data stored in the database 29 to the preliminary image data. The external image processing device 21 then generates processed image data in a step 47 of the method by applying a correction dependent on the camera sample-specific data to the preliminary image data, wherein this can be done in the on-site computing unit 23 and / or in the computing unit 27 of the cloud infrastructure 25.

[0108] In the illustrated embodiment of the method, it is also provided that the external image processing device 21 can also generate only partially processed image data in a further step 49 by applying a simplified correction to the preliminary image data, which is independent of the camera sample-specific data or which is at least less dependent on the camera sample-specific data than the correction applied to generate the (completely) processed image data in step 47. Alternatively, it is also possible to generate these partially processed image data in the camera in step 49 by applying a correction dependent on the camera sample-specific data to only a part of the preliminary image data. After the processed image data or partially processed image data have been generated, these image data can be stored and / or output respectively.

[0109] In particular, it can also be provided that the image sensor 15 is controlled to continuously generate image signal values, which are continuously read in the camera 13 and preliminary image data are continuously generated from these image signal values, which are then continuously transmitted to the external image processing device 21. The external image processing device 21 can continuously generate partially processed image data based on the transmitted preliminary image data, and output these partially processed image data to a monitor device, in particular the mentioned electronic viewfinder 17 of the camera 13, on which these partially processed image data are continuously displayed. In this way, the image data can be viewed as a live image in a partially processed form during its recording. Instead of being displayed on the viewfinder 17 or in addition to being displayed on the viewfinder, these partially processed image data can also be continuously output to a monitor device separate from the camera 13 and then displayed on the monitor device.

[0110] Here, whether (completely) processed image data are generated and / or whether only partially processed image data are generated may depend on whether the external image processing device 21 receives the first user input or the second user input. Therefore, by means of corresponding user input, it is advantageously possible to select to what extent the image data should be processed, so that the method enables images of different qualities to be obtained as required.

Claims

1. A method for generating image data by means of a camera (13) and for processing the image data by means of an external image processing device (21), in, The camera (13) comprises an image sensor (15) having a plurality of light-sensitive sensor cells arranged in rows and columns, and readout electronics. Wherein, the method comprises: - providing camera model specific data about determined characteristics of the camera (13), which characteristics can be different from camera model generic characteristics of the camera (13); - operating the image sensor (15) to generate corresponding image signal values ​​according to the intensity of light incident on the sensor unit; - reading the image signal values ​​in the camera (13) and generating preliminary image data from the image signal values; - transmitting the preliminary image data to the external image processing device (21) together with metadata, the metadata comprising the camera sample specific data or at least allowing the assignment of the camera sample specific data to the preliminary image data; and - the external image processing means (21) generates processed image data by applying a correction depending on the camera sample specific data to the preliminary image data.

2. The method according to claim 1, in, The camera sample-specific data relate to characteristics of the image sensor (15) and / or characteristics of the readout electronics.

3. The method according to claim 1, in, The camera sample-specific data relate to individual characteristics of individual sensor cells of the image sensor (15).

4. The method according to claim 1, in, The camera sample specific data comprises: a gain-correction offset of the sensor unit; a gain-correction factor of the sensor unit; and / or status information about a defective sensor unit of the image sensor (15).

5. The method according to claim 1, in, The camera sample specific data include parameters of a non-linear characteristic curve of a sensor unit of the image sensor (15).

6. The method according to claim 1, in, the metadata additionally comprising shooting-specific data about operating conditions which were already present during the generation of the image signal values ​​and which are suitable for influencing the generation of the image signal values, In this case, the mentioned correction is additionally dependent on the acquisition-specific data.

7. The method according to claim 1, in, Providing the camera sample specific data comprises: storing the camera sample specific data in a database (29), wherein the metadata transmitted to the external image processing device (21) includes identification information about the camera (13) or a portion of the camera (13), and The method comprises: the external image processing device (21) reads the camera sample specific data from the database (29) according to the identification information and assigns the camera sample specific data to the transmitted preliminary image data.

8. The method according to claim 7, in, Reading the camera sample specific data from the database (29) requires evidence of a read authorization received within the framework of a user input.

9. The method according to claim 1, The method further comprises: - Partially processed image data are generated in the camera (13) or by the external image processing device (21).

10. The method according to claim 9, in, The portion of processed image data is generated by applying a correction depending on the camera sample specific data to a portion of the preliminary image data.

11. The method according to claim 10, in, The portion of the preliminary image data to which the correction is applied is adjustable.

12. The method according to claim 9, in, The preliminary image data corresponds to a motion image sequence, the motion image sequence comprising a sequence of multiple individual images, wherein the partially processed image data is generated by applying a correction that depends on the camera sample specific data only to a portion of the preliminary image data corresponding to a subset of the multiple individual images, while not applying such correction to a remaining portion of the preliminary image data corresponding to other individual images of the multiple individual images.

13. The method according to claim 12, in, A subset of the plurality of individual images corresponds to a first refresh rate of the motion image sequence, wherein all of the plurality of individual images correspond to a second refresh rate of the motion image sequence, and wherein the second refresh rate is higher than the first refresh rate.

14. The method according to claim 9, in, The partially processed image data are generated by applying a simplified correction to the preliminary image data, which simplified correction depends on the camera sample-specific data to a lesser extent than the mentioned correction.

15. The method according to claim 9, in, The partially processed image data are generated by applying a simplified correction to the preliminary image data, the simplified correction being independent of the camera sample specific data.

16. The method according to claim 9, in, The external image processing device (21) is designed to receive user input, and The external image processing device (21) generates and / or outputs the processed image data in response to a first user input, and generates and / or outputs part of the processed image data in response to a second user input.

17. The method according to claim 9, The method further comprises: The partially processed image data are continuously generated and output to a monitor device (17), on which the partially processed image data are continuously displayed.

18. The method according to claim 1, The method further comprises: The preliminary image data are continuously transmitted to the external image processing device (21), while further preliminary image data are continuously generated in the camera (13).

19. The method according to claim 1, The method further comprises: - generating partly processed image data by the external image processing device (21), wherein the preliminary image data is continuously transmitted to the external image processing device (21), and further preliminary image data is continuously generated in the camera (13), and The external image processing device (21) continuously generates the partially processed image data and outputs the partially processed image data to a monitor device (17), and the partially processed image data is continuously displayed on the monitor device.

20. The method according to claim 1, in, The external image processing device comprises an on-site computing unit (23) which is connected to the camera (13) via a local data connection (33).

21. The method according to claim 20, in, The on-site computing unit (23) generates and / or outputs the processed image data.

22. The method according to claim 1, in, The external image processing device (21) includes a cloud infrastructure (25), and the camera (13) is connected to the cloud infrastructure via a wide area network (WAN) or the Internet (35).

23. The method according to claim 22, in, The cloud infrastructure (25) comprises a computing unit (27) which generates and / or outputs the processed image data.

24. The method according to claim 22, in, The external image processing device comprises an on-site computing unit (23), which is connected to the camera (13) via a local data connection (33) via (23), wherein the cloud infrastructure (25) is connected to the local network (33) and the on-site computing unit (23) via the wide area network or the Internet (35).

25. The method according to claim 22, in, Providing the camera sample specific data comprises: storing the camera sample specific data in a database (29), wherein the metadata transmitted to the external image processing device (21) includes identification information about the camera (13), the camera (13) includes a portion of the camera (13), and The method comprises: the external image processing device (21) reads the camera sample specific data from the database (29) according to the identification information and assigns the camera sample specific data to the transmitted preliminary image data, Therein, the cloud infrastructure (25) includes the mentioned database (29).

26. The method according to claim 22, in, The preliminary image data together with the metadata are transmitted to a memory (31) of the cloud infrastructure (25) and stored in the memory (31), and read from the memory (31) for generating the processed image data.

27. The method according to claim 1, The method further comprises: - scrambling the camera sample specific data according to the camera sample specific data when the preliminary image data is generated, in such a way that the preliminary image data is put into an irregular order relative to a regular order, wherein the metadata comprises information about the scrambling; and The correction depending on the camera sample-specific data comprises: re-de-scrambling the preliminary image data as a function of the information about the scrambling, in that the preliminary image data are brought from the irregular sequence into the regular sequence.

Images