Methods for generating and processing image data

Abstract

A method for generating image data using a camera comprising an image sensor with a plurality of light-sensitive sensor cells arranged in rows and columns, and for processing the image data using an external image processing device, includes the following steps: providing camera-specific data about determined camera properties that may differ from camera-model-generic properties; controlling the image sensor to generate respective image signal values ​​depending on the intensity of the light incident on the sensor cells; reading the image signal values ​​in the camera and generating preliminary image data from the image signal values;Transferring the preliminary image data, together with metadata that includes the camera-specific data or at least allows the camera-specific data to be associated with the preliminary image data, to the external image processing unit; and generating processed image data using the external image processing unit by applying a correction to the preliminary image data that depends on the camera-specific data.

Description

[0001] The invention relates to a method for generating image data and subsequently processing the image data.

[0002] Image data can be generated using a camera, which can be, in particular, a moving image camera that produces a sequence of individual images as image data, recorded at a specific frame rate. The camera can be an electronic camera and include an image sensor with a multitude of light-sensitive sensor cells arranged in rows and columns. The camera can also include readout electronics. Depending on the intensity of the light striking the sensor cells, the image sensor can generate corresponding image signal values ​​that can be read out and / or further processed by the readout electronics.From the image signal values, an image can then be generated (in various ways) which, depending on the image sensor, can have a large number of image points (pixels) arranged in rows and columns, each corresponding to one of the sensor cells.

[0003] The image signal values ​​read from the image sensor are initially raw image data, which cannot necessarily be displayed directly as a high-quality image. For example, the image sensor may be equipped with a color filter matrix that, according to a predefined color pattern, only allows light from a specific area of ​​the color spectrum to pass through to the individual sensor cells. This assigns each sensor cell of the image sensor, according to the color filter matrix, to one of, for example, three or four different color channels, which are defined by the area of ​​the color spectrum transmitted by the respective color filter.A common method is the use of a so-called Bayer filter, in which, of the four sensor cells arranged in two rows and two columns, two diagonally opposite sensor cells are equipped with a green transmitting color filter, and of the two remaining sensor cells, one is equipped with a red transmitting color filter and the other with a blue transmitting color filter. With such raw image data, therefore, initially only a single image signal value assigned to a single color channel exists for each pixel, with the image signal values ​​of neighboring pixels being assigned to different color channels.In order to display a realistic image based on this raw image data, further image signal values ​​must be determined for each pixel by interpolation (so-called demosaicing) from the image signal values ​​of neighboring pixels, which are assigned to the remaining color channels to which the image signal value of the respective pixel is not assigned.

[0004] For cameras of a specific model, the color filter used in that particular camera is generally known as a generic property of the camera or image sensor, and it can be assumed with certainty that every camera of that model actually uses the same color filter. However, other generic camera properties that are also important for generating a high-quality image from the image signal values ​​produced by the image sensor or from the raw image data generated therefrom are not as reliably established.

[0005] For example, a fixed nominal relationship between the intensity of the light incident on a particular sensor cell and the resulting image signal value generated by that sensor cell may be defined as a generic property of the camera model, particularly one that is the same for all sensor cells. Such a nominal relationship can be specified as a generic property for several instances of a camera model (i.e., of a type). However, the actual relationship may deviate from the nominal relationship, for example, due to manufacturing tolerances, and this deviation may vary for each sensor cell. Furthermore, individual sensor cells and / or individual amplifiers of the image sensor or parts of the downstream readout electronics of a particular camera instance may be defective.Such deviations of the actual properties from the camera model-generic properties can lead to disturbing artifacts in the image data, which is why, in order to generate a high-quality image from the image data, the aim is ideally to completely compensate for the deviations by means of an appropriate correction.

[0006] Therefore, it is generally necessary to determine the actual characteristics of each individual camera of a given model, particularly those of the image sensor and / or individual sensor cells and / or the readout electronics, which may deviate from the camera model-generic characteristics, for example, through calibration. The result of such a calibration, which may be stored within the camera, can then be used to correct disturbances in the image data resulting from discrepancies between the actual and camera model-generic characteristics.

[0007] Electronic cameras often include an integrated image processing unit, which can be implemented using specialized software and / or hardware. This unit is designed to perform the aforementioned interpolation and / or correction to generate processed image data that can then be directly displayed (for example, on a display unit integrated with or connected to the camera), saved, and / or output as a high-quality image. However, such in-camera image processing requires sufficiently high processing power, which necessitates correspondingly complex hardware and / or software. The computational effort increases with quality requirements as well as with parameters such as resolution (number of pixels) and frame rate, which typically continue to rise with technological advancements and increasing demands.As a result, the complexity and therefore the costs and power requirements of the camera increase.

[0008] To avoid this, it is conceivable to outsource the part of the image processing that does not depend on camera-specific data, such as the aforementioned deviations between the observed (actual) and camera-model-generic (nominal) properties, from the camera. This would allow each camera of a given model to deliver image data that can be processed uniformly to generate a high-quality image. However, while this reduces the computational effort required in the camera, it remains comparatively high due to the correction of these deviations still being performed within the camera—especially when meeting the quality standards demanded of the final image in professional film productions.

[0009] It is an object of the invention to provide a method for generating and processing image data that is suitable for keeping the complexity of data processing in the camera low and for meeting high quality requirements for the resulting image.

[0010] The problem is solved by a method having the features of claim 1. Advantageous further developments of the invention will become apparent from the dependent claims, the present description and the figures.

[0011] The method according to the invention relates to the generation of image data, in particular moving image data, by means of a camera and the processing of the image data by means of an external image processing device. The camera comprises an image sensor which (as described above) has a plurality of light-sensitive sensor cells arranged in rows and columns, as well as readout electronics downstream of the image sensor.

[0012] The method involves providing camera-specified data on observed camera properties that may differ from camera-model-generic properties. In particular, camera-specified data on deviations of the observed properties from the camera-model-generic properties may be provided. The camera-specified data on observed camera properties may relate to only a part of the camera, for example, the image sensor itself, the individual sensor cells of the image sensor, integrated signal amplifiers of the image sensor, integrated analog-to-digital converters (ADCs) of the image sensor, the camera's readout electronics itself, or parts thereof. The camera's readout electronics may comprise various components located outside the image sensor, for example, on a common circuit board or distributed across multiple components.The camera's readout electronics may include, for example, amplifiers, analog-to-digital converters, or electronic components for signal processing or control, such as an integrated circuit (IC), a microprocessor, a central processing unit (CPU), a graphics processing unit (GPU), an application-specific integrated circuit (ASIC), and / or a field-programmable gate array (FPGA).

[0013] The determined properties can be, in particular, actual properties of the camera (especially of the image sensor and the readout electronics), as distinct from merely nominal properties of the camera (as explained above). Determining these properties is not necessarily part of the method according to the invention, but may have already been carried out beforehand, for example, by a separate calibration procedure, which may, for instance, have already been performed by the camera manufacturer after its production. In principle, however, the method according to the invention can also include determining the (actual) properties, which then takes place before the camera-specific data is provided.

[0014] The aforementioned camera characteristics can affect all data acquired by means of the image sensor, in particular at least substantially uniformly, or only a part of the acquired data, e.g., one or more respective rows or columns of sensor cells of the image sensor.

[0015] In some embodiments, the aforementioned properties of the individual sensor cells may be limited to influencing the data acquired by the respective sensor cell. The determined properties of the individual sensor cells may, in particular, be represented in the form of a (calibration) matrix that has a number of rows and columns corresponding to the image sensor and includes one or more correction parameters and / or status information (for example, whether the respective sensor cell is defective or not) for each sensor cell of the image sensor. Such a matrix can also be used to parameterize non-linear characteristics of the sensor cells, as will be explained below.

[0016] The provision of camera-specific data can be achieved, in particular, by storing the camera-specific data in the camera, in an external database, and / or in other storage media. Advantageously, the camera-specific data is assigned identification information that allows the respective camera or its relevant components (especially the image sensor and / or the readout electronics or parts thereof) to which the camera-specific data refers to to be uniquely identified.

[0017] The method further comprises controlling the image sensor to generate specific image signal values ​​depending on the intensity of the light incident on the sensor cells. In particular, each sensor cell, provided it is not defective, generates one or (sequentially) several image signal values ​​depending on the intensity of the light incident on it. Preferably, the image sensor is controlled so that all sensor cells generate image signal values ​​synchronously at a specific, predetermined frame rate.

[0018] The process further includes reading out the image signal values ​​from the camera and generating preliminary image data from these values. The image signal values ​​can essentially be read directly from the image sensor. This can, in particular, involve digitizing the analog image signals generated by the sensor cells in the image sensor, which may be amplified and form the basis of the image signal values, using analog-to-digital converters. Image data is then generated from the read-out image signal values. This data may contain errors and artifacts, particularly due to possible deviations of the aforementioned determined properties from the camera model's generic properties, and is therefore referred to as preliminary image data.

[0019] Generating this preliminary image data can, in particular, involve aggregating the image signal values ​​into a sequence of individual frames. This process can, in principle, include some preprocessing of the image signal values, such as applying non-linear pre-amplification (pre-emphasis). Furthermore, demosaicing (interpolation of the aforementioned type) can also be performed, although this is not mandatory and interpolation can also be carried out at a later stage, particularly outside the camera. Preferably, however, no correction of errors and artifacts resulting from the aforementioned deviations is performed during the generation of the preliminary image data.

[0020] In some embodiments, however, it is also possible that the preliminary image data is preliminary (among other things) in that at least one correction (of potentially several planned corrections) is carried out, but only incompletely. For example, to mask deviations between amplifiers of the image sensor, especially row or column amplifiers, the image signals can be subjected to scrambling (so-called scrambling, which is described in more detail below) before they are amplified, whereby the correction is still incomplete until the scrambling is reversed after amplification (descrambling).

[0021] Furthermore, the procedure involves transferring the preliminary image data, along with metadata that includes camera-specific data or at least allows for the association of camera-specific data with the preliminary image data, to the external image processing unit. The image processing unit is considered external in that it is not integrated into the camera.

[0022] The preliminary image data and metadata can be transferred directly or indirectly (via one or more intermediaries) from the camera to the external image processing unit. The transfer can be wired, wireless, or a combination of both. Transfer via one or more data carriers is also possible, allowing the data (preliminary image data and metadata) to be stored, thus decoupling the data transfer from the recording process. Even when the transfer occurs via a data connection rather than data carriers, the data does not necessarily have to be transferred immediately after generation; it may be possible to temporarily store the data within the camera first.

[0023] Furthermore, it may be provided that the data are compressed, especially for a given transmission, and then preferably decompressed again before further processing.

[0024] The metadata can be specifically assigned to the image data, but it is not part of the image data itself. Instead, it contains additional information beyond the image information already included in the image data, namely, in particular, the aforementioned camera-specific data. However, the metadata can be integrated into the preliminary image data insofar as it can be combined with the preliminary image data in a single file or data stream. Alternatively, the metadata can also exist separately from the preliminary image data and thus be transmitted separately.The fact that the preliminary image data is transmitted together with the metadata does not necessarily mean that the preliminary image data and the metadata are transmitted together, but in particular that both the preliminary image data and the metadata are transmitted to the external image processing device, preferably simultaneously or at least sequentially, and are related to each other, for example by the metadata containing a reference to the preliminary image data and / or conversely the preliminary image data containing a reference to the metadata.

[0025] The metadata does not necessarily have to include the camera-specific data itself. For example, it may be sufficient for the metadata to include identification information about the camera (especially the image sensor and / or the readout electronics or parts thereof), i.e., information that allows the camera used to generate the preliminary image data, or its image sensor, to be uniquely identified. This identification information can then be used to match camera-specific data already present in the external image processing unit with the preliminary image data, or to obtain camera-specific data from elsewhere, for example, by reading it from an external database (which will be described in more detail below).In this way, the camera-specific data can be assigned to the preliminary image data using the metadata, without having to be contained in the metadata itself that is transmitted along with the preliminary image data.

[0026] Furthermore, the process involves the external image processing unit generating processed image data by applying a correction, dependent on camera-specific data, to the preliminary image data. The processed image data is thus generated from the transmitted preliminary image data by applying a correction to the preliminary image data. This correction serves to eliminate errors and artifacts that may arise from the aforementioned deviations between the observed and camera-model-generic properties.This correction incorporates camera-specific data that was transmitted along with the preliminary image data or assigned to the preliminary image data after it was already present in the external image processing unit or obtained from elsewhere; for example, the camera-specific data can be incorporated as parameters into the respective correction. If a correction already occurs during the generation of the preliminary image data, but is only incomplete, applying the correction dependent on the camera-specific data can also include completing this incomplete correction, whereby even the mere completion is preferably still dependent on the camera-specific data.

[0027] The fact that the correction applied to the preliminary image data depends on the camera-specific data has the additional advantage that access to this data is a prerequisite for applying the correction. If the metadata does not directly include the camera-specific data, but merely provides identification information or otherwise allows the camera-specific data to be linked to the preliminary image data, then restricting access to the camera-specific data advantageously controls who can apply the correction, which depends on the camera-specific data, to produce processed image data of the highest quality. For example, access to the camera-specific data (possibly in addition to the identification information for retrieving the correct, i.e.,In addition to the camera-specific data, an access key (e.g., a license key) may be required. Alternatively, it can be ensured that the correction, which depends on the camera-specific data, can only be carried out by a limited number of authorized personnel, in particular only by the camera manufacturer. The correction, which depends on the camera-specific data, can thus be performed at different authorization and quality levels.

[0028] After the processed image data has been generated, it can then be output by the external image processing unit.

[0029] The generation of processed image data is not limited to the aforementioned correction dependent on camera-specific data. Rather, the generation of processed image data can additionally include other image processing and image preparation steps that may be independent of the camera-specific data. In particular, if the image data comprises multiple color channels and the preliminary image data does not yet contain values ​​in all color channels for every pixel, the generation of processed image data may also include interpolation (demosaicing) to add values ​​for each pixel in those color channels where no values ​​yet exist. However, such interpolation may already have been performed in the camera during the generation of the preliminary image data from the image signal values ​​and therefore may no longer be necessary when generating the processed image data.Furthermore, the processed image data can still be uninterpolated, meaning that although it may have multiple color channels, each pixel may only have a value in one of the respective color channels (e.g., according to the aforementioned Bayer filter).

[0030] The inventive method advantageously eliminates the need for the camera to be designed to generate fully processed, high-quality image data, thus keeping the computational effort required by the camera comparatively low. This allows the camera to have reduced complexity compared to conventional cameras. At the same time, the metadata ensures that image processing can be carried out or completed outside the camera, namely in the external image processing unit, based on the necessary camera-specific data. This corrects potential errors or artifacts resulting from deviations between the actual and nominal properties of the specific camera unit, ultimately resulting in high-quality image data. Since the metadata, particularly the camera-specific data, is generally global, i.e.,Since the metadata applies to all image data recorded with the respective camera model, or at least remains constant over time, for example for the duration of a respective recording sequence, its volume is small compared to the data volume of the image data, so that the additional transmission of the metadata does not result in any significant additional effort even if the camera-specific data is directly contained in the metadata.

[0031] The aforementioned correction applied to the preliminary image data can include one or more types of image data correction (possibly raw image data). For example, offset correction and / or gain correction can be applied, in which any gain involved in reading the image signal values ​​and / or generating the preliminary image data from the image signal values ​​is corrected by a correction offset or correction factor, which is specified individually for each sensor cell.

[0032] A more complex correction can involve making the correction factor signal-dependent. For example, the gain of the image signal values ​​of the individual sensor cells can be corrected using a non-linear characteristic curve, where the parameters of the characteristic curve are preferably individually defined for each sensor cell. The various image signal values ​​can then be transformed using the characteristic curve specific to each sensor cell.

[0033] Furthermore, a correction can be made to compensate for the fact that individual sensor cells are defective, for example by replacing values ​​of pixels corresponding to a defective sensor cell in the preliminary image data with estimated values, such as those obtained by interpolation from values ​​of neighboring pixels.

[0034] Therefore, an embodiment of the invention is advantageous in which the camera-specific data includes gain correction offsets of the sensor cells, gain correction factors of the sensor cells, parameters of non-linear characteristics of the sensor cells, and / or status information about defective sensor cells. A gain correction offset or correction factor of a respective sensor cell is an offset or factor for correcting a gain that is incorporated into the readout of an image signal value generated by the respective sensor cell or into the generation of preliminary image data (among other things) from this image signal value and may be erroneous due to the aforementioned possible deviations between the observed and camera model-generic properties.

[0035] Alternatively or additionally to applying a gain correction offset or a gain correction factor, a non-linear correction can be applied to the image signal values ​​using a characteristic curve, preferably defined individually for each sensor cell. This allows a signal-dependent correction to be applied to the image signal values ​​of the image sensor or to the preliminary image data generated therefrom. Such a characteristic curve can assign a modified image signal value to different image signal values ​​and thus corresponds to a (non-linear) transformation of the image signal values. The respective characteristic curve can be defined, for example, as a function or as a lookup table, preferably based on the results of a calibration of the respective image sensor.To define an individual characteristic curve for each sensor cell while keeping the amount of camera-specific data low, the characteristic curve can be partially defined the same for all sensor cells. This can be achieved, for example, by determining (to approximate the calibration result) reference points of the characteristic curve that are identical for all sensor cells, thus effectively "constricting" the sensor cell characteristic curves to these points. Preferably, but at least partially, the characteristic curves are also defined by sensor cell-specific parameters, which allow the shape of the respective characteristic curve between two reference points to be individually specified for each sensor cell.

[0036] The gain correction offsets and gain correction factors, or the sensor cell-specific parameters of the non-linear characteristics, only need to be available for those sensor cells that are not defective according to the aforementioned status information. Preferably, the respective information is available separately for each sensor cell, for example, in the form of a matrix that corresponds to the arrangement of the sensor cells in the image sensor. Thus, it can be known, in particular, for each sensor cell whether it is defective and, if it is not, with which gain correction offset and with which gain correction factor, or according to which non-linear characteristic, an image signal value generated by the respective sensor cell or a value derived therefrom from the preliminary image data should be corrected.

[0037] According to a further advantageous embodiment, the metadata additionally includes recording-specific data about operating conditions that existed during the generation of the image signal values ​​and that are at least capable of influencing the generation of the image signal values, or that actually do influence the generation of the image signal values, wherein the correction in question additionally depends on the recording-specific data. In particular, the metadata can include recording-specific data about deviations of the operating conditions from standard conditions with respect to which the aforementioned camera model-generic (nominal) properties are defined.

[0038] The image acquisition-specific data can include, in particular, physical quantities that describe the conditions under which the image signal values ​​are generated. An example of image acquisition-specific data is the temperature, especially the temperature of the image sensor and / or the readout electronics, during the generation of the image signal values. This can influence image sensor noise and / or, more generally, the relationship between the intensity of the light incident on a particular sensor cell and the image signal value generated by that sensor cell in response. Furthermore, atmospheric pressure and / or mechanical stress (static forces) and / or acceleration values ​​(dynamic forces) can also influence the generation of the image signal values.

[0039] According to a further advantageous embodiment, providing the camera-specific data comprises storing the camera-specific data in a database, wherein the metadata transmitted to the external image processing unit includes identification information about the camera or parts thereof, in particular the image sensor and / or the readout electronics. In such an embodiment, the method comprises the external image processing unit using the identification information to read the camera-specific data from the database and assign it to the transmitted preliminary image data. The identification information may, for example, be one or more serial numbers of the camera or a component thereof, in particular the image sensor, the readout electronics, and / or another electronic component of the camera, such as a relevant circuit board.

[0040] In this case, the metadata does not need to directly include the camera-specific data, as it can be retrieved from the database. Specifically, the identification information transmitted as part of the metadata allows the camera model used to generate the preliminary image data, or its image sensor or readout electronics, to be identified. This enables the data specific to that camera model to be retrieved from the database and assigned to the preliminary image data. Subsequently, a correction dependent on this camera-model-specific data can be applied to the preliminary image data. In such a case, the camera-model-specific data may have been determined once for that particular camera model during calibration and stored in the database, for example, by the camera manufacturer.

[0041] According to an advantageous further development of such an embodiment, reading the camera-unit-specific data from the database requires proof of read authorization received as part of a user input. The external image processing unit can be configured, in particular, to receive user input in order to obtain this proof of read authorization. However, the user input does not necessarily have to be entered directly at the external image processing unit; the external image processing unit can also receive it via transmission from another device where it was entered. The proof could, for example, be a password or a license key.However, it is also conceivable that the mere knowledge of the aforementioned identification information about the camera, the image sensor and / or the readout electronics could be considered proof of readout authorization.

[0042] The verification can be received from the external image processing unit as part of the user input. For example, the user input could consist of first requesting the generation of the processed image data and then entering proof of authorization to read the data. Alternatively, the verification can be stored in advance in the external image processing unit and thus be available as part of a later user input (request for processed image data).

[0043] Verification of data retrieval authorization based on proof of authorization can be performed, for example, directly in the external image processing unit or in the database. In other words, the external image processing unit can be configured to verify proof of authorization and only retrieve camera-specific data from the database if the authorization is confirmed by the verification process. Alternatively or additionally, it can be implemented that proof of authorization is also verified in the database, and retrieval of camera-specific data is only permitted if the authorization is confirmed by the verification process. In this way, the generation of (fully) processed image data of the highest quality can be made contingent on each user possessing proof of authorization.This can advantageously prevent unauthorized use of the image data, at least with high quality. At the same time, it can be provided that partially processed image data of lower quality can also be obtained without the aforementioned proof.

[0044] According to a further advantageous embodiment, the method further comprises generating partially processed image data in the camera or by the external image processing unit. After generating the partially processed image data, this data can be output by the camera or by the external image processing unit.

[0045] Partially processed image data can be generated by applying a correction, dependent on camera-specific data, to a portion of the preliminary image data. This correction is not applied, or at least not completely, to the remaining portion of the image data. This remaining portion can then be included in the partially processed image data either without the correction, with the incomplete correction, or not at all (i.e., simply missing from the partially processed image data), with the latter being preferred.

[0046] For example, the correction can be limited to a subset of the pixels of a particular frame of the image data. This subset can correspond to a specific, particularly central, section of the respective frame. If the image data consists of moving images comprising a sequence of multiple frames, the section can be the same for all frames; that is, the section has the same position and dimensions for each frame.

[0047] The subset of image data to which a correction is applied can also be formed by spatial subsampling, in particular by correcting only the pixels of each nth row and each mth column of a respective frame, while leaving the remaining pixels uncorrected or omitting them (where n and m are positive integers and preferably identical). The partially processed image data then exhibits—in the case of omitting image data—a reduced resolution compared to the resolution of the (fully) processed image data or to the resolution at which the image data were recorded.

[0048] In the case of moving image data, the subset of image data to which a correction is applied can also be formed by temporal subsampling, in particular by correcting only every nth frame and leaving the remaining frames uncorrected or omitted (where n is a positive integer). The partially processed image data then exhibits—in the case of omitted frames—a reduced frame rate compared to the frame rate of the (fully) processed image data or the frame rate at which the image data was recorded.

[0049] In particular, in some embodiments, the preliminary image data can correspond to a moving image sequence comprising a series of several individual images, wherein the partially processed image data is generated by applying a correction dependent on the camera-example-specific data only to a portion of the preliminary image data corresponding to a subset of the several individual images, while no such correction is applied to the remaining portion of the preliminary image data corresponding to the further individual images. In such embodiments, the subset of the several individual images can correspond to a first frame rate of the moving image sequence, with the entirety of the several individual images corresponding to a higher second frame rate of the moving image sequence.Thus, the partially processed image data can be displayed, for example, on a monitor device with a relatively low frame rate, whereas for playback or further processing of the preliminary image data with a relatively higher frame rate, a complete processing of the image data based on the camera-specific data is required.

[0050] Two or more of these options can also be combined. The partially processed image data may therefore be limited to a section, have a reduced resolution, and / or a reduced frame rate compared to the (fully) processed image data.

[0051] It is preferred if the part of the preliminary image data to which the correction is applied is adjustable, for example by allowing a specific section, resolution and / or frame rate to be selected from several predefined options or freely chosen as a specification for the partially processed image data.

[0052] Preferably, the correction applied to a portion of the preliminary image data to generate the partially processed image data is the same camera-unit-specific correction applied by the external image processing unit to generate the (fully) processed image data. Therefore, when generating the partially processed image data, the portion of the preliminary image data is not corrected less effectively than when generating the (fully) processed image data; rather, the correction is comprehensive in both cases. The difference lies, at least essentially, only in the fact that in one case the correction is applied to all preliminary image data, while in the other case it is applied only to a portion or part of it.

[0053] If partially processed image data is generated in the camera or by the external image processing unit, the external image processing unit can generate the (fully) processed image data at a later time by applying the correction, which depends on the camera-specific data, to the preliminary image data (in the form generated by the camera or in the partially processed form).

[0054] If partially processed image data has been generated, generating the (fully) processed image data can advantageously be limited to applying the correction to the remaining portion of the preliminary image data and combining the result with the partially processed image data to obtain the (fully) processed image data overall. However, this is not necessarily the case, as it is also conceivable that the partially processed image data is not used to generate the (fully) processed image data, but rather that the external image processing unit applies the correction to all preliminary image data independently of the partially processed image data.

[0055] Partially processed image data can be generated with less computational effort compared to fully processed image data, which is particularly advantageous for in-camera generation. Partially processed image data can, for example, allow the progress or result of an image recording to be reviewed directly at the camera or on an attached display device without excessive effort. Generating the fully processed image data outside the camera can then be made contingent upon proof of authorization, in particular the aforementioned authorization to access the camera-specific data. In this way, the generation of high-quality image data can be made dependent on authorization, especially in the form of a license key, without impairing the ability to directly review the progress or result of a recording.

[0056] Alternatively or additionally, to generating partially processed image data by applying a correction (only) to a portion of the preliminary image data, partially processed image data can also be generated by applying a different, and in particular simpler, correction to the preliminary image data than that used to generate the (fully) processed image data (whether to all preliminary image data or only to a portion thereof). Specifically, partially processed image data can be generated in the camera or by the external image processing unit by applying a simplified correction to the preliminary image data that is independent of the camera-specific data or that depends less on the camera-specific data compared to the aforementioned correction applied to generate the (fully) processed image data.

[0057] In some embodiments, the simplified correction can be simplified precisely insofar as it is independent of the camera-specific data.

[0058] In other embodiments, the simplified correction may depend to a lesser extent on camera-specific data compared to the aforementioned (comprehensive) correction. In particular, the simplified correction may depend on a smaller number of camera-specific data points compared to the aforementioned (comprehensive) correction. It may also be simplified in that it is limited to a correction of less complexity than the aforementioned (comprehensive) correction, for example, by performing the correction with parameters of lower result quality and / or by simply omitting one or more parts of the correction. In principle, all camera-specific data that are also included in the aforementioned (comprehensive) correction can be incorporated into the simplified correction.

[0059] Preferably, the degree to which the simplified correction depends less on camera-specific data compared to the aforementioned (complete) correction is adjustable. In other words, the degree to which the partially processed image data should already be processed can be set. The range can extend from minimally partially processed to almost completely processed. It is also conceivable that the image processing unit can optionally be set to directly generate completely processed image data. Depending on the correction method used, the aforementioned degree of processing can be adjusted quasi-continuously or even continuously.

[0060] If the simplified correction is independent of the camera-specific data, it can, for example, be limited to mere interpolation (demosaicing), by which values ​​are calculated for each pixel of the image data from values ​​of neighboring pixels in those color channels in which no values ​​yet exist for that pixel.

[0061] The partially processed image data generated by simplified correction is generally of lower quality than the (fully) processed image data due to the lack of or reduced consideration of camera-specific data. Similarly, the partially processed image data generated by correcting only a portion of the preliminary image data is also of reduced quality compared to the (fully) processed image data, as not all preliminary image data has been (comprehensively) corrected in this case. Therefore, in both cases, the partially processed image data is generally insufficient for producing the highest quality image required, for example, for projection onto a cinema screen.However, the partially processed image data can, for example, be used to generate control images with relatively little effort. These control images (such as a digital viewfinder image) can be used during or shortly after image recording to check the image content, particularly the successful realization of visual design goals. Furthermore, the partially processed data can be used in the form of so-called proxies for preliminary editing decisions, while the final edit is carried out later using the (fully) processed image data of the highest quality.

[0062] If partially processed image data is generated, it can also be used for the aforementioned generation of (fully) processed image data by applying an additional, camera-specific correction to the partially processed image data generated by the simplified correction. The generation of the (fully) processed image data is therefore at least a two-stage process, since the overall correction applied to the preliminary image data includes at least the simplified correction and the additional correction. More than two stages can also be provided, preferably with the number of stages being adjustable and / or the stage to which the simplified correction should extend being adjustable. Furthermore, the generation of the (fully) processed image data can, in principle, also be independent of the generation of partially processed image data.

[0063] According to an advantageous further development of the above embodiment, the external image processing device is configured to receive user inputs, wherein the external image processing device generates and / or (if the processed image data has already been generated previously) the processed image data in response to a first user input, and generates and / or (if the processed image data has already been generated previously) the partially processed image data in response to a second user input different from the first user input.Depending on whether the external image processing unit receives the first or the second user input, either the (fully) processed image data generated by the correction dependent on the camera-specific data or the partially processed image data generated by the simplified correction independent of or to a lesser extent dependent on the camera-specific data are produced and / or output.

[0064] The designation of user inputs as first and second is not to be understood as chronological or hierarchical, but rather serves to conceptually distinguish between the two user inputs, which may differ in their nature and / or content. At least the first user input may, if necessary, include the aforementioned proof of read authorization.

[0065] More user inputs than just the first and second can be distinguished. In response to these, the external image processing unit generates and / or outputs partially processed image data. These inputs differ from the second input and from each other in that they generate and / or output partially processed image data to varying degrees, for example, by applying different simplified corrections to the preliminary image data. The various simplified corrections can differ, in particular, with regard to whether and, if so, on which and / or how many camera-specific data points they depend. In this way, the degree of image data processing, and thus the quality of the resulting image, can be selectively adapted to the specific requirements through appropriate user input.

[0066] According to an advantageous embodiment, the partially processed image data (whether generated in the camera or by the external image processing unit) is continuously generated and output to a monitor, where it is continuously displayed. In particular, preliminary image data can be continuously generated in the camera, from which either partially processed image data is generated in the camera or which is transferred to the external image processing unit, where partially processed image data is generated. The partially processed image data is then also continuously output to a monitor, where it is finally displayed. The monitor can be a device separate from the camera or integrated into the camera, for example, in the form of a digital viewfinder.

[0067] Through continuous processing of the image data, the image displayed on the monitor can be a live image, enabling monitoring and immediate control of the captured image content during the recording of a moving image sequence (i.e., a sequence of several individual images). Since the image data does not need to be fully processed for this purpose, it is sufficient to continuously generate and output partially processed image data to the monitor. The (fully) processed image data does not also need to be generated continuously, but can be generated at a later time, for example, during general post-production.

[0068] In principle, independent of the foregoing embodiments, the method according to a further advantageous embodiment can also include continuously transferring the preliminary image data (from the camera) to the external image processing unit while further preliminary image data is continuously generated in the camera. In other words, during the recording of a moving image sequence (a sequence of several individual images) in which preliminary image data is continuously generated in the camera, this preliminary image data is continuously transferred, particularly in real time, to the external image processing unit. Specifically, the preliminary image data can be continuously transferred to the external image processing unit together with the aforementioned metadata, which includes the camera-specific data or at least allows for the association of the camera-specific data with the preliminary image data.However, it may also be sufficient if this metadata is only transmitted once during the recording of a moving image sequence, for example at the beginning of the recording, to the external image processing device.

[0069] According to a further advantageous embodiment, the external image processing unit comprises an on-set computing unit connected to the camera via a local, preferably high-bandwidth, data connection. Such a high-bandwidth data connection can, for example, be characterized by data transmission rates of at least 1 Gbit / s, preferably at least 10 Gbit / s, and particularly at least 100 Gbit / s, and can be provided, for example, by a local area network (LAN). The local network can be a wired network, for example, via Ethernet, a wireless network (WLAN), for example, according to one of the standards of the IEEE 802.11 family of standards, or a partially wired and partially wireless network. In principle, however, the local, high-bandwidth data connection can also be established by transmission via a storage medium, e.g.,This can be achieved through a magazine exchange.

[0070] The on-set computing unit is advantageously located in close proximity to the camera. Therefore, the on-set computing unit can be, in particular, an edge server. Specifically, it can be a computing unit operated on the set of a shoot. For the calculations performed by the on-set computing unit, especially the application of the aforementioned correction, the on-set computing unit can comprise, or at least be substantially composed of, an integrated circuit (IC), a microprocessor, a central processing unit (CPU), a graphics processing unit (GPU), an application-specific integrated circuit (ASIC), and / or a field-programmable gate array (FPGA).

[0071] It is preferred that the on-set processing unit generates and / or outputs the processed image data. Alternatively or additionally, the on-set processing unit may generate and / or output the aforementioned partially processed image data or various (to varying degrees) partially processed image data. The on-set processing unit may be configured to automatically generate and / or output the processed and / or partially processed image data. However, it may also be configured that the on-set processing unit generates and / or outputs the processed and / or partially processed image data in response to user input.

[0072] Another task of the on-set processing unit can be to temporarily store the preliminary image data generated by the camera before generating the processed or partially processed image data. At a later time, the processed or partially processed image data can then be generated from this temporarily stored preliminary data, thus decoupling the generation of the processed or partially processed image data from the generation of the preliminary image data. The preliminary image data temporarily stored in the on-set processing unit can also be transferred at a later time to a processing unit and / or storage in a cloud infrastructure (described in more detail below) for further processing, in particular processing, or for (temporary) temporary storage there as well.

[0073] According to a further advantageous embodiment, the external image processing device comprises a cloud infrastructure. Such a cloud infrastructure can, in particular, include a distributed arrangement of image processing and storage devices (e.g., several distributed servers), each contributing its respective image processing and storage capacity to the cloud infrastructure. In this way, image data, including metadata, can be transferred to the cloud infrastructure, where camera-specific data is determined based on the metadata, in particular read from a storage medium (e.g., a database), and then used to generate the processed image data. After generation, the processed image data can finally be output or retrieved from the cloud infrastructure. The cloud infrastructure is located remotely from the camera, i.e., at least spatially separated.However, at least part of the cloud infrastructure can, in principle, also be located at the production site where the image data is recorded.

[0074] Regardless of the location of the cloud infrastructure or its various components, the camera is connected to the cloud infrastructure to transmit image data and, if applicable, other data such as metadata. This connection may have a lower bandwidth than the connection between the camera and the on-set computing unit (if one is provided). Preferably, the camera is connected to the cloud infrastructure via a wide area network (WAN) or the internet (GAN). The respective network may, for example, be based on MPLS (Multiprotocol Label Switching) as the switching method and / or IP (Internet Protocol) as the network protocol.The camera can be connected to the cloud infrastructure directly or indirectly, in particular via the aforementioned local network and, if applicable, via the aforementioned on-set computing unit. The cloud infrastructure can comprise one or more computing units (servers) as well as storage and / or databases. In particular, the cloud infrastructure can include the aforementioned database, in which the camera-specific data may be stored.

[0075] It is preferred that the cloud infrastructure includes a computing unit that generates and / or outputs the processed image data. This computing unit, which may be configured as a cloud server, may comprise, or at least be substantially composed of, an integrated circuit (IC), a microprocessor, a central processing unit (CPU), a graphics processing unit (GPU), an application-specific integrated circuit (ASIC), and / or a field-programmable gate array (FPGA). If the cloud infrastructure includes multiple computing units, each of these units may be configured in this way.

[0076] Furthermore, the aforementioned computing unit of the cloud infrastructure may, as an alternative or additional step to generating and / or outputting the processed image data, generate and / or output the aforementioned partially processed image data, or image data that is partially processed to varying degrees. The computing unit may be configured to automatically generate and / or output the processed or partially processed image data. Alternatively, the computing unit may be configured to generate and / or output the processed or partially processed image data in response to user input.

[0077] According to a further advantageous embodiment, the cloud infrastructure is connected to the local network via the wide area network or the internet and, in particular, to the on-set computing unit via the local network. In this respect, the cloud infrastructure can also be connected to the camera by the cloud infrastructure being connected to the wide area network or the internet and the camera being connected to the local network, wherein the local network is connected to the wide area network or the internet.

[0078] According to a further advantageous embodiment, the preliminary image data, together with the metadata, are transferred to a storage location within the cloud infrastructure and stored there. They are then read from this storage location to generate the processed image data and / or partially processed image data. In other words, in this embodiment, the transfer of the preliminary image data, together with the metadata, to the external image processing device includes transferring the preliminary image data, along with the metadata, to the storage location and storing it there. Furthermore, in this embodiment, the generation of processed image data or partially processed image data includes first reading the preliminary image data, again together with the metadata, from the storage location before applying the appropriate correction. The generation of processed or partially processed image data...Partially processed image data can be processed in particular by means of the aforementioned on-set computing unit, the aforementioned computing unit of the cloud infrastructure or any other computing unit of the external image processing facility, whereby the preliminary image data is preferably read from memory by this respective computing unit.

[0079] According to a further advantageous embodiment, the method further comprises scrambling the preliminary image data during its generation, depending on the camera-specific data, by rearranging the preliminary image data into an irregular sequence relative to a regular sequence. The regular sequence can, for example, correspond to the arrangement of the sensor cells along rows and / or columns along the image sensor, or the arrangement of row amplifiers and / or column amplifiers of the image sensor, or the arrangement of analog-to-digital converters of the image sensor or the separate readout electronics.In such embodiments, the metadata may include information about the scrambling, and the correction dependent on the camera-copy-specific data may include dis-scrambling the preliminary image data based on the scrambling information by bringing the preliminary image data from the irregular order into the regular order.

[0080] In principle, scrambling, also known as image scrambling, can only take place in the external image processing unit, for example, if it serves as a form of image data encryption. Preferably, however, scrambling takes place in the camera or at least before transmission to the external image processing unit, particularly when it serves to mask discrepancies between different components of the readout electronics, such as row or column amplifiers (i.e., amplifiers that are each assigned to an entire row or column of sensor cells of the image sensor).

[0081] Because if individual row or column amplifiers amplify the image signal values ​​generated by the sensor cells in the respective row or column to a greater or lesser extent than neighboring row or column amplifiers, these rows or columns can appear in the image as brighter or darker stripes compared to their surroundings. This can be avoided by scrambling, in which the image signal values ​​of a respective row or column are shifted, depending on their position within the row or column, to a (closer or further) adjacent row or column, so that they are amplified by the row or column amplifier of the adjacent row or column, and the rows or columns are thus "scrambled" (see, for example, DE 10 2007 058 973 A1 or DE 10 2007 027 463 A1). As a result of the scrambling, successive columns or columns in the respective individual frame are no longer visible.The rows are shifted relative to each other to varying degrees (along their respective longitudinal direction), so that lighter or darker bands running perpendicular to this shift, caused by deviations between the row or column intensifiers, are distributed across several rows or columns and, so to speak, blurred after the shift is reversed (descrambling). Thus, descrambling makes the deviations less noticeable in the image.

[0082] In particular, because the deviations between the row and column enhancers are usually camera-specific, the pattern according to which the scrambling occurs (i.e., which row or column is shifted by how much) can also be camera-specific. Therefore, the aforementioned scrambling information can specifically include this particular pattern, which then flows into the correction, dependent on the camera-specific data and encompassing the drafting, as part of the camera-specific data. If the image data is video data, the pattern can also vary over time, meaning it doesn't necessarily have to be the same for several consecutive frames. The temporal dependence of the pattern can also be camera-specific and thus part of the camera-specific data.

[0083] Furthermore, it is generally possible that the described generation of partially processed image data also includes the process of unscrambling the preliminary image data based on the information about the scrambling. In this process, the correction can be limited (similar to what was described above) to unscrambling only a portion of the scrambled preliminary image data. In the case of moving image data, this can mean, in particular, that—as already described in general terms—not all individual frames are unscrambled when generating the partially processed image data, but rather the scrambling is limited to a portion of the image data sufficient for playback at a reduced frame rate compared to the frame rate at which the image data was recorded.For example, the image sensor can be controlled to generate image signal values ​​at a frame rate of 60 fps (frames per second) or 120 fps, so that the resulting and scrambled preliminary image data also has this frame rate. When generating the partially processed image data, only every second or fourth frame of the preliminary image data is then unscrambled, while the remaining frames are either not unscrambled or simply omitted, resulting in a correspondingly reduced frame rate of, for example, 30 fps. Such partially processed image data with a reduced frame rate can then be displayed on a monitor (for example, in an electronic viewfinder or on a monitor) so that a shot can be quickly checked with relatively little effort.

[0084] The invention will be further explained below by way of example only, with reference to the figures. Fig. Figure 1 shows a simplified schematic representation of an image recording system designed to carry out an embodiment of the method according to the invention. Fig. Figure 2 illustrates in schematic form the process of one embodiment of the method according to the invention.

[0085] In Fig. Figure 1 shows an image recording system 11, by means of which image data can be generated and processed. The image data is generated by a camera 13 of the image recording system 11, which includes an image sensor 15. The camera 13 also includes an electronic viewfinder 17. The camera 13 is part of a set 19, on which, for example, a scene (not shown) is recorded using the camera 13. The image recording system 11 also includes an external image processing unit 21, which is designed separately from the camera 13.

[0086] In the illustrated embodiment, the external image processing unit 21 comprises, on the one hand, an on-set computing unit 23, which functions as an edge server, and, on the other hand, a cloud infrastructure 25, which in turn comprises one or more computing units 27, databases 29, and / or storage 31. The on-set computing unit 23 is located at the set 19 and is connected to the camera 13 via a local network 33, enabling it to receive image data from the camera 13 via the local network 33. The connection between the camera 13 and the on-set computing unit 23 via the local network 33 can be wired or wireless. The cloud infrastructure 25, in contrast, is located remotely from the set 19 and can, in particular, be distributed across different locations, such as different data centers.The cloud infrastructure 25 is connected to the on-set computing unit 23 via the internet 35. This connection can be established by the cloud infrastructure 25 being connected to the local network 33 via the internet 35. The connection between the camera 13 and the on-set computing unit 23 via the local network 33 has a higher bandwidth than the connection to the cloud infrastructure 25 via the internet.

[0087] The image recording system 11 is configured to execute a method according to the invention. One possible embodiment of the method according to the invention is described in Fig. Figure 2 illustrates how individual steps 37-49 of the procedure are represented as blocks.

[0088] In step 37 of the procedure, camera-specified data about determined properties of the camera 13, in particular the image sensor 15, individual sensor cells of the image sensor 15, and / or readout electronics of the camera 13, are provided. These properties may differ from camera-model-generic properties of the camera 13, in particular the image sensor 15, the individual sensor cells, or the readout electronics. For example, the camera-specified data can be provided by storing it in the database 29 of the cloud infrastructure 25. From there, it can then be read out using identification information about the respective camera-specified camera, i.e., the specific camera 13 in use.

[0089] The method further comprises step 39, in which the image sensor 15 is controlled to generate respective image signal values ​​depending on the intensity of the light incident on the sensor cells. The method also comprises step 41, in which the image signal values ​​are read out in the camera 13, and step 43, in which preliminary image data is generated from the image signal values ​​in the camera 13.

[0090] In a further step 45 of the procedure, the preliminary image data, together with metadata that includes the camera-specific data or at least allows an assignment of camera-specific data stored in database 29 to the preliminary image data (e.g., in the form of the aforementioned identification information), are transferred to the external image processing unit 21, namely, in the example shown, initially to the on-set computing unit 23. In a further step 47 of the procedure, the external image processing unit 21 then generates processed image data by applying a correction to the preliminary image data that depends on the camera-specific data. This correction can be performed in the on-set computing unit 23 and / or in a computing unit 27 of the cloud infrastructure 25.

[0091] Furthermore, in the illustrated embodiment of the method, the external image processing unit 21 can also generate only partially processed image data in a further step 49 by applying a simplified correction to the preliminary image data. This simplified correction is independent of the camera-specific data or, compared to the correction applied in step 47 for generating the (fully) processed image data, depends at least to a lesser extent on the camera-specific data. Alternatively, partially processed image data could also be generated in the camera in step 49 by applying a correction dependent on the camera-specific data only to a portion of the preliminary image data. Following the generation of the processed or partially processed image data, this data can then be stored and / or output.

[0092] In particular, it can further be provided that the image sensor 15 is controlled to continuously generate image signal values, which are continuously read out in the camera 13 and from which preliminary image data is continuously generated. This preliminary image data is then continuously transmitted to the external image processing unit 21. The external image processing unit 21 can continuously generate partially processed image data from the transmitted preliminary image data and output it to a monitor device, in particular the aforementioned electronic viewfinder 17 of the camera 13, where it is continuously displayed. In this way, the image data can be viewed in partially processed form as a live image even while it is being recorded. Alternatively or in addition to displaying it on the viewfinder 17, the partially processed image data can also be continuously output to a monitor device separate from the camera 13 and then displayed there.

[0093] Whether (fully) processed image data and / or only partially processed image data are generated can depend on whether the external image processing unit 21 receives a first or a second user input. The respective user input thus advantageously allows the user to select the extent to which the image data should be processed, so that the process enables images of varying quality to be obtained as needed. Reference sign 11 Image recording system 13 Camera 15 image sensor 17 viewfinders 19 Set 21 external image processing unit 23 On-set computing unit 25 Cloud infrastructure 27 computing units 29 database 31 storage 33 local network 35 Internet 37-49 procedural steps QUOTES INCLUDED IN THE DESCRIPTION

[0000] This list of documents cited by the applicant was automatically generated and is included solely for the reader's convenience. The list is not part of the German patent or utility model application. The DPMA accepts no liability for any errors or omissions. Cited patent literature

[0000] DE 10 2007 058 973 A1

[0081] DE 10 2007 027 463 A1

[0081]

Claims

[1] Method for generating image data by means of a camera (13) and processing the image data by means of an external image processing device (21), wherein the camera (13) comprises an image sensor (15) having a plurality of light-sensitive sensor cells arranged in rows and columns, as well as readout electronics, and the method comprising: - that camera-instance-specific data about determined properties of the camera (13) are provided, which may differ from camera-model-generic properties of the camera (13); - that the image sensor (15) is controlled to generate respective image signal values ​​depending on the intensity of the light incident on the sensor cells; - that the image signal values ​​are read out in the camera (13) and preliminary image data are generated from the image signal values; - that the preliminary image data are transmitted to the external image processing device (21) together with metadata which comprise the camera-specific data or at least allow an assignment of the camera-specific data to the preliminary image data; and - that the external image processing device (21) generates processed image data by applying a correction dependent on the camera-specific data to the preliminary image data. [2] Method according to claim 1, wherein the camera-specific data relate to properties of the image sensor (15) and / or properties of the readout electronics. [3] Method according to claim 1 or 2, wherein the camera-specific data relate to individual properties of the individual sensor cells of the image sensor (15). [4] Method according to one of the preceding claims, wherein the camera-example-specific data comprise gain correction offsets of the sensor cells, gain correction factors of the sensor cells and / or status information about defective sensor cells of the image sensor (15). [5] Method according to one of the preceding claims, wherein the camera-specific data comprise parameters of non-linear characteristics of the sensor cells of the image sensor (15). [6] Method according to one of the preceding claims, wherein the metadata additionally comprises recording-specific data about operating conditions that existed during the generation of the image signal values ​​and that are capable of having an influence on the generation of the image signal values, and The correction mentioned also depends on the recording-specific data. [7] Method according to one of the preceding claims, wherein the provision of the camera-specific data comprises storing the camera-specific data in a database (29), wherein the metadata transmitted to the external image processing device (21) comprises identification information about the camera (13) or parts of the camera (13), and wherein the method comprises the external image processing device (21) reading the camera-specific data from the database (29) based on the identification information and assigning it to the transmitted preliminary image data. [8] Method according to claim 7, wherein the reading of the camera-specific data from the database (29) requires proof of read-out authorization received as part of a user input. [9] A method according to any one of the preceding claims, further comprising: - that partially processed image data are generated in the camera (13) or by the external image processing device (21). [10] Method according to claim 9, wherein the partially processed image data are generated by applying a correction dependent on the camera-example-specific data, in particular said correction, to a part of the preliminary image data. [11] A method according to claim 10, wherein the part of the preliminary image data to which the correction is applied is adjustable. [12] Method according to one of claims 9 to 11, wherein the preliminary image data correspond to a moving image sequence comprising a sequence of several individual images, wherein the partially processed image data are generated by applying a correction dependent on the camera instance-specific data, in particular said correction, to only a part of the preliminary image data which corresponds to a subset of the several individual images, while such a correction is not applied to the remaining part of the preliminary image data which corresponds to the further of the several individual images. [13] The method of claim 12, wherein the subset of the plurality of individual images corresponds to a first frame rate of the moving image sequence, wherein the total of the plurality of individual images corresponds to a second frame rate of the moving image sequence, and wherein the second frame rate is higher than the first frame rate. [14] Method according to one of claims 9 to 13, wherein the partially processed image data are generated by applying a simplified correction to the preliminary image data, which depends to a lesser extent on the camera-specific data compared to the said correction, wherein the degree to which the simplified correction depends to a lesser extent on the camera-specific data compared to the said correction is preferably adjustable. [15] The method of claim 9, wherein the partially processed image data are generated by applying a simplified correction to the preliminary image data that is independent of the camera instance-specific data. [16] Method according to one of claims 9 to 15, wherein the external image processing device (21) is designed to receive user inputs, and wherein the external image processing device (21) generates and / or outputs the processed image data in response to a first user input and generates and / or outputs the partially processed image data in response to a second user input. [17] A method according to any one of claims 9 to 16, further comprising: - that the partially processed image data are continuously generated and output to a monitor device (17) on which they are continuously displayed. [18] A method according to any one of the preceding claims, further comprising: - that the preliminary image data are continuously transmitted to the external image processing device (21) while further preliminary image data are continuously generated in the camera (13). [19] A method according to any one of claims 1 to 8, further comprising: - that partially processed image data are generated by the external image processing device (21), wherein the preliminary image data are continuously transmitted to the external image processing device (21) while further preliminary image data are continuously generated in the camera (13), and wherein the external image processing device (21) continuously generates the partially processed image data and outputs them to a monitor device (17) on which they are continuously displayed. [20] Method according to one of the preceding claims, wherein the external image processing device comprises an on-set computing unit (23) which is connected to the camera (13) via a local, preferably high-bandwidth, data connection (33). [21] Method according to claim 20, wherein the on-set computing unit (23) generates and / or outputs the processed image data. [22] Method according to one of the preceding claims, wherein the external image processing device (21) comprises a cloud infrastructure (25) to which the camera (13) is preferably connected via a wide area network (WAN) or the Internet (35). [23] Method according to claim 22, wherein the cloud infrastructure (25) comprises a computing unit (27) which generates and / or outputs the processed image data. [24] Method according to claim 22 or 23, wherein the external image processing device comprises an on-set computing unit (23) connected to the camera (13) via a local data connection (33), wherein the cloud infrastructure (25) is connected to the local network (33) and the on-set computing unit (23) via the wide area network or the Internet (35). [25] Method according to one of claims 22 to 24, wherein the provision of the camera-specific data comprises storing the camera-specific data in a database (29), wherein the metadata transmitted to the external image processing device (21) comprises identification information about the camera (13) including parts of the camera (13), and wherein the method comprises the external image processing device (21) reading the camera-specific data from the database (29) based on the identification information and assigning it to the transmitted preliminary image data, wherein the cloud infrastructure (25) comprises said database (29). [26] Method according to one of claims 22 to 25, wherein the preliminary image data together with the metadata are transferred to a memory (31) of the cloud infrastructure (25) and stored in the memory (31) and read out from the memory (31) for generating the processed image data. [27] A method according to any one of the preceding claims, further comprising: - that the preliminary image data are scrambled during their generation depending on the camera-specific data by placing the preliminary image data in an irregular order relative to a regular order, wherein the metadata comprises information about the scrambling; and - that the correction depending on the camera-specific data comprises descrambling the preliminary image data using the scrambling information by bringing the preliminary image data from the irregular sequence into the regular sequence.

Images