Method of forming an image of an object, computer program product and image forming system

Abstract

The invention relates to a method for forming an image of an object, a computer program product and an image forming system (1) for carrying out the method. In the method, data about the object are provided by a first data processing device (3) and a first data record with first data is provided. The first data record is loaded from the first data processing device (3) into a second data processing device (4). A second data record is loaded from a data store (5) into the second data processing device (4) in dependence on the first data record loaded into the second data processing device (4). A processing data record is generated or detected on the basis of the second data record. A two-dimensional output image of the object is generated by processing the data about the object using the processing data record, the output image having a predetermined number of output image pixels.

Description

Technical Field

[0001] The present invention relates to a method for forming an image of an object, a computer program product, and an image forming system for performing the method. Background Technology

[0002] For some time, it has been known to form images using optical imaging systems having lenses and image acquisition units. These image acquisition units are, for example, formed as electronic image sensors. Specifically, the electronic image sensor is formed as a digital image acquisition unit, for example, in the form of a CMOS sensor. Alternatively, the image acquisition unit is provided to be formed as photosensitive chemical film. Image sequences comprising multiple images can also be formed using known optical imaging systems. Images formed using known optical imaging systems are hereinafter referred to as actually formed images. Furthermore, image sequences formed using known optical imaging systems are hereinafter referred to as actually formed image sequences.

[0003] Optical imaging systems are known, for example, to be configured as cameras. Specifically, what is provided is a camera configured as a film camera used in the field of cinematography. Alternatively, what is provided is a camera configured as a camera used in the field of photography.

[0004] The camera lens mentioned above has at least one lens element and at least one aperture unit, the at least one aperture unit being provided with an aperture. For example, the lens has at least one lens group that moves along the optical axis of the lens for setting the focus of the lens on an object and / or for setting the focal length of the lens. In the above and below, a lens group is understood to mean a group having a single lens element or a group of multiple lens elements. Additionally, the lens group may also have at least one prism.

[0005] Images actually formed by known optical imaging systems typically have imaging errors, such as spherical aberration, geometric distortion, and / or vignetting. In this case, geometric distortion is essentially the distortion of straight lines within the image. Vignetting is the reduction of light towards the periphery, that is, shadows towards the edges of the image. The actual sequence of images formed may also have the imaging errors mentioned above.

[0006] In photography and cinematography, there are known stylistic devices used to guide the viewer's attention to specific content of an image or film, or to modify that content specifically for the viewer to achieve a complex aesthetic impression. To achieve this, it is known from the prior art to form an image of an object using one or more very specialized lenses. For example, lenses with large apertures are advantageous in photography and cinematography, not only because of their high speed, but also because they can form images with a shallow depth of field. Depth of field is the area in front of the camera lens, where the lens is used to image the object. If the object is located within this area, i.e., within the depth of field, it is focused and imaged by the lens. By focusing the lens on the object, the object located in this area is represented in focus in the image, while the space outside the depth of field becomes blurred due to the indistinctness in the image. Therefore, the viewer's attention is drawn to the sharp image area of ​​the object. In other words, by focusing the lens on a very specific object plane, the object can be imaged sharply, more precisely, while simultaneously being out of focus on portions of the object in front of and behind the object plane. These portions are out of focus.

[0007] As mentioned above, stylistic devices are used to achieve a pleasing aesthetic impression. For example, it is often desired that specific areas of an object take on a particular form in an image. Thus, for example, it is often desired that a strong local light source, which is part of the object to be imaged and is significantly located outside the object plane, be represented as a uniform disk in the image. The form and imaging quality of these specific areas of the object in the image are also referred to by those skilled in the art as bokeh. Bokeh describes the (albeit subjective) aesthetic quality of out-of-focus areas of an object in an image. In this context, bokeh does not refer to the degree to which these areas are out of focus, but rather to the form and nature of the imaged area of ​​the object in the image.

[0008] As is known from existing technology, computer graphics designers can create a sequence of three-dimensional scenes with multiple three-dimensional representations and / or create three-dimensional representations through mathematical calculations of data. This data is then used to convert the three-dimensional scene into a sequence of two-dimensional images and / or to convert the three-dimensional representation into two-dimensional images. This method is also known as rendering. To create the three-dimensional scene and / or the three-dimensional representation, the computer graphics designer uses a mathematical model of the three-dimensional scene and / or the three-dimensional representation. This mathematical model includes, for example, parameters that specifically describe the form, color, and surface finish of the object to be modeled in the three-dimensional scene and / or the three-dimensional representation. Furthermore, the mathematical model includes, for example, parameters describing the lighting of the object, specifically the position, type, color, and direction of the light source to be modeled. Additionally, the mathematical model includes the position of the object in the three-dimensional scene and / or the three-dimensional representation in at least one of the following: acquisition direction, field of view, focal length, focus, image format, size of the image acquisition unit, position of the virtual camera, and movement path. Based on these parameters, two-dimensional images and / or sequences of two-dimensional images can be calculated. For such calculations, it is typically assumed that the virtual camera is formed as a pinhole camera, and the image formed by the pinhole camera can be calculated according to the radiation theorem. Since pinhole cameras do not have any imaging errors in principle, the calculated two-dimensional images and / or the calculated two-dimensional image sequences have no image errors.

[0009] It is also known from the prior art that a two-dimensional image or sequence of two-dimensional images formed by rendering (that is, artificially in nature) is blended with an image and / or sequence of images already formed by an optical imaging system (such as a film camera). The blending mentioned above can include creating effects known in 3D computer graphics and cinematography as "visual effects" (often abbreviated as VFX). The blending mentioned above is also referred to as enhancement. Enhancement occurs, for example, during the post-production of film, specifically in so-called compositing, where images from different sources are combined. The desired outcome is that the two-dimensional image and / or sequence of images formed by rendering in the blended image created through compositing and / or the blended image sequence created through compositing have no discernible difference from the actually formed image and / or sequence of images, or only a slight discernible difference, in order to convey a good aesthetic impression and the impression of an object or scene as realistic as possible.

[0010] It is also known from existing technology that two-dimensional images or sequences of two-dimensional images, formed (essentially artificially) through rendering, are not mixed, but rather used for fully animated images and / or sequences of images. This is used, for example, in the fields of animated film production and / or virtual reality, such as computer games, flight simulators for pilot training, ship simulators for captain training, and / or train simulators for train driver training. It is also desired here that the two-dimensional images and / or sequences of images formed (essentially artificially) through rendering have no discernible difference from, or only slightly discernible differences from, the actually formed images and / or sequences of images, in order to convey a good aesthetic impression and an impression of objects or scenes as realistic as possible. Summary of the Invention

[0011] The present invention aims to provide a method for forming an image of an object and an image forming system for performing the method, wherein the method, on the one hand, modifies the imaging error in the actually formed image and / or image sequence, and on the other hand, the artificially formed object representation has no discernible difference from the actually formed image and / or image sequence, or has only a few discernible differences.

[0012] According to the invention, this objective is achieved by a method having the features described below. The invention also provides a computer program product having program code that can be loaded into a processor of an image forming system, and, when the program code is loaded into the processor, controls the image forming system during execution of the program code in such a way that the method according to the invention is performed. Furthermore, the invention relates to an image forming system having the features described below. Further features of the invention will become apparent from the following description, the appended claims, and / or the drawings.

[0013] This invention relates to a method for forming an image of an object. In the method according to the invention, data about the object is provided by a first data processing device. In this case, data about the object is understood, as described above and below, to be any data describing the object. For example, data about the object is at least one two-dimensional input image of the object. Alternatively, or as an alternative, data about the object is, for example, at least one three-dimensional representation of the object. Two embodiments of data about the object are discussed in further detail below. Alternatively, or as an alternative, it is provided that the data about the object is data in which a multidimensional (e.g., two-dimensional or three-dimensional) representation of the object can be calculated. The above enumeration of data about the object should not be construed as exhaustive. Rather, any data describing the object and suitable for performing the invention can be used. Examples of how such data about the object can be obtained are further explained below.

[0014] The first data processing device is, for example, an electronic system formed by a central unit and peripheral devices. The central unit may be, for example, a local computer, a server unit, a network with multiple workstations, a cloud-based virtual server, a tablet computer, and / or a smartphone. These peripheral devices may be specifically formed, for example, as input and / or output units in the form of a keyboard and / or as a monitor.

[0015] The method according to the invention further includes at least one first data record provided by the first data processing device. The first data record has first data, which includes: (i) at least first imaging parameters of a first imaging system, with which data about the object has been generated, and / or (ii) at least second imaging parameters of a second imaging system, intended to represent an image of the object on a display unit based on the data about the object using the characteristics of the second imaging system.

[0016] Therefore, the first data may at least include first imaging parameters of the first imaging system, with which data about the object has been generated. As explained in further detail below, the first imaging parameters include, for example, first metadata of the first imaging system, specifically first camera data and first lens data. Further examples of this first data are mentioned below.

[0017] The first imaging system is, for example, a first optical imaging system having at least one lens element. This first optical imaging system is, for example, configured as a camera. This will be discussed in further detail below.

[0018] Alternatively, or as an alternative, the first imaging system is configured as a computer graphics system, which uses mathematical calculations of data to create a sequence of three-dimensional scenes with multiple three-dimensional representations. Alternatively, the computer graphics system creates the three-dimensional representations using mathematical calculations of data. Then, the first data recorded includes, for example, data generated through mathematical calculations. Alternatively, or as an alternative, the mathematically calculated data mentioned above is converted into a sequence of two-dimensional images and / or two-dimensional images. Then, the first data includes data from the sequence of two-dimensional images and / or two-dimensional images.

[0019] As mentioned above, the data for a 3D scene or 3D representation is mathematically calculated. For this purpose, computer graphics designers use, for example, mathematical models of the 3D scene and / or 3D representation. These mathematical models include, for example, parameters that specifically describe the form, color, and surface finish of the object to be modeled and represented in the 3D scene and / or 3D representation. Furthermore, the mathematical model includes, for example, parameters describing the lighting of the object, specifically the position, type, color, and direction of the light source to be modeled. Additionally, the mathematical model includes the object's position in the 3D scene and / or 3D representation within at least one of the following: acquisition direction, field of view, focal length, focus, image format, size of the image acquisition unit, position of the virtual camera, and movement path.

[0020] As described above, alternatively, the first data may include at least the second imaging parameters of the second imaging system. The aim is to represent an image of the object on the display unit using the characteristics of the second imaging system and based on data about the object. As will be explained in further detail below, these second imaging parameters include, for example, second metadata of the second imaging system, specifically second camera data and second lens data. Further examples of this first data are mentioned below.

[0021] The second imaging system is, for example, a second optical imaging system having at least one lens element. This second optical imaging system is, for example, configured as a camera. This will be discussed in further detail below.

[0022] Alternatively, or as an alternative, the second imaging system is provided as a virtual camera. At least the second imaging parameters have the effect that an object image based on data about the object is represented on the display unit in such a way that it appears as if a virtual camera using the second imaging parameters is actually imaging the object. In other words, the image of the object is intended to be formed and represented on the display unit based on data about the object through mathematical calculations, in such a way that it appears as if a camera with characteristics selected by the second imaging parameters is actually imaging the object.

[0023] In the method according to the invention, the first data record is also loaded from the first data processing device into the second data processing device. The first and second data processing devices are interconnected, for example, for data exchange. Specifically, it is envisioned that the first data processing device be connected to the second data processing device via a line. Alternatively, or as an alternative, it is envisioned that the first data processing device be wirelessly connected to the second data processing device in a manner that allows data exchange. For example, the wireless connection between the first and second data processing devices is a radio connection or a WLAN connection. Alternatively, or as an alternative, the first and second data processing devices are interconnected via the Internet. The second data processing device is, for example, an electronic system with a central unit. For example, the central unit is a local computer, a server unit, a network with multiple workstations, a cloud-based virtual server, a tablet computer, and / or a smartphone. Additionally, the second data processing device may, for example, be equipped with peripheral devices. These peripheral devices are specifically formed, for example, in the form of a keyboard as an input and / or output unit and / or as a monitor.

[0024] The method according to the invention further includes loading a second data record from a data memory into the second data processing device based on the first data record loaded into the second data processing device. The second data record has second data, which includes: (i) modification data for modifying imaging errors according to first imaging parameters of the first imaging system and / or (ii) modification data for modifying data about the object according to second imaging parameters of the second imaging system.

[0025] Therefore, the second data may include modification data for modifying imaging errors based on the first imaging parameters of the first imaging system. In other words, the second data includes modification data that can be used to correct imaging errors that have already occurred when generating data about the object (specifically, when forming the aforementioned two-dimensional input image of the object). Specifically, using the modification data, these imaging errors can be reduced or increased. For example, the modification data may have correction data for correcting imaging errors based on the first imaging parameters of the first imaging system. In other words, the second data includes correction data that can be used to reduce or completely correct imaging errors that have already occurred when generating data about the object (specifically, when forming the aforementioned two-dimensional input image of the object). Alternatively or as an alternative, it is also contemplated that one or more imaging errors can be reconstructed using the modification data. In other words, imaging errors can be inserted into the image by using the modification data.

[0026] Alternatively, the second data may include modification data for modifying data about the object based on the second imaging parameters of the second imaging system. In other words, by means of this modification data, data about the object can be modified according to the second imaging parameters of the second imaging system. For example, the data about the object may be modified in such a way that the modification has the effect of forming an image of the object that substantially corresponds to an image of the object formed using the aforementioned second optical imaging system or an image of the object formed using the aforementioned virtual camera.

[0027] The second data record can be designed, for example, in the form of a polynomial. The polynomial represents, for example, a virtual camera and mathematically describes how a light beam entering and exiting the lens of the virtual camera images onto the image acquisition unit of the virtual camera, and where within the image acquisition unit it images. For example, the polynomial has the following form:

[0028]

[0029] Where, x s and y s The x represents the position of the emitted light beam on the surface of the image acquisition unit. a and y a This represents the position of the incident beam on the virtual aperture plane, and β is the desired imaging scale.

[0030] In the method according to the invention, specifically, a processed data record is generated based on the second data record using the first data processing device and / or the second data processing device. For example, the processed data record includes a correction diagram. Alternatively, it is provided that, for example, the first data processing device and / or the second data processing device detect that the second data record is used unchanged as the processed data record. Specifically, for example, the first data processing device and / or the second data processing device determine that the second data record is used unchanged as the processed data record.

[0031] Furthermore, in the method according to the invention, a two-dimensional output image of the object is formed using the first data processing device and / or the second data processing device, for example, by processing data about the object using the processing data record. This output image has a predetermined number of output image pixels. For example, the correction map formed as the processing data record is placed on the two-dimensional input image of the object, and corrections for these imaging errors are performed. The formed two-dimensional output image is then a two-dimensional input image of the object with these corrections. For example, if the processing data record is specifically formed as the second data record in the form of a polynomial, then data about the object is processed using the processing data record in such a way that an image of the object that substantially corresponds to or substantially corresponds to an image of the object formed using the second optical imaging system mentioned above or an image of the object formed using the virtual camera mentioned above is formed as the two-dimensional output image. The two-dimensional output image of the object can then be displayed on a display unit.

[0032] This invention provides a method for forming an image of an object, by which one or more imaging errors in the actually formed image and / or image sequence can be modified in a simple manner. To this end, the invention always provides a suitable processing data record, with which the one or more imaging errors in the actually formed image can be modified, specifically, completely or substantially corrected. Furthermore, the invention ensures that the artificially created object representation has no discernible difference from the actually formed image and / or image sequence, or only a few discernible differences. Also for this purpose, a suitable processing data record is always provided, with which the artificially created representation of the object can be processed accordingly.

[0033] In one embodiment of the method according to the invention, it is additionally or alternatively provided that the second data record is loaded from the second data processing device into the first data processing device. Additionally, it is provided that the first data processing device is used to generate the processed data record or to detect that the second data record is used as the processed data record.

[0034] In another embodiment of the method according to the invention, it is additionally or alternatively provided that the first data processing device is used to form a two-dimensional output image of the object.

[0035] In yet another embodiment of the method according to the invention, additionally or alternatively, the second data processing device is provided for generating the processed data record or detecting that the second data record is used as the processed data record. Alternatively, for example, the processed data record is provided to be loaded from the second data processing device into the first data processing device, and the first data processing device is used to form a two-dimensional output image of the object. As an alternative, for example, the second data processing device is provided to form a two-dimensional output image of the object, and the two-dimensional output image is loaded from the second data processing device into the first data processing device.

[0036] As mentioned above, in one embodiment of the method according to the invention, additionally or alternatively, the data concerning the object includes at least one two-dimensional input image of the object. The input image of the object has a predetermined number of input image pixels. The two-dimensional input image is formed, for example, using an optical imaging system in the form of a camera. Specifically, it is envisioned that the two-dimensional input image is stored on a data carrier, from which the first data processing device loads and provides the input image. During the formation of the output image of the object, at least one input image pixel of the predetermined number of input image pixels of the object's input image is processed, for example, by using the first data processing device and / or the second data processing device with processing data recording, and the pixel values ​​of the input image pixels of the object's input image are modified using data from the processing data recording. For example, the grayscale value or color value of the input image pixel is modified.

[0037] As mentioned above, in another embodiment of the method according to the invention, it is additionally or alternatively provided that the data regarding the object relates to at least one three-dimensional representation. The data regarding the object includes first data content in a first dimension, second data content in a second dimension, and third data content in a third dimension. The invention is not limited to the embodiments of data regarding the object described above concerning the three-dimensional representation. Rather, any embodiment suitable for the invention can be used, for example, a three-dimensional representation of a body that can take any desired form. For example, these bodies are spherical, cubic, and / or rotationally symmetric. These bodies can be specifically, additionally, or subjectively combined. As mentioned above, a three-dimensional scene and / or three-dimensional representation having a sequence of multiple three-dimensional representations can be created through mathematical computation of the data. For this purpose, a mathematical model of the three-dimensional scene and / or three-dimensional representation is used. This mathematical model includes, for example, parameters that specifically describe the form, color, and surface finish of the object to be modeled and represented in the three-dimensional scene and / or the three-dimensional representation. Furthermore, the mathematical model includes, for example, parameters describing the lighting of the object, specifically the position, type, color, and orientation of the light source to be modeled. Additionally, the mathematical model includes the position of the object in a 3D scene and / or 3D representation of at least one of the following: acquisition direction, field of view, focal length, focus, image format, size of the image acquisition unit, position of the virtual camera, and movement path. During the formation of the output image of the object, the first data content, the second data content, and / or the third data content are processed, for example, by using the first data processing device and / or the second data processing device for processing data recording, wherein the first data content, the second data content, and / or the third data content are modified using data from the processed data recording.

[0038] As mentioned above, in yet another embodiment of the method according to the invention, alternatively or additionally, a first optical imaging system is provided as the first imaging system. For example, the first optical imaging system has a first lens and a first image acquisition unit. The first image acquisition unit is, for example, formed as an electronic image sensor. Specifically, the electronic image sensor is formed as a digital image acquisition unit, for example, in the form of a CMOS sensor. Alternatively, the image acquisition unit is provided as a photosensitive chemical film. The first optical imaging system is, for example, formed as a camera. Specifically, the camera is provided as a film camera used in the field of cinematography. Alternatively, the camera is provided as a camera used in the field of photography. The first lens has at least one lens element and at least one aperture unit, the at least one aperture unit being provided with an aperture. For example, the first lens has at least one lens group that moves along the optical axis of the first lens for setting the focus of the first lens on an object and / or for setting the focal length of the first lens. The lens group is understood above and below to mean a group having a single lens element or a group of multiple lens elements. Additionally, the lens group may also have at least one prism.

[0039] In another embodiment of the method according to the invention, alternatively or additionally, the first metadata of the first imaging system is used as the first imaging parameter. The first metadata includes, for example, the imaging characteristics and / or functional units of the first imaging system. Specifically, the first metadata is automatically read from data about the object or from data corresponding to the characteristics of the first imaging system by the first data processing device, or manually input into the first data processing device. For example, at least one of the following parameters is used as the first imaging parameter:

[0040] - Data about the object has been generated using the first camera data from the first camera;

[0041] - Data about the object has been generated using the first lens data, which is the first lens data.

[0042] - Regarding the first aperture unit data, data about the object has already been generated using the first aperture unit data;

[0043] - Regarding the first focusing unit data, data about the object has already been generated using this focusing unit data;

[0044] -Regarding the first focal length setting unit data, data about the object has already been generated using the first focal length setting unit data;

[0045] - First information regarding the position and orientation of the first imaging system in space. In other words, it provides first information regarding the position and alignment of the first imaging system, for example, in three-dimensional space; and

[0046] - First information regarding the resolution of the first imaging system. In other words, the resolution of the data about the object that has been generated using it is provided. For example, the resolution is a so-called "full HD" resolution, that is, specifically a resolution of 1920 × 1080 pixels. Alternatively, or as an alternative, the resolution is a so-called 2K resolution, that is, specifically a resolution of 2560 × 1440 pixels. However, the invention is not limited to the resolutions mentioned above. Rather, any resolution suitable for the invention can be used. Alternatively, or as an alternative, the first information is provided with a target resolution desired by the user, for example, a target resolution that can be input into the first data processing device. This target resolution can be, for example, one of the resolutions mentioned above.

[0047] In yet another embodiment of the method according to the invention, alternatively or additionally, a second optical imaging system is provided as the second imaging system. For example, the second optical imaging system has a second lens and a second image acquisition unit. The second image acquisition unit is, for example, formed as an electronic image sensor. Specifically, the electronic image sensor is formed as a digital image acquisition unit, for example, in the form of a CMOS sensor. As an alternative, the second image acquisition unit is provided as a photosensitive chemical film. The second optical imaging system is, for example, formed as a camera. Specifically, the camera is provided as a film camera used in the field of cinematography. As an alternative, the camera is provided as a camera used in the field of photography. The second lens has at least one lens element and at least one aperture unit, the at least one aperture unit being provided with an aperture. For example, the second lens has at least one lens group that moves along the optical axis of the second lens for setting the focus of the second lens on an object and / or for setting the focal length of the second lens. The lens group is understood above and below to mean a group having a single lens element or a group of multiple lens elements. Additionally, the lens group may also have at least one prism.

[0048] In yet another embodiment of the method according to the invention, additionally or alternatively, the second metadata of the second imaging system is provided as the second imaging parameter. The second metadata includes, for example, the imaging characteristics and / or functional units of the second imaging system. Specifically, the second metadata is automatically read from data about the object or from data corresponding to the characteristics of the second imaging system by the first data processing device, or manually input into the first data processing device. For example, at least one of the following parameters is used as the second imaging parameter:

[0049] - Data about the second camera is intended to be displayed on the display unit using the characteristics of the second camera;

[0050] - Data about the second lens, intended to represent data about the object on the display unit using the characteristics of the second lens;

[0051] - Data about the second aperture unit, intended to represent data about the object on the display unit using the characteristics of the second aperture unit;

[0052] - Data about the second focusing unit is intended to represent data about the object on the display unit using the characteristics of the second focusing unit;

[0053] - Data about the second focal length setting unit is intended to represent data about the object on the display unit using the characteristics of the second focal length setting unit;

[0054] - Second information regarding the location and orientation of the second imaging system in space. In other words, second information is provided regarding the location and alignment of the second imaging system, for example, in three-dimensional space; and

[0055] - Second information regarding the resolution of the second imaging system. In other words, a resolution is provided intended for representing data about the object on the display unit. For example, the resolution is a so-called "Full HD" resolution, that is, specifically a resolution of 1920 × 1080 pixels. Alternatively, or as an alternative, the resolution is a so-called 2K resolution, that is, specifically a resolution of 2560 × 1440 pixels. However, the invention is not limited to the resolutions mentioned above. Instead, any resolution suitable for the invention can be used. Alternatively, or as an alternative, the second information is provided with a target resolution desired by the user, specifically a target resolution that can be manually input into the first data processing device. This target resolution can be, for example, one of the resolutions mentioned above.

[0056] In one embodiment of the method according to the invention, additionally or alternatively, data for modifying the distortion of the first imaging system is provided as modification data. Additionally or alternatively, data for modifying the vignetting of the first imaging system is provided as modification data.

[0057] In another embodiment of the method according to the invention, additionally or alternatively, data for correcting distortion of the first imaging system is provided as modification data. Additionally or alternatively, data for correcting vignetting of the first imaging system is provided as modification data.

[0058] As mentioned above, in one embodiment of the method according to the invention, additionally or alternatively, a virtual camera is provided as the second imaging system, which forms an image of the object using mathematical calculations based on data about the object, in such a way that it appears as if a camera with characteristics selected by the second imaging parameters is actually imaging the object. As also mentioned above, in one embodiment of the method according to the invention, a mathematical mapping rule, specifically a polynomial or Fourier expansion, is provided as the second data record, which represents the virtual camera and mathematically describes how a light beam entering and exiting the lens of the virtual camera is imaged on and where it is imaged on the image acquisition unit of the virtual camera. It should be explicitly noted that the mathematical mapping rule is not limited to the embodiments mentioned above. Rather, any mathematical mapping rule suitable for the invention can be used.

[0059] In yet another embodiment of the method according to the invention, alternatively or additionally, a first data record loaded from a first data processing device into a second data processing device contains identification data and / or user identification data regarding the object. In other words, the first data record makes it possible to clearly identify data about the object through the identification data. In this way, for example, a two-dimensional input image and / or data relating to a three-dimensional representation of the object can be clearly identified. This also applies accordingly to the user identification data. The user of the method according to the invention can be clearly identified through the user identification data. For example, the user identification data includes a usage license for performing the method according to the invention or a portion thereof. A usage license can exist at any time, for example, when the user has already paid to perform the method according to the invention, will pay in the near future, has been provided with a credit line for performing the method according to the invention, or has already obtained a license to perform the method according to the invention.

[0060] In yet another embodiment of the method according to the invention, alternatively or additionally, the following method steps are performed: checking, based on the identification data and / or the user identification data, whether a usage authorization for using the second data record with the first data processing device and / or the second data processing device exists, and generating the processed data record only if such usage authorization exists. For example, the method steps mentioned above are performed before generating or detecting the processed data record with the first data processing device.

[0061] In yet another embodiment of the method according to the invention, additionally or alternatively provided is the following method steps performed, for example, after the second data record is loaded from the second data processing device into the first data processing device: (i) loading the identification data and / or the user identification data again from the first data processing device into the second data processing device, and (ii) checking, based on the identification data and / or the user identification data, whether a usage authorization for using the second data record with the first data processing device and / or the second data processing device exists using the second data processing device. The processing data record is generated only if a usage authorization exists. For example, the method steps mentioned above are performed before the processing data record is generated or detected with the first data processing device.

[0062] In one embodiment of the method according to the invention, additionally or alternatively, it is provided that the two-dimensional output image of the object is modified again after it has been formed. In this embodiment, for this purpose, the second data of the second data record includes modification data for modifying the output image of the object formed according to the first imaging parameters of the first imaging system to incorporate imaging errors into the output image of the object. Furthermore, the processing data record has processing data based on the modification data after formation or detection. In an embodiment of the method according to the invention, it is provided that the output image of the object is modified by, for example, using the processing data with the first data processing device and / or the second data processing device to process at least one output image pixel of a predetermined number of output image pixels of the object's output image, the pixel values ​​of which are modified by the processing data. In this embodiment, it is advantageous to process, for example, an output image that has previously been fully or almost fully corrected and has no imaging errors by incorporating imaging errors, in a way that produces an almost natural aesthetic impression, as in the case of an actual image created by an optical imaging system.

[0063] This invention relates to an additional method for forming an image of an object. The additional method according to the invention may have at least one of the features mentioned above or a combination of at least two of the features further mentioned above. In the additional method according to the invention, data concerning the object is also provided by a first data processing device. Regarding the data concerning the object and the first data processing device, reference is made to the further comments made above, which also apply here.

[0064] Another method according to the invention further includes at least providing a first data record by the first data processing device. The first data record has first data including: (i) first imaging parameters of at least a first imaging system, with which data about the object has been generated; and / or (ii) second imaging parameters of at least a second imaging system, intended to represent an image of the object on a display unit based on the data about the object using the characteristics of the second imaging system. Regarding the first imaging parameters, the first imaging system, the second imaging parameters, and the second imaging system, reference is made to the comments made above, which also apply herein.

[0065] In another method according to the invention, the first data record is also loaded from the first data processing device into a second data processing device. Regarding the second data processing device, reference is made to the further comments made above, which also apply here.

[0066] Furthermore, in another method according to the invention, a license data record is generated based on the first data record loaded into the second data processing device. The license data record is essentially an electronic key that can be used to decrypt (i.e., open) a suitable second data record for processing data about the object. Subsequently, the license data record is loaded from the second data processing device into the first data processing device.

[0067] Another method according to the invention further includes loading a second data record from a data memory into the first data processing device based on the first data record loaded into the second data processing device. The second data record has second data including: (i) modification data for modifying imaging errors according to first imaging parameters of the first imaging system and / or (ii) modification data for modifying data about the object according to second imaging parameters of the second imaging system. Regarding the second data record, reference is made to the further comments above, which also apply here. Additionally, in another method according to the invention, the second data record is decrypted using the licensed data record.

[0068] Furthermore, in another method according to the invention, the first data processing apparatus is provided for generating a processing data record based on the second data record. For example, the processing data record includes a correction diagram. Alternatively, the first data processing apparatus is provided to detect that the second data record is used as the processing data record without modification.

[0069] Additionally, in another method according to the invention, a two-dimensional output image of the object is formed by processing data about the object using the processed data record, for example, with the first data processing device and / or the second data processing device, the output image having a predetermined number of output image pixels. For example, the correction map formed as the processed data record is placed on the two-dimensional input image of the object, and corrections for these imaging errors are performed. The formed two-dimensional output image is then a two-dimensional input image of the object with these corrections provided. For example, if the processed data record is specifically formed as the second data record in the form of a polynomial, the processed data record is used to process data about the object in such a way that an image of the object that substantially corresponds to or substantially corresponds to an image of the object formed using the second optical imaging system mentioned above or using the virtual camera mentioned above is formed as the two-dimensional output image. The two-dimensional output image of the object can then be displayed on a display unit.

[0070] The alternative method according to the invention also has the advantages already mentioned above. These advantages also apply here.

[0071] The present invention also relates to a computer program product having program code that can be partially or wholly loaded, or has been partially or wholly loaded, into a processor of an image forming system, and, when the program code is loaded into the processor, controls the image forming system during execution of the program code in a manner that causes a method having at least one of the features mentioned above or further mentioned below, or a combination of at least two of the features further mentioned above or further mentioned below, to be performed. In other words, the present invention relates to a computer program product that can be partially or wholly loaded, or has been partially or wholly loaded, into a processor and, during execution of the computer program product in the processor, controls an image forming system in a manner that causes a method having at least one of the features mentioned above or further mentioned below, or a combination of at least two of the features further mentioned above or further mentioned below, to be performed.

[0072] The present invention also relates to an image forming system for forming an image of an object. The image forming system according to the invention has a display unit, which is configured, for example, as a monitor. However, the invention is not limited to this display unit. Rather, any display unit suitable for the invention can be used in the invention. Furthermore, the image forming system according to the invention has a first imaging system and a second imaging system. Furthermore, the image forming system according to the invention has a first data processing device for providing data about the object and for providing a first data record having the first data. The first data includes at least first imaging parameters of the first imaging system, with which data about the object has been generated. Alternatively or as an alternative, the first data includes at least second imaging parameters of the second imaging system, intended to represent an image of the object on the display unit based on the data about the object using the characteristics of the second imaging system. Regarding the first and second imaging parameters, reference is made to the further comments made above, which also apply here. Similarly, regarding the first and second imaging systems, reference is made to the further comments made above, which also apply here.

[0073] The first data processing device is, for example, an electronic system formed by a central unit and peripheral devices. The central unit may be, for example, a local computer, a server unit, a network with multiple workstations, a cloud-based virtual server, a tablet computer, and / or a smartphone. These peripheral devices may be specifically formed, for example, as input and / or output units in the form of a keyboard and / or as a monitor.

[0074] The image forming system according to the invention further includes a second data processing device connected to a first data processing device for data exchange. Specifically, it is envisioned that the first data processing device be connected to the second data processing device via a line. Alternatively, or as an alternative, it is envisioned that the first data processing device be wirelessly connected to the second data processing device in a manner that allows data exchange. For example, the wireless connection between the first and second data processing devices is a radio connection or a WLAN connection. Alternatively, or as an alternative, the first and second data processing devices are interconnected via the Internet. The second data processing device is, for example, an electronic system with a central unit. For example, the central unit is a local computer, a server unit, a network with multiple workstations, a cloud-based virtual server, a tablet computer, and / or a smartphone. Additionally, the second data processing device may, for example, be equipped with peripheral devices. These peripheral devices are specifically formed, for example, in the form of a keyboard as an input and / or output unit and / or as a monitor.

[0075] The image forming system according to the invention further includes a data memory storing a second data record having second data. This second data includes modification data for modifying imaging errors based on first imaging parameters of the first imaging system. For example, the modification data is data for correcting imaging errors based on the first imaging parameters of the first imaging system. Alternatively, or as an alternative, the second data includes modification data for modifying data about the object based on second imaging parameters of the second imaging system. The data memory is, for example, allocated to the first data processing device and / or the second data processing device. For example, it is provided that the data memory is a unit of the first data processing device and / or the second data processing device. The location of the data memory does not necessarily have to be the same as the location of the first data processing device and / or the second data processing device. Conversely, the data memory may also be arranged separately from the first data processing device and / or the second data processing device.

[0076] Additionally, the image forming system according to the invention includes a processor loaded with a computer program product having at least one of the features further mentioned above or below, or a combination of at least two of the features further mentioned above or below.

[0077] In one embodiment of the image forming system according to the invention, additionally or alternatively, the first imaging system is configured as the first optical imaging system. Specifically, the first optical imaging system is provided to have at least one lens element. For example, the first optical imaging system has a first lens and a first image acquisition unit. The first image acquisition unit is configured, for example, as an electronic image sensor. Specifically, the electronic image sensor is configured, for example, as a digital image acquisition unit in the form of a CMOS sensor. Alternatively, the image acquisition unit is provided to be configured as a photosensitive chemical film. The first optical imaging system is configured, for example, as a camera. Specifically, the camera is configured to be a film camera used in the field of cinematography. Alternatively, the camera is configured to be a camera used in the field of photography. The first lens has at least one lens unit and at least one aperture unit, the at least one aperture unit being provided with an aperture. For example, the first lens has at least one lens group that moves along the optical axis of the first lens for setting the focus of the first lens on an object and / or for setting the focal length of the first lens. The lens group is understood above and below to mean a group having a single lens element or a group of multiple lens elements. In addition, the lens group may also have at least one prism.

[0078] In another embodiment of the image forming system according to the invention, alternatively or additionally, the first imaging system is configured as a computer graphics system, which uses mathematical calculations of data to create a three-dimensional scene having a sequence of multiple three-dimensional representations. Alternatively, the computer graphics system creates the three-dimensional representations using mathematical calculations of data. Then, the first data recorded includes, for example, data generated through mathematical calculations. Alternatively or additionally, the mathematically calculated data mentioned above is converted into a two-dimensional image sequence and / or two-dimensional images. Then, the first data includes data from the two-dimensional image sequence and / or two-dimensional images.

[0079] As mentioned above, the data for a 3D scene or 3D representation is mathematically calculated. For this purpose, computer graphics designers use, for example, mathematical models of the 3D scene and / or 3D representation. These mathematical models include, for example, parameters that specifically describe the form, color, and surface finish of the object to be modeled and represented in the 3D scene and / or 3D representation. Furthermore, the mathematical model includes, for example, parameters describing the lighting of the object, specifically the position, type, color, and direction of the light source to be modeled. Additionally, the mathematical model includes the object's position in the 3D scene and / or 3D representation within at least one of the following: acquisition direction, field of view, focal length, focus, image format, size of the image acquisition unit, position of the virtual camera, and movement path.

[0080] In yet another embodiment of the image forming system according to the invention, alternatively or otherwise, the second imaging system is configured as an optical imaging system. For example, the second optical imaging system has at least one lens element. The second optical imaging system is configured, for example, as a camera. Specifically, it is provided that the camera is configured as a film camera used in the field of cinematography. Alternatively, it is provided that the camera is configured as a camera used in the field of photography. The second lens has at least one lens unit and at least one aperture unit, the at least one aperture unit being provided with an aperture. For example, the second lens has at least one lens group that moves along the optical axis of the second lens for setting the focus of the second lens on an object and / or for setting the focal length of the second lens. The lens group is understood above and below to mean a group having a single lens element or a group of multiple lens elements. Additionally, the lens group may also have at least one prism.

[0081] In one embodiment of the image forming system according to the invention, additionally or alternatively, the second imaging system is configured as a virtual camera. At least the second imaging parameters have the effect that an object image based on data about the object is represented on the display unit in such a way that it appears as if the virtual camera using the second imaging parameters is actually imaging the object. In other words, the image of the object is intended to be formed and represented on the display unit based on data about the object through mathematical calculations, in such a way that it appears as if a camera with characteristics selected by the second imaging parameters is actually imaging the object.

[0082] As mentioned above, in one embodiment of the image forming system according to the invention, the first imaging system is additionally or alternatively provided to have at least one of the following features: a first camera, a first lens, a first aperture unit, a first focusing unit, and / or a first focal length setting unit. Regarding the first camera and the first lens, reference is made to the further comments made above, which also apply here. The first aperture unit is, for example, an aperture with an adjustable aperture. The first focusing unit and the first focal length setting unit have, for example, a single lens element or multiple lens elements that can be combined to form a lens group. The single or multiple lenses are movably designed such that, on the one hand, the first imaging system can be focused on an object, and on the other hand, the focal length of the first imaging system can be set.

[0083] As mentioned above, in another embodiment of the image forming system according to the invention, the second imaging system is additionally or alternatively provided to have at least one of the following features: a second camera, a second lens, a second aperture unit, a second focusing unit, and / or a second focal length setting unit. Regarding the second camera and the second lens, reference is made to the further comments made above, which also apply here. The second aperture unit is, for example, an aperture with an adjustable aperture. The second focusing unit and the second focal length setting unit have, for example, a single lens element or multiple lens elements that can be combined to form a lens group. The single or multiple lenses are movably designed such that, on the one hand, the second imaging system can be focused on an object, and on the other hand, the focal length of the second imaging system can be set.

[0084] As mentioned above, in one embodiment of the image forming system according to the invention, it is additionally or alternatively provided that the second imaging system is a virtual camera for forming an image of the object based on data about the object through mathematical calculations, in such a way that it appears as if a camera with characteristics selected by the second imaging parameters is actually imaging the object. Alternatively or alternatively, it is provided that the second data record is formed as a mathematical mapping rule, specifically a polynomial or a Fourier expansion, which represents the virtual camera and mathematically describes how a light beam entering and exiting the lens of the virtual camera is imaged on and where it is imaged on the image acquisition unit of the virtual camera. It should be explicitly noted that the mathematical mapping rule is not limited to the embodiments mentioned above. Rather, any mathematical mapping rule suitable for the present invention can be used. Attached Figure Description

[0085] Further practical embodiments and advantages of the invention are described below in conjunction with the accompanying drawings. In the drawings:

[0086] Figure 1 A schematic representation of an image forming system according to the present invention is shown;

[0087] Figure 2 A schematic representation of an imaging system in the form of a camera is shown;

[0088] Figure 3 It shows according to Figure 2 Another schematic representation of the imaging system;

[0089] Figure 4 A schematic representation of a flowchart illustrating an embodiment of the method according to the present invention is shown;

[0090] Figure 5 It shows according to Figure 4 Schematic representation of further method steps according to the method of the present invention;

[0091] Figure 6 A schematic representation of a two-dimensional input image is shown;

[0092] Figure 7 The data is shown in three dimensions;

[0093] Figure 8 A schematic representation of the imaging parameters of the imaging system is shown;

[0094] Figure 9 A schematic representation of a flowchart illustrating another embodiment of the method according to the invention is shown;

[0095] Figure 10A schematic representation of a flowchart illustrating yet another embodiment of the method according to the invention is shown;

[0096] Figure 11 A schematic representation of a flowchart illustrating yet another embodiment of the method according to the invention is shown;

[0097] Figure 12 A schematic representation of a flowchart illustrating an embodiment of the method according to the present invention; and

[0098] Figure 13 A schematic representation of a flowchart illustrating another embodiment of the method according to the invention is shown. Detailed Implementation

[0099] Figure 1 A schematic representation of an image forming system 1 according to the present invention is shown, which is used to form an image of an object. The image forming system 1 has a display unit 2, which is configured, for example, as a monitor. However, the present invention is not limited to this display unit 2. Rather, any display unit 2 suitable for the present invention can be used in the present invention.

[0100] Additionally, the image forming system 1 includes a first data processing unit 3. The first data processing unit 3 is, for example, an electronic system formed by a central unit and peripheral devices. For example, the central unit is a local computer, a server unit, a network with multiple workstations, a cloud-based virtual server, a tablet computer, and / or a smartphone. These peripheral devices are specifically formed, for example, as input and / or output units in the form of a keyboard and / or as a monitor.

[0101] The image forming system 1 also includes a second data processing unit 4, which is connected to the first data processing unit 3 for data exchange. Specifically, it is envisioned that the first data processing unit 3 is connected to the second data processing unit 4 via a line. Alternatively, or as an alternative, it is envisioned that the first data processing unit 3 is wirelessly connected to the second data processing unit 4 in a manner that allows data exchange. For example, the wireless connection between the first data processing unit 3 and the second data processing unit 4 is a radio connection or a WLAN connection. Alternatively, or as an alternative, the first data processing unit 3 can connect to the second data processing unit 4 via the Internet.

[0102] The second data processing device 4 is, for example, an electronic system with a central unit. The central unit could be a local computer, a server unit, a network with multiple workstations, a cloud-based virtual server, a tablet computer, and / or a smartphone. Additionally, the second data processing device 4 may include peripheral devices. These peripheral devices could be specifically configured as input and / or output units in the form of a keyboard and / or as a monitor.

[0103] The image forming system 1 further includes a data memory 5. The data memory 5 is, for example, allocated to the first data processing device 3 and / or the second data processing device 4. For example, it is provided that the data memory 5 is a unit of the first data processing device 3 and / or the second data processing device 4. The location of the data memory 5 does not necessarily have to be the same as that of the first data processing device 3 and / or the second data processing device 4. Instead, the data memory 5 may also be arranged separately from the first data processing device 3 and / or the second data processing device 4.

[0104] The image forming system 1 also includes a first imaging system 6. For example, the first imaging system 6 is configured as a first optical imaging system. The first imaging system 6, in the form of a first optical imaging system, has at least one lens element. For example, the first imaging system 6, in the form of a first optical imaging system, has a first lens and a first image acquisition unit. The first image acquisition unit is, for example, configured as an electronic image sensor. Specifically, the electronic image sensor is configured as a digital image acquisition unit, for example, in the form of a CMOS sensor. Alternatively, the image acquisition unit is configured as a photosensitive chemical film. The first imaging system 6, in the form of a first optical imaging system, is configured as a camera. Specifically, the camera is configured as a film camera used in the field of cinematography. Alternatively, the camera is configured as a camera used in the field of photography. The first lens has at least one lens element and at least one aperture element, the at least one aperture element being provided with an aperture. For example, the first lens has at least one lens group that moves along the optical axis of the first lens for setting the focus of the first lens on an object and / or for setting the focal length of the first lens. In the preceding and following text, "lens group" is understood to mean a group having a single lens element or a group of multiple lens elements. Additionally, the lens group may also have at least one prism.

[0105] Figure 2 and Figure 3 An embodiment of a first imaging system 6 in the form of a camera 1000 is shown. Figure 2 A schematic representation of a camera 1000 is shown. The camera 1000 is, for example, formed as a camera or a film camera. The camera 1000 has a housing 1001 on which a lens 1002 is arranged. An image acquisition unit 1003, which acquires images formed through the lens 1002, is arranged in the housing 1001. For example, the image acquisition unit 1003 is a digital image acquisition unit, specifically a CMOS sensor. However, the invention is not limited to the use of a digital image acquisition unit. Rather, any image acquisition unit suitable for the invention (e.g., photographic film) can be used as the image acquisition unit. Figure 2In the embodiment shown, lens 1002 is formed as an interchangeable lens. However, the invention is not limited to this type of lens. Conversely, lenses that are non-removably arranged on the housing 1001 of camera 1000 are also suitable for the invention. For example, an XD data interface 1017 is arranged on lens 1002 for connection of a data storage unit.

[0106] Figure 3 The vertical section shows the results according to Figure 2 Another schematic representation of the camera 1000. In this embodiment, the lens 1002 has a first lens unit 1004 and a second lens unit 1005 arranged front and rear along the optical axis OA of the lens 1002. The lens 1002 may have a number of individual lens elements, lens groups and / or additional optical units, for example, in the form of a prism or mirror. The invention is not limited to a particular embodiment of the lens. Rather, any suitable lens can be used in the invention. An aperture stop unit 1016 with an adjustable aperture of diameter D is arranged between the first lens unit 1004 and the second lens unit 1005. The camera 1000 also has a processor 1006 and a monitor 1007. An image acquisition unit 1003 is also provided on the camera 1000. Starting from the object O to be imaged, in the direction of the image acquisition unit 1003, the object O is first arranged, then the lens 1002 is arranged and then the image acquisition unit 1003 is arranged. In addition, the camera 1000 and / or lens 1002 have a SLAM module 1008, the construction, function and operation mode of which are explained in more detail below.

[0107] SLAM module 1008 includes an inertial measurement unit (IMU), a depth camera, and an environment camera. The IMU of SLAM module 1008 has an accelerometer and a rotation rate sensor, which, for example, enable the detection of movement of camera 1000 or lens 1002 with six degrees of freedom. The IMU is essentially an inertial navigation system and is used to detect movement and to determine the position of camera 1000 or lens 1002 in space. The depth camera of SLAM module 1008 is used to determine the distance of lens 1002 from a point in space (i.e., a point in the environment of camera 1000). For example, the depth camera may be configured as an all-optical imaging unit, a stereo imaging unit, a time-of-flight imaging unit (i.e., a TOF imaging unit), and / or a unit for projecting and acquiring patterns (e.g., structured light projection or point cloud projection). All-optical imaging units, such as all-optical cameras, are known from the prior art. With an all-optical camera, not only the position and intensity of the light beam on image acquisition unit 1003 can be determined, but also the direction of the incident light beam. Stereo imaging units, such as stereo cameras, are also known from the prior art. This is based on the principle of stereo vision. Furthermore, TOF imaging units, such as TOF cameras, are also known from the prior art. In the case of a TOF camera, the distance between the object O and the TOF camera is measured using a time-of-flight method. However, it should be noted that the present invention is not limited to using the imaging units mentioned above for determining distance. Rather, any suitable method and / or any suitable imaging unit can be used to determine distance. For example, an ultrasonic measurement unit can also be used to determine distance using an ultrasonic measurement method. The environmental camera of the SLAM module 1008 is used to acquire data about the environment of the camera 1000.

[0108] Camera 1000 also includes a communication device 1009. Alternatively, lens 1002 includes the communication device 1009, which... Figure 3 The diagram is shown in dashed lines. The communication device 1009 is configured as a radio device that uses one or more transmission standards on one or more transmission paths. For example, Bluetooth is used as the transmission standard. Wireless local area networks (i.e., WLANs) are also used for transmission. As explained above, the invention is not limited to this type of communication device. Rather, the communication device 1009 can have any form suitable for the invention.

[0109] In another embodiment of the image forming system 1, alternatively or additionally, the first imaging system 6 is configured as a computer graphics system, which uses mathematical calculations of data to create a sequence of three-dimensional scenes with multiple three-dimensional representations. Alternatively, the computer graphics system creates the three-dimensional representations using mathematical calculations of data. For the calculations, the computer graphics designer uses, for example, a mathematical model of the three-dimensional scene and / or the three-dimensional representation. This mathematical model includes, for example, parameters that specifically describe the form, color, and surface finish of the object to be modeled and represented in the three-dimensional scene and / or the three-dimensional representation. Furthermore, the mathematical model includes, for example, parameters describing the lighting of the object, specifically the position, type, color, and direction of the light source to be modeled. Additionally, the mathematical model includes the position of the object in the three-dimensional scene and / or the three-dimensional representation in at least one of the following: acquisition direction, field of view, focal length, focus, image format, size of the image acquisition unit, position of the virtual camera, and movement path.

[0110] The image forming system 1 also includes a second imaging system 7. For example, the second imaging system 7 is configured as a second optical imaging system. The second imaging system 7, in the form of a second optical imaging system, has at least one lens element. The second imaging system 7, in the form of a second optical imaging system, is configured, for example, as a camera with a second lens. Specifically, it is provided that the camera is configured as a film camera used in the field of cinematography. Alternatively, it is provided that the camera is configured as a camera used in the field of photography. The second lens has at least one lens unit and at least one aperture unit, the at least one aperture unit being provided with an aperture. For example, the second lens has at least one lens group that moves along the optical axis of the second lens for setting the focus of the second lens on an object and / or for setting the focal length of the second lens. The lens group is understood above and below to mean a group having a single lens element or a group of multiple lens elements. Additionally, the lens group may also have at least one prism.

[0111] The second imaging system 7 can, for example, be similarly configured as shown in... Figure 2 and Figure 3 The comments mentioned above also apply here, as indicated in the text.

[0112] In one embodiment of the image forming system 1, alternatively or additionally, a second imaging system 7 is provided, which is formed as a virtual camera. An image of the object is formed by mathematical calculations using the virtual camera and displayed on the display unit 2 in such a way that it appears as if a camera with the same characteristics as the virtual camera is actually imaging the object.

[0113] The image forming system 1 has a first processor 8 and a second processor 9. The first processor 8 is assigned to a first data processing device 3. In other words, the first processor 8 is connected to the first data processing device 3. For example, it is provided that the first processor 8 is a unit of the first data processing device 3. The second processor 9 is assigned to a second data processing device 4. In other words, the second processor 9 is connected to the second data processing device 4. For example, it is provided that the second processor 9 is a unit of the second data processing device 4.

[0114] The first processor 8 and the second processor 9 have a computer program product having program code that has been partially or completely loaded into the first processor 8 and / or the second processor 9. During the execution of the program code, the image forming system 1 is controlled in such a way that the method according to the invention is performed. Embodiments of the method according to the invention are explained in more detail below.

[0115] Figure 4 and Figure 5 A flowchart illustrating an embodiment of the method according to the invention is shown. In method step S1, data about an object is provided by a first data processing device 3. As further mentioned above, the data about the object is data describing the object. For example, the data about the object is at least one two-dimensional input image of the object. Alternatively, the data about the object may be, for example, at least one three-dimensional representation of the object. Alternatively, the data provided may be data in which a multidimensional (e.g., two-dimensional or three-dimensional) representation of the object can be calculated. The above-mentioned enumeration of data about the object should not be construed as exhaustive. Rather, any data describing the object and suitable for performing the invention may be used.

[0116] As mentioned above, the data about the object includes, for example, at least one two-dimensional input image of the object. Figure 6 A schematic representation of an embodiment of a two-dimensional input image 10 is shown, the two-dimensional input image having a predetermined number of input image pixels P. op Let o and p be integers, and for these two numbers, the following conditions apply: 1 ≤ o ≤ n and 1 ≤ p ≤ n. Here, n corresponds to the total number of pixels in the input image. Figure 6 In this embodiment, the following condition applies: n = 81. For example, four pixels in the input image are represented by reference numerals, specifically by P. 11 P 19 P 91 and P 99It should be clearly stated that the total number of pixels in the input image is not limited to the values ​​mentioned above. Instead, the total number of pixels in the input image can take any suitable value. Specifically, the total number of pixels in the input image can be exactly within the range of 6 bits, exactly within 7 bits, exactly within 8 bits, or exactly within 9 bits.

[0117] The two-dimensional input image 10 is formed, for example, using the first imaging system 6. For example, the two-dimensional input image 10 is used in... Figure 2 and Figure 3 The image is formed by the camera 1000 shown in the figure. In this regard, the two-dimensional input image 10, as further explained above, is the image that is actually formed. Specifically, it is envisioned that the two-dimensional input image 10 is stored on a data carrier (not shown), and the first data processing device 3 loads and provides the input image 10 from the data carrier.

[0118] As discussed above, data about an object includes, for example, at least one three-dimensional representation. Figure 7 A schematic representation of an embodiment of the three-dimensional representation 11 is shown. This three-dimensional representation includes first data content in a first dimension D1, second data content in a second dimension D2, and third data content in a third dimension D3. The first data content, second data content, and third data content can be represented, for example, as voxels V. ijk , where i, j, and k are integers for which the following conditions apply, for example: 1 ≤ i ≤ m, 1 ≤ j ≤ m, and 1 ≤ k ≤ m. Here, m corresponds to the total number of voxels. The total number of voxels can take any suitable value. Specifically, the total number of voxels is exactly within the range of 6 bits, exactly within 7 bits, exactly within 8 bits, or exactly within 9 bits. The invention is not limited to the embodiments of data concerning objects described above with respect to three-dimensional representation. Rather, any embodiments suitable for the invention can be used. Referring to the further comments made above, these comments also apply here.

[0119] As mentioned above, a sequence of three-dimensional scenes and / or representations with multiple three-dimensional representations can be created through mathematical calculations of data. For this purpose, a mathematical model of the three-dimensional scene and / or representation is used. This mathematical model includes, for example, parameters that specifically describe the form, color, and surface finish of the object to be modeled and represented in the three-dimensional scene and / or representation. Furthermore, the mathematical model includes, for example, parameters describing the lighting of the object, specifically the position, type, color, and direction of the light source to be modeled. Additionally, the mathematical model includes the position of the object in the three-dimensional scene and / or representation in at least one of the following: acquisition direction, field of view, focal length, focus, image format, size of the image acquisition unit, position of the virtual camera, and movement path. The data calculated using the mathematical model is, for example, data about the object.

[0120] In method step S2, a first data processing device 3 is used to provide a first data record. In one embodiment of the method according to the invention, the first data record includes the following first data:

[0121] (i) User identification data, which clearly identifies the user according to the method of the invention. For example, the user identification data includes a use authorization for performing the method according to the invention or a portion thereof. The use authorization may exist at any time, for example, when the user has already paid for performing the method according to the invention, will pay in the near future, has been provided with a credit line for performing the method according to the invention, or has already obtained permission to perform the method according to the invention;

[0122] (ii) Identification data, which allows for the clear identification of data concerning the object. In this way, for example, data relating to a two-dimensional input image 10 and / or data relating to a three-dimensional representation 11 of the object can be clearly identified.

[0123] (iii) at least a first imaging parameter of the first imaging system 6, which has been used to generate data about the object, and / or at least a second imaging parameter of the second imaging system 7, which is intended to represent an image of the object on the display unit 2 based on the data about the object using the characteristics of the second imaging system.

[0124] Therefore, the first data may at least include first imaging parameters of the first imaging system 6, with which data about the object has already been generated. An example of the first imaging parameters is... Figure 8 The first metadata 12A of the first imaging system 6 is used as a first imaging parameter. The first metadata 12A includes, for example, imaging characteristics and / or functional units of the first imaging system 6. These are specifically read from the object's data or manually input into the first data processing device 3 via the first data processing device 3. For example, the first metadata 12A includes at least one of the following parameters:

[0125] - First camera data 13A about camera 1000 has been used to generate data about the object;

[0126] - Regarding the first lens data 14A of lens 1002, data about the object has been generated using the first lens data;

[0127] - Regarding the first aperture unit data 15A of aperture unit 1016, data about the object has been generated using the first aperture unit data;

[0128] - Regarding the first focusing unit data 16A, which is in the form of a first lens unit 1004 and a second lens unit 1005, data about the object has been generated using the first focusing unit data;

[0129] -Regarding the first focal length setting unit data 17A, which is in the form of a first lens unit 1004 and a second lens unit 1005, data about the object has been generated using the first focal length setting unit data;

[0130] - First information 18A regarding the position and orientation of the first imaging system 6 in the form of a camera 1000 in space. In other words, first information 18A regarding the position and alignment of the first imaging system 6, for example, in three-dimensional space; and

[0131] - First information 19A regarding the resolution of the first imaging system 6. In other words, the resolution of the data about the object that has been generated using it is provided. For example, the resolution is a so-called "full HD" resolution, that is, specifically a resolution of 1920 × 1080 pixels. Alternatively, or as an alternative, the resolution is a so-called 2K resolution, that is, specifically a resolution of 2560 × 1440 pixels. However, the invention is not limited to the resolutions mentioned above. Instead, any resolution suitable for the invention can be used. Alternatively, or as an alternative, the user can input a desired target resolution.

[0132] As explained above, the first imaging system 6 can also be configured as a computer graphics system, which creates a three-dimensional scene with a sequence of multiple three-dimensional representations through mathematical calculations of data. Alternatively, the computer graphics system creates the three-dimensional representations through mathematical calculations of data. Then, the first data recorded includes, for example, data generated through mathematical calculations. Alternatively, the mathematically calculated data mentioned above can be converted into a two-dimensional image sequence and / or two-dimensional images. Then, the first data includes data from the two-dimensional image sequence and / or two-dimensional images.

[0133] As explained above, additionally or alternatively, the first data may at least include the second imaging parameters of the second imaging system 7. The characteristics of the second imaging system 7 are intended to represent an image of the object on the display unit 2 based on data about the object. For embodiments in which the second imaging system 7 is formed as a second optical imaging system, examples of the second imaging parameters are as follows: Figure 8The second metadata 12B of the second imaging system 7 is used as a second imaging parameter. The second metadata 12B includes, for example, imaging characteristics and / or functional units of the second imaging system 7. These are specifically read from the object's data by the first data processing device 3 or manually input into the first data processing device 3. For example, the second metadata 12B includes at least one of the following parameters:

[0134] -Second camera data 13B about camera 1000, intended to use the characteristics of the second camera to represent data about the object on display unit 2;

[0135] - Regarding the second lens data 14B of lens 1002, the purpose is to display data about the object on the display unit 2 using the characteristics of the second lens;

[0136] - Regarding the second aperture unit data 15B of aperture unit 1016, it is intended to use the characteristics of the second aperture unit to represent data about the object on the display unit 2;

[0137] -Regarding the second focusing unit data 16B, which is in the form of a first lens unit 1004 and a second lens unit 1005, the second focusing unit is intended to display data about the object on the display unit 2 using the characteristics of the second focusing unit;

[0138] -Regarding the second focal length setting unit data 17B, which is in the form of a first lens unit 1004 and a second lens unit 1005, the second focal length setting unit is intended to display data about the object on the display unit 2 using the characteristics of the second focal length setting unit;

[0139] -Second information 18B regarding the position and orientation of the second imaging system 7 in the form of camera 1000 in space. In other words, second information 18B is provided regarding the position and alignment of the second imaging system 7, for example, in three-dimensional space; and

[0140] - Second information 19B regarding the resolution of the second imaging system 7. In other words, the resolution of the data about the object that has been generated using it is provided. For example, the resolution is a so-called "full HD" resolution, that is, specifically a resolution of 1920 × 1080 pixels. Alternatively, or as an alternative, the resolution is a so-called 2K resolution, that is, specifically a resolution of 2560 × 1440 pixels. However, the invention is not limited to the resolutions mentioned above. Instead, any resolution suitable for the invention can be used. Alternatively, or as an alternative, the user can predetermine the desired target resolution.

[0141] Alternatively, or as an alternative, the second imaging system 7 is provided as a virtual camera. At least the second imaging parameters have the effect that an object image based on data about the object is represented on the display unit 2 in such a way that it appears as if the virtual camera using the second imaging parameters is actually imaging the object. In other words, the image of the object is intended to be formed and represented on the display unit 2 based on data about the object through mathematical calculations, in such a way that it appears as if a camera with characteristics selected by the second imaging parameters is actually imaging the object.

[0142] In method step S3, a first data record is loaded from the first data processing device 3 into the second data processing device 4. Then, in method step S4, a second data record is loaded from the data memory 5 into the second data processing device 4 based on the first data record loaded into the second data processing device 4. In other words, a second data record is selected based on the first data record loaded into the second data processing device 4, and then the second data record is loaded from the data memory 5 into the second data processing device 4. If the first data record relates to a first imaging parameter of the first imaging system 6, the second data record has second data, which includes modification data for modifying imaging errors based on the first imaging parameters of the first imaging system 6. For example, the modification data is data for correcting imaging errors based on the first imaging parameters of the first imaging system 6. If the first data record additionally or alternatively relates to a second imaging parameter of the second imaging system 7, the second data record has second data, which includes modification data for modifying data about the object based on the second imaging parameters of the second imaging system 7.

[0143] Therefore, the second data may include modification data for modifying imaging errors based on the first imaging parameters of the first imaging system 6. Specifically, the modification data is data used to correct imaging errors based on the first imaging parameters of the first imaging system 6. In other words, the second data includes correction data that can be used to reduce or completely correct imaging errors that have occurred when generating data about the object (specifically, when forming the aforementioned two-dimensional input image 10 of the object). For example, the correction data is data used to correct distortions in the first imaging system 6. Alternatively, or as an alternative, data for correcting vignetting in the first imaging system 6 is provided as correction data.

[0144] Alternatively, the second data may include modification data for modifying the data about the object based on the second imaging parameters of the second imaging system 7. In other words, by means of this modification data, the data about the object can be modified according to the second imaging parameters of the second imaging system 7. For example, the data about the object may be modified in such a way that the modification has the effect of forming an image of the object that substantially corresponds to an image of the object formed by the second optical imaging system 7 mentioned above or by the virtual camera mentioned above.

[0145] The second data record can be designed, for example, in the form of a polynomial. The polynomial represents, for example, a virtual camera and mathematically describes how a light beam entering and exiting the lens of the virtual camera images onto the image acquisition unit of the virtual camera, and where within the image acquisition unit it images. For example, the polynomial has the following form:

[0146]

[0147] Where, x s and y s The x represents the position of the emitted light beam on the surface of the image acquisition unit. a and y a This represents the position of the incident beam on the virtual aperture plane, and β is the desired imaging scale.

[0148] In method step S5, the second data record is loaded from the second data processing device 4 into the first data processing device 3. In this case, identification data about the object can be loaded from the second data processing device 4 into the first data processing device 3 together with the second data record. Alternatively, or as an alternative, information about the cost of performing the method is loaded from the second data processing device 4 into the first data processing device 3 together with the second data record.

[0149] If the user agrees to the cost, method step S6 is executed. If the user does not agree to the cost, the second data is erased from the first data processing device 3 and the method is stopped. Alternatively, it is envisioned that the user is notified of the cost for continuing to execute the method and then method step S6 is executed. In method step S6, a processing data record is then generated using the first data processing device 3 based on the second data record. For example, the processing data record includes a correction diagram. Alternatively, it is provided that the second data record is detected by the first data processing device 3 and used as the processing data record unchanged.

[0150] In method step S7, a two-dimensional output image of the object is formed by the first data processing device 3 by processing data records to process data about the object, and the output image has a predetermined number of output image pixels. For example, a correction map formed as a processing data record is placed on the two-dimensional input image 10 of the object and corrections for these imaging errors are performed. The formed two-dimensional output image is then the two-dimensional input image 10 of the object with these corrections. For example, if the processing data record is specifically formed as a second data record in the form of a polynomial, the data about the object is processed by the processing data record in such a way that an object image that substantially corresponds to or substantially corresponds to the object image formed by the second optical imaging system 7 mentioned above or the object image formed by the virtual camera mentioned above is formed as a two-dimensional output image. The two-dimensional output image of the object can then be displayed on the display unit 2.

[0151] As mentioned above, in an embodiment of the method according to the invention, the first data record loaded into the second data processing device 4 has identification data and / or user identification data regarding the object. In another embodiment of the method according to the invention, before performing method step S4 (in which the second data record is loaded from the data storage 5), it is first checked whether an authorization for using the second data record exists. This embodiment of the method according to the invention... Figure 9 The method step S3A is described in the diagram. Therefore, in step S3A, the existence of a usage authorization for using the second data record with the first data processing device 3 and / or the second data processing device 4 is checked based on identification data and / or user identification data using the first data processing device 3 and / or the second data processing device 4. The usage authorization can exist at any time, for example, when the user has already paid for performing the method according to the invention, will pay in the near future, has been provided with a credit line for performing the method according to the invention, or has already obtained a license to perform the method according to the invention. If the usage authorization exists, step S4 is performed according to step S3B. If the usage authorization does not exist, the user is notified of this situation. In this case, the user can obtain the usage authorization, for example, by paying a usage fee for performing the method according to the invention or by obtaining a license. If the user has not obtained a usage authorization, the method according to the invention is stopped according to step S3B. Alternatively, or as an alternative, it is contemplated that the second data record be erased.

[0152] In yet another embodiment of the method according to the invention, it is additionally or alternatively provided that, before performing method step S6 (in which the processing data record is generated or detected), a use authorization for using the second data record is first checked. This embodiment of the method according to the invention... Figure 10The method step S5A is executed first after method step S5. In this case, the identification data and / or user identification data are again loaded from the first data processing device 3 into the second data processing device 4. In method step S5B, the second data processing device 4 checks whether a usage authorization exists for using the second data record with the first data processing device 3 and / or the second data processing device 4 based on the identification data and / or user identification data. A usage authorization can exist at any time, for example, when the user has already paid for performing the method according to the invention, will pay in the near future, has been provided with a credit line for performing the method according to the invention, or has already obtained a license to perform the method according to the invention. If a usage authorization exists, method step S6 is executed according to method step S5C. The data record is generated or detected only when a usage authorization exists. If a usage authorization does not exist, the user is notified of this situation. In this case, the user can obtain a usage authorization, for example, by paying a usage fee for performing the method according to the invention or by obtaining a license. If the user does not obtain a usage authorization, the method according to the invention is stopped according to method step S5C. Alternatively, or as an alternative, it is contemplated that the second data record be erased.

[0153] In one embodiment of the method according to the invention, it is additionally or alternatively provided that a further method step S8 is performed after method step S7. Method step S8 is... Figure 11 The text indicates that, in this embodiment of the method according to the invention, the two-dimensional output image is modified again after the two-dimensional output image of the object is formed. For this purpose, the second data of the second data record includes modification data used to modify the output image of the formed object according to the first imaging parameters of the first imaging system 6 to incorporate imaging errors into the output image of the object. Furthermore, the processing data record has processing data based on the modification data after formation or detection. In method step S8, the output image of the object is modified by using the processing data with the first data processing device 3 to process at least one output image pixel from a predetermined number of output image pixels of the object's output image, the pixel values ​​of which are modified using the processing data. In this embodiment, it is advantageous to process, for example, an output image that has previously been fully or almost fully corrected and has no imaging errors by incorporating imaging errors, in a way that produces an almost natural aesthetic impression, as in the case of an actual image created by an optical imaging system.

[0154] Figure 12 A schematic representation of another embodiment of the method according to the invention is shown. This further embodiment of the method according to the invention is based on... Figure 4 and Figure 5The embodiments are as follows. Therefore, referring first to the statements made above, these statements also apply here. According to Figure 12 Another embodiment also has method steps S1 to S3. Method step S10 is performed after method step S3. In method step S10, a license data record is generated using the second data processing device 4 based on the first data record loaded into the second data processing device 4. The license data record is essentially an electronic key, which can be used to decrypt (i.e., open) a suitable second data record in order to process data about the object.

[0155] In method step S11, the license data record is loaded from the second data processing device 4 into the first data processing device 3. In this case, identification data about the object can be loaded from the second data processing device 4 into the first data processing device 3 together with the license data record. Alternatively, or as an alternative, information about the cost of performing the method is loaded from the second data processing device 4 into the first data processing device 3 together with the license data record.

[0156] If the user agrees to the cost, then method step S12 is executed. If the user does not agree to the cost, then the permission data record is erased from the first data processing device 3 and the method is stopped. Alternatively, it is envisioned that the user is notified of the cost for continuing to execute the method and then method step S12 is executed.

[0157] In method step S12, a second data record is loaded from the data memory 5 into the first data processing device 3 based on the first data record loaded into the second data processing device 4. The second data record has second data, which includes: (i) modification data for modifying imaging errors according to the first imaging parameters of the first imaging system 6, specifically correction data for correcting imaging errors according to the first imaging parameters of the first imaging system 6; and / or (ii) modification data for modifying data about the object according to the second imaging parameters of the second imaging system 7. Regarding the second data record, refer to the further comments made above, which also apply here.

[0158] In method step S13, the first data processing device 3 then decrypts the second data record using a licensed data record. After method step S13, method step S6 and any other subsequent method steps are executed.

[0159] As mentioned above, in embodiments of the method according to the invention, the first data record loaded into the second data processing device 4 contains identification data and / or user identification data regarding the object. Figure 12In another embodiment of the method according to the invention, it is provided that, before performing method step S10 (in which the license data record is generated), a use authorization for using the license data record is first checked. This embodiment of the method according to the invention is similar to... Figure 9 The embodiments illustrated herein are executed. Therefore, the existence of a usage authorization for using the license data record with the first data processing device 3 and / or the second data processing device 4 is checked based on identification data and / or user identification data using the first data processing device 3 and / or the second data processing device 4. A usage authorization can exist at any time, for example, when the user has already paid for performing the method according to the invention, will pay in the near future, has been provided with a credit line for performing the method according to the invention, or has already obtained a license to perform the method according to the invention. If a usage authorization exists, method step S10 is executed. If a usage authorization does not exist, the user is notified of this situation. In this case, the user can obtain a usage authorization, for example, by paying a usage fee for performing the method according to the invention or by obtaining a license. If the user does not obtain a usage authorization, the method according to the invention is stopped.

[0160] According to Figure 12 In yet another embodiment of the method according to the invention, it is additionally or alternatively provided that, before performing method step S12 (in which the second data record is loaded from the data memory 5 into the first data processing device 3), a use authorization for the use license data record is first checked. This embodiment of the method according to the invention is similar to that according to... Figure 10 The implementation of the embodiment is as follows. Therefore, the identification data and / or user identification data are first loaded again from the first data processing device 3 into the second data processing device 4. Based on the identification data and / or user identification data, the existence of a usage authorization for using the license data record with the first data processing device 3 and / or the second data processing device 4 is checked by using the second data processing device 4. The usage authorization may exist at any time, for example, when the user has already paid for performing the method according to the invention, will pay in the near future, has been provided with a credit line for performing the method according to the invention, or has already obtained a license to perform the method according to the invention. If the usage authorization exists, method step S12 is executed. If the usage authorization does not exist, the user is notified of this situation. In this case, the user can obtain the usage authorization, for example, by paying the usage fee for performing the method according to the invention or by obtaining a license. If the user does not obtain the usage authorization, the method according to the invention is stopped. Alternatively or as an alternative, it is contemplated that the license data record be erased.

[0161] Figure 13A schematic representation of yet another embodiment of the method according to the invention is shown. Still other embodiments of the method according to the invention are based on... Figure 4 The embodiments are as follows. Therefore, referring first to the statements made above, these statements also apply here. According to Figure 13 Another embodiment also includes method steps S1 to S4. Method step S14 is performed after method step S4. In method step S14, a processing data record is generated using the second data processing device 4, or a second data record is detected as being used as a processing data record. Alternatively, for example, it is provided that the processing data record is loaded from the second data processing device 4 into the first data processing device 3 (method step S15), and the first data processing device 3 is used to form a two-dimensional output image of the object (method step S16). Alternatively, after step S14, it is provided that the second data processing device 4 is used to form a two-dimensional output image of the object (method step S17), and the two-dimensional output image is loaded from the second data processing device 4 into the first data processing device 3 (method step S18). Regarding the formation of the output image, refer to the further comments made above, which also apply here.

[0162] This invention provides a method and image forming system 1 for forming an image of an object, by which one or more imaging errors in the actually formed image and / or image sequence can be modified and specifically corrected in a simple manner. To this end, the invention always provides a suitable processing data record, which can completely or substantially correct the one or more imaging errors in the actually formed image. Furthermore, the invention ensures that the artificially created object representation has no discernible difference from the actually formed image and / or image sequence, or only a few discernible differences. Also for this purpose, a suitable processing data record is always provided, which can be used to process the artificially created representation of the object accordingly.

[0163] The features of the invention disclosed in this specification, drawings, and claims may be essential for implementing the invention in the various embodiments, either individually or in any combination. The invention is not limited to the described embodiments. Modifications may be made within the scope of the claims and taking into account the knowledge of those skilled in the art.

[0164] List of reference numerals

[0165] 1 Image Forming System

[0166] 2 Display Units

[0167] 3 First Data Processing Device

[0168] 4 Second Data Processing Device

[0169] 5. Data Storage

[0170] 6 First Imaging System

[0171] 7 Second Imaging System

[0172] 8 First Processor

[0173] 9 Second Processor

[0174] 10 Input Images

[0175] 11 Three-dimensional representation

[0176] 12A First Metadata

[0177] 12B Secondary Metadata

[0178] 13A First Camera Data

[0179] 13B Second Camera Data

[0180] 14A First Lens Data

[0181] 14B Second Lens Data

[0182] 15A First Aperture Unit Data

[0183] 15B Second Aperture Unit Data

[0184] 16A First Focusing Unit Data

[0185] 16B Second Focusing Unit Data

[0186] 17A First Focal Length Setting Unit Data

[0187] 17B Second Focal Length Setting Unit Data

[0188] 18A First information about location and positioning

[0189] 18B Second information regarding location and positioning

[0190] 19A First information regarding the resolution of the first imaging system

[0191] 19B Second information regarding the resolution of the second imaging system

[0192] 1000 cameras

[0193] 1001 Housing

[0194] 1002 Lens

[0195] 1003 Image Acquisition Unit

[0196] 1004 First Lens Unit

[0197] 1005 Second Lens Unit

[0198] 1006 processor

[0199] 1007 Monitor

[0200] 1008 SLAM Module

[0201] 1009 Communication device

[0202] 1016 aperture units

[0203] 1017 XD Data Interface

[0204] O object

[0205] OA optical axis

[0206] D diameter

[0207] D1 First Dimension

[0208] D2 Second Dimension

[0209] D3 Third Dimension

[0210] S1 to S8 Method Steps

[0211] S10 to S18 Method Steps

[0212] S3A to S3B Method Steps

[0213] S5A to S5C Method Steps

[0214] V Voxel

Claims

1. A method for forming an image of an object (O), the method comprising the following method steps: - Data about the object (O) is provided by the first data processing device (3); - The first data processing device (3) provides at least a first data record having first data, the first data including the following data: (i) at least a first imaging parameter of the first imaging system (6), with which data about the object (O) has been generated, and / or (ii) at least a second imaging parameter of the second imaging system (7), which is intended to represent an image of the object (O) on the display unit (2) based on the data about the object (O) using the characteristics of the second imaging system; - Load the first data record from the first data processing device (3) into the second data processing device (4), wherein the first data record loaded from the first data processing device into the second data processing device has user identification data; - Load the second data record from the data memory (5) into the second data processing device (4) according to the first data record loaded into the second data processing device (4). The second data record has second data, which includes the following: (i) modification data for modifying the imaging error according to the first imaging parameters of the first imaging system (6) and / or (ii) modification data for modifying the data about the object according to the second imaging parameters of the second imaging system (7); - Generate a processing data record based on the second data record or detect that the second data record is used as the processing data record; - By processing data about the object using the processing data record, a two-dimensional output image of the object (O) is formed, the output image having a predetermined number of output image pixels; as well as - By using the first data processing device and / or the second data processing device based on the user identification data, it checks whether there is a usage authorization for using the second data record with the first data processing device and / or the second data processing device, and generates the processing data record only if the usage authorization exists.

2. The method according to claim 1, wherein, - Load the second data record from the second data processing device (4) into the first data processing device (3); and wherein, - The first data processing device (3) is used to generate the processed data record or to detect that the second data record is used as the processed data record.

3. The method according to claim 1 or 2, wherein, The first data processing device (3) is used to form a two-dimensional output image of the object (O).

4. The method according to claim 1, wherein, The second data processing device (4) is used to generate the processing data record or to detect that the second data record is used as the processing data record.

5. The method according to claim 4, wherein the method comprises one of the following method steps: (i) The processed data record is loaded from the second data processing device (4) into the first data processing device (3) and the first data processing device (3) is used to form a two-dimensional output image of the object (O); (ii) Using the second data processing device (4) to generate a two-dimensional output image of the object (O) and loading the two-dimensional output image from the second data processing device (4) into the first data processing device (3).

6. The method according to any one of the preceding claims, wherein, - The data about the object (O) includes at least one two-dimensional input image (10) of the object (O); - The input image (10) of the object (O) has a predetermined number of input image pixels (P) op ); And among them, - During the formation of the output image of the object (O), a predetermined number of input image pixels (P) of the input image (10) of the object (O) are processed using the processing data record. op At least one input image pixel (P) in ) op The input image pixels (P) of the input image (10) of the object (O) op The pixel values ​​are modified using the data recorded in the processing data log.

7. The method according to any one of the preceding claims, wherein, - The data concerning the object (O) involves at least one three-dimensional representation (11); - The data about this object (O) includes the first data content (V) of the first dimension (D1). ijk The second data content (V) of the second dimension (D2) ijk ) and the third dimension (D3) of the third data content (V) ijk ); and among them, - During the formation of the output image of the object (O), the first data content (V) is processed by using the processing data record. ijk The second data content (V) ijk ) and / or the third data content (V ijk ), where the first data content (V) ijk The second data content (V) ijk ) and / or the third data content (V ijk () is modified using the data recorded in the data processing.

8. The method according to any one of the preceding claims, wherein, The first optical imaging system is used as the first imaging system (6).

9. The method according to any one of the preceding claims, wherein, At least one of the following parameters of the first imaging system (6) is used as the first imaging parameter: (i) The first metadata (12A) of the first imaging system (6); (ii) Regarding the first camera data (13A), data about the object (O) has been generated using the first camera data; (iii) Regarding the first lens data (14A), data about the object (O) has been generated using the first lens data; (iv) Regarding the first aperture unit data (15A), data about the object (O) has been generated using the first aperture unit data; (v) Regarding the first focusing unit data (16A), data about the object (O) has been generated using the first focusing unit data; (vi) Regarding the first focal length setting unit data (17A) of the first focal length setting unit, data about the object (O) has been generated using the first focal length setting unit data; (vii) First information regarding the location and orientation of the first imaging system (6) in space; (viii) First information regarding the resolution of the first imaging system and / or the desired target resolution.

10. The method according to any one of the preceding claims, wherein, The second optical imaging system is used as the second imaging system (7).

11. The method according to claim 10, wherein, At least one of the following parameters of the second imaging system is used as the second imaging parameter: (i) The second metadata (12B) of the second optical imaging system; (ii) Second camera data (13B) regarding the second camera, intended to represent data about the object (O) on the display unit (2) using the characteristics of the second camera; (iii) Second lens data (14B) regarding the second lens, intended to represent data about the object (O) on the display unit (2) using the characteristics of the second lens; (iv) Second aperture unit data (15B) regarding the second aperture unit, intended to represent data about the object (O) on the display unit (2) using the characteristics of the second aperture unit; (v) Second focusing unit data (16B) regarding the second focusing unit, which is intended to represent data about the object (O) on the display unit (2) using the characteristics of the second focusing unit; (vi) Data (17B) of the second focal length setting unit, which is intended to represent data about the object (O) on the display unit (2) using the characteristics of the second focal length setting unit; (vii) Second information regarding the location and orientation of the second imaging system (7) in space; (viii) Second information regarding the resolution of the first imaging system and / or regarding the desired target resolution.

12. The method according to any one of the preceding claims, wherein, The method includes at least one of the following method steps: (i) The data used to modify the distortion of the first imaging system (6) is used as the modification data; (ii) The vignetting data used to modify the first imaging system (6) is used as the modification data; (iii) The data used to correct the distortion of the first imaging system (6) is used as the modification data; (iv) Use the vignetting data used to correct the first imaging system (6) as the modification data.

13. The method according to any one of the preceding claims, wherein, The method includes at least one of the following method steps: (i) Using a virtual camera as the second imaging system (7), an image of the object (O) is formed by mathematical calculation based on data about the object (O) in such a way that it appears as if a camera with characteristics selected by the second imaging parameters is actually imaging the object (O); (ii) Using a mathematical mapping rule as the second data record, the mathematical mapping rule represents the virtual camera and mathematically describes how a beam of light entering the lens of the virtual camera and exiting the lens again is imaged on the image acquisition unit of the virtual camera and where it is imaged on the image acquisition unit of the virtual camera. (iii) A polynomial is used as the second data record, which represents the virtual camera and mathematically describes how a beam of light entering the lens of the virtual camera and exiting the lens again is imaged on the image acquisition unit of the virtual camera and where it is imaged on the image acquisition unit of the virtual camera. (iv) The Fourier expansion is used as the second data record, which represents the virtual camera and mathematically describes how a beam of light entering the lens of the virtual camera and exiting the lens again is imaged on the image acquisition unit of the virtual camera and where it is imaged on the image acquisition unit of the virtual camera.

14. The method according to any one of the preceding claims, wherein, The first data record loaded from the first data processing device (3) into the second data processing device (4) has identification data about the object (O).

15. The method according to claim 14, wherein, Perform the following steps: - By using the first data processing device (3) and / or the second data processing device (4) based on the identification data, the device checks whether there is an authorization to use the second data record with the first data processing device (3) and / or the second data processing device (4), and generates the processing data record only if the authorization to use the second data record exists.

16. The method of claim 14, wherein, Perform the following steps: (i) The identification data and / or the user identification data are loaded again from the first data processing device (3) into the second data processing device (4); (ii) By using the second data processing device (4) to check whether there is a usage authorization for using the second data record with the first data processing device (3) and / or the second data processing device (4) based on the identification data and / or the user identification data, the processing data record is generated only if the usage authorization exists.

17. The method according to any one of the preceding claims, wherein, - The second data recorded in the second data record includes modification data, which is used to modify the output image of the object (O) formed according to the first imaging parameters of the first imaging system (6) to incorporate the imaging error into the output image of the object (O); -The processing data record contains processing data based on the modified data after it is formed or detected; and wherein, - The method includes the following steps: modifying the output image of the object (O) by using the processing data with the first data processing device (3) and / or the second data processing device (4) to process at least one output image pixel of a predetermined number of output image pixels of the output image of the object (O), wherein the pixel value of the output image pixel of the output image of the object (O) is modified by the processing data.

18. A method for forming an image of an object (O), the method comprising the following method steps: - Data about the object (O) is provided by the first data processing device (3); - The first data processing device (3) provides at least a first data record having first data, the first data including the following data: (i) at least a first imaging parameter of the first imaging system (6), with which data about the object (O) has been generated, and / or (ii) at least a second imaging parameter of the second imaging system (7), which is intended to represent an image of the object (O) on the display unit (2) based on the data about the object (O) using the characteristics of the second imaging system; - Load the first data record from the first data processing device (3) into the second data processing device (4); - Generate a license data record based on the first data record loaded into the second data processing device (4); - Load the license data record from the second data processing device (4) into the first data processing device (3); - Load a second data record from the data memory (5) into the first data processing device (3) according to the first data record loaded into the second data processing device (4). The second data record has second data, which includes the following data: (i) modification data for modifying the imaging error according to the first imaging parameters of the first imaging system (6) and / or (ii) modification data for modifying the data about the object (O) according to the second imaging parameters of the second imaging system (7); -Decrypt the second data record by using the licensed data record; - Based on the second data record, the first data processing device (3) is used to generate a processing data record or the first data processing device (3) is used to detect that the second data record is used as the processing data record; as well as - A two-dimensional output image of the object (O) is formed by processing data about the object (O) using the processing data record, the output image having a predetermined number of output image pixels.

19. A computer program product having program code capable of being loaded into a processor of an image forming system (1) and, when the program code has been loaded into the processor, controlling the image forming system (1) during execution of the program code in such a way that the method according to any one of the preceding claims is performed.

20. An image forming system (1) for forming an image of an object (O), the image forming system having - Display unit (2); - First imaging system (6); -Second imaging system (7); - A first data processing device (3) for providing data about the object (O) and for providing a first data record having first data including the following: (i) at least the first imaging parameters of the first imaging system (6), with which data about the object (O) has been generated, and / or (ii) at least the second imaging parameters of the second imaging system (7), intended to represent an image of the object (O) on the display unit (2) based on the data about the object (O) using the characteristics of the second imaging system; - A second data processing device (4), which is connected to the first data processing device (3) for data exchange; - Data storage (5), wherein a second data record is stored, and wherein the second data record has second data, the second data including the following data: (i) modification data for modifying imaging errors based on the first imaging parameters of the first imaging system (6) and / or (ii) modification data for modifying data about the object (O) based on the second imaging parameters of the second imaging system (7); and having - At least one processor, wherein the at least one processor is loaded with the computer program product according to claim 19.

21. The image forming system (1) according to claim 20, wherein, (i) The first imaging system (6) is formed as a first optical imaging system; and / or wherein, (ii) The second imaging system (7) is formed as a second optical imaging system.

22. The image forming system (1) according to claim 20 or 21, wherein, The first imaging system (6) has at least one of the following features: (i) First camera; (ii) First lens; (iii) First aperture unit; (iv) First focusing unit; (v) First focal length setting unit.

23. The image forming system (1) according to any one of claims 20 to 22, wherein, The second imaging system (7) has at least one of the following features: (i) Second camera; (ii) Second lens; (iii) Second aperture unit; (iv) Second focusing unit; (v) Second focal length setting unit.

24. The image forming system (1) according to claim 20, wherein, The image forming system has at least one of the following characteristics: (i) The second imaging system (7) is a virtual camera that is used to form an image of the object (O) by mathematical calculation based on data about the object (O) in such a way that it appears as if a camera with characteristics selected by the second imaging parameters is actually imaging the object (O); (ii) The second data record is formed as a mathematical mapping rule, which represents the virtual camera and mathematically describes how a beam of light entering the lens of the virtual camera and exiting the lens again is imaged on the image acquisition unit of the virtual camera and where it is imaged on the image acquisition unit of the virtual camera. (iii) The second data record is formed as a polynomial, which represents the virtual camera and mathematically describes how a beam of light entering the lens of the virtual camera and exiting the lens again is imaged on the image acquisition unit of the virtual camera and where it is imaged on the image acquisition unit of the virtual camera. (iv) The second data record is formed as a Fourier expansion, which represents the virtual camera and mathematically describes how a beam of light entering the lens of the virtual camera and exiting the lens again is imaged on the image acquisition unit of the virtual camera and where it is imaged on the image acquisition unit of the virtual camera.

Images