Method and apparatus for generating information from camera images - Patents.com
By evaluating camera image data quality before extraction and discarding low-quality images, the method optimizes computational efficiency by reducing unnecessary calculations and time.
Patent Information
- Application Number
- JP2021008613
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2020-01-24
- Filing Date
- 2021-01-22
- Publication Date
- 2025-01-28
- Estimated Expiration
- 2041-01-22
AI Technical Summary
Existing methods for evaluating camera image data are inefficient due to the need to repeat operations if defects are detected, leading to excessive calculation and time loss.
A method that evaluates camera image data in multiple steps, determines the data quality before extraction, and discards images with insufficient quality, allowing for reduced calculations by skipping further processing if the data quality deviates beyond a threshold.
This approach reduces unnecessary calculations and time by discarding low-quality image data early in the process, optimizing computational efficiency and saving time.
Smart Images

Figure 0007623144000001 
Figure 0007623144000002
Abstract
Description
[Technical field]
[0001] The present invention relates to a method for generating information from at least one camera image of an object, the method comprising the steps of: A) recording raw image data of at least one camera image; B) evaluating raw image data of at least one camera image in a plurality of evaluation steps, in which in at least one of the plurality of evaluation steps the raw image data of the at least one camera image or image data extracted from the raw image data of the at least one camera image are processed by mathematical combination with one another so as to generate combined image data; C) deriving information from the combined image data; D) outputting the information.
[0002] The invention also relates to an apparatus for carrying out such a method. [Background technology]
[0003] The evaluation of the raw image data of one or more camera images is accomplished step by step, and based on the nature of the recording of the raw image data of the camera images in one or more evaluation steps, the raw image data of one or more images are processed by mathematical concatenation so that combined image data is generated. In the case of the current state of the art, it may only be possible to recognize whether the raw image data is defective or not after information has been extracted from the combined image data. If there are defects in the raw image data, the recording of the raw image data of at least one camera image must be repeated and the entire operation of evaluating the raw image data must be carried out anew, which involves additional calculation effort and significant time losses. Summary of the Invention [Problem to be solved by the invention]
[0004] In comparison, it is an object of the present invention to provide a method for generating information from at least one camera image of an object, which method can be performed with reduced computational involvement even with defective raw image data. It is a further object of the present invention to provide an apparatus for performing such a method. [Means for solving the problem]
[0005] According to the invention, the above object is achieved by a method for generating information from at least one camera image of an object, the method comprising the steps of: A) recording raw image data of at least one camera image; B) evaluating raw image data of at least one camera image in a plurality of evaluation steps, in which in at least one of the plurality of evaluation steps the raw image data of the at least one camera image or image data extracted from the raw image data of the at least one camera image are processed by mathematical combination with one another so as to generate combined image data; C) extracting information from the combined image data; D) outputting the information; E) determining, before or after at least one of the evaluation steps of step B), a real measure of the data quality of the raw image data of at least one camera image; F) determining the deviation between an actual measure of data quality and a target measure of data quality of the raw image data of at least one camera image; G) if the deviation determined in step F) is greater than a predefined threshold, re-recording all raw image data of said camera images and re-performing at least one evaluation step from step B) and steps C) to F) until either the deviation determined in step F) for all raw image data of said camera images from said plurality of camera images is less than the threshold or a predefined termination condition is met. Includes.
[0006] The basic idea of the invention is to determine the data quality of the original image data of at least one camera image before information is extracted from the combined image data. In that way, it is possible to at least omit the step of extracting information from the combined image data (step C)) if it turns out that the original image data of at least one camera image is not of sufficiently high quality to obtain information from the combined image data. In that respect, according to step G), those camera images are discarded and then newly recorded if the deviation determined in step F) is greater than a predefined threshold, and the evaluation operation is carried out again until either the deviation from the target scale to the actual scale for the data quality of the original image data is less than the threshold or an end condition is reached. This at least saves computational effort or computational time.
[0007] In one embodiment, the termination condition is a predefined maximum number of runs updated in steps B) to F), which prevents the iterative procedure from running indefinitely when the raw image data of at least one camera image is consistently worse than a predefined threshold.
[0008] In the evaluation of the raw image data of at least one camera image in step B), in at least one evaluation step, either the raw image data of at least one camera image or the image data extracted from the raw image data are processed by mathematical connection with each other. In one embodiment of the present invention, this is achieved by mathematical connection of at least two elements of the raw image data of a single camera image. An example of such an evaluation of the raw image data is to separate two lasers simultaneously combined in the frequency domain and then calculate the recorded interference contrast separately. In that case, in step B), the first and second image data are extracted from the raw image data of a single camera image and then processed by mathematical connection with each other so that the combined image data is generated. If the interference contrast for one of the two lasers is significantly low, it will be considered that this laser is not operating in a stable state.
[0009] Therefore, in one embodiment of the present invention, in step A) raw image data of exactly one camera image is recorded, and in step B) in at least one of the multiple evaluation steps, first image data extracted from the raw image data of exactly one camera image and second image data extracted from the raw image data of exactly one camera image are processed by mathematically linking each other so that combined image data is generated.
[0010] In an embodiment of the invention in which the raw image data of just one camera image is recorded in step A), a real measure for the data quality of the raw image data is determined before the evaluation step in step B), in which the extracted image data are processed by mathematical concatenation. In that way, in situations in which the operation of determining the deviations in step F) indicates that the data quality of the raw image data is not sufficient, the evaluation step by mathematical concatenation can be omitted and the recording of the raw image data can be repeated with subsequent evaluation in steps A) and B). In addition, in one embodiment, a time-consuming transmission of the raw image data from the camera computer to the processing computer can be made unnecessary.
[0011] In one embodiment of the present invention, in step A) raw image data of a plurality of camera images are recorded, and in at least one of a plurality of evaluation steps in step B) either the raw image data of a first camera image of the plurality of camera images or image data extracted from the raw image data of the first camera image and either the raw image data of a second camera image of the plurality of camera images or image data extracted from the raw image data of the second camera image are processed by mathematical concatenation so as to generate combined image data.
[0012] In one embodiment of the present invention, raw image data for multiple camera images is recorded consecutively in time.
[0013] Based on the respective measurement method, steps E) and F) include at least: It is carried out after step A) and before step B), or or after one of the evaluation steps in step B), a real measure for the data quality of the original image data is determined in step E) on the basis of image data extracted from the original image data; or or performed after step B) and before step C), in which a real measure for the data quality of the original image data in step E) is determined based on the combined image data; or The actual measure of data quality of the raw image data in step C) is determined by combining multiple image The decision is based on a combination of data.
[0014] Although the advantages of the invention may already be enjoyed when steps E) to G) are performed at least once after recording the original image data in step A), in one embodiment of the invention steps E) to G) are performed multiple times and at different places in the method, in the latter case then different criteria serve as measures for the data quality of the original image data.
[0015] As measures of the data quality of the original image data, not only direct criteria such as the environmental conditions during recording of the original image data may be taken into account, but also indirect criteria such as image characteristics of the original image data or image data extracted from the original image data.
[0016] In one embodiment of the present invention, during the recording of the raw image data in step A), environmental conditions are detected by means of measurement variables, the measurement variables being real measures for the data quality and predefined values for the measurement variables forming target measures for the data quality. In that respect, the term environmental conditions is used to mean the conditions in the surroundings of the camera and / or of the object by which the raw image data are detected.
[0017] In one embodiment of the invention, the measurement variables are selected from the group comprising vibration of the object and / or the camera for detecting the object, relative motion between the object and the camera, acoustic pressure, brightness, temperature, and air motion between the camera and the object, or any combination thereof. The environmental conditions of the camera and / or the object have a direct impact on the data quality of the raw image data.
[0018] If the recording of the original image data is influenced or disturbed by environmental conditions, the data quality of the original image data changes. At least the data quality of the original image data is degraded by the change of environmental conditions. A likely example of this is the shaking of the camera while performing step A), i.e. while recording the original image data. If the camera vibrates too much, the original image data will be "blurred". Now, if environmental conditions are detected during the recording of all the original image data of a plurality of camera images, it is already possible immediately after the execution of step A) to discard those camera images whose data quality is very likely not adequate. Then only those discarded camera images have to be recorded anew.
[0019] However, it is also possible to additionally or alternatively determine a real measure for the data quality of the original image data from the original image data itself or from image data of the camera image extracted from the original image data.
[0020] Therefore, in one embodiment of the present invention, the real measure of data quality of the raw image data is selected from the group including: average luminance of the raw image data or extracted image data of the camera image, contrast of the raw image data or extracted image data of the camera image, correlation of the raw image data or extracted image data of two different camera images of the same object, change in luminance or contrast between the raw image data and extracted image data of two different camera images of the same object, or any combination thereof.
[0021] In one embodiment of the present invention, steps E) and F) are performed in the camera computer after step A) and before step B), before which the raw image data is transmitted by the camera computer to the processing computer, and the evaluation step of step B) is performed in the processing computer. Such an embodiment is preferred, since it performs a first check on data quality before the time-consuming transmission of the raw image data from the camera computer to the processing computer. In one embodiment, the camera computer and the processing computer are two mutually independent processors of the same computer.
[0022] In a further embodiment, steps E) and F) are performed in the camera computer, the first evaluation step of step B) is performed in the camera computer, and the second evaluation step of step B) is performed in the processing computer, and the image data extracted after the first evaluation step and before the second evaluation step are transmitted by the camera computer to the processing computer. In such an embodiment, also at least one first evaluation step of step B) is still performed in the camera computer before the extracted image data is transmitted to the processing computer. In this case, also, the first check on the data quality in the camera computer provides that the data quality is checked before the time-consuming transmission of the image data extracted from the original image data from the camera computer to the processing computer. In situations where the original image data of one or more camera images have to be discarded and re-recorded, it provides a considerable saving in terms of processing time.
[0023] In one embodiment of the invention, the method is an interferometric or holographic method, the method comprising illuminating the object with electromagnetic radiation having exactly one discrete wavelength or multiple discrete wavelengths, and the combined image data represents an interferometric or holographic image, and the generated information comprises the spatial phase distribution of electromagnetic radiation of exactly one respective wavelength at least reflected or scattered by the object.
[0024] Examples of measurement methods that are always based on the mathematical combination of original image data or image data extracted from the original image data, by mathematical combination with each other such that combined image data is generated, are all interferometric or holographic methods.
[0025] A single interferogram or hologram in the sense of the present application generates a preferably complex spatial phase distribution as combined image data from raw data of one or several camera images at one wavelength.
[0026] It will be appreciated that in one embodiment, processing and computational times can be reduced if all camera images that are mathematically combined to provide the combined image data are of sufficient data quality with respect to their original image data before the computationally intensive mathematical combination is accomplished.
[0027] As an interferometric or holographic method in which the phase distribution for a single wavelength is taken into account, the method according to the invention can also be advantageously used for differential or multi-wavelength holography. In that case, the spatial distribution of the phase position of a synthetic wavelength (synthetic phase) formed by the difference of two discrete wavelengths of electromagnetic radiation reflected or scattered by an object with multiple discrete wavelengths is taken into account. In one embodiment of the present invention, the method is therefore a holographic method, which comprises a step of illuminating an object with electromagnetic radiation with multiple discrete wavelengths, combining image The data represents a holographic image, and the generated information includes a spatial distribution of the composite phase of magnetic radiation at least reflected or scattered by the object, having a plurality of discrete wavelengths.
[0028] In that regard, in one embodiment of the present invention, a real measure of the data quality of the raw image data is the combined image Parameters of phase shift operation on the data, coupling of objects image Combining Data and Criteria image Correlation and connection between data image Mean amplitude and combined data imageThe contrast of the known structure of the object in the data is selected from the group consisting of: image The data can be used to determine a real measure of the data quality of the raw image data.
[0029] In one embodiment of the present invention, in step A), a plurality of raw image data for each of a plurality of camera images are recorded for a plurality of discrete wavelengths, in step B), combined image data in the form of a hologram is generated for each of the plurality of discrete wavelengths, and in step C), a differential hologram is generated from the combined image data of the plurality of discrete wavelengths.
[0030] In one embodiment of the present invention, in step C) a height map of the object's surface is calculated as information from multiple difference holograms.
[0031] In one embodiment of the present invention, the real measure of data quality of the original image data is selected from the group including: phase noise in at least one differential hologram over a selected portion of the object, phase noise in at least one differential hologram over a portion of a reference body of known type, correlation between the phase noise in the differential hologram of a portion of the object and a portion of the reference body, correlation between the amplitude in the differential hologram of the object and the amplitude in the differential hologram of the reference body, the slope of the spatial distribution of the composite phase of electromagnetic radiation at least reflected or scattered by the object at a first selection of wavelengths from a plurality of discrete wavelengths and the spatial distribution of the composite phase of electromagnetic radiation at least reflected or scattered by the object at a second selection of wavelengths from the plurality of discrete wavelengths, and a comparison of a shape recorded with a first synthetic wavelength of a surface portion of the object with a shape recorded with a second synthetic wavelength of the same surface portion of the object.
[0032] The above object is also achieved by an apparatus for generating information from at least one camera image of an object, the apparatus comprising: A camera, the camera being configured to: A) recording raw image data of at least one camera image; a camera adapted to perform an evaluation device connected to the camera such that, during operation of the apparatus, the evaluation device obtains raw image data of the at least one camera image or image data extracted from the raw image data of the at least one camera image; having During operation of the device, at least the camera or the evaluation device B) evaluating raw image data of at least one camera image in a plurality of evaluation steps, In at least one of the evaluation steps, the raw image data of the at least one camera image or image data extracted from the raw image data of the at least one camera image are processed by mathematical combination with each other so that combined image data is generated; C) extracting information from the combined image data; D) outputting the information; E) determining a real measure for the data quality of the raw image data of at least one camera image before or after at least one of the evaluation steps in step B), F) determining the deviation between an actual measure of data quality of the raw image data of at least one camera image and a target measure of data quality; G) if the deviation determined in step F) is greater than a predefined threshold, then re-recording the raw image data of all of those camera images and performing again at least one evaluation step from step B) and steps C) to F) until either the deviation determined in step F) for the raw image data of all camera images from the plurality of camera images is less than the threshold or a predefined termination condition is met.
[0033] Insofar as aspects of the invention have been described above with respect to a method for generating information from at least one camera image of an object, they also apply to an apparatus for generating information from at least one camera image of an object. In particular, an apparatus according to the invention is suitable for carrying out the method according to the invention and embodiments thereof. Insofar as embodiments of the invention are carried out by means of an apparatus embodiment according to the invention, the apparatus comprises a device corresponding to that purpose or the camera and / or the evaluation device are designed and adapted to carry out their corresponding method steps during operation of the apparatus. The alphabetical listing of the method steps in the description of the method is the same as in the description of the apparatus. [Brief description of the drawings]
[0034] Further advantages, features and possible applications of the present invention will become apparent from the following description of embodiments and the associated drawings, in which like elements are indicated by like reference numerals. [Figure 1] 2 is a schematic flow diagram of an embodiment of a method according to the present invention for generating information from at least one camera image of an object. [Diagram 2] 3 is a schematic flow diagram of a further embodiment of the method according to the invention, in which a height map for an object is generated by a differential holographic method; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0035] FIG. 1 shows a flow chart for one embodiment of the method according to the invention, in which in step 100 raw image data of just one camera image of an object 1 is recorded by a camera 2 .
[0036] Simultaneously with the recording of the raw image data, in step 200, shaking of the camera 2 and of the object 1 is detected by the acceleration sensor 3. The detected shaking serves as an actual measure for the data quality of the raw image data of the camera images. The actual measure for the data quality of the raw image data detected in step 200 is then compared in step 300 with a predefined threshold value 4 as a target measure for the data quality. If the deviation between the actual measure and the target measure for the data quality is greater than the threshold value 4, in step 100 the raw image data of the camera image of the object 1 is discarded and newly detected by the camera 2.
[0037] Otherwise, in step 400 the original image data is evaluated, which in the embodiment shown comprises three evaluation steps 401, 402, 403. In steps 401 and 402, various image data are extracted from the original image data of a single camera image, and in step 403, the different image data are mathematically linked together to generate combined image data. After steps 401, 402, a check of the data quality of the original image data is again achieved. For that purpose, in step 210, an indirect measure for the data quality in the form of a contrast of the image data of the camera image extracted in steps 401, 402 is determined. The actual measure is again compared in step 310 with a predefined threshold value 5 for the data quality of the original image data. If the deviation between the actual measure and the target measure for the data quality exceeds the predefined threshold value 5, the image data is discarded and the original image data of the object 1 is again detected by the camera 2.
[0038] Only if both tests 200, 210 and 300, 310 on the data quality of the original image data are positive are the extracted image data concatenated together in step 403 to provide the combined image data. Additionally, information is extracted from the combined image data in step 500 and output in step 600. One example of a method following the procedure of Figure 1 is a method of generating a holographic image where first and second image data are extracted from the original image data of a single hologram in steps 401 and 402 and are mathematically concatenated together in step 403 to generate the combined image data.
[0039] Fig. 2 shows a schematic representation of a further embodiment of the method according to the invention, in which raw image data of multiple camera images of an object 1 are detected by a camera 2. The figure represents a sequence of numerical reconstructions for the case of a hologram with three discrete wavelengths (a), (b) and (c). Three phase steps are detected for each of the three wavelengths, i.e. for the raw image data of the three respective camera images. Thus, a 3x3 set of raw image data of the camera images is evaluated.
[0040] Simultaneously with the recording of the camera images, the acceleration sensor 3 detects shaking of the camera 2 and / or the object 1. A first check on the data quality of the raw image data, i.e. determining an actual measure for the data quality of the raw image data and determining the deviation between the actual measure and a target measure for the data quality, is accomplished in step 220 while still in the camera computer 6, before the transmission of the raw image data to the processing computer 7. If it is determined that the camera 2 and / or the object 1 have been shaken excessively during the recording of the raw image data of a camera image, the corresponding raw image data of the camera image is discarded and only the discarded camera image is newly recorded.
[0041] A second assessment of the data quality of the raw image data is achieved in step 230, still in the camera computer 6, based on the average brightness of the raw image data of the individual camera images. It is noted that the third image for the third wavelength (c) is significantly darker. Therefore, it must be discarded and recorded anew with an adjusted exposure time for the camera 2 or an increased brightness of the illumination laser. Only raw image data of camera images which successfully pass the two first checks 220, 230 on the data quality of the raw image data are transmitted from the camera computer 6 to the processing computer 7. In that way, time is saved in the data transmission from the camera computer to the processing computer. Otherwise, the transmission would also have to be repeated for those raw data of camera images whose data quality is not sufficient.
[0042] After transmission into the memory of the processing computer 7, more complex calculations are carried out in an evaluation step. In parallel to the processing of the image data, the data quality of the original image data is checked many times based on criteria or measures that were not accessible in the previous processing states of the image data.
[0043] In step 240, the average modulation for each wavelength is calculated, for example by repeated subtraction for the separate camera images. If a shaking motion during the recording of the camera images affects the camera 2 or the object 1 such that the interference contrast is reduced, the average modulation is reduced. Here again a measure of the data quality of the raw image data can be defined. If it is not met, the corresponding camera image is discarded and the raw image data for that image is recorded anew.
[0044] In a next step, three separate camera images of each wavelength are applied to form a hologram 8, and in a next step three difference holograms with a composite wavelength are generated from the three holographic images. Finally, a height map 10 for the surface of the object 1 is generated from the difference holograms.
[0045] It will be appreciated that before or after each processing step, a further indirect measure of the data quality of the underlying raw image data may be defined, and a real measure may be determined and compared with a target measure to generate a criterion for the rejection of one or more camera images at each processing step. As an example, during a phase shift in the generation of the hologram 8 in step 250, a criterion for a phase step is defined, which serves as a measure for the data quality of the raw image data.
[0046] It is pointed out that, for the sake of inherent disclosure, all features as may be recognized by a person skilled in the art from the present description, figures and claims, even if they are specifically described only in connection with certain other features, may be combined both separately and in any combination with other features or groups of features disclosed herein, unless it has been expressly excluded or technical aspects make such combination impossible or meaningless. A comprehensive and explicit representation of all possible combinations of features has been omitted in this specification only for the sake of brevity and readability of the description.
[0047] Although the invention has been illustrated and described in detail in the drawings and the above description, said illustration and description are by way of example only and are not to be considered as limitations on the scope of protection as defined by the claims. The invention is not limited to the disclosed embodiments.
[0048] Modifications in the disclosed embodiments will be apparent to one skilled in the art from the drawings, the description and the appended claims. In the claims, the word "have" does not exclude other elements or steps, and the indefinite article "a" does not exclude a plurality. The mere fact that certain features are claimed in different claims does not exclude their combination. References in the claims shall not be considered as a limitation on the scope of protection. [Explanation of symbols]
[0049] 1. Target 2 Camera 3. Acceleration Sensor 4. Predetermined Threshold 5. Predetermined Threshold 6. Camera Computer 7 Processing Computer 8. Hologram 10 Height Map
Claims
1. 1. A method for generating information from at least one camera image of an object, comprising: A) recording raw image data of said at least one camera image (100); B) evaluating (400) said raw image data of said at least one camera image in a number of evaluation steps (401, 402, 403), in at least one of said evaluation steps (401, 402, 403), said raw image data of said at least one camera image or image data extracted from said raw image data of said at least one camera image are processed by mathematical combination with each other so that combined image data is generated, Steps and C) extracting said information from said combined image data (500); D) outputting said information (600); In a method comprising the steps of: E) determining (200, 210) a real measure of the data quality of the raw image data of at least one camera image, before or after at least one of the evaluation steps of step B); F) determining the deviation between the actual measure of data quality of the raw image data of the at least one camera image and a target measure of data quality (300, 310); G) if the deviation determined in step F) is greater than a predefined threshold, then a step (100) of re-recording all the raw image data of those camera images and re-performing at least one evaluation step from step B) and steps C) to F) until either the deviation determined in step F) is less than the threshold or a predefined termination condition is met. Further comprising: During the recording of the raw image data in step A), environmental conditions are detected by means of measurement variables, the measurement variables being the actual measures for the data quality and predefined values for the measurement variables forming the target measures for the data quality, the measurement variables are selected from the group including vibrations of the object, vibrations of a camera for detecting the object, relative motion between the object and the camera, acoustic pressure, temperature, and air motion between the camera and the object, or combinations thereof; A method comprising:
2. 2. The method of claim 1, wherein in step A) the raw image data of exactly one camera image is recorded, and in step B) in at least one of the evaluation steps, first image data extracted from the raw image data of the exactly one camera image and second image data extracted from the raw image data of the exactly one camera image are processed by mathematically linking each other so as to generate the combined image data.
3. 2. The method of claim 1, wherein in step A) the raw image data of a plurality of camera images is recorded, and in step B) in at least one of the evaluation steps, either the raw image data of a first camera image of the plurality of camera images or image data extracted from the raw image data of the first camera image, and either the raw image data of a second camera image of the plurality of camera images or image data extracted from the raw image data of the second camera image are processed by mathematical combination to generate the combined image data.
4. Steps E) and F) comprise at least It is carried out after step A) and before step B), or or, in step B), after one of the evaluation steps, the actual measure for the data quality of the original image data is determined in step E) based on the extracted image data; or or - performed after step B) and before step C), in which the actual measure for the data quality of the original image data in step E) is determined based on the combined image data; or 4. The method of claim 1, wherein step C) is performed, and wherein the actual measure of the data quality of the original image data in step E) is determined based on a combination of a plurality of combined image data.
5. steps E) and F) are performed in a camera computer after step A) and before step B), and before step B), the raw image data are transmitted by the camera computer to a processing computer, and the evaluation step of step B) is performed in the processing computer, or Or, 5. The method according to claim 1, wherein steps E) and F) are performed in the camera computer, the first evaluation step of step B) is performed in the camera computer and the second evaluation step of step B) is performed in the processing computer, and the extracted image data after the first evaluation step and before the second evaluation step are transmitted by the camera computer to the processing computer.
6. The method is an interferometric or holographic method, the method comprising: illuminating the object with electromagnetic radiation having just one discrete wavelength or a plurality of discrete wavelengths; 6. The method of claim 1, wherein the combined image data represents an interferometric or holographic image, and the generated information comprises a spatial phase distribution of the electromagnetic radiation of exactly one respective wavelength, the electromagnetic radiation being at least reflected or scattered by the object.
7. The method comprises: It is a holographic method, illuminating the object with electromagnetic radiation having a plurality of discrete wavelengths; 7. The method of claim 1, wherein the combined image data represents a holographic image and the generated information contains a spatial distribution of a composite phase of the electromagnetic radiation having the plurality of discrete wavelengths, the electromagnetic radiation being at least reflected or scattered by the object.
8. 8. The method of claim 7, wherein the real measure of the data quality of the raw image data is selected from a group including parameters for phase shifting in the combined image data, correlation of the combined image data of the object with the combined image data of a reference object, average amplitude of the combined image data, and contrast of known structures of the object in the combined image data.
9. 9. The method of claim 7 or 8, wherein in step A) a plurality of raw image data for each of a plurality of camera images are recorded for the plurality of discrete wavelengths, in step B) combined image data in the form of a hologram is generated for each of the plurality of discrete wavelengths, and in step C) a difference hologram is generated from the combined image data for the plurality of discrete wavelengths.
10. 10. The method of claim 9, wherein in step C a height map of the object's surface is calculated as information from a plurality of said difference holograms.
11. 11. The method of claim 7, wherein the real measure of the data quality of the original image data is selected from the group comprising: phase noise in at least one differential hologram over a selected portion of the object, phase noise in at least one differential hologram over a portion of a reference body of known type, a correlation between the phase noise in the differential hologram of a portion of the object and a portion of the reference body, a correlation between the amplitude in the differential hologram of the object and the amplitude in the differential hologram of a reference body, a slope between the spatial distribution of the composite phase of the electromagnetic radiation at least reflected or scattered by the object at a first selection of wavelengths from the plurality of discrete wavelengths and the spatial distribution of the composite phase of the electromagnetic radiation at least reflected or scattered by the object at a second selection of wavelengths from the plurality of discrete wavelengths, and a comparison of a shape recorded with a first synthetic wavelength of a surface portion of the object with a shape recorded with a second synthetic wavelength of the same surface portion of the object.
12. 1. An apparatus for generating information from at least one camera image of an object, comprising: a camera, wherein during operation of the device, the camera A) recording raw image data of at least one camera image; a camera adapted to perform an evaluation device connected to the camera such that, during operation of the apparatus, the evaluation device obtains the raw image data of the at least one camera image or image data extracted from the raw image data of the at least one camera image; Equipped with At least the camera or the evaluation device, during operation of the apparatus, B) evaluating (400) said raw image data of said at least one camera image in a number of evaluation steps (401, 402, 403), - in at least one of said evaluation steps (401, 402, 403), the raw image data of said at least one camera image or the image data extracted from said raw image data of said at least one camera image are processed by mathematical combination with each other so that combined image data is generated; C) extracting said information from said combined image data (500); D) outputting said information (600); 2. An apparatus designed and adapted to carry out Furthermore, during operation of the apparatus, at least the camera or the evaluation device E) determining (200, 210) a real measure of data quality of said raw image data of at least one camera image before or after at least one of said evaluation steps in step B); F) determining the deviation between the actual measure of data quality of the raw image data of at least one camera image and a target measure of data quality (300, 310); G) if the deviation determined in step F) is greater than a predefined threshold, then a step (100) of re-recording all the raw image data of those camera images and re-performing at least one evaluation step from step B) and steps C) to F) until either the deviation determined in step F) is less than a threshold or a predefined termination condition is met. is designed and adapted to carry out During the recording of the raw image data in step A), environmental conditions are detected by means of measurement variables, the measurement variables being the actual measures for the data quality and predefined values for the measurement variables forming the target measures for the data quality, the measurement variables are selected from the group including vibrations of the object, vibrations of a camera for detecting the object, relative motion between the object and the camera, acoustic pressure, temperature, and air motion between the camera and the object, or combinations thereof; An apparatus comprising:
Citation Information
Patent Citations
Speckle noise elimination based on shift in optical axis direction of sample
JP2013178484A
Oblique incidence interferometer
JP2015155865A
Authentication system and method using a mobile device
JP2019503546A