Image processing method and spectroscopic camera system

By calculating correction values ​​in the image processing device and using these correction values ​​to process the spectral image data, the problem of color reproducibility being affected by the half-value width of the spectral element is solved, thus achieving the generation of color composite images with high color reproducibility.

CN116071439BActive Publication Date: 2026-04-07SEIKO EPSON CORP
View PDF 2 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-10-26
Publication Date
2026-04-07

AI Technical Summary

Technical Problem

In the prior art, the wider the half-width of the beam-splitting element in a spectrophotometer, the lower the wavelength resolution, which leads to a decrease in the color reproducibility of the color composite image.

Method used

By calculating the correction value, the spectral image data is processed by the processor in the image processing device to generate a color composite image. The correction value is calculated by multiplying it by the correction value set according to each wavelength to obtain the color conversion value, and the sum spectrum is made consistent with the spectrum of any color filter.

Benefits of technology

It improves the color reproduction of color composite images, enabling the generation of color composite images with high color reproduction, regardless of the performance of the spectrophotometer.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116071439B_ABST
    Figure CN116071439B_ABST
Patent Text Reader

Abstract

This invention provides an image processing method and a spectrophotometer system capable of generating highly color-reproducible composite images regardless of the performance of the spectrophotometer. The image processing method uses a processor to convert spectrophotometer image data of multiple spectrophotometer wavelengths captured by the spectrophotometer into a color image. The processor retrieves multiple spectrophotometer image data from a storage unit, calculates a correction value by multiplying the spectrophotometer spectrum of each pixel of the multiple spectrophotometer image data by a correction factor set for each wavelength, sums the correction values ​​at the same pixel location to calculate a color conversion value, and generates a composite color image based on the color conversion value. Furthermore, the correction factor is set in such a way that the summed spectrum obtained by multiplying the sensitivity characteristics of the spectrophotometer for each spectrophotometer wavelength by the correction factor corresponding to each wavelength is consistent with the target spectrum of any color filter.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to an image processing method for processing spectral images and a spectral camera system. Background Technology

[0002] An image processing apparatus is known to use a spectrophotometer to capture images of a subject and obtain spectrophotometer images of each of multiple wavelengths, and to generate a color image of the subject based on these spectrophotometer images (see, for example, Patent Document 1).

[0003] The image processing apparatus described in Patent Document 1 acquires spectral image data of multiple wavelengths for a photographed object, and corrects for transmittance, sensitivity, etc., of the spectral image data for each wavelength band λi. Furthermore, it multiplies the brightness value of each pixel in the spectral image data by a pseudo-color conversion function r′(λi), g′(λi), b′(λi) or an isochromatic function r ̄(λi), g ̄(λi), b ̄(λi) to obtain three stimulus values ​​R, G, and B. In other words, for the brightness value of each pixel, an arbitrary color filter (r filter, g filter, b filter, etc.) is applied to calculate the RGB value. Then, the RGB values ​​of each pixel in the spectral image data of each wavelength band are accumulated for each pixel to calculate the R, G, and B data of each pixel, and a color composite image is generated based on the calculated R, G, and B data.

[0004] In the image processing apparatus described in Patent Document 1, regardless of the characteristics of the spectrophotometer—that is, the spectral dispersive performance at a predetermined wavelength when the spectrophotometer is used to capture an image at that wavelength—the same pseudo-color conversion function or isochromatic function is accumulated as a correction coefficient in the luminance value. This is simply multiplying the luminance value of the camera by the filtering function of an arbitrary color filter.

[0005] In such a structure, when the resolution of the beam-splitting element assembled in the beam-splitting camera is high and the desired wavelength can be transmitted with a narrow half-width, a color composite image with high color reproducibility for the subject can be generated. However, there is a problem that the wider the half-width of the beam-splitting element and the lower the wavelength resolution, the greater the error, which leads to a decrease in color reproducibility in the color composite image.

[0006] In other words, in existing image processing methods as described in Patent Document 1, there is a problem that the color reproducibility of color composite images is affected by the characteristics of the spectrophotometer.

[0007] Patent Document 1: Japanese Patent Application Publication No. 2009-33222 Summary of the Invention

[0008] The image processing method disclosed herein, in its first aspect, uses one or more processors to convert spectroscopic image data of multiple spectroscopic wavelengths captured by a spectroscopic camera into a color image. This image processing method causes the one or more processors to perform the following processing: obtaining a data cube including a spectroscopic spectrum from a storage unit, the spectroscopic spectrum being based on the brightness value of the same pixel position in the multiple spectroscopic image data corresponding to each of the multiple spectroscopic wavelengths; calculating a correction value by multiplying the spectroscopic spectrum of each pixel by a correction factor set according to each wavelength; calculating a color conversion value by summing the correction values ​​at the same pixel position in the multiple spectroscopic image data; and generating a color composite image based on the color conversion values ​​of each pixel. In a case where the spectrum obtained by multiplying the sensitivity characteristic spectrum of the spectroscopic camera for the spectroscopic wavelengths by the correction factors corresponding to each wavelength is set as the characteristic spectrum, and the spectrum obtained by summing the respective characteristic spectra corresponding to the multiple spectroscopic wavelengths is set as the sum spectrum, the correction factor is set in a manner that makes the sum spectrum consistent with the spectrum of any color filter, i.e., the target spectrum.

[0009] In this image processing method, the image processing method causes one or more processors to further perform the following processing: obtaining the sensitivity characteristic spectrum of the spectrophotometer for multiple spectroscopic wavelengths; obtaining the target spectrum; and calculating the complement normal value corresponding to each wavelength in a manner that makes the sum spectrum consistent with the target spectrum.

[0010] In this image processing method, the target spectrum is set as F(λ), and the wavelength λ is... i Let the complement constant be a. i The aforementioned spectrophotometer will be used to analyze the spectrophotometer wavelength Λ. i The sensitivity characteristics of the spectral image data during shooting are set to S. i In the case of (λ), the complement constant a i For Σ({Σa i S i (λ)}-F(λ)) 2 The minimum value.

[0011] The second aspect of the spectrophotometer system disclosed herein includes: a spectrophotometer that splits and images light centered at a predetermined spectrophotometer wavelength from incident light, and is capable of changing the spectrophotometer wavelength to multiple wavelengths; a storage unit that stores spectrophotometer image data captured by the spectrophotometer; a data acquisition unit that acquires a data cube including a spectrophotometer spectrum from the storage unit, the spectrophotometer spectrum being based on the brightness value of the same pixel position in multiple spectrophotometer image data corresponding to each of the multiple spectrophotometer wavelengths; and a correction value calculation unit that calculates a correction value by multiplying the spectrophotometer spectrum of each pixel by a correction value set according to each wavelength. The image synthesis unit calculates a color conversion value by summing the correction values ​​at the same pixel position in multiple spectroscopic image data, and generates a color composite image based on the color conversion values ​​of each pixel. The correction value is set in such a way that the spectrum obtained by multiplying the sensitivity characteristic spectrum of the spectroscopic camera for the spectroscopic wavelength and the correction value corresponding to each wavelength is set as the characteristic spectrum, and the spectrum obtained by accumulating the characteristic spectra corresponding to each of the multiple spectroscopic wavelengths is set as the sum spectrum.

[0012] In the spectrophotometer system of this method, the supplementary normal values ​​are pre-recorded in the storage unit.

[0013] In the spectrophotometer system of this method, the storage unit pre-stores the sensitivity characteristic spectra of multiple spectrophotometers, each with a different sensitivity characteristic spectrum, and the compensating normal value for each sensitivity characteristic spectrum. The spectrophotometer system also includes a camera characteristic acquisition unit that acquires the sensitivity characteristic spectrum of the spectrophotometer. The compensating normal value calculation unit reads the compensating normal value corresponding to the acquired sensitivity characteristic spectrum from the storage unit and calculates the compensating value.

[0014] The spectrophotometer system of this method further includes: a camera characteristic acquisition unit that acquires the sensitivity characteristic spectrum of the spectrophotometer for a plurality of spectrophotometer wavelengths; and a constant calculation unit that calculates the complement constant corresponding to each wavelength in a manner that makes the sum spectrum consistent with the target spectrum. Attached Figure Description

[0015] Figure 1 This is a schematic diagram showing the general structure of the beam splitter camera system according to the first embodiment.

[0016] Figure 2 This is a flowchart illustrating the method for calculating the complement constants in the first embodiment.

[0017] Figure 3 This is a conceptual diagram illustrating an example of the method for calculating the complement constant in the first embodiment.

[0018] Figure 4 A diagram showing an example of color filter data.

[0019] Figure 5 This is a flowchart illustrating the method for generating a color composite image in the first embodiment.

[0020] Figure 6 A conceptual diagram illustrating an example of a method for generating color composite images.

[0021] Figure 7 This is a schematic diagram showing the general structure of the beam splitter camera system according to the second embodiment. Detailed Implementation

[0022] First Implementation Method

[0023] The following describes a spectrophotometer system according to one embodiment of the present invention.

[0024] Figure 1 This is a schematic diagram illustrating the general structure of a spectrophotometer system.

[0025] like Figure 1 As shown, the spectrophotometer system of this embodiment includes a spectrophotometer 10 and an image processing device 20. The spectrophotometer 10 captures a spectrophotometer image of the object being photographed, and the image processing device 20 receives the spectrophotometer image data captured by the spectrophotometer 10.

[0026] As a beam splitter camera system, it may also be provided with an optical element (illumination unit) that illuminates the subject being photographed.

[0027] Furthermore, in the spectrophotometer system of this embodiment, the image processing device 20 synthesizes the spectrophotometer images of multiple spectrophotometer wavelengths captured by the spectrophotometer 10 to generate a color image.

[0028] The following describes the various structures of such a spectrophotometer system.

[0029] Structure of the Spectrophotometer 10

[0030] like Figure 1 As shown, the beam splitter camera 10 includes an optical lens system 11, a beam splitter element 12, an image capturing element 13, and a camera control unit 14.

[0031] The optical lens system 11 is, for example, composed of multiple lenses that guide incident light reflected from the object being photographed and incident on the beam splitter 10 toward the beam splitter element 12 or the imaging element 13. Additionally, although in Figure 1 In the figure, multiple lenses constituting the incident optical system are shown as optical lens system 11. However, for example, one or more lenses constituting the imaging optical system may also be provided between the beam splitting element 12 and the imaging element 13. In addition, various lenses constituting the telecentric optical system may also be provided.

[0032] The beam splitter 12 receives incident light guided by the optical lens system 11 and allows light centered at a predetermined beam splitting wavelength to pass through. Furthermore, although this embodiment shows an example where light centered at a desired beam splitting wavelength passes through the beam splitter 12 toward the imaging element 13, it could also be configured such as a structure that reflects light of the desired beam splitting wavelength toward the imaging element 13.

[0033] The beam-splitting element 12 is an element capable of switching the beam-splitting wavelength of light transmitted toward the imaging element 13. For example, a wavelength-variable Fabry-Perot etalon can be used. A Fabry-Perot etalon is an element in which a pair of mirrors are arranged opposite each other, causing multiple reflections of incident light between these mirrors, and allowing light of a predetermined beam-splitting wavelength, enhanced by interference, to pass through. In such a Fabry-Perot etalon, the beam-splitting wavelength can be switched, for example, by changing the spacing between the mirrors using an actuator element such as an electrostatic actuator.

[0034] Furthermore, the beam splitter 12 is not limited to the Fabry-Perot etalon described above; for example, an AOTF (Acousto-Optic Tunable Filter) or an LCTF (Liquid Crystal Tunable Filter) can also be used.

[0035] The imaging element 13 receives light centered on the desired wavelength after it has been split by the beam splitting element 12, and captures the split image. The imaging element 13 can be a general image sensor such as a CCD (Charge-Coupled Device) or CMOS (Complementary Metal-Oxide Semiconductor).

[0036] The camera control unit 14 is configured to include, for example, the following components: a beam splitting control circuit that controls the beam splitting element 12; an image capture control circuit that controls the image capture element 13; a microcomputer that controls the overall operation of the beam splitting camera 10; and a camera memory that stores various data.

[0037] The beam splitting control circuit, controlled by a microcomputer, outputs a predetermined drive signal to the beam splitting element 12 and switches the beam splitting wavelengths split by the beam splitting element 12.

[0038] The imaging control circuit, controlled by a microcomputer, drives the imaging element 13 and outputs image signals corresponding to the amount of light received by each pixel to the microcomputer.

[0039] The microcomputer controls the beam splitting control circuit to switch the beam splitting wavelengths of the beam splitting element 12, and controls the imaging control circuit to acquire image signals from the imaging element 13. Then, based on the image signals input from the imaging element 13, beam splitting image data is generated.

[0040] The camera memory records various data used to control the beam splitter 12, etc.

[0041] Furthermore, the sensitivity characteristic spectrum (hereinafter referred to simply as sensitivity characteristic) of the beam splitter camera 10 can also be recorded in the camera memory. The sensitivity characteristic of the beam splitter camera 10 refers to the spectral data representing the sensitivity to each wavelength when using the beam splitter camera 10 to capture a beam split image relative to a predetermined beam splitting wavelength. This sensitivity characteristic is the value obtained by multiplying the optical lens characteristics of the optical lens system 11, the beam splitting characteristics of the beam splitting element 12, and the shooting sensitivity characteristic of the imaging element 13. Additionally, as a beam splitter camera system, when illuminating a target with illumination light and capturing its reflected light, the sensitivity characteristic is the value obtained by multiplying the optical lens characteristics of the optical lens system 11, the beam splitting characteristics of the beam splitting element 12, the shooting sensitivity characteristic of the imaging element 13, and the spectrum (emission spectrum) of the illumination light.

[0042] Here, the optical lens characteristic of the optical lens system 11 is the transmittance of light per wavelength transmitted through the optical lens system 11.

[0043] Furthermore, the beam splitting characteristic of the beam splitter 12 is the transmittance for each wavelength when light of the split wavelength Λ is transmitted through the beam splitter 12. In this embodiment, the beam splitter 12 can switch between multiple split wavelengths Λ. That is, the number of switchable split wavelengths Λ is set to K, and the beam splitter 12 can split wavelengths Λ1 to Λ2. KThe K wavelengths are selected. Therefore, the beam splitter 12 corresponds to each beam splitting wavelength Λ i It has K spectroscopic characteristics.

[0044] The shooting sensitivity characteristic of the shooting element 13 indicates the sensitivity of the shooting element 13 to each wavelength.

[0045] Structure of image processing device 20

[0046] The image processing device 20 can be, for example, composed of a smartphone or tablet terminal, a personal computer, or other ordinary computer, and as... Figure 1 As shown, it has at least a storage unit 21 and one or more processors 22.

[0047] Storage unit 21 is an information storage device consisting of a memory or hard disk.

[0048] The information stored in the storage unit 21 can include various programs, including image processing programs used by the image processing device 20 to perform image processing, and various data used when executing the image processing program or other various programs.

[0049] Various types of data can be listed, such as spectroscopic image data, color filter data, sensitivity characteristics of the spectroscopic camera 10, and complementary normal values.

[0050] Spectroscopic image data refers to the image data of spectroscopic images captured by the spectroscopic camera 10. In this embodiment, for the object being photographed, the spectroscopic wavelength is switched and individual spectroscopic images are captured for each of the multiple spectroscopic wavelengths. Therefore, spectroscopic image data for the same object at multiple spectroscopic wavelengths are recorded in a manner that associates them with each other through an image ID or the like.

[0051] As described above, the sensitivity characteristics of the spectrophotometer 10 are spectral data obtained by multiplying the optical lens characteristics of the optical lens system 11, the spectral dispersion characteristics of the beam-splitting element 12, and the imaging sensitivity characteristics of the imaging element 13. When only one spectrophotometer 10 is used in the spectrophotometer system, it is sufficient to record the sensitivity characteristics of that spectrophotometer 10. Furthermore, when the spectrophotometer 10 can be easily installed and removed in the spectrophotometer system, and any spectrophotometer 10 can be selected, the sensitivity characteristics of each spectrophotometer 10 can also be recorded.

[0052] Regarding the color filter data, the spectral data of the target color filter when forming a color composite image from the spectroscopic spectrum is recorded. This color filter data is used in the calculation of the complement normal. For example, when generating an RGB color image based on the spectroscopic spectrum that is the same as when the subject was photographed using an RGB color filter, a complement normal is needed to convert the spectroscopic spectrum into individual color conversion values ​​for R, G, and B. In this case, the transmittance spectra of the R color filter, the transmittance spectra of the G color filter, and the transmittance spectra of the B color filter, which are used in the calculation of the complement normal, are recorded in the storage unit 21.

[0053] Alternatively, multiple color filter data corresponding to multiple colorimetric systems can be recorded. For example, color filters for the RGB colorimetric system, the XYZ colorimetric system, and the Lab colorimetric system can also be recorded. In this case, the user can select the desired colorimetric system.

[0054] The compensator is a constant used in the calculation of the compensator value. As described above, in this embodiment, the spectroscopic spectrum is converted into color conversion values ​​corresponding to any color filter, and an image identical to that taken with that color filter is generated as a color composite image. Therefore, the compensator is set for each color filter and for each wavelength.

[0055] For example, in the case of generating a color composite image in a manner that is a color image using an RGB color filter, the complement of each wavelength corresponding to the R color filter, the complement of each wavelength corresponding to the G color filter, and the complement of each wavelength corresponding to the B color filter are recorded.

[0056] In addition, the sensitivity characteristics of the spectrophotometer 10 assembled in the spectrophotometer system can also be recorded in the storage unit 21.

[0057] The processor 22 reads and executes the program stored in the storage unit 21, thereby functioning as a data acquisition unit 221, a camera characteristic acquisition unit 222, a color filter selection unit 223, a constant calculation unit 225, a correction value calculation unit 224, and an image compositing unit 226.

[0058] The data acquisition unit 221 acquires a data cube including a spectroscopic spectrum from the storage unit 21. This spectroscopic spectrum is based on the brightness value of the same pixel position in multiple spectroscopic image data corresponding to each of multiple spectroscopic wavelengths. That is, the data acquisition unit 221 acquires data including the pixel position, the spectroscopic wavelength, and the brightness value at that pixel position relative to that spectroscopic wavelength. Specifically, the data acquisition unit 221 can acquire individual spectroscopic image data corresponding to multiple spectroscopic wavelengths, or it can acquire the brightness value of each pixel (x, y) in each spectroscopic image data separately, or it can acquire the brightness value variation along a line region in the X direction for each position in the Y direction. In any case, it is possible to obtain the brightness value (spectral spectrum) for each wavelength of the same pixel.

[0059] The camera characteristic acquisition unit 222 acquires the sensitivity characteristics of the beam splitter camera 10. The camera characteristic acquisition unit 222 can acquire the sensitivity characteristics stored in the camera memory of the beam splitter camera 10, or it can acquire the sensitivity characteristics input by the user.

[0060] The color filter selection unit 223 selects a color filter when generating a color composite image from multiple spectroscopic image data. Furthermore, when calculating the complement normal value, a target color filter is selected.

[0061] Furthermore, although this embodiment illustrates a structure in which the user can select any color filter, the color filter selection unit 223 may not be present when using a color filter from a single color system.

[0062] The constant calculation unit 225 calculates the complement constant and stores it in the storage unit 21.

[0063] The details are described below. In this embodiment, the constant calculation unit 225 calculates the complement constant using, for example, the sensitivity characteristics of the spectrophotometer 10 and arbitrary color filter data.

[0064] The correction value calculation unit 224 reads from the storage unit 21 a correction value that corresponds to the sensitivity characteristics of the spectrophotometer 10 and the color filter of the color system that is the target. Then, the correction value calculation unit 224 calculates a correction value that corrects the signal value of each pixel of the multiple spectrophotometer images of the target using the corresponding correction value.

[0065] The image synthesis unit 226 calculates the color conversion value obtained by summing the correction values ​​calculated by the correction value calculation unit 224, and generates a color composite image.

[0066] Image processing methods

[0067] Next, the image processing method for generating a color composite image in the spectrophotometer system of this embodiment will be described.

[0068] Calculation of complementary positive numbers

[0069] In the spectrophotometer system of this embodiment, the complementary normal values ​​are pre-recorded in the storage unit 21. In this embodiment, the image processing device 20 is able to calculate these complementary normal values, and the calculation method of the complementary normal values ​​will be described below.

[0070] Figure 2 A flowchart illustrating the calculation method for complementing positive constants. Figure 3 A concept diagram illustrating an example of how to calculate the complement of a positive constant.

[0071] First, the camera characteristic acquisition unit 222 of the image processing device 20 acquires the sensitivity characteristics of the spectrophotometer 10 assembled in the spectrophotometer system (step S1).

[0072] As described above, the sensitivity characteristics of the beam splitter 10 can be obtained, for example, if the sensitivity characteristics are recorded in the camera memory or storage unit 21 of the camera control unit 14 of the beam splitter 10, simply by reading the sensitivity characteristics.

[0073] The sensitivity characteristics of the spectrophotometer 10 are typically measured during the manufacturing inspection of the spectrophotometer 10.

[0074] For example, the beam splitter 12 is set to a predetermined beam splitting wavelength Λ i A single wavelength of laser light is incident on the beam splitter 12, and the intensity of the transmitted light is measured. By sequentially varying the wavelength λ of the laser light within the wavelength range of the beam splitting image captured by the beam splitter camera 10, and measuring the intensity of the transmitted light, it is possible to set the beam splitter 12 to the beam splitting wavelength Λ. i The spectral characteristics of each wavelength λ at different times. By sequentially switching to the spectral wavelengths Λ that can be switched using the spectral element 12. i This operation is performed using (i = integers from 1 to K), thereby enabling the setting of the beam-splitting element 12 to each beam-splitting wavelength Λ. i The various spectroscopic characteristics at different times.

[0075] Regarding the optical lens characteristics of the optical lens system 11, for example, a single-wavelength laser is incident into the optical lens system 11, and the intensity of the transmitted light is measured. By sequentially varying the wavelength of the laser within the wavelength range of the beam splitting image captured by the beam splitter 10, and measuring the intensity of the transmitted light, the optical lens characteristics of the optical lens system 11 can be obtained.

[0076] Similarly, regarding the shooting sensitivity characteristics of the imaging element 13, for example, the imaging element 13 is subjected to a single wavelength of laser light, and the intensity of the received light (the output light-receiving signal) is measured. By sequentially varying the wavelength of the laser within the wavelength range of the beam-splitting image captured by the beam splitter 10, and measuring the light-receiving signal, the shooting sensitivity characteristics of the imaging element 13 can be obtained. Furthermore, the shooting sensitivity characteristics of the imaging element 13 can also be measured on a per-pixel basis.

[0077] Furthermore, by multiplying the beam-splitting characteristics of the beam-splitting elements 12, the optical lens characteristics of the optical lens system 11, and the shooting sensitivity characteristics of the imaging element 13, the sensitivity characteristics of the beam-splitting camera 10 are obtained. Therefore, the sensitivity characteristics of the beam-splitting camera 10 are as follows: Figure 3 As shown, this becomes the case for each beam-splitting wavelength Λ set by the beam-splitting element 12. i Different spectral data, and these sensitivity characteristics are set for each pixel of the imaging element 13.

[0078] Next, the beam splitter 12 will be set to the beam splitting wavelength Λ. i The sensitivity characteristic at that time is expressed as S i (λ). i is a subscript representing the wavelength that can be switched by the beam splitter 12, and when the number of switches that can be switched is set to K, i is an integer from 1 to K.

[0079] Furthermore, the spectral characteristics of the beam-splitting element 12, the optical lens characteristics of the optical lens system 11, and the imaging sensitivity characteristics of the imaging element 13 each have wavelengths from λ1 to λ2. K The K elements. Therefore, the sensitivity characteristic S i (λ) such as Figure 3 As shown, it can be represented by a K x K matrix.

[0080] In addition, the wavelength of the beam splitting Λ i and wavelength λ i Preferred to be Λ i =λ i .

[0081] Next, the color filter selection unit 223 selects the color filter to be used when generating the color composite image and reads its color filter data from the storage unit 21 (step S2). The color filter data read here is set as the target spectrum.

[0082] If the color filter to be used is preset, simply read the color filter data of that preset color filter. For example, when generating an RGB color composite image, read the color filter data of the R color filter, the G color filter, and the B color filter of the RGB color system.

[0083] Furthermore, if color filters corresponding to multiple color systems are recorded in the storage unit 21, it is sufficient to select the color system specified by the user's operation and read the color filter data.

[0084] Furthermore, although this embodiment shows an example of reading color filter data corresponding to one color system, it is also possible to read color filter data from multiple color systems. For example, it is also possible to read color filter data corresponding to the RGB color system and color filter data corresponding to the Lab color system.

[0085] Figure 4 This is an example of color filter data, showing the color filter data for the B color filter in the RGB color filter. The color filter data is as follows: Figure 4 As shown, spectral data representing the relationship between the wavelength of light passing through the filter and the intensity of the transmitted light can be obtained by means of wavelengths from λ1 to λ2. K It is represented by a matrix consisting of K rows and 1 columns of K elements.

[0086] After that, the constant calculation unit 225 calculates the complement constant (step S3).

[0087] In step S3, the constant calculation unit 225 is as follows: Figure 3 As shown, the spectrum obtained in step S1 by multiplying the sensitivity characteristics of the spectrophotometer 10 with the complement constant is taken as the characteristic spectrum, and multiple spectrophotometers Λ are summed. i The sum of the characteristic spectra and the color filter data obtained in step S2 (refer to...) Figure 4 The complementary constants are calculated in a way that is consistent or roughly consistent with the original constants.

[0088] For example, the constant calculation unit 225 uses the least squares method to make Σ({Σa i S i (λ)}-F(λ)) 2 To minimize the amount of time, calculate the wavelength λ. i The complement of the positive constant a i .

[0089] To explain more specifically, as mentioned above, there are K spectroscopic wavelengths Λ i Sensitivity characteristics S i (λ) includes K wavelengths λ j Corresponding element S i (λ j The color filter data F(λ) includes K wavelengths λ. j The corresponding element F(λ) jTherefore, the constant calculation unit 225 calculates the complement constant a, which is the minimum value of X as shown in the following equation (1). i .

[0090] Mathematical Formula 1

[0091]

[0092] After this, the constant calculation unit 225 calculates the complement constant a. i The data is appropriately stored in the storage unit 21 (step S4). In this embodiment, since the sensitivity characteristics of the spectrophotometer 10 are set per pixel, the complement a can also be calculated per pixel. i .

[0093] As shown above, the complement constant a corresponds to the color filter of the color system selected in step S2. i It is calculated. For example, as a complement constant for color image synthesis using the RGB color system, the R-filter is calculated for each wavelength λ. i The complement of the positive constant a i G filters are used for various wavelengths λ i The complement of the positive constant a i And B filters are used for various wavelengths λ. i The complement of the positive constant a i .

[0094] In addition, in step S2, multiple color filter data of color systems can be selected as described above. In this case, it is only necessary to perform the processing of steps S3 and S4 on each color filter.

[0095] Generation of color composite images

[0096] Next, a method for generating a color composite image based on multiple spectral image data of the subject captured by the spectrophotometer 10 will be described.

[0097] Figure 5 This is a flowchart illustrating a method for generating a color composite image. Figure 6 A conceptual diagram illustrating an example of a method for generating color composite images.

[0098] When the user commands the capture of a beam-splitting image, the beam-splitting camera 10 sequentially switches the beam-splitting wavelength Λ in the beam-splitting element 12. i And at each spectral wavelength Λ i Next, take a picture of the subject (step S11).

[0099] In each spectral image data acquired through imaging, for example, wavelength data and imaging ID are associated. The wavelength data represents the spectral wavelength Λ in the spectral element 12 at the time the spectral image data was captured. i The data. Furthermore, multiple spectroscopic wavelengths Λ obtained through a single image processing. i The same shooting ID is appended to each of the spectral image data.

[0100] The spectral image data captured by the spectrophotometer 10 is sent to the image processing device 20 and is appropriately stored in the storage unit 21 of the image processing device 20.

[0101] Next, when the data acquisition unit 221 of the image processing apparatus 20 receives the meaning of the instruction to generate a color composite image from the user, it acquires a data cube including the spectroscopic spectrum of each pixel (e.g., spectroscopic image data relative to multiple spectroscopic wavelengths) from the storage unit 21 (step S12).

[0102] For example, the data acquisition unit 221 reads multiple spectroscopic image data with a shooting ID specified by the user from the storage unit 21.

[0103] Furthermore, the color filter selection unit 223 selects the color filter when compositing the color composite image (step S13). For example, the color filter selection unit 223 may also inform the user of the selectable color filters and urge the user to make a selection, and obtain the color filter selected by the user as the color filter to be used.

[0104] Alternatively, if only one color filter is available, or if the color filter to be used by the user is predetermined, step S13 can be skipped.

[0105] Furthermore, the correction value calculation unit 224 calculates the spectral spectrum of each pixel based on the spectral image data read in step S12 using a correction value a corresponding to the color filter selected in step S13. i Perform correction to calculate the correction value (step S14).

[0106] Here, as mentioned above, in Λ i =λ i In the case of, by using the split wavelength Λ i The brightness value P of each pixel in the spectroscopic image data i and wavelength λ i The corresponding complement positive constant a i The correction value a can be easily calculated. i P i .

[0107] On the other hand, the beam splitting wavelength Λ achieved by the beam splitting element 12i and wavelength λ, which is an element of the spectrum i Under different conditions, the spectroscopic spectrum is calculated based on the brightness values ​​of each pixel in each spectroscopic image data, and the wavelength λ in the calculated spectroscopic spectrum is used. i The corresponding brightness value P i and the wavelength λ i The corresponding complement positive constant a i Calculate the correction value a i P i .

[0108] For example, in generating a color composite image using the RGB color system, the complement constant a corresponding to the R color filter is used. ri The complement constant a corresponding to the G color filter gi And the complement constant a corresponding to the B color filter. bi Therefore, for K wavelengths λ i And calculate the correction values ​​(R correction value, G correction value, B correction value) respectively = (a ri P i a gi P i a bi P i ).

[0109] Furthermore, the image synthesis unit 226 calculates the color conversion value obtained by summing the correction values ​​calculated in step S14 (step S15).

[0110] Specifically, the image compositing unit 226, as shown in equation (2) below, modifies the image by adjusting the correction value a of each color filter. i P i The color conversion value C is calculated by summing the values ​​for each pixel.

[0111] Mathematical formula 2

[0112]

[0113] As described above, when the correction values ​​(R correction value, G correction value, B correction value) are calculated, the R color conversion value CR, G color conversion value CG, and B color conversion value CB corresponding to RGB are calculated separately for each pixel.

[0114] After this, the image compositing unit 226 generates a color composite image with the parameters of each pixel set based on these color conversion values ​​(step S16). For example, in a color composite image of the RGB color system, an RGB color composite image is generated with the color parameters of each pixel set as (R, G, B) = (CR, CG, CB).

[0115] The effect of this implementation method

[0116] The image processing apparatus 20 of this embodiment includes one or more processors 22, and the processors 22 function as a data acquisition unit 221, a correction value calculation unit 224, and an image synthesis unit 226 by reading and executing programs stored in the storage unit 21.

[0117] In step S12, the data acquisition unit 221 acquires multiple spectroscopic image data corresponding to each of the multiple spectroscopic wavelengths from the storage unit 21. In step S14, the correction value calculation unit 224 calculates the correction value based on the brightness value of each pixel in the multiple spectroscopic image data, multiplying the spectroscopic spectrum of each pixel by a correction value 'a' set for each wavelength. i The correction value is calculated. The image synthesis unit 226 calculates the color conversion value by summing the correction values ​​at the same pixel position in multiple spectroscopic image data, and generates a color composite image based on the color conversion value of each pixel.

[0118] Here, in this embodiment, the complement constant a for each wavelength i The settings are configured as follows: the sensitivity characteristics of the spectrophotometer are compared with those of each wavelength λ. i The corresponding complement positive constant a i The spectrum obtained by multiplication is used as the characteristic spectrum, and it will be combined with multiple spectroscopic wavelengths Λ i The sum of the characteristic spectra of each of the corresponding components is consistent with the target spectrum of any color filter.

[0119] In this embodiment, since the normal complement is set in a way that allows for arbitrary color filters based on the sensitivity characteristics of the spectrophotometer 10, the color reproducibility when generating a color composite image can be improved.

[0120] In other words, although the beam splitter 12 is ideally designed to only split the desired wavelength Λ i Light passes through, but it is difficult to separate the wavelength Λ. i All light except that is blocked, and even if it were possible, the amount of light passing through the beam-splitting element 12 would be significantly reduced. For this reason, beam-splitting cameras 10 that capture beam-splitting images are typically configured such that the beam splitting wavelength Λ is... i Light is transmitted through a predetermined half-width centered on the image. However, in this case, the half-width varies depending on the performance of the spectrophotometer 10. Therefore, as in the prior art, when the spectrophotometer based on the spectrophotometer image data is multiplied by a filter function corresponding to an arbitrary color filter, the color reproducibility of the resulting color composite image varies depending on the performance of the spectrophotometer 10.

[0121] In contrast, in this embodiment, the complement constant is set in a manner that obtains the same spectrum as when light incident on the spectrophotometer is input into any color filter, corresponding to the sensitivity characteristics of the spectrophotometer. Therefore, regardless of the performance of the spectrophotometer 10, it is possible to generate a color composite image with high color reproducibility.

[0122] In the image processing apparatus 20 of this embodiment, the processor 22 also functions as a camera characteristic acquisition unit 222, a color filter selection unit 223, and a constant calculation unit 225. The camera characteristic acquisition unit 222 acquires data for multiple beam-splitting wavelengths Λ from the beam-splitting camera 10. i The sensitivity characteristics are determined. The color filter selection unit 223 acquires the target spectrum. The constant calculation unit 225 calculates the complement constant a in a manner that makes the sum spectrum consistent with the target spectrum. i .

[0123] Therefore, the image processing device 20 can calculate the compensating normal values ​​corresponding to each of the beam splitters 10 assembled in the beam splitter system. For example, even if the beam splitter 10 is replaced, the compensating normal values ​​corresponding to the replaced beam splitter can still be calculated.

[0124] In this embodiment, the constant calculation unit 225 of the image processing apparatus 20 sets the target spectrum as F(λ) and calculates the constant for wavelength λ. i Let the complement of the positive constant be a. i The spectrophotometer will be used to separate 10 pairs of wavelengths Λ i The sensitivity characteristics of the spectral image data during shooting are set to S. i In the case of (λ), Σ({Σa) is calculated. i S i (λ)}-F(λ)) 2 The smallest complement of a positive constant a i .

[0125] Therefore, it is possible to appropriately calculate the complement constants that can reproduce the target spectrum.

[0126] Second Implementation Method

[0127] Although in the above embodiment, the constant calculation unit 225 of the image processing apparatus 20 calculates the complement constant a corresponding to the sensitivity characteristics of the spectrophotometer 10. i For example, but the complement normals can also be stored in the storage unit 21 in advance.

[0128] In the second embodiment, an example is shown in which the complementary normals corresponding to the plurality of spectrophotometers 10 that can be assembled in the spectrophotometer system are pre-stored in the storage unit.

[0129] In addition, in the following descriptions, the same symbols are used to mark structures that have already been described, and the descriptions are omitted or simplified.

[0130] Figure 7 This is a schematic diagram illustrating the structure of the beam splitter camera system according to the second embodiment.

[0131] The beam splitter system of this embodiment is configured similarly to that of the first embodiment, including a beam splitter 10 and an image processing device 20. In this embodiment, the beam splitter 10 is replaceable, and the sensitivity characteristics of the usable beam splitter 10 are pre-stored in the storage unit 21.

[0132] Furthermore, the storage unit 21 contains pre-stored complement constants a corresponding to the sensitivity characteristics of these spectrophotometers 10. i .

[0133] Therefore, in this embodiment, the processor 22 is as follows Figure 7 As shown, it functions as a data acquisition unit 221, a camera characteristic acquisition unit 222, a color filter selection unit 223, a correction value calculation unit 224, and an image compositing unit 226. In other words, the function of a constant calculation unit 225 for calculating the correction value is unnecessary.

[0134] Although the color composite image is generated in a manner substantially similar to that of the first embodiment in this embodiment, the camera characteristic acquisition unit 222 acquires the sensitivity characteristics of the spectrophotometer 10 after steps S11 to S13 are performed.

[0135] Then, in step S14, the correction value calculation unit 224 reads the correction constant a that has been pre-stored in the storage unit 21. i The complement constant a, which corresponds to the sensitivity characteristics of the spectrophotometer 10 and the color filter selected in step S13, is... i And calculate the correction value.

[0136] After this, similar to the first embodiment, the processing of steps S15 and S16 is performed to generate a color composite image.

[0137] The effect of this implementation method

[0138] In this embodiment, the same effects as in the first embodiment can be achieved, and the following effects can also be achieved.

[0139] In the spectrophotometer system 2 of this embodiment, the compensation normals are pre-calculated at the factory and recorded in the storage unit 21.

[0140] Therefore, it is not necessary to calculate the complement constant, thereby simplifying the structure of the image processing device 20.

[0141] In the spectrophotometer system of this embodiment, the sensitivity characteristics of the plurality of spectrophotometers 10 and the complement constant a for each sensitivity characteristic are discussed. i The data is pre-stored in the storage unit 21. Furthermore, the camera characteristic acquisition unit 222 of the processor 22 acquires the sensitivity characteristics of the spectrophotometer 10 assembled in the spectrophotometer system, and the correction value calculation unit 224 reads the correction value a corresponding to the acquired sensitivity characteristics from the storage unit 21. i And calculate the correction value.

[0142] Therefore, even when the beam splitter 10 is freely installed and removed from the beam splitter system and different beam splitters 10 are installed, it is not necessary to recalculate the correction value. The correction value can be easily calculated simply by reading the correction value corresponding to the installed beam splitter 10.

[0143] Furthermore, even when multiple spectrophotometers 10 are connected to the image processing unit 20, as long as the complement constant a corresponding to the spectrophotometer 10 that captured the spectrophotometer image is read in, i This allows it to be compatible with the spectrophotometer 10 used and generate color composite images with high color reproduction.

[0144] Variations

[0145] Furthermore, the present invention is not limited to the various embodiments described above. Structures obtained by modification, improvement, and appropriate combination of various embodiments within the scope of achieving the objectives of the present invention are also included in the present invention.

[0146] Variation Example 1

[0147] Although the above embodiment illustrates a beam splitter system comprising a beam splitter 10 and an image processing device 20, the beam splitter 10 and the image processing device 20 can also be configured as a single unit. In this case, it is not necessary to store the sensitivity characteristics of multiple beam splitters 10 in the storage unit 21; simply recording the sensitivity characteristic of one beam splitter 10 is sufficient to calculate the complement normal value corresponding to that beam splitter 10. Furthermore, if the complement normal value corresponding to the sensitivity characteristic of the beam splitter 10 is calculated and recorded in the storage unit 21 at the time of manufacture, it is not necessary to record the sensitivity characteristics in the storage unit 21.

[0148] Variation Example 2

[0149] Although the above embodiment shows the complement constant 'a' for each pixel...i This example is set based on the sensitivity characteristics of each pixel of the beam splitter camera 10, but if the sensitivity characteristics of each pixel are the same, a common complement can also be set regardless of the pixel position.

[0150] Variation Example 3

[0151] While the above embodiment shows an example where sensitivity characteristics are recorded in the camera memory of the spectrophotometer 10, it is not limited to this. For example, the sensitivity characteristics may be stored in the storage unit 21 or in other external devices capable of communicating with the spectrophotometer system.

[0152] Other external devices could include, for example, a data server provided by the manufacturer of the spectrophotometer 10, which pre-records a camera ID such as a manufacturing number that can identify the spectrophotometer 10, as well as the sensitivity characteristics of the spectrophotometer 10. Furthermore, the image processing device 20 can also send the camera ID of the spectrophotometer 10 assembled in the spectrophotometer system to an external device via the Internet or the like, and download the corresponding sensitivity characteristics of the spectrophotometer 10 from the external device.

[0153] Furthermore, as a spectrophotometer system, a sensitivity measurement unit may be assembled to measure the sensitivity characteristics of the spectrophotometer 10. For example, the sensitivity measurement unit may include a laser light source capable of changing the wavelength, with the laser wavelength ranging from λ1 to λ2. K The changes are made sequentially, and each wavelength λ is applied to each pixel of the imaging element 13. i The light intensity is measured by sequentially changing the beam-splitting wavelength Λ set by the beam-splitting element 12. i This process is repeated simultaneously to obtain the desired results for each spectroscopic wavelength Λ. i Sensitivity characteristics.

[0154] This is a summary of the disclosure.

[0155] The image processing method disclosed herein, in its first aspect, uses one or more processors to convert spectroscopic image data of multiple spectroscopic wavelengths captured by a spectroscopic camera into a color image. This image processing method causes the one or more processors to perform the following processing: obtaining multiple spectroscopic image data corresponding to each of the multiple spectroscopic wavelengths from a storage unit; calculating a correction value by multiplying the spectroscopic spectrum of the brightness values ​​of each pixel in the multiple spectroscopic image data by a correction factor set for each wavelength; calculating a color conversion value by summing the correction values ​​at the same pixel position in the multiple spectroscopic image data; and generating a color composite image based on the color conversion values ​​of each pixel. The correction factor is set such that the summed spectrum is consistent with the spectrum of any color filter, i.e., the target spectrum, when the spectrum obtained by multiplying the sensitivity characteristic spectrum of the spectroscopic camera for the spectroscopic wavelengths by the correction factor corresponding to each wavelength is set as the characteristic spectrum, and the spectrum obtained by summing the characteristic spectra corresponding to each of the multiple spectroscopic wavelengths is set as the summed spectrum.

[0156] Therefore, since the compensator is set in a way that allows any color filter to be based on the sensitivity characteristics of the spectrophotometer, it is possible to generate color composite images with high color reproducibility regardless of the performance of the spectrophotometer.

[0157] In this image processing method, the image processing method causes one or more processors to further perform the following processing: obtaining the sensitivity characteristic spectrum of the spectrophotometer for multiple spectroscopic wavelengths; obtaining the target spectrum; and calculating the complement normal value corresponding to each wavelength in a manner that makes the sum spectrum consistent with the target spectrum.

[0158] Therefore, it is possible to calculate the compensating normals corresponding to the beam splitter camera used to capture the beam splitter image. For example, even if the beam splitter camera is replaced, the compensating normals corresponding to the replaced beam splitter camera can still be calculated.

[0159] In this image processing method, the target spectrum is set as F(λ), and the wavelength λ is... i Let the complement constant be a. i The aforementioned spectrophotometer will be used to analyze the spectrophotometer wavelength Λ. i The sensitivity characteristics of the spectral image data during shooting are set to S. i In the case of (λ), the complement constant a i For Σ({Σa i S i (λ)}-F(λ)) 2 The minimum value.

[0160] Therefore, it is possible to appropriately calculate the complement constants that can reproduce the target spectrum.

[0161] The second aspect of the spectrophotometer system disclosed herein includes: a spectrophotometer that splits and images light centered at a predetermined spectrophotometer wavelength from incident light, and is capable of changing the spectrophotometer wavelength to multiple wavelengths; a storage unit that stores spectrophotometer image data captured by the spectrophotometer; a data acquisition unit that acquires from the storage unit multiple spectrophotometer image data corresponding to each of the multiple spectrophotometer wavelengths; a correction value calculation unit that calculates a correction value by multiplying the spectrophotometer spectrum based on the brightness values ​​of each pixel of the multiple spectrophotometer image data by a correction factor set according to each wavelength; and image synthesis. The unit calculates a color conversion value by summing the correction values ​​at the same pixel position in multiple spectroscopic image data, and generates a color composite image based on the color conversion values ​​of each pixel. The correction value is set in such a way that the spectrum obtained by multiplying the sensitivity characteristic spectrum of the spectroscopic camera for the spectroscopic wavelength and the correction value corresponding to each wavelength is set as the characteristic spectrum, and the spectrum obtained by accumulating the characteristic spectra corresponding to the multiple spectroscopic wavelengths is set as the summed spectrum.

[0162] Therefore, since the complement is set in the same way as in the first method, by making any color filter based on the sensitivity characteristics of the spectrophotometer, a spectrophotometer system can be realized that can generate color composite images with high color reproducibility regardless of the performance of the spectrophotometer.

[0163] In the spectrophotometer system of this method, the supplementary normal values ​​are pre-recorded in the storage unit.

[0164] In this case, it is not necessary to calculate the compensating normals every time a beam splitter image is captured using a beam splitter camera. Furthermore, the compensating normals can be pre-recorded in the storage unit at the factory. In this case, since the compensating normals do not need to be calculated separately in the beam splitter camera system, the structure can be simplified.

[0165] In the spectrophotometer system of this method, the storage unit pre-stores the sensitivity characteristic spectra of multiple spectrophotometers, each with a different sensitivity characteristic spectrum, and the compensating normal value for each sensitivity characteristic spectrum. The spectrophotometer system also includes a camera characteristic acquisition unit that acquires the sensitivity characteristic spectrum of the spectrophotometer. The compensating normal value calculation unit reads the compensating normal value corresponding to the acquired sensitivity characteristic spectrum from the storage unit and calculates the compensating value.

[0166] According to this method, as long as the corrected value is calculated, it is only necessary to select the corrected value that corresponds to the sensitivity characteristics of the spectrophotometer that has captured the spectrophotometer image from the multiple corrected values ​​stored in the storage unit. Therefore, it is not necessary to calculate the corrected value every time the spectrophotometer is used to capture the spectrophotometer image. Since the corrected value is recorded in the storage unit in advance at the factory, it is not necessary to calculate the corrected value, thereby simplifying the structure.

[0167] The spectrophotometer system of this method further includes: a camera characteristic acquisition unit that acquires the sensitivity characteristic spectrum of the spectrophotometer for a plurality of spectrophotometer wavelengths; and a constant calculation unit that calculates the complement constant corresponding to each wavelength in such a way that the sum spectrum is consistent with the target spectrum.

[0168] According to this method, the compensating constant corresponding to the spectrophotometer used in the spectrophotometer system can be calculated. Therefore, even when the spectrophotometer is replaced, an appropriate compensating constant can be calculated, thereby enabling the generation of color composite images with high color reproducibility.

[0169] Symbol Explanation

[0170] 10…Spectrophotometer; 11…Optical lens system; 12…Spectrophotometer element; 13…Image capturing element; 14…Camera control unit; 20…Image processing device; 21…Storage unit; 22…Processor; 221…Data acquisition unit; 222…Camera characteristic acquisition unit; 223…Color filter selection unit; 224…Correction value calculation unit; 225…Constant calculation unit; 226…Image synthesis unit; 234…Constant calculation unit.

Claims

1. An image processing method that uses one or more processors to synthesize spectroscopic image data of multiple spectroscopic wavelengths captured by a spectroscopic camera into a color image, wherein, The image processing method causes the one or more processors to perform the following processing: The data cube, including the spectral spectrum, is obtained from the storage unit. The spectral spectrum is based on the brightness value of the same pixel position in a plurality of spectral image data corresponding to each of the plurality of spectral wavelengths. The correction value for each wavelength in each pixel of the plurality of color filters corresponding to the color system of the synthesized color image is calculated by multiplying the positive constant of each wavelength in each pixel of the spectrophotometer of each pixel. The color conversion value of each color filter is calculated by summing the correction values ​​for each wavelength at the same pixel location in multiple spectroscopic image data, and a color composite image is generated based on the color conversion values ​​of each color filter for each pixel. The complement is set in such a way that the spectrum obtained by multiplying the sensitivity characteristic spectrum of the spectrophotometer for the spectrophotometer wavelength by the complement normal corresponding to each wavelength is set as the characteristic spectrum, and the spectrum obtained by summing the characteristic spectra corresponding to each of the multiple spectrophotometer wavelengths is set as the sum spectrum, so that the sum spectrum is consistent with the spectrum of the multiple color filters corresponding to the color system of the synthesized color image, i.e., the target spectrum.

2. The image processing method as described in claim 1, wherein, The image processing method causes the one or more processors to further perform the following processing: Obtain the sensitivity characteristic spectrum of the spectrophotometer for multiple said spectrophotometric wavelengths; Obtain the target spectrum; The complementary constants corresponding to each wavelength are calculated in a manner that makes the sum spectrum consistent with the target spectrum.

3. The image processing method as described in claim 1 or claim 2, wherein, When the target spectrum is set as F(λ), For wavelength λ i Let the complement constant be a. i , The aforementioned spectrophotometer will be used to analyze the spectrophotometer wavelength Λ. i The sensitivity characteristics of the spectral image data during shooting are set to S. i In the case of (λ), The complement constant a i For Σ({Σa i S i (λ)}-F(λ)) 2 The minimum value.

4. A spectrophotometer system, comprising: A spectrophotometer is a camera that splits and captures light from incident light centered at a predetermined spectrophotometer wavelength, and can change the spectrophotometer wavelength to multiple wavelengths. The storage unit stores the spectral image data captured by the spectral camera. The data acquisition unit acquires a data cube including a spectroscopic spectrum from the storage unit, the spectroscopic spectrum being based on the brightness value of the same pixel position in a plurality of spectroscopic image data corresponding to each of the plurality of spectroscopic wavelengths; The correction value calculation unit calculates the correction value for each wavelength in each pixel of the plurality of color filters by multiplying the correction constant of each wavelength in each pixel of the plurality of color filters corresponding to the color system of the synthesized color image by the spectroscopic spectrum of each pixel. The image synthesis unit calculates the color conversion value of each color filter by summing the correction values ​​of each wavelength at the same pixel location in the multiple spectroscopic image data, and generates a color composite image based on the color conversion values ​​of each color filter for each pixel. The complement is set in such a way that the spectrum obtained by multiplying the sensitivity characteristic spectrum of the spectrophotometer for the spectrophotometer wavelength by the complement normal corresponding to each wavelength is set as the characteristic spectrum, and the spectrum obtained by accumulating the characteristic spectra corresponding to the multiple spectrophotometer wavelengths is set as the sum spectrum, so that the sum spectrum is consistent with the spectrum of the multiple color filters corresponding to the color system of the synthesized color image, i.e., the target spectrum.

5. The spectrophotometer system as described in claim 4, wherein, The complement normals are pre-recorded in the storage unit.

6. The spectrophotometer system as claimed in claim 5, wherein, The storage unit pre-stores the sensitivity characteristic spectra of multiple spectrophotometers, each with a different sensitivity characteristic spectrum, and the complement constants for each sensitivity characteristic spectrum. The spectrophotometer system further includes a camera characteristic acquisition unit, which acquires the sensitivity characteristic spectrum of the spectrophotometer. The correction value calculation unit reads the correction constant corresponding to the obtained sensitivity characteristic spectrum from the storage unit and calculates the correction value.

7. The spectrophotometer system as claimed in claim 4, wherein, It also has: A camera characteristic acquisition unit acquires the sensitivity characteristic spectrum of the spectrophotometer for a plurality of said spectrophotometer wavelengths; The constant calculation unit calculates the complementary constants corresponding to each wavelength in a manner that makes the sum spectrum consistent with the target spectrum.

Citation Information

Patent Citations

  • Imaging apparatus, and program and method for controlling the same

    JP2009033222A

  • Photographing device

    WO2006075581A1