Data conversion device, data conversion method and data conversion program

By designing data conversion equipment, using the acquisition and conversion unit to process the image data output by line sensors, the photosensitive difference caused by changes in line sensors specifications is solved, and the compatibility of line sensors output between the current and successor models is achieved, ensuring the stability of the bank symbol recognition system.

JP7660764B2Active Publication Date: 2025-04-11JAPAN CASH MASCH CO LTD
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2024510563
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2022-03-28
Publication Date
2025-04-11
Estimated Expiration
2042-03-28

AI Technical Summary

Technical Problem

When the specifications of line sensors change, the difference between the light source arrangement and spectral characteristics leads to photosensitive differences, making it difficult to effectively utilize the image database of the current model in the bank symbol recognition development of the successor model.

Method used

A data conversion device is designed, including a acquisition unit and a conversion unit. The acquisition unit acquires image data output by the first line sensors, and the conversion unit converts the image data output by the first line sensors according to the corresponding data set by the photosensitive difference between the second line sensors and the first line sensors.

Benefits of technology

Through this method, the compatibility of line sensors output between the current model and the successor model can be maintained, ensuring the continuity and stability of the bank symbol identification system.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007660764000001
    Figure 0007660764000001
  • Figure 0007660764000002
    Figure 0007660764000002
  • Figure 0007660764000003
    Figure 0007660764000003
Patent Text Reader

Abstract

In the present invention, a data conversion device comprises: an acquisition unit for acquiring image data outputted by a first line sensor; and a conversion unit for converting pixel values included in the image data outputted by the first line sensor according to correlation data, in which the pixel value correlations are set on the basis of the difference in spectral characteristics sensitivity between the first line sensor and a second line sensor, which is different from the first line sensor.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a data conversion device, a data conversion method, and a data conversion program. [Background technology]

[0002] 2. Description of the Related Art In a bill handling device used in an automated teller machine (ATM) or the like, parameters used for bill validation are set based on an image database in which image data outputted by a line sensor is compiled into a database. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-28029 A [Patent Document 2] JP 2004-112627 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, when the specifications of the line sensor are changed, the difference in the light source arrangement and the spectral characteristics between the line sensors of the current model and the successor model appears as a sensitivity difference, which makes it difficult to effectively use the image database corresponding to the current model in the development of the banknote validator for the successor model.

[0005] In one aspect, an object of the present invention is to provide a data conversion device, a data conversion method, and a data conversion program that can maintain compatibility of the output of a line sensor between a current model and a successor model. [Means for solving the problem]

[0006] A data conversion device according to one aspect has an acquisition unit that acquires image data output by a first line sensor, and a conversion unit that converts pixel values ​​included in the image data output by the first line sensor in accordance with correspondence data in which a correspondence between pixel values ​​is set based on a sensitivity difference in spectral characteristics between the first line sensor and a second line sensor different from the first line sensor. Effect of the Invention

[0007] According to one embodiment, compatibility of the output of the line sensor can be maintained between the current model and the successor model. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a block diagram illustrating an example of a functional configuration of a server device. [Diagram 2] FIG. 2 is a schematic diagram showing an application example of the inverse log curve. [Diagram 3] FIG. 3 is a diagram illustrating an example of an inverse element gain. [Figure 4] FIG. 4 is a schematic diagram showing an example of generating a conversion table. [Diagram 5] FIG. 5 is a diagram showing an example of image data. [Figure 6] FIG. 6 is a diagram illustrating an example of a cumulative frequency distribution. [Figure 7] FIG. 7 is a diagram showing an example of the conversion table. [Figure 8] FIG. 8 is a schematic diagram (1) showing an example of determining a watermark portion. [Figure 9] FIG. 9 is a schematic diagram (2) showing an example of determining the watermark portion. [Figure 10] FIG. 10 is a schematic diagram (1) showing an example of skew correction. [Figure 11] FIG. 11 is a schematic diagram (2) showing an example of skew correction. [Figure 12] FIG. 12 is a diagram showing an example of adding a transport filter. [Figure 13]FIG. 13 is a schematic diagram showing an application example of a log curve. [Figure 14] FIG. 14 is a flowchart showing the procedure of the data conversion process. [Figure 15] FIG. 15 is a flowchart showing the procedure of the watermark blur correction process. [Figure 16] FIG. 16 is a diagram showing one aspect of the effect. [Figure 17] FIG. 17 is a diagram illustrating an example of a hardware configuration. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an embodiment of the data conversion device, the data conversion method, and the data conversion program according to the present application will be described with reference to the attached drawings. Each embodiment merely shows one example or aspect, and the range of values, functions, and usage scenes are not limited by such examples. Each embodiment can be appropriately combined within a range that does not cause contradiction in the processing contents. EXAMPLES

[0010] <Overall composition> Fig. 1 is a block diagram showing an example of the functional configuration of a server device 10. The server device 10 shown in Fig. 1 provides a data conversion function for converting image data output by a line sensor of a current model into image data compatible with the line sensor of a successor model, from the viewpoint of maintaining compatibility of the output of the line sensor between a current model and a successor model.

[0011] The server device 10 corresponds to an example of a data conversion device that provides the above-mentioned data conversion function. In one embodiment, the server device 10 can be realized as a server that provides the above-mentioned data conversion function on-premise. In addition, the server device 10 can be realized as a PaaS (Platform as a Service) type or SaaS (Software as a Service) type application, thereby providing the above-mentioned data conversion function as a cloud service.

[0012] As shown in Fig. 1, the server device 10 can be communicatively connected to the client terminal 30 via a network NW. For example, the network NW may be any type of communication network, such as the Internet or a LAN (Local Area Network), whether wired or wireless. Note that, although Fig. 1 shows an example in which one client terminal 30 is connected to one server device 10, any number of client terminals 30 may be connected.

[0013] The client terminal 30 corresponds to an example of a terminal device that receives the above-mentioned data conversion function. For example, the client terminal 30 may be realized by a desktop or laptop personal computer. This is merely an example, and the client terminal 30 may be realized by any computer such as a mobile terminal device or a wearable terminal.

[0014] Although FIG. 1 shows an example in which the above data conversion function is provided in a client-server system, this is merely one example, and the above data conversion function may be provided as a stand-alone function.

[0015] <Configuration of Server Device 10> Next, an example of the functional configuration of the server device 10 according to this embodiment will be described. Fig. 1 shows a block diagram related to the data conversion function of the server device 10. As shown in Fig. 1, the server device 10 has a communication control unit 11, a storage unit 13, and a control unit 15. Note that Fig. 1 shows only an excerpt of the functional units related to the above-mentioned data conversion function, and the server device 10 may have functional units other than those shown in the figure.

[0016] The communication control unit 11 is a functional unit that controls communication with other devices such as the client terminal 30. As just one example, the communication control unit 11 can be realized by a network interface card such as a LAN card. As one aspect, the communication control unit 11 receives a data conversion request from the client terminal 30 to convert image data of a current model into image data of a successor model, or outputs a data conversion result to the client terminal 30.

[0017] The storage unit 13 is a functional unit that stores various data. As just one example, the storage unit 13 is realized by an internal, external, or auxiliary storage of the server device 10. For example, the storage unit 13 stores a first image database 13A1, a second image database 13A2, and a conversion table 13T.

[0018] The first image database 13A1 and the second image database 13A2 are databases in which a collection of image data output by a line sensor is managed. As an example, the first image database 13A1 and the second image database 13A2 collect image data by country, by denomination, by state such as soiling or damage, and by wavelength such as reflection or transmission.

[0019] Hereinafter, merely as an example, the first image database 13A1 corresponds to a set of image data output by a line sensor of a current model, while the second image database 13A2 corresponds to a set of image data output by a line sensor of a successor model. Note that the line sensor of the current model and the line sensor of the successor model correspond to an example of the first line sensor and the second line sensor, and the image data of the current model and the image data of the successor model correspond to an example of the first image data and the second image data.

[0020] As one aspect, the first image database 13A1 and the second image database 13A2 may be used to set parameters used by banknote validation software, such as firmware, installed in the banknote handling machine. As another aspect, the first image database 13A1 and the second image database 13A2 may be used to create templates used as a reference during banknote validation verification installed in the banknote handling machine. In this way, the first image database 13A1 and the second image database 13A2 are used as development assets for generating and testing the banknote validation firmware and templates used as a reference during verification.

[0021] The conversion table 13T will be described later when the conversion table 13T is referred to.

[0022] The control unit 15 is a functional unit that performs overall control of the server device 10. For example, the control unit 15 can be realized by a hardware processor. As shown in FIG. 1, the control unit 15 has an inverse log curve application unit 15A, an inverse element gain adjustment unit 15B, a table conversion unit 15C, a pixel density correction unit 15D, a watermark blur correction unit 15E, a transport filter addition unit 15F, and a log curve application unit 15G. The control unit 15 may be realized by hardwired logic or the like.

[0023] Hereinafter, as an example of a trigger for starting provision of the data conversion function, a case where a data conversion request for converting image data of a current model into image data of a successor model is received from the client terminal 30 will be taken as an example. At the time of such a data conversion request, as merely one example, it is possible to receive designation of image data of the current model that is requested to be converted into image data of the successor model from the first image database stored in the storage unit 13.

[0024] The inverse log curve application unit 15A is a processing unit that applies an inverse log curve to image data corresponding to a current model line sensor.

[0025] Fig. 2 is a schematic diagram showing an application example of an inverse log curve. Fig. 2 shows image data 20 of a current model specified in a data conversion request, in which each pixel has 256 gradations and the gradation expression is in a log scale, as an example only.

[0026] As shown in Fig. 2, for each pixel included in the image data 20 of the current model, the gradation value of that pixel is multiplied by a specific magnification, for example, 16 times in the example shown in Fig. 2. As a result, the image data 20 of the current model is converted into image data 20A of 4096 gradations, which has 16 times the gradations of the original.

[0027] Next, an inverse log curve, in which a gain for inverse conversion from a log scale to a linear scale is set, is applied to the 4096-level image data 20A. As a result, the gradation expression is converted from a log scale to a linear scale by multiplying each pixel included in the 4096-level image data 20A by the gain of the inverse log curve corresponding to the gradation value of that pixel.

[0028] In this way, for each pixel included in the 4096-level image data 20B to which the inverse log curve has been applied, the gradation value of that pixel is multiplied by the reciprocal of the magnification, i.e., 1 / 16. This results in image data 21 of the current model with 256 levels of gradation that corresponds to the linear scale.

[0029] The inverse element gain adjustment unit 15B is a processing unit that performs inverse element gain adjustment on the image data after the inverse log curve is applied. One aspect of such inverse element gain adjustment is to correct the output of a current model line sensor that fluctuates due to the influence of a bill transport mechanism, such as a belt.

[0030] Fig. 3 is a diagram showing an example of the inverse element gain. Fig. 3 shows a graph G11 indicating the output when a medium with uniform reflection density and transmission density, for example a medium whose entire surface is adjusted to a density of a gradation value of "210", is read by a current model line sensor. The horizontal axis of this graph G11 indicates N (=210) imaging elements arranged on a straight line in a direction perpendicular to the conveying direction of the banknote, and the vertical axis indicates the gradation value output by each imaging element.

[0031] As shown in graph G11 in Fig. 3, the output is reduced in range R1 of image sensor numbers from 50 to 80, and in range R2 of image sensor numbers from 130 to 160. One of the causes of the output reduction in ranges R1 and R2 is the change in the focal position due to the influence of the conveyor belt.

[0032] For this reason, from the perspective of eliminating the influence of the belt, a coefficient is back-calculated based on the imaging results of the above-mentioned medium by the current model line sensor, such that the output of the imaging element of the line sensor shown in graph G11 becomes the target value of the line sensor shown in graph G12. The gain of the imaging element obtained by such back-calculation, i.e., the ratio of the input and output corresponding to graph G13 shown in Fig. 3, is set as the coefficient by which the output of the current model line sensor is multiplied.

[0033] With the above inverse element gain settings, the inverse element gain adjustment unit 15B multiplies the pixels in the main scanning direction of the image data of the current model by the inverse element gain corresponding to the graph G13 shown in Fig. 3. As a result, the output reduction of the image sensor corresponding to the ranges R1 and R2 is adjusted to the target value, and the influence of the belt is eliminated.

[0034] The table conversion unit 15C is a processing unit that converts the image data of the current model after the inverse element gain adjustment into image data compatible with the successor model, in accordance with the conversion table 13T stored in the storage unit 13.

[0035] Here, the conversion table 13T is data in which the correspondence between input and output regarding gradation values ​​is set. As just one example, the conversion table 13T is set by histogram matching of two image data obtained by reading the same medium, such as a banknote, using two line sensors, one for the current model and the other for the successor model.

[0036] Fig. 4 is a schematic diagram showing an example of generating a conversion table 13T. As shown in Fig. 4, the gradation expressions of image data 20 of the current model and image data 40 of the successor model are aligned to a linear scale in a stage prior to histogram matching.

[0037] For example, image data 20 of a current model is subjected to the application of the inverse log curve shown in Fig. 2 to obtain image data 21 of a current model with 256 gradations corresponding to a linear scale. Furthermore, image data 22 of a current model from which the influence of the conveying system has been removed is obtained by multiplying the pixels in the main scanning direction of image data 21 of a current model by the inverse element gain corresponding to graph G13 shown in Fig. 3.

[0038] On the other hand, for each pixel included in the successor model image data 40, the gradation value of that pixel is multiplied by a specific magnification, for example, 4 times in the example shown in Fig. 4. As a result, the successor model image data 40 is converted into 1024-level image data 40A, which has four times the gradation of the original.

[0039] Next, an inverse log curve, in which a gain for inverse conversion from a log scale to a linear scale is set, is applied to the 1024-level image data 40A. As a result, the gradation expression is converted from a log scale to a linear scale by multiplying each pixel included in the 1024-level image data 40A by the gain of the inverse log curve corresponding to the gradation value of that pixel.

[0040] In this way, for each pixel included in the 1024-level image data 40B to which the inverse log curve has been applied, the gradation value of that pixel is multiplied by the reciprocal of the magnification, i.e., 1 / 4. This results in image data 41 for the successor model with 256 gradations that correspond to the linear scale.

[0041] Histogram matching is performed based on the cumulative frequency distribution calculated for each of the image data 22 of the current model and the image data 41 of the successor model. This allows a lookup table for converting the gradation values ​​of the image data 22 of the current model into gradation values ​​corresponding to the image data 41 of the successor model to be generated as the conversion table 13T.

[0042] Fig. 5 is a diagram showing an example of image data. Fig. 6 is a diagram showing an example of cumulative frequency distribution. Fig. 7 is a diagram showing an example of conversion table 13T. Fig. 5 shows image data 22 and image data 41 obtained by reading the same banknote by two line sensors, one of a current model and the other of a successor model. For example, the cumulative frequency distribution shown in Fig. 6 can be calculated from image data 22 of the current model shown in Fig. 5 and image data 41 of the successor model shown in Fig. 5.

[0043] 6 shows a graph G2 with pixel values ​​on the horizontal axis and cumulative frequencies on the vertical axis. For example, the cumulative frequency distribution of image data 22 of the current model shown in FIG. 5 corresponds to the cumulative distribution function f1 shown in FIG. 6, while the cumulative frequency distribution of image data 41 of the successor model shown in FIG. 5 corresponds to the cumulative distribution function f2 shown in FIG. 6. Histogram matching is performed to derive a function that maps inputs corresponding to these cumulative distribution functions f1 to target values ​​corresponding to the cumulative distribution function f2. As a result, a conversion table 13T is obtained in which the corresponding relationship between inputs and outputs related to pixel values ​​is defined, as shown in FIG. 7.

[0044] As an example only, a case will be taken where conversion table 13T is applied to image data 22 of a current model shown in Fig. 5 as input data. In this case, the pixel value of each pixel included in image data 22 of the current model is input, and the input is converted to an output pixel value corresponding to the input according to conversion table 13T shown in Fig. 7. As a result, image data 22 of the current model shown in Fig. 5 is converted to image data 23 compatible with the successor model shown in Fig. 5.

[0045] It is clear that there is a sensitivity difference based on the spectral characteristics between the line sensor of the current model and the line sensor of the successor model, according to the image data 22 of the current model and the image data 41 of the successor model. Furthermore, it is clear that data conversion can be realized to match the sensitivity corresponding to the line sensor of the current model to the sensitivity corresponding to the line sensor of the successor model, according to the image data 22 of the current model and the image data 23 for the successor model.

[0046] The pixel density correction unit 15D is a processing unit that corrects the pixel density of image data compatible with the successor model. In one embodiment, the pixel density correction unit 15D resizes the image data compatible with the successor model by enlarging or reducing it according to a magnification factor that matches the pixel density of the line sensor of the current model to the pixel density of the line sensor of the successor model. For example, if the pixel density of the line sensor of the current model is greater than the pixel density of the line sensor of the successor model, the image data compatible with the successor model is reduced. In this case, the pixels may be thinned out by the reduction, or the pixel value of the background may be assigned to some pixels without changing the number of pixels. On the other hand, if the pixel density of the line sensor of the current model is smaller than the pixel density of the line sensor of the successor model, the image data compatible with the successor model is enlarged. It goes without saying that any interpolation method, such as bilinear or bicubic, can be applied to these enlargements or reductions.

[0047] The watermark blur correction unit 15E is a processing unit that corrects the degree of blur of the watermark portion according to the difference between the gap between the imaging element of the line sensor of the current model and the banknote transport path and the gap between the imaging element of the line sensor of the successor model and the banknote transport path. Note that the gap between the imaging element of the line sensor of the current model and the banknote transport path corresponds to an example of a first gap, and the gap between the imaging element of the line sensor of the successor model and the banknote transport path corresponds to an example of a second gap.

[0048] In one aspect, when the gap of the current model is smaller than that of the successor model, the watermark blur correction unit 15E executes a blurring process to blur the watermark part of the image data for the successor model after pixel density correction to a degree corresponding to the gap difference. As just one example, such a blurring process may be realized by applying a low-pass filter, for example, a Gaussian filter, to the watermark part.

[0049] In another aspect, when the gap of the current model is larger than that of the successor model, the watermark blur correction unit 15E executes a sharpening process to sharpen the watermark part of the image data for the successor model after pixel density correction to a degree corresponding to the gap difference. As an example, such a sharpening process may be realized by applying a high-pass filter, for example, a sharpening filter or an edge enhancement filter, to the watermark part.

[0050] Here, the above-mentioned watermark portion can be identified by extracting an area in the image data for the successor model after pixel density correction, where the features appearing at the reflected wavelength and the features appearing at the transmitted wavelength satisfy specific conditions.

[0051] As merely one example, the watermark blur correction unit 15E applies a filter of a specific kernel size, for example, 5×5, to each image data corresponding to a transmitted wavelength among the image data by wavelength of the reflected wavelength and the transmitted wavelength. For example, the watermark blur correction unit 15E applies the filter by overlapping the origin of the filter with the pixel of the origin of the image data corresponding to the transmitted wavelength, for example, starting from the upper left pixel. Hereinafter, the pixel that is overlapped with the origin of the filter when the filter is applied may be referred to as the "pixel of interest."

[0052] In this way, each time a filter is applied, the watermark blur correction unit 15E calculates the difference between the pixel value in the kernel when the current filter is applied and the pixel value in the kernel when the previous filter is applied. Hereinafter, the difference between the pixel value in the kernel when the current filter is applied and the pixel value in the kernel when the previous filter is applied may be referred to as the "adjacent difference". For example, the pixel value difference between elements that exist at the same position in the kernel is calculated, and a statistical value of the differences calculated between the elements at the same position, such as a total value or an average value, is calculated to calculate a representative value of the differences as the "adjacent difference".

[0053] Then, when the adjacent differences for all the transmission wavelengths are equal to or greater than the threshold value Th1, the watermark blur correction unit 15E superimposes the origin of the filter on the pixel of interest for each image data corresponding to the reflection wavelength. This further applies the filter to the image data corresponding to the reflection wavelength. Next, the watermark blur correction unit 15E calculates the adjacent differences between the pixel values ​​in the kernel when the current filter is applied and the pixel values ​​in the kernel when the previous filter is applied.

[0054] If the adjacent differences for all reflection wavelengths are equal to or smaller than the threshold value Th2, it is determined that the pixel to which the filter is applied is highly likely to correspond to the watermark portion. In this case, the watermark blur correction unit 15E stores the coordinates of the pixel of interest in an internal memory (not shown) as an element corresponding to the watermark portion.

[0055] Fig. 8 and Fig. 9 are schematic diagrams (1) and (2) showing examples of determining a watermark portion. Fig. 8 shows a schematic diagram of a filter being moved on image data 24P corresponding to a transmission wavelength among image data 24 for a successor model after pixel density correction. Meanwhile, Fig. 9 shows a schematic diagram of a filter being moved on image data 24R corresponding to a reflection wavelength among image data 24 for a successor model after pixel density correction.

[0056] As shown in FIG. 8, when the filter is located in a background portion where there is no banknote, the pixel values ​​are saturated toward white, so adjacent differences in transmission wavelengths are unlikely to occur. Furthermore, when the filter is located in an edge portion of the banknote, adjacent differences in transmission wavelengths may occur. However, even if the filter is located in an edge portion of the banknote, adjacent differences in reflection wavelengths also occur at the same time, as shown in FIG. 9. This makes it possible to prevent the edge portion of the banknote from being mistakenly determined to be a watermark portion. Furthermore, when the filter is located in the watermark portion WM, it can be seen that adjacent differences in transmission wavelengths increase, as shown in FIG. 8. On the other hand, even if the filter is located in the watermark portion WM, adjacent differences in transmission wavelengths of a certain value or more are unlikely to occur, as shown in FIG. 9. Therefore, the watermark portion WM can be accurately extracted.

[0057] This process of applying the filter, determining adjacent differences in transmitted wavelengths, determining adjacent differences in reflected wavelengths and saving the elements corresponding to the watermark portion is repeated while shifting the pixel of interest until the origin of the filter is applied to the end point of the image, for example the bottom right vertex of the image.

[0058] It should be noted that when shifting the pixel of interest to which the filter is applied in the main scanning direction and the sub-scanning direction, it is not necessary to shift it one by one, and it goes without saying that the pixel of interest can be shifted every any number of pixels.

[0059] In addition, an example has been given here in which threshold value Th1 is used commonly for determining adjacent differences for each transmitted wavelength, and threshold value Th2 is used commonly for determining adjacent differences for each reflected wavelength, but it is also possible to set different threshold values ​​for each wavelength.

[0060] Further, although an example in which the adjacent difference is calculated for every transmitted wavelength and every reflected wavelength has been given here, it is not necessary to calculate the adjacent difference for every transmitted wavelength and every reflected wavelength. For example, the adjacent difference may be calculated for any one of the transmitted wavelengths and any one of the reflected wavelengths.

[0061] The transport filter adding unit 15F is a processing unit that adds a transport filter compatible with the successor model to the image data compatible with the successor model after the watermark blur correction.

[0062] As an example, the conveyance filter adding unit 15F extracts a portion corresponding to a banknote from the image data compatible with the successor model after the watermark blur correction. More specifically, the conveyance filter adding unit 15F binarizes the image data corresponding to the transmission wavelength, and smoothes the uneven portion by applying morphology processing to the binarized image. Then, the conveyance filter adding unit 15F extracts a contour line from the binarized image to which the morphology processing has been applied, and calculates the position of the center of gravity from the banknote area formed by the contour line. Hereinafter, the partial image corresponding to the banknote area among the images compatible with the successor model may be referred to as a "banknote image."

[0063] Thereafter, the conveyance filter adding unit 15F performs skew correction for correcting the skew of the banknote on the image data compatible with the successor model. FIG. 10 and FIG. 11 are schematic diagrams (1) and (2) showing an example of skew correction. FIG. 10 shows image data 25 before skew correction, while FIG. 11 shows image data 25A after skew correction. As shown in FIG. 25, the short side ds and long side dl of the rectangle corresponding to the banknote are calculated based on the four vertices of the image data 25 compatible with the successor model. Then, as shown in FIG. 26, coordinates where there is no skew on the short side ds and long side dl, that is, src_pt[0]=(0,0), src_pt[1]=(0,ds), src_pt[2]=(dl,0) and src_pt[3]=(dl,ds), are set. By performing projective transformation on the image data 25 based on these coordinates, the image data 25A compatible with the successor model after skew correction is obtained.

[0064] Then, the conveying filter adding unit 15F adds a conveying filter that reflects the influence of a conveying mechanism, such as a belt, corresponding to the successor model to the image data corresponding to the successor model after the skew correction. FIG. 12 is a diagram showing an example of the conveying filter addition. As shown in FIG. 12, a conveying filter CF is added to the image data 25 corresponding to the successor model after the watermark blur correction after the skew correction is performed. For example, the conveying filter CF is set based on the difference between the density of a medium having uniform reflection density and transmission density and the output when the medium is read by the line sensor of the successor model. This allows a conveying filter CF to be obtained in which a coefficient, that is, a ratio of output to input, is associated with each pixel. By multiplying such a conveying filter CF by the image data corresponding to the successor model after the skew correction, it is possible to obtain image data 26 to which the influence of a conveying mechanism, such as a belt, corresponding to the successor model is added.

[0065] The log curve application unit 15G is a processing unit that applies a log curve to image data compatible with the successor model after the addition of the transport filter.

[0066] Fig. 13 is a schematic diagram showing an example of application of a log curve. As shown in Fig. 13, for each pixel included in image data 26 compatible with successor models, the gradation value of the pixel is multiplied by a specific magnification, for example, four times in the example shown in Fig. 13. As a result, image data 26 compatible with successor models is converted into image data 26A with 1024 gradations, which has four times the gradations of the original.

[0067] Next, a log curve with a gain set for converting from a linear scale to a log scale is applied to the 1024-level image data 26A. As a result, the gradation expression is converted from a linear scale to a log scale by multiplying each pixel included in the 1024-level image data 26A by the gain of the log curve corresponding to the gradation value of that pixel.

[0068] In this way, for each pixel included in the 1024-level image data 26B to which the log curve has been applied, the gradation value of that pixel is multiplied by the reciprocal of the magnification, i.e., 1 / 4. This results in the final output of 256-level image data 27 for successor models that corresponds to the log scale.

[0069] Such image data compatible with the successor model can be output to any output destination as a data conversion result. As just one example, the data conversion result can be output to an external device such as the client terminal 30, or to software or a service that uses the data conversion result. In addition, the data conversion result can be added to and saved in the second image database 13A2.

[0070] <Processing flow> Next, a process flow of the server device 10 according to the present embodiment will be described. Here, (1) data conversion process executed by the server device 10 will be described, and then (2) watermark blur correction process will be described.

[0071] (1) Data conversion processing 14 is a flowchart showing the procedure of the data conversion process. This process can be started when a data conversion request for converting image data of a current model into image data of a successor model is received from the client terminal 30, as an example.

[0072] As shown in FIG. 14, the inverse log curve application unit 15A acquires image data of the current model designated by the data conversion request from the first image database 13A1 (step S101).

[0073] Next, the inverse log curve application unit 15A applies an inverse log curve, in which a gain for inversely converting from a log scale to a linear scale is set, to the image data of the current model acquired in step S101 (step S102).

[0074] Then, the inverse element gain adjustment unit 15B performs inverse element gain adjustment on the image data to which the inverse log curve has been applied in step S102 (step S103).

[0075] Then, the table conversion unit 15C converts the image data of the current model on which the inverse element gain adjustment has been performed in step S103 into image data compatible with the successor model in accordance with the conversion table 13T (step S104).

[0076] Next, pixel density correction unit 15D resizes the image data for the successor model converted in step S104 by enlarging or reducing it according to a magnification that matches the pixel density of the line sensor of the current model with the pixel density of the line sensor of the successor model (step S105).

[0077] Thereafter, the watermark blur correction unit 15E corrects the degree of blur in the watermark portion according to the difference between the gap between the imaging element of the line sensor of the current model and the banknote transport path and the gap between the imaging element of the line sensor of the successor model and the banknote transport path (step S106).

[0078] Then, the transport filter adding unit 15F adds a transport filter compatible with the successor model to the image data compatible with the successor model in which the degree of blurring has been corrected in the watermark portion in step S106 (step S107).

[0079] Finally, the log curve application unit 15G applies a log curve to the successor model compatible image data to which the transport filter has been added in step S107 (step S108), outputs the result as a data conversion result (step S109), and ends the process.

[0080] (2) Watermark blur correction processing Fig. 15 is a flowchart showing the procedure of the watermark blur correction process. This process corresponds to the process of step S106 shown in Fig. 14. As shown in Fig. 15, the watermark blur correction unit 15E executes loop process 1 which repeats the processes from step S301 to step S307 described below while shifting the pixel of interest until the origin of the filter is applied to the end point of the image, for example, the lower right vertex of the image.

[0081] Furthermore, the watermark blur correction unit 15E executes loop process 2 in which the processes of step S301 and step S302 described below are repeated a number of times corresponding to the number K of types corresponding to the transmitted wavelengths among the image data for each reflected wavelength and transmitted wavelength.

[0082] That is, the watermark blur correction unit 15E applies a filter by overlapping the origin of the filter with a pixel of interest of image data corresponding to a transmission wavelength k (step S301).Then, the watermark blur correction unit 15E calculates an adjacent difference for the transmission wavelength k between a pixel value in the kernel when the current filter is applied and a pixel value in the kernel when the previous filter is applied (step S302).

[0083] By repeating such loop process 2, the calculation result of the adjacent difference is obtained for each transmission wavelength k. Then, when the above loop process 2 is completed, the watermark blur correction unit 15E judges whether the adjacent difference for the K transmission wavelengths is equal to or larger than the threshold value Th1 (step S303).

[0084] At this time, if the adjacent difference for the K transmitted wavelengths is greater than or equal to the threshold value Th1, the watermark blur correction unit 15E executes loop process 3 in which the processes of step S304 and step S305 described below are repeated a number of times corresponding to the number M of types corresponding to the reflected wavelengths.

[0085] That is, the watermark blur correction unit 15E applies the filter by overlapping the origin of the filter with the pixel of interest of the image data corresponding to the reflected wavelength m (step S304).Then, the watermark blur correction unit 15E calculates the adjacent difference for the reflected wavelength m between the pixel value in the kernel when the current filter is applied and the pixel value in the kernel when the previous filter is applied (step S305).

[0086] By repeating such loop process 3, the calculation result of the adjacent difference is obtained for each reflection wavelength m. Then, when the above loop process 3 is completed, the watermark blur correction unit 15E judges whether the adjacent difference regarding the M reflection wavelengths is equal to or smaller than the threshold value Th2 (step S306).

[0087] If the adjacent differences for all reflected wavelengths are equal to or smaller than the threshold Th2 (Yes in step S306), it is determined that the pixel to which the filter is applied is highly likely to correspond to the watermark portion. In this case, the watermark blur correction unit 15E stores the coordinates of the pixel of interest in an internal memory (not shown) as an element corresponding to the watermark portion (step S307).

[0088] A set of coordinates of pixels corresponding to the watermark portion is obtained by repeating such loop process 1. Then, when the above loop process 1 ends, the watermark blur correction unit 15E ends the process shown in Fig. 15 and proceeds to the process of step S107 shown in Fig. 14.

[0089] <One aspect of the effect> As described above, the server device 10 according to the present embodiment can convert image data corresponding to the line sensor of the current model into image data corresponding to the line sensor of the successor model. Therefore, the server device 10 according to the present embodiment can maintain compatibility of the output of the line sensor between the current model and the successor model.

[0090] The effects, for example, one aspect of the technical significance, achieved by the processing of each step shown in Fig. 14 are listed below as examples. Fig. 16 is a diagram showing one aspect of the effects. The original image data 20 of the current model includes the effects listed in (a) to (e) shown in Fig. 16. By applying the inverse log curve to the image data 20 of the current model in step S102 above, it is possible to obtain image data 21 of the current model corresponding to the linear scale, as shown in (b).

[0091] Next, in step S103 above, inverse element gain adjustment is performed on the image data 21 of the current model after application of the inverse log curve, thereby obtaining (b) image data 22 of the current model from which the influence of the conveying system of the current model has been removed.

[0092] Furthermore, by performing table conversion on the image data 22 of the current model after the inverse element gain adjustment in step S104 above, (c) the influence of the spectral characteristics of the current model is removed, and (a) image data 23 compatible with the successor model that corresponds to the spectral characteristics of the successor model is obtained.

[0093] Then, in step S105 above, the pixel density of the successor model compatible image data 23 after table conversion is corrected, thereby obtaining the successor model compatible image data 24 that corresponds to the pixel density or resolution of the successor model.

[0094] Next, in step S106, the degree of blurring of the watermark portion of the image data 24 for the successor model after pixel density correction is corrected. This removes the influence of the line sensor and the gap in the conveying path of the current model (e), and obtains image data 25 for the successor model that corresponds to the line sensor and the gap in the conveying path of the successor model (e).

[0095] In addition, by adding a transport filter to the image data 25 compatible with the successor model after correcting the degree of blur of the watermark portion in step S107 above, (b) image data 26 compatible with the successor model to which the influence of the transport system of the successor model has been added is obtained.

[0096] Finally, by applying a log curve to the successor model compatible image data 26 after the addition of the transport filter in step S108, (a) successor model compatible image data 27 corresponding to the log scale is obtained as the final output.

[0097] In the image data 27 for the successor model obtained in this way, (B) to (C) corresponding to the current model can be removed, and the influence of (B) to (E) corresponding to the successor model can be reflected. Therefore, compatibility of the output of the line sensor between the current model and the successor model can be maintained in many ways.

[0098] Although an example has been given here in which all the processes from step S102 to step S108 are executed, it is not necessary that all the processes are executed, and there is nothing to prevent only some of the processes from being executed. EXAMPLES

[0099] Although the embodiments of the disclosed device have been described above, the present invention may be embodied in various different forms other than the above-described embodiments. Therefore, other embodiments included in the present invention will be described below.

[0100] <Distribution and integration> Also, each component of each device shown in the figure does not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed and integrated in any unit according to various loads and usage conditions. For example, the inverse log curve application unit 15A, the inverse element gain adjustment unit 15B, the table conversion unit 15C, the pixel density correction unit 15D, the watermark blur correction unit 15E, the conveyance filter addition unit 15F, or the log curve application unit 15G may be connected via a network as an external device of the server device 10. Also, the inverse log curve application unit 15A, the inverse element gain adjustment unit 15B, the table conversion unit 15C, the pixel density correction unit 15D, the watermark blur correction unit 15E, the conveyance filter addition unit 15F, or the log curve application unit 15G may be included in a separate device, and they may be connected to a network and cooperate with each other. In this way, the functions of the server device 10 described above may be realized.

[0101] <Hardware configuration> Moreover, the various processes described in the above embodiments can be realized by executing a prepared program on a computer such as a personal computer or a workstation. Therefore, an example of a computer that executes a data conversion program having the same functions as those in the first and second embodiments will be described below with reference to FIG.

[0102] Fig. 17 is a diagram showing an example of a hardware configuration. As shown in Fig. 17, the computer 100 has an operation unit 110a, a speaker 110b, a camera 110c, a display 120, and a communication unit 130. Furthermore, the computer 100 has a CPU 150, a ROM 160, a HDD 170, and a RAM 180. These units 110 to 180 are connected via a bus 140.

[0103] As shown in Fig. 17, the HDD 170 stores a data conversion program 170a that performs the same functions as the functional units included in the control unit 15 shown in the above-mentioned first embodiment. This data conversion program 170a may be integrated or separated, like each component of the functional units included in the control unit 15 shown in Fig. 1. That is, the HDD 170 does not necessarily have to store all the data shown in the above-mentioned first embodiment, and it is sufficient that the data used for processing is stored in the HDD 170.

[0104] Under such an environment, the CPU 150 reads out the data conversion program 170a from the HDD 170 and loads it in the RAM 180. As a result, the data conversion program 170a functions as a data conversion process 180a as shown in FIG. 17. The data conversion process 180a loads various data read out from the HDD 170 in an area of ​​the storage area of ​​the RAM 180 that is assigned to the data conversion process 180a, and executes various processes using the loaded various data. For example, the processes shown in FIG. 14 to FIG. 15 are included as examples of the processes executed by the data conversion process 180a. Note that in the CPU 150, all of the processing units shown in the above-mentioned first embodiment do not necessarily need to operate, and it is sufficient that the processing units corresponding to the processes to be executed are virtually realized.

[0105] The data conversion program 170a does not necessarily have to be stored in the HDD 170 or the ROM 160 from the beginning. For example, each program is stored in a "portable physical medium" such as a flexible disk, a so-called FD, a CD-ROM, a DVD disk, a magneto-optical disk, or an IC card that is inserted into the computer 100. The computer 100 may then acquire and execute each program from the portable physical medium. Alternatively, each program may be stored in another computer or server device connected to the computer 100 via a public line, the Internet, a LAN, a WAN, or the like, and the computer 100 may acquire and execute each program from the other computer or server device. [Explanation of symbols]

[0106] 10. Server equipment 11 Communication control section 13 Storage section 13A1 First Image Database 13A2 Second Image Database 13T Conversion table 15 Control section 15A Reverse log curve application section 15B Inverse element gain adjustment section 15C Table conversion section 15D Pixel Density Correction Unit 15E Watermark blur correction section 15F Transport filter attachment 15G Log Curve Application Section 30 Client Terminals

Claims

1. an acquisition unit that acquires image data output by the first line sensor; a conversion unit that converts pixel values ​​included in image data output by the first line sensor in accordance with correspondence data in which a correspondence between pixel values ​​is set based on a sensitivity difference between the first line sensor and a second line sensor different from the first line sensor; a correction unit that corrects the degree of blurring of a watermark portion of the banknote in the image data obtained by converting the pixel values ​​by the conversion unit, in accordance with a difference between a gap between an imaging element of the first line sensor and a banknote transport path and a gap between an imaging element of the second line sensor and a banknote transport path; A data conversion device comprising:

2. 2. The data conversion device according to claim 1, wherein the correspondence data is set by histogram matching of two sets of image data obtained by reading the same medium with the first line sensor and the second line sensor.

3. a multiplication unit that multiplies a pixel value included in the image data output by the first line sensor by an inverse element gain that removes an influence of a transport mechanism of a model corresponding to the first line sensor on an output of an image sensor of the first line sensor, 2. The data conversion device according to claim 1, wherein the conversion unit converts pixel values ​​included in the image data after multiplication by the inverse element gain.

4. The data conversion device described in claim 3, characterized in that the inverse element gain is set to a coefficient such that the output of the imaging element of the first line sensor becomes a target value of the line sensor corresponding to the density of the medium, based on the output when the first line sensor reads a medium having uniform reflection density and transmission density.

5. The data conversion device according to claim 1, further comprising a multiplication unit that multiplies the image data whose pixel values ​​have been converted by the conversion unit by a transport filter that adds an effect that a transport mechanism of a model corresponding to the second line sensor has on the output of the image sensor of the second line sensor.

6. 6. The data conversion device according to claim 5, wherein the transport filter is set based on the difference between the density of a medium having uniform reflection density and transmission density and the output when the medium is read by the second line sensor.

7. Acquire image data output by a first line sensor; converting pixel values ​​included in the image data output by the first line sensor in accordance with correspondence data in which a correspondence relationship between pixel values ​​is set based on a sensitivity difference between the first line sensor and a second line sensor different from the first line sensor; correcting a degree of blur of a watermark portion of the banknote in the image data whose pixel values ​​have been converted in the converting process, according to a difference between a gap between an imaging element of the first line sensor and a banknote transport path and a gap between an imaging element of the second line sensor and a banknote transport path; A data conversion method, the processing of which is executed by a computer.

8. Acquire image data output by a first line sensor; converting pixel values ​​included in the image data output by the first line sensor in accordance with correspondence data in which a correspondence relationship between pixel values ​​is set based on a sensitivity difference between the first line sensor and a second line sensor different from the first line sensor; correcting a degree of blur of a watermark portion of the banknote in the image data whose pixel values ​​have been converted in the converting process, according to a difference between a gap between an imaging element of the first line sensor and a banknote transport path and a gap between an imaging element of the second line sensor and a banknote transport path; A data conversion program that causes a computer to execute a process.

Citation Information

Patent Citations

  • Image processing method, image file and file for image processing

    JP1996154172A

  • Paper sheets, discriminating device

    JP1997212707A

  • Image forming device, information processor, and connecting device used for them

    JP2004112627A

  • Device and method for discriminating paper sheet

    JP2006146321A

  • Image processing method and device, image reading device, image forming device, and program

    JP2007060354A