Banknote image processing device and banknote image processing method
The banknote image processing device addresses the inefficiency of obtaining damaged banknote images by applying simulated damage processing to normal banknote images, allowing for the easy generation of a large number of damaged images without physically damaging actual banknotes.
Patent Information
- Application Number
- JP2024502297
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-02-22
- Publication Date
- 2025-03-28
- Estimated Expiration
- 2042-02-22
AI Technical Summary
Obtaining a large amount of damaged banknote images is labor-intensive and inefficient, as it requires physically damaging actual banknotes.
A banknote image processing device that includes a storage unit for normal banknote images and a processor that applies simulated damage processing to these images, mimicking common damage types such as holes, cuts, tears, stains, and washing.
Enables the easy generation of a large number of damaged banknote images without physically harming actual banknotes, facilitating the development and testing of banknote identification algorithms and systems.
Smart Images

Figure 0007653574000001 
Figure 0007653574000002 
Figure 0007653574000003
Abstract
Description
[Technical field]
[0001] The present disclosure relates to a banknote image processing device and a banknote image processing method. [Background technology]
[0002] In order to develop a banknote validation algorithm or system that uses banknote images, in addition to images of normal banknotes, a large number of images of abnormal banknotes that have been damaged, such as banknotes with holes, cut off portions, torn banknotes, folded banknotes, stained banknotes, banknotes that have been laundered, etc. (hereinafter referred to as "damaged banknote images") are required. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2011-258029 A Summary of the Invention [Problem to be solved by the invention]
[0004] However, if a large number of damaged banknote images are obtained by actually damaging actual banknotes, a large number of steps would be required to damage the actual banknotes.
[0005] Therefore, the present disclosure proposes a technique that makes it easy to obtain a large number of damaged banknote images. [Means for solving the problem]
[0006] The banknote image processing device of the present disclosure includes a memory unit and a processor. The memory unit stores an image of a normal banknote. The processor applies a pseudo-damage process to the image, which imitates damage that would be given to the normal banknote. Effect of the Invention
[0007] According to the disclosed technique, a large number of damaged banknote images can be easily obtained. [Brief description of the drawings]
[0008] [Figure 1] FIG. 1 is a diagram illustrating a configuration example of a banknote image processing system according to a first embodiment of the present disclosure. [Diagram 2] FIG. 2 is a diagram showing an example of a captured image in the first embodiment of the present disclosure. [Diagram 3] FIG. 3 is a diagram illustrating an example of a normalized projection according to the first embodiment of the present disclosure. [Figure 4] FIG. 4 is a diagram showing an example of hole drilling according to the first embodiment of the present disclosure. [Diagram 5] FIG. 5 is a diagram showing an example of hole drilling according to the first embodiment of the present disclosure. [Figure 6] FIG. 6 is a diagram showing an example of a cutting process according to the first embodiment of the present disclosure. [Figure 7] FIG. 7 is a diagram showing an example of a cutting process according to the first embodiment of the present disclosure. [Figure 8] FIG. 8 is a diagram showing an example of the tearing process according to the first embodiment of the present disclosure. [Figure 9] FIG. 9 is a diagram showing an example of the tearing process according to the first embodiment of the present disclosure. [Figure 10] FIG. 10 is a diagram showing an example of corner folding processing according to the first embodiment of the present disclosure. [Figure 11] FIG. 11 is a diagram showing an example of corner folding processing according to the first embodiment of the present disclosure. [Figure 12] FIG. 12 is a diagram showing an example of the stain processing according to the first embodiment of the present disclosure. [Figure 13] FIG. 13 is a diagram showing an example of the stain processing according to the first embodiment of the present disclosure. [Figure 14] FIG. 14 is a diagram showing an example of thickness data according to the second embodiment of the present disclosure. [Figure 15] FIG. 15 is a diagram showing an example of thickness data according to the second embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0009] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. In the following embodiments, the same components are denoted by the same reference numerals.
[0010] [Example 1] <Configuration of banknote image processing system> FIG. 1 is a diagram illustrating a configuration example of a banknote image processing system according to a first embodiment of the present disclosure.
[0011] 1, a banknote image processing system 1 includes a banknote image processing device 10, an input device 20, and a display 30. The input device 20 and the display 30 are connected to the banknote image processing device 10. Examples of the input device 20 include a pointing device such as a mouse, and a keyboard. An example of the display 30 is an LCD (Liquid Crystal Display).
[0012] The banknote image processing device 10 has a processor 11 and a memory unit 12. Examples of the processor 11 include a CPU (Central Processing Unit), a DSP (Digital Signal Processor), an FPGA (Field Programmable Gate Array), and an ASIC (Application Specific Integrated Circuit). Examples of the memory unit 12 include a memory and a storage. The banknote image processing device 10 is realized by, for example, a computer.
[0013] The memory unit 12 stores in advance images captured by a camera (hereinafter sometimes referred to as "captured images"), including images of normal banknotes without damage (hereinafter sometimes referred to as "normal banknote images"). The captured images include an image of the front side of a normal banknote (hereinafter sometimes referred to as "front image") and an image of the back side of a normal banknote (hereinafter sometimes referred to as "back image").
[0014] Fig. 2 is a diagram showing an example of a captured image in the first embodiment of the present disclosure. In Fig. 2, the captured image OI is formed from a normal banknote image MOIa and an image of the background of the normal banknote (hereinafter, may be referred to as a "background image") BI. The normal banknote image MOIa is a rectangular image and has corner points C1, C2, C3, and C4, which are the four vertices of the rectangle.
[0015] The processor 11 acquires the photographed image OI from the memory unit 12, and generates a damaged banknote image by applying pseudo damage processing (hereinafter sometimes referred to as "pseudo damage processing") that imitates damage given to a normal banknote to the normal banknote image MOIa included in the acquired photographed image OI. Hereinafter, an image formed from the damaged banknote image and the background image BI, that is, an image after the pseudo damage processing has been applied to the normal banknote image MOIa, may be referred to as a "processed image".
[0016] <Pre- and post-treatment for simulated damage processing> The processor 11 performs normalization projection on the normal bill image MOIa before performing pseudo damage processing on the normal bill image MOIa. FIG. 3 is a diagram showing an example of normalization projection in the first embodiment of the present disclosure. As shown in FIG. 3, the processor 11 detects four corner points C1 to C4 of the normal bill image MOIa, and performs normalization projection based on the detected corner points C1 to C4. Hereinafter, the image after normalization projection may be referred to as a "post-normalization image". In FIG. 3, the width of the post-normalization image MOIb is indicated as "W", and the height of the post-normalization image MOIb is indicated as "H". When any of the pseudo damage processing described below is performed on the normal bill image MOIa, the processor 11 performs normalization projection as a pre-processing of the pseudo damage processing, and performs back projection of the normalization projection as a post-processing of the pseudo damage processing. Hereinafter, as examples of pseudo damage processing, hole processing, cutting processing, tear processing, corner folding processing, stain processing, and washing processing will be described.
[0017] <Hole machining> 4 and 5 are diagrams showing an example of hole processing in the first embodiment of the present disclosure. First, the processor 11 acquires pixel values of the background image BI (hereinafter, sometimes referred to as "background pixel values") from the normalized image MOIb. Next, the processor 11 converts pixel values of a circular area HL of radius R centered on center coordinates (Cx, Cy) into background pixel values as shown in FIG. 4. The center coordinates (Cx, Cy) and the radius R are specified by the operator of the banknote image processing system 1 using the input device 20. By converting the pixel values of the circular area HL of radius R into background pixel values, hole processing is performed on the normal banknote image MOIa as pseudo damage processing for the normal banknote image MOIa, and a processed image Ia including a damaged banknote image MIa with a hole HLI is obtained as shown in FIG. 5.
[0018] <Cutting process> 6 and 7 are diagrams showing an example of cutting processing in the first embodiment of the present disclosure. First, the processor 11 acquires background pixel values from the normalized image MOIb. Next, the processor 11 calculates the x coordinate based on the designated lengths L1 and L2 according to the formula (1) as shown in FIG. 6. The designated lengths L1 and L2 are designated by the operator of the banknote image processing system 1 using the input device 20. Then, the processor 11 converts the pixel values from the coordinate (0, y) to the x coordinate indicated by the formula (1) into background pixel values. However, the processor 11 changes the y coordinate in the formula (1) row by row within the range of 0 to H-1. x=((L2-L1) / (H-1))×y+L1-1 …(1)
[0019] By converting the pixel values of the area CU of the specified length L1, L2 and height H into background pixel values, a cutting process is applied to the normal banknote image MOIa as a pseudo-damage process for the normal banknote image MOIa, and a processed image Ib is obtained, which includes a damaged banknote image MIb in which a part CUI of the normal banknote image MOIa is cut off from the normal banknote image MOIa, as shown in Figure 7.
[0020] <Tearing processing> 8 and 9 are diagrams showing an example of tear processing in the first embodiment of the present disclosure. First, the processor 11 acquires background pixel values from the normalized image MOIb. Next, the processor 11 calculates vertex coordinates (Vx, Vy) based on the designated lengths P, L and angle A according to equations (2) and (3) as shown in FIG. 8. Also, the processor 11 calculates B1 coordinates and B2 coordinates based on the designated lengths P, BL according to equations (4) and (5) as shown in FIG. 8. The designated lengths P, L, BL and angle A are specified by the operator of the banknote image processing system 1 using the input device 20. Vx = P + L × sin(A) … (2) Vy = HL × cos(A) … (3) B1=P-(BL / 2)-1 …(4) B2=P+(BL / 2)-1 …(5)
[0021] Then, processor 11 converts pixel values from the x1 coordinate shown in equation (6) to the x2 coordinate shown in equation (7) starting from the vertex coordinate (Vx, Vy) into background pixel values. However, processor 11 changes the y coordinate in equations (6) and (7) row by row within the range of Vy to H-1. x1=((Vx-B1) / (H-Vy-1))×(Hy-1)+B1 …(6) x2=((Vx-B2) / (H-Vy-1))×(Hy-1)+B2 …(7)
[0022] As a result, the pixel values of the area TE surrounded by the line segments BL, L1, and L2 are converted to background pixel values, and a tear processing is applied to the normal banknote image MOIa as a pseudo-damage processing for the normal banknote image MOIa, resulting in a processed image Ic including a damaged banknote image MIc in which a tear TEI exists in part of the normal banknote image MOIa, as shown in Figure 9.
[0023] <Corner folding processing> 10 and 11 are diagrams showing an example of corner folding processing in the first embodiment of the present disclosure. First, the processor 11 acquires background pixel values from the normalized image MOIb. Next, as shown in FIG. 10, the processor 11 calculates the angle θ, the rotation angle φ, the X-axis direction movement distance Tx, and the Y-axis direction movement distance Ty based on the designated lengths Dx and Dy according to equations (8), (9), (10), and (11). The designated lengths Dx and Dy are specified by the operator of the banknote image processing system 1 using the input device 20. θ = atan(Dy / Dx) … (8) φ=π-2θ …(9) Tx = Dx × (1-cos(2θ))-W … (10) Ty = Dy × (1 + cos(2θ)) … (11)
[0024] Processor 11 also rotates the back image in the range from coordinate (0, y) to the x coordinate shown by equation (12) by the rotation angle φ and moves it by movement distances Tx, Ty, and then pastes it onto the front image. Processor 11 also converts pixel values from coordinate (0, y) to the x coordinate shown by equation (13) into background pixel values. However, processor 11 changes the y coordinate in equations (12) and (13) by one line at a time within the range of 0 to Dy. x = W - (Dx × (Dy - y) / Dy) ... (12) x = Dx × (Dy-y) / Dy … (13)
[0025] As a result, the front image of area FO1 is converted into a back image, and the pixel values of area FO2 are converted into background pixel values, so that a corner-folding process is applied to the normal banknote image MOIa as a pseudo-damage process for the normal banknote image MOIa, and a processed image Id is obtained that includes a damaged banknote image MId in which folded corner FOI is present as part of the normal banknote image MOIa, as shown in Figure 11.
[0026] <Stain processing> 12 and 13 are diagrams showing an example of stain processing in the first embodiment of the present disclosure. First, the processor 11 calculates coordinates (X1, Y1) and coordinates (X2, Y2) based on the center coordinates (Cx, Cy) and the designated length L according to formulas (14), (15), (16), (17) and (18) as shown in Fig. 12. The center coordinates (Cx, Cy) and the designated length L are specified by the operator of the banknote image processing system 1 using the input device 20. R = L / 2 … (14) X1 = Cx - R ... (15) Y1=Cy-R …(16) X2=Cx+R-1 …(17) Y2=Cy+R-1 …(18)
[0027] Then, the processor 11 reduces the luminance of the pixels in the region ST by multiplying the pixel values in the region ST from the coordinates (X1, Y1) to the coordinates (X2, Y2) by a predetermined gain value. As a result, the normal banknote image MOIa is subjected to a stain processing as a pseudo-damage processing for the normal banknote image MOIa, and a processed image Ie is obtained, which includes a damaged banknote image MIe in which a stain STI is applied to a part of the normal banknote image MOIa, as shown in Fig. 13.
[0028] <Washing process> Laundry detergent contains fluorescent agents, so images of washed bills appear brighter than images of unwashed bills.
[0029] Therefore, the processor 11 multiplies the pixel values of all pixels in the normalized image MOIb by a predetermined gain value, thereby increasing the luminance of all pixels in the normalized image MOIb.
[0030] As a result, the normal banknote image MOIa is subjected to washing processing as pseudo-damage processing for the normal banknote image MOIa, and a processed image including a damaged banknote image in which the overall brightness of the normal banknote image MOIa is increased is obtained.
[0031] The first embodiment has been described above.
[0032] [Example 2] In the second embodiment, it is assumed that a tape is attached to a bill.
[0033] Banknote validation algorithms and systems may use not only images of banknotes to validate banknotes, but also their thickness. Thus, normal banknote images are accompanied by data indicating the thickness of each part of the banknote (hereinafter, sometimes referred to as "thickness data"). Figs. 14 and 15 are diagrams showing an example of thickness data in Example 2 of the present disclosure. Fig. 14 shows thickness data in the height H direction, and Fig. 15 shows thickness data in the width W direction.
[0034] In Fig. 14, data OD is thickness data indicating the thickness of a normal banknote, and data TZ is thickness data indicating the thickness of the tape affixed to the banknote. Also, "WD" in Fig. 14 indicates the height of the tape. That is, Fig. 14 assumes a case where a tape with a thickness of TZ and a height of WD is affixed to a position X1 in the height H direction of a normal banknote having a thickness OD. Also, Fig. 15 assumes a case where the tape is affixed to a position shifted to the right in the width W direction of a normal banknote.
[0035] The processor 11 adds thickness data TZ indicating the thickness of the tape to thickness data OD indicating the thickness of a normal banknote, for example, based on a specified value X1. The specified value X1 is specified by an operator of the banknote image processing system 1 using the input device 20. The thickness data OD and TZ are stored in the memory unit 12 in advance.
[0036] In this way, the processor 11 generates thickness data of an abnormal banknote to which tape has been affixed by adding the tape thickness data to the thickness data of a normal banknote.
[0037] The second embodiment has been described above.
[0038] As described above, the banknote image processing device (banknote image processing device 10 of the embodiment) of the present disclosure includes a memory unit (memory unit 12 of the embodiment) and a processor (processor 11 of the embodiment). The memory unit stores an image of a normal banknote. The processor applies pseudo-damage processing to the image of the normal banknote, simulating damage that is given to a normal banknote.
[0039] For example, the processor applies holes to an image of a normal banknote to simulate damage.
[0040] For example, the processor may also apply cut processing to an image of a normal banknote to simulate damage processing.
[0041] For example, the processor may also apply a tear effect to an image of a normal banknote to simulate damage.
[0042] For example, the processor may also apply a folded corner effect to an image of a normal banknote to simulate damage.
[0043] For example, the processor may also apply a stain effect to an image of a normal banknote to simulate damage.
[0044] For example, the processor may also apply a washing effect to an image of a normal banknote to simulate damage.
[0045] In this way, damaged banknote images can be generated simply by processing images of normal banknotes, without actually damaging the actual banknotes, so that a large number of damaged banknote images can be easily obtained. [Explanation of symbols]
[0046] 1. Banknote image processing system 10. Banknote image processing device 11 Processors 12 Storage section
Claims
1. a storage unit that stores an image formed from a first image that is an image of a front side of a normal banknote, a second image that is an image of a back side of the normal banknote, and a third image that is an image of the background of the first image; a processor that applies a pseudo-damage effect to the first image that imitates damage that is applied to the normal banknote; Equipped with The processor converts a first region, which is a triangular region including a corner point of the first image, into the third image, and converts a second region, which is a region in the first image that is line-symmetrical to the first region, into the second image, thereby performing a corner folding process on the first image as the damage process. Banknote image processing device.
2. The processor: Obtaining an image formed from a first image which is an image of a front side of a normal banknote, a second image which is an image of a back side of the normal banknote, and a third image which is an image of a background of the first image; When applying a pseudo damage process to the first image that imitates damage to the normal banknote, a first region that is a triangular region including a corner point of the first image is converted into the third image, and a second region that is an area in the first image that is line-symmetrical to the first region is converted into the second image, thereby applying a corner folding process to the first image as the damage process. Banknote image processing method.
Citation Information
Patent Citations
Paper sheet thickness sensing device
JP2004083172A
Sheets discrimination method, sheets discrimination device and normal / defective discrimination learning method
JP2011258029A
Valuable medium processing apparatus and valuable medium processing method
JP2014127163A
Paper sheet discrimination processing method
JP2019192012A
Banknote recognition and classification method and system
US20160121370A1