Program, display position determining method, and automated transaction device

Abstract

To provide a program, a display position determination method, and an automatic transaction device that in a case where a medium is placed on a display surface of a display unit and reading is performed, enables the medium to be read even in a case where external light of a ceiling lamp or the like is reflected white on the display surface.SOLUTION: The program for the automatic transaction device causes an image pickup unit 20 to be used for reading a reading target medium to pick up an image of a display unit 10 that displays a medium placement area designating a region on which the reading target medium is to be placed, detects a contour of an external light reflection area represented in the image picked up by the image pickup unit 20, and based on the position of the contour of the detected external light reflection area in the image, determines the position of the medium placement area to be displayed on the display unit 10.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a program, a display position determining method, and an automated transaction device. [Background technology]

[0002] Conventionally, an automatic transaction device such as an ATM (Automatic Teller Machine) is provided with a means for reading media such as slips (see, for example, Patent Documents 1 to 4).

[0003] In an automatic transaction device equipped with an OCR (Optical Character Recognition) unit as a means for reading a medium, for example, a camera captures an image of a medium placed at a predetermined position to read the medium. In this case, the OCR unit detects the area of ​​the medium shown in the image by image processing of the image captured by the camera, identifies the area of ​​the characters to be read in that area, and recognizes the characters to be read in that area. Here, the detection of the area of ​​the medium is performed by detecting the outline of the medium. The detection of the outline of the medium is performed based on the contrast between the medium and the background shown in the image and the shape and size of the medium that are specified in advance. The identification of the area of ​​the characters to be read in the detected area of ​​the medium is performed based on the layout (format) of the medium that is specified in advance.

[0004] In an automatic transaction device where a medium is placed on the display surface of a display unit that displays various transaction screens and is read, a polarizing filter is provided on the display surface of the display unit so that the light of the screen displayed on the display unit is not incident on the camera. This makes it possible to realize an image with a black background when the medium placed on the display surface of the display unit is imaged by the camera, ensuring contrast with the medium on a white background. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2020-27352 A [Patent Document 2] JP 2019-105991 A [Patent Document 3] JP 2012-9080 A [Patent Document 4] JP 2007-164367 A Summary of the Invention [Problem to be solved by the invention]

[0006] Depending on the installation environment of the automated transaction device, external light such as ceiling lights may be reflected white on the display surface of the display unit. In such a case, when a medium is placed on the display surface of the display unit and read, the reflection of the external light is also reflected in the image captured by the camera. For example, if the reflection of the external light overlaps with the outline of the medium shown in the image, the contrast between the medium shown in the image and the background cannot be ensured, and the outline of the medium cannot be detected. As a result, the medium cannot be read.

[0007] In view of the above-mentioned situation, the present invention aims to provide a program, a display position determination method, and an automatic transaction device that enable reading of a medium when the medium is placed on the display surface of a display unit and read, even when external light from a ceiling light or the like is reflected whitely on the display surface. [Means for solving the problem]

[0008] According to one aspect of the program, a processor is caused to execute a process of: capturing an image of a display unit that displays a medium placement area that specifies an area in which a medium to be read is placed, using an imaging unit used to read the medium to be read; detecting an outline of an external light reflection area shown in an image captured by the imaging unit; and determining a position of the medium placement area to be displayed on the display unit based on a position of the outline of the external light reflection area in the image. The direction of the vertical component of the imaging direction of the imaging unit is the same as the direction of the vertical component of the incident direction of the reflected external light. It is a program.

[0009] In one aspect of the method, an automated transaction device causes an imaging unit used to read a medium to capture an image of a display unit that displays a medium placement area that specifies an area in which a medium to be read is placed, detects an outline of an external light reflection area shown in an image captured by the imaging unit, and determines a position of the medium placement area to be displayed on the display unit based on a position of the outline of the external light reflection area in the image. a direction of a vertical component of an imaging direction of the imaging unit is the same as a direction of a vertical component of an incident direction of the external light reflected in the imaging device. This is a method for determining a display position.

[0010] According to one aspect of the device, the device includes a display unit that displays a medium placement area that specifies an area in which a medium to be read is placed, an imaging unit that is used to read the medium to be read, a detection unit that detects an outline of an external light reflection area that is displayed in an image of the display unit captured by the imaging unit, and a determination unit that determines a position of the medium placement area to be displayed on the display unit based on a position of the outline of the external light reflection area in the image. The direction of the vertical component of the imaging direction of the imaging unit is the same as the direction of the vertical component of the incident direction of the reflected external light. It is an automated trading device. Effect of the Invention

[0011] According to the present invention, when a medium is placed on the display surface of the display unit and is read, it is possible to read the medium even if external light from a ceiling light or the like is reflected whitely on the display surface. [Brief description of the drawings]

[0012] [Figure 1] FIG. 2 is a diagram illustrating a functional configuration of an automatic transaction device according to an embodiment. [Diagram 2] 1 is a perspective view illustrating an example of an external configuration of an automatic transaction apparatus according to an embodiment; [Diagram 3] 3 is a diagram illustrating an example of an imaging range of an OCR camera unit; [Figure 4] FIG. 2 is a diagram illustrating a hardware configuration of an automatic transaction device according to an embodiment. [Diagram 5] 11 is a flowchart illustrating the flow of a display position determination process. [Figure 6] FIG. 11 is a diagram illustrating parameters used in the determination process. [Figure 7] 11 is a flowchart illustrating the flow of a determination process. [Figure 8] 13A and 13B are diagrams illustrating an example of medium placement after a display position determination process in a case where external light is reflected at one location on the display surface of the display / input unit, in comparison with a conventional medium placement example. [Figure 9] 13A and 13B are diagrams showing an example of medium placement after a display position determination process in a case where external light is reflected at multiple points on the display surface of the display / input unit, in comparison with a conventional medium placement example. [Figure 10] 11 is a flowchart illustrating the flow of a medium reading process. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a diagram illustrating a functional configuration of an automated transaction device according to one embodiment. The functional configuration illustrated in FIG. 1 shows a configuration related to a display position determination function provided in the automated transaction device, and configurations related to other functions provided in the automated transaction device are not shown. The display position determination function is a function for determining the position of a medium placement area to be displayed on the display unit. The medium placement area is an area that specifies an area in which a medium to be read is placed. The medium to be read is, for example, a document such as a deposit slip or a remittance form. The automated transaction device is, for example, an ATM, and is installed in a financial institution such as a bank.

[0014] As illustrated in FIG. 1, the automated transaction device 1 includes a display unit 10, an imaging unit 20, a detection unit 30, and a determination unit 40.

[0015] The display unit 10 displays a medium placement area that specifies an area where a medium to be read is placed. The imaging unit 20 is used to read the medium to be read. The detection unit 30 detects the outline of an external light reflection area shown in an image of the display unit 10 captured by the imaging unit 20. The determination unit 40 determines the position of the medium placement area to be displayed on the display unit 10 based on the position of the outline of the external light reflection area detected by the detection unit 30 in the image of the display unit 10 captured by the imaging unit 20.

[0016] The detection unit 30 may detect the outline of an external light reflection area that is displayed within the readable range of an image captured by the imaging unit 20 on the display unit 10 .

[0017] The determination unit 40 may calculate an evaluation value based on the shortest distance between the contour of the corresponding area and the contour of the external light reflection area at each position of the corresponding area, which is an area corresponding to the medium placement area and which can be placed on the image captured by the imaging unit 20 by the display unit 10, and determine the display position of the display unit 10 corresponding to the position of the corresponding area where the evaluation value is maximum as the position of the medium placement area to be displayed on the display unit 10.

[0018] In this case, the evaluation value may be set to 0 when the outline of the corresponding area is not included within the readable range of the image captured by the image capturing unit 20 on the display unit 10. Also, the shortest distance when the outline of the corresponding area and the outline of the external light reflection area overlap may be set to 0.

[0019] Furthermore, the evaluation value in a case where there is one outline of the external light reflecting region detected by the detection unit 30 may be the shortest distance between the outline of the corresponding region and the outline of the external light reflecting region.

[0020] In addition, the evaluation value may be set to 0 when there are multiple contours of the external light reflection area detected by the detection unit 30 and at least one of the shortest distances between the contour of the corresponding area and each of the contours of the multiple external light reflection areas is 0.

[0021] In addition, when there are multiple contours of external light reflecting areas detected by the detection unit 30 and all of the shortest distances between the contour of the corresponding area and each of the contours of the multiple external light reflecting areas are greater than 0, the evaluation value may be the minimum value of those shortest distances.

[0022] According to such an automated transaction device 1, when a medium to be read is placed on the display surface of the display unit 10 and read, even if external light such as a ceiling light is reflected white on the display surface, it is possible to prevent the outline of the medium from overlapping with the reflection of the external light, making it possible to read the medium. The automated transaction device 1 will be described in more detail below.

[0023] Fig. 2 is a perspective view illustrating an example of an external configuration of an automatic transaction apparatus according to an embodiment of the present invention Fig. 3 is a diagram illustrating an image capturing range of an OCR camera unit.

[0024] As shown in FIG. 2, the automated transaction apparatus 1 includes an OCR camera unit 101, a passbook insertion / ejection unit 102, a card insertion / ejection unit 103, a coin deposit / withdrawal unit 104, a paper money deposit / withdrawal unit 105, and a display / input unit 106.

[0025] The OCR camera unit 101 captures an image of a medium placed in a medium placement area displayed on the display input unit 106. The imaging range (angle of view) of the OCR camera unit 101 is the imaging range 101a illustrated in Fig. 3, which is a range that includes at least the medium placement area 201 that can be displayed on the display input unit 106. The shape and size of the medium placement area 201 are the same or approximately the same as the shape and size of the medium.

[0026] The passbook insertion and ejection unit 102 accepts and returns passbooks. The card insertion and ejection unit 103 accepts and returns cards (cash cards, etc.) used for transactions. The card insertion and ejection unit 103 also ejects receipts on which transaction details are printed. The coin deposit and ejection unit 104 accepts deposited coins and ejects withdrawn coins. The paper money deposit and ejection unit 105 accepts deposited paper money and ejects withdrawn paper money.

[0027] The display / input unit 106 displays various transaction screens (including a medium reading screen) and accepts operational inputs from the customer.

[0028] 4 is a diagram illustrating a hardware configuration of an automatic transaction device according to an embodiment. As illustrated in FIG. 4, the automatic transaction device 1 includes a control unit 121, a display input unit 106, an OCR camera unit 101, a card processing unit 122, a passbook processing unit 123, a coin processing unit 124, a bill processing unit 125, and a power supply unit (power supply panel) 126.

[0029] The control unit 121 includes a processor 131, a RAM (Random Access Memory) 132, a communication interface 133, a graphics processing unit 134, an external storage device 135, and an input / output interface 136, which are connected to one another via a bus 137. The control unit 121 may further include an FPGA (Field Programmable Gate Array) 138 or an ASIC (Application Specific Integrated Circuit) (not shown) connected to the bus 137. In this case, some of the functions of the control unit 121 may be performed by the FPGA 138 or the ASIC.

[0030] The processor 131 is, for example, a CPU (Central Processing Unit). The processor 131 controls the overall operation of the automated transaction device 1 by executing various programs such as an OS (Operating System) program and an application program. For example, the processor 131 controls an operation related to a display position determination function, such as causing the display input unit 106 to be imaged by the OCR camera unit 101, detecting the outline of an external light reflection area shown in the image imaged by the OCR camera unit 101, and determining the position of the medium placement area 201 to be displayed on the display input unit 106 based on the position of the outline of the detected external light reflection area in the image. The RAM 132 temporarily stores a part of the program executed by the processor 131 and is used as a working storage area for the processor 131.

[0031] The communication interface 133 is connected to a network (not shown) and communicates with, for example, a host computer (not shown) via the network.

[0032] The graphic processing unit 134 is connected to the display device 106 a of the display input unit 106 , and in accordance with control signals from the processor 131 , causes the display device 106 a to display various transaction screens.

[0033] The external storage device 135 is, for example, a hard disk drive (HDD). The external storage device 135 stores various programs executed by the processor 131, various data required for executing the programs, and the like.

[0034] The input / output interface 136 is connected to the touch panel 106b of the display input unit 106, the OCR camera unit 101, the card processing unit 122, the passbook processing unit 123, the coin processing unit 124, and the bill processing unit 125. Although not shown, the automated transaction apparatus 1 may further include a portable recording medium interface capable of writing information to a portable recording medium and reading information from the portable recording medium, and the input / output interface 136 may further be connected to the portable recording medium interface.

[0035] The input / output interface 136 notifies the touch panel 106b, the OCR camera unit 101, the card processing unit 122, the passbook processing unit 123, the coin processing unit 124, and the banknote processing unit 125 of control signals from the processor 131. The input / output interface 136 also notifies the processor 131 of signals (data, information) from the touch panel 106b, the OCR camera unit 101, the card processing unit 122, the passbook processing unit 123, the coin processing unit 124, and the banknote processing unit 125.

[0036] The display input unit 106 includes a display device 106a and a touch panel 106b arranged on the display device 106a. The display device 106a is, for example, an LCD (Liquid Crystal Display). A polarizing filter is provided on the display surface of the display device 106a so that light from the screen displayed on the display device 106a does not enter the OCR camera unit 101. This allows a black background to be realized in an image captured by the OCR camera unit 101 of a medium placed in the medium placement area 201 displayed on the display input unit 106 (display device 106a), ensuring contrast with the white medium. The touch panel 106b detects an operation input to the touch panel 106b and notifies the processor 131 of the detection result.

[0037] The OCR camera unit 101 includes an image sensor such as a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS).

[0038] The card processing unit 122 inserts and ejects cards from the card insertion and ejection unit 103. It also reads and writes information (data) from the magnetic stripe and IC (Integrated Circuit) chip of the inserted card. The card processing unit 122 also prints transaction details on a receipt and ejects it from the card insertion and ejection unit 103.

[0039] The passbook processing unit 123 inserts and ejects a passbook from the passbook insertion and ejection unit 102. It also reads information (data) recorded on the magnetic stripe of an inserted passbook, writes information into the passbook, and so on.

[0040] The coin processing unit 124 deposits and withdraws coins through the coin depositing and withdrawing section 104. It also counts and validates deposited coins and counts withdrawn coins.

[0041] The banknote processing unit 125 deposits and withdraws banknotes through the banknote deposit / withdrawal unit 105. It also counts and validates deposited banknotes and counts withdrawn banknotes.

[0042] The power supply unit 126 supplies power to each component of the automated transaction device 1 .

[0043] 4, the display input unit 106 (display device 106a) is an example of the display unit 10. The OCR camera unit 101 is an example of the imaging unit 20. The processor 131 is an example of the detection unit 30 and the determination unit 40.

[0044] Next, a process related to the display position determination function performed by the automated transaction device 1 (hereinafter, referred to as "display position determination process") will be described with reference to Figures 5 to 7. Note that this display position determination process is a process that is performed by the processor 131 executing the above-mentioned program, for example, when the automated transaction device 1 is installed or started up (when the power is turned on), etc.

[0045] Fig. 5 is a flow chart illustrating the flow of the display position determination process. As illustrated in Fig. 5, when the automatic transaction device 1 starts the display position determination process, first, the display input unit 106 in a state where no medium is placed thereon is captured by the OCR camera unit 101 to obtain an image 301 (step (hereinafter simply referred to as "S") 101). Here, assume that external light such as a ceiling light is reflected on the display surface of the display input unit 106, and therefore the external light reflection (for example, external light reflection 302) is shown in the obtained image 301.

[0046] Next, the automated transaction device 1 performs image processing for grayscale conversion on the image 301 to obtain a grayscale image 303 (S102).

[0047] Next, the automated transaction device 1 performs binarization image processing on the grayscale image 303 to obtain a binarized image 304 (S103). In this binarization image processing, a binarization threshold may be determined based on the pixel values ​​of surrounding pixels.

[0048] Next, the automated transaction device 1 detects the contour of the external light reflection area (for example, the external light reflection area 306) shown in the OCR possible range (readable range) 305 of the binary image 304 (S104). Here, the OCR possible range 305 is predefined based on the performance (resolution, angle of view, range in focus, etc.) of the OCR camera unit 101. In addition, the detection of the contour of the external light reflection area is performed by detecting the closed contour of the object by labeling within the OCR possible range 305 of the binary image 304. As a labeling method, for example, an algorithm described in "Satoshi Suzuki and others. Topological structural analysis of digitized binary images by border following. Computer Vision, Graphics, and Image Processing, 30(1):32-46, 1985." (hereinafter referred to as "Document A") can be used. In S104, the contour of the external light reflection area represented within the OCR possible range 305 of the binary image 304 is detected, but the contour of the external light reflection area represented in the binary image 304 may be detected not only within the OCR possible range 305 but also within an area other than the OCR possible range 305.

[0049] Next, the automated transaction device 1 calculates an evaluation value based on the shortest distance between the contour of the corresponding area 307 and the contour of the external light reflection area (for example, the external light reflection area 306) at each position of the corresponding area 307 that can be arranged on the binary image 304 and corresponds to the medium placement area 201, and determines the display position of the display input unit 106 corresponding to the position of the corresponding area 307 where the evaluation value is maximum as the position of the medium placement area 201 to be displayed on the display input unit 106 (S105). Since the imaging range of the OCR camera unit 101 is determined, the display position of the corresponding display input unit 106 can be obtained from the position on the binary image 304 based on the imaging range. When S105 is completed, the automated transaction device 1 ends the display position determination process illustrated in FIG. 5.

[0050] Here, the process of S105 (hereinafter referred to as "decision process") will be described in more detail with reference to Fig. 6 and Fig. 7. Fig. 6 is a diagram for explaining parameters used in the decision process. Fig. 7 is a flowchart illustrating the flow of the decision process.

[0051] First, the parameters used in the determination process will be described with reference to FIG. 6. In the determination process, as shown in FIG. 6, the upper left vertex of the binarized image 304 is set as the origin (0,0), the width direction of the binarized image 304 is set as the X direction, and the height direction is set as the Y direction. The width of the binarized image 304 is set as w dots, and the height is set as h dots. The OCR possible range 305 is represented as O(0). Also, it is assumed that N (N is an integer equal to or greater than 1) contours of the external light reflection area have been detected, and the contours of the N external light reflection areas are represented as O(n) (n=1,2,...,N). FIG. 6 shows a case where two contours of the external light reflection area (O(1), O(2)) have been detected. Also, the corresponding area 307, which is an area that can be arranged on the binarized image 304 and corresponds to the medium placement area 201, is represented as A(x,y). (x, y) in A(x, y) represents the position of the upper left vertex of the corresponding area 307, and also represents the position of the corresponding area 307. Furthermore, a threshold value for determining whether or not the shortest distance between the contour of the corresponding area 307 and the contour of the external light reflection area is an allowable distance (corresponding to whether or not overlap between the contour of the medium and the external light reflection can be avoided) is represented as D. Furthermore, an evaluation value at each position of the corresponding area 307 that can be placed on the binarized image 304 is represented as R(x, y). Based on these assumptions, the determination process will be specifically described with reference to FIG. 7.

[0052] As illustrated in FIG. 7, when the automatic transaction apparatus 1 starts the determination process, first, it performs a loop process A from x=1 to w (x=1, 2, . . . , w) (S201 to S212).

[0053] In the loop process A for each x, the automated transaction apparatus 1 performs the loop process B for y=1 to h (y=1, 2, . . . , h) (S202 to S211).

[0054] In the loop process B for each y, the automated transaction device 1 sets R(x, y)=0 (S203), and determines whether A(x, y) is included in O(0) (S204).

[0055] If the determination result in S204 is NO, the automated transaction device 1 sets R(x, y)=0 (S205) and ends the loop process B for y at this time.

[0056] On the other hand, if the determination result in S204 is YES, the automated transaction device 1 performs loop processing C for n=1 to N (n=1, 2, . . . , N) (S206 to S210).

[0057] In the loop process C for each n, the automated transaction device 1 calculates the shortest distance between the contour of A(x,y) and O(n) as d (S207). In this calculation, the shortest distance when the contour of A(x,y) and O(n) overlap is set to 0 (d=0). In addition, when the contour of A(x,y) and O(n) are separated or when O(n) is included within the contour of A(x,y), d>0.

[0058] Next, the automated transaction device 1 judges whether d>0 (S208). If the judgment result of S208 is NO, the automated transaction device 1 ends the loop process C regardless of the value of n at this time, sets R(x, y)=0 (S205), and ends the loop process B for y at this time.

[0059] On the other hand, if the judgment result of S208 is YES, the automatic transaction device 1 assigns d to R(x, y) if R(x, y)=0, and assigns the smaller of d and R(x, y) to R(x, y) if R(x, y)=0 is not true (S209).

[0060] In this manner, when the processing of S201 to S212 is completed, the automated transaction device 1 acquires as Rmax the maximum value of R(x, y) obtained in the processing of S201 to S212, and acquires as Amax the position of A(x, y) when the maximum value of R(x, y) was obtained (S213).

[0061] Next, the automatic transaction device 1 judges whether or not Rmax>D (S214). If the judgment result of S214 is YES, the automatic transaction device 1 determines the display position of the display input unit 106 corresponding to Amax as the position of the medium placement area 201 to be displayed on the display input unit 106 (S215).

[0062] On the other hand, if the determination result in S214 is NO, the automated transaction apparatus 1 determines that it is impossible to avoid overlap between the outline of the medium and the reflection of external light (S216). In this case, the automated transaction apparatus 1 may notify the bank clerk of the determination result. The notification method may be, for example, displaying the determination result on the display input unit 106, or notifying the determination result to a bank clerk terminal. Such a notification allows the bank clerk to review the installation location of the automated transaction apparatus 1, etc.

[0063] When S215 or S216 ends, the automated transaction device 1 ends the determination process illustrated in FIG.

[0064] In this manner, by displaying the medium placement area 201 at the position determined in S215, it is possible to prevent the outline of the medium placed in the medium placement area 201 from overlapping with external light reflection. Here, an example of medium placement after the display position determination process will be described in comparison with a conventional example of medium placement, using Figs. 8 and 9. For ease of explanation, the display surface of the display input unit 106 is shown in black in Figs. 8 and 9. Also, illustrations of characters, lines, etc. printed on the medium are omitted.

[0065] 8 is a diagram showing a medium placement example after a display position determination process in the case where there is an external light reflection at one location on the display surface of the display input unit, in comparison with a conventional medium placement example. As shown in FIG. 8, when there is an external light reflection 311 at one location on the display surface 106c of the display input unit 106, in the conventional case, the display position of the medium placement area 201 was fixed, so that when the medium reading screen 312 including the medium placement area 201 was displayed on the display input unit 106 and the medium 313 was placed on the medium placement area 201, the outline of the medium 313 and the external light reflection 311 may overlap. In this case, the outline of the medium 313 cannot be detected, so the medium 313 cannot be read. In contrast to this, in this embodiment, the display position determination process determines the display position of the medium placement area 201 to be within the OCR possible range 305 and to a position where the outline of the placed medium 313 does not overlap with the external light reflection 311, so that when the medium reading screen 312 including the medium placement area 201 is displayed on the display input unit 106 and the medium 313 is placed in the medium placement area 201, the outline of the medium 313 does not overlap with the external light reflection 311. Therefore, the outline of the medium 313 can be detected, and the medium 313 can be read.

[0066] 9 is a diagram showing a medium placement example after a display position determination process in the case where external light reflection is present at multiple locations on the display surface of the display input unit, in comparison with a conventional medium placement example. As shown in FIG. 9, when external light reflection 321 (321a, 321b) is present at multiple locations (two locations in this example) on the display surface 106c of the display input unit 106, the display position of the medium placement area 201 was fixed in the past, so when the medium reading screen 312 including the medium placement area 201 was displayed on the display input unit 106 and the medium 313 was placed on the medium placement area 201, the outline of the medium 313 and the external light reflection 321 may overlap. In this case, the outline of the medium 313 cannot be detected, and therefore the medium 313 cannot be read. In contrast, in this embodiment, the display position determination process determines the display position of the medium placement area 201 to be within the OCR possible range 305 and to be a position where the contour of the placed medium 313 does not overlap with the external light reflection 321. Therefore, when the medium reading screen 312 including the medium placement area 201 is displayed on the display input unit 106 and the medium 313 is placed in the medium placement area 201, the contour of the medium 313 does not overlap with the external light reflection 321. In the example of FIG. 9, the medium placement area 201 is displayed so that one of the two external light reflections, external light reflection 321a, is contained within the medium placement area 201 and the other external light reflection area 321b is located at a distant position outside the medium placement area 201. Therefore, the contour of the medium 313 placed in the medium placement area 201 can be detected, and the medium 313 can be read.

[0067] Here, the medium reading process performed by the automated transaction device 1 with the medium placed in the medium placement area 201 displayed on the display input unit 106 after the above-mentioned display position determination process will be described with reference to Fig. 10. This medium reading process is performed by the processor 131 executing the above-mentioned program. For ease of explanation, characters, lines, etc. printed on the medium shown in the image are omitted in Fig. 10. Also, the detected contour and polygonal approximation contour are shown in schematic form.

[0068] Fig. 10 is a flow chart illustrating the flow of the medium reading process. As illustrated in Fig. 10, when the automatic transaction device 1 starts the medium reading process, it first captures an image 331 by using the OCR camera unit 101 (S301). Here, although external light such as a ceiling light is reflected on the display surface of the display input unit 106, the outline of the medium placed in the medium placement area 201 displayed at the position determined by the above-mentioned display position determination process does not overlap with the external light reflection, so the outline of the medium 332 displayed in the image 331 does not overlap with the external light reflection (for example, the external light reflection 333).

[0069] Next, the automated transaction device 1 performs image processing for grayscale conversion on the image 331 to obtain a grayscale image 334 (S302).

[0070] Next, the automated transaction device 1 performs binarization image processing on the grayscale image 334 to obtain a binarized image 335 (S303). In this binarization image processing, a binarization threshold may be determined based on the pixel values ​​of surrounding pixels.

[0071] Next, the automated transaction device 1 detects contours in the binarized image 335 (S304). This contour detection is performed by detecting closed contours of objects through labeling. As a labeling method, for example, the algorithm described in the above-mentioned document A can be used. Through the process of S304, a contour 336a of the medium 336 shown in the binarized image 335 and a contour of an external light reflection area (for example, a contour 337a of an external light reflection area 337) are detected.

[0072] Next, the automated transaction device 1 performs polygon approximation to approximate the contour detected in S304 to a polygon (S305). As a method of polygon approximation, the Douglas-Peucker algorithm or the like can be used. By the process of S305, a contour 336b obtained by approximating the contour 336a to a polygon, a contour 337b obtained by approximating the contour 337a to a polygon, or the like can be obtained.

[0073] Next, the automated transaction device 1 identifies the contour of the medium 336 from the contours approximated by the polygon in S305 (S306). This identification can be performed based on the shape and size of the medium to be read that are specified in advance. Here, the contour 336b is identified as the contour of the medium 336.

[0074] Next, the automated transaction device 1 performs image processing for trapezoidal conversion on the binarized image 335 so that the shape (trapezoidal shape) of the contour 336b of the medium 336 identified in S306 becomes similar to the shape (rectangular shape) of the actual medium (S307).

[0075] Next, the automated transaction device 1 cuts out a partial image 339 of the character region to be read in the region of the medium 338 represented in the binary image that has been trapezoidally converted in S307 (S308). The cutting out of the partial image 339 at this time can be performed based on a predefined layout (format) of the medium to be read.

[0076] Next, the automated transaction device 1 performs character recognition on the partial image 339 of the reading target character area cut out in S308 (S309), and ends the medium reading process illustrated in FIG.

[0077] According to the automatic transaction device 1 described above, when the medium to be read is placed on the display surface of the display input unit 106 and reading is performed, even if external light from a ceiling light or the like is reflected in white on the display surface, it is possible to prevent the outline of the medium from overlapping with the reflection of the external light, making it possible to read the medium.

[0078] Note that a message, illustration, or the like may be displayed in the medium placement area 201 displayed on the display input unit 106. In this case, the customer may be prompted to specify the orientation of the medium to be placed in the medium placement area 201 by the message, illustration, or the like.

[0079] Although the embodiment of the present invention has been described above, the present invention is not limited to the above-described embodiment, and various improvements and modifications can be made without departing from the gist of the present invention. [Explanation of symbols]

[0080] 1. Automatic transaction device 10 Display section 20 Imaging unit 30 Detection unit 40 Decision Section 101 OCR camera unit 101a Imaging range 102 Passbook insertion and ejection section 103 Card insertion and ejection section 104 Coin deposit and withdrawal section 105 Banknote deposit and withdrawal section 106 Display Input Unit 106a Display device 106b Touch Panel 106c display surface 121 Control Unit 122 Card Processing Unit 123 Passbook Processing Unit 124 Coin Handling Unit 125 Bill Processing Unit 126 Power supply unit 131 processors 132 RAM 133 Communication Interface 134 Graphics Processing Unit 135 External storage device 136 Input / Output Interface 137 Bus 138 FPGA 201 Media placement area 301 images 302 External light reflection 303 Grayscale Images 304 Binarized Images 305 OCR possible range 306 External light reflection area 307 Coverage Area 311 External light reflection 312 Media reading screen 313 Medium 321, 321a, 321b External light reflection 331 images 332 Medium 333 External light reflection 334 Grayscale Images 335 Binarized Images 336 Medium 336a, 336b Contour 337 External light reflection area 337a, 337b Contour 338 Medium 339 Partial Image

Claims

1. a display unit that displays a medium placement area that specifies an area in which a medium to be read is placed, the display unit being imaged by an image capture unit that is used to read the medium to be read; Detecting an outline of an external light reflection area shown in an image captured by the imaging unit; determining a position of the medium placement area to be displayed on the display unit based on a position of a contour of the external light reflection area in the image; causing a processor to execute the process; The direction of the vertical component of the imaging direction of the imaging unit is the same as the direction of the vertical component of the incident direction of the reflected external light. A program characterized by:

2. In the detection, an outline of an area where external light is reflected and displayed within a readable range of the image is detected.

2. The program according to claim 1 .

3. In the determination, an evaluation value is calculated based on the shortest distance between the contour of the corresponding area and the contour of the external light reflection area at each position of a corresponding area that can be arranged on the image and corresponds to the medium placement area, and the display position of the display unit corresponding to the position of the corresponding area where the evaluation value is maximum is determined as the position of the medium placement area to be displayed on the display unit.

3. The program according to claim 1 or 2.

4. When the outline of the corresponding area is not included within the readable range of the image, the evaluation value is set to 0.

4. The program according to claim 3.

5. The shortest distance when the contour of the corresponding area and the contour of the external light reflection area overlap is set to 0.

5. The program according to claim 4.

6. The evaluation value when the external light reflection region in the image has one contour is set to the shortest distance between the contour of the corresponding region and the contour of the external light reflection region.

6. The program according to claim 5.

7. When the image has a plurality of contours of the external light reflection region and at least one of the shortest distances between the contour of the corresponding region and each of the contours of the plurality of external light reflection regions is 0, the evaluation value is set to 0.

6. The program according to claim 5.

8. When the image has a plurality of contours of the external light reflection region and all of the shortest distances between the contour of the corresponding region and each of the contours of the plurality of external light reflection regions are greater than 0, the evaluation value is set to a minimum value of the shortest distances.

6. The program according to claim 5.

9. a display unit that displays a medium placement area that specifies an area in which a medium to be read is placed, the display unit being imaged by an image capture unit that is used to read the medium to be read; Detecting an outline of an external light reflection area shown in an image captured by the imaging unit; determining a position of the medium placement area to be displayed on the display unit based on a position of a contour of the external light reflection area in the image; This is done by the automated transaction device, The direction of the vertical component of the imaging direction of the imaging unit is the same as the direction of the vertical component of the incident direction of the reflected external light. A display position determining method comprising:

10. a display unit that displays a medium placement area for designating an area in which a medium to be read is placed; An imaging unit used to read the medium to be read; a detection unit that detects an outline of an external light reflection area displayed in an image captured by the imaging unit of the display unit; a determination unit that determines a position of the medium placement area to be displayed on the display unit based on a position of a contour of the external light reflection area in the image; Equipped with The direction of the vertical component of the imaging direction of the imaging unit is the same as the direction of the vertical component of the incident direction of the reflected external light.

1. An automatic transaction device comprising:

Images