Automated trading device, shooting method, and shooting program

Abstract

To facilitate barcode reading by ATMs. [Solution] The automated trading device 10 includes a camera 11, a guide 12, a detection unit 13, and a processing unit 14. The camera 11 is positioned to photograph the user and captures a camera image 1. The guide 12 is positioned around the camera 11 and protrudes in the direction the camera 11 is facing. The detection unit 13 detects a medium 2 approaching the tip of the guide 12. The processing unit 14 determines an area within the camera image 1 based on whether the detection unit 13 has detected a medium 2. The processing unit 14 sets the camera 11 based on the brightness of the area.

Description

Technical Field

[0005]

[0001] The present invention relates to an automatic transaction device, a photographing method, and a photographing program.

Background Art

[0002] In an automated teller machine (ATM), a transaction may be executed by reading a barcode such as a QR (Quick Response) code (registered trademark). For example, an ATM may read an account number from a QR code instead of a cash card or the like.

[0003] As technologies related to ATMs, for example, an automatic transaction device has been proposed that enables customer photographing and code reading such as QR codes using a customer photographing camera that does not require securing space and suppresses the impact on the number of components and product price. Further, for example, a customer transaction system that aims to eliminate paper slips in a store such as a financial institution has been proposed. Further, for example, a personal identification device that provides a personal identification device with low power consumption has been proposed.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Patent Document 2

Patent Document 3

Summary of the Invention

Problems to be Solved by the Invention

[0005] One possible method for ATMs to read barcodes is to use customer cameras, which are installed to photograph customers operating the ATM, to capture the barcode. However, customer cameras are often set up to capture the entire scene, and may not be able to capture a barcode in a way that allows it to be read.

[0006] One aspect of this project is that it aims to facilitate the reading of barcodes by ATMs. [Means for solving the problem]

[0007] One proposal provides an automated trading device comprising a camera, a guide, a detection unit, and a processing unit. The camera is positioned to photograph users and captures camera images. The guide is positioned around the camera and protrudes in the direction the camera is facing. The detection unit detects media approaching the tip of the guide. The processing unit determines an area within the camera image based on whether the detection unit has detected media, and sets the camera based on the brightness of the area. [Effects of the Invention]

[0008] According to one embodiment, barcode reading by an ATM can be facilitated. [Brief explanation of the drawing]

[0009] [Figure 1] This figure shows an example of an automated trading device according to the first embodiment. [Figure 2] This figure shows an example of an information processing system according to the second embodiment. [Figure 3] This diagram shows an example of an ATM hardware configuration. [Figure 4] This figure shows an example of what an ATM looks like. [Figure 5] This figure shows an example of a camera and guide. [Figure 6] This is a diagram showing examples of ATM functions. [Figure 7] This is a diagram showing an example of a screen when the screen is set to prevent unauthorized viewing. [Figure 8] FIG. (1) showing an example of a transaction screen using a QR code. [Figure 9] FIG. (2) showing an example of a transaction screen using a QR code. [Figure 10] FIG. (3) showing an example of a transaction screen using a QR code. [Figure 11] FIG. (4) showing an example of a transaction screen using a QR code. [Figure 12] FIG. (5) showing an example of a transaction screen using a QR code. [Figure 13] FIG. showing an example of a camera setting method. [Figure 14] FIG. is a flowchart showing an example of the procedure of camera control processing. [Figure 15] FIG. is a flowchart showing an example of the procedure of peeping prevention processing. [Figure 16] FIG. is a flowchart showing an example of the procedure of code transaction processing. [Figure 17] FIG. showing an example of brightness adjustment of a camera image.

MODE FOR CARRYING OUT THE INVENTION

[0010] Hereinafter, the present embodiment will be described with reference to the drawings. Note that the embodiments can be implemented in combination of a plurality of embodiments within a non - contradictory range. 〔First Embodiment〕 First, the first embodiment will be described.

[0011] FIG. 1 is a diagram showing an example of an automatic transaction device according to the first embodiment. The first embodiment reads a barcode by a camera 11 for customer photography of the automatic transaction device 10.

[0012] The automated transaction device 10 is a device that executes transactions using a user's bank account according to the user's instructions. The automated transaction device 10 is, for example, an ATM installed in a bank. The automated transaction device 10 has a camera 11, a guide 12, a detection unit 13, and a processing unit 14.

[0013] Camera 11 is installed so as to be able to photograph users of the automated trading device 10. For example, camera 11 is installed on the automated trading device 10 so that its lens is pointed towards the position where a user operating the automated trading device 10 is standing. Camera 11 takes a camera image 1. Camera image 1 is an image of the scene in the direction that camera 11 is pointing its lens. Note that camera image 1 may be a video.

[0014] Guide 12 is a component that assists in bringing the medium 2 closer to the camera 11. The medium 2 is a barcode such as a QR code. For example, the medium 2 is a card with a barcode printed on it, or a smartphone, tablet, or mobile phone displaying a barcode. Guide 12 is installed around the camera 11 and protrudes in the direction the camera 11 is facing. For example, guide 12 is a columnar component provided on the left and right sides of the camera 11, with its tip becoming thinner.

[0015] Furthermore, the guide 12 may have a different shape that protrudes in the direction that the camera 11 is facing. Also, the guide 12 may be provided above and below the camera 11 instead of to the left and right. In addition, there may be one guide 12 or three or more guides 12. For example, the guide 12 may be provided on all four sides of the camera 11.

[0016] The guide 12 protrudes so that the medium 2 in contact with the tip of the guide 12 is separated from the camera 11 by a distance greater than the shortest distance at which the camera 11 can focus. The guide 12 is also formed from a light-transmitting material. For example, the guide 12 is made from a material such as acrylic resin.

[0017] The detection unit 13 detects the medium 2 approaching the tip of the guide 12. For example, the detection unit 13 is a switch or non-contact sensor installed at the tip of the guide 12. The processing unit 14 controls the automated trading device 10 and can perform the required processing. The processing unit 14 is, for example, a processor or arithmetic circuit of the automated trading device 10.

[0018] The processing unit 14 determines a region within the camera image 1 based on whether or not the detection unit 13 has detected the medium 2, and sets the camera 11 based on the brightness of the region. For example, if the detection unit 13 does not detect the medium 2 (no detection), the processing unit 14 determines a first region 1a within the camera image 1. The first region 1a is, for example, the entire area of ​​the camera image 1. Then, the processing unit 14 sets the camera 11 so that the brightness of the first region 1a falls within a first range.

[0019] For example, the processing unit 14 calculates the average value of the RGB (Red, Green, Blue) values ​​for each pixel in the first region 1a as the degree of brightness. The processing unit 14 then calculates the average of the calculated degrees of brightness for the entire first region 1a. The processing unit 14 then adjusts the exposure of the camera 11 so that the overall average of the degrees of brightness approaches the first range. For example, the processing unit 14 increases or decreases the shutter speed and gain.

[0020] Furthermore, when the detection unit 13 detects the medium 2, the processing unit 14 determines a second region 1b that is narrower than the first region 1a in the camera image 1. For example, the second region 1b is a predetermined area from the center of the camera image 1. Alternatively, for example, the second region 1b is the area in the camera image 1 where a barcode is detected. The processing unit 14 sets the camera 11 so that the brightness of the second region 1b falls within the second range. The second range may be the same as or different from the first range.

[0021] For example, the processing unit 14 calculates the average value of the RGB values ​​for each pixel in the second region 1b as the degree of brightness. The processing unit 14 then calculates the average of the calculated degrees of brightness for the entire second region 1b. The processing unit 14 then increases or decreases the shutter speed and gain so that the overall average of the degrees of brightness approaches the second range.

[0022] According to the first embodiment, the camera 11 of the automated trading device 10 is positioned to photograph the user and captures a camera image 1. The guide 12 of the automated trading device 10 is positioned around the camera 11 and protrudes in the direction the camera 11 is facing. The detection unit 13 of the automated trading device 10 detects a medium 2 approaching the tip of the guide 12. The processing unit 14 of the automated trading device 10 determines an area within the camera image 1 based on whether the detection unit 13 has detected the medium 2, and sets the camera 11 based on the brightness of the area.

[0023] Here, when camera 11 photographs the scene of a user operating the automated transaction device 10, if the entire camera image 1 is bright, it is easier to see the user operating the automated transaction device 10. On the other hand, when using camera 11 to read a barcode, if the part of camera image 1 showing the barcode is bright, the reading process is more likely to succeed. The automated transaction device 10 can determine whether to photograph the scenery or the barcode depending on whether the detection unit 13 has detected the medium 2, and can set the appropriate settings for the subject to be photographed. This makes it easier for the automated transaction device 10 to read barcodes at an ATM.

[0024] Furthermore, if the detection unit 13 does not detect the medium 2, the processing unit 14 determines a first region 1a in the camera image 1 and sets the camera 11 so that the brightness of the first region 1a falls within a first range. If the detection unit 13 detects the medium 2, the processing unit 14 determines a second region 1b in the camera image 1 that is narrower than the first region 1a and sets the camera 11 so that the brightness of the second region 1b falls within a second range. This allows the automated trading device 10 to appropriately set the camera 11 depending on whether it is photographing a landscape or a barcode.

[0025] Furthermore, the guide 12 protrudes so that the medium 2 in contact with the tip of the guide 12 is further away from the camera 11 than the shortest distance at which the camera 11 can focus. This allows the automated trading device 10 to focus on and photograph the barcode displayed on the medium 2.

[0026] Furthermore, the guide 12 is made of a light-transmitting material. This allows the automated trading device 10 to prevent the camera image 1 from being darkened by the guide 12. [Second Embodiment] Next, a second embodiment will be described. In the second embodiment, the barcode is read using the ATM's customer camera.

[0027] Figure 2 shows an example of an information processing system according to the second embodiment. The information processing system according to the second embodiment includes an ATM 100 and a host server 200. The ATM 100 receives operations from users and, based on the received operations, executes transactions using the user's bank account, such as deposits, withdrawals, and transfers.

[0028] ATM100 is equipped with a customer camera to film users. ATM100 uses the customer camera to film and record users operating the ATM, as well as what is behind them. For example, ATM100 displays the video footage captured by the customer camera on the screen when a PIN is entered, preventing third parties from peeking at the user's operation and illegally obtaining their PIN.

[0029] Furthermore, the ATM 100 uses a customer camera to photograph barcodes such as QR codes and executes transactions based on the information read from the photographed barcodes. For example, the ATM 100 reads a QR code displayed on a mobile device such as a smartphone held over the customer camera and executes a transaction targeting the account number indicated by the read QR code. Alternatively, the ATM 100 can perform transactions using a points account indicated by a barcode on a points card, or charge a QR payment account indicated by a QR code. The information processing system of the second embodiment may have multiple ATMs similar to the ATM 100.

[0030] The ATM 100 is connected to the host server 200 via the network 20. The network 20 may be a wired network or a wireless network. The network 20 may also be a dedicated line. The host server 200 is a server computer for managing a database that stores information such as the user's bank account. The host server 200 retrieves transaction details from the ATM 100 and updates the information stored in the database based on the retrieved transaction details.

[0031] Figure 3 shows an example of the hardware configuration of an ATM. The ATM 100 is controlled as a whole by a processor 101. The processor 101 is connected to memory 102 and several peripheral devices via a bus 108. The processor 101 may be a multiprocessor. The processor 101 may be, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or a DSP (Digital Signal Processor). At least some of the functions that the processor 101 implements by executing a program may be implemented by electronic circuits such as an ASIC (Application Specific Integrated Circuit) or a PLD (Programmable Logic Device).

[0032] Memory 102 is used as the main memory of the ATM 100. Memory 102 temporarily stores at least a portion of the OS (Operating System) program and application programs that are to be executed by the processor 101. Memory 102 also stores various data used for processing by the processor 101. As memory 102, a volatile semiconductor memory device such as RAM (Random Access Memory) is used.

[0033] Peripheral devices connected to bus 108 include a storage device 103, a network interface 104, a display processing unit 105, a touch panel processing unit 106, and an I / O (Input / Output) control unit 107.

[0034] The storage device 103 electrically or magnetically writes and reads data from its built-in recording medium. The storage device 103 is used as an auxiliary storage device for the ATM 100. Various data, including OS programs, application programs, and transaction history information, are stored in the storage device 103. For example, an HDD (Hard Disk Drive) or an SSD (Solid State Drive) can be used as the storage device 103.

[0035] The network interface 104 is connected to the network 20. The network interface 104 sends and receives data to and from the host server 200 via the network 20.

[0036] A display 111 is connected to the display processing unit 105. The display processing unit 105 displays various information, such as operation instructions, on the screen of the display 111 according to instructions from the processor 101. The display 111 can be an organic EL (Electro Luminescence) display device or a liquid crystal display device.

[0037] A touch panel 112 is connected to the touch panel processing unit 106. The touch panel 112 is positioned, for example, in front of the display 111. The touch panel processing unit 106 detects the position on the screen where the operator's finger touches or approaches the touch panel 112 and notifies the processor 101.

[0038] The I / O control unit 107 is connected to a card processing unit 113, a receipt printing unit 114, a cash processing unit 115, a camera 116, a numeric keypad 117, a multi-scan tray 118, and a switch 119. The I / O control unit 107 notifies each connected unit of instructions from the processor 101 according to the instructions from the processor 101. The I / O control unit 107 also notifies the processor 101 of information acquired from each unit via the bus 108.

[0039] The card processing unit 113 controls the insertion and ejection of cash cards. The card processing unit 113 reads the information (account number, etc.) recorded on the magnetic strip attached to the inserted cash card. The card processing unit 113 also ejects the cash card at the end of the transaction. The receipt printing unit 114 prints text and images on paper. The receipt printing unit 114 ejects a receipt with the transaction details printed on it at the end of the transaction.

[0040] The cash handling unit 115 controls the deposit and withdrawal of cash (coins and banknotes) according to the instructions of the processor 101. The cash handling unit 115 reads the type of cash deposited from the cash entry / exit and outputs it to the processor 101. The cash handling unit 115 also withdraws the type of cash notified by the processor 101 from the cash entry / exit.

[0041] Camera 116 is a customer camera used to photograph users. Camera 116 generates still image or video data of the scene pointed at the camera's lens according to instructions from processor 101 and stores it in memory 102.

[0042] The numeric keypad 117 is a keyboard for entering numbers. When a key is pressed on the numeric keypad 117, it notifies the processor 101 of the pressed key. The multi-scan tray 118 is a cavern-shaped tray that reads information from IC (Integrated Circuit) cards and mobile terminals placed inside. The multi-scan tray 118 uses an internal camera to photograph the display screen of the IC card or mobile terminal and transmits it to the processor 101. In addition, the multi-scan tray 118 uses an internal NFC (Near Field Communication) unit to read information from the IC chip of the IC card or mobile terminal and transmit it to the processor 101.

[0043] Switch 119 is a switch that switches between an ON state and an OFF state depending on whether the button portion is pressed or not. Switch 119 is in the OFF state when the button portion is not pressed. Switch 119 is in the ON state when the button portion is pressed. Switch 119 notifies the processor 101 whether it is in the ON state or the OFF state.

[0044] Furthermore, the I / O control unit 107 can read data from or write data to the portable recording medium 31. The portable recording medium 31 is, for example, a recording medium such as a DVD (Digital Versatile Disc) or a CD (Compact Disc). The portable recording medium 31 can store transaction history information, etc.

[0045] Furthermore, the automated transaction device 10 shown in the first embodiment can also be realized with the same hardware as the ATM 100 shown in Figure 3. Also, the processor 101 is an example of the processing unit 14 shown in the first embodiment. Also, the switch 119 is an example of the detection unit 13 shown in the first embodiment.

[0046] The ATM 100 implements the processing functions of the second embodiment by executing a program recorded on a computer-readable recording medium, for example. The program describing the processing to be executed by the ATM 100 can be recorded on various recording media. For example, the program to be executed by the ATM 100 can be stored in the storage device 103. The processor 101 loads at least a portion of the program in the storage device 103 into the memory 102 and executes the program. Alternatively, the program to be executed by the ATM 100 can be recorded on the portable recording medium 31. The program stored on the portable recording medium 31 becomes executable after being installed in the storage device 103, for example, under control from the processor 101. The processor 101 can also directly read and execute the program from the portable recording medium 31.

[0047] Next, I will describe the appearance of the ATM100. Figure 4 shows an example of the appearance of an ATM. ATM 100 has a card / receipt slot 21, a cash slot 22, a guide 40, a display 111, a touch panel 112, a camera 116, a numeric keypad 117, and a multi-scan tray 118 on the side facing the user operating the ATM 100.

[0048] The card / receipt slot 21 is used for inserting and ejecting cash cards and ejecting receipts. The card processing unit 113 reads the account number from the cash card inserted through the card / receipt slot 21 at the start of a transaction. The card processing unit 113 also ejects the cash card from the card / receipt slot 21 at the end of a transaction. The receipt printing unit 114 prints the transaction details on a receipt at the end of a transaction and ejects the printed receipt from the card / receipt slot 21.

[0049] The cash entry / exit 22 is an entry / exit used for users to deposit cash and for the cash processing unit 115 to release cash. The cash processing unit 115 reads the cash deposited into the cash entry / exit 22. The cash processing unit 115 also releases the cash to be withdrawn from the cash entry / exit 22.

[0050] Display 111 displays the operation screen of ATM 100. Touch panel 112 is positioned in front of display 111. Touch panel 112 detects the user's touch operation on the screen displayed by display 111. Thus, display 111 and touch panel 112 provide guidance on transaction operations by ATM 100 and receive instructions from the user.

[0051] Camera 116 is installed so that its lens faces the front of the surface on which it is placed. Camera 116 photographs the user operating the ATM 100. Guides 40 are placed to the left and right of camera 116. Guides 40 are components that assist in bringing mobile devices such as smartphones and tablet terminals, or cards such as point cards, closer to camera 116.

[0052] The numeric keypad 117 accepts key presses by the user. The numeric keypad 117 transmits the key number indicating the pressed key to the processor 101. The multi-scan tray 118 is formed in a cavernous shape and accepts the placement of IC cards, mobile terminals, etc. by the user. The multi-scan tray 118 reads information from IC cards, mobile terminals, etc.

[0053] Transactions are executed using this ATM 100. The ATM 100 can also capture barcodes using the camera 116 for photographing the user. This allows the ATM 100 to acquire information from media that do not fit inside the multi-scan tray 118.

[0054] In this case, camera 116 is often configured with settings suitable for photographing landscapes, such as setting the camera to brighten the entire image. Furthermore, camera 116 may be a fixed-focus camera without the autofocus function, which is unnecessary for landscape photography. When camera 116 photographs a barcode with settings suitable for landscape photography, the brightness of the barcode area may be insufficient, preventing the barcode from being captured in a way that allows the information to be read during the scanning process.

[0055] Therefore, in the second embodiment, the ATM 100 switches between a setting for photographing the scenery being operated by the user (scenery shooting mode) and a setting for photographing a barcode such as a QR code (code shooting mode) depending on whether or not the medium is in contact with the guide 40. Next, the camera 116 and the guide 40 will be described.

[0056] Figure 5 shows an example of a camera and guide. The guide 40 is a columnar member provided on the left and right sides of the camera 116, with its tip becoming thinner. The guide 40 protrudes in the direction that the camera 116 is facing. The guide 40 holds the medium pressed against its tip in a position where it is facing the camera 116. For example, when a user holds a mobile device up to the camera 116, they point the screen displaying the barcode towards the camera 116 and press the mobile device against the tip of the guide 40. The guide 40 can reduce the burden on the user when holding a medium up to the camera 116.

[0057] The guide 40 protrudes so that the medium in contact with the tip of the guide 40 is further away from the camera 116 than the shortest distance at which the camera 116 can focus. This prevents the medium from getting too close to the camera 116, allowing the camera 116 to focus and photograph the barcode. The guide 40 is also made of a light-transmitting material such as acrylic resin. This prevents the image captured by the camera 116 from becoming dark due to insufficient external light.

[0058] A switch 119 is installed at the tip of the guide 40. The button portion of the switch 119 is pressed when an object is pressed against the tip of the guide 40. Therefore, the ATM 100 can detect when a medium is held up to the camera 116 when the switch 119 changes from the OFF state to the ON state. When the switch 119 is OFF, the ATM 100 causes the camera 116 to take an image in landscape shooting mode. When the switch 119 is ON, the ATM 100 causes the camera 116 to take an image in code shooting mode. Next, the functions of the ATM 100 will be explained in detail.

[0059] Figure 6 is a block diagram illustrating an example of ATM functionality. The ATM 100 includes a storage unit 120, an image capture control unit 130, and a transaction control unit 140. The storage unit 120 is implemented using the storage area of ​​memory 102 or storage device 103. The image capture control unit 130 and the transaction control unit 140 are implemented by the processor 101 executing a program stored in memory 102. The storage unit 120 stores camera images 121-1, 121-2, ... Camera images 121-1, 121-2, ... are images captured by camera 116.

[0060] The shooting control unit 130 controls the camera 116 to capture camera images. The shooting control unit 130 causes the camera 116 to capture camera images and saves them as camera images 121-1, 121-2, ... The shooting control unit 130 checks the state of switch 119. If switch 119 is OFF, the shooting control unit 130 sets it to landscape shooting mode, and if switch 119 is ON, it sets it to code shooting mode.

[0061] In landscape shooting mode, the shooting control unit 130 increases or decreases the shutter speed and gain of the camera 116 so that the brightness of the entire captured camera image approaches a preset reference range. In code shooting mode, the shooting control unit 130 increases or decreases the shutter speed and gain of the camera 116 so that the brightness of a predetermined range near the center of the captured camera image approaches a preset reference range.

[0062] The transaction control unit 140 controls the execution of transactions using the ATM 100. For example, while the user is entering their PIN, the transaction control unit 140 performs an anti-peeping process using camera images 121-1, 121-2, ... In the anti-peeping process, the transaction control unit 140 acquires the current camera image from among camera images 121-1, 121-2, ... Then, the transaction control unit 140 displays the acquired camera image on the screen.

[0063] For example, the transaction control unit 140 executes a transaction using a QR code. In a transaction using a QR code, when switch 119 is turned ON, the transaction control unit 140 acquires the current camera image from among camera images 121-1, 121-2, ... The transaction control unit 140 detects the QR code from the acquired camera image and reads the account number from the detected QR code. Then, the transaction control unit 140 executes a transaction for the account corresponding to the read account number.

[0064] Note that the lines connecting each element shown in Figure 6 represent only a portion of the communication path, and other communication paths can also be set. Next, we will explain an example screen of processing using camera images 121-1, 121-2, ...

[0065] Figure 7 shows an example of a screen when preventing unauthorized viewing. When the ATM 100 accepts a PIN from a user, it displays screen 51 on the display 111. Screen 51 is a PIN input screen that displays an image of the user's background to prevent unauthorized viewing.

[0066] Screen 51 includes a message prompting the user to enter their PIN, such as "Please enter your PIN." Screen 51 also includes a field for entering the PIN. Screen 51 also includes a numeric keypad. ATM 100 accepts the PIN input in response to touch operations on the numeric keypad on screen 51.

[0067] Furthermore, the current camera image from among camera images 121-1, 121-2, ... is displayed as video on screen 51. By checking the video displayed on screen 51, the user can enter their PIN while confirming that there is no one looking over the screen 111 from behind. At this point, since the medium is not held over the camera 116 while the PIN is being entered, switch 119 is in the OFF state. As a result, the ATM 100 displays the camera image captured by camera 116 in landscape shooting mode on screen 51. Therefore, the ATM 100 can allow the user to check a video that makes it easy to see the situation behind them.

[0068] Furthermore, the ATM 100 stores the captured camera images as camera images 121-1, 121-2, ... in the memory unit 120. This allows the ATM 100 to provide images of the moment the peeping occurred if it is later discovered that a third party illegally obtained the PIN by peeking over the user's shoulder. Since the camera captures images in landscape mode while the user is operating the ATM, the ATM 100 can provide images that make it easy to see the face of the third party who peeked. In this way, the ATM 100 can enhance its security by capturing images of the scenery in landscape mode while the user is operating the ATM.

[0069] Figure 8 is an example (part 1) of a transaction screen using a QR code. The ATM 100 displays screen 61 on display 111 while waiting for an operation from the user. Screen 61 is the initial screen of the ATM 100.

[0070] Screen 61 includes messages prompting the insertion of a cash card, such as "Welcome" and "Please insert your card." Screen 61 also includes buttons for "Smartphone Transaction," "Electronic Money Charge," "Point Linkage," and "Account Opening." These buttons are used to select the transaction or procedure that ATM 100 will perform. When ATM 100 accepts the insertion of a cash card through the card / receipt slot 21 while screen 61 is displayed, it executes a transaction for the account corresponding to the account number read from the cash card. Furthermore, when the "Smartphone Transaction," "Electronic Money Charge," "Point Linkage," or "Account Opening" button is pressed while screen 61 is displayed, ATM 100 executes the process corresponding to the pressed button.

[0071] Here, we assume that the "Smartphone Transaction" button is pressed on screen 61. The ATM 100 then initiates a transaction using the QR code displayed on the smartphone and displays screen 62 on display 111.

[0072] Screen 62 is a screen for selecting the type of transaction using a QR code displayed on a smartphone. Screen 62 includes a "Smartphone Transaction" display indicating that a transaction using a QR code displayed on a smartphone will be executed. Screen 62 also includes a message prompting the user to select a transaction type, such as "Please select your desired transaction." Screen 62 also includes a "Cancel" button. The "Cancel" button is used to cancel a transaction. When the "Cancel" button is pressed, ATM 100 cancels the transaction and displays screen 61 on display 111.

[0073] Screen 62 also includes "Withdrawal," "Deposit," "Transfer," and "Balance Inquiry" buttons. These buttons are used to select the type of transaction. When the ATM 100 displays screen 62 and the "Withdrawal," "Deposit," "Transfer," or "Balance Inquiry" button is pressed, the ATM 100 initiates a transaction of the type corresponding to the pressed button.

[0074] Figure 9 is a diagram (part 2) showing an example of a transaction screen using a QR code. When the "Deposit" button is pressed while screen 62 is displayed on ATM 100, the ATM 100 starts the deposit transaction and displays screen 63 on display 111.

[0075] Screen 63 is a screen that shows the user's actions when making a deposit transaction using a QR code displayed on a smartphone. Screen 63 includes a "Cardless Deposit" display indicating that a deposit transaction using a QR code displayed on a smartphone (i.e., a deposit transaction without using a cash card) is to be performed. Screen 63 also includes a message prompting the user to hold the QR code displayed on the smartphone up to the camera 116, such as "Please let me scan the QR code." Screen 63 also includes a "Cancel" button.

[0076] Furthermore, screen 63 includes a message prompting the user to display a QR code showing the account number of the account to be traded on their smartphone, such as "Please display the QR code on your smartphone screen." Screen 63 also includes a diagram of a smartphone displaying a QR code. After a predetermined time has elapsed since displaying screen 63, the ATM 100 displays screen 64 on display 111.

[0077] Screen 64 is a screen that presents the next step after the operation shown on Screen 63. Screen 64 includes the display of "Cardless Deposit," the message "Please scan the QR code," and a "Cancel" button.

[0078] Furthermore, screen 64 includes a message prompting the user to bring the smartphone displaying the QR code closer to the camera 116, such as "Please bring your smartphone closer to the camera." Screen 64 also includes a diagram showing a smartphone being brought closer to the camera 116.

[0079] Figure 10 is a diagram (part 3) showing an example of a transaction screen using a QR code. ATM 100 displays screen 65 on display 111 after a predetermined time has elapsed since displaying screen 64. Screen 65 is a screen that presents the next operation after the operation shown on screen 64. Screen 65 includes the display of "Cardless Deposit," the message "Please scan the QR code," and a "Cancel" button.

[0080] Screen 65 includes a message prompting the user to press their smartphone against the switch 119 at the tip of the guide 40, such as "Place your smartphone against the switch at the top of the guide on both sides of the camera." Screen 65 also includes a diagram showing the smartphone being pressed against the switch 119. In the diagram on screen 65, the smartphone is shown transparently. In the diagram on screen 65, the switch 119 is shown in a highlighted manner.

[0081] While switch 119 is OFF, ATM 100 repeatedly displays screens 63, 64, and 65 on display 111. When switch 119 is turned ON from the OFF state while screens 63, 64, and 65 are displayed, ATM 100 acquires the current camera image from among camera images 121-1, 121-2, ... ATM 100 detects a QR code from the acquired camera image and reads the account number from the detected QR code. ATM 100 retrieves the balance of the account corresponding to the read account number from the host server 200. ATM 100 initiates a deposit transaction for the account corresponding to the read account number and displays screen 66 on display 111.

[0082] Screen 66 is a screen for accepting the insertion of cash to be used in a deposit transaction. Screen 66 includes a message prompting the insertion of cash, such as "Please insert banknotes." Screen 66 also includes a "Cancel" button. Furthermore, Screen 66 includes the message "Please insert banknotes" in an arrow-shaped box pointing from display 111 towards the cash slot 22.

[0083] Figure 11 is a diagram (part 4) showing an example of a transaction screen using a QR code. When ATM 100 accepts a cash deposit from the cash slot 22 while displaying screen 66, it displays screen 67 on the display 111. Screen 67 is a screen that prompts the user to wait while the deposited cash is being counted, etc. Screen 67 includes messages prompting the user to wait, such as "We are checking the transaction details" and "Please wait a moment."

[0084] With screen 67 displayed, ATM 100 reads the cash inserted into the cash slot 22 using the cash processing unit 115. Then, ATM 100 determines the total amount of cash inserted. Once ATM 100 has determined the total amount of cash inserted, it displays screen 68 on the display 111.

[0085] Screen 68 is a screen for users to confirm transaction details. Screen 68 includes a message prompting the user to confirm the transaction details, such as "Please check the transaction details and press the confirmation button." Screen 68 also displays the total amount of cash deposited (deposit amount). Screen 68 also displays the amount of fees. Screen 68 also displays the account balance after the transaction. Screen 68 also includes a "Confirm" button.

[0086] Figure 12 is a diagram (part 5) showing an example of a transaction screen using a QR code. When the "Confirm" button is pressed while screen 68 is displayed on the ATM 100, screen 69 is displayed on the display 111. Screen 69 is a screen that prompts the user to wait while the transaction is being executed.

[0087] Screen 69 includes messages prompting the user to wait, such as "Processing your transaction" or "Please wait a moment." With screen 69 displayed, ATM 100 requests the host server 200 to add the amount obtained by subtracting the fee from the total amount of cash deposited to the account balance of the transaction target. When ATM 100 is notified by the host server 200 that the account balance has been added, it displays screen 70 on display 111.

[0088] Screen 70 is the transaction completion screen. Screen 70 includes a message indicating that the transaction is complete, such as "Thank you for using our service." With screen 70 displayed, ATM 100 has the receipt printing unit 114 print a receipt showing the transaction details and eject it from the card / receipt slot 21.

[0089] In this way, the ATM 100 executes a transaction using a QR code. Here, when reading the QR code, the smartphone is held up to the camera 116, so the switch 119 is in the ON state. As a result, the ATM 100 reads the QR code from the camera image captured by the camera 116 in code shooting mode. Therefore, the ATM 100 can easily read QR codes. Next, the settings method for the camera 116 in landscape shooting mode and code shooting mode will be explained.

[0090] Figure 13 shows an example of how to set up the camera. The shooting control unit 130 sets the camera 116 so that the brightness of the camera image in a predetermined area is within a reference value. The shooting control unit 130 switches the area for calculating brightness depending on whether the mode is landscape shooting mode or code shooting mode.

[0091] The shooting control unit 130 causes the camera 116 to capture a camera image 81 and stores it in the storage unit 120 as camera images 121-1, 121-2, ... The camera image 81 is, for example, an image with 1920 pixels horizontally and 1080 pixels vertically. In the following, the coordinates of the top-left pixel of the camera image 81 are shown as coordinates (0,0), and the coordinates of the bottom-right pixel of the camera image 81 are shown as coordinates (1920,1080).

[0092] In landscape shooting mode, the shooting control unit 130 sets the camera 116 so that the brightness of the entire area of ​​the camera image 81 is within a reference value. First, the shooting control unit 130 calculates the brightness level as the average value of the RGB gradation for each pixel from coordinates (0,0) to (1920,1080). The average value of the RGB gradation is expressed as a value from 0 to 255, with a higher number indicating greater brightness. The shooting control unit 130 then calculates the average value of the calculated brightness levels.

[0093] The shooting control unit 130 compares the average value of the brightness level with the reference value for landscape shooting mode. The reference value for landscape shooting mode is a range of values ​​that are pre-set as suitable brightness for landscape photography. For example, the reference value for landscape shooting mode is a predetermined range from 128.

[0094] If the average brightness level is outside the reference range for landscape shooting mode, the shooting control unit 130 increases or decreases the shutter speed and gain of the camera 116 so that the average brightness level approaches the reference range for landscape shooting mode. For example, if the average brightness level is greater than the reference range for landscape shooting mode, the shooting control unit 130 increases the shutter speed and decreases the gain of the camera 116. Also, if the average brightness level is less than the reference range for landscape shooting mode, the shooting control unit 130 decreases the shutter speed and increases the gain of the camera 116.

[0095] In code shooting mode, the shooting control unit 130 sets the camera 116 so that the brightness in a predetermined range near the center of the camera image 81 is within a reference value. Here, as an example, the shooting control unit 130 sets the camera 116 so that the brightness in the range of coordinates (520,300) to (1400,780) is within a reference value. First, the shooting control unit 130 calculates the average value of the RGB gradation for each pixel in the coordinates (520,300) to (1400,780) as the degree of brightness. The shooting control unit 130 then calculates the average value of the calculated degrees of brightness.

[0096] The shooting control unit 130 compares the average value of the brightness level with the reference value for the code shooting mode. The reference value for the code shooting mode is a range of values ​​that have been pre-set as suitable brightness for shooting QR codes. For example, the reference value for the code shooting mode is set higher than the reference value for the landscape shooting mode, and is within a predetermined range from 200.

[0097] The shooting control unit 130 increases or decreases the shutter speed and gain of the camera 116 so that the average value of the brightness approaches the reference value of the code shooting mode if the average value of the brightness is outside the reference value range of the code shooting mode. For example, if the average value of the brightness is greater than the reference value range of the code shooting mode, the shooting control unit 130 increases the shutter speed and decreases the gain of the camera 116. Also, if the average value of the brightness is less than the reference value range of the code shooting mode, the shooting control unit 130 decreases the shutter speed and increases the gain of the camera 116.

[0098] In addition, in code shooting mode, the shooting control unit 130 may compare the brightness of the area where a barcode is detected in the camera image 81 with a reference value, instead of a predetermined area near the center of the camera image 81.

[0099] In this way, the shooting control unit 130 configures the camera 116. In landscape shooting mode, the shooting control unit 130 configures the camera 116 so that the entire camera image is bright, allowing the camera 116 to capture images that make the landscape easy to see. In code shooting mode, the shooting control unit 130 configures the camera 116 so that the central area where barcodes such as QR codes are likely to be placed on the camera image is bright, allowing the camera 116 to capture images that make QR codes easy to read. Furthermore, the shooting control unit 130 configures the camera 116 to capture images that are more suitable for the intended use by setting different reference values ​​for landscape shooting mode and code shooting mode.

[0100] The following describes in detail the processing procedure of ATM100. First, the procedure for controlling the camera 116 by ATM100 will be explained. Figure 14 is a flowchart showing an example of the camera control process. The process shown in Figure 14 will be explained below according to the step numbers.

[0101] [Step S11] The shooting control unit 130 determines whether or not a transaction has started. If the shooting control unit 130 determines that a transaction has started, it proceeds to step S13. If the shooting control unit 130 determines that a transaction has not started, it proceeds to step S12.

[0102] [Step S12] The shooting control unit 130 causes the camera 116 to take a camera image in landscape shooting mode and saves it as camera image 121-1, 121-2, ... The processing in landscape shooting mode is shown in steps S14 to S19 described later. Then the processing proceeds to step S11.

[0103] [Step S13] The shooting control unit 130 determines whether the switch 119 is in the ON state. If the shooting control unit 130 determines that the switch 119 is in the ON state, it proceeds to step S20. If the shooting control unit 130 determines that the switch 119 is in the OFF state, it proceeds to step S14.

[0104] [Step S14] The shooting control unit 130 sets the area for calculating brightness to the entire camera image. [Step S15] The shooting control unit 130 causes the camera 116 to take a camera image and saves it as camera image 121-1, 121-2, ...

[0105] [Step S16] The shooting control unit 130 calculates the brightness of the area set in step S14 of the camera image captured in step S15. For example, the shooting control unit 130 calculates the average value of the RGB gradation for each pixel in the entire camera image captured in step S15 as the degree of brightness. The shooting control unit 130 then calculates the average value of the calculated degrees of brightness.

[0106] [Step S17] The shooting control unit 130 compares the brightness calculated in step S16 with the reference value for landscape shooting mode. [Step S18] The shooting control unit 130 determines whether the brightness calculated in step S16 is within the range of the reference values ​​for landscape shooting mode. If the shooting control unit 130 determines that the brightness is within the range of the reference values ​​for landscape shooting mode, it proceeds to step S26. If the shooting control unit 130 determines that the brightness is outside the range of the reference values ​​for landscape shooting mode, it proceeds to step S19.

[0107] [Step S19] The shooting control unit 130 increases or decreases the shutter speed and gain of the camera 116 so that the brightness approaches the reference value for landscape shooting mode. For example, if the brightness calculated in step S16 is greater than the reference value range for landscape shooting mode, the shooting control unit 130 increases the shutter speed and decreases the gain of the camera 116. Also, if the brightness calculated in step S16 is less than the reference value range for landscape shooting mode, the shooting control unit 130 decreases the shutter speed and increases the gain of the camera 116. Then the process proceeds to step S15.

[0108] [Step S20] The shooting control unit 130 sets the area for calculating brightness to be near the center of the camera image. For example, the shooting control unit 130 sets a predetermined range within the camera image, which has been set in advance, as the area for calculating brightness.

[0109] [Step S21] The shooting control unit 130 causes the camera 116 to take a camera image and saves it as camera image 121-1, 121-2, ... [Step S22] The shooting control unit 130 calculates the brightness of the area set in step S20 of the camera image captured in step S21. For example, for each pixel included in a predetermined range within the camera image captured in step S21, the shooting control unit 130 calculates the average value of the RGB gradation as the degree of brightness. The shooting control unit 130 then calculates the average value of the calculated degrees of brightness.

[0110] [Step S23] The shooting control unit 130 compares the brightness calculated in step S22 with the reference value of the code shooting mode. [Step S24] The shooting control unit 130 determines whether the brightness calculated in step S22 is within the range of the reference value for the code shooting mode. If the shooting control unit 130 determines that the brightness is within the range of the reference value for the code shooting mode, it proceeds to step S26. If the shooting control unit 130 determines that the brightness is outside the range of the reference value for the code shooting mode, it proceeds to step S25.

[0111] [Step S25] The shooting control unit 130 increases or decreases the shutter speed and gain of the camera 116 so that the brightness approaches the reference value of the code shooting mode. For example, if the brightness calculated in step S22 is greater than the range of the reference value of the code shooting mode, the shooting control unit 130 increases the shutter speed and decreases the gain of the camera 116. Also, if the brightness calculated in step S22 is less than the range of the reference value of the code shooting mode, the shooting control unit 130 decreases the shutter speed and increases the gain of the camera 116. Then the process proceeds to step S21.

[0112] [Step S26] The shooting control unit 130 determines whether the transaction has ended. If the shooting control unit 130 determines that the transaction has ended, it proceeds to step S11. If the shooting control unit 130 determines that the transaction has not ended, it proceeds to step S13.

[0113] In this way, when switch 119 is OFF, ATM100 is set to landscape shooting mode, and when switch 119 is ON, it is set to code shooting mode, and takes a camera image with camera 116. In landscape shooting mode, ATM100 sets camera 116 so that the brightness of the entire camera image approaches a reference value. This allows ATM100 to have camera 116 take a camera image that is easy to see in its entirety. In code shooting mode, ATM100 sets camera 116 so that the brightness of the area near the center of the camera image approaches a reference value. This allows ATM100 to have camera 116 take a camera image that is easy to read, such as a QR code or other barcode. In this way, ATM100 can appropriately set camera 116 according to the application.

[0114] Furthermore, when switch 119 is turned ON, ATM 100 switches to code shooting mode, allowing it to capture the scene of the user's operation in landscape shooting mode from the start of a transaction until just before the media is held up to the reader. Next, the procedure for preventing unauthorized viewing by ATM 100 will be explained.

[0115] Figure 15 is a flowchart showing an example of the procedure for preventing unauthorized viewing. The process shown in Figure 15 will be explained below according to the step numbers. [Step S31] The transaction control unit 140 determines whether or not the PIN entry screen for entering the PIN is currently displayed. If the transaction control unit 140 determines that the PIN entry screen is currently displayed, it proceeds to step S32. If the transaction control unit 140 determines that the PIN entry screen is not currently displayed, it proceeds to step S31.

[0116] [Step S32] The transaction control unit 140 acquires the current camera image from among the camera images 121-1, 121-2, ... [Step S33] The transaction control unit 140 displays the camera image acquired in step S32 on the screen. Then, the process proceeds to step S31.

[0117] In this way, the ATM 100 can display a video of the area behind the user while they are entering their PIN. Here, since switch 119 is OFF while the PIN is being entered, the ATM 100 displays the camera image captured by camera 116 in landscape mode. This allows the ATM 100 to show the user a video of the area behind them that is easy to see while they are entering their PIN.

[0118] Next, we will explain the procedure for processing transactions using QR codes (code transaction processing) with ATM100. When the "Smartphone Transaction" button is pressed on screen 61, ATM100 will execute the code transaction processing.

[0119] Figure 16 is a flowchart illustrating an example of the procedure for processing a code transaction. The process shown in Figure 16 will be explained below according to the step numbers. [Step S41] The transaction control unit 140 accepts the selection of a transaction type. For example, the transaction control unit 140 displays screen 62 on the display 111 and accepts the selection of a transaction type corresponding to the button pressed on screen 62.

[0120] [Step S42] The transaction control unit 140 displays a QR code reading screen that waits for the QR code to be read. For example, the transaction control unit 140 repeatedly displays screens 63, 64, and 65 on the display 111.

[0121] [Step S43] The transaction control unit 140 determines whether the switch 119 is in the ON state. If the transaction control unit 140 determines that the switch 119 is in the ON state, it proceeds to step S44. If the transaction control unit 140 determines that the switch 119 is in the OFF state, it proceeds to step S43.

[0122] [Step S44] The transaction control unit 140 acquires the current camera image from among the camera images 121-1, 121-2, ... [Step S45] The transaction control unit 140 detects a QR code from the camera image acquired in step S44. Then, the transaction control unit 140 reads the account number from the detected QR code.

[0123] [Step S46] The transaction control unit 140 determines whether or not it was able to successfully read the account number from the QR code in step S45. If the transaction control unit 140 determines that it was able to successfully read the account number from the QR code, it proceeds to step S47. If the transaction control unit 140 determines that it was not able to successfully read the account number from the QR code, it proceeds to step S44.

[0124] [Step S47] The transaction control unit 140 executes a transaction of the type selected in step S41 for the account corresponding to the account number read in step S45. For example, if a deposit transaction was selected in step S41, the transaction control unit 140 instructs the cash handling unit 115 to read the cash deposited into the cash inlet / outlet 22 and determines the total amount. The transaction control unit 140 then requests the host server 200 to add the amount obtained by subtracting the fee from the total amount of cash deposited to the balance of the account corresponding to the account number read in step S45.

[0125] [Step S48] The transaction control unit 140 issues a receipt. For example, the transaction control unit 140 causes the receipt printing unit 114 to print a receipt showing the transaction details and ejects it from the card / receipt opening / exit 21.

[0126] In this way, the ATM 100 executes a transaction using a QR code. Here, when reading the QR code, the smartphone is held up to the camera 116, so the switch 119 is in the ON state. As a result, the ATM 100 reads the QR code from the camera image captured by the camera 116 in code reading mode. Therefore, the ATM 100 can easily read QR codes. Next, the effect of adjusting the brightness of the camera image by the ATM 100 will be explained.

[0127] Figure 17 shows an example of adjusting the brightness of a camera image. The example in Figure 17 describes the case where a medium with a one-dimensional barcode (for example, a loyalty card) is photographed by camera 116.

[0128] Camera image 91 is a camera image taken by camera 116 before the medium held in front of camera 116 pressed the switch 119. Since camera image 91 was taken by camera 116 set to landscape shooting mode, the average brightness of the entire camera image is within the standard range. However, in camera image 91, the central part where the one-dimensional barcode is visible is dark. This makes it difficult to read the one-dimensional barcode from camera image 91.

[0129] When the medium presses switch 119, ATM 100 sets camera 116 to code shooting mode. ATM 100 increases or decreases the shutter speed and gain of camera 116 so that the average brightness near the center of the camera image is within the reference range. Camera image 92 is a camera image taken by camera 116 after the brightness has been adjusted in code shooting mode. In camera image 92, the area near the center where the one-dimensional barcode is captured is brighter. This makes it easier to distinguish the boundaries of the lines of the one-dimensional barcode captured in camera image 92. Therefore, ATM 100 can easily read the barcode.

[0130] Although embodiments have been illustrated above, the configurations of each part shown in the embodiments can be replaced with others having similar functions. Furthermore, other arbitrary components or processes may be added. Moreover, any two or more configurations (features) from the embodiments described above may be combined. [Explanation of symbols]

[0131] 1 Camera image 1a 1st area 1b 2nd area 2 medium 10. Automated trading device 11 Cameras 12 Guides 13 Detection unit 14 Processing Unit

Claims

1. A camera is installed to photograph users and capture camera images, A guide is installed around the camera and protrudes in the direction the camera is facing, A detection unit for detecting a medium approaching the tip of the guide, A processing unit determines a region within the camera image based on whether the detection unit has detected the medium, and sets the camera based on the brightness of the region. An automated trading device having the following features.

2. If the detection unit does not detect the medium, the processing unit determines a first region in the camera image and sets the camera so that the brightness of the first region falls within a first range. If the detection unit detects the medium, the processing unit determines a second region in the camera image that is narrower than the first region and sets the camera so that the brightness of the second region falls within a second range. The automated trading device according to claim 1.

3. The guide protrudes such that the medium in contact with the tip is separated from the camera by a distance greater than the shortest distance at which the camera can focus. The automated trading device according to claim 1.

4. The aforementioned guide is formed from a light-transmitting material. The automated trading device according to claim 1.

5. The automated trading system A detection unit, which is installed around a camera that is positioned to photograph users and capture camera images, and which detects a medium approaching the tip of a guide that protrudes in the direction the camera is facing, determines a region within the camera image based on whether or not it has detected the medium. Based on the brightness of the aforementioned region, the camera is set. Shooting method.

6. In the automated trading system, A detection unit, which is installed around a camera that is positioned to photograph users and capture camera images, and which detects a medium approaching the tip of a guide that protrudes in the direction the camera is facing, determines a region within the camera image based on whether or not it has detected the medium. Based on the brightness of the aforementioned region, the camera is set. A shooting program that executes the processing.

Images