Information reading apparatus and storage medium

Abstract

The invention provides an information reading apparatus and a storage medium, which can read information of a card medium by using a reading unit desired by an operator. A settlement terminal as an information reading device includes an operation prediction unit, a reading unit standby state acquisition unit, and a reading unit operation control unit. And an operation prediction unit that predicts which one of a plurality of reading units, including a non-contact reading unit, is intended by an operator to read the held card medium, the plurality of reading units reading the information registered in the card medium when the operator brings the held card medium at least close to the information reading device, the plurality of reading units including the non-contact reading unit. A reading unit standby state acquisition unit that acquires information indicating which reading unit in the settlement terminal is in an operable standby state; and a reading unit operation control unit that, when the plurality of reading units are in the standby state, cancels the standby state of the reading units other than the reading units predicted by the operation prediction unit.

Description

[0001] This application claims priority to Japanese application No. JP2024-140565, filed on August 22, 2024, and incorporates the contents of the aforementioned application in their entirety. Technical Field

[0002] Embodiments of the present invention relate to an information reading device and a storage medium. Background Technology

[0003] Commonly known payment terminals include multiple reading units that read card media such as credit cards held by users (hereinafter referred to as multi-functional payment terminals). For example, a known example of a payment terminal has the function of reading magnetic stripes based on a magnetic card reader and the function of contactless reading using near-field communication. Furthermore, the card media reading unit may also have the function of reading IC chips based on an IC card reader. In addition, the card media held by the customer may also include multiple functions such as IC chips, magnetic stripes, and near-field communication functions.

[0004] When customers use multi-function payment terminals with various reading capabilities, a problem arises: while some reading functions are in a standby state, unwanted functions may activate. Specifically, when a customer brings their magnetic stripe card close to the terminal's magnetic stripe slot to read it, the proximity of the card to the contactless reading area might trigger the near-field communication (NFC) function, reading the card's information. This can cause confusion for the customer if an unwanted reading function activates. Furthermore, for example, during credit card transactions, depending on the activated reading function, points may or may not be awarded based on the purchase amount; therefore, it's necessary to activate the appropriate reading function. Summary of the Invention

[0005] In view of the above problems, the problem to be solved by the present invention is to provide an information reading device and storage medium capable of reading information from a card medium using a reading unit desired by the operator.

[0006] To address the aforementioned problems, the information reading device of this embodiment includes an action prediction unit, a standby state acquisition unit, and a reading unit action control unit. The action prediction unit predicts which of a plurality of reading units, including a contactless reading unit, the operator wishes to use to read the card medium held by the operator, which reads information registered in the card medium by bringing the card medium at least close to the information reading device. The standby state acquisition unit acquires information indicating which reading unit in the information reading device is in a standby state capable of operation. The reading unit action control unit, when multiple reading units are in a standby state, deactivates the standby state of reading units other than the one predicted by the action prediction unit.

[0007] The aforementioned information reading device can prevent problems such as the inability to award purchase points due to the card medium being read by an unwanted reading unit.

[0008] In the aforementioned information reading device, the reading unit further includes: a contact IC card reading unit for reading the information registered in the IC chip inserted by the operator into the IC card slot of the information reading device; and a magnetic card reading unit for reading the information registered by the operator in the magnetic stripe scanned by the scanning slot of the information reading device.

[0009] According to the above-mentioned information reading device, even information reading devices that include contactless reading units, contact IC card reading units, and magnetic card reading units can use the reading unit desired by the customer to read the card medium.

[0010] In the aforementioned information reading device, the motion prediction unit predicts which reading unit the operator wishes to use to read the card medium by analyzing the images captured by the camera unit that captures the image of the operator.

[0011] Based on the information reading device described above, it is possible to easily and accurately predict the reading unit that the customer wishes to use.

[0012] In the aforementioned information reading device, the motion prediction unit predicts which reading unit the operator wishes to use to read the card medium based on a motion model generated by learning images of the operator operating the information reading device.

[0013] Based on the aforementioned information reading device, it is possible to easily and accurately predict the reading unit that a customer wishes to use. Furthermore, the accuracy of the prediction can be improved through continuous learning.

[0014] In the aforementioned information reading device, the action model is generated by associating reading unit installation information, which indicates which of the multiple reading units is installed in the information reading device being operated by the operator, with the setting position of the IC card insertion slot, the setting position of the scanning slot, and the setting position of the antenna serving as the receiving part of the contactless reading unit in the information reading device.

[0015] Based on the aforementioned information reading device, regardless of the device's settings or construction, it is possible to predict customer actions based on a suitable motion model.

[0016] The information reading device described above also includes a settlement method acquisition unit, which acquires the settlement method selected by the operator, wherein the standby state acquisition unit is executed when the settlement method acquisition unit has acquired information indicating that a credit card has been selected for settlement.

[0017] According to the information reading device described above, since the standby state of the reading unit is only checked when a credit card-based settlement operation is performed, the processing of the standby state acquisition unit can be simplified.

[0018] In the aforementioned information reading device, the photography unit begins taking pictures after the settlement method acquisition unit has acquired information indicating that settlement based on a credit card has been selected, without needing to acquire information indicating which reading unit has been selected based on the operator's operation.

[0019] The information reading device described above simplifies the operation because it eliminates the need for the operator to select the reading unit to use.

[0020] In the aforementioned information reading device, when the action prediction unit has predicted that the magnetic card reading unit or the contact IC card reading unit will be used, the reading unit action control unit releases the standby state of the non-contact reading unit.

[0021] The aforementioned information reading device can prevent misreading by the non-contact reading unit.

[0022] In the aforementioned information reading device, when the action prediction unit has predicted that a contactless reading unit will be used, the reading unit action control unit deactivates the standby state of the magnetic card reading unit and the contact IC card reading unit.

[0023] According to the aforementioned information reading device, the standby state of unused magnetic card reading units and contact IC card reading units can be deactivated.

[0024] Another aspect of the present invention is a storage medium storing a program that causes a computer operating an information reading device to operate as the following functional units: an operation prediction unit that predicts which of a plurality of reading units, including a contactless reading unit, an operator wishes to use to read a card medium held by the operator, the plurality of reading units reading information registered in the card medium by the operator bringing the held card medium at least close to the information reading device; a standby state acquisition unit that acquires information indicating which reading unit of the information reading device is in a standby state that is capable of operation; and a reading unit operation control unit that, when the plurality of reading units are in a standby state, deactivates the standby state of reading units other than the reading unit predicted by the operation prediction unit.

[0025] Based on the aforementioned storage medium, a function can be provided to the computer to prevent problems such as the inability to assign purchase points due to the card medium being read by an unwanted reading unit. Attached Figure Description

[0026] Figure 1 This is a block diagram illustrating an example of the general structure of a commodity sales data processing system according to an embodiment.

[0027] Figure 2 This is a perspective view showing an example of a settlement terminal included in the commodity sales data processing system according to the embodiment.

[0028] Figure 3 This is a hardware block diagram illustrating an example of the hardware structure of a settlement terminal.

[0029] Figure 4 This is an example of a credit card's appearance as observed from its surface.

[0030] Figure 5 This is a diagram showing an example of the names of the various parts when the settlement terminal is arranged vertically.

[0031] Figure 6 This is a diagram showing an example of the names of the various parts when the settlement terminal is set up horizontally.

[0032] Figure 7 This is a diagram illustrating an example of the data construction of the main file for the settlement terminal.

[0033] Figure 8 This is a diagram illustrating an example of the construction of an action prediction model.

[0034] Figure 9 This is a functional block diagram illustrating an example of the functional structure of the settlement terminal involved in the embodiment.

[0035] Figure 10This is a flowchart illustrating an example of the processing flow performed by the settlement terminal involved in the embodiment.

[0036] Explanation of reference numerals in the attached figures

[0037] 10. Product Sales Data Processing System; 12. Network; 20. POS Terminal

[0038] 30 Settlement Terminal (Information Reading Device) 301 Housing 302 Display Panel

[0039] 303 IC Card Reader (Contact IC Card Reading Unit)

[0040] 304 Magnetic Card Reader (Magnetic Card Reading Unit)

[0041] 305 antenna (contactless IC card reader unit)

[0042] 306 camera (photography unit)

[0043] 307 IC Card Insertion Port

[0044] 308 scanning slots

[0045] 322 Settlement Terminal Construction Master File

[0046] 323 Action Prediction Model

[0047] 40 store servers

[0048] 41 Front surface 42 Top surface 43 Bottom surface

[0049] 44 Left side 45 Right side

[0050] 51 Upper surface 52 Rear surface 53 Front surface

[0051] 54 Left side 55 Right side

[0052] 61 Settlement Method Acquisition Department

[0053] 62 Reading Unit Standby Status Acquisition Section (Standby Status Acquisition Section)

[0054] 63 Photography Control Department

[0055] 64 Motion Model Generation Department

[0056] 65. Motion Prediction Department

[0057] 66 Reading Unit Action Control Section

[0058] 67 Settlement Processing Department

[0059] 90 Credit Card (Card Medium) 91 IC Chip 92 Magnetic Strip

[0060] 93 Non-contact IC Chip

[0061] Maa, Mab action modes Detailed Implementation

[0062] The embodiments will now be described in detail with reference to the accompanying drawings. Furthermore, the embodiments described below do not constitute a limitation of the present invention.

[0063] The following description uses the accompanying drawings to illustrate the settlement terminal 30 included in the commodity sales data processing system 10, which is an embodiment of this disclosure.

[0064] (Brief structure of a commodity sales data processing system)

[0065] use Figure 1 The following describes the general structure of the product sales data processing system 10 in this embodiment. Figure 1 This is a block diagram illustrating an example of the general structure of a commodity sales data processing system according to an embodiment.

[0066] The merchandise sales data processing system 10 is used to manage merchandise sales and sales revenue in a store, and is primarily located within the store. The merchandise sales data processing system 10 includes a POS (Point of Sale) terminal 20, a checkout terminal 30, and a store server 40. Furthermore, multiple POS terminals 20 and checkout terminals 30 are typically installed to create a fully self-service merchandise sales data processing system where customers can complete the entire process from product registration to checkout themselves. The store server 40 is connected to the POS terminals 20 via a network 12. The network 12 is, for example, a LAN (Local Area Network). However, the merchandise sales data processing system 10 is not limited to... Figure 1 The structure is as follows: POS terminal 20 can be a terminal device for store clerks to register goods, and checkout terminal 30 can be a terminal device for customers to process payments based on the registered goods information. In this case, Figure 1 The settlement terminal 30 is directly connected to the network 12, and the commodity sales data processing system 10 constitutes a so-called semi-self-service commodity sales data processing system.

[0067] The POS terminal 20 is operated by the customer themselves to register the goods they wish to purchase. Alternatively, the POS terminal 20 can also be operated by a store clerk to register the goods purchased by the customer.

[0068] The payment terminal 30 is operated by the customer for cashless payment processing related to goods that have been registered. Cashless payment processing is performed via, for example, credit card payment based on the customer's credit card. In addition, the payment terminal 30 can also perform payment processing other than credit card payment, such as electronic money payment, QR code payment, etc.

[0069] The store server 40 acquires and stores the historical records of product registration processing performed by the POS terminal 20 and the historical records of cashless settlement processing performed by the settlement terminal 30. Furthermore, the store server 40 monitors whether the POS terminal 20 and the settlement terminal 30 are operating normally.

[0070] (Brief structure of the settlement terminal)

[0071] use Figure 2 To illustrate the general structure of the settlement terminal 30. Figure 2 This is a perspective view of an example of a settlement terminal included in the merchandise sales system described in the embodiment.

[0072] The settlement terminal 30 is composed of a rectangular shell 301, on its front surface ( Figure 2 The display panel 302 is positioned along the positive X-axis. Information related to the operation status of the checkout terminal 30 is displayed on the display panel 302. The display panel 302 can be, for example, an LCD monitor or an OLED monitor. Additionally, the display panel 302 may also function as an operation panel that allows customers to operate various buttons displayed on it. The functions of the operation panel are implemented via a touch panel layered on the display panel 302.

[0073] The settlement terminal 30 includes multiple reading units that read information registered on the credit card 90 held by the customer.

[0074] Figure 2 The settlement terminal 30 shown is a reading unit including an IC card reader 303, a magnetic card reader 304, and an antenna 305.

[0075] IC card reader 303 communicates with IC chip 91 installed on credit card 90 (see...). Figure 4 The IC card reader 303 contacts the IC chip 91 of the credit card 90 inserted from the IC card slot 307 in the direction of arrow A, thereby reading the information registered in the IC chip 91. The IC card reader 303 is an example of a contact IC card reading unit in this disclosure.

[0076] In this Figure 2In the case of the settlement terminal 30, an IC card insertion slot 307 is formed on the top surface of the housing 301. However, the location of the IC card insertion slot 307 is not limited to the top surface of the housing 301.

[0077] Magnetic card reader 304 communicates with the magnetic stripe 92 of credit card 90 (see...) Figure 4 The magnetic card reader 304 reads the registered information from the magnetic stripe 92 of the credit card 90, which is inserted into the scanning slot 308 and scanned in the direction of arrow B. The magnetic card reader 304 is an example of a magnetic card reading unit in this disclosure.

[0078] In this Figure 2 In the case of the settlement terminal 30, the scanning groove 308 is formed on the right side of the housing 301. However, the location where the scanning groove 308 is formed is not limited to the right side of the housing 301.

[0079] Antenna 305 reads information registered in contactless IC chip 93 via near-field wireless communication (e.g., NFC). Specifically, antenna 305 reads information registered in contactless IC chip 93 by conducting near-field wireless communication with the display panel 302 near the settlement terminal 30. Antenna 305 is an example of a contactless IC card reading unit in this disclosure.

[0080] The checkout terminal 30 also includes a camera 306 facing the display panel 302. The camera 306 captures at least the upper body, including the face, of the customer operating the checkout terminal 30. The camera 306 is one example of a camera unit in this disclosure. Furthermore, the camera 306 does not necessarily have to be built into the checkout terminal 30. For example, the camera 306 could be positioned above the customer's head to capture the customer operating the checkout terminal 30.

[0081] In addition, although Figure 2 Not shown in the figure, but the settlement terminal 30 also includes decimal keys for inputting passwords, etc.

[0082] (Hardware structure of the settlement terminal)

[0083] use Figure 3 To illustrate the hardware structure of the settlement terminal 30. Figure 3 This is a hardware block diagram illustrating an example of the hardware structure of a settlement terminal.

[0084] The settlement terminal 30 has a structure in which the control unit 31, the storage unit 32, the peripheral device controller 34 and the communication controller 35 are interconnected via an internal bus 33.

[0085] The control unit 31 controls the overall operation of the settlement terminal 30. The control unit 31 includes a CPU (Central Processing Unit) 311, a ROM (Read Only Memory) 312, and a RAM (Random Access Memory) 313. The CPU 311 is connected to the ROM 312 and RAM 313 via internal buses such as the address bus and data bus. The CPU 311 loads various programs stored in the ROM 312 and the storage unit 32 into the RAM 313. The CPU 311 operates according to the various programs loaded into the RAM 313 to control the operation of the settlement terminal 30. In other words, the control unit 31 has a general computer architecture.

[0086] Storage unit 32 is a storage device such as HDD (Hard Disk Drive) or SSD (Solid State Drive). Alternatively, storage unit 32 can be a non-volatile memory such as flash memory, which retains stored information even when the power is off. Storage unit 32 stores control program 321, settlement terminal construction master file 322, and action prediction model 323.

[0087] The control program 321 is a program that controls the overall operation of the settlement terminal 30. The control program 321 can be provided either stored in the storage unit 32 or stored as an installable or executable file on a computer-readable, non-temporary storage medium such as a CD-ROM, floppy disk (FD), CD-R, or DVD. Furthermore, the control program 321 can be stored on a computer connected to a network and provided via network download. Additionally, the control program 321 can be provided or distributed via a network such as the Internet.

[0088] The main file 322 for the settlement terminal is a file that stores the setup status of the settlement terminal 30, the installation status of the reading unit, the location of various supporting devices related to the reading unit, and an identification number that uniquely identifies the settlement terminal 30. The setup status of the settlement terminal 30 indicates whether it is set up vertically or horizontally (see [link to documentation]). Figure 5 , Figure 6 The locations of various auxiliary devices related to the reading unit are stored in a main file, which contains, for example, the location of the IC card slot 307 when the settlement terminal 30 includes an IC card reader 303, the location of the antenna 305 when the settlement terminal 30 includes an antenna 305, and the location of the scanning slot 308 when the settlement terminal 30 includes a magnetic card reader 304. The construction of the main file 322 for the settlement terminal will be described in detail later (see [reference]). Figure 7 ).

[0089] Additionally, the main file 322 for the checkout terminal is pre-stored by, for example, a store server 40, while the checkout terminal 30 may only store its own identification number. Then, the checkout terminal 30 can retrieve the main file 322 corresponding to its own identification number from the store server 40 when needed.

[0090] The motion prediction model 323 is a model that predicts the customer's actions when making a payment at the checkout terminal 30. The motion prediction model 323 stores the customer's motion prediction model in association with an identification number that uniquely identifies the checkout terminal 30 and the terminal's current status. The construction of the motion prediction model 323 will be described in detail later (see [link to documentation]). Figure 8 ).

[0091] Furthermore, the motion prediction model 323 can be pre-stored by, for example, the store server 40, while the checkout terminal 30 can only store its own identification number and its own settings. Then, the checkout terminal 30 can read the motion prediction model 323 corresponding to its own identification number and its own settings from the store server 40 when needed.

[0092] The control unit 31 is connected via the peripheral device controller 34 to various input / output devices, including the display panel 302, IC card reader 303, magnetic card reader 304, antenna 305, and camera 306. The overview of each input / output device is as described above, therefore repeated descriptions will be omitted.

[0093] In addition, the control unit 31 inputs and outputs various information to the store server 40 and POS terminal 20 via the communication controller 35.

[0094] For example, the control unit 31 outputs the settlement processing result to the store server 40 via the communication controller 35.

[0095] In addition, the control unit 31 obtains product registration information from the POS terminal 20 via the communication controller 35.

[0096] (A brief overview of the structure of a credit card)

[0097] Will use Figure 4 This section describes the general structure of a credit card (Type 90). Figure 4 This is an example of a credit card's appearance as observed from its surface.

[0098] Credit Card 90 is a card held by a customer that contains various information related to settlement (customer's name, card number, account to which the settlement amount is deducted, etc.). Credit Card 90 is an example of a card medium in this disclosure.

[0099] The IC chip 91 is embedded in the surface of the credit card 90. Electrodes are exposed on the surface of the IC chip 91 when the credit card 90 is inserted into the IC card slot 307 of the settlement terminal 30 (see...). Figure 2 When the IC chip 91's electrodes are connected to the IC card reader 303 (see...), the IC chip 91's electrodes are connected to the IC card reader 303 (see...). Figure 2 The system makes contact with the IC chip 91, thereby reading various transaction-related information registered in the IC chip 91. Credit cards that include this IC chip 91 are sometimes called contact IC cards.

[0100] A magnetic stripe 92 is provided on the back of the credit card 90 along its long side. When scanned along the scanning slot 308 of the checkout terminal 30 (see...) Figure 2 When scanning the magnetic stripe 92, the magnetic card reader 304 (see...) Figure 2 It reads various transaction-related information stored in the magnetic stripe 92. Credit cards that include this magnetic stripe 92 are sometimes called magnetic cards.

[0101] Furthermore, a contactless IC chip 93 is embedded inside the credit card 90. When the antenna 305 of the settlement terminal 30 (refer to...) Figure 2 When the device approaches the contactless IC chip 93, various information related to the transaction is read from the contactless IC chip 93. Credit cards that include this contactless IC chip 93 are sometimes called contactless IC cards. Alternatively, the IC chip 91 can also function as the contactless IC chip 93.

[0102] (Configuration status of the settlement terminal)

[0103] use Figure 5 and Figure 6 This is to explain the configuration status of the settlement terminal 30. Figure 5 This is a diagram showing an example of the names of the various parts when the settlement terminal is set up vertically. Figure 6 This is a diagram showing an example of the names of the various parts when the settlement terminal is set up horizontally.

[0104] Will Figure 2 The settlement terminal 30 described in the text is as follows: Figure 5 As shown, vertically arranged, or as... Figure 6 Set it horizontally as shown.

[0105] When the settlement terminal 30 is set vertically, the IC card insertion port 307 (see...) Figure 2 ) set in Figure 5 On one of the top surface 42, bottom surface 43, left side surface 44, and right side surface 45 shown. Furthermore, on... Figure 5 A scanning groove 308 is provided on one of the top surface 42, bottom surface 43, left side surface 44, and right side surface shown (see...). Figure 2 Then, antenna 305 (see...) Figure 2 ) set in Figure 5The inner side of the front surface 41 shown.

[0106] On the other hand, when the settlement terminal 30 is set horizontally, the IC card insertion port 307 (see Figure 2 ) set in Figure 6 On one of the following surfaces: rear surface 52, front surface 53, left side surface 54, and right side surface 55. Furthermore, on... Figure 6 A scanning groove 308 is provided on one of the following surfaces: rear surface 52, front surface 53, left side surface 54, and right side surface 55 (see [reference]). Figure 2 Then, antenna 305 (see...) Figure 2 ) set in Figure 6 The inner side of the upper surface 51 shown.

[0107] Associated with a unique identification number for the settlement terminal 30, information regarding whether the settlement terminal 30 is vertically or horizontally positioned, and which side of the settlement terminal 30 has the IC card slot 307 and scanning slot 308 located on, is registered in the aforementioned main settlement terminal construction file 322 (see [link to main file]). Figure 3 ).

[0108] (Data construction of the main file for the settlement terminal)

[0109] use Figure 7 This section explains the data construction of the main file 322 for the settlement terminal. Figure 7 This is a diagram illustrating an example of the data construction of the main file for the settlement terminal.

[0110] The main file 322 of the settlement terminal is associated with the unique identification number that specifies the settlement terminal 30 and stores the setting status of the settlement terminal 30, the installation status of the reading unit, the setting position of the IC card insertion port 307, the setting position of the antenna 305 and the setting position of the scanning slot 308.

[0111] The setting status of the settlement terminal 30 indicates that the settlement terminal 30 is set as follows: Figure 5 As shown, vertical setting or as Figure 6 The information is set horizontally as shown.

[0112] The installation status of the reading unit indicates which of the following reading units the settlement terminal 30 includes: a contact IC card reading unit (i.e., IC card reader 303), a contactless IC card reading unit (i.e., antenna 305), or a magnetic card reading unit (i.e., magnetic card reader 304). For example, it can indicate that both a contactless IC card reading unit and a contact IC card reading unit are installed. Alternatively, it can indicate that both a contactless IC card reading unit and a magnetic card reading unit are installed.

[0113] Figure 7The settlement terminal 30, which shows the settlement terminal identification number Ia, includes the entirety of the IC card reader 303, antenna 305, and magnetic card reader 304.

[0114] The location of the IC card slot 307 indicates which surface of the settlement terminal 30 the IC card slot 307 is formed on when the settlement terminal 30 includes an IC card reader 303.

[0115] Figure 7 This diagram shows the case where, with the settlement terminal 30 bearing the settlement terminal identification number Ia arranged vertically, the IC card slot 307 is formed on the top surface 42. Furthermore, it shows the case where, with the settlement terminal 30 bearing the settlement terminal identification number Ia arranged horizontally, the IC card slot 307 is formed on the rear surface 52.

[0116] The location of the scanning slot 308 indicates which surface of the settlement terminal 30 the IC card insertion slot 307 is formed on when the settlement terminal 30 includes an IC card reader 303.

[0117] Figure 7 This illustrates a case where the settlement terminal 30 with settlement terminal identification number Ia is vertically positioned, and the antenna 305 is integrated into the front surface 41. Furthermore, Figure 7 The antenna 305 is built into the upper surface 51 when the settlement terminal 30 with the settlement terminal identification number Ia is arranged horizontally.

[0118] The location of the IC card insertion port 307 indicates which surface of the settlement terminal 30, when the settlement terminal 30 includes a magnetic card reader 304, will form the scanning slot 308.

[0119] Figure 7 This illustrates a case where the checkout terminal 30, with the checkout terminal identification number Ia, is vertically positioned, and the scanning slot 308 is formed on the right side 45. Furthermore, Figure 7 This illustrates a case where a checkout terminal 30 with checkout terminal identification number Ia is positioned horizontally, and a scanning slot 308 is formed on the right side 55.

[0120] Thus, if the identification number and setting status (vertical or horizontal) of the settlement terminal 30 are known, the type of reading unit included in the settlement terminal 30 and the setting positions of the IC card insertion port 307, antenna 305, and scanning slot 308 required to activate each reading unit can be specified by referring to the settlement terminal construction master file 322.

[0121] (Data Construction for Action Prediction Models)

[0122] use Figure 8 This will illustrate the data construction of action prediction model 323. Figure 8 This is a diagram illustrating an example of the construction of an action prediction model.

[0123] The motion prediction model 323 stores the customer's motion model Maa, Mab in association with the unique identification number of the checkout terminal 30 and the setting state of the checkout terminal 30 (e.g., portrait or landscape).

[0124] Action models Maa and Mab are machine learning models that learn the relationship between the actions of a customer holding a credit card 90 on the checkout terminal 30 and the reading unit operated by the checkout terminal 30. Action models Maa and Mab are recorded, for example, using a known neural network. The input to action models Maa and Mab is an image captured showing the actions of a customer holding a credit card 90, and the output of action models Maa and Mab is the reading unit operated by the checkout terminal 30.

[0125] The action model Maa is an identification model generated when multiple group members hold the credit card 90, and the settlement terminal 30, with a known vertical identification number, reads the credit card 90 using the instructed reading unit. More specifically, the action model Maa is a model obtained by learning the relationship between the group members' actions, the behavior of the credit card 90, and the reading unit operated by the settlement terminal 30 by recording the actions of the group members when the credit card 90 is read using the instructed reading unit using the camera 306.

[0126] The action model Mab is an identification model generated when multiple group members hold the credit card 90, and the horizontally positioned identification number of the settlement terminal 30 is used to read the credit card 90 by the instructed reading unit. More specifically, the action model Mab is a model obtained by learning the relationship between the group members' actions, the behavior of the credit card 90, and the reading unit operated by the settlement terminal 30 by recording the actions of the group members when the credit card 90 is read using the instructed reading unit using the camera 306.

[0127] The commodity sales data processing system 10 performs the same learning process on multiple settlement terminals 30 with different settings for each reading unit (position of IC card insertion port 307, position of antenna 305, scanning slot 308), thereby pre-generating data based on the setting status and structure of each settlement terminal 30, such as... Figure 8 The action prediction model 323 is shown.

[0128] Action models Maa and Mab are generated using, for example, well-known deep learning methods. Specifically, action models Maa and Mab are action models that record the relationship between action features of group members extracted from video footage containing group members, changes in the orientation of the credit card 90 held by the group members, and the reading unit operated by the settlement terminal 30 at that time, using, for example, a multi-layered neural network.

[0129] The checkout terminal 30 reads the action models Maa and Mab corresponding to its own identification number from the action prediction model 323, and predicts which reading unit the customer wants to use to read the credit card 90 by analyzing the actions of the customer holding the credit card 90 and the orientation of the credit card 90, which are actually captured by the camera 306. Specifically, for example, it learns which reading unit should be used depending on how the customer's hand holds the credit card 90 and where that position is.

[0130] (Functional structure of the settlement terminal)

[0131] use Figure 9 To illustrate the functional structure of the settlement terminal 30. Figure 9 This is a functional block diagram illustrating an example of the functional structure of a settlement terminal related to an embodiment.

[0132] The control unit 31 of the settlement terminal 30 loads the control program 321 into the RAM 313 and activates it, thereby implementing it as a functional unit. Figure 9 The unit shown includes a settlement method acquisition unit 61, a reading unit standby state acquisition unit 62, a photography control unit 63, a motion model generation unit 64, a motion prediction unit 65, a reading unit motion control unit 66, and a settlement processing unit 67. Furthermore, all or part of these functional units can be implemented using dedicated hardware.

[0133] The settlement method acquisition unit 61 acquires the settlement method selected by the customer's operation. Specifically, for example, the settlement method acquisition unit 61 acquires the settlement method selected by the customer from the various settlement method options displayed on the display panel 302. These include credit card settlement or cash settlement, etc.

[0134] The standby state acquisition unit 62 acquires information indicating which reading unit in the settlement terminal 30 is in an operational standby state. Specifically, the standby state acquisition unit 62 determines, by referring to a pre-created list (not shown), that the reading unit corresponding to the settlement method acquired by the settlement method acquisition unit 61 is in a standby state. Furthermore, the standby state acquisition unit 62 is an example of a standby state acquisition unit in this disclosure.

[0135] The camera control unit 63 causes the camera 306 to record images of customers using the checkout terminal 30.

[0136] The motion model generation unit 64 generates motion models Maa and Mab by having a settlement terminal 30 with a known identification number read the credit card 90 using an instructed reading unit while multiple group members are holding the credit card 90.

[0137] The motion prediction unit 65 predicts which of a plurality of reading units, including a contactless reading unit, the customer wishes to use to read the credit card he holds, the plurality of reading units reading the information registered in the credit card 90 by the customer bringing the credit card he holds at least close to the checkout terminal 30.

[0138] When multiple read units are in standby mode, the read unit operation control unit 66 deactivates the standby mode of the read units other than those predicted by the operation prediction unit 65. When the standby mode is deactivated, the read unit does not perform a read operation.

[0139] Settlement processing unit 67 performs settlement processing using the specified settlement method.

[0140] (The processing flow performed by the settlement terminal)

[0141] use Figure 10 The process of processing the settlement terminal 30 is explained. Figure 10 This is a flowchart illustrating an example of the processing flow performed by the settlement terminal according to the embodiment. Furthermore, it is assumed that the settlement terminal 30 already stores motion prediction models 323, including motion models Maa and Mab generated by the motion model generation unit 64. Additionally, the reading unit can be either an IC card reader 303 or a magnetic card reader 304, in addition to the antenna 305. In this embodiment, it is assumed that the reading unit is equipped with all three types of reading units: an IC card reader 303, a magnetic card reader 304, and an antenna 305.

[0142] The settlement method acquisition unit 61 acquires the settlement method selected by the customer's operation (step S11). For example, it acquires information indicating that the customer has selected credit card 90 as the settlement method. Afterward, the customer reads the credit card 90 without needing to select any of the reading units (IC card reader 303, magnetic card reader 304, and antenna 305) (e.g., selecting the reading unit to use using a touch panel). When the settlement method acquisition unit 61 acquires that the settlement method is credit card 90, the reading unit standby state acquisition unit 62 is executed. If the settlement is not credit card 90 (e.g., cash settlement), the reading unit standby state acquisition unit 62 is not executed, and other settlement processes are performed. Because the standby state of the reading unit of the settlement terminal 30 is only checked when a settlement operation based on credit card 90 is performed, the processing is simplified.

[0143] The standby state acquisition unit 62 of the reading unit determines whether the settlement terminal 30 has put multiple reading units, including the contactless IC chip 93, into a standby state (step S12). When it is determined that the settlement terminal 30 has put multiple reading units, including the contactless IC chip 93, into a standby state (step S12: Yes), proceed to step S13. On the other hand, if it is determined that the settlement terminal 30 has not put multiple reading units, including the contactless IC chip 93, into a standby state (step S12: No), proceed to step S18.

[0144] When it is determined in step S12 that the payment terminal 30 has multiple reading units, including the reading unit of the contactless IC chip 93, in a standby state, the camera control unit 63 causes the camera 306 to start recording images of the customer using the payment terminal 30 (step S13). In other words, since the customer does not select a particular reading unit, the payment terminal 30, having already obtained information indicating that payment has been selected based on the credit card 90, does not need to obtain information indicating that a particular reading unit has been selected before starting to take pictures using the camera unit. Because the customer does not need to select a reading unit, operability is improved.

[0145] The motion prediction unit 65 determines whether it has acquired the image captured by the camera unit and has predicted the customer's action from the acquired image (step S14). If it is determined that the customer's action has been predicted (step S14: Yes), proceed to step S15. On the other hand, if it is determined that the customer's action has not been predicted (step S14: No), repeat step S14.

[0146] When it is determined in step S14 that the customer's action has been predicted, the camera control unit 63 stops recording the customer's image (step S15).

[0147] The action prediction unit 65 determines whether the customer has predicted that they will use the magnetic stripe 92 or IC chip 91 reading unit (magnetic card reader 304 or IC card reader 303) (step S16). If it is determined that the customer will predict that they will use the magnetic stripe 92 or IC chip 91 reading unit (step S16: Yes), the process proceeds to step S17. On the other hand, if it is determined that the customer will not use the magnetic stripe 92 or IC chip 91 reading unit (step S16: No), the process proceeds to step S18. That is, if it is determined that the customer will predict that they will use the contactless IC chip 93 reading unit (antenna 305), the process proceeds to step S18. In this embodiment, when the customer has predicted that they will use the contactless IC chip 93 reading unit, the process of deactivating the standby state of the magnetic card reader 304 and IC card reader 303 is omitted. When the antenna 305 is to be used, the credit card 90 does not come into contact with the magnetic card reader 304 or IC card reader 303, so the possibility of misreading is low. Therefore, the standby state is not deactivated. This simplifies the processing of the reading unit's operation control unit 66. Furthermore, in cases where a customer mistakenly believes that the credit card 90 contains a contactless IC chip 93, the card cannot be recognized. If the customer switches to the magnetic card reader 304 or the IC card reader 303, the customer can quickly perform the reading operation because the standby state is not deactivated. Additionally, the standby state of the magnetic card reader 304 and the IC card reader 303 can be deactivated if it is determined that the reading unit (antenna 305) is expected to use the contactless IC chip 93.

[0148] In step S16, if it is determined that the customer is expected to use the reading unit of the magnetic stripe 92 or the IC chip 91, the reading unit operation control unit 66 releases the standby state of the reading unit (antenna 305) of the non-contact IC chip 93 (step S17). Alternatively, in this case, the standby state of unused reading units in the reading units of the magnetic stripe 92 or the IC chip 91 can also be released. For example, when it is determined that the reading unit of the magnetic stripe 92 will be used, the standby state of the reading unit of the IC chip 91 and the standby state of the reading unit of the non-contact IC chip 93 can be released.

[0149] The settlement processing unit 67 reads the information registered in the credit card 90 (step S18).

[0150] The settlement processing unit 67 performs settlement processing using the designated method (step S19). Afterwards, the settlement terminal 30 completes the processing.

[0151] (Effects of the Examples)

[0152] As described above, the settlement terminal 30 (information reading device) of this embodiment includes an action prediction unit 65, a reading unit standby state acquisition unit 62 (standby state acquisition unit), and a reading unit action control unit 66. The action prediction unit 65 predicts which of a plurality of reading units, including a contactless reading unit, the customer wishes to use to read the held credit card 90 (card medium). These plurality of reading units read the information registered in the credit card 90 when the customer (operator) brings the held credit card 90 (card medium) at least close to the settlement terminal 30. The reading unit state acquisition unit 62 acquires information indicating which reading unit in the settlement terminal 30 is in a standby state capable of operation. The reading unit action control unit 66, when multiple reading units are in a standby state, deactivates the standby state of reading units other than the reading unit predicted by the action prediction unit 65. Therefore, the settlement terminal 30 can read the information of the credit card 90 using the reading unit desired by the operator. More specifically, when the motion prediction unit 65 predicts that the customer wants to use a reader other than a contactless reader to read the information in the credit card 90, the reader motion control unit 66 releases the contactless reader from standby mode, so that the checkout terminal 30 can read the information in the credit card 90 using the reader desired by the customer. This prevents problems such as not awarding purchase points due to the credit card 90 being read by an unwanted reader.

[0153] Furthermore, the settlement terminal 30 (information reading device) in this embodiment also includes an IC card reader 303 (contact IC card reader) and a magnetic card reader 304 (magnetic card reader) as reading units. The IC card reader 303 reads the information registered in the IC chip 91 inserted by the customer (operator) into the IC card insertion slot 307 of the settlement terminal 30, and the magnetic card reader 304 reads the information registered by the customer in the magnetic stripe 92 scanned by the customer in the scanning slot 308 of the settlement terminal 30. Therefore, even a multi-function settlement terminal equipped with multiple reading units can read the information of the credit card 90 through the reading unit desired by the customer.

[0154] Furthermore, in the settlement terminal 30 (information reading device) of the embodiment, the motion prediction unit 65 predicts which reading unit the customer wishes to use to read the credit card 90 (card medium) by analyzing the images captured by the camera 306 (photography unit) that captures the customer (operator). Therefore, it is possible to easily and accurately predict which reading unit the customer wishes to use.

[0155] Furthermore, in the settlement terminal 30 (information reading device) of this embodiment, the motion prediction unit 65 predicts which reading unit the customer wishes to use to read the credit card 90 (card medium) based on motion models Maa and Mab generated by learning images of the customer (operator) operating the settlement terminal 30. Therefore, the reading unit the customer wishes to use can be predicted easily and accurately. Moreover, since the motion models Maa and Mab are generated through learning, the accuracy of the prediction can be improved through continued learning.

[0156] Furthermore, in the settlement terminal 30 (information reading device) of the embodiment, the reading unit installation information indicating which of the multiple reading units is installed in the settlement terminal 30 that the customer (operator) is operating is associated with the setting position of the IC card insertion slot 307, the setting position of the scanning slot 308, and the setting position of the antenna 305, which serves as the receiving unit of the contactless reading unit, to generate an action mode Maa, Mab. Therefore, regardless of the setting state or structure of the settlement terminal 30, the customer's actions can be predicted based on the appropriate action mode Maa, Mab.

[0157] So far, although embodiments of the present invention have been described, these embodiments are merely examples and are not intended to limit the scope of the invention. For example, when multiple reading units (antenna 305, magnetic card reader 304, IC card reader 303) are in standby mode, if the action prediction unit has predicted that it is desired to use a reading unit other than the contactless reading unit (magnetic card reader 304 or IC card reader 303) for reading, the standby mode of the contactless reading unit (antenna 305) may be released; if the action prediction unit has predicted that it is desired to use the contactless reading unit (antenna 305) for reading, the standby mode of the reading units other than the contactless reading unit (magnetic card reader 304 and IC card reader 303) may not be released. This novel embodiment can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their variations are all included within the scope and spirit of the invention, and are included within the scope of the invention as described in the claims and their equivalents.

Claims

1. An information reading device, characterized in that, include: The motion prediction unit predicts which of a plurality of reading units, including a contactless reading unit, the operator wishes to use to read the card medium held by the operator by bringing the card medium at least close to the information reading device. The standby state acquisition unit acquires information indicating which reading unit in the information reading device is in a standby state that can operate. as well as The reading unit action control unit, when multiple reading units are in standby mode, releases the standby state of reading units other than those predicted by the action prediction unit.

2. The information reading device according to claim 1, wherein, The reading unit also includes: A contact IC card reader unit reads the information registered in the IC chip that the operator inserts into the IC card slot of the information reading device; and The magnetic card reading unit reads the information registered by the operator in the magnetic stripe scanned by the scanning slot of the information reading device.

3. The information reading device according to claim 2, wherein, The motion prediction unit predicts which reading unit the operator wants to use to read the card medium by analyzing the images captured by the camera unit that captures the image of the operator.

4. The information reading device according to claim 3, wherein, The motion prediction unit predicts which reading unit the operator wants to use to read the card medium based on a motion model generated by learning from images of the operator operating the information reading device.

5. The information reading device according to claim 4, wherein, The action model is generated by associating the reading unit installation information, which indicates which of the multiple reading units is installed in the information reading device being operated by the operator, with the setting position of the IC card slot, the setting position of the scanning slot, and the setting position of the antenna, which serves as the receiving part of the contactless reading unit, in the information reading device.

6. The information reading device according to claim 5, wherein, Also includes: The settlement method acquisition unit acquires the settlement method selected by the operator, wherein... The standby state acquisition unit is executed when the settlement method acquisition unit has already acquired information indicating that a credit card has been selected for settlement.

7. The information reading device according to claim 6, wherein, The photography unit begins taking pictures after the settlement method acquisition unit has obtained information indicating that settlement based on a credit card has been selected, without needing to obtain information indicating which reading unit has been selected based on the operator's operation.

8. The information reading device according to claim 7, wherein, The motion prediction unit has predicted that the magnetic card reader or contact IC will be used. In the case of a card reading unit, the reading unit operation control unit releases the standby state of the non-contact reading unit.

9. The information reading device according to claim 8, wherein, When the action prediction unit has predicted that the contactless reading unit will be used, the reading unit action control unit releases the standby state of the magnetic card reading unit and the contact IC card reading unit.

10. A storage medium storing a program that causes a computer operating an information reading device to operate the following functional units: The motion prediction unit predicts which of a plurality of reading units, including a contactless reading unit, the operator wishes to use to read the card medium held by the operator by bringing the card medium at least close to the information reading device. The standby state acquisition unit acquires information indicating which reading unit of the information reading device is in an operational standby state; as well as The reading unit action control unit, when multiple reading units are in standby mode, releases the standby state of reading units other than those predicted by the action prediction unit.

Images