Securities processing system, settlement system, and securities processing method

The securities processing device facilitates accurate gift certificate identification by incorporating a system for adjusting identification criteria based on forced acceptance information, addressing the challenges of diverse gift certificate designs and colors.

JP2026087119APending Publication Date: 2026-05-27LAUREL PRECISION CO LTD

Patent Information

Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
LAUREL PRECISION CO LTD
Filing Date
2024-11-15
Publication Date
2026-05-27

AI Technical Summary

Technical Problem

Existing systems struggle to accurately identify diverse gift certificates due to variations in design, issuer, and color changes, making it difficult to adjust AI judgment criteria effectively.

Method used

A securities processing device with an insertion unit, transport unit, image reading unit, identification unit, operation control unit, storage unit, and determination criteria changing unit, which allows for simple adjustment of identification criteria based on forced acceptance information.

Benefits of technology

Enables accurate and efficient identification of gift certificates by allowing for dynamic adjustment of identification criteria, simplifying the process and reducing the need for extensive training data preparation.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2026087119000001_ABST
    Figure 2026087119000001_ABST
Patent Text Reader

Abstract

The criteria for identifying securities will be simplified. [Solution] The securities processing device 10 includes an input unit 110 into which gift certificates GT are inserted, a transport unit 160 for transporting gift certificates GT, an image reading unit 120 for generating first image information showing an image IIMG of the gift certificates GT, an identification unit 154 for determining whether or not to accept the gift certificates GT by performing an identification process that identifies the gift certificates GT based on predetermined criteria using the first image information and a second image information showing a pre-registered reference image RIMG, an operation control unit 152 for controlling the transport operation of the gift certificates GT according to the determination result of the identification unit 154, a storage unit 140 for storing the gift certificates GT, and a determination criterion change unit 155 for changing the determination criteria based on forced acceptance information TINF relating to the identification result of gift certificates GT that were forcibly accepted despite being determined not to be accepted in the identification process when the determination criteria are changed.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a securities processing apparatus, a settlement processing system, and a securities processing method.

Background Art

[0002] In retail stores such as supermarkets, securities such as gift certificates may be handled in addition to currency. For example, Patent Document 1 discloses a mode in which a coin changer and a POS register are communicatively connected to each other, and a currency processing unit in which the POS register and a gift certificate processor are also communicatively connected to each other is installed at a cashier in the front area of a store. The system disclosed in Patent Document 1 allows an employee in a retail store or the like to identify a gift certificate received from a customer and perform settlement processing for purchased goods. Further, the gift certificate processor disclosed in Patent Document 1 includes an insertion unit for inserting a gift certificate from the outside of the machine body into the inside, a conveyance unit for conveying the inserted gift certificate, an identification unit for identifying the conveyed gift certificate and obtaining information related to the gift certificate, and a deposit rejection unit. The deposit rejection unit is connected to the conveyance unit, and a gift certificate that could not be identified by the identification unit or a gift certificate that has been identified by the identification unit but is determined to be unacceptable for acceptance is sent from the conveyance unit to the deposit rejection unit. The gift certificate sent to the deposit rejection unit can be taken out of the machine body by an operator.

[0003] In recent years, in consideration of highly accurate identification of currency, studies have been underway to use AI (Artificial Intelligence) for identification of currency and the like. For example, Patent Document 2 discloses that an infrared reflection image of an imaged banknote is compared with infrared reflection image data based on a genuine banknote, and machine learning is used to determine the authenticity of the banknote.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Patent Document 2

[0005] Incidentally, the variety of gift certificates is far greater than, for example, banknotes. Furthermore, with gift certificates, there are cases where only the issuing company or sponsoring company's information differs, the design remains the same, the design itself differs slightly depending on the issuance date, and the color changes slightly due to fading, etc. Therefore, it is extremely difficult to accurately identify these different types of gift certificates. For this reason, it is conceivable to improve accuracy by adjusting the criteria for identifying gift certificates over time, but since the algorithm used in AI processing is a black box, it is difficult to adjust the judgment results. It is possible to adjust the judgment results by introducing trends into the training data, but controlling the degree of adjustment is extremely difficult. It is also possible to create new training data for different versions of gift certificates or gift certificates with only slight color changes due to fading, etc., and train the AI ​​as separate gift certificates, but even in this case, considering the effort required to prepare the training data and train the AI, it is not practical. For this reason, there is a need to adjust the criteria for identifying securities such as gift certificates in a simple way. [Means for solving the problem]

[0006] A securities processing device according to a preferred embodiment of the present invention is a securities processing device for determining whether or not to accept inserted securities, comprising: an insertion unit into which securities are inserted; a transport unit for transporting the securities inserted into the insertion unit; an image reading unit for generating first image information showing a first image which is an image of the securities; an identification unit for determining whether or not to accept the securities by performing an identification process that identifies the securities based on predetermined criteria using the first image information and second image information showing second images which are images of each of a plurality of pre-registered reference securities; an operation control unit for controlling the transport operation of the securities by the transport unit according to the determination result of the identification unit; a storage unit for storing the securities that can be accepted; and a determination criteria changing unit for changing the determination criteria based on forced acceptance information relating to the identification result of securities that were forcibly accepted despite being determined not to be accepted in the identification process, when the determination criteria are changed.

[0007] Furthermore, a settlement processing system according to a preferred embodiment of the present invention is a settlement processing system having at least a POS register, a settlement processing device, and a securities processing device, wherein the securities processing device includes an input unit into which securities are inserted, a transport unit for transporting the securities inserted into the input unit, an image reading unit for generating a first image showing a first image which is an image of the securities, an identification unit for determining whether or not to accept the securities by performing an identification process that identifies the securities based on predetermined criteria using the first image information and a second image showing a second image which is an image of each of a plurality of pre-registered reference securities, an operation control unit for controlling the transport operation of the securities by the transport unit according to the determination result of the identification unit, a storage unit for storing the acceptable securities, and a determination criteria changing unit for changing the determination criteria based on forced acceptance ticket information relating to the identification result of securities that were forcibly accepted despite being determined to be unacceptable in the identification process when the determination criteria are changed.

[0008] Furthermore, a securities processing method according to a preferred embodiment of the present invention is a securities processing method executed by a securities processing device comprising: an input unit into which securities are inserted; a transport unit for transporting the securities inserted into the input unit; an image reading unit for generating first image information showing a first image which is an image of the securities; a control unit for determining whether or not the securities can be accepted; and a storage unit for storing the acceptable securities, wherein the control unit determines whether or not the securities can be accepted by performing an identification process that identifies the securities based on predetermined criteria using the first image information and second image information showing second images which are images of each of a plurality of pre-registered reference securities, and controls the transport operation of the securities by the transport unit according to the determination result of the identification process, and when changing the criteria, the criteria are changed based on forced acceptance information relating to the identification result of securities that were forcibly accepted despite being determined not to be acceptable in the identification process. [Effects of the Invention]

[0009] According to the present invention, the criteria for identifying securities can be adjusted in a simple manner. [Brief explanation of the drawing]

[0010] [Figure 1] This is a conceptual diagram illustrating the outline of the settlement processing system according to the first embodiment. [Figure 2] This is a schematic diagram showing the internal structure of a securities processing unit. [Figure 3] This is a diagram showing the configuration of a securities processing unit. [Figure 4] Figure 3 is an explanatory diagram illustrating an example of a ticket type table. [Figure 5] This is an explanatory diagram illustrating the overview of the ticket type identification process. [Figure 6] This is an explanatory diagram illustrating an example of a confirmation screen used to verify the identification result of a gift certificate inserted into the input section of a securities processing device. [Figure 7] This is an explanatory diagram illustrating another example of a confirmation screen. [Figure 8] It is an explanatory diagram for explaining an example of an employee-exclusive screen for selecting the forced acceptance mode. [Figure 9] It is an explanatory diagram for explaining an example of a settlement screen for forcibly executing the acceptance of gift certificates. [Figure 10] It is a flowchart showing an example of the operation of a securities processing device when performing a settlement process using gift certificates. [Figure 11] It is a flowchart showing an example of identification processing. [Figure 12] It is a flowchart showing an example of coupon type identification processing. [Figure 13] It is a flowchart showing an example of forced acceptance processing. [Figure 14] It is an explanatory diagram for explaining an example of forced acceptance coupon information. [Figure 15] It is an explanatory diagram for explaining an example of a criterion change selection screen for selecting whether to execute the change of the judgment criterion. [Figure 16] It is an explanatory diagram for explaining an example of a change target selection screen for selecting a judgment criterion for the change target. [Figure 17] It is an explanatory diagram for explaining an example of a change information input screen for changing the first reference value which is a similarity judgment criterion. [Figure 18] It is a flowchart showing an example of a criterion change process for changing the judgment criterion.

Embodiments for Carrying Out the Invention

[0011] Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings. In each figure, the dimensions and scales of each part are appropriately different from the actual ones. Further, the embodiments described below are preferred specific examples of the present invention, and thus various technically preferable limitations are imposed. However, the scope of the present invention is not limited to these embodiments unless there is a description to specifically limit the present invention in the following description.

[0012] [1. Embodiment] First, while referring to FIG. 1, an example of the outline of the settlement processing system 1 according to the first embodiment will be described.

[0013] [First Embodiment] FIG. 1 is a conceptual diagram for explaining the outline of the settlement processing system 1 according to the first embodiment. In FIG. 1, the settlement processing system 1 includes a securities processing device 10 that processes securities such as commodity vouchers GT and service vouchers, a POS register 20 (including self-checkout and semi-self-checkout), and a change machine 30 that is a settlement processing device.

[0014] The securities processing device 10 is communicably connected to the POS register 20, and the POS register 20 is communicably connected to the change machine 30. The connection between the securities processing device 10 and the POS register 20, and the connection between the POS register 20 and the change machine 30 may be a connection using either wired or wireless, or a connection using both wired and wireless. Also, the connection between a plurality of elements including the securities processing device 10 and the like only needs to be a connection that enables communication between the plurality of elements, and may be a connection via a network. The network may include the Internet and a local area network. In this embodiment, for example, it is assumed that the securities processing device 10, the POS register 20, and the change machine 30 are installed in a retail store such as a supermarket that handles commodity vouchers GT.

[0015] Details will be described later in FIG. 3, but the securities processing device 10 has, for example, an input unit 110, a temporary storage unit outlet 131, a storage unit outlet 141, and the like. In this embodiment, the input unit 110 serves as both an input port into which the commodity voucher GT is inserted and a discharge (reject) port that discharges the commodity voucher GT inserted into the securities processing device 10. Whether to discharge the commodity voucher GT inserted into the securities processing device 10 is determined by an identification process that identifies the commodity voucher GT based on, for example, an image IIMG of the commodity voucher GT. Also, the securities inserted into the securities processing device 10 can be taken out from the temporary storage unit outlet 131 or the storage unit outlet 141 as needed.

[0016] The POS register 20, for example, has a display and operation unit 21 and is used to process payments for goods purchased by customers in stores such as supermarkets. The display and operation unit 21 functions as both an output device such as a display and an operation panel, which is an input device for the POS register 20. Thus, in this embodiment, it is assumed that the display and operation unit 21 is configured to be integrated with an operation device (for example, a touch panel) that accepts operations from an administrator of the settlement processing system 1.

[0017] Furthermore, in this embodiment, it is assumed that the POS register 20 communicates with the securities processing device 10 and the change dispenser 30, and the securities processing device 10 identifies the securities, such as gift certificates GT, that the customer wishes to use, and determines whether the securities can be used at the store, and the POS register 20 and the change dispenser 30 perform the settlement process. Note that the securities processed by the settlement processing system 1 in the present invention are not limited to gift certificates GT, but may also be negotiable securities such as regional development vouchers, or non-negotiable securities such as service vouchers, coupons, and discount vouchers. Also, the settlement processing device is not limited to the change dispenser 30, but may be a settlement processing device other than the change dispenser 30.

[0018] Figure 2 is a schematic diagram illustrating the internal structure of the securities processing device 10. For clarity, in Figure 2, a number (1, 2, 3, or 4) is appended to the end of the code for the gift certificate GT. However, gift certificates GT1, GT2, GT3, and GT4 are also referred to simply as gift certificate GT without distinction. Furthermore, Figure 2 illustrates the internal structure of the securities processing device 10 using the example of a case where the securities processing device 10 is installed on a plane perpendicular to the direction of gravity (horizontal plane).

[0019] In the following explanation, for convenience, we will use the mutually orthogonal X, Y, and Z axes shown in Figure 2 as appropriate. The direction indicated by the arrow on the X axis will be referred to as the +X direction, and the opposite direction of the +X direction will be referred to as the -X direction. Similarly, the direction indicated by the arrow on the Y axis will be referred to as the +Y direction, and the opposite direction of the +Y direction will be referred to as the -Y direction. The direction indicated by the arrow on the Z axis will be referred to as the +Z direction, and the opposite direction of the +Z direction will be referred to as the -Z direction. For example, Figure 2 schematically shows the internal structure of the securities processing device 10 when viewed from the +X direction to the -X direction. In this embodiment, the surface grasped when viewing the securities processing device 10 from the +X direction to the -X direction corresponds to the front. In this embodiment, the -Z direction corresponds to the direction of gravity. In the following explanation, the +Z direction may be referred to as upward, and the -Z direction may be referred to as downward.

[0020] The securities processing device 10 includes an input section 110 into which gift certificates GT are inserted, an image reading section 120 that reads an image IIMG of the gift certificates GT inserted from the input section 110, a temporary storage section 130 that temporarily stores the gift certificates GT after the image IIMG has been read, a storage section 140 that stores the gift certificates GT after settlement processing is complete, and a processing device 150. Furthermore, the securities processing device 10 includes a transport section 160 that transports the gift certificates GT inserted into the input section 110. The transport section 160 has, for example, a plurality of transport rollers ROL driven by a motor (not shown). Hereinafter, the rotation of the transport rollers ROL when transporting the gift certificates GT in the direction from the input section 110 to the temporary storage section 130 (from top to bottom in Figure 2) will be referred to as forward rotation, and the rotation in the opposite direction to forward rotation will be referred to as reverse rotation. Also, although not clearly shown in Figure 2, the transport path from the image reading section 120 to the storage section 140 is also part of the transport section 160.

[0021] For example, an employee or customer of a retail store where the securities processing device 10 is installed will insert a gift certificate GT1 into the input section 110. The input section 110 then inserts the inserted gift certificate GT1 into the securities processing device 10. In other words, the securities processing device 10 can take in the gift certificate GT1 inserted into the input section 110. If the identification process determines that the gift certificate GT1 inserted into the input section 110 is unacceptable, the gift certificate GT1 is returned from the input section 110 to the employee or customer. In other words, the input section 110 serves as both an input and output port for gift certificates GT.

[0022] The image reading unit 120 is, for example, an optical device such as a camera and an image scanner. In this embodiment, the image reading unit 120 has an end ED1 closer to the input unit 110 than the storage unit 140, and an end ED2 closer to the storage unit 140 than the input unit 110. For example, a gift certificate GT1 inserted from the input unit 110 passes through the end ED1 of the image reading unit 120 by a transport roller ROL. The image reading unit 120 then generates image information representing the image IIMG by reading one or both of the front and back surfaces of the gift certificate GT that has passed through the end ED1. Reading the image IIMG of the gift certificate GT is achieved, for example, by imaging the gift certificate GT. For example, the image reading unit 120 shown in Figure 2 can read the image IIMG of the front and back surfaces of the gift certificate GT by imaging the gift certificate GT from the +Y direction and the -Y direction, respectively.

[0023] Based on the image information generated by the image reading unit 120, an identification process for identifying the gift certificate GT is performed by the processing unit 150 (more specifically, the identification unit 154 shown in Figure 3), which will be described later. For example, a gift certificate GT inserted into the input unit 110 is the target of the identification process. Hereinafter, the gift certificate GT inserted into the input unit 110 may be referred to as the gift certificate GT to be identified.

[0024] In this embodiment, the transport unit 160 waits while the identification unit 154 determines whether or not to accept the gift certificate GT, holding the gift certificate GT so that it can move in reverse from the image reading unit 120 to the input unit 110. The state in which the gift certificate GT can move in reverse from the image reading unit 120 to the input unit 110 is, for example, the state before the gift certificate GT passes the transport roller ROL closest to the end ED2 of the image reading unit 120, among the multiple transport roller ROLs located within the image reading unit 120. For example, a portion of the gift certificate GT has passed the end ED2 of the image reading unit 120, and the area of ​​the gift certificate GT that has not passed the end ED2 is held by the transport roller ROL closest to the end ED2 of the gift certificate GT (state of gift certificate GT2 in Figure 2). That is, the transport unit 160 waits until the result of the identification process is known, holding the gift certificate GT so that it extends from the end ED2 toward the storage unit 140 (state of gift certificate GT2 in Figure 2).

[0025] If the result of the identification process is determined and the gift certificate GT2 is to be accepted, the transport roller ROL rotates forward, releasing the gift certificate GT2 from its position at the end ED2 of the image reading unit 120, and it is stored in the temporary storage unit 130. If the gift certificate GT2 is not to be accepted, the transport roller ROL rotates backward, causing the gift certificate GT2 to move in reverse from its position at the end ED2 of the image reading unit 120 and be discharged (rejected) from the input unit 110. Reverse movement of the gift certificate GT means, for example, transporting the gift certificate GT in the opposite direction to the transport direction when it is being transported into the securities processing unit 10, in the transport path for loading the gift certificate GT into the securities processing unit 10.

[0026] Thus, in this embodiment, the transport path from the input section 110 to the end ED2 of the image reading section 120 is also used as a transport path for discharging the gift certificate GT2 to the outside. Therefore, in this embodiment, it is not necessary to provide a separate transport path for discharging the gift certificate GT2 to the outside from the transport path for inputting the gift certificate GT into the securities processing device 10, thus preventing the transport path for the gift certificate GT from becoming complicated. As a result, in this embodiment, the configuration of the securities processing device 10 can be kept from becoming complicated. This prevents an increase in the cost of the securities processing device 10 in this embodiment.

[0027] Furthermore, in this embodiment, since unacceptable gift certificates GT are returned to the input unit 110, it is possible to prevent employees or customers from forgetting to take their gift certificates GT. Also, in this embodiment, since there is no need to provide a separate discharge port from the input unit 110, as described above, the transport path of gift certificates GT inside the securities processing device 10 is simplified, so it is possible to suppress the time it takes to remove unacceptable gift certificates GT from the machine. Moreover, in this embodiment, the gift certificates GT are held in a waiting state so that a portion of them is located between end ED1 and end ED2, so the time it takes to remove unacceptable gift certificates GT from the machine can be shortened. From the viewpoint of shortening the time it takes to remove unacceptable gift certificates GT from the machine, it is preferable that the image reading unit 120 be located close to the input unit 110.

[0028] The temporary storage unit 130 includes a temporary storage unit outlet 131 provided on the side of the temporary storage unit 130, an opening / closing plate 132, a support part 133 that rotatably supports the opening / closing plate 132, and a stopper 134. The temporary storage unit outlet 131 can be opened and closed, for example, using an axis along the direction of gravity (-Z direction) as the axis of rotation. The opening / closing plate 132 can be rotated around the support part 133 by a motor (not shown), and can be switched between an inclined state shown by a solid line and a vertical state shown by a dashed line in Figure 2.

[0029] The inclined state shown by the solid line in Figure 2 is the closed state, where the transport path from the temporary storage section 130 to the storage section 140 is closed, for example, when the opening / closing plate 132 is inclined with respect to the direction of gravity (-Z direction). On the inclined opening / closing plate 132, the gift certificate GT2 transported from the image reading section 120 is temporarily stored as gift certificate GT3. The stopper 134 is a stopper for securing the gift certificate GT3 on the inclined opening / closing plate 132. The vertical state shown by the dashed line in Figure 2 is the open state, where the transport path from the temporary storage section 130 to the storage section 140 is opened. When the opening / closing plate 132 transitions from the inclined state to the vertical state, the gift certificate GT3 temporarily stored on the opening / closing plate 132 is transported to the storage section 140.

[0030] For example, the gift certificate GT transported from the image reading unit 120 is temporarily stored on the inclined opening / closing plate 132. Once the settlement process by the POS register 20 is complete, the opening / closing plate 132 transitions from an inclined state to a vertical state, and the gift certificate GT is transported to the storage unit 140. If an employee or customer inserts multiple gift certificates GT, the multiple gift certificates GT are stored in the temporary storage unit 130, and once the settlement process is complete, all of the gift certificates GT are transported to the storage unit 140. Furthermore, if any problem occurs during the settlement process, the temporary storage unit outlet 131 can be opened, and the gift certificates GT GT stored in the temporary storage unit 130 can be removed from the securities processing device 10.

[0031] Thus, in this embodiment, a temporary storage unit 130 is provided in the middle of the transport path from the image reading unit 120 to the storage unit 140. Therefore, the temporary storage unit 130 can also be considered as part of the transport unit 160.

[0032] The storage unit 140 has a storage unit outlet 141 provided on its side and a collection box 142 for storing the gift certificates GT3 transported from the temporary storage unit 130 as gift certificates GT4. The storage unit outlet 141 can be opened and closed, for example, using an axis along the direction of gravity (-Z direction) as the axis of rotation. By opening the storage unit outlet 141, the collection box 142 can be removed from the securities processing device 10. That is, the gift certificates GT4 stored in the storage unit 140 can be removed from the securities processing device 10 through the storage unit outlet 141. For example, an employee or security officer can unlock the storage unit outlet 141 of the storage unit 140 and retrieve the gift certificates GT4 stored in the storage unit 140.

[0033] Furthermore, the present invention is not limited to a configuration in which, if the gift certificate GT2 is not accepted, the transport roller ROL rotates in reverse, causing the gift certificate GT2 to move in reverse from a state in which it is held to extend from the end ED2 toward the storage section 140, and to be discharged (rejected) to the outside from the input section 110. For example, the gift certificate GT may not be held to extend from the end ED2 toward the storage section 140, but all may be transported to the temporary storage section 130, and if the gift certificate GT2 is not accepted, the temporary storage section outlet 131 may be opened and the gift certificate GT2 may be removed to the outside. Alternatively, the temporary storage section 130 may not be provided, and the gift certificates may be transported directly from the image reading section 120 to the storage section 140. This makes it possible to miniaturize the securities processing device 10.

[0034] The processing unit 150 controls the identification process using image information indicating the image read by the image reading unit 120, and the overall operation of the securities processing unit 10.

[0035] Figure 3 is a block diagram showing the configuration of the securities processing device 10.

[0036] The securities processing device 10 includes, for example, the elements described in Figure 2 (the input unit 110, the image reading unit 120, the temporary storage unit 130, the storage unit 140, and the processing device 150), as well as a storage device 156 for storing various information and a communication device 170. The securities processing device 10 also has a plurality of sensors (not shown) corresponding to the image reading unit 120, the temporary storage unit 130, the storage unit 140, and the transport unit 160. For example, each sensor outputs a signal to the processing device 150 for detecting the state of the element corresponding to that sensor (any of the image reading unit 120, the temporary storage unit 130, the storage unit 140, and the transport unit 160).

[0037] The storage device 156 includes, for example, one or both of the following: a volatile memory such as RAM (Random Access Memory) that functions as a work area for the processing unit 150, and a non-volatile memory such as EEPROM (Electrically Erasable Programmable Read-Only Memory) that stores various information such as the control program PG1. The storage device 156 may be detachable from the securities processing unit 10. Specifically, the storage device 156 may be a storage medium such as a memory card that is detachable from the securities processing unit 10. Furthermore, the storage device 156 may be a storage device (e.g., online storage) that is communicably connected to the securities processing unit 10 via a network or the like.

[0038] In this embodiment, the storage device 156 stores, in addition to the control program PG1 executed in the identification process, a ticket type table TBL and compulsory acceptance ticket information TINF, which are referenced during the identification process. The ticket type table TBL will be explained in Figure 4, which will be described later. The compulsory acceptance ticket information TINF is information regarding the results of the identification process for gift certificates GT that were forcibly accepted despite being determined to be unacceptable during the identification process. Details of the compulsory acceptance ticket information TINF will be explained in Figure 14, which will be described later.

[0039] The communication device 170 is hardware for communicating with external devices such as a POS register 20 located outside the securities processing device 10. For example, the communication device 170 can send and receive signals with the POS register 20 located outside the securities processing device 10. The communication device 170 is not limited to the POS register 20; it can also be connected to communicate with a change dispenser 30, a server device, a cloud device, and the like.

[0040] The processing unit 150 is a processor that controls the entire securities processing unit 10 and is configured, for example, to include one or more CPUs (Central Processing Units). For example, the processing unit 150 functions as a display control unit 151, an operation control unit 152, an identification unit 154, and a judgment criterion changing unit 155 by executing a control program PG1 stored in the storage device 156. The control program PG1 may be transmitted from another device via a network.

[0041] Based on the identification result by the securities processing device 10, the POS register 20 processes the settlement of the customer's purchased goods. For example, when an employee or customer settles using a gift certificate GT, the processing device 150 causes the image reading unit 120 to read the gift certificate GT (the gift certificate GT to be identified) inserted into the input unit 110. The image reading unit 120 generates image information showing the image IIMG (image IIMG of the gift certificate GT to be identified) of the read gift certificate GT and transmits the generated image information to the processing device 150. The image reading unit 120 may also store the image information in the storage device 156. In this case, the processing device 150 may read the image information from the storage device 156.

[0042] Furthermore, for example, if the processing unit 150 is configured to include multiple CPUs, some or all of the functions of the processing unit 150 may be realized by these multiple CPUs cooperating and operating according to a program such as a control program PG1. Also, the processing unit 150 may be configured to include hardware such as a GPU (Graphics Processing Unit), a DSP (Digital Signal Processor), or an FPGA (Field Programmable Gate Array) in addition to one or more CPUs, or in place of some or all of the one or more CPUs. In this case, some or all of the functions of the processing unit 150 may be realized by hardware such as a DSP.

[0043] Thus, in this embodiment, the control program PG1 includes an application program for causing the processing unit 150 to function as a display control unit 151, an operation control unit 152, an identification unit 154, and a judgment criterion changing unit 155. The control program PG1 may also include, for example, an operating system program for the processing unit 150 to control each part of the securities processing unit 10. The processing unit 150 is an example of a "control unit." For example, the identification unit 154 and the judgment criterion changing unit 155 correspond to "control units."

[0044] The display control unit 151 can control the display operation unit 21 of the POS register 20. For example, the display control unit 151 can display various screens, such as the confirmation screen SCa shown in Figure 6 (described later), on the display operation unit 21.

[0045] The motion control unit 152 controls the operation of each of the input unit 110, image reading unit 120, temporary storage unit 130, storage unit 140, and transport unit 160 based on signals from sensors and the like that are provided corresponding to each element. For example, the motion control unit 152 controls the timing and speed of the transport operation of the transport unit 160, the opening and closing operation of the opening / closing plate 132 of the temporary storage unit 130, the opening and closing operation of the temporary storage unit outlet 131, and the opening and closing operation of the storage unit outlet 141. The transport operation of the transport unit 160 may include, for example, the operation of rotating the transport roller ROL forward or backward. In addition, the opening and closing operation of the opening / closing plate 132 of the temporary storage unit 130 may be included in the transport operation of the transport unit 160.

[0046] Furthermore, the identification unit 154 obtains image information from the image reading unit 120 that shows the image of the gift certificate GT (the gift certificate GT to be identified) inserted into the input unit 110. Then, the identification unit 154 performs an identification process to determine whether or not to accept the gift certificate GT to be identified based on the image information obtained from the image reading unit 120 (image information showing image IIMG of the gift certificate GT to be identified). Hereafter, the image information showing image IIMG of the gift certificate GT may be referred to as the image information of the gift certificate GT. Note that if the image reading unit 120 stores the image information of the gift certificate GT to be identified in the storage device 156, the identification unit 154 may obtain the image information of the gift certificate GT to be identified from the storage device 156. Image IIMG of the gift certificate GT to be identified is an example of the "first image," and the image information showing image IIMG of the gift certificate GT to be identified is an example of the "first image information."

[0047] The identification process performed by the identification unit 154 will be explained in Figure 11 below, but the identification process includes at least image processing and OCR (Optical Character Recognition) processing. Therefore, the identification unit 154 may be considered to include at least an image processing unit and an OCR processing unit.

[0048] Furthermore, in the identification process, the acceptance or rejection of the gift certificate GT is determined based on predetermined criteria. In this embodiment, the criteria used in the identification process can be changed. For example, the criteria change unit 155 changes the criteria based on the compulsory acceptance voucher information TINF. The process for changing the criteria will be explained later in Figures 17 and 18.

[0049] The configuration of the settlement processing system 1 is not limited to the example shown in Figure 3. For example, the processing unit 150 and storage device 156 of the securities processing device 10 may be installed in a device located separately from the main body of the securities processing device 10 and may be connected to the image reading unit 120 etc. via a network such as a LAN (Local Area Network). In this case, the device including the processing unit 150 and storage device 156 (a device installed separately from the main body of the securities processing device 10) may function as a server for identifying gift certificates GT. For example, the image may be sent to an API (Application Programming Interface) on the cloud such as AWS (Amazon Web Services) to obtain the judgment result. Note that AWS is a registered trademark. Amazon is a registered trademark. Also, for example, the judgment criterion changing unit 155 may be provided separately from the processing unit 150. Alternatively, the judgment criterion changing unit 155 may be provided not in the securities processing device 10, but in a POS register 20 or an external control device.

[0050] Here, gift certificates GT determined to be unacceptable by the identification process are normally discharged to the outside from the input section 110, as described above. In this embodiment, the securities processing device 10 has a forced acceptance mode in which gift certificates GT are transported to the storage section 140 regardless of the result of the identification process. In the forced acceptance mode, gift certificates GT determined to be unacceptable in the identification process can be transported to the storage section 140. That is, in this embodiment, the securities processing device 10 has a normal mode in which gift certificates GT determined to be acceptable by the identification process are transported to the storage section 140 and gift certificates GT determined to be unacceptable by the identification process are discharged to the outside, and the forced acceptance mode described above. In this embodiment, it is assumed that if the forced acceptance mode is not selected, the securities processing device 10 operates in normal mode even if no operation to select the normal mode is performed. If the forced acceptance mode is selected, for example, forced acceptance ticket information TINF, which is information regarding the result of the identification process for gift certificates GT that were transported to the storage section 140 despite being determined to be unacceptable in the identification process, is stored in the storage device 156.

[0051] Next, we will explain an example of a ticket type table (TBL) with reference to Figure 4.

[0052] Figure 4 is an explanatory diagram illustrating an example of the voucher type table TBL shown in Figure 3. The voucher type table TBL has, for example, one or more records. In the example shown in Figure 4, the voucher type table TBL has multiple records that correspond one-to-one with multiple types of gift certificates GT registered in the voucher type table TBL.

[0053] For example, each record in the voucher type table TBL stores voucher type information, including identification information, information indicating the voucher type name, and information indicating the face value. The reference image RIMG stores image information indicating the reference image RIMG and information regarding the feature portion FT. Furthermore, each record in the voucher type table TBL stores information indicating the position of the expiration date area NAR on the voucher GT, where the expiration date of the voucher GT is written, as the expiration date area NAR. The color analysis results for the image IIMG of the voucher GT are stored as the color analysis results.

[0054] The identification information is information used to identify each type of gift certificate GT from among several types. The certificate type name is the name of the type of gift certificate GT that corresponds to the identification information. For example, the certificate type name is displayed on the confirmation screen SCa shown in Figure 6, which will be described later, so that employees of a retail store where a POS register 20 is installed can easily recognize the type of gift certificate GT inserted into the input section 110 of the securities processing device 10. The face value is the price of the gift certificate GT as a monetary voucher, as written on it.

[0055] Here, the types of gift certificates (GT) are distinguished by combinations of, for example, the design, face value, and issuer of the gift certificate. For example, three gift certificates (GT) corresponding to three different types of identification information, "001," "002," and "003," have the same design and issuer, but are stored as different types because their face values ​​are different. Similarly, three gift certificates (GT) corresponding to three different types of identification information, "003," "006," and "022," have the same face value, but are stored as different types because their design and issuer are different. Furthermore, even if the issuer and face value are the same, gift certificates (GT) with different designs are stored as different types.

[0056] Furthermore, the reference image RIMG is, for example, an image of the front of an acceptable gift certificate GT. The reference image RIMG is an example of a "second image," and the image information indicating the reference image RIMG is an example of "second image information." Note that the reference image RIMG may also be images of the front and back of an acceptable gift certificate GT. In addition, the storage location of the image information indicating the reference image RIMG may be stored in each record of the gift certificate type table TBL. The storage location of the image information is, for example, an address indicating the storage area where the image information is stored. Note that the image information may be stored in the storage device 156 where the gift certificate type table TBL is stored, or it may be stored in a storage device different from the storage device 156. Hereinafter, the image information indicating the reference image RIMG may be referred to as the image information of the reference image RIMG.

[0057] Furthermore, the reference image RIMG has feature portions FT corresponding to the type of gift certificate GT. It is preferable that multiple feature portions FT are defined for a single reference image RIMG. Feature portions FT are used, for example, in template matching performed in the identification process (more specifically, the gift certificate type identification process described in Figure 5). Template matching is a process that detects the location of an image that matches a template image within the image subject to template matching. "Match" includes not only exact matches but also cases where the images are similar enough to be considered a match. In this embodiment, the image IIMG of the gift certificate GT to be identified is the image subject to template matching, and the image of the feature portion FT corresponds to the template image. For example, examples of feature portion FT images include an image showing the issuing company of the gift certificate GT and an image showing the logo marks of sponsoring companies of the gift certificate GT. The image of the feature portion FT and its location differ depending on the type of gift certificate GT, for example. Therefore, the information regarding feature portions FT stored in each record of the gift certificate type table TBL includes, for example, image information showing the image of the feature portion FT and information showing the location of the feature portion FT in the gift certificate GT. Furthermore, the position coordinates of the feature portion FT may have a slight range to account for printing misalignment, etc. Additionally, the template images for each reference image RIMG can be automatically extracted and stored by the processing unit 150.

[0058] The location of the expiration date area NAR varies depending on the type of gift certificate GT. For example, in the gift certificate type table TBL shown in Figure 4, the expiration date area NAR for gift certificate GTs with identification information "001" to "006" is located in a portion of the back of the gift certificate GT, while the expiration date area NAR for gift certificate GTs with identification information "022" is located in a portion of the front of the gift certificate GT.

[0059] The color analysis results are, for example, the results of a color analysis of the surface of the gift certificate GT against the reference image RIMG. Color analysis involves, for example, analysis using the hue, lightness, and saturation of the image. Known color analysis methods can be employed.

[0060] Thus, in the voucher type table (TBL), the type of voucher GT, image, expiration date area (NAR), and color analysis results are associated with each other. Voucher GTs registered in the voucher type table (TBL) as acceptable voucher GTs are examples of "reference securities." Hereafter, voucher GTs registered in the voucher type table (TBL) may be referred to as reference voucher GTs.

[0061] Note that the configuration of the voucher type table TBL is not limited to the example shown in Figure 4. For example, the card company that issued the voucher GT may store information in each record of the voucher type table TBL indicating the location of the area where the voucher number (serial number) for managing the voucher GT is written. Also, for example, in the case of a voucher GT without an expiration date, information indicating that no expiration date is set may be stored instead of information indicating the location of the expiration date area NAR. Furthermore, for example, the color analysis results do not necessarily have to be stored in the voucher type table TBL.

[0062] The voucher type table TBL is referenced, for example, by the processing unit 150 of the securities processing unit 10 when the settlement processing system 1 performs settlement processing using vouchers GT. For example, the processing unit 150 functions as an identification unit 154 and performs voucher type identification processing to identify the voucher type of the voucher GT to be identified based on the image information of the reference image RIMG and the image information of the voucher GT to be identified, image IIMG. The voucher type identification processing searches for a reference image RIMG that matches the image IIMG of the voucher GT to be identified from among multiple reference image RIMGs stored in the voucher type table TBL. Note that the voucher type identification processing is included in the identification processing for determining whether or not to accept the voucher GT to be identified. The program that performs the identification processing, including the voucher type identification processing, is included, for example, in the control program PG1 stored in the storage device 156. When the settlement processing system 1 performs settlement processing using vouchers GT, for example, the confirmation screen SCa shown in Figure 6 is displayed on the display operation unit 21 of the POS register 20.

[0063] Next, we will explain the overview of the ticket type identification process, referring to Figure 5.

[0064] Figure 5 is an explanatory diagram illustrating the overview of the ticket type identification process.

[0065] The image IIMGf shown in Figure 5 is the image of the surface of the gift certificate GT to be identified, read by the image reading unit 120, and used as the image IIMG of the gift certificate GT to be identified in the gift certificate type identification process. For example, image IIMGf is an image represented by the image information generated by the image reading unit 120. In this embodiment, we assume that the image IIMGf of the gift certificate GT to be identified is used in the gift certificate type identification process. In the example shown in Figure 5, the gift certificate GT to be identified has some scribbles NZ1 and a stamp impression NZ2.

[0066] Furthermore, the reference images RIMG1, RIMG2, and RIMG3 shown in Figure 5 are reference images RIMG that are searched using AI (Artificial Intelligence) as candidates for reference image RIMG that match image IIMGf. In the example shown in Figure 5, in order to facilitate understanding of the voucher type identification process, two feature parts FT are predetermined for each of the reference images RIMG1, RIMG2, and RIMG3, and it is assumed that image IIMGf has two feature parts FT. The images of the two feature parts FT (template images) are, for example, an image showing the company that issued the gift certificate GT, and an image showing the logo marks of the sponsoring companies of the gift certificate GT.

[0067] In Figure 5, for the sake of clarity, a two-character alphanumeric code (either ia, ib, 1a, 1b, 2a, 2b, 3a, or 3b) is appended to the end of the feature portion FT code. However, below, feature portions FTia, FTib, FT1a, FT1b, FT2a, FT2b, FT3a, and FT3b will also be referred to simply as feature portions FT without any particular distinction. Note that feature portions FTia and FT1b are not pre-registered as feature portions FT; rather, images that match the reference image RIMG through the template processing described later are conveniently treated as feature portions. Similarly, below, reference images RIMG1, RIMG2, and RIMG3 will also be referred to simply as reference images RIMG without any particular distinction. Furthermore, below, a candidate reference image RIMG that matches the image IIMGf of the gift certificate GT to be identified may be referred to as a matching candidate reference image RIMG. A matching candidate reference image RIMG is an example of a "candidate image".

[0068] In the ticket type identification process, first, a first process is performed that uses AI to search for a reference image RIMG of potential matches. Then, a second process is performed to identify the type of the gift certificate GT to be identified based on the degree of match between the multiple feature portion FTs of the reference image RIMG and the image IIMGf. In the second process, template matching is performed using the image of the feature portion FT as a template image. The degree of match is an index that represents the degree of match between the feature portion FTs of the reference image RIMG and the feature portion FTs of the image IIMGf. For example, the degree of match is calculated based on how much of the feature corresponding portion of the image IIMGf corresponds to the feature portion FTs of the reference image RIMG. For example, the degree of match is calculated based on whether or not there is an image in the image IIMGf that can be considered to match the feature portion FTs of the reference image RIMG, and if so, whether or not the position of that image can be considered to be equal to the position of the feature portion FTs of the reference image RIMG. In other words, the ticket type identification process includes a first process using AI and a second process using template matching.

[0069] First, let me explain the first process using AI.

[0070] In the first process, the identification unit 154 generates a feature vector for image IIMGf by performing a process to generate a feature vector representing the features of the image on the image IIMGf of the gift certificate GT to be identified. The process of generating the feature vector includes, for example, multiple convolutional layers and pooling layers in a convolutional neural network. For example, the identification unit 154 generates the feature vector for image IIMGf using an AI model that has been trained (metric learning) to reduce the distance between feature vectors of multiple images of the same gift certificate type and increase the distance between feature vectors of multiple images of different gift certificate types. Then, the identification unit 154 calculates the similarity between image IIMGf and each reference image RIMG based on the inter-vector distance, which is the distance between the feature vector of image IIMGf and the feature vector of each reference image RIMG. The feature information representing the feature vector of the reference image RIMG is stored in the gift certificate type table TBL, for example, associated with the reference image RIMG.

[0071] Thus, in this embodiment, an AI model generated by distance learning specifically for gift certificates GT and coupons is used. However, while the above-mentioned AI model is very effective for gift certificates GT and coupons, which have many types and many similar tickets, the AI ​​model in the present invention is not limited to the AI ​​model generated by distance learning described above, and it is possible to use a generally known AI model.

[0072] For example, the similarity calculated using AI is calculated as a numerical value such as 0.000 to 1.000. For example, the closer the similarity of two images is to 1.000, the more similar the two images are to each other. If the images are exactly the same, the similarity will be 1.000. However, in cases where there are many types and many similar images, such as with gift certificates (GT), it is often difficult to accurately determine a single reference image (RIMG) that matches the image (IIMGf) of the gift certificate (GT) to be identified, based solely on the similarity calculated by AI. For example, gift certificates (GT) often have scribbles, stains, and wrinkles, and if the AI ​​accuracy is increased too much, the detection accuracy decreases. In other words, there are many cases where the highest similarity score calculated by AI does not correspond to the correct gift certificate (GT). For this reason, in this embodiment, all reference images (RIMG) with a similarity of 1.000 or higher to the image (IIMGf) of the gift certificate (GT) to be identified are extracted as candidate reference images (RIMG). Furthermore, if there is no reference image RIMG whose similarity to the image IIMGf of the gift certificate GT to be identified is equal to or greater than the first criterion value, it may be determined that there is no reference image RIMG that matches the image IIMGf of the gift certificate GT to be identified. In this embodiment, it is assumed that the first criterion value is 0.900. The first criterion value is an example of a "criterion value". Also, the first criterion value corresponds to the judgment criterion of the first processing and is one of the judgment criteria for the identification processing.

[0073] In the example shown in Figure 5, reference images RIMG1, RIMG2, and RIMG3, whose similarity to the image IIMGf of the gift certificate GT to be identified is 0.9 or higher (a first criterion value), are searched from the gift certificate type table TBL as candidate reference images RIMG. For example, the similarity between image IIMGf and reference image RIMG1 is 0.941, the similarity between image IIMGf and reference image RIMG2 is 0.935, and the similarity between image IIMGf and reference image RIMG3 is 0.925. From the candidate reference images RIMG1, RIMG2, and RIMG3, the reference image RIMG that matches the image IIMGf of the gift certificate GT to be identified is identified by the second process. Note that if there are no reference images RIMG with a similarity of 0.9 or higher (a first criterion value), the identification unit 154 may determine that there are no reference images RIMG that match the image IIMGf of the gift certificate GT to be identified without performing the second process. In other words, if there is no reference image RIMG with a similarity of 1 or higher than the first criterion value, the identification unit 154 may determine that the type of gift certificate GT to be identified is unknown.

[0074] Next, we will explain the second process, which utilizes template matching.

[0075] In the second process, the identification unit 154 determines whether the image IIMGf of the gift certificate GT to be identified has a feature corresponding portion corresponding to the feature portion FT of each of the candidate reference images RIMG1, RIMG2, and RIMG3. Specifically, for example, the identification unit 154 performs template matching to detect the location in the image IIMGf of the gift certificate GT to be identified where an image matching the image of the feature portion FT (template image) exists. The identification unit 154 then calculates the degree of matching for each of the candidate reference images RIMG1, RIMG2, and RIMG3 with respect to the image IIMGf of the feature portion FT, based on the results of the template matching. The identification unit 154 also identifies the type of gift certificate GT to be identified based on the degree of matching for each of the candidate reference images RIMG1, RIMG2, and RIMG3.

[0076] For example, the matching candidate reference image RIMG1 has a feature portion FT1a that shows the logo of a sponsoring company and a feature portion FT1b that shows the issuing company. That is, the image of feature portion FT1a is an image that shows the logo of a sponsoring company, and the image of feature portion FT1b is an image that shows the issuing company. Furthermore, the region of feature portion FT1a is the region enclosed by four vertices P11, P12, P13 and P14, and the region of feature portion FT1b is the region enclosed by four vertices P15, P16, P17 and P18.

[0077] The identification unit 154 uses the image of feature portion FT1a of the reference image RIMG1 as a template image and performs template matching on image IIMGf. This identifies the position of the image of feature portion FTia that matches the image of feature portion FT1a. The region of feature portion FTia is the region enclosed by four vertices P1, P2, P3, and P4. Figure 5 assumes that the position coordinates of the region enclosed by the four vertices P1, P2, P3, and P4 (i.e., the position of feature portion FTia) coincide with the position coordinates of the region enclosed by the four vertices P11, P12, P13, and P14 (i.e., the position of feature portion FT1a). Therefore, the identification unit 154 identifies the feature portion FTia of image IIMGf as the feature corresponding portion to the feature portion FT1a of the reference image RIMG1.

[0078] Furthermore, the identification unit 154 uses the image of feature portion FT1b of the reference image RIMG1 as a template image to perform template matching on image IIMGf. In this case, since there is no portion in image IIMGf that matches the image of feature portion FT1b, the identification unit 154 identifies that there is no feature corresponding portion in image IIMGf that corresponds to feature portion FT1b of the reference image RIMG1. Thus, in the reference image RIMG1, a feature corresponding portion that matches one of the two feature portions FT is detected in image IIMGf. In this case, for example, in a method that calculates the degree of match of the reference image RIMG1 based on the number of feature portions FT that correspond to the feature corresponding portion detected in image IIMGf, the degree of match of the reference image RIMG1 will be 1.

[0079] The method for calculating the degree of matching of reference image RIMG1 is not limited to the method described above. For example, the degree of matching of reference image RIMG1 may be calculated based on the matching ratio of feature segments FT. In the example shown in Figure 5, the number of feature segments FT in reference image RIMG1 is two, and the number of feature segments FT corresponding to the feature-matching portion detected from image IIMGf is one. In this case, using the method of calculating the degree of matching of reference image RIMG1 based on the matching ratio of feature segments FT, the degree of matching of reference image RIMG1 would be 0.5 (=1 / 2). Alternatively, the degree of matching of reference image RIMG of matching candidates such as reference image RIMG1 may be quantified using AI or the like.

[0080] Furthermore, for example, the matching candidate reference image RIMG2 has a feature portion FT2a that shows the logo of a sponsoring company and a feature portion FT2b that shows the issuing company. That is, the image of feature portion FT2a is an image that shows the logo of a sponsoring company, and the image of feature portion FT2b is an image that shows the issuing company. Also, the region of feature portion FT2a is the region enclosed by four vertices P21, P22, P23 and P24, and the region of feature portion FT2b is the region enclosed by four vertices P25, P26, P27 and P28.

[0081] The identification unit 154 uses the image of feature portion FT2a of the reference image RIMG2 as a template image and performs template matching on image IIMGf. This identifies the position coordinates of the image of feature portion FTia that matches the image of feature portion FT2a. Figure 5 assumes a case where the position coordinates of the region enclosed by the four vertices P1, P2, P3 and P4 (i.e., the position of feature portion FTia) match the position coordinates of the region enclosed by the four vertices P21, P22, P23 and P24 (i.e., the position of feature portion FT2a). Therefore, the identification unit 154 identifies the feature portion FTia of image IIMGf as the feature corresponding portion to the feature portion FT2a of the reference image RIMG2.

[0082] Furthermore, the identification unit 154 uses the image of feature portion FT2b of the reference image RIMG2 as a template image and performs template matching on image IIMGf. This identifies the position coordinates of the image of feature portion FTib that matches the image of feature portion FT2b. The region of feature portion FTib is the region enclosed by four vertices P5, P6, P7, and P8. Figure 5 assumes that the position coordinates of the region enclosed by the four vertices P5, P6, P7, and P8 (i.e., the position of feature portion FTib) match the position coordinates of the region enclosed by the four vertices P25, P26, P27, and P28 (i.e., the position of feature portion FT2b). Therefore, the identification unit 154 identifies the feature portion FTib of image IIMGf as the feature corresponding portion to feature portion FT2b of the reference image RIMG2. In this way, two feature corresponding portions that match the two feature portions FT in the reference image RIMG2 are detected from image IIMGf. In this case, for example, if the degree of matching of the reference image RIMG2 is calculated based on the number of feature segments FT corresponding to the feature-matching portion detected in image IIMGf, the degree of matching of the reference image RIMG2 will be 2. However, if the degree of matching of the reference image RIMG2 is calculated based on the matching ratio of feature segments FT, the degree of matching of the reference image RIMG2 will be 1 (=2 / 2).

[0083] Furthermore, for example, the matching candidate reference image RIMG3 has a feature portion FT3a that shows the logo of a sponsoring company and a feature portion FT3b that shows the issuing company. That is, the image of feature portion FT3a is an image that shows the logo of a sponsoring company, and the image of feature portion FT3b is an image that shows the issuing company. Also, the region of feature portion FT3a is the region enclosed by four vertices P31, P32, P33 and P34, and the region of feature portion FT3b is the region enclosed by four vertices P35, P36, P37 and P38.

[0084] The identification unit 154 uses the image of feature portion FT3a of the reference image RIMG3 as a template image and performs template matching on image IIMGf. This identifies the position coordinates of the image of feature portion FTia that matches the image of feature portion FT3a. Figure 5 assumes a case where the position coordinates of the region enclosed by the four vertices P1, P2, P3 and P4 (i.e., the position of feature portion FTia) are different from the position coordinates of the region enclosed by the four vertices P31, P32, P33 and P34 (i.e., the position of feature portion FT3a). Therefore, the identification unit 154 identifies that there is no feature corresponding to feature portion FT3a of the reference image RIMG3 in image IIMGf.

[0085] Furthermore, the identification unit 154 uses the image of feature portion FT3b of the reference image RIMG3 as a template image and performs template matching on image IIMGf. This identifies the position coordinates of the image of feature portion FTib that matches the image of feature portion FT3b. Figure 5 assumes a case where the position coordinates of the region enclosed by the four vertices P5, P6, P7, and P8 (i.e., the position of feature portion FTib) match the position coordinates of the region enclosed by the four vertices P35, P36, P37, and P38 (i.e., the position of feature portion FT3b). Therefore, the identification unit 154 identifies the feature portion FTib of image IIMGf as the feature corresponding portion corresponding to feature portion FT3b of the reference image RIMG3. In this way, in the reference image RIMG3, a feature corresponding portion that matches one of the two feature portions FT is detected from image IIMGf. In this case, for example, in a method that calculates the degree of match of the reference image RIMG3 based on the number of feature portions FT corresponding to the feature corresponding portion detected from image IIMGf, the degree of match of the reference image RIMG3 will be 1. Furthermore, in the method of calculating the degree of matching of the reference image RIMG3 based on the matching ratio of the feature portion FT, the degree of matching of the reference image RIMG3 is 0.5 (=1 / 2).

[0086] The identification unit 154 identifies reference image RIMG2, which has the highest degree of match calculated based on the feature portion FT, as the reference image RIMG that matches the image IIMGf of the gift certificate GT to be identified, from among the candidate reference images RIMG1, RIMG2, and RIMG3. Generally, the likelihood that a candidate reference image RIMG matches image IIMGf increases as the degree of match between the feature portion FT of the reference image RIMG and image IIMGf increases. Furthermore, the accuracy of the degree of match improves when multiple feature portion FTs are defined for a reference image RIMG compared to when only one feature portion FT is defined for a reference image RIMG. For this reason, it is preferable to define multiple feature portion FTs for a single reference image RIMG.

[0087] Here, for example, in a proportional approach where the second processing is not performed, the reference image RIMG that matches the image IIMGf of the gift certificate GT to be identified is identified based solely on the similarity calculated using AI. Therefore, in the example shown in Figure 5, in a proportional approach, the reference image RIMG1, which has the highest similarity, is incorrectly identified as the reference image RIMG that matches the image IIMGf of the gift certificate GT to be identified. In contrast, in this embodiment, in addition to the similarity calculated using AI, the degree of match with the image IIMGf of the feature portion FT is also considered. Therefore, in this embodiment, it is possible to suppress the incorrect identification of the reference image RIMG that matches the image IIMGf of the gift certificate GT to be identified.

[0088] Thus, in this embodiment, even with gift certificates such as GT, which have many types and many similar certificates, the type of gift certificate can be identified with high accuracy. Furthermore, in this embodiment, the processing that is black-boxed by AI is used in the first process to calculate the similarity of the matching candidate reference image RIMG. The final identification of the reference image RIMG that matches the image IIMGf of the gift certificate GT to be identified is performed in the second process, which has a clear processing algorithm. For this reason, in this embodiment, even if it becomes necessary to change the judgment criteria for the gift certificate type identification process due to some factor, the judgment criteria can be easily changed.

[0089] The ticket type identification process is not limited to the example shown in Figure 5. For example, the degree of matching may be compared with a predetermined second criterion value. In the mode in which the degree of matching is compared with the second criterion value, for example, if there is no reference image RIMG of a candidate match with a degree of matching equal to or greater than the second criterion value, the identification unit 154 may determine that there is no reference image RIMG that matches the image IIMGf of the gift certificate GT to be identified. In other words, if there is no reference image RIMG of a candidate match with a degree of matching equal to or greater than the second criterion value, the identification unit 154 may determine that the type of gift certificate GT to be identified is unknown. The second criterion value compared with the degree of matching of the candidate reference image RIMG corresponds to the judgment criterion of the second process and is one of the judgment criteria of the identification process.

[0090] Furthermore, for example, if there are multiple reference image RIMGs with the same degree of similarity among multiple candidate reference image RIMGs, the reference image RIMG that matches the image IIMGf of the gift certificate GT to be identified may be identified as follows. For example, the identification unit 154 may identify the reference image RIMG with the highest similarity among multiple reference image RIMGs with the same degree of similarity as the reference image RIMG that matches the image IIMGf of the gift certificate GT to be identified. Alternatively, if the degree of similarity is calculated based on the number of feature portion FTs corresponding to the feature corresponding portion detected from the image IIMGf, the identification unit 154 may identify the reference image RIMG with the highest matching ratio of feature portion FTs among multiple reference image RIMGs with the same degree of similarity as the reference image RIMG that matches the image IIMGf of the gift certificate GT to be identified.

[0091] Furthermore, in calculating the degree of match, the method for determining the number of feature segment FTs corresponding to the feature-matching portion detected from image IIMGf is not limited to the example described above (where both the image and position coordinates of the feature segment FTs match). For example, in image IIMGf, if there is an image that matches the image of a feature segment FT, but the position coordinates of the image that matches the image of the feature segment FT are different from the position coordinates of the feature segment FT, the number of feature segment FTs corresponding to the feature-matching portion detected from image IIMGf may be set to 0.5. In other words, the degree of match may be quantified for each feature segment FT.

[0092] Furthermore, the second process is not limited to template matching; any process is acceptable as long as it can identify one reference image RIMG that matches the image IIMGf of the gift certificate GT to be identified from the candidate reference image RIMGs. Specifically, for example, in the second process, instead of detecting the position coordinates of an image that matches the image of the feature portion FT, it may be determined whether the image at the position of the feature portion FT in the reference image RIMG in image IIMGf matches the image of the feature portion FT. Alternatively, in the second process, a single reference image RIMG that matches the image IIMGf of the gift certificate GT to be identified may be identified by checking whether a predetermined number of symbols or numbers are written in a specific area using character recognition processing such as OCR processing.

[0093] Furthermore, while Figure 5 assumes that the number of feature segments (FTs) defined in the reference image RIMG is the same (2) in multiple candidate reference image RIMGs, the number of feature segments (FTs) may differ in multiple reference image RIMGs. If the number of feature segments (FTs) differs in multiple candidate reference image RIMGs, the degree of match is preferably calculated based, for example, on the matching ratio of the feature segments (FTs).

[0094] Next, referring to Figure 6, we will explain the confirmation screen SCa for confirming the identification result of the gift certificate GT inserted into the input unit 110 of the securities processing device 10.

[0095] Figure 6 is an explanatory diagram illustrating an example of a confirmation screen SCa for confirming the identification result of a gift certificate GT inserted into the input section 110 of the securities processing device 10. The confirmation screen SCa shown in Figure 6 is displayed on the display operation unit 21 of the POS register 20 when a store employee confirms the gift certificate GT that the customer wishes to use, when the POS register 20 is a regular counter-type register or a semi-self-service register. If the POS register 20 is a self-service register, the confirmation screen SCa is not displayed on the display operation unit 21. The display operation unit 21 displays the confirmation screen SCa when the securities processing device 10 performs an operation as shown in Figure 9, which will be described later. The confirmation screen SCa shown in Figure 6 displays the identification result of one gift certificate GT.

[0096] The confirmation screen SCa displays, for example, the reading order, ticket type name, face value, reference image RIMG, read image, and multiple buttons BT (BTa, BTb, BTc, and BTd) for the GUI (Graphical User Interface).

[0097] The reading order is, for example, the reading order when the image reading unit 120 reads multiple gift certificates GT to be identified. The certificate type name is the name of the type of gift certificate GT to be identified. For example, among the multiple certificate types registered in the certificate type table TBL, the certificate type indicated by the reference image RIMG that is determined to match the image IIMG of the gift certificate GT to be identified is identified as the certificate type name of the gift certificate GT to be identified.

[0098] The face value is the face value of the gift certificate GT being identified. For example, among the face values ​​of multiple gift certificate types registered in the gift certificate type table TBL, the face value of the same gift certificate type as the gift certificate GT being identified is identified as the face value of the gift certificate GT being identified. The reference image RIMG is the image of the front of the gift certificate GT corresponding to the same gift certificate type as the gift certificate GT being identified, among the multiple gift certificate types registered in the gift certificate type table TBL. In other words, the reference image RIMG displayed on the confirmation screen SCa is the reference image RIMG that has been determined to match the image IIMG of the gift certificate GT being identified, among the multiple reference images RIMG registered in the gift certificate type table TBL.

[0099] The image to be read is the image IIMG of the gift certificate GT to be identified (the image IIMG of the gift certificate GT read by the image reading unit 120). In the example shown in Figure 6, the image IIMGf of the front of the gift certificate GT to be identified and the image IIMGb of the back of the gift certificate GT to be identified are displayed on the confirmation screen SCa. Hereafter, images IIMGf and IIMGb will be referred to simply as image IIMG without any particular distinction.

[0100] Store employees who identify gift certificates GT can easily confirm whether the gift certificate GT to be identified has been correctly identified by checking the confirmation screen SCa. For example, if an employee confirms on the confirmation screen SCa that the gift certificate GT has been correctly identified, they may press the "Start Settlement" button BTa on the confirmation screen SCa to have the settlement processing system 1 execute the settlement process using the gift certificate GT. For example, if there is another gift certificate GT to be inserted into the input section 110 of the securities processing device 10 (the second gift certificate GT in the example shown in Figure 6), the employee may press the "Next" button BTb on the confirmation screen SCa. Also, for example, if an employee wants to cancel the settlement process currently being processed, they may press the "Cancel" button BTc on the confirmation screen SCa. If the settlement process currently being processed is canceled, for example, the gift certificate GT with reading order "1" is stored in the temporary storage section 130, and can be retrieved by unlocking the temporary storage section outlet 131 of the temporary storage section 130.

[0101] Next, referring to Figure 7, we will explain the confirmation screen SCa when multiple gift certificates GT are sequentially inserted into the input section 110 of the securities processing device 10.

[0102] Figure 7 is an explanatory diagram illustrating another example of the confirmation screen SCa. The confirmation screen SCa shown in Figure 7 is similar to the confirmation screen SCa shown in Figure 6, except that it displays the number of identified gift certificates GT and the "Forced Acceptance Mode" button BTd. For example, the confirmation screen SCa shown in Figure 6 displays the identification result of one gift certificate GT, while the confirmation screen SCa shown in Figure 7 displays the identification result of four gift certificates GT. The "Forced Acceptance Mode" button BTd is a button BT that is displayed on the confirmation screen SCa to select forced acceptance mode, for example, when an unacceptable gift certificate GT is detected. Therefore, if no unacceptable gift certificates GT are detected, the "Forced Acceptance Mode" button BTd is not displayed on the confirmation screen SCa.

[0103] In the example shown in Figure 7, the gift certificate GT with reading order "1", the gift certificate GT with reading order "2", and the gift certificate GT with reading order "3" are determined to be acceptable by the processing unit 150 (more specifically, the identification unit 154) of the securities processing device 10 and are stored in the temporary storage unit 130. The gift certificate GT with reading order "4" is a gift certificate GT that is determined not to correspond to any of the multiple gift certificate types registered in the gift certificate type table TBL. For this reason, there is no reference image RIMG corresponding to the gift certificate GT with reading order "4", and the gift certificate type name is "unknown".

[0104] Gift certificates GT with a reading order of "4" are unacceptable, and are therefore held at the end ED2 of the image reading unit 120, reversed direction toward the input unit 110, and discharged from the input unit 110. Gift certificates GT with a reading order of "1", "2", and "3" are stored in the temporary storage unit 130 and can be retrieved by unlocking the temporary storage unit outlet 131 of the temporary storage unit 130. For example, to cancel a settlement process using a gift certificate GT stored in the temporary storage unit 130 (a gift certificate GT currently being processed), if the POS register 20 is a self-checkout register, an input screen indicating the cancellation of the settlement process may be displayed on the display operation unit 21. If the POS register 20 is a regular counter-type register or a semi-self-checkout register, the "Cancel" button BT on the confirmation screen SCa may be pressed, as explained in Figure 6.

[0105] Furthermore, in the example shown in Figure 7, for example, an employee may press the "Start Settlement" button BTa on the confirmation screen SCa to have the settlement system 1 execute a settlement process using gift certificates GT other than those determined to be unacceptable by the identification process. In other words, in this embodiment, even if an unacceptable gift certificate GT is detected, settlement processing in normal mode can be performed using gift certificates GT other than those determined to be unacceptable by the identification process. Hereinafter, settlement processing in normal mode may be referred to as normal settlement processing.

[0106] Furthermore, in this embodiment, if the POS register 20 is a normal counter-type register or a semi-self-service register, even if a gift certificate GT is determined to be unacceptable by the identification process, if an employee checks the gift certificate GT and determines that it is an acceptable gift certificate GT, the settlement process can be performed using that gift certificate GT. For example, an employee may select the forced acceptance mode by pressing the "forced acceptance mode" button BTd on the confirmation screen SCa. When the "forced acceptance mode" button BTd on the confirmation screen SCa is pressed, for example, after predetermined processing such as employee authentication is performed, the employee-only screen SCb shown in Figure 8, which will be described later, is displayed on the display operation unit 21.

[0107] Furthermore, if the POS register 20 is a self-checkout register and the customer wants to confirm whether the gift certificate GT returned to the input unit 110 is valid, the customer will call an employee, and the employee will check the gift certificate GT. The employee will check the type of gift certificate, expiration date, etc., and if they determine that the gift certificate GT is not acceptable, they will explain this to the customer and return the unacceptable gift certificate GT to the customer. In addition, if the employee determines, for example, that the gift certificate GT returned to the input unit 110 should be accepted by the security processing unit 10, they may perform settlement processing in forced acceptance mode. Note that if the POS register 20 is a self-checkout register and the gift certificate GT is returned to the input unit 110, the processing unit 150 may function as a display control unit 151 and display a screen on the display operation unit 21 of the POS register 20 that includes buttons BT for selecting whether or not to perform normal settlement processing and buttons BT for calling an employee. Hereafter, settlement processing in forced acceptance mode may be referred to as forced settlement processing.

[0108] Note that the confirmation screen SCa is not limited to the examples shown in Figures 6 and 7. For example, if the gift certificate GT to be identified is determined to be unacceptable, the reason for unacceptability (e.g., unknown gift certificate name, expired, or counterfeit) may be displayed in the gift certificate name field. Also, for example, if an unacceptable gift certificate GT is detected, the "forced acceptance mode" button BTd does not have to be displayed on the confirmation screen SCa. Alternatively, the "forced acceptance mode" button BTd may be displayed on the confirmation screen SCa regardless of whether an unacceptable gift certificate GT is detected or not.

[0109] Next, referring to Figures 8 and 9, we will explain the processing of gift certificates GT that have been determined to be unacceptable through the identification process.

[0110] Figure 8 is an explanatory diagram illustrating an example of an employee-only screen SCb for selecting the forced acceptance mode. The employee-only screen SCb is a screen reserved for employees and is displayed on the display operation unit 21 of the POS register 20 after employee authentication when selecting the forced acceptance mode.

[0111] Here, the POS register 20 has, for example, a forced settlement mode corresponding to the forced acceptance mode of the securities processing device 10. That is, in this embodiment, the POS register 20 has a normal mode for performing normal settlement processing and a forced settlement mode for performing forced settlement processing. The forced settlement mode is selected, for example, by selecting the forced acceptance mode of the securities processing device 10.

[0112] For example, an employee can perform a predetermined process, such as authentication, on the display operation unit 21 of the POS register 20, thereby displaying the employee-only screen SCb shown in Figure 8 on the display operation unit 21. The employee-only screen SCb displays, for example, multiple GUI buttons BT (BTe, BTf, BTg, and BTh).

[0113] The "Unlock Temporary Storage Unit" button BTe is a button BT used to unlock the temporary storage unit retrieval port 131 of the temporary storage unit 130. For example, when the "Unlock Temporary Storage Unit" button BTe is pressed, the temporary storage unit retrieval port 131 of the temporary storage unit 130 is unlocked. This allows the employee to retrieve the gift certificates GT stored in the temporary storage unit 130 from the securities processing device 10.

[0114] The "unlock storage compartment" button BTf is a button BT used to unlock the storage compartment retrieval opening 141 of the storage compartment 140. For example, when the "unlock storage compartment" button BTf is pressed, the storage compartment retrieval opening 141 of the storage compartment 140 is unlocked. This allows the employee to retrieve the gift certificates GT stored in the storage compartment 140.

[0115] The "forced acceptance of gift certificates" button BTg is a button BT used to switch the securities processing device 10 to forced acceptance mode. For example, when the "forced acceptance of gift certificates" button BTg is pressed, the securities processing device 10 transitions from normal mode to forced acceptance mode, and the POS register 20 transitions from normal mode to forced settlement mode. Specifically, when the "forced acceptance of gift certificates" button BTg is pressed, for example, the settlement screen SCc shown in Figure 9, which will be described later, is displayed on the display operation unit 21.

[0116] Furthermore, the "back" button BTh is a button BT used to return the screen displayed on the display operation unit 21 back to the screen that was displayed before the employee-only screen SCb was shown.

[0117] Note that the employee-only screen SCb is not limited to the example shown in Figure 8. For example, one or both of the "Unlock Temporary Storage" button BTe and the "Unlock Storage Compartment" button BTf do not need to be displayed on the employee-only screen SCb.

[0118] Figure 9 is an explanatory diagram illustrating an example of a settlement screen SCc for forcing the acceptance of gift certificates GT. For example, settlement screen SCc is an employee-only screen, and is displayed on the display operation unit 21 of the POS register 20 when the "Force Gift Certificate Acceptance" button BTg on the employee-only screen SCb shown in Figure 8 is pressed.

[0119] The settlement screen SCc displays, for example, multiple input windows IWD (IWDa and IWDb) for entering information on gift certificates GT to be forcibly accepted by the securities processing device 10, and multiple GUI buttons BT (BTh and BTi). Note that the "back" button BTh is the same as the "back" button BTh shown in Figure 8.

[0120] Input window IWDa is for entering the type of gift certificate GT, and input window IWDb is for entering the face value of the gift certificate GT. A dropdown menu is preferred for entering information into input window IWD, but it is also acceptable to directly enter a string indicating the type of gift certificate GT or other information into input window IWD.

[0121] In Figure 9, we assume that the gift certificate GT to be forcibly accepted by the securities processing device 10 is of type "XX Gift Card" and has a face value of "1000 yen". In this case, as shown in Figure 9, the employee enters "XX Gift Card" as the type of gift certificate GT into input window IWDa and "1000 yen" as the face value of the gift certificate GT into input window IWDb. After the employee has finished entering information into input windows IWDa and IWDb, they press the "Execute Forced Acceptance" button BTi. This confirms the information entered into input windows IWD (IWDa and IWDb).

[0122] Furthermore, if the “Force Acceptance Execution” button BTi is pressed, the amount to be settled by means other than the gift certificate GT will be reduced by the face value of the gift certificate GT used for settlement, and the settlement process will continue. For example, if the POS register 20 is a regular counter-type register or a semi-self-service register, the employee will continue the settlement process with the amount reduced by the face value of the gift certificate GT, and if the POS register 20 is a self-service register, the customer will continue the settlement process with the amount reduced by the face value of the gift certificate GT.

[0123] Specifically, for example, if only one gift certificate GT (XX gift card worth 1,000 yen) that is forcibly accepted by the securities processing device 10 is used for settlement, the amount to be settled by means other than the gift certificate GT will be reduced by 1,000 yen, and the settlement process will continue. Also, for example, if three gift certificate GTs with reading orders of "1", "2", and "3" as shown in Figure 7 are determined to be acceptable, and one gift certificate GT with reading order "4" as shown in Figure 7 is forcibly accepted by the securities processing device 10, the amount to be settled by means other than the gift certificate GT will be reduced by 21,000 yen, and the settlement process will continue. Note that 21,000 yen is the sum of the face values ​​of the four gift certificate GTs with reading orders of "1", "2", "3", and "4" as shown in Figure 7.

[0124] Note that the settlement screen SCc is not limited to the example shown in Figure 9. For example, the employee-only screen SCb shown in Figure 8 may include the settlement screen SCc shown in Figure 9. Specifically, a screen including the "Unlock Temporary Storage Unit" button BTe, the "Unlock Temporary Storage Unit" button BTe, the input window IWD (IWDa and IWDb), the "Force Acceptance Execution" button BTi, and the "Back" button BTh may be displayed on the display operation unit 21 of the POS register 20 as a screen that serves as both the employee-only screen SCb and the settlement screen SCc.

[0125] Thus, in this embodiment, even if a gift certificate GT is determined to be unacceptable by the identification process, if an employee determines that it is an acceptable gift certificate GT, it can be forcibly accepted by the securities processing device 10 and used for settlement. For example, in this embodiment, even gift certificate GTs that have slightly changed color due to fading, etc., can be forcibly accepted by the securities processing device 10. As a result, in this embodiment, the number of gift certificate GTs that are not accepted by the securities processing device 10, even though they have been visually confirmed by an employee and used for settlement, can be reduced. This reduces the need to manage gift certificate GTs that are not accepted by the securities processing device 10 separately from those that are accepted by the securities processing device 10. In other words, in this embodiment, the complexity of managing gift certificate GTs used for settlement can be suppressed.

[0126] Next, with reference to Figure 10, we will describe the general operation of the securities processing device 10 when an employee or customer processes a settlement for purchased goods using gift certificates GT.

[0127] Figure 10 is a flowchart showing an example of the operation of the securities processing device 10 when performing settlement processing using gift certificates GT. The process in step S100 is executed, for example, when an employee or customer inserts gift certificates GT into the input unit 110. In this embodiment, when settlement processing for purchased goods is performed using multiple gift certificates GT, it is assumed that the gift certificates GT are inserted into the input unit 110 one by one.

[0128] First, in step S100, the processing unit 150 functions as an operation control unit 152 and controls the transport unit 160 to feed the gift certificate GT inserted into the input unit 110 into the securities processing unit 10 (more specifically, the image reading unit 120). As a result, the gift certificate GT inserted into the input unit 110 passes through the image reading unit 120 in step S120.

[0129] In step S120, the image reading unit 120 reads the image IIMG of the gift certificate GT as it passes through the image reading unit 120. As a result, the image information of the gift certificate GT is generated by the image reading unit 120.

[0130] Next, in step S140, the processing unit 150 functions as an identification unit 154 and determines whether or not it can accept the gift certificate GT inserted into the input unit 110. The process in step S140 is the identification process of the gift certificate GT. As will be described in detail in Figure 11, in this embodiment, the identification process of the gift certificate GT (i.e., the process in step S140) includes multiple identification processes. Until the result of the determination by the process in step S140 (the result of the identification process) is known, the gift certificate GT is maintained in a state where a part of the gift certificate GT has passed the end ED2 of the image reading unit 120, as explained in Figure 2.

[0131] If the result of the determination in step S140 is negative, that is, if it is determined that the gift certificate GT cannot be accepted, the processing device 150 functions as the operation control unit 152 in step S162 and returns the gift certificate GT to the input unit 110. For example, in step S162, the operation control unit 152 reverses the transport roller ROL to transport the gift certificate GT held at the end ED2 of the image reading unit 120 to the input unit 110 and discharges it to the outside from the input unit 110. After executing the process in step S162, the processing device 150 proceeds to step S180.

[0132] On the other hand, if the result of the determination in step S140 is positive, that is, if it is determined that the gift certificate GT can be accepted, the processing device 150 proceeds to step S160.

[0133] In step S160, the processing unit 150 functions as an operation control unit 152 and controls the transport unit 160 to transport the gift certificate GT held at the end ED2 of the image reading unit 120 to the temporary storage unit 130. For example, the operation control unit 152 rotates the transport roller ROL in the forward direction to release the gift certificate GT held at the end ED2 of the image reading unit 120 and transport it to the temporary storage unit 130. As a result, the gift certificate GT determined to be acceptable is stored in the temporary storage unit 130. After executing the process in step S160, the processing unit 150 proceeds to step S180.

[0134] In step S180, the processing unit 150 functions as an operation control unit 152 and determines whether or not there is another gift certificate GT (a gift certificate GT to be inserted into the input unit 110).

[0135] For example, if the POS register 20 is a self-checkout register, the processing unit 150 may function as a display control unit 151 and display a selection screen on the display operation unit 21 of the POS register 20 to select whether or not there is a gift certificate GT to be inserted next. If it is selected via the selection screen that there is a gift certificate GT to be inserted next, the operation control unit 152 may determine that there is another gift certificate GT. In this case, the display control unit 151 may display an input screen on the display operation unit 21 instructing the insertion of the next gift certificate GT. Alternatively, if it is selected via the selection screen that there is no gift certificate GT to be inserted next, the operation control unit 152 may determine that there is no next gift certificate GT. In this case, the display control unit 151 may display an input screen on the display operation unit 21 instructing the execution of the settlement process.

[0136] Furthermore, for example, if the POS register 20 is a regular counter-type register or a semi-self-service register, the confirmation screen SCa is displayed on the display operation unit 21 of the POS register 20, as explained in Figures 6 and 7. The operation control unit 152 may, for example, determine that there is a next gift certificate GT when the "Next" button BTb on the confirmation screen SCa is pressed, and determine that there is no next gift certificate GT when the "Start Payment" button BTa or the "Forced Acceptance Mode" button BTd on the confirmation screen SCa is pressed.

[0137] If the result of the determination in step S180 is positive, that is, if there is another gift certificate GT to be inserted, the processing unit 150 returns to step S100. For example, if an employee or customer inserts the next gift certificate GT into the input unit 110, the series of processes from step S100 to step S140 are executed on the gift certificate GT inserted into the input unit 110 (the next gift certificate GT). Then, the series of processes in steps S160 and S180, or the series of processes in steps S162 and S180 are executed.

[0138] In this manner, when an employee or customer inserts n gift certificates GT consecutively (where n is a natural number greater than or equal to 2), after the mth gift certificate GT (where m is a natural number greater than or equal to 1 and less than n) is determined to be acceptable, in step S180, the presence or absence of the next gift certificate GT to be inserted is selected, and the (m+1)th gift certificate GT is inserted into the insertion unit 110. For example, if the first to third gift certificates GT were accepted, but the fourth gift certificate GT was determined to be unacceptable, a different gift certificate GT from the one returned (the fourth gift certificate GT) may be inserted into the insertion unit 110.

[0139] On the other hand, if the result of the determination in step S180 is negative, that is, if there are no gift certificates GT to be inserted next, the processing device 150 proceeds to step S190.

[0140] In step S190, the processing unit 150 functions as an operation control unit 152 and determines whether or not the normal settlement process is executed. For example, the operation control unit 152 may determine that the normal settlement process is not executed if the employee-only screen SCb shown in Figure 8 is displayed. If the POS register 20 is a normal counter-type register or a semi-self-service register, the operation control unit 152 can determine whether or not the normal settlement process is executed based on the button BT pressed on the confirmation screen SCa shown in Figure 6 or Figure 7. For example, the operation control unit 152 may determine that the normal settlement process is executed if the "Start Settlement" button BTa on the confirmation screen SCa is pressed, and determine that the normal settlement process is not executed if the "Forced Acceptance Mode" button BTd on the confirmation screen SCa is pressed.

[0141] If the result of the determination in step S190 is negative, that is, if the normal settlement process is not performed, the processing unit 150 proceeds to step S192.

[0142] On the other hand, if the result of the determination in step S190 is positive, that is, if the normal settlement process is to be executed, the processing unit 150 proceeds to step S200. Also, if the result of the determination in step S190 is positive, the employee or customer executes the settlement process via the POS register 20. If the POS register 20 is a self-checkout register, as described above, an input screen indicating that the settlement process will be executed may be displayed on the display operation unit 21 of the POS register 20. Here, for example, if the first to third gift certificates GT were accepted, but the fourth gift certificate GT was determined to be unacceptable, and the result of the determination in step S190 is positive, the normal settlement process using the first to third gift certificates GT is executed.

[0143] In step S200, the processing unit 150 functions as an operation control unit 152 and determines whether the settlement process has been completed. For example, if an employee or customer has completed the settlement process, the operation control unit 152 receives a notification from the POS register 20 via the communication device 170 indicating that the settlement process has been completed. Therefore, if the operation control unit 152 receives a notification from the POS register 20 via the communication device 170 indicating that the settlement process has been completed, it determines that the settlement process has been completed and proceeds to step S220. On the other hand, if the operation control unit 152 has not received a notification from the POS register 20 via the communication device 170 indicating that the settlement process has been completed, it determines that the settlement process has not been completed and returns to step S200.

[0144] Thus, if the result of the determination in step S200 is positive, the operation control unit 152 proceeds to step S220, and if the result of the determination in step S200 is negative, it returns to step S200. In other words, the operation control unit 152 waits to execute the process in step S220 until the settlement process is completed.

[0145] In step S220, the processing unit 150 functions as an operation control unit 152 and controls the opening / closing plate 132 of the temporary storage unit 130 to transport the gift certificates GT stored in the temporary storage unit 130 to the storage unit 140. For example, the operation control unit 152 transitions the state of the opening / closing plate 132 of the temporary storage unit 130 from an inclined state to a vertical state, thereby opening the transport path from the temporary storage unit 130 to the storage unit 140 and transporting the gift certificates GT stored on the opening / closing plate 132 to the storage unit 140. As a result, the gift certificates GT (gift certificates GT used in the settlement process) temporarily stored in the temporary storage unit 130 are stored in the storage unit 140.

[0146] The process in step S220 is executed, and the operation shown in Figure 10 is completed.

[0147] Thus, when the normal settlement process is performed, the securities processing device 10 operates in normal mode. If the normal settlement process is not performed, first, in step S192, the processing device 150 functions as the operation control unit 152 and determines whether or not the forced acceptance process is performed.

[0148] If the normal settlement process is not performed, the employee-only screen SCb is displayed on the display operation unit 21 of the POS register 20, as explained in Figures 7 and 8. The operation control unit 152 determines, for example, whether or not to perform the forced acceptance process based on the button BT pressed on the employee-only screen SCb. For example, the operation control unit 152 determines that the forced acceptance process will be performed if the "forced acceptance of gift certificates" button BTg on the employee-only screen SCb is pressed. Also, the operation control unit 152 determines that the forced acceptance process will not be performed if the "temporary storage unit unlock" button BTe or the "storage unit unlock" button BTf on the employee-only screen SCb is pressed.

[0149] If the result of the determination in step S192 is negative, that is, if neither the normal settlement process nor the forced acceptance process is executed, the processing unit 150 terminates the operation shown in Figure 10.

[0150] On the other hand, if the result of the determination in step S192 is positive, that is, if the normal settlement process is not performed but the forced acceptance process is performed, the processing unit 150 proceeds to step S300.

[0151] In step S300, the processing unit 150 functions as the operation control unit 152 and executes the forced acceptance process. As will be described in detail in Figure 13, the forced acceptance process executes a forced settlement process using the gift certificates GT that were determined to be unacceptable by the identification process, and the gift certificates GT that were determined to be unacceptable by the identification process are stored in the storage unit 140. The operation shown in Figure 10 ends when the forced acceptance process is completed.

[0152] Note that the operation of the securities processing device 10 is not limited to the example shown in Figure 10. For example, the processing device 150 may terminate the operation shown in Figure 10 after executing the process in step S162. In this case as well, the gift certificates GT stored in the temporary storage unit 130 can be retrieved by unlocking the temporary storage unit outlet 131 of the temporary storage unit 130. That is, in the configuration in which the operation shown in Figure 10 terminates after executing the process in step S162, the series of processes in steps S190, S192 and S300 may be omitted from the operation shown in Figure 10, and the forced acceptance process in step S300 may be executed separately from the operation shown in Figure 10.

[0153] Next, an example of the identification process will be explained with reference to Figure 11.

[0154] Figure 11 is a flowchart of an example of the identification process. The identification process shown in Figure 11 is executed as the process of step S140 in Figure 10 after the process of step S120 in Figure 10 has been executed. Therefore, the series of processes (identification process) from step S141 to step S148 is executed by the processing device 150 which functions as an identification unit 154.

[0155] First, in step S141, the identification unit 154 determines whether a reference image RIMG (image IIMG of an acceptable gift certificate GT) that matches the image of the gift certificate GT (gift certificate GT to be identified) inserted into the input unit 110 is stored in the gift certificate type table TBL. For example, the identification unit 154 compares each of the multiple reference image RIMGs stored in the gift certificate type table TBL with the image IIMG of the gift certificate GT to be identified. Then, based on the comparison result, the identification unit 154 determines whether there is a reference image RIMG among the multiple reference image RIMGs stored in the gift certificate type table TBL that matches the image IIMG of the gift certificate GT to be identified. In addition, in the gift certificate type determination process in step S141, the image reading unit 120 may obtain image information of both sides of the gift certificate GT and perform a determination of whether the gift certificate GT is front or back.

[0156] Furthermore, "match" as described above includes not only cases of exact matching, but also cases where the images are similar enough to be considered identical. For example, if the similarity of two images is equal to or greater than the first criterion, the two images may be considered to be identical. A known method can be used to calculate the similarity of two images.

[0157] Step S141 is a voucher type identification process that identifies the type of voucher GT to be identified. The voucher type identification process is explained in Figure 5, so a detailed explanation is omitted here. However, the flow of the voucher type identification process (step S141) will be described later in Figure 12.

[0158] If the result of the determination in step S141 is negative, that is, if it is determined that there is no reference image RIMG that matches the image IIMG of the gift certificate GT to be identified, the identification unit 154 determines that the gift certificate GT cannot be accepted and proceeds to step S162 in Figure 10. Therefore, if there is no reference image RIMG that matches the image IIMG of the gift certificate GT to be identified, the gift certificate GT held at the end ED2 of the image reading unit 120 is returned to the input unit 110 in step S162.

[0159] On the other hand, if the result of the determination in step S141 is positive, that is, if it is determined that there is a reference image RIMG that matches the image IIMG of the gift certificate GT to be identified, the identification unit 154 proceeds to step S146.

[0160] In step S146, the identification unit 154 performs character recognition processing, such as OCR processing, on the image IIMG of the gift certificate GT to be identified. For example, the identification unit 154 performs OCR processing on the expiration date area NAR within the image IIMG of the gift certificate GT to be identified. The information indicating the location of the expiration date area NAR within the image IIMG of the gift certificate GT is stored in the gift certificate type table TBL, as described in Figure 4, and is associated with the type of gift certificate GT. For example, the identification unit 154 refers to the gift certificate type table TBL and identifies the location of the expiration date area NAR of the gift certificate type corresponding to the reference image RIMG that matches the image IIMG of the gift certificate GT to be identified as the location of the expiration date area NAR within the image IIMG of the gift certificate GT to be identified. Then, the identification unit 154 extracts the characters contained in the expiration date area NAR within the image IIMG of the gift certificate GT by performing known OCR processing on the expiration date area NAR identified by referring to the gift certificate type table TBL within the image IIMG of the gift certificate GT to be identified. For example, the identification unit 154 extracts the string printed in the expiration date area NAR of the gift certificate GT to be identified as text data. This identifies the expiration date of the gift certificate GT to be identified.

[0161] The type of data extracted from the expiration date area NAR can be determined by the matching data used to compare the extracted data with the NAR data. For example, if the data is date data such as an expiration date, it is sufficient to match the numbers with "year", "month", "day", " / ", and ".".

[0162] After executing the process in step S146, the identification unit 154 proceeds to step S147.

[0163] In step S147, the identification unit 154 determines whether the gift certificate GT to be identified is a gift certificate GT that is within its validity period. For example, the identification unit 154 determines whether the gift certificate GT to be identified is a gift certificate GT that is within its validity period by comparing the date of the expiration date (the expiration date of the gift certificate GT to be identified) identified in the character recognition process in step S146 with today's date on which the settlement process is executed. The identification unit 154 may also determine that the gift certificate GT to be identified is not a gift certificate GT that is within its validity period if the expiration date is not printed in the expiration date area NAR identified by referring to the gift certificate type table TBL in the image IIMG of the gift certificate GT to be identified. In other words, the identification unit 154 may determine that the gift certificate GT to be identified is not a gift certificate GT that is within its validity period if the expiration date is not identified in the character recognition process in step S146.

[0164] If the result of the determination in step S147 is negative, that is, if it is determined that the gift certificate GT to be identified is not a gift certificate GT within its validity period, the identification unit 154 determines that the gift certificate GT cannot be accepted and proceeds to step S162 in Figure 10. Therefore, if the gift certificate GT to be identified is not a gift certificate GT within its validity period, the gift certificate GT held at the end ED2 of the image reading unit 120 is returned to the input unit 110 in step S162.

[0165] On the other hand, if the result of the determination in step S147 is affirmative, that is, if the gift certificate GT to be identified is determined to be a gift certificate GT within its validity period, the identification unit 154 proceeds to step S148. In this way, the characters printed in the validity period area NAR of the gift certificate GT are identified through the series of processes in steps S146 and S147. Hereafter, the series of processes in steps S146 and S147 will also be referred to as the character information identification process. The character information identification process (the series of processes in steps S146 and S147) corresponds to one of several identification processes.

[0166] In step S148, the identification unit 154 determines whether the gift certificate GT to be identified is a genuine gift certificate. A genuine gift certificate is a legitimate gift certificate GT that is not counterfeit. Hereafter, gift certificates GT that have been counterfeited by copying, etc., may be referred to as counterfeit. For example, the identification unit 154 performs a counterfeit identification process to determine whether the gift certificate GT to be identified is a counterfeit (a counterfeit gift certificate GT). That is, in step S148, the identification unit 154 determines that a gift certificate GT that has been determined not to be counterfeit by the counterfeit identification process is a genuine gift certificate.

[0167] For example, the identification unit 154 performs color analysis on the image IIMG of the gift certificate GT to be identified and determines whether the gift certificate GT is counterfeit or not. Here, for example, the color analysis results of each reference image RIMG are stored in the gift certificate type table TBL, corresponding to the type of gift certificate GT, as explained in Figure 4. For example, the identification unit 154 obtains the color analysis result of the reference image RIMG that matches the image IIMG of the gift certificate GT to be identified from the gift certificate type table TBL. By comparing the color analysis result of the reference image RIMG that matches the image IIMG of the gift certificate GT to be identified with the color analysis result of the image IIMG of the gift certificate GT to be identified, the identification unit 154 can determine whether the gift certificate GT to be identified is counterfeit or not. For example, by performing color analysis using the hue, brightness, and saturation of the image, it is possible to distinguish between simple fading and discoloration due to copying. Furthermore, by using AI, more accurate analysis is possible.

[0168] Furthermore, in the counterfeit identification process, in addition to judgment based on color, it is also possible to determine whether the target gift certificate GT is counterfeit by comparing a specific part within the image IIMG of the gift certificate GT and identifying the degradation of image resolution due to copying.

[0169] If the result of the determination in step S148 is negative, that is, if the gift certificate GT to be identified is determined not to be a genuine gift certificate, the identification unit 154 determines that the gift certificate GT cannot be accepted and proceeds to step S162 in Figure 10. Therefore, if the gift certificate GT to be identified is determined not to be a genuine gift certificate, that is, if the gift certificate GT to be identified is determined to be a counterfeit gift certificate, the gift certificate GT held at the end ED2 of the image reading unit 120 is returned to the input unit 110 in step S162.

[0170] On the other hand, if the result of the determination in step S148 is positive, that is, if the gift certificate GT to be identified is determined to be genuine, the identification unit 154 proceeds to step S160 in Figure 10. Therefore, if the gift certificate GT to be identified is determined to be genuine, that is, if the gift certificate GT to be identified is determined not to be counterfeit, the gift certificate GT held at the end ED2 of the image reading unit 120 is transported to the temporary storage unit 130 in step S160.

[0171] Here, the series of processes in steps S146 and S147 (character information identification process) and the process in step S148 (counterfeit identification process) are validity verification processes that confirm the validity of the gift certificate GT identified in the process in step S141 (certificate type identification process). Note that the validity verification process is not limited to the character information identification process and the counterfeit identification process. For example, as a validity verification process, a barcode process may be performed in which the barcode containing the encrypted JAN (Japanese Article Number) code printed on the gift certificate GT is read, and the validity of the gift certificate GT identified in the certificate type identification process is confirmed based on the information read from the barcode. For example, in the barcode process, if the certificate type identified based on the JAN code matches the certificate type of the gift certificate GT identified in the certificate type identification process, the gift certificate GT identified in the certificate type identification process is determined to be valid. The barcode process may be performed in addition to the character information identification process and the counterfeit identification process, or in place of one or both of the character information identification process and the counterfeit identification process. The validity verification process is an example of a "rejection determination process".

[0172] As described above, in the identification process shown in Figure 11, multiple identification processes (voucher type identification process, character information identification process, and counterfeit voucher identification process) determine whether or not the voucher GT to be identified is acceptable, thus preventing the incorrect determination of an unacceptable voucher GT as acceptable. Furthermore, in the identification process shown in Figure 11, each of the multiple identification processes is executed sequentially, and as soon as it is determined that the voucher GT is unacceptable, the process proceeds to step S162 in Figure 10. In other words, when the identification process shown in Figure 11 is executed, each identification process is executed sequentially, and as soon as it is determined that the voucher GT is unacceptable, the operation control unit 152 causes the transport unit 160 to perform a transport operation to move the voucher GT in reverse and transport it to the input unit 110, thereby discharging the voucher GT from the input unit 110 to the outside. For this reason, in this embodiment, compared to a configuration in which an unacceptable voucher GT is returned after all of the multiple identification processes have been completed, it is possible to suppress the time it takes to remove an unacceptable voucher GT from the machine.

[0173] Furthermore, in this embodiment, in addition to the ticket type identification process, character information identification and counterfeit ticket identification processes are also performed, so it is possible to identify expired gift certificates GT and counterfeit tickets. In other words, in this embodiment, for example, the probability that a gift certificate GT that cannot be used at a retail store where a POS register 20 is installed will be judged as acceptable can be reduced. As a result, in this embodiment, the number of times staff are called to retail stores such as supermarkets can be reduced, and the customer turnover rate can be improved. In addition, since the probability that a gift certificate GT that cannot be used at a retail store will be judged as acceptable can be reduced in this embodiment, it is also effective in reducing customer stress.

[0174] Note that the identification process is not limited to the example shown in Figure 11. For example, at least two of the processes in step S141, the series of processes in steps S146 and S147, and the process in step S148 may be executed in parallel. Specifically, for example, the series of processes in steps S146 and S147 and the process in step S148 may be executed in parallel. Executing multiple processes in parallel includes not only switching between processes but also executing multiple processes simultaneously. Note that, for example, the series of processes in steps S146 and S147 may be executed after the process in step S148.

[0175] Furthermore, for example, at least a part of the processing in step S148 (for example, color analysis of the image IIMG of the gift certificate GT to be identified) may be executed in parallel with the processing in step S141. Also, for example, the processing in step S141, the series of processing in steps S146 and S147, and the processing in step S148 may be executed in parallel. In this case, for example, the character recognition processing (for example, OCR processing) that extracts text data indicating the expiration date from the image IIMG of the gift certificate GT may be performed on the entire image IIMG of the gift certificate GT.

[0176] Even in the configuration where multiple identification processes are executed in parallel, when any of the multiple identification processes determines that the gift certificate GT is unacceptable, the operation control unit 152 causes the transport unit 160 to execute a transport operation to move the gift certificate GT in reverse and transport it to the input unit 110, thereby ejecting the gift certificate GT from the input unit 110 to the outside. Therefore, even in the configuration where multiple identification processes are executed in parallel, it is possible to suppress the time required to remove the unacceptable gift certificate GT from the machine. Furthermore, in the configuration where multiple identification processes are executed in parallel, if it is determined that none of the multiple identification processes have determined that the gift certificate GT is unacceptable, in step S160 of Figure 10, the gift certificate GT held at the end ED2 of the image reading unit 120 is transported to the temporary storage unit 130.

[0177] Furthermore, Figure 11 illustrates a case where three identification processes are performed as part of the identification process: the process in step S141 (voucher type identification process), the series of processes in steps S146 and S147 (character information identification process), and the process in step S148 (counterfeit voucher identification process). However, the present invention is not limited to this embodiment. For example, in addition to the three identification processes described above (voucher type identification process, character information identification process, and counterfeit voucher identification process), one or more of the following may be performed: an identification process based on the degree of notch and scale of the voucher GT identified by image processing, an identification process based on the thickness of the voucher GT, and an identification process using magnetism. Alternatively, one or more of the following may be performed instead of one or both of the character information identification process and the counterfeit voucher identification process: an identification process based on the degree of notch and scale of the voucher GT identified by image processing, an identification process based on the thickness of the voucher GT, and an identification process using magnetism. Alternatively, only the voucher type identification process may be performed from the three identification processes described above, or only two identification processes, including the voucher type identification process, may be performed.

[0178] Next, an example of ticket type identification processing will be explained with reference to Figure 12.

[0179] Figure 12 is a flowchart showing an example of the ticket type identification process. The ticket type identification process shown in Figure 12 is executed as the process in step S141 of Figure 11, after the process in step S120 of Figure 10 has been executed. Therefore, the series of processes from step S142 to step S145 (ticket type identification process) is executed by the processing device 150, which functions as the identification unit 154. The process in step S142 corresponds to the first process described in Figure 5, and the series of processes from step S143 to step S145 corresponds to the second process described in Figure 5.

[0180] First, in step S142, the identification unit 154 determines whether a reference image RIMG of a matching candidate whose similarity to the image of the gift certificate GT (gift certificate GT to be identified) inserted into the input unit 110 is equal to or greater than the first criterion value is stored in the gift certificate table TBL. For example, the identification unit 154 uses AI to calculate the similarity between each of the multiple reference image RIMGs stored in the gift certificate table TBL and the image IIMG of the gift certificate GT to be identified. Then, based on the similarity calculated using AI, the identification unit 154 determines whether there is a reference image RIMG of a matching candidate among the multiple reference image RIMGs stored in the gift certificate table TBL.

[0181] If the result of the determination in step S142 is negative, that is, if it is determined that there is no matching candidate reference image RIMG whose similarity to the image IIMG of the gift certificate GT to be identified is equal to or greater than the first criterion value, the identification unit 154 determines that the gift certificate GT cannot be accepted and proceeds to step S162 in Figure 10. Therefore, if there is no reference image RIMG that matches the image IIMG of the gift certificate GT to be identified, the gift certificate GT held at the end ED2 of the image reading unit 120 is returned to the input unit 110 in step S162.

[0182] On the other hand, if the result of the determination in step S141 is positive, that is, if it is determined that there is a matching candidate reference image RIMG whose similarity to the image IIMG of the gift certificate GT to be identified is equal to or greater than the first criterion value, the identification unit 154 proceeds to step S143.

[0183] In step S143, the identification unit 154 reads information about the feature portion FT (information showing the image and position coordinates of the feature portion FT) of the candidate reference image RIMG from the ticket type table TBL. If multiple candidate reference image RIMGs are identified as candidate reference image RIMGs, information about the feature portion FT of all candidate reference image RIMGs is read from the ticket type table TBL.

[0184] Next, in step S144, the identification unit 154 calculates the degree of matching between the feature portion FT of the candidate reference image RIMG and the image IIMG of the gift certificate GT to be identified, for each candidate reference image RIMG. For example, as explained in Figure 5, the identification unit 154 calculates the degree of matching between the feature portion FT of the candidate reference image RIMG by performing template matching using the image of the feature portion FT as a template image.

[0185] Next, in step S145, the identification unit 154 identifies the reference image RIMG with the highest matching degree calculated in step S144 as the reference image RIMG that matches the image IIMG of the gift certificate GT to be identified. After executing the process in step S145, the identification unit 154 proceeds to step S146 in Figure 11.

[0186] Note that the ticket type identification process is not limited to the example shown in Figure 12. For example, if there is no reference image RIMG of a matching candidate whose degree of matching calculated in step S144 is equal to or greater than the second criterion value, the identification unit 154 may determine that there is no reference image RIMG that matches the image IIMGf of the gift certificate GT to be identified, and proceed to step S162 in Figure 10. In other words, if there is no reference image RIMG of a matching candidate whose degree of matching is equal to or greater than the second criterion value, the identification unit 154 may determine that the gift certificate GT to be identified is unacceptable.

[0187] Furthermore, for example, before the series of processes from step S143 to step S145 are executed, the series of processes from step S146 to step S148 shown in Figure 11 may be executed on the reference image RIMG of the matching candidate. In other words, the series of processes from step S143 to step S145 may be executed on the reference image RIMG of the matching candidate whose validity has been confirmed by the series of processes from step S146 to step S148 shown in Figure 11.

[0188] Next, we will explain an example of compulsory acceptance processing, referring to Figure 13.

[0189] Figure 13 is a flowchart illustrating an example of a forced acceptance process. The forced acceptance process shown in Figure 13 is executed as the process in step S192 of Figure 10 if the result of the determination in step S192 of Figure 10 is positive. Also, if the result of the determination in step S192 of Figure 10 is positive, for example, the employee performs a forced settlement process via the POS register 20, as explained in Figure 9.

[0190] In step S310, the processing unit 150 functions as an operation control unit 152 and determines whether the forced settlement process has been completed. For example, if an employee completes the forced settlement process, the operation control unit 152 receives a notification from the POS register 20 via the communication device 170 indicating that the settlement process has been completed. Therefore, if the operation control unit 152 receives a notification from the POS register 20 via the communication device 170 indicating that the settlement process has been completed, it determines that the forced settlement process has been completed and proceeds to step S320. On the other hand, if the operation control unit 152 has not received a notification from the POS register 20 via the communication device 170 indicating that the settlement process has been completed, it determines that the forced settlement process has not been completed and returns to step S310.

[0191] Thus, if the result of the determination in step S310 is positive, the operation control unit 152 proceeds to step S320, and if the result of the determination in step S310 is negative, it returns to step S310. In other words, the series of processes from step S320 to step S340 are executed after the forced settlement process is completed. As a result, in this embodiment, the settlement process can be started quickly without making the customer wait.

[0192] In the operation shown in Figure 13, it is assumed that after the forced settlement process is completed, the gift certificates GT that were determined to be unacceptable in the identification process described in Figure 11, etc., are reinserted one by one into the input unit 110 as gift certificates GT subject to forced acceptance. Also, in the operation shown in Figure 13, it is assumed that the type of gift certificate GT subject to forced acceptance is specified by the employee before the process of step S324 is executed. For example, before the process of step S320 is executed, a screen similar to the settlement screen SCc shown in Figure 9 may be displayed on the display operation unit 21 of the POS register 20. Hereafter, the type of gift certificate GT specified by the employee as the type of gift certificate GT subject to forced acceptance may be referred to as the specified type. Also below, the reference image RIMG corresponding to the specified type may be referred to as the reference image RIMG of the specified type.

[0193] In step S320, the processing unit 150 functions as an operation control unit 152 and, similar to step S100 in Figure 10, controls the transport unit 160 to feed the gift certificate GT inserted into the input unit 110 into the securities processing unit 10 (more specifically, the image reading unit 120).

[0194] Next, in step S322, the image reading unit 120 reads the image IIMG of the gift certificate GT passing through the image reading unit 120, similar to step S120 in Figure 10. As a result, the image reading unit 120 generates image information of the gift certificate GT that is subject to compulsory acceptance.

[0195] Then, in step S324, the processing unit 150 functions as an identification unit 154 and stores the identification result (e.g., similarity and match rate, etc.) of the voucher type identification process for the voucher GT subject to compulsory acceptance as compulsory acceptance voucher information TINF in the storage device 156. For example, the identification unit 154 performs the same voucher type identification process as shown in Figure 12 on the voucher GT subject to compulsory acceptance. In the process corresponding to step S142 in Figure 12, the identification unit 154 uses AI to calculate the similarity between the reference image RIMG of the specified voucher type and the image IIMG of the voucher GT subject to compulsory acceptance. Then, regardless of whether the similarity is equal to or greater than the first criterion value, the identification unit 154 uses the information on the feature portion FT of the reference image RIMG of the specified voucher type and the image information of the voucher GT subject to compulsory acceptance to perform the process in step S144 in Figure 12. This calculates the match rate of the feature portion FT of the reference image RIMG of the specified voucher type with the image IIMG of the voucher GT to be identified. The identification unit 154 then stores the similarity between the reference image RIMG of the designated ticket type and the image IIMG of the gift certificate GT subject to compulsory acceptance, and the degree of agreement between the feature portion FT of the reference image RIMG of the designated ticket type and the image IIMG of the gift certificate GT subject to compulsory acceptance, in the storage device 156 as compulsory acceptance ticket information TINF. Preferably, the degree of agreement stores information indicating whether or not there is an image that matches the image of the feature portion FT of the reference image RIMG of the designated ticket type, and whether or not the position of the feature portion FT matches the position of the image that matches the feature portion FT.

[0196] Then, in step S326, the processing unit 150 functions as an identification unit 154 and stores the identification result of the character information identification process for the gift certificate GT subject to compulsory acceptance (for example, whether or not it is within its expiration date) as compulsory acceptance ticket information TINF in the storage device 156. For example, the identification unit 154 performs the same character information identification process as the series of processes in steps S146 and S147 shown in Figure 11 on the gift certificate GT subject to compulsory acceptance. The identification unit 154 then stores in the storage device 156 information indicating whether or not an expiration date is printed in the expiration date area NAR of the gift certificate GT subject to compulsory acceptance, and whether or not the date printed in the expiration date area NAR is within its expiration date, as compulsory acceptance ticket information TINF.

[0197] Next, in step S328, the processing unit 150 functions as an identification unit 154 and stores the identification results of the counterfeit identification process for the gift certificate GT subject to compulsory acceptance (e.g., color analysis results and resolution, etc.) in the storage device 156 as compulsory acceptance ticket information TINF. For example, the identification unit 154 performs the same counterfeit identification process as shown in step S148 in Figure 11 on the gift certificate GT subject to compulsory acceptance. The identification unit 154 then stores in the storage device 156 the results of the color analysis using the hue, lightness, and saturation of the image IIMG of the gift certificate GT subject to compulsory acceptance, as well as information indicating the resolution of a specific part of the image IIMG of the gift certificate GT subject to compulsory acceptance, as compulsory acceptance ticket information TINF.

[0198] Next, in step S330, the processing unit 150 functions as an operation control unit 152 and, similar to step S160, controls the transport unit 160 to transport the gift certificates GT to the temporary storage unit 130. In this way, in the compulsory acceptance process, regardless of the identification results of the gift certificate type identification process, character information identification process, and counterfeit identification process, the gift certificates GT subject to compulsory acceptance are transported to the temporary storage unit 130.

[0199] Then, in step S332, the processing unit 150 functions as an operation control unit 152 and determines whether or not there is another gift certificate GT (another gift certificate GT to be reinserted into the input unit 110). For example, the processing unit 150 may function as a display control unit 151 and display a selection screen on the display operation unit 21 of the POS register 20, which allows the user to select whether or not there is another gift certificate GT to be inserted, or a screen similar to the confirmation screen SCa shown in Figure 6. When a screen similar to the confirmation screen SCa shown in Figure 6 is displayed on the display operation unit 21 of the POS register 20, the name of the specified gift certificate may be displayed as the gift certificate name, and the face value may be the face value identified from the specified gift certificate.

[0200] If it is selected via the selection screen or the like that there is a gift certificate GT to be inserted next, the operation control unit 152 determines that there is a gift certificate GT to be inserted next. In this case, the display control unit 151 may display an input screen for specifying the type of gift certificate GT to be inserted next (for example, a screen similar to the settlement screen SCc shown in Figure 9) on the display operation unit 21. If it is selected via the selection screen or the like that there is no gift certificate GT to be inserted next, the operation control unit 152 determines that there is no gift certificate GT to be inserted next. In this case, the display control unit 151 may display a screen on the display operation unit 21 indicating that the forced acceptance process has ended.

[0201] If the result of the determination in step S332 is positive, that is, if there is another gift certificate GT to be inserted, the processing unit 150 returns to step S320. For example, if an employee inserts the next gift certificate GT to be subject to compulsory acceptance into the input unit 110, the series of processes from step S320 to step S330 are executed on the gift certificate GT to be subject to compulsory acceptance inserted into the input unit 110. Then, the process in step S332 is executed.

[0202] On the other hand, if the result of the determination in step S332 is negative, that is, if there are no gift certificates GT to be inserted next, the processing device 150 proceeds to step S340.

[0203] In step S340, the processing unit 150 functions as an operation control unit 152 and, similar to step S220, controls the opening / closing plate 132 of the temporary storage unit 130 to transport the gift certificates GT subject to compulsory acceptance stored in the temporary storage unit 130 to the storage unit 140. As a result, the gift certificates GT subject to compulsory acceptance are stored in the storage unit 140, and the operation shown in Figure 13 is completed.

[0204] Here, the operation shown in Figure 13 assumes that, as described above, a gift certificate GT that was determined to be unacceptable in the identification process is re-inserted into the input unit 110 as a gift certificate GT subject to compulsory acceptance. For this reason, the compulsory acceptance ticket information TINF stored in the storage device 156 in steps S324, S326, and S328 will always contain at least one factor (information) that does not satisfy the judgment criteria. The factor that does not satisfy the judgment criteria is the factor that caused the security processing device 10 (more specifically, the identification process performed by the security processing device 10) to determine that a gift certificate GT that an employee had confirmed to be acceptable was unacceptable.

[0205] Note that the compulsory acceptance process is not limited to the example shown in Figure 13. For example, the series of processes from step S320 to step S340 may be executed before the compulsory settlement process starts, or they may be executed in parallel with the compulsory settlement process. In an embodiment in which the series of processes from step S320 to step S340 and the compulsory settlement process are executed in parallel, for example, the type of gift certificate GT subject to compulsory acceptance may be specified by the information entered in the input windows IWD (IWDa and IWDb) of the settlement screen SCc shown in Figure 9.

[0206] Next, we will explain an example of compulsory acceptance voucher information (TINF) with reference to Figure 14.

[0207] Figure 14 is an explanatory diagram illustrating an example of compulsory acceptance voucher information TINF. Figure 14 assumes that eight compulsory acceptance voucher information TINFs corresponding to eight gift certificates GT are stored in the storage device 156. Furthermore, Figure 14 assumes that criteria other than similarity (e.g., degree of agreement) are also used for judgment.

[0208] Each compulsory acceptance voucher information TINF includes, for example, information indicating the voucher type name of the gift certificate GT, and information indicating the identification results of the voucher type identification process, character information identification process, and counterfeit voucher identification process performed on the gift certificate GT. For example, the voucher type name is the name of the voucher type designated by the employee as the voucher type subject to compulsory acceptance (designated voucher type), as explained in Figure 13.

[0209] Furthermore, for example, the identification result of the ticket type identification process is the similarity between the reference image RIMG of the designated ticket type and the image IIMG of the compulsory-accepted gift certificate GT, and the degree of match between the feature portion FT of the reference image RIMG of the designated ticket type and the image IIMG of the compulsory-accepted gift certificate GT. In Figure 14, it is assumed that the similarity is calculated in the range of 0.000 to 1.000, and the first criterion value, which is the criterion for determining similarity, is 0.900. For example, if the similarity is 0.900 or higher (greater than or equal to the first criterion value), information indicating that the similarity is greater than or equal to the first criterion value is stored, and if the similarity is less than 0.900 (less than the first criterion value), information indicating the value of the similarity is stored. The circle in the similarity column of Figure 14 indicates that the similarity is 0.900 or higher. Also, in Figure 14, it is assumed that the degree of match is calculated in the range of 0.000 to 1.000 based on the matching ratio of the feature portion FT, and the second criterion value, which is the criterion for determining the degree of match, is 0.900. Furthermore, in Figure 14, for ease of understanding, we assume that all eight designated ticket types shown in Figure 14 have five feature segments (FTs). If the degree of match is 0.900 or higher (above the second criterion), information indicating that the degree of match is above the second criterion is stored. If the degree of match is less than 0.900 (below the second criterion), information indicating the value of the degree of match is stored. The circles in the degree of match column in Figure 14 indicate that the degree of match is 0.900 or higher.

[0210] Furthermore, for example, the identification result of the character information identification process is the determination result of whether or not an expiration date is printed in the expiration date area NAR of the gift certificate GT subject to compulsory acceptance, and the determination result of whether or not the date printed in the expiration date area NAR is within the expiration period. For example, if an expiration date is printed in the expiration date area NAR, information indicating that an expiration date is printed is stored, and if an expiration date is not printed in the expiration date area NAR, information indicating that an expiration date is not printed is stored. The circle in the expiration date area NAR column of Figure 14 indicates that an expiration date is printed in the expiration date area NAR. Also, if the date printed in the expiration date area NAR is within the expiration period, information indicating that it is within the expiration period is stored, and if the date printed in the expiration date area NAR is not within the expiration period, information indicating that it is not within the expiration period is stored. The circle in the expiration date column of Figure 14 indicates that the date printed in the expiration date area NAR is within the expiration period.

[0211] Furthermore, for example, the identification result of the counterfeit voucher identification process is the result of color analysis of the hue, lightness, and saturation of the image IIMG of the gift certificate GT subject to compulsory acceptance, as well as the resolution of a specific part of the image IIMG of the gift certificate GT subject to compulsory acceptance. In Figure 14, it is assumed that the result of the color analysis of hue, the result of the color analysis of lightness, the result of the color analysis of saturation, and the resolution of a specific part are each quantified and calculated in the range of 0.000 to 1.000, and that the third criterion value, which is the judgment criterion for the quantified analysis result of each factor, is 0.900. For example, if the analysis result of each of the multiple factors (hue, lightness, saturation, and resolution of a specific part) is 0.900 or higher (3rd criterion value or higher), information indicating that the analysis result of that factor is 3rd criterion value or higher is stored, and if the analysis result of that factor is less than 0.900 (less than the 3rd criterion value), information indicating the value (quantified value) of the analysis result of that factor is stored. In Figure 14, the circles in the columns for hue, lightness, saturation, and resolution indicate that the analysis result value (quantified value) is 0.900 or higher.

[0212] In the example shown in Figure 14, five of the eight gift certificates GT are "XX Gift Card 1000 Yen Vouchers," and the degree of agreement for all five of these gift certificates GT is 0.800, which is below the second criterion value of 0.900. Therefore, in the example shown in Figure 14, in all five gift certificates GT, one of the five feature parts FT did not match the feature part FT of the reference image RIMG. This is presumed to indicate that for some reason, a particular feature part FT of the "XX Gift Card 1000 Yen Voucher" no longer matches the feature part FT of the reference image RIMG. Furthermore, information indicating which of the multiple feature parts FT did not match the feature part FT of the reference image RIMG may be stored as an identification result of the voucher type identification process.

[0213] Here, the compulsory acceptance voucher information TINF is used, for example, when changing the criteria used in the identification process (e.g., first criterion value, second criterion value, and third criterion value, etc.). For example, if, for a particular type of voucher, a factor is identified among several factors (similarity, degree of match, expiration date area NAR, hue, lightness, saturation, and resolution, etc.) that does not satisfy the criteria for multiple gift certificates GT, the criteria for the identified factor may be changed. In the example shown in Figure 14, the degree of match for "XX Gift Card 1000 Yen" is the factor that does not satisfy the criteria for multiple gift certificates GT. In this case, for example, the second criterion value, which is the criterion for the degree of match for "XX Gift Card 1000 Yen," may be changed from 0.900 to 0.800. When the second criterion value for the degree of match for "XX Gift Card 1000 Yen" is changed to 0.800, the five gift certificates GT corresponding to "XX Gift Card 1000 Yen" shown in Figure 14 are determined to be acceptable by the identification process of the securities processing device 10. In other words, in the example shown in Figure 14, by changing the second reference value of "XX Gift Card 1000 Yen," it is possible to appropriately determine in the identification process whether or not the "XX Gift Card 1000 Yen" gift certificate GT is acceptable. As a result, in this embodiment, for example, the probability that a gift certificate GT usable at a retail store where a POS register 20 is installed will be deemed unacceptable can be reduced. This reduces the number of times staff are called to retail stores such as supermarkets, thereby improving customer turnover. Furthermore, since this embodiment reduces the probability that a gift certificate GT usable at a retail store will be deemed unacceptable, it is also effective in reducing customer stress.

[0214] For example, when deciding whether or not to change the second threshold value for "XX Gift Card 1000 Yen," it is preferable to consider the number (percentage) of "XX Gift Card 1000 Yen" with a match score of 0.800 relative to the total number of "XX Gift Card 1000 Yen" gift certificates GT received by the securities processing device 10 during a specific period. For example, the second threshold value for "XX Gift Card 1000 Yen" may be changed only if the percentage of "XX Gift Card 1000 Yen" with a match score of 0.800 during a specific period is 80% or more. The decision to change other threshold values ​​may also be made using the same approach as for the second threshold value.

[0215] Next, referring to Figures 15 to 17, we will explain an example of an operation screen for changing the judgment criteria used in the identification process.

[0216] Figure 15 is an explanatory diagram illustrating an example of a criteria change selection screen SCd for selecting whether or not to perform a change in the judgment criteria. For example, the criteria change selection screen SCd is a screen exclusively for employees and is displayed on the display operation unit 21 of the POS register 20 when an employee manually changes the judgment criteria.

[0217] The reference change selection screen SCd displays, for example, several GUI buttons BT (BTh, BTj, and BTk). Note that the "Back" button BTh is the same as the "Back" button BTh shown in Figure 8.

[0218] The "Change Judgment Criteria" button BTj is a button BT used to change the judgment criteria used in the identification process. For example, when the "Change Judgment Criteria" button BTj is pressed, the change target selection screen SCe shown in Figure 16 is displayed on the display operation unit 21 of the POS register 20, which allows the user to select the judgment criterion to be changed from among multiple judgment criteria, including the ticket type identification process.

[0219] The "Do not change judgment criteria" button BTk is a button BT used to terminate the process for changing the judgment criteria (for example, the criterion change process shown in Figure 18). For example, if the "Do not change judgment criteria" button BTk is pressed, the process for changing the judgment criteria will be terminated.

[0220] Note that the criteria change selection screen SCd is not limited to the example shown in Figure 15. For example, the "Do not change the judgment criteria" button BTk does not need to be displayed on the criteria change selection screen SCd.

[0221] Figure 16 is an explanatory diagram illustrating an example of a change target selection screen SCe for selecting the criteria to be changed. For example, the change target selection screen SCe is a screen exclusively for employees and is displayed on the display operation unit 21 of the POS register 20 when the "Change Criteria" button BTj on the criterion change selection screen SCd shown in Figure 15 is pressed.

[0222] The SCe screen for selecting the item to change displays, for example, multiple GUI buttons BT (BTh, BTl, BTm, BTn, and BTo). Note that the "Back" button BTh is the same as the "Back" button BTh shown in Figure 8.

[0223] The "Change AI Judgment Criteria" button Btl is a button BT used to change the first similarity criterion value used when searching for a matching candidate reference image RIMG. For example, when the "Change AI Judgment Criteria" button Btl is pressed, a screen for changing the first criterion value (for example, the change information input screen SCf shown in Figure 17) is displayed on the display operation unit 21 of the POS register 20.

[0224] The "Change Template Matching Criteria" button BTm is a button BT used to change the second criterion value of the degree of match used when searching for a reference image RIMG that matches the image IIMGf of the gift certificate GT to be identified. For example, when the "Change Template Matching Criteria" button BTm is pressed, a screen for changing the second criterion value is displayed on the display operation unit 21 of the POS register 20.

[0225] The "Change Character Information Identification Criteria" button BTn is a button BT used to change the criteria for character information identification processing. Changing the criteria for character information identification processing also includes excluding the character information identification process from the identification process shown in Figure 11 (for example, omitting the series of processes in steps S146 and S147 from the identification process shown in Figure 11). For example, when the "Change Character Information Identification Criteria" button BTn is pressed, a screen for selecting whether or not to execute the character information identification process is displayed on the display operation unit 21 of the POS register 20.

[0226] The "Change Counterfeit Bill Identification Criteria" button BTo is a button BT used to change the third criterion value, which is the criterion for the counterfeit bill identification process. For example, when the "Change Counterfeit Bill Identification Criteria" button BTo is pressed, a screen for changing the third criterion value is displayed on the display operation unit 21 of the POS register 20.

[0227] Note that the change target selection screen SCe is not limited to the example shown in Figure 16. For example, a screen containing the contents of the change target selection screen SCe and the contents of the reference change selection screen SCd shown in Figure 15 may be displayed on the display operation unit 21 of the POS register 20. Specifically, in the reference change selection screen SCd shown in Figure 15, buttons BTl, BTm, BTn, and BTo may be displayed instead of button BTj.

[0228] Figure 17 is an explanatory diagram illustrating an example of a change information input screen SCf for changing the first criterion value, which is the similarity determination criterion. For example, the change information input screen SCf is a screen exclusively for employees and is displayed on the display operation unit 21 of the POS register 20 when the "Change AI Judgment Criteria" button BTL on the change target selection screen SCe shown in Figure 16 is pressed.

[0229] The change information input screen SCf displays, for example, a confirmation window CWD that shows the value of the judgment criterion to be changed (the first criterion value in Figure 17), i.e., the current value; an input window IWDc for entering the changed value of the judgment criterion; and GUI buttons BT (BTh and BTp). Note that the "Back" button BTh is the same as the "Back" button BTh shown in Figure 8.

[0230] When the modified value of the judgment criterion to be changed (0.880 in the example shown in Figure 17) is entered into the input window IWDc and the "Confirm" button BTp is pressed, the judgment criterion change unit 155 changes the judgment criterion according to the entered modification.

[0231] Note that the change information input screen SCf is not limited to the example shown in Figure 17. For example, the lower and upper limits of the judgment criteria may be displayed in the confirmation window CWD, and the values ​​of the lower and upper limits of the judgment criteria may be entered in the input window IWDc.

[0232] Next, we will explain an example of a criteria change process that modifies the judgment criteria, referring to Figure 18.

[0233] Figure 18 is a flowchart illustrating an example of a criteria change process for altering the judgment criteria. Note that Figure 18 shows the criteria change process when an employee manually changes the judgment criteria. For example, the criteria change process shown in Figure 18 is initiated when an employee performs a predetermined process such as authentication.

[0234] In step S400, the processing unit 150 functions as a display control unit 151 and displays the compulsory acceptance voucher information TINF on the display operation unit 21 of the POS register 20. This allows employees to analyze the contents of the identification results of the gift certificates GT accepted through the compulsory acceptance process, such as trends. The analysis of the contents of the gift certificates GT accepted through the compulsory acceptance process may be performed not only using the compulsory acceptance voucher information TINF already stored in the storage device 156, but also considering future prospects such as whether similar cases will continue to occur or whether it is a temporary incident. For example, the screen on which the compulsory acceptance voucher information TINF is displayed may also display a button BT to be pressed when the analysis of the contents of the compulsory acceptance voucher information TINF is completed.

[0235] Next, in step S420, the processing unit 150 functions as a display control unit 151 and displays a criterion change selection screen SCd on the display operation unit 21 of the POS register 20 for selecting whether or not to perform a change in the judgment criteria. For example, the display control unit 151 displays the criterion change selection screen SCd shown in Figure 15 on the display operation unit 21 of the POS register 20 when the analysis of the contents of the compulsory acceptance ticket information TINF is completed. Alternatively, the display control unit 151 may display a screen containing a list of compulsory acceptance ticket information TINF and the criterion change selection screen SCd shown in Figure 15 on the display operation unit 21 of the POS register 20.

[0236] Next, in step S440, the processing unit 150 functions as a judgment criterion change unit 155 and determines whether or not to change the judgment criterion. For example, the judgment criterion change unit 155 determines to change the judgment criterion if the "Change judgment criterion" button BTj on the criterion change selection screen SCd is pressed. Also, the judgment criterion change unit 155 determines not to change the judgment criterion if the "Do not change judgment criterion" button BTk on the criterion change selection screen SCd is pressed.

[0237] If the result of the determination in step S440 is positive, that is, if the determination criteria are to be changed, the processing unit 150 proceeds to step S460. On the other hand, if the result of the determination in step S440 is negative, that is, if the determination criteria are not to be changed, the processing unit 150 terminates the criteria change process shown in Figure 18.

[0238] In step S460, the processing unit 150 functions as a display control unit 151 and displays a change target selection screen SCe on the display operation unit 21 of the POS register 20 for selecting the judgment criterion to be changed. For example, when the "Change Judgment Criterion" button BTj on the criterion change selection screen SCd is pressed, the display control unit 151 displays the change target selection screen SCe shown in Figure 16 on the display operation unit 21 of the POS register 20.

[0239] Then, in step S462, the processing unit 150 functions as a display control unit 151 and displays a change information input screen SCf on the display operation unit 21 of the POS register 20 for inputting change information (changed information) for the judgment criterion to be changed. For example, the display control unit 151 displays a change information input screen SCf on the display operation unit 21 of the POS register 20 for inputting change information for the judgment criterion selected on the change target selection screen SCe. This allows employees to input change information, such as the changed value of the judgment criterion to be changed, to the securities processing unit 10 via the change information input screen SCf. After the change information for the judgment criterion to be changed has been input to the securities processing unit 10 via the change information input screen SCf, the processing unit 150 proceeds to step S480.

[0240] In step S480, the processing unit 150 functions as a judgment criterion change unit 155 and changes the judgment criterion based on the change information entered in step S462. For example, as shown in Figure 17, if the change information for the first criterion value entered into the securities processing unit 10 via the change information input screen SCf is 0.840, the judgment criterion change unit 155 changes the first criterion value from 0.900 to 0.840. After executing the process in step S480, the processing unit 150 returns to step S420.

[0241] Thus, in this embodiment, if there is a certain trend among gift certificates GT that should be accepted but are determined to be unacceptable, the criteria for determining the processing that shows that trend can be changed. Furthermore, in this embodiment, not only can the criteria for determining the processing be changed, but the processing in question may also be excluded from the determination. For example, in this embodiment, if there is an increase in the return of gift certificates GT whose expiration date area NAR used for character information identification processing has shifted significantly due to printing, the determination of the expiration date area NAR (and expiration date) can be excluded.

[0242] Here, the analysis of the trend of information that does not satisfy the judgment criteria requires that the number of gift certificates GT returned from the input unit 110 but deemed acceptable by the employee reaches a certain number. For this reason, the criterion change process shown in Figure 18 may be performed once a week, once a month, or during maintenance of the securities processing device 10. Alternatively, when the number of gift certificates GT returned from the input unit 110 but deemed acceptable by the employee reaches a certain number, a notification prompting the execution of the criterion change process may be displayed on the display operation unit 21 of the POS register 20.

[0243] Note that the criteria change process for altering the judgment criteria is not limited to the example shown in Figure 18. For example, regarding the changes, the judgment criteria change unit 155 may analyze the contents of the compulsory acceptance ticket information TINF, and the display control unit 151 may display the recommended changes on the display operation unit 21 of the POS register 20.

[0244] Furthermore, for example, the reasons or purpose for changing the judgment criteria may be stored in the memory device 156, etc. In this case, the judgment criteria can be managed very easily.

[0245] Furthermore, for example, changes to criteria other than the first similarity criterion used when searching for matching candidate reference images (RIMGs) may be performed for each reference image (RIMG). For example, in the example of compulsory acceptance voucher information (TINF) shown in Figure 14, only the second criterion (matching criterion) for "XX Gift Card 1000 Yen Voucher" may be changed to 0.800, while the second criterion for other voucher types remains at 0.900. In this case, the criteria can be appropriately changed according to the type of gift certificate (GT).

[0246] Furthermore, for example, multiple decision criteria corresponding to multiple processes may be changed in a single series of processes from step S460 to step S480. In this case, the processing unit 150 may terminate the criterion change process shown in Figure 18 after executing the process in step S480.

[0247] In this embodiment, the settlement processing system 1 includes at least a POS register 20, a change dispenser 30, and a securities processing device 10. The securities processing device 10 determines whether or not to accept the inserted gift certificate GT. The securities processing device 10 includes an input unit 110 into which gift certificates GT are inserted, a transport unit 160 for transporting the gift certificates GT inserted into the input unit 110, an image reading unit 120 for generating first image information showing image IIMG, which is an image of the gift certificates GT, an identification unit 154 for determining whether or not to accept the gift certificates GT by performing an identification process that identifies the gift certificates GT based on predetermined criteria using the first image information and second image information showing reference images RIMG, which are images of each of a plurality of pre-registered reference gift certificates GT, an operation control unit 152 for controlling the transport operation of the gift certificates GT by the transport unit 160 according to the determination result of the identification unit 154, a storage unit 140 for storing the gift certificates GT that can be accepted, and a determination criterion change unit 155 for changing the determination criteria based on forced acceptance information TINF, which relates to the identification result of gift certificates GT that were forcibly accepted despite being determined to be unacceptable in the identification process, when the determination criteria are changed.

[0248] Thus, in this embodiment, for example, if the number of gift certificates GT that should be accepted but are determined to be unacceptable increases, the judgment criteria can be changed based on the compulsory acceptance information TINF. As a result, in this embodiment, even with gift certificates GT, which have many types and many different versions depending on the issuance period, the type of gift certificate GT can be identified with high accuracy by changing the judgment criteria according to the actual situation. In other words, in this embodiment, by changing the judgment criteria according to the actual situation, it is possible to appropriately determine whether or not a gift certificate GT is acceptable in the identification process. As a result, in this embodiment, for example, the number of gift certificates GT that are determined to be unacceptable, which conventionally increases over time, can be significantly reduced. Therefore, in this embodiment, waiting times for employees or customers can be reduced, and settlement processing can be performed efficiently. Furthermore, since waiting times for employees or customers can be reduced in this embodiment, it is also effective in reducing stress for employees or customers.

[0249] Furthermore, in this embodiment, the identification process may include a first process that uses AI to calculate the similarity between image IIMG and reference image RIMG to search for a candidate image (hereinafter referred to as a matching candidate reference image RIMG) from among multiple reference image RIMGs corresponding to multiple reference gift certificate GTs whose similarity to image IIMG is equal to or greater than a first criterion value, and a rejection determination process that determines whether or not to accept the gift certificate GT based on information about the matching candidate reference image RIMG identified in the gift certificate identification process. The determination criterion changing unit 155 changes at least one determination criterion used in the process of determining that the gift certificate GT is not to be accepted among the gift certificate identification process and the rejection determination process.

[0250] Thus, in the above-described embodiment, the identification process includes a voucher type identification process and a rejection judgment process. At least one judgment criterion used in the process of determining that the gift certificate GT is unacceptable among the voucher type identification process and the rejection judgment process is changed. The AI ​​process is used in the first process of the voucher type identification process to calculate the similarity of the matching candidate reference image RIMG. Therefore, in this embodiment, even in the voucher type identification process using AI such as gift certificate GT, the first criterion value, which is the similarity judgment criterion used when searching for the matching candidate reference image RIMG, is the target of modification, rather than the AI ​​process whose algorithm is a black box. Furthermore, the rejection judgment process can utilize a known process with a clearly defined processing algorithm. For this reason, in this embodiment, the judgment criteria for the identification process can be easily changed compared to adjusting the judgment result of the AI ​​process, which is a black box.

[0251] Furthermore, in this embodiment, a feature portion FT may be predetermined for each of the multiple reference image RIMGs. The voucher type identification process may further include a second process that identifies the reference image RIMG with the highest degree of matching to the image IIMG of the feature portion FT predetermined for the reference image RIMG, from among the matching candidate reference image RIMGs searched in the first process. The rejection determination process may include a character recognition process that recognizes characters contained in the image IIMG, a character information identification process that determines whether or not to accept the voucher GT based on the information identified by the multiple characters recognized by the character recognition process, and a counterfeit voucher identification process that determines whether or not the voucher GT is counterfeit based on the first image information. The determination criterion changing unit 155 changes at least one determination criterion used in the process that determined that the voucher GT was not to be accepted, among the first process, the second process, the character information identification process, and the counterfeit voucher identification process.

[0252] Thus, in the above-described embodiment, the voucher type identification process includes a first process and a second process, and the rejection judgment process includes a character information identification process and a counterfeit voucher identification process. At least one judgment criterion used in the process that determines that the voucher GT is unacceptable among the first process, the second process, the character information identification process, and the counterfeit voucher identification process is changed. The judgment criteria that are subject to change in the voucher type identification process are the judgment criterion used in the first process (first criterion value) and the judgment criterion used in the second process. The second process can utilize a known image processing method with a clearly defined processing algorithm (e.g., template matching). The character information identification process and the counterfeit voucher identification process can also utilize a known process with a clearly defined processing algorithm. Therefore, in this embodiment as well, the judgment criteria for the identification process can be easily changed. Furthermore, in this embodiment, the identification result of the voucher type identification process can be adjusted by changing one or both of the judgment criteria used in the first process (first criterion value) and the judgment criteria used in the second process. Therefore, in this embodiment, in order to adjust the identification results of the voucher type identification process, it is no longer necessary to train the AI ​​to recognize voucher GTs that have only slightly changed in color due to different versions or fading as separate voucher GTs.

[0253] Furthermore, in this embodiment, the judgment criterion change unit 155 may change the judgment criteria based on change information obtained from an external input operation (e.g., a POS register 20) to change the judgment criteria based on the compulsory acceptance ticket information TINF. In this embodiment, since the judgment criteria are changed based on change information obtained from an external input operation, it is possible to suppress the complexity of the processing of the judgment criterion change unit 155.

[0254] [2. Variant] The present invention is not limited to the embodiments illustrated above. Specific variations are illustrated below. Two or more embodiments arbitrarily selected from the following examples may be combined.

[0255] [First variation] In the embodiments described above, an example was given in which an employee analyzes the contents of the compulsory acceptance voucher information TINF to determine the changes to the judgment criteria, but the present invention is not limited to this embodiment. For example, the processing device 150 (for example, the judgment criteria change unit 155) may analyze the contents of the compulsory acceptance voucher information TINF and automatically change the judgment criteria based on the analysis results. Specifically, for example, when the number of gift certificates GT forcibly accepted by the compulsory acceptance process exceeds a predetermined number or predetermined percentage, the judgment criteria change unit 155 uses the compulsory acceptance voucher information TINF to analyze the factors that were determined to be unacceptable by the identification process. Then, the judgment criteria change unit 155 automatically changes the judgment criteria based on the analysis results of the factors that were determined to be unacceptable by the identification process. In this modified example, the history of changes to the judgment criteria may be stored in the storage device 156 or the like. In this case, the management of the judgment criteria can be made easier. In this modified example, it may be possible to select between a method in which an employee determines the changes to the judgment criteria (the method of the first embodiment) and a method in which the judgment criteria change unit 155 automatically changes the judgment criteria.

[0256] In this modified version, the judgment criterion changing unit 155 identifies the factors that led to the refusal to accept the gift certificate GT based on the compulsory acceptance voucher information TINF, and changes the judgment criteria based on the identified factors. In this modified version, the same effects as in the embodiment described above can be obtained. Furthermore, in this modified version, since employees do not need to analyze the contents of the compulsory acceptance voucher information TINF, the workload of employees can be significantly reduced.

[0257] [Second variation] In the embodiment described above, for gift certificates GT that do not have an expiration date set, the series of processes (character information identification process) in steps S146 and S147 shown in Figure 11 may not be performed. For example, among the multiple gift certificates GT stored in the gift certificate table TBL, for gift certificates GT that do not have an expiration date set, information indicating that no expiration date is set may be stored instead of information indicating the position of the gift certificate GT in the expiration date area NAR. In this case, for example, the identification unit 154 can determine whether or not an expiration date is set for the gift certificate GT to be identified by referring to the field in the expiration date area NAR that corresponds to the reference image RIMG that matches the image IIMG of the gift certificate GT to be identified in the gift certificate table TBL. Thus, the same effects as in the embodiment described above can be obtained in this modified example as well. Furthermore, in this modified example, settlement processing using gift certificates GT that do not have an expiration date set can be easily performed.

[0258] [Third variation] In the embodiments and modifications described above, the identification unit 154 may store the identification results of each identification process as forced acceptance ticket information TINF in the storage device 156 without re-executing the ticket type identification process, character information identification process, and counterfeit ticket identification process in the forced acceptance process shown in Figure 13. For example, in the identification process shown in Figure 11, the identification unit 154 executes all of the ticket type identification process, character information identification process, and counterfeit ticket identification process regardless of the judgment result of each identification process, and temporarily stores the identification results of the gift certificates GT that are determined to be unacceptable in the storage device 156 or the like. Then, in the forced acceptance process, the display control unit 151 displays the gift certificates GT that are determined to be unacceptable on the display operation unit 21 of the POS register 20, as shown in the confirmation screen SCa in Figure 7. The employee specifies the gift certificates GT to be forcibly accepted by selecting them from the screen displaying the gift certificates GT that are determined to be unacceptable via that screen. In the compulsory acceptance process, the identification unit 154 reads the identification result corresponding to the gift certificate GT selected by the employee for compulsory acceptance from the identification results temporarily stored in the storage device 156, etc. The identification unit 154 then stores the read identification result (the identification result corresponding to the gift certificate GT selected by the employee for compulsory acceptance) in the storage device 156 as compulsory acceptance ticket information TINF.

[0259] In this modified example, the identification unit 154 may calculate the similarity between the image of the gift certificate GT subject to compulsory acceptance that has been reinserted into the input unit 110 and the image of the gift certificate GT subject to compulsory acceptance selected from the screen displaying the gift certificate GTs that have been determined to be unacceptable. The identification unit 154 may then determine, based on the similarity, whether the image of the gift certificate GT subject to compulsory acceptance that has been reinserted into the input unit 110 matches the gift certificate GT subject to compulsory acceptance selected from the screen displaying the gift certificate GTs that have been determined to be unacceptable. In this case, it is possible to suppress the compulsory acceptance of a gift certificate GT that is different from the gift certificate GT subject to compulsory acceptance selected from the screen displaying the gift certificate GTs that have been determined to be unacceptable by the securities processing device 10.

[0260] As described above, the same effects as those of the embodiments and modifications described can be obtained in this modified example as well.

[0261] [Fourth variation] In the embodiments described above, the input section 110 is provided on the upper surface of the securities processing device 10 (the surface that is grasped when viewing the securities processing device 10 from the +Z direction), but the present invention is not limited to this embodiment. For example, in the embodiments and modifications described above, the input section 110 may be provided on the front surface of the securities processing device 10 (the surface that is grasped when viewing the securities processing device 10 from the +X direction). In this modification as well, the same effects as in the embodiments and modifications described above can be obtained.

[0262] [Fifth variation] In the embodiments described above, the input section 110 is shown as serving as both an input port for inserting gift certificates GT and an output port for discharging the gift certificates GT inserted into the securities processing device 10. However, the present invention is not limited to this embodiment. For example, in the embodiments and modifications described above, the output port for discharging the gift certificates GT inserted into the securities processing device 10 may be provided separately from the input section 110. In this modified form as well, the same effects as in the embodiments and modifications described above can be obtained.

[0263] [Sixth variation] In the embodiments and modifications described above, multiple reference image RIMGs for multiple gift certificate GTs may be associated with a single gift certificate type information. In this case, for example, the expiration date area NAR and color analysis results are stored in the gift certificate type table TBL, associated with each of the multiple reference image RIMGs for multiple gift certificate GTs. In this modification, even if there are multiple gift certificate GTs with different designs for the same gift certificate type due to design changes, for example, it is possible to identify each gift certificate GT by type while suppressing the complexity of managing the reference gift certificate GTs. Thus, the same effects as in the embodiments and modifications described above can be obtained in this modification as well. [Explanation of Symbols]

[0264] 1...Settlement processing system, 10...Securities processing device, 20...POS register, 21...Display operation unit, 30...Change dispenser, 110...Input unit, 120...Image reading unit, 130...Temporary storage unit, 140...Storage unit, 150...Processing device, 151...Display control unit, 152...Operation control unit, 154...Identification unit, 155...Judgment criterion change unit, 156...Storage device, 160...Transport unit, 170...Communication device, TBL...Ticket type table, TINF...Mandatory acceptance ticket information, GT...Gift certificate.

Claims

1. In a securities processing system that determines whether or not to accept the securities that have been submitted, The input section into which the aforementioned securities are inserted, A transport unit for transporting the securities that have been inserted into the input unit, An image reading unit that generates first image information showing a first image which is an image of the security, An identification unit determines whether or not to accept a security by performing an identification process that identifies the security based on predetermined criteria, using the first image information and the second image information which is an image of each of a plurality of pre-registered reference securities. An operation control unit controls the transport operation of the securities by the transport unit according to the determination result of the identification unit, A storage compartment for storing the aforementioned securities that can be accepted, When changing the aforementioned criteria, a criteria change unit changes the criteria based on compulsory acceptance information relating to the identification results of securities that were forcibly accepted despite being determined to be unacceptable in the identification process, It is equipped with A securities processing device characterized by the following:

2. The aforementioned identification process is, A securities type identification process includes a first process that uses Artificial Intelligence (AI) to calculate the similarity between the first image and the second image, and searches for candidate images from among a plurality of second images corresponding to the plurality of reference securities whose similarity to the first image is equal to or greater than a certain threshold. A rejection determination process determines whether or not to accept the security based on the information of the candidate image identified in the security type identification process, Includes, The aforementioned judgment criterion changing unit is, The process used in determining whether the security is unacceptable among the security type identification process and the rejection determination process is to change at least one of the determination criteria used in the process that determines the security is unacceptable. The securities processing apparatus according to claim 1.

3. Each of the aforementioned plurality of second images has a predetermined feature portion, The aforementioned ticket type identification process is: A second process is performed to identify the candidate image among the candidate images searched in the first process that has the highest degree of match between the predetermined feature portion of the candidate image and the first image. Furthermore, The rejection determination process described above is: A character recognition process is performed to recognize characters contained in the first image, and a character information identification process is performed to determine whether or not to accept the securities based on the information identified by the multiple characters recognized by the character recognition process. A counterfeit certificate identification process that determines whether the security is counterfeit or not based on the first image information, Includes, The aforementioned judgment criterion changing unit is, The first process, the second process, the character information identification process, and the counterfeit certificate identification process, which determine that the security is unacceptable, are modified to change at least one of the determination criteria used in the process that determines that the security is unacceptable. The securities processing apparatus according to feature 2.

4. The aforementioned judgment criterion changing unit is, Based on the change information obtained by an external input operation to change the judgment criteria based on the compulsory acceptance ticket information, the judgment criteria are changed. A securities processing apparatus according to any one of claims 1 to 3.

5. The aforementioned judgment criterion changing unit is, Based on the compulsory acceptance information, identify the factors that led to the rejection of the securities, and modify the criteria for the rejection based on the identified factors. A securities processing apparatus according to any one of claims 1 to 3.

6. A settlement processing system having at least a POS register, a settlement processing device, and a securities processing device, The securities processing device is The input section into which securities are inserted, A transport unit for transporting the securities that have been inserted into the input unit, An image reading unit that generates first image information showing a first image which is an image of the security, An identification unit determines whether or not to accept a security by performing an identification process that identifies the security based on predetermined criteria, using the first image information and the second image information which is an image of each of a plurality of pre-registered reference securities. An operation control unit controls the transport operation of the securities by the transport unit according to the determination result of the identification unit, A storage compartment for storing the aforementioned securities that can be accepted, When changing the aforementioned criteria, a criteria change unit changes the criteria based on compulsory acceptance information relating to the identification results of securities that were forcibly accepted despite being determined to be unacceptable in the identification process, It is equipped with A settlement processing system characterized by the following:

7. The aforementioned identification process is, A securities type identification process includes a first process that uses AI to calculate the similarity between the first image and the second image to search for candidate images from among a plurality of second images corresponding to the plurality of reference securities, the second image having a similarity to the first image that is equal to or greater than a certain threshold; A rejection determination process determines whether or not to accept the security based on the information of the candidate image identified in the security type identification process, Includes, The aforementioned judgment criterion changing unit is, The process used in determining whether the security is unacceptable among the security type identification process and the rejection determination process is to change at least one of the determination criteria used in the process that determines the security is unacceptable. The settlement processing system according to feature 6.

8. Each of the aforementioned plurality of second images has a predetermined feature portion, The aforementioned ticket type identification process is: A second process is performed to identify the candidate image among the candidate images searched in the first process that has the highest degree of match between the predetermined feature portion of the candidate image and the first image. Furthermore, The rejection determination process described above is: A character recognition process is performed to recognize characters contained in the first image, and a character information identification process is performed to determine whether or not to accept the securities based on the information identified by the multiple characters recognized by the character recognition process. A counterfeit certificate identification process that determines whether the security is counterfeit or not based on the first image information, Includes, The aforementioned judgment criterion changing unit is, The first process, the second process, the character information identification process, and the counterfeit certificate identification process, which determine that the security is unacceptable, are modified to change at least one of the determination criteria used in the process that determines that the security is unacceptable. The settlement processing system according to feature 7.

9. The aforementioned judgment criterion changing unit is, Based on the change information obtained by an input operation from the POS register to change the judgment criteria based on the aforementioned compulsory acceptance ticket information, the judgment criteria are changed. The settlement processing system according to any one of claims 6 to 8.

10. A securities processing method performed by a securities processing apparatus comprising: an input unit into which securities are inserted; a transport unit for transporting the securities inserted into the input unit; an image reading unit for generating first image information showing a first image which is an image of the securities; a control unit for determining whether or not the securities can be accepted; and a storage unit for storing the securities that can be accepted, wherein The control unit, Using the first image information and the second image information, which shows images of each of a plurality of pre-registered reference securities, an identification process is performed to identify the security based on predetermined criteria, thereby determining whether the security is acceptable or not. In accordance with the determination result of the identification process, the transport unit controls the transport operation of the securities. When changing the aforementioned criteria, the criteria may be changed based on compulsory acceptance information relating to the identification results of securities that were forcibly accepted despite being determined to be unacceptable in the identification process. A method for processing securities, characterized by the following: