Transaction processing system

Abstract

To enable reduction of persons to be deployed in a shop.SOLUTION: A transaction processing system of an embodiment includes image pickup means, recognition means, approval means, registration means, and payment means. The image pickup means picks up an image of a commodity placed at a place provided in a shop to obtain the image. The recognition means recognizes the commodity reflected in the image using the image obtained by the image pickup means. The approval means causes staff at a location other than the shop to check a recognition result obtained by the recognition means and the image used by the recognition means in order to obtain the recognition result and receives approval by the staff about the recognition result obtained by the recognition means. The registration means registers a transaction commodity based on the recognition result approved by the approval means. The payment means causes a purchaser of the commodity placed at the place to make a payment for the transaction commodity registered by the registration means.SELECTED DRAWING: Figure 7

Description

Technical Field

[0001] Embodiments of the present invention relate to a transaction processing system.

Background Art

[0002] There is already known a transaction processing apparatus configured to register a transaction item by using a technique for recognizing a product based on features on an image of the product reflected in an image. However, due to the problem of recognition accuracy, confirmation by a store clerk of the recognition result has been required. Therefore, although the labor of the store clerk related to the operation of the transaction processing apparatus can be reduced, it has not led to a reduction in the number of store clerks. Under such circumstances, it has been desired to enable reduction of the number of personnel to be placed in a store.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] The problem to be solved by the present invention is to provide a transaction processing system capable of reducing the number of personnel to be placed in a store.

Means for Solving the Problems

[0005] The transaction processing system according to the embodiment includes a photographing unit, a recognition unit, First display means, an approval unit, a registration unit, and a settlement unit. The photographing unit photographs a product placed in a storage area provided in a store to obtain an image. The recognition unit uses the image obtained by the photographing unit to recognize the product reflected in the image. First display The approval unit causes a staff member to confirm, at a location different from the store, the recognition result by the recognition unit and the image used by the recognition unit to obtain the recognition result A confirmation screen is displayed for this purpose. The approval means is shown on the confirmation screen displayed by the first display means. Approval is obtained from an officer regarding the recognition results. The registration method is approved by the approval method. Accordingly, the products recognized by the recognition means Trading products as Register. The payment method involves having the buyer of the goods placed at the location pay for the goods registered through the registration method. [Brief explanation of the drawing]

[0006] [Figure 1] A block diagram showing the schematic configuration of a transaction processing system according to one embodiment. [Figure 2] A block diagram showing the main circuit configuration of a store terminal. [Figure 3] A diagram schematically representing the structure of transaction data. [Figure 4] A block diagram showing the main circuit configuration of the support and management device. [Figure 5] A diagram schematically representing the structure of a single data record included in the management data. [Figure 6] A block diagram showing the main circuit configuration of the trading support device. [Figure 7] A sequence diagram illustrating the processing involved in a single transaction. [Figure 8] A diagram illustrating the first example of a user interface screen. [Figure 9] A diagram illustrating a second example of a user interface screen. [Modes for carrying out the invention]

[0007] An example of an embodiment will be described below with reference to the drawings. Figure 1 is a block diagram showing the schematic configuration of the transaction processing system 1 according to this embodiment. The transaction processing system 1 is configured to enable communication between multiple store systems 10, recognition servers 20, and support systems 30 via a communication network 2. The communication network 2 can be the internet, VPN (virtual private network), LAN, public communication network, mobile communication network, etc., either individually or in appropriate combinations. As an example of the communication network 2, the internet or VPN is used.

[0008] Each of the multiple store systems 10 is installed in a separate store where goods are displayed and sold to customers who are buyers. The multiple stores may include multiple stores operated by the same operator, or stores operated by different operators. The store system 10 includes multiple store terminals 11, multiple cash registers 12, a gateway 13, and an in-store network 14. However, the store system 10 may include only one store terminal 11. Similarly, the store system 10 may include only one cash register 12. The number of store terminals 11 included in each of the multiple store systems 10 is arbitrary. Similarly, the number of cash registers 12 included in each of the multiple store systems 10 is arbitrary.

[0009] The store terminal 11 and the accounting machine 12 can communicate with each other via the in-store network 14. The store terminal 11 and the accounting machine 12 can also communicate via the communication network 2 via the in-store network 14 and the gateway 13. The store terminal 11 is an information processing device that functions as a user interface for the operator when processing transactions for the sale of goods to customers in a store. The operator of the store terminal 11 is primarily the customer. In some cases, a store employee may also operate the store terminal 11.

[0010] The accounting machine 12 is an information processing device that executes accounting processing related to the settlement of the above transactions. The accounting machine 12 receives operations by an operator during accounting processing. The operator of the accounting machine 12 is mainly a customer. In some cases, a store clerk may be the operator of the accounting machine 12. As the accounting machine 12, for example, an accounting machine that is currently used in an existing semi-self-service POS system can be used as it is. That is, the accounting machine 12 has a function as a settlement means.

[0011] The gateway 13 relays communication in the communication network 2 and communication in the in-store network 14. As the gateway 13, for example, a well-known communication device compatible with the communication method of the communication network 2 and the communication method of the in-store network 14 can be used as it is.

[0012] The in-store network 14 is a communication network provided within one store. Typically, a LAN is used as the in-store network 14. As the in-store network 14, any other arbitrary type of communication network that enables computer communication may be used.

[0013] The recognition server 20 processes the image data sent from the store terminal 11 and identifies the products reflected in the image represented by the image data. The recognition server 20 notifies the support system 30 of the recognition result. The recognition server 20 is realized, for example, as a cloud server that provides the above processing as a cloud service.

[0014] The support system 30 is provided at a support center provided at a location different from any of the multiple stores where the multiple store systems 10 are provided. The support system 30 is operated by an operator different from any of the operators of each of the multiple store systems 10. That is, the support system 30 provides support services related to transactions in the multiple store systems 10. However, it may be the case that one of the operators of each of the multiple store systems 10 and the operator of the support system 30 are the same.

[0015] The support system 30 includes a support management device 31, a plurality of transaction support devices 32, a gateway 33, and an in-center network 34. The support management device 31 and the plurality of transaction support devices 32 can communicate with each other via the in-center network 34. The support management device 31 and the transaction support devices 32 can also perform communication via the communication network 2 through the in-center network 34 and the gateway 33.

[0016] The support management device 31 is an information processing device that performs management processing for causing the plurality of transaction support devices 32 to perform support processing described later. The transaction support device 32 is an information processing device that executes support processing described later while receiving an operation by an operator. The operator of the transaction support device 32 is a staff member who is stationed at the support center and supports transactions at the store.

[0017] The gateway 33 relays communication in the communication network 2 and communication in the in-center network 34. As the gateway 33, for example, a well-known communication device compatible with the communication method of the communication network 2 and the communication method of the in-center network 34 can be directly used.

[0018] The in-center network 34 is a communication network provided within the support center. Typically, a LAN is used as the in-center network 34. As the in-center network 34, any other arbitrary type of communication network that enables computer communication may be used.

[0019] Figure 2 is a block diagram showing the main circuit configuration of the store terminal 11. The store terminal 11 includes a processor 111, a main storage unit 112, an auxiliary storage unit 113, a touch panel 114, a camera unit 115, a sound unit 116, a communication unit 117, and a transmission path 118. The processor 111 is connected to the main storage unit 112, the auxiliary storage unit 113, the touch panel 114, the camera unit 115, the sound unit 116, and the communication unit 117 via the transmission path 118.

[0020] By connecting the processor 111, the main storage unit 112, and the auxiliary storage unit 113 with a transmission line 118, a computer is configured to perform information processing for controlling the store terminal 11. The processor 111 corresponds to the central part of the computer described above. The processor 111 performs information processing to realize various functions as a store terminal 11, in accordance with information processing programs such as the operating system and application programs.

[0021] The main memory unit 112 corresponds to the main memory portion of the computer described above. The main memory unit 112 includes a read-only memory area and a rewritable memory area. The main memory unit 112 stores a portion of the information processing program described above in the read-only memory area. The main memory unit 112 may also store data necessary for the processor 111 to perform processing to control each part in the read-only memory area or the rewritable memory area. The main memory unit 112 uses the rewritable memory area as a work area for the processor 111.

[0022] The auxiliary storage unit 113 corresponds to the auxiliary storage portion of the computer described above. The auxiliary storage unit 113 can utilize, for example, an EEPROM (electric erasable programmable read-only memory), an HDD (hard disk drive), an SSD (solid state drive), or various other well-known storage devices. The auxiliary storage unit 113 stores data used by the processor 111 for various processing tasks and data generated by the processing performed by the processor 111. The auxiliary storage unit 113 may also store the information processing programs described above. In this embodiment, the auxiliary storage unit 113 stores the store terminal program PRA, which is one of the information processing programs. A portion of the storage area of ​​the auxiliary storage unit 113 is used as an area for storing transaction data DAA. Transaction data DAA is data representing a list of registered transaction products for a single transaction.

[0023] The touch panel 114 displays a screen for presenting information to the operator. The touch panel 114 also accepts input from the operator through touch operations on the screen. The camera unit 115 captures an image by photographing a shooting range that encompasses the entire predetermined location. The camera unit 115 then outputs image data representing the image obtained through the shooting. The camera unit 115 may be equipped with a still camera and repeat shooting at a fixed interval, or it may take pictures in response to instructions from the processor 111. The camera unit 115 may also be equipped with a video camera and shoot video. The camera unit 115 may be equipped with multiple shooting devices. The camera unit 115 is just one example of a shooting means.

[0024] The sound unit 116 includes a sound processor, amplifier, and speaker, and reproduces various sounds such as voices, chimes, buzzers, and music. The communication unit 117 performs communication processing for data communication via the in-store network 14. For example, an existing communication device for a LAN can be used as the communication unit 117. Access to the in-store network 14 by the communication unit 117 may be via a wired or wireless access method. The transmission line 118 includes an address bus, a data bus, and control signal lines, and transmits data and control signals exchanged between the connected parts.

[0025] Figure 3 is a schematic diagram illustrating the structure of the transaction data DAA. Transaction data DAA is generated for transactions processed using the store terminal 11 and stored in the auxiliary storage unit 113. The transaction data DAA includes field FAA, and can contain any number of additional fields from field FAB onward. Field FAA is set to the transaction code, which serves as the identifier for the transaction in question. If there are registered transaction products that are the subject of the transaction, fields FAB, FAC, ... associated with each transaction product are added to the transaction data DAA. Fields FAB, FAC, ... are each set to the product data DAB for a separate transaction product.

[0026] A single product data DAB contains the fields FBA, FBB, FBC, and FBD. The FBA field contains the product code, which serves as the identifier for the associated trading product. The FBB field contains the product name defined for the associated trading product. The FBC field contains the unit price of the associated trading product. The FBD field contains the quantity of the associated trading product. Note that product data may also contain other information, such as discount information.

[0027] The transfer of the store terminal 11 is generally carried out with the store terminal program PRA stored in the auxiliary storage unit 113. However, the hardware and the store terminal program PRA may be transferred separately, either without the store terminal program PRA stored in the auxiliary storage unit 113, or with a different version of the same type of application program stored in the auxiliary storage unit 113. Furthermore, the store terminal 11 may be configured by writing the store terminal program PRA to the auxiliary storage unit 113 in response to an operation by any worker. The transfer of the store terminal program PRA can be carried out by recording it on a removable recording medium such as a magnetic disk, magneto-optical disk, optical disk, or semiconductor memory, or by communication over a network.

[0028] Figure 4 is a block diagram showing the main circuit configuration of the support management device 31. The support management device 31 includes a processor 311, a main storage unit 312, an auxiliary storage unit 313, a communication unit 314, and a transmission line 315. The general functions of the processor 311, main memory unit 312, auxiliary memory unit 313, and transmission line 315 are the same as those of the processor 111, main memory unit 112, auxiliary memory unit 113, and transmission line 118, so their explanation will be omitted. However, the auxiliary memory unit 313 stores the management program PRB instead of the store terminal program PRA. The management program PRB is an application program that describes the procedures for the management processing described later. In addition, a portion of the memory area of ​​the auxiliary memory unit 313 is used to store management data DAC instead of transaction data DAA. Management data DAC is data for managing the allocation status of support processing to the transaction support device 32.

[0029] The communication unit 314 performs communication processing for data communication via the central network 34. For example, an existing communication device for a LAN can be used as the communication unit 314. Access to the central network 34 by the communication unit 314 may be via a wired or wireless access method.

[0030] Figure 5 schematically shows the structure of a single data record REA included in the management data DAC. The management data DAC is a collection of data records REA associated with each transaction being supported by the transaction support device 32. Therefore, the number of data records REA included in the management data DAC changes depending on the number of transactions being supported. When no support is being provided by any of the transaction support devices 32, the management data DAC will not contain any data records REA, or the management data DAC will not be stored in the auxiliary storage unit 313.

[0031] The data record REA includes fields FCA, FCB, FCC, and FCD. Field FCA contains the store code, which is the identifier of the store where the associated transaction is taking place. The store code is predetermined to identify all stores included in the transaction processing system 1. Field FCB contains the terminal code, which is the identifier of the store terminal 11 used in the associated transaction. The terminal code is predetermined to identify at least multiple store terminals 11 installed in the same store. Field FCC contains the transaction code, which is the identifier of the associated transaction. Field FCD contains the support device code, which is the identifier of the transaction support device 32 used to support the associated transaction. The support device code is predetermined to identify each individual transaction support device 32.

[0032] The basic hardware of the support management device 31 is expected to be, for example, the hardware of a general-purpose information processing device for servers. The transfer of the support management device 31 is generally carried out with the management program PRB stored in the auxiliary storage unit 313. However, the hardware and the management program PRB may be transferred separately, either without the management program PRB stored in the auxiliary storage unit 313, or with a different version of the same type of application program stored in the auxiliary storage unit 313. The support management device 31 may also be configured by writing the management program PRB to the auxiliary storage unit 313 in response to an operation by any operator. The transfer of the management program PRB can be carried out by recording it on a removable recording medium such as a magnetic disk, magneto-optical disk, optical disk, or semiconductor memory, or by communication over a network.

[0033] Figure 6 is a block diagram showing the main circuit configuration of the trading support device 32. The transaction support device 32 includes a processor 321, a main memory unit 322, an auxiliary memory unit 323, a touch panel 325, a sound unit 326, a communication unit 327, and a transmission line 328.

[0034] The general functions of the processor 321, main memory unit 312, auxiliary memory unit 323, touch panel 325, sound unit 326, and transmission line 328 are equivalent to those of the processor 111, main memory unit 112, auxiliary memory unit 113, touch panel 114, sound unit 116, and transmission line 118, and the general functions of the communication unit 327 are equivalent to those of the communication unit 314, so their explanation will be omitted. However, the auxiliary memory unit 323 stores the support program PRC instead of the store terminal program PRA. The support program PRC is an application program that describes the procedures for the support processing described later. In addition, a portion of the memory area of ​​the auxiliary memory unit 323 is used to store the setting data DAD instead of the transaction data DAA. The setting data DAD is data that represents the settings for each store. The settings represented by the setting data DAD include settings related to the user interface screen. The display unit 324 displays various screens for presenting information to the operator. A well-known device, such as a liquid crystal display device, can be used as the display unit 324.

[0035] The basic hardware of the trading support device 32 is expected to be, for example, the hardware of a general-purpose information processing device for servers. The transfer of the trading support device 32 is generally carried out with the support program PRC stored in the auxiliary storage unit 323. However, the hardware and the support program PRC may be transferred separately, either without the support program PRC stored in the auxiliary storage unit 323, or with a different version of the same type of application program stored in the auxiliary storage unit 323. The trading support device 32 may also be configured by writing the support program PRC to the auxiliary storage unit 323 in response to an operation by any operator. The transfer of the support program PRC can be carried out by recording it on a removable recording medium such as a magnetic disk, magneto-optical disk, optical disk, or semiconductor memory, or by communication over a network.

[0036] Next, the operation of the transaction processing system 1 configured as described above will be explained. Note that the processing described below is an example, and the order of some processes can be changed, some processes can be omitted, or other processes can be added as appropriate. For example, in the following explanation, some processes have been omitted in order to clearly illustrate the characteristic operation of this embodiment. For example, if an error occurs, processing to deal with that error may be performed, but such processing has been omitted from the description.

[0037] Figure 7 is a sequence diagram showing the processing involved in a single transaction. The customer picks up one or more items they wish to purchase from the store's display area. The customer then selects an unused store terminal 11 from among those available in the same store and places the items in the designated area for that terminal 11. The customer then initiates the transaction with the selected store terminal 11, for example, by performing a predetermined operation on the touch panel 114.

[0038] The processor 111 in the store terminal 11, which has been designated to start in this manner, begins transaction processing for a single transaction within the information processing based on the store terminal program PRA. In the following description of the operation, when simply referred to as "store terminal 11," it refers to the store terminal 11 from which transaction processing has now been started.

[0039] As ACT101, the processor 111 generates transaction data DAA. That is, for example, the processor 111 determines a new transaction code that is different from the transaction code used to identify other transactions according to predetermined rules, generates new transaction data DAA that includes this transaction code but does not include product information about the traded product, and stores it in the auxiliary storage unit 113.

[0040] As ACT102, the processor 111 notifies the support management device 31 of the start of a transaction. The processor 111 generates notification data in a predetermined format that includes, for example, the store code, the terminal code, and the transaction code determined in ACT101, and sends this notification data from the communication unit 117 to the support management device 31 and then to the in-store network 14. Each store terminal 11 has, for example, the store code of the store where the store terminal 11 is installed and the terminal code assigned to that store terminal 11 stored in the auxiliary storage unit 113 in advance. The processor 111 then includes the store code and terminal code stored in the auxiliary storage unit 113 in the notification data.

[0041] The notification data is transmitted to the support management device 31 via the in-store network 14, gateway 13, communication network 2, gateway 33, and the center network 34. The transmitted notification data is then received by the communication unit 314.

[0042] Now, in the support management device 31, the processor 311 awaits the start of a transaction to be supported within the management processing based on the management program PRB. Then, if the notification data is received by the communication unit 314 as described above, the processor 311 proceeds to ACT 311.

[0043] As ACT311, processor 311 determines which transaction support device 32 will be responsible for supporting the transaction for which the start of the transaction has been notified. For example, from among the transaction support devices 32 that are not performing the support processing described later, processor 311 selects one transaction support device 32 according to predetermined rules and determines that transaction support device 32 to be responsible. Then processor 311 adds a new data record REA to the management data DAC. In the data record REA added here, processor 311 sets the store code, terminal code, and transaction code included in the notification data into fields FCA, FCB, and FCC respectively, and sets the support device code of the transaction support device 32 determined to be responsible in the field FCD. In the following description of operations, when simply referred to as "transaction support device 32", it refers to the transaction support device 32 determined to be responsible here.

[0044] The above rules may be determined as appropriate by, for example, the creator of the management program PRB. For example, the rules may be set to equalize the load on the transaction support device 32. For example, the rules may be set to select the transaction support device 32 regardless of the store where the transaction takes place. For example, the rules may be set to select the transaction support device 32 that is pre-associated with the store where the transaction takes place. The rules may be set by combining the above examples and other rules. However, it is preferable that the rules be set so that one transaction support device 32 can be responsible for transactions at multiple stores.

[0045] As ACT312, processor 311 instructs transaction support device 32 to start support processing. For example, processor 311 generates instruction data in a predetermined form that includes the store code, terminal code, and transaction code included in the notification data, and sends this instruction data from communication unit 314 to transaction support device 32 via the central network 34. The instruction data is transmitted to the trading support device 32 via the central network 34. The transmitted instruction data is then received by the communication unit 327 of the trading support device 32.

[0046] Now, in the transaction support device 32, the processor 321 awaits an instruction to start support during support processing based on the support program PRC. If the instruction data is received by the communication unit 327 as described above, the processor 321 proceeds to ACT 321. As ACT321, processor 321 displays a user interface screen on touch panel 325 for operation by an employee to support transactions. The user interface screen displayed by processor 321 is adapted to the store where the store terminal 11 is located, based on the setting data DAD. In other words, processor 321 displays different user interface screens depending on the store where the transaction is taking place. Details of the interface screen will be described later. Thus, by having processor 321 perform information processing based on the support program PRC, the computer with processor 321 as its central component functions as a display means.

[0047] Now, if the processor 111 at the store terminal 11 notifies the start with ACT102, it proceeds to ACT103. As ACT103, the processor 111 starts transmitting the image data obtained by the camera unit 115 to the recognition server 20. If the camera unit 115 is equipped with a still camera and takes pictures at regular intervals, the processor 111 sequentially transmits all or part of the image data output by the camera unit 115 at regular intervals. If the camera unit 115 is equipped with a still camera and takes pictures in response to instructions from the processor 111, the processor 111 instructs it to take pictures at predetermined regular intervals and sequentially transmits the image data output from the camera unit 115 accordingly. Furthermore, if the camera unit 115 is equipped with a video camera and takes pictures of video, the processor 111 transmits the image data output by the camera unit 115, i.e., the video data. For example, when transmitting image data, the processor 111 compresses and encodes the image data output by the camera unit 115 using a predetermined encoding method, and then sends a predetermined form of transfer data, which includes this encoded image data and the terminal code of the sending store terminal 11, from the communication unit 117 to the recognition server 20 and then to the in-store network 14. The transfer data is transmitted to the recognition server 20 via the in-store network 14, gateway 13, and communication network 2.

[0048] Upon receiving the above transfer data, the recognition server 20 proceeds to ACT201. As ACT201, the recognition server 20 starts processing for product recognition (hereinafter referred to as the recognition process). In the recognition process, the recognition server 20 recognizes products that appear in the image represented by the image data included in the transferred data, based on the features of the product that are displayed in the image. As the recognition process, for example, a well-known process using a machine learning-trained image recognition engine can be applied. In other words, the recognition server 20 is equipped with the function of a recognition means.

[0049] The recognition server 20 may not be able to recognize the product if the product is not visible in the image, or depending on how the product is visible in the image. If the recognition server 20 successfully recognizes the product as ACT202, it proceeds to ACT203.

[0050] As ACT203, the recognition server 20 notifies the support management device 31 of the recognition result. For example, the recognition server 20 sends notification data in a predetermined format to the support management device 31 via the communication network 2, which includes the product code as an identifier for the recognized product, the image data taken into consideration when the product was successfully identified, and the terminal code included in the transferred data along with the image data. The notification data is transmitted to the support management device 31 via the communication network 2, gateway 33, and the center network 34. The transmitted notification data is then received by the communication unit 314 of the support management device 31.

[0051] If the processor 311 receives notification data for notifying the recognition result via the communication unit 314, as described above, it proceeds to ACT 313. As ACT313, processor 311 forwards the notification data received as described above to transaction support device 32. In other words, processor 311 determines which transaction support device 32 is responsible for supporting transactions using the store terminal 11 identified by the terminal code included in the notification data, and sends the notification data from communication unit 314 to the central network 34 addressed to that transaction support device 32. More specifically, processor 311 finds, for example, the data record REA in management data DAC in which the terminal code included in the notification data is set in field FCB. Then, processor 311 sets the transaction support device 32 identified by the support device code set in field FCD of the corresponding data record REA as the forwarding destination.

[0052] When the notification data is received by the communication unit 327 in the transaction support device 32, the processor 321 proceeds to ACT 322. As ACT322, processor 321 displays a confirmation screen on display unit 324 for the staff member to confirm the recognition result. The confirmation screen may, for example, display the product name of the recognized product and an image based on the image data.

[0053] The staff member checks the confirmation screen and verifies whether the recognition result is correct. If the staff member determines that the recognition result is correct, they perform a predetermined operation to approve the recognition result, for example, on the touch panel 325. If the staff member determines that the recognition result is incorrect, they identify the product based on the image displayed on the confirmation screen and perform a predetermined operation to select that product, for example, on the touch panel 325.

[0054] Figure 8 shows a first example of a user interface screen. Figure 9 shows a second example of a user interface screen. Both Figures 8 and 9 show only some of the display objects, and the illustration of some display objects has been omitted.

[0055] The user interface screens shown in Figures 8 and 9 both include buttons BUA and BUB. Button BUA is a soft key for obtaining staff approval regarding the recognition result. Button BUB is a soft key for receiving staff designation to call a store employee. Furthermore, the user interface screen shown in Figure 8 includes a button group BGA. The user interface screen shown in Figure 9 also includes a button group BGB. Button group BGA contains 15 preset buttons for selecting products. In contrast, button group BGB contains 10 preset buttons for selecting products, and the size of each of these preset buttons is larger than that of button group BGA. Also, the products preset for each preset button are different between button group BGA and button group BGB. The strings such as "AAAA" or "PPPPPP" displayed above each preset button are actually strings that represent product names, etc. The user interface screen shown in Figure 8 is more suitable for stores where there are many products that are likely to be selected by staff members because they may fail to be recognized by the recognition server 20, compared to the user interface screen shown in Figure 9.

[0056] If the staff member approves the recognition result displayed on the confirmation screen, they tap, for example, the BUA button. If the staff member does not approve the recognition result displayed on the confirmation screen, they specify the product, for example, by tapping one of the preset keys included in the user interface screen. Once such an operation is performed by the staff member, processor 321 proceeds to ACT323. As ACT323, processor 321 determines which products should be registered in response to operations by the staff member. That is, for example, if the staff member approves the recognition result, processor 321 determines that the product recognized by the recognition server 20 should be registered. Also, for example, if the staff member specifies a product, processor 321 determines that the specified product should be registered. Thus, by having processor 321 perform information processing based on the support program PRC, the computer with processor 321 as its central component functions as an approval means and a designation means.

[0057] As ACT324, processor 321 requests the store terminal 11 to register the determined product. For example, processor 321 sends a predetermined form of request data, including the product code of the determined product, from the communication unit 327 to the central network 34, addressed to the store terminal 11 identified by the terminal code included in the notification data for result notification. Thus, by having processor 321 perform information processing based on the support program PRC, the computer with processor 321 as its central component functions as a notification means.

[0058] This request data is transmitted to the designated store terminal 11 via the central network 34, gateway 33, communication network 2, gateway 13, and in-store network 14. The request data is then received by the communication unit 117 of the designated store terminal 11.

[0059] As described above, upon receiving the request data at the store terminal 11, the processor 111 proceeds to ACT 104. As ACT104, processor 111 registers a product as a transaction product upon request. For example, processor 111 adds new product data to the transaction data DAA regarding the product identified by the product code included in the request data. Thus, by having processor 111 perform information processing based on the store terminal program PRA, the computer with processor 111 as its central component functions as a registration means.

[0060] As ACT105, processor 111 displays a guidance screen on touch panel 114 to instruct the customer to remove the product registered as a transaction item from its storage location. Customers follow the instructions on the guidance screen to remove registered items from the designated area and bag them.

[0061] If another product is already in the storage area, then the following products will be registered as trading products in the same manner as ACT202, ACT203, ACT313, ACT322, ACT323, ACT324, ACT104, and ACT105, as ACT204, ACT205 respectively. If yet another product is already in the storage area, the same process will be repeated.

[0062] Once the customer has removed all the items they placed in the storage area, they specify payment by performing a predetermined operation, for example, on the touch panel 114. After such an operation is performed, the processor 111 proceeds to ACT 108. As ACT108, processor 111 notifies support management device 31 of the completion of the transaction. For example, processor 111 generates notification data in a predetermined format that includes the store code, terminal code, and transaction code determined in ACT101, and sends this notification data from communication unit 117 to support management device 31 and then to the in-store network 14. The notification data is transmitted to the support management device 31 via the in-store network 14, gateway 13, communication network 2, gateway 33, and the center network 34. The transmitted notification data is then received by the communication unit 314.

[0063] Upon receiving the above notification data, processor 311 proceeds to ACT315. As ACT315, processor 311 instructs transaction support device 32, which is providing support for the transaction that has been notified of termination, to terminate the support processing. For example, processor 311 finds data record REA in management data DAC in which the store code, terminal code, and transaction code included in the notification data are set in fields FCA, FCB, and FCC, respectively. Then, processor 311 sends instruction data in a predetermined format for termination from communication unit 314 to the center network 34, addressed to transaction support device 32, which is identified by the support device code set in field FCD of the corresponding management data DAC. The instruction data is transmitted to the trading support device 32 via the central network 34. The transmitted instruction data is then received by the communication unit 327 of the designated trading support device 32. In response, the processor 321 proceeds to ACT 328. As ACT328, processor 321 causes display unit 324 to display a predetermined notification screen to inform the agent of the completion of the transaction.

[0064] Furthermore, as ACT109, the processor 111 at the store terminal 11 stops transmitting image data. When it can no longer receive image data as a result, the recognition server 20 stops recognition as ACT206. As ACT110, the processor 111 at the store terminal 11 requests the accounting machine 12 to settle the payment for all registered transaction items. That is, the processor 111 generates request data in a predetermined form that includes transaction data DAA. Then, the processor 111 sends the request data to the accounting machine 12 that has been pre-assigned to one of the multiple accounting machines 12. Alternatively, the processor 111 may calculate the amount to be settled and request the accounting machine 12 to settle that amount. Or, the processor 111 may request payment from the accounting machine 12 selected by the customer in response to the request from that accounting machine 12. The accounting machine 12 then performs the settlement process to allow the customer to pay the corresponding amount.

[0065] As described above, the transaction processing system 1 displays the results of product recognition from images on a transaction support device 32 installed at a support center different from the store where the transaction takes place, allowing staff stationed at the support center to confirm the results. This eliminates the need to assign personnel to each store terminal 11 to verify the results of product recognition from images, thus enabling a reduction in the number of personnel that need to be stationed at the store.

[0066] Furthermore, the transaction processing system 1 can assign support processing related to transactions conducted using multiple store terminals 11 installed in one store, and even multiple store terminals 11 installed in multiple stores, to a single transaction support device 32. In this way, one staff member can be responsible for multiple store terminals 11, enabling efficient support and reducing the overall number of personnel required for the system.

[0067] Furthermore, the transaction support device 32 changes the user interface screen according to the store where the transaction to be supported takes place. This makes it easy for staff to perform operations that are adapted to the specific circumstances of each store.

[0068] This embodiment can be modified in various ways as follows: As a means of capturing images, a camera unit externally attached to the store terminal 11 may be used. Alternatively, as a means of capturing images, a network camera that is directly connected to the in-store network 14 or the communication network 2 and transmits image data to the recognition server 20 without going through the store terminal 11 may be used.

[0069] The recognition process may be performed by any of the processors 111, 311, or 321, or by a processor in any other information processing device. In other words, the function as a means of recognition may be provided in any information processing device other than the recognition server 20.

[0070] The process for registering trading products may be performed by a processor in either processor 311, 321, or any other information processing device. In other words, the function as a means of registration may be provided in any information processing device other than the store terminal 11.

[0071] The store terminal 11 may also be equipped with the functions of a cashier 12.

[0072] Each of the functions realized by processors 111, 311, and 321 through information processing can also be partially or entirely realized by hardware that performs non-program-based information processing, such as logic circuits. Furthermore, each of the above functions can also be realized by combining the above-mentioned hardware, such as logic circuits, with software control.

[0073] While several embodiments of the present invention have been described, these embodiments are presented as examples only and are not intended to limit the scope of the invention. These novel embodiments can be carried out in a variety of other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, as well as in the claims of the invention and its equivalents. The invention described in the original claims of this application is listed below. [Note 1] A photographic means for taking pictures of products placed in designated areas within a store and obtaining images of those products, A recognition means that uses the image obtained by the aforementioned photographic means to recognize the product that is visible in the image, An approval means for having an employee at a location other than the store confirm the recognition result obtained by the recognition means and the image used by the recognition means to obtain the recognition result, and for obtaining approval from the employee regarding the recognition result obtained by the recognition means, A registration means for registering trading products based on the recognition result approved by the aforementioned approval means, A payment means that causes the buyer of the goods placed in the storage area to pay the price for the goods registered by the registration means, A transaction processing system equipped with the following features. [Appendix 2] The system further comprises a designation means for receiving a designation by the staff of a product different from the recognition result by the recognition means, The registration means registers trading products based on the recognition results approved by the approval means, and also registers products designated by the designation means as trading products. The transaction processing system described in Appendix 1. [Note 3] A plurality of store terminals, each associated with a plurality of storage locations, are provided with the aforementioned photographing means and the aforementioned registration means. A transaction support device equipped with the aforementioned approval means, Includes, The transaction support device further includes a notification means for notifying the store terminal, which is equipped with a shooting means that has taken a picture of the image used by the recognition means to obtain the recognition result that was the subject of the approval, that approval has been granted by the approval means. The registration means registers the trading product based on the recognition result that has been approved and notified by the notification means. The transaction processing system described in Appendix 1. [Note 4] At least several of the aforementioned multiple store terminals are associated with each of the multiple locations designated within each of the multiple stores. The transaction processing system described in Appendix 3. [Note 5] Multiple store terminals equipped with the aforementioned photographic means, each associated with a designated location in each of the multiple stores, A transaction support device equipped with the aforementioned approval means, Includes, The aforementioned transaction support device is A designation means for receiving a designation by the staff of a product different from the recognition result by the recognition means, A display means that displays different user interface screens in order to receive designation by the designation means, depending on which of the above-mentioned multiple stores the transaction to be supported, Equipped with, The registration means registers trading products based on the recognition results approved by the approval means, and also registers products designated by the designation means as trading products. The transaction processing system described in Appendix 1. [Explanation of symbols]

[0074] 1...Transaction processing system, 2...Communication network, 10...Store system, 11...Store terminal, 12...Accounting machine, 13...Gateway, 14...In-store network, 20...Recognition server, 30...Support system, 31...Support management device, 32...Transaction support device, 33...Gateway, 34...Center network, 111, 311, 321...Processor, 112, 312, 322...Main memory unit, 113, 313, 323...Auxiliary memory unit, 114, 325...Touch panel, 115...Camera unit, 116, 326...Sound unit, 117, 314, 327...Communication unit, 118, 315, 328...Transmission path, 324...Display unit.

Claims

1. A photographic means to obtain images by taking pictures of products placed in designated areas within a store, A recognition means that uses the image obtained by the aforementioned photographic means to recognize one of the products that appear in the image, A first display means that displays a confirmation screen for allowing an employee to confirm the recognition result obtained by the recognition means and the image used by the recognition means to obtain the recognition result, at a location other than the store. Approval means for obtaining approval by the staff member for the recognition result shown on the confirmation screen displayed by the first display means, A registration means that registers the goods recognized by the recognition means as trading goods in accordance with the approval obtained by the approval means, A payment means that causes the buyer of the goods placed in the storage area to pay the price for the goods registered by the registration means, It is equipped with, The recognition means recognizes a product other than the one registered as a trading product by the registration means if it is placed in the storage area. The first display means displays a confirmation screen each time the recognition means successfully recognizes something. The approval means, each time a confirmation screen is displayed by the first display means, receives approval for the recognition result shown on the confirmation screen. The registration means adds the product recognized by the recognition means to the trading products each time approval is received by the approval means. Transaction processing system.

2. The system further comprises a designation means for receiving a designation from the staff of a product different from the recognition result obtained by the recognition means, The registration means registers the goods recognized by the recognition means as trading goods in accordance with the approval received by the approval means, and also registers the goods that are subject to the designation received by the designation means as trading goods in accordance with the designation received by the designation means. The transaction processing system according to claim 1.

3. The system includes the aforementioned photographing means and the aforementioned registration means, and multiple store terminals associated with each of the multiple storage locations, A transaction support device comprising the first display means and the approval means, Includes, The transaction support device further includes a notification means for notifying the store terminal, which is equipped with a shooting means that has taken a picture of the image used by the recognition means to obtain the recognition result that was the subject of the approval, that approval has been granted by the approval means. The registration means registers the trading product based on the recognition result that has been approved and notified by the notification means. The transaction processing system according to claim 1.

4. At least several of the aforementioned multiple store terminals are associated with each of the multiple designated locations within each of the multiple stores. The transaction processing system according to claim 3.

5. The system includes the aforementioned photographic means, and multiple store terminals, each associated with a designated location in each of the multiple stores, A transaction support device comprising the first display means and the approval means, Includes, The aforementioned transaction support device is A designation means for receiving a designation by the staff of a product different from the recognition result by the recognition means, A second display means that displays different user interface screens in order to receive designation by the designation means, depending on which of the above-mentioned multiple stores the transaction to be supported, Equipped with, The registration means registers the goods recognized by the recognition means as trading goods in accordance with the approval received by the approval means, and also registers the goods that are subject to the designation received by the designation means as trading goods in accordance with the designation received by the designation means. The transaction processing system according to claim 1.

Images