Transaction processing system

Abstract

To enable reduction of persons to be deployed in a shop.SOLUTION: A transaction processing system of an embodiment includes image pickup means, recognition means, approval means, registration means, and payment means. The image pickup means picks up an image of a commodity placed at a place provided in a shop to obtain the image. The recognition means recognizes the commodity reflected in the image using the image obtained by the image pickup means. The approval means causes staff at a location other than the shop to check a recognition result obtained by the recognition means and the image used by the recognition means in order to obtain the recognition result and receives approval by the staff about the recognition result obtained by the recognition means. The registration means registers a transaction commodity based on the recognition result approved by the approval means. The payment means causes a purchaser of the commodity placed at the place to make a payment for the transaction commodity registered by the registration means.SELECTED DRAWING: Figure 7

Description

Technical Field

[0001] Embodiments of the present invention relate to a transaction processing system.

Background Art

[0002] There is already known a transaction processing apparatus configured to register a transaction item by using a technique for recognizing the item based on features on an image of the item reflected in an image. However, due to a problem of recognition accuracy, confirmation by a store clerk of the recognition result has been required. For this reason, although the labor of the store clerk related to the operation of the transaction processing apparatus can be reduced, it has not led to a reduction in the number of store clerks. Under such circumstances, it has been desired to make it possible to reduce the number of personnel to be arranged in a store.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] The problem to be solved by the present invention is to provide a transaction processing system capable of reducing the number of personnel to be arranged in a store.

Means for Solving the Problems

[0005] The transaction processing system of the embodiment includes a photographing unit, a recognition unit, an approval unit, a registration unit, and a settlement unit. The photographing unit photographs a product placed in a storage location provided in a store to obtain an image. The recognition unit uses the image obtained by the photographing unit to recognize the product reflected in the image. The approval unit causes a staff member to confirm, at a location different from the store, the recognition result by the recognition unit and the image used by the recognition unit to obtain the recognition result, and receives approval from the staff member regarding the recognition result by the recognition unit. The registration unit registers the transaction product based on the recognition result approved by the approval unit. The settlement unit settles the price for the transaction product registered by the registration unit with the purchaser of the product placed in the storage location.

Brief Description of Drawings

[0006]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Embodiments for Carrying Out the Invention

[0007] Hereinafter, an example of an embodiment will be described with reference to the drawings. FIG. 1 is a block diagram showing a schematic configuration of a transaction processing system 1 according to the present embodiment. The transaction processing system 1 is configured such that a plurality of store systems 10, a recognition server 20, and a support system 30 can communicate with each other via a communication network 2. As the communication network 2, the Internet, a VPN (virtual private network), a LAN, a public communication network, a mobile communication network, etc. can be used alone or in an appropriate combination. As an example, the Internet or a VPN is used as the communication network 2.

[0008] Each of the plurality of store systems 10 is provided in a separate store that displays and sells goods to customers who are purchasers. The plurality of stores may include a plurality of stores operated by the same operator, or may include stores respectively operated by different operators. The store system 10 includes a plurality of store terminals 11, a plurality of cash registers 12, a gateway 13, and an in-store network 14. However, only one store terminal 11 may be included in the store system 10. Also, only one cash register 12 may be included in the store system 10. The number of store terminals 11 included in the plurality of store systems 10 is arbitrary for each store system 10. Also, the number of cash registers 12 included in the plurality of store systems 10 is arbitrary for each store system 10.

[0009] The store terminal 11 and the cash register 12 can communicate with each other via the in-store network 14. The store terminal 11 and the cash register 12 can also communicate via the communication network 2 via the in-store network 14 and the gateway 13. The store terminal 11 is an information processing device that functions as a user interface for an operator in processing transactions for selling goods to customers in the store. The operator of the store terminal 11 is mainly a customer. In some cases, a store clerk may be the operator of the store terminal 11.

[0010] The accounting machine 12 is an information processing device that executes accounting processing related to the settlement of the price of the above transactions. When performing accounting processing, the accounting machine 12 receives operations by an operator. The operator of the accounting machine 12 is mainly a customer. In some cases, a store clerk may be the operator of the accounting machine 12. As the accounting machine 12, for example, an accounting machine that is currently used in an existing semi-self-service POS system can be used as it is. That is, the accounting machine 12 has a function as a settlement means.

[0011] The gateway 13 relays communication in the communication network 2 and communication in the in-store network 14. As the gateway 13, for example, a well-known communication device compatible with the communication method of the communication network 2 and the communication method of the in-store network 14 can be used as it is.

[0012] The in-store network 14 is a communication network provided within one store. Typically, a LAN is used as the in-store network 14. As the in-store network 14, any other arbitrary type of communication network that enables computer communication may be used.

[0013] The recognition server 20 processes the image data sent from the store terminal 11 and identifies the products reflected in the image represented by the image data. The recognition server 20 notifies the support system 30 of the recognition result. The recognition server 20 is realized, for example, as a cloud server that provides the above processing as a cloud service.

[0014] The support system 30 is provided at a support center provided at a location different from any of the multiple stores where the multiple store systems 10 are provided. The support system 30 is operated by an operator different from any of the operators of the multiple store systems 10. That is, the support system 30 provides support services related to transactions in the multiple store systems 10. However, it is also possible that one of the operators of the multiple store systems 10 and the operator of the support system 30 are the same.

[0015] The support system 30 includes a support management device 31, a plurality of transaction support devices 32, a gateway 33, and an in-center network 34. The support management device 31 and the plurality of transaction support devices 32 can communicate with each other via the in-center network 34. The support management device 31 and the transaction support devices 32 can also perform communication via the communication network 2 through the in-center network 34 and the gateway 33.

[0016] The support management device 31 is an information processing device that performs management processing to cause the plurality of transaction support devices 32 to perform support processing described later. The transaction support device 32 is an information processing device that executes support processing described later while receiving an operation by an operator. The operator of the transaction support device 32 is a staff member who is stationed at the support center and supports transactions at the store.

[0017] The gateway 33 relays communication in the communication network 2 and communication in the in-center network 34. As the gateway 33, for example, a well-known communication device compatible with the communication method of the communication network 2 and the communication method of the in-center network 34 can be directly used.

[0018] The in-center network 34 is a communication network provided within the support center. Typically, a LAN is used as the in-center network 34. As the in-center network 34, any other arbitrary type of communication network that enables computer communication may be used.

[0019] FIG. 2 is a block diagram showing the main circuit configuration of the store terminal 11. The store terminal 11 includes a processor 111, a main storage unit 112, an auxiliary storage unit 113, a touch panel 114, a camera unit 115, a sound unit 116, a communication unit 117, and a transmission path 118. The processor 111 is connected to the main storage unit 112, the auxiliary storage unit 113, the touch panel 114, the camera unit 115, the sound unit 116, and the communication unit 117 via the transmission path 118.

[0020] A computer for performing information processing for controlling the store terminal 11 is configured by connecting a processor 111, a main memory unit 112, and an auxiliary memory unit 113 via a transmission path 118. The processor 111 corresponds to the central part of the computer. The processor 111 executes information processing for realizing various functions as the store terminal 11 according to information processing programs such as an operating system and application programs.

[0021] The main memory unit 112 corresponds to the main memory part of the computer. The main memory unit 112 includes a read-only memory area and a rewritable memory area. The main memory unit 112 stores a part of the above information processing program in the read-only memory area. Also, the main memory unit 112 may store data necessary for the processor 111 to execute processing for controlling each part in the read-only memory area or the rewritable memory area. The main memory unit 112 uses the rewritable memory area as a work area by the processor 111.

[0022] The auxiliary storage unit 113 corresponds to the auxiliary storage part of the above computer. The auxiliary storage unit 113 can use, for example, EEPROM (electric erasable programmable read-only memory), HDD (hard disc drive), SSD (solid state drive), or other various well-known storage devices. The auxiliary storage unit 113 stores the data used by the processor 111 to perform various processes and the data generated by the processes in the processor 111. The auxiliary storage unit 113 may also store the above information processing program. In the present embodiment, the auxiliary storage unit 113 stores the store terminal program PRA, which is one of the information processing programs. A part of the storage area of the auxiliary storage unit 113 is used as an area for storing the transaction data DAA. The transaction data DAA is data representing a list of transaction goods registered for one transaction.

[0023] The touch panel 114 displays a screen for presenting information to the operator. The touch panel 114 also inputs instructions by the operator's touch operation on the screen. The camera unit 115 captures an image by capturing a shooting range that encompasses the entire predetermined placement area. Then, the camera unit 115 outputs image data representing the captured image. Note that the camera unit 115 may be equipped with a still camera and repeat shooting at a fixed cycle, or may perform shooting in response to an instruction from the processor 111. Also, the camera unit 115 may be equipped with a video camera and shoot a video. The camera unit 115 may be equipped with a plurality of shooting devices. The camera unit 115 is an example of shooting means.

[0024] The sound unit 116 includes a sound processor, an amplifier, a speaker, etc., and reproduces various sounds such as voices, chime sounds, buzzer sounds, music. The communication unit 117 executes communication processing for data communication via the in-store network 14. As the communication unit 117, for example, an existing communication device for a LAN can be used. Note that the access by the communication unit 117 to the in-store network 14 may be either a wired access method or a wireless access method. The transmission path 118 includes an address bus, a data bus, control signal lines, etc., and transmits data and control signals exchanged between the connected units.

[0025] FIG. 3 is a diagram schematically showing the configuration of the transaction data DAA. The transaction data DAA is generated for transactions processed using the store terminal 11 and stored in the auxiliary storage unit 113. The transaction data DAA includes a field FAA, and may further include an arbitrary number of fields after the field FAB. In the field FAA, a transaction code is set as an identifier of the corresponding transaction. If there are registered transaction items targeted by the corresponding transaction, fields FAB, FAC,... associated with each of the transaction items are added to the transaction data DAA. In the fields FAB, FAC,..., product data DAB regarding different transaction items are set respectively.

[0026] One product data DAB includes fields FBA, FBB, FBC, FBD. In the field FBA, a product code is set as an identifier of the associated transaction item. In the field FBB, a product name defined for the associated transaction item is set. In the field FBC, the unit price of the associated transaction item is set. In the field FBD, the quantity of the associated transaction item is set. Note that the product data may include various other information such as discount information.

[0027] The transfer of the store terminal 11 is generally performed with the store terminal program PRA stored in the auxiliary storage unit 113. However, the hardware in a state where the store terminal program PRA is not stored in the auxiliary storage unit 113 or a state where an application program of the same type but different version is stored in the auxiliary storage unit 113 and the store terminal program PRA may be transferred individually. And, according to the operation of an arbitrary worker, the store terminal 11 may be configured by writing the store terminal program PRA into the auxiliary storage unit 113. The transfer of the store terminal program PRA can be performed by recording it on a removable recording medium such as a magnetic disk, a magneto-optical disk, an optical disk, a semiconductor memory, etc., or by communication via a network.

[0028] FIG. 4 is a block diagram showing the circuit configuration of the main part of the support management device 31. The support management device 31 includes a processor 311, a main storage unit 312, an auxiliary storage unit 313, a communication unit 314, and a transmission path 315. The outlines of the functions of the processor 311, the main storage unit 312, the auxiliary storage unit 313, and the transmission path 315 are equivalent to those of the processor 111, the main storage unit 112, the auxiliary storage unit 113, and the transmission path 118, so the description thereof is omitted. However, the auxiliary storage unit 313 stores the management program PRB instead of the store terminal program PRA. The management program PRB is an application program that describes the procedure of the management process described later. Also, a part of the storage area of the auxiliary storage unit 313 is used to store the management data DAC instead of storing the transaction data DAA. The management data DAC is data for managing the allocation status of the support process to the transaction support device 32.

[0029] The communication unit 314 executes communication processing for data communication via the in-center network 34. As the communication unit 314, for example, an existing communication device for a LAN can be used. Note that the access by the communication unit 314 to the in-center network 34 may be either a wired access method or a wireless access method.

[0030] FIG. 5 is a diagram schematically showing the configuration of one data record REA included in the management data DAC. The management data DAC is a set of data records REA associated with each of the transactions being supported by the transaction support device 32. Therefore, the number of data records REA included in the management data DAC changes according to the number of transactions being supported. In a situation where no support is being provided by any of the transaction support devices 32, the management data DAC either does not include any data records REA or the management data DAC is not stored in the auxiliary storage unit 313.

[0031] The data record REA includes fields FCA, FCB, FCC, and FCD. In the field FCA, a store code as an identifier of the store where the associated transaction is being conducted is set. Note that the store code is predetermined so as to be able to identify all the stores included in the transaction processing system 1. In the field FCB, a terminal code as an identifier of the store terminal 11 used in the associated transaction is set. Note that the terminal code is predetermined so as to be able to identify at least a plurality of store terminals 11 installed in the same store. In the field FCC, a transaction code as an identifier of the associated transaction is set. In the field FCD, a support device code as an identifier of the transaction support device 32 used to support the associated transaction is set. Note that the support device code is predetermined so as to be able to identify each of the transaction support devices 32.

[0032] As the basic hardware of the support management device 31, for example, the hardware of a general-purpose information processing device for a server is assumed to be used. And the transfer of the support management device 31 is generally performed with the management program PRB stored in the auxiliary storage unit 313. However, the hardware in a state where the management program PRB is not stored in the auxiliary storage unit 313, or in a state where an application program of the same type but different version is stored in the auxiliary storage unit 313, and the management program PRB may be transferred individually. And depending on the operation of an arbitrary operator, the support management device 31 may be configured by writing the management program PRB to the auxiliary storage unit 313. The transfer of the management program PRB can be performed by recording it on a removable recording medium such as a magnetic disk, a magneto-optical disk, an optical disk, a semiconductor memory, etc., or by communication via a network.

[0033] FIG. 6 is a block diagram showing the circuit configuration of the main part of the transaction support device 32. The transaction support device 32 includes a processor 321, a main storage unit 322, an auxiliary storage unit 323, a touch panel 325, a sound unit 326, a communication unit 327, and a transmission path 328.

[0034] The general functions of the processor 321, main memory unit 312, auxiliary storage unit 323, touch panel 325, sound unit 326, and transmission path 328 are equivalent to those of the processor 111, main memory unit 112, auxiliary storage unit 113, touch panel 114, sound unit 116, and transmission path 118, respectively. The general function of the communication unit 327 is equivalent to that of the communication unit 314. Therefore, their descriptions are omitted. However, the auxiliary storage unit 323 stores the support program PRC instead of the store terminal program PRA. The support program PRC is an application program that describes the procedures of the support processing described below. Also, a part of the storage area of the auxiliary storage unit 323 is used to store the setting data DAD instead of storing the transaction data DAA. The setting data DAD is data representing the settings for each store. The settings represented by the setting data DAD include the settings related to the user interface screen. The display unit 324 displays various screens for presenting information to the operator. As the display unit 324, a well-known device such as a liquid crystal display device can be used.

[0035] As the basic hardware of the transaction support device 32, for example, the hardware of a general-purpose information processing device for servers is assumed to be used. Generally, the transfer of the transaction support device 32 is performed with the support program PRC stored in the auxiliary storage unit 323. However, the hardware in a state where the support program PRC is not stored in the auxiliary storage unit 323, or in a state where an application program of the same type but different version is stored in the auxiliary storage unit 323, and the support program PRC may be transferred individually. And the transaction support device 32 may be configured by writing the support program PRC into the auxiliary storage unit 323 according to the operation of any operator. The transfer of the support program PRC can be performed by recording it on a removable recording medium such as a magnetic disk, magneto-optical disk, optical disk, semiconductor memory, etc., or by communication via a network.

[0036] Next, the operation of the transaction processing system 1 configured as described above will be described. Note that the content of the processing described below is an example, and it is possible to appropriately change the order of some processing, omit some processing, or add other processing. For example, in the following description, in order to explain the characteristic operations of the present embodiment in an easy-to-understand manner, the description of some processing is omitted. For example, when some error occurs, processing for dealing with the error may be performed, but the description of such processing is omitted.

[0037] FIG. 7 is a sequence diagram for processing related to one transaction. The customer picks up one or more products to be purchased from the store floor of the store. Then the customer selects an unused store terminal 11 among the store terminals 11 provided in the same store, and places the products in the storage area provided for the said store terminal 11. Then, the customer subsequently designates the start of the transaction for the corresponding store terminal 11 by, for example, a predetermined operation on the touch panel 114.

[0038] The processor 111 in the store terminal 11 thus designated to start starts the transaction processing related to one transaction in the information processing based on the store terminal program PRA. In the following description of the operations, when simply referred to as the "store terminal 11", it refers to the store terminal 11 where the transaction processing is started here.

[0039] As ACT101, the processor 111 generates transaction data DAA. That is, for example, the processor 111 determines a new transaction code different from the transaction code for identifying other transactions according to a predetermined rule, generates new transaction data DAA that includes this transaction code and does not include product information related to the transaction products, and stores it in the auxiliary storage unit 113.

[0040] As ACT102, the processor 111 notifies the support management device 31 of the start of a transaction. For example, the processor 111 generates notification data in a predetermined form including the store code and terminal code, and the transaction code determined in ACT101, and causes the communication unit 117 to send this notification data to the support management device 31 addressed via the in-store network 14. For each of the store terminals 11, for example, the store code of the store where the store terminal 11 is installed and the terminal code determined for the store terminal 11 are stored in advance in the auxiliary storage unit 113. And the processor 111 includes the store code and terminal code stored in the auxiliary storage unit 113 in the above notification data.

[0041] The said notification data is transmitted to the support management device 31 through the in-store network 14, the gateway 13, the communication network 2, the gateway 33, and the in-center network 34. And the notification data transmitted in this way is received by the communication unit 314.

[0042] Now, in the support management device 31, the processor 311 is waiting for the start of the transaction to be supported in the management process based on the management program PRB. And if the processor 311 receives the notification data by the communication unit 314 as described above, it proceeds to ACT311.

[0043] As ACT311, the processor 311 determines a transaction support device 32 responsible for supporting the transaction for which the start has been notified. For example, the processor 311 selects one transaction support device 32 from among the transaction support devices 32 that are not executing the support process described later, in accordance with a predetermined rule, and determines that the selected transaction support device 32 is responsible. Then, the processor 311 adds a new data record REA to the management data DAC. In the data record REA added here, the processor 311 sets the store code, terminal code, and transaction code included in the notification data to fields FCA, FCB, and FCC, respectively, and sets the support device code of the transaction support device 32 determined as the above responsibility to field FCD. In the following description of the operations, when simply referred to as "transaction support device 32", it refers to the transaction support device 32 determined as the responsibility here.

[0044] The above rule may be appropriately determined by, for example, the creator of the management program PRB or the like. As an example, the rule is determined so as to equalize the load on the transaction support device 32. As an example, the rule is determined to select the transaction support device 32 regardless of the store where the transaction is performed. As an example, the rule is determined to select the transaction support device 32 associated in advance with the store where the transaction is performed. The rule may be determined by combining each of the above examples and other rules. However, it is preferable that the rule is determined such that one transaction support device 32 can be responsible for transactions in multiple stores.

[0045] As ACT312, the processor 311 instructs the transaction support device 32 to start the support process. For example, the processor 311 generates instruction data in a predetermined form including the store code, terminal code, and transaction code included in the notification data, and causes the communication unit 314 to send this instruction data to the transaction support device 32 via the in-center network 34. The said instruction data is transmitted to the transaction support device 32 by the in-center network 34. Then, the instruction data thus transmitted is received by the communication unit 327 of the transaction support device 32.

[0046] Now, in the assistance process based on the assistance program PRC in the transaction support device 32, the processor 321 is waiting for an instruction to start the assistance. Then, if the instruction data is received by the communication unit 327 as described above, the processor 321 proceeds to ACT321. As ACT321, the processor 321 causes the touch panel 325 to display a user interface screen for receiving an operation by a staff member for transaction support. The user interface screen that the processor 321 displays here is a screen adapted to the store where the store terminal 11 is installed based on the setting data DAD. That is, the processor 321 displays different user interface screens according to the store where the transaction is taking place. Details of the interface screen will be described later. Thus, by the processor 321 executing the information processing based on the assistance program PRC, the computer having the processor 321 as the central part functions as a display means.

[0047] Now, in the store terminal 11, if the processor 111 notifies the start in ACT102, it proceeds to ACT103. As ACT103, the processor 111 starts transmitting the image data obtained by the camera unit 115 to the recognition server 20. If the camera unit 115 is equipped with a still camera and repeats shooting at a fixed cycle, the processor 111 sequentially transmits all or part of the image data output by the camera unit 115 at the fixed cycle. If the camera unit 115 is equipped with a still camera and performs shooting according to an instruction from the processor 111, the processor 111 instructs shooting at a predetermined fixed cycle and sequentially transmits the image data output from the camera unit 115 in response thereto. Also, if the camera unit 115 is equipped with a video camera and shoots a video, the processor 111 transmits the image data output by the camera unit 115, that is, the video data. For example, when transmitting the image data, the processor 111 compresses and encodes the image data output by the camera unit 115 using a predetermined encoding method, and then causes the communication unit 117 to send transfer data in a predetermined form including the encoded image data and the terminal code of the source store terminal 11 to the recognition server 20 via the in-store network 14. The said transfer data is transmitted to the recognition server 20 via the in-store network 14, the gateway 13, and the communication network 2.

[0048] When receiving the above transfer data, the recognition server 20 proceeds to ACT201. As ACT201, the recognition server 20 starts processing for recognizing products (hereinafter referred to as recognition processing). In the recognition processing, the recognition server 20 recognizes the products reflected in the image represented by the image data included in the transfer data based on the features appearing in the image for the products. As the recognition processing, for example, well-known processing using a machine learning-based image recognition engine can be applied. That is, the recognition server 20 has a function as a recognition means.

[0049] When the recognition server 20 cannot recognize a product because the product is not reflected in the image or depending on the situation of the product reflection, if the recognition server 20 succeeds in recognition as ACT202, it proceeds to ACT203.

[0050] As ACT203, the recognition server 20 notifies the support management device 31 of the recognition result. For example, the recognition server 20 transmits notification data in a predetermined form including the product code as the identifier of the recognized product, the image data considered when the recognition of the product was successful, and the terminal code included in the transfer data together with the image data, to the communication network 2 addressed to the support management device 31. The said notification data is transmitted to the support management device 31 through the communication network 2, the gateway 33, and the in-center network 34. Then, the notification data transmitted in this way is received by the communication unit 314 of the support management device 31.

[0051] If the processor 311 receives the notification data for notifying the recognition result as described above by the communication unit 314, it proceeds to ACT313. As ACT313, the processor 311 transfers the notification data received as described above to the transaction support device 32. That is, the processor 311 determines the transaction support device 32 responsible for supporting the transaction in which the store terminal 11 identified by the terminal code included in the notification data is used, and causes the communication unit 314 to send the notification data to the in-center network 34 addressed to the transaction support device 32. More specifically, for example, the processor 311 searches the management data DAC for the data record REA in which the terminal code included in the notification data is set in the field FCB. Then, for example, the processor 311 uses the transaction support device 32 identified by the support device code set in the field FCD of the corresponding data record REA as the transfer destination.

[0052] When the said notification data is received by the communication unit 327 in the transaction support device 32, the processor 321 proceeds to ACT322. As the ACT322, the processor 321 causes the display unit 324 to display a confirmation screen for allowing a staff member to confirm the recognition result. The confirmation screen is, for example, a screen showing the name of the recognized product and an image based on the image data.

[0053] The staff member checks the confirmation screen to confirm whether the recognition result is appropriate. Then, if the staff member determines that the recognition result is appropriate, the staff member performs a predetermined operation for approving the recognition result on, for example, the touch panel 325. Also, if the staff member determines that the recognition result is not appropriate, the staff member determines the product based on the image shown on the confirmation screen and performs a predetermined operation for specifying the product on, for example, the touch panel 325.

[0054] Figure 8 is a diagram showing a first example of the user interface screen. Figure 9 is a diagram showing a second example of the user interface screen. Both Figure 8 and Figure 9 show only some of the display objects, and the illustration of some of the display objects is omitted.

[0055] The user interface screens shown in Figure 8 and Figure 9 commonly include buttons BUA and BUB. Button BUA is a soft key for receiving approval from a staff member regarding the recognition result. Button BUB is a soft key for receiving a designation by a staff member to call a store clerk. And the user interface screen shown in Figure 8 further includes a button group BGA. Also, the user interface screen shown in Figure 9 further includes a button group BGB. Button group BGA includes 15 preset buttons for specifying products. In contrast, button group BGB includes 10 preset buttons for specifying products, and the size of each of the preset buttons is larger than that of button group BGA. Also, the products preset on each preset button are different between button group BGA and button group BGB. The character strings such as "AAAA" or "PPPPPP" shown on each preset button are actually character strings representing product names or the like. The user interface screen shown in FIG. 8 is adapted for stores where there are many items for which clerks are likely to perform operations to specify those items because there is a possibility of failure in recognition by the recognition server 20 as compared to the user interface screen shown in FIG. 9.

[0056] If the clerk approves the recognition result shown on the confirmation screen, for example, the clerk taps button BUA. If the clerk does not approve the recognition result shown on the confirmation screen, the clerk specifies the item by tapping, for example, any of the preset keys included in the user interface screen. When such an operation by the clerk is performed, the processor 321 proceeds to ACT323. As ACT323, the processor 321 determines the item to be registered according to the operation by the clerk. That is, for example, if the clerk approves the recognition result, the processor 321 determines the item recognized by the recognition server 20 as the item to be registered. Also, for example, if the clerk specifies an item, the processor 321 determines the specified item as the item to be registered. Thus, by the processor 321 executing information processing based on the support program PRC, the computer having the processor 321 as the central part functions as an approval means and a specification means.

[0057] As ACT324, the processor 321 requests the store terminal 11 to register the item determined above. For example, the processor 321 sends from the communication unit 327 to the in-center network 34 the request data of a predetermined form including the item code of the item determined above addressed to the store terminal 11 identified by the terminal code included in the notification data for result notification. Thus, by the processor 321 executing information processing based on the support program PRC, the computer having the processor 321 as the central part functions as a notification means.

[0058] This requested data is transmitted to the designated store terminal 11 via the in-center network 34, gateway 33, communication network 2, gateway 13, and in-store network 14. Then, the requested data is received by the communication unit 117 of the designated store terminal 11.

[0059] At the store terminal 11 where the requested data has been received as described above, the processor 111 proceeds to ACT104. As ACT104, the processor 111 registers the product as a transaction product in response to the request. For example, the processor 111 adds new product data regarding the product identified by the product code included in the requested data to the transaction data DAA. Thus, by the processor 111 executing information processing based on the store terminal program PRA, the computer with the processor 111 as the central part functions as a registration means.

[0060] As ACT105, the processor 111 causes the touch panel 114 to display a guidance screen for guiding the customer to remove the product registered as a transaction product from the storage area as described above. The customer follows the guidance on the guidance screen, removes the registered products from among the products placed in the storage area, and bags them.

[0061] If another product is placed in the storage area, then subsequently, as ACT204, ACT205, ACT314, ACT325, ACT326, ACT327, ACT106, ACT107, another product is registered as a transaction product in the same manner as ACT202, ACT203, ACT313, ACT322, ACT323, ACT324, ACT104, ACT105. If yet another product is placed in the storage area, the same processing is repeated.

[0062] If the customer has removed all the products placed in the storage area from the storage area, for example, the customer designates checkout by a predetermined operation on the touch panel 114. If such an operation is performed, the processor 111 proceeds to ACT108. As ACT108, the processor 111 notifies the support management device 31 of the completion of the transaction. For example, the processor 111 generates notification data in a predetermined form including the store code and terminal code, and the transaction code determined in ACT101, and causes the communication unit 117 to send this notification data to the support management device 31 and out to the in-store network 14 addressed to it. The said notification data is transmitted to the support management device 31 via the in-store network 14, gateway 13, communication network 2, gateway 33, and in-center network 34. Then, the notification data transmitted in this way is received by the communication unit 314.

[0063] When the above notification data is received, the processor 311 proceeds to ACT315. As ACT315, the processor 311 instructs the transaction support device 32 that is providing support for the transaction for which the completion has been notified to end the support process. For example, the processor 311 searches the management data DAC for a data record REA in which the store code, terminal code, and transaction code included in the notification data are set in fields FCA, FCB, and FCC respectively. Then, for example, the processor 311 addresses the transaction support device 32 identified by the support device code set in field FCD of the corresponding management data DAC, and causes the communication unit 314 to send instruction data in a predetermined form for the end instruction to the in-center network 34. The said instruction data is transmitted to the transaction support device 32 via the in-center network 34. Then, the instruction data transmitted in this way is received by the communication unit 327 of the destination transaction support device 32. In response, the processor 321 proceeds to ACT328. As ACT328, the processor 321 causes the display unit 324 to display a predetermined notification screen for notifying the staff of the completion of the transaction.

[0064] Also, as ACT109, at the store terminal 11, the processor 111 stops transmitting the image data. As a result, when the recognition server 20 recognizes that it is no longer possible to receive the image data, it stops recognition as ACT206. As ACT110, at the store terminal 11, the processor 111 requests the accounting machine 12 to settle the payment for all registered transaction items. That is, for example, the processor 111 generates request data in a predetermined form including the transaction data DAA. Then, for example, the processor 111 transmits the request data addressed to the accounting machine 12 that has been pre-associated among the plurality of accounting machines 12. Note that, for example, the processor 111 may calculate the amount to be settled and then request the accounting machine 12 to settle that amount. Alternatively, the processor 111 may request accounting from the accounting machine 12 in response to a request from the accounting machine 12 selected by the customer. The accounting machine 12 performs a settlement process for settling the corresponding payment to the customer.

[0065] As described above, the transaction processing system 1 allows a clerk stationed at the support center to confirm the result of product recognition from an image by displaying it on a transaction support device 32 installed at a support center different from the store where the transaction is carried out. This makes it unnecessary to individually allocate personnel for the work of confirming the result of product recognition from the image to each of the store terminals 11, and it is possible to reduce the number of personnel to be arranged in the store.

[0066] Furthermore, the transaction processing system 1 can allocate support processing related to transactions carried out using a plurality of store terminals 11 installed in one store and further a plurality of store terminals 11 installed in a plurality of stores respectively, to one transaction support device 32. Thus, one clerk can be in charge of a plurality of store terminals 11, enabling efficient support and reducing the required number of personnel in the entire system.

[0067] Furthermore, in the transaction support device 32, the user interface screen is changed according to the store where the transaction to be supported is carried out. This enables the clerk to easily perform operations adapted to the circumstances of each store.

[0068] This embodiment can be variously modified as follows. As the photographing means, a camera unit externally attached to the store terminal 11 or the like may be used. Alternatively, as the photographing means, a network camera directly connected to the in-store network 14 or the communication network 2 and transmitting image data to the recognition server 20 without going through the store terminal 11 may be used.

[0069] The recognition process may be executed by any one of the processors 111, 311, 321, or a processor provided in any other arbitrary information processing device. That is, the function as the recognition means may be provided in any information processing device other than the recognition server 20.

[0070] The process for registering the transaction product may be executed by any one of the processors 311, 321, or a processor provided in any other arbitrary information processing device. That is, the function as the registration means may be provided in any information processing device other than the store terminal 11.

[0071] The store terminal 11 may be equipped with the function of the accounting machine 12.

[0072] Each function realized by the processors 111, 311, 321 through information processing can also be realized in part or in whole by hardware that executes information processing not based on a program such as a logic circuit. Also, each of the above functions can be realized by combining software control with the above hardware such as a logic circuit.

[0073] Although some embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the gist of the invention. These embodiments and their modifications are included in the scope and gist of the invention, and are included in the invention described in the claims and the scope of equivalents thereof.

Explanation of Reference Numerals

[0074] 1…Transaction processing system, 2…Communication network, 10…Store system, 11…Store terminal, 12…Accounting machine, 13…Gateway, 14…In-store network, 20…Recognition server, 30…Support system, 31…Support management device, 32…Transaction support device, 33…Gateway, 34…Intra-center network, 111, 311, 321…Processor, 112, 312, 322…Main storage unit, 113, 313, 323…Auxiliary storage unit, 114, 325…Touch panel, 115…Camera unit, 116, 326…Sound unit, 117, 314, 327…Communication unit, 118, 315, 328…Transmission path, 324…Display unit.

Claims

1. Imaging means for obtaining an image by photographing a product placed in a storage location provided in a store; Recognition means for recognizing a product reflected in the image obtained by the imaging means; Approval means for causing a staff member to confirm, at a location separate from the store, the recognition result by the recognition means and the image used by the recognition means to obtain the recognition result, and receiving approval by the staff member for the recognition result by the recognition means; Registration means for registering a transaction product based on the recognition result approved by the approval means; Settlement means for causing the purchaser of the product placed in the storage location to settle the price for the transaction product registered by the registration means; A transaction processing system comprising the same.

2. Designation means for receiving designation by the staff member of a product different from the recognition result by the recognition means, further comprising: The registration means registers a transaction product based on the recognition result approved by the approval means, and also registers the product designated by the designation means as a transaction product. The transaction processing system according to claim 1.

3. A plurality of store terminals each associated with a respective one of a plurality of storage locations and equipped with the imaging means and the registration means; A transaction support device equipped with the approval means; Including; The transaction support device further comprises notification means for notifying the store terminal equipped with imaging means for photographing the image used by the recognition means to obtain the recognition result of which the approval by the approval means has been made, of the fact that the approval by the approval means has been made. The registration means registers a transaction product based on the recognition result approved by the notification means. The transaction processing system according to claim 1.

4. At least a plurality of the plurality of store terminals are each associated with a respective one of a plurality of storage locations defined in a plurality of stores. The transaction processing system according to claim 3.

5. A plurality of store terminals each associated with a respective one of a plurality of storage locations defined in a plurality of stores and equipped with the imaging means; A transaction support device equipped with the approval means; Including; The transaction support device: Designation means for receiving designation by the staff member of a product different from the recognition result by the recognition means; Display means for displaying different user interface screens for receiving designation by the designation means according to which store among the plurality of stores the transaction is to be supported; Comprising. The registration means registers the transaction goods based on the recognition result approved by the approval means, and also registers the goods designated by the designation means as the transaction goods. The transaction processing system according to claim 1.

Images