Purchase support system, purchase support method, and portable terminal

Abstract

To provide a purchase support system, a purchase support method and a portable terminal which are advantageous in enhancing usability in a purchase support technique.SOLUTION: A purchase support system has: a portable terminal which can execute a normal mode for supporting purchase through Internet mail order and a store mode for supporting purchase in a real store; a store server; and a gate system. The portable terminal includes: a processing unit which starts, on receipt of a start instruction from a user, an application in the normal mode and causes, on receipt of a trigger during operation in the normal mode, the application to enter the store mode; a read unit which reads a bar-code attached to a commodity in the store mode by an imaging unit, and extracts code information from the obtained image; and a display unit which stores a commodity corresponding to the code information obtained by the read means in a virtual cart which is different from a normal cart in the normal mode, and displays the total price of the commodities in the virtual cart.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a technology for assisting user purchases.

Background Art

[0002] There is a service called Internet shopping through which goods and services can be purchased (online) via the Internet. Internet shopping is convenient because it allows users to purchase goods etc. without being in a store and without having to queue at a cash register. On the other hand, there is also a high need to purchase clothing, furniture, etc. after checking the actual items, and there is a demand for technologies that support purchases in physical stores.

[0003] Patent Document 1 describes a technology for assisting purchases in physical stores by reading a barcode attached to a product with a communication terminal owned by a user and performing accounting with a cash register in the store using the read barcode information.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, with the above-described technology, the user has to queue at the cash register in the store and it takes time depending on the length of the queue.

[0006] An object of the present invention is to provide a technology that is advantageous in enhancing user usability in purchase support technologies.

Means for Solving the Problems

[0007] To solve the above problems, an embodiment of the present invention is a purchase support system having a mobile terminal capable of executing a normal mode for assisting purchases by Internet communication sales and a store mode for assisting purchases at a physical store, and a cash register for executing settlement processing. When receiving an activation instruction from a user, the mobile terminal activates an application in the normal mode, and when receiving a trigger during operation in the normal mode, the mobile terminal has a processing means for transitioning the application to the store mode, a reading means for reading a barcode attached to a product by an imaging unit in the store mode and extracting code information from the obtained image, and a display means for storing a product corresponding to the code information obtained by the reading means in a virtual cart different from a normal cart in the normal mode and displaying the total amount of the products in the virtual cart. The cash register is set in the store and is characterized by performing accounting for the total amount.

Effect of the Invention

[0008] According to the present invention, in the purchase support technology, user experience can be improved.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Mode for Carrying Out the Invention

[0010] <Purchase Support System> Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[0011] FIG. 1 is a configuration diagram showing an example of the configuration of the purchase support system 1 according to the embodiment. The purchase support system 1 includes a mobile terminal 100, a gate system 200, and a store server 300. The mobile terminal 100, the gate system 200, and the store server 300 are communicably connected via a network 10, respectively. The network 10 includes, for example, the Internet, a WAN (Wide Area Network), a LAN (Local Area Network), a wireless base station such as WiFi, a provider device, a dedicated line, and the like. The purchase support system 1 is a system that supports customers' purchases in, for example, clothing stores, grocery stores, and general merchandise stores. In this embodiment, an example of supporting purchases in a clothing store will be described.

[0012] The mobile terminal 100 has a reading unit 101, an input unit 102, a display unit 103, a trigger reception unit 104, and a processing unit 105. The mobile terminal 100 is an information processing device such as a smartphone, a tablet terminal, and a mobile phone owned by a customer who is a user, for example. The application operating on the mobile terminal 100 can execute a normal mode for supporting purchases by mail order (including e-commerce, online shopping, etc.) and a store mode for supporting purchases in a physical store. In the normal mode, products can be purchased through the Internet. That is, it is possible to purchase Internet communication sales products such as online shopping, e-commerce, and EC. In the store mode, when purchasing products in a physical store, the payment process for the products can be performed using the application operating on the mobile terminal 100.

[0013] The reading unit 101 is, for example, a camera (imaging unit) provided in a smartphone, and captures a two-dimensional code indicated on a tag attached to a product such as a QR code (trademark). By capturing the two-dimensional code by the reading unit 101 and interpreting it according to a predetermined procedure, the code information included in the two-dimensional code is extracted.

[0014] The input unit 102 is, for example, a touch panel or input buttons that receive operation inputs from the user. When the user makes an input such as an instruction using the input unit 102, the mobile terminal 100 receives the instruction etc. from the user.

[0015] The display unit 103 is, for example, a liquid crystal display panel, a plasma display panel, an organic EL display panel, etc., and is controlled by a CPU (Central Processing Unit) provided in the mobile terminal 100. The display unit 103 displays a predetermined screen based on the control of the CPU. Note that, for example, the display unit 103 may also function as the input unit 102 like a touch panel, and the display unit 103 and the input unit 102 may have an integrated structure.

[0016] The trigger reception unit 104 receives a trigger for starting the store mode and for ending the store mode, and outputs it to the processing unit 105. The trigger reception unit 104 has at least one or more of a GPS communication unit for acquiring position information, a BLE (Bluetooth Low Energy) communication unit for acquiring a beacon signal, and a detection unit for detecting that the check-in code has been read by the reading unit 101.

[0017] Based on the output from the trigger reception unit 104, the processing unit 105 switches between the normal mode and the store mode for the applications operating on the mobile terminal 100. Further, the processing unit 105 performs settlement processing etc. for the purchased goods in the store mode.

[0018] The gate system 200 includes an information processing device 210 and a gate device 220. The information processing device 210 and the gate device 220 are communicably connected via the network 10. The user passes through the gate system 200 and leaves the store.

[0019] The information processing device 210 has a first reading unit 211 and a display unit 212.

[0020] The first reading unit 211 is, for example, a camera (imaging unit), and captures a two-dimensional code printed on a predetermined surface, such as a QR code generated after completion of the settlement process described later and displayed on the mobile terminal 100, or a QR code marked on a product tag. By the first reading unit 211 capturing the two-dimensional code and interpreting it according to a predetermined procedure, the code information included in the two-dimensional code is extracted.

[0021] The display unit 212 is, for example, a liquid crystal display panel, a plasma display panel, an organic EL display panel, etc., and is controlled by the CPU included in the information processing device 210. The display unit 212 displays a predetermined screen such as the collation result of the collation unit 222 described later based on the control of the CPU. Note that the display unit 212 may also function as an input unit, such as a touch panel.

[0022] The gate device 220 includes a second reading unit 221 and a collation unit 222.

[0023] The second reading unit 221 includes an antenna and reads the identification information of the product from the RFID (Radio Frequency Identifier) tag of the product. It is preferable that the second reading unit 221 includes a plurality of antennas because the reading resolution and accuracy are improved.

[0024] The collation unit 222 collates the code information acquired by the first reading unit 211 (including the identification information of the product for which settlement has been completed or information (settlement information) for referring to the identification information of the product for which settlement has been completed) with the identification information of the product acquired by the second reading unit 221 (the identification information (carry-out information) of the product that the customer is trying to carry out of the store from inside the store). Note that the collation unit 222 may be included in the information processing device 210.

[0025] The store server 300 has a store information database (DB) 301. The store information database 301 stores inventory information, a floor map, and the location information of products in the store. Of course, it may be configured to hold each piece of information as a server for each store, or the server may be configured for each inventory information, floor map, and product location information.

[0026] <Hardware Configuration of Each Information Processing Device> Figure 2 is a block diagram showing the hardware configuration of an information processing device such as the mobile terminal 100. Here, the mobile terminal 100 will be described as an example. The mobile terminal 100 includes an input unit 102, a display unit 103, a storage unit 111, a CPU 112, a RAM 113, a ROM 114, and a communication unit 132.

[0027] The storage unit 111 stores a program that realizes the flow in the mobile terminal 100 described later when executed by the CPU 112, and data used by this program.

[0028] The CPU 112 operates based on the programs and applications stored in the ROM 114 or the storage unit 111, and controls each part of the mobile terminal 100. That is, the CPU 112 functions as a control unit of the mobile terminal 100. The ROM 114 stores a boot program executed by the CPU 112 when the mobile terminal 100 is started up, programs dependent on the hardware of the mobile terminal 100, and the like. The CPU 112 expands the program in the ROM 114 onto the RAM 113, and by executing the expanded program by the CPU 112, the flow described later is realized. Note that the CPU 112 may obtain at least a part of these programs from another device via the network 10 and execute them, or directly execute the programs stored in the ROM 114.

[0029] The communication unit 115 receives data from other devices via the network 10 and sends it to the CPU 112, and transmits the data and instructions generated by the CPU 112 to other devices via the network 10. Note that each of the information processing device 210, the gate device 220, and the store server 300 also has the same configuration as that in FIG. 2. However, it is not necessary for the information processing device 210 to have two display units 103 and 212, and for the gate device 220 and the store server 300, the configurations corresponding to the display unit 103 and the input unit 102 may be omitted.

[0030] <Configuration of Gate Device> FIG. 3 is a schematic diagram showing the appearance of the gate device. A user enters the device from the front of the device shown in the figure, proceeds in the advancing direction 228, operates the information processing device 210 placed on the placement unit 224 to perform processes such as verification described later, and if the process is problem-free, the user passes through to the back of the device in the figure. The schematic structure of the gate device 220 will be described using this figure. The gate device 220 preferably has a color and texture that do not look out of place in the store and an appearance that ensures a sense of unity with the store interior. In addition to the second reading unit 221, the gate device 220 includes a first side wall portion 223a, a second side wall portion 223b, a placement unit 224, a light emitting unit 225, and a metal member 226.

[0031] The first side wall portion 223a and the second side wall portion 223b are arranged opposite to each other to form a passage 227. The second reading unit 221 is arranged on at least one of the first side wall portion 223a and the second side wall portion 223b. Hereinafter, the first side wall portion 223a and the second side wall portion 223b are collectively referred to simply as the "side wall portion".

[0032] The second reading unit 221 reads the identification information regarding the product by performing wireless communication using radio waves with the tag attached to the product. That is, the second reading unit 221 acquires the identification information of the product stored in the tag by performing wireless communication with the tag attached to the product. The second reading unit 221 is, for example, an RFID reader including a plurality of antennas. The number of antennas included in the second reading unit 221 may be one, but it is preferably plural. The second reading unit 221 forms a reading area 230 by emitting (outputting) radio waves toward the passage 227, and acquires the identification information of the product from the tag of the product held by the user who has passed through the reading area 230 in the passage 227.

[0033] FIG. 4 is a diagram for explaining the reading area 230 of the second reading unit 221. FIG. 4(A) is a schematic diagram showing an example of the reading area 230 of the second reading unit 221. The reading area 230 of the second reading unit 221 preferably includes a first reading area 231 where a reading accuracy of 90% or more is ensured, and a second reading area 232 where the reading accuracy is lower than that of the first reading area 231. The second reading unit 221 is preferably arranged on the first side wall portion 223a or the second side wall portion 223b, or both the first side wall portion 223a and the second side wall portion 223b, such that the range within at least 50 cm from each of the entrance and the end portion on the exit side of the side wall portion is the first reading area 231. Further, the second reading unit 221 is preferably arranged on the first side wall portion 223a or the second side wall portion 223b, or both the first side wall portion 223a and the second side wall portion 223b, such that the range in the height direction of 90 cm or more from the floor surface of the passage 227, more preferably, the range in the height direction of 120 cm to 150 cm from the floor surface of the passage 227 is the first reading area 231. Furthermore, the second reading unit 221 is preferably arranged on the first side wall portion 223a or the second side wall portion 223b, or both the first side wall portion 223a and the second side wall portion 223b, such that the range within 200 cm in the height direction from the floor surface of the passage 227 is the second reading area 232.

[0034] FIG. 4(B) is a schematic diagram showing a state in which user 240 holds bag 250 containing goods in hand. When user 240 passes through gate device 220 while holding bag 250 containing the goods purchased by user 240 in hand, bag 250 is considered to be positioned at a height of 30 cm to 60 cm from the floor surface of passage 227. That is, when user 240 passes through gate device 220 while holding bag 250 containing the goods purchased by user 240 in hand, by arranging second reading unit 221 such that the range of heights from 30 cm to 60 cm from the floor surface of passage 227 is the first reading area 231, second reading unit 221 can accurately read the identification information of the goods from the tag of the goods contained in bag 250. FIG. 4(C) is a schematic diagram showing a state in which user 240 hangs bag 250 containing goods on the elbow. When user 240 passes through gate device 220 while hanging bag 250 containing the goods purchased by user 240 on the elbow, bag 250 is considered to be positioned at a height of 60 cm to 90 cm from the floor surface of passage 227. That is, when user 240 passes through gate device 220 while hanging bag 250 containing the goods purchased by user 240 on the elbow, by arranging second reading unit 221 such that the range of heights from 60 cm to 90 cm from the floor surface of passage 227 is the first reading area 231, second reading unit 221 can accurately read the identification information of the goods from the tag of the goods contained in bag 250. FIG. 4(D) is a schematic diagram showing a state in which user 240 holds bag 250 containing goods against the chest. When user 240 passes through gate device 220 while holding bag 250 containing the goods purchased by user 240 against the chest, bag 250 is considered to be positioned at a height of 90 cm to 120 cm from the floor surface of passage 227. That is, when user 240 passes through gate device 220 while holding bag 250 containing the goods purchased by user 240 against the chest, by arranging second reading unit 221 such that the range of heights from 90 cm to 120 cm from the floor surface of passage 227 is the first reading area 231, second reading unit 221 can accurately read the identification information of the goods from the tag of the goods contained in bag 250.

[0035] Therefore, by arranging the second reading unit 221 such that the range in the height direction is 90 cm or more from the floor surface of the passage 227, and more preferably, the range is 120 cm to 150 cm in the height direction from the floor surface of the passage 227 to be the first reading area 231, it becomes possible to accurately read the identification information of the product regardless of the state (posture) in which the user 240 holds the bag 250 containing the purchased product. Note that the bag 250 may be a shopping basket, but in order not to affect the reading accuracy of the RFID tag, its material is preferably not a conductor such as metal.

[0036] The tag attached to the product is, for example, a tag capable of recording the identification information of the product, such as an RFID tag. For example, when the tag corresponds to RFID, it has an antenna and a chip (integrated circuit) for storing identification information inside (embedded) and is attached to the package, or is fixed to a part of the product by a member called a lock. Then, when the radio wave of the UHF band RFID reader is received by the antenna in the tag from the outside, it generates electricity and outputs the information held in the IC to the outside by the radio wave of the same UHF band. Thereby, the second reading unit 221 can read the identification information of the product.

[0037] In order to reduce the reading omission of the RFID tag of the product by the second reading unit 221, it is preferable to arrange the second reading unit 221 on both the first side wall portion 223a and the second side wall portion 223b. Also, for the first side wall portion 223a and the second side wall portion 223b, a conductor such as a thin metal plate or a thin metal film is arranged in the direction of the surface not facing the passage 227 (the direction outside the device across the side wall portion from the center of the device) so that the radio wave used for reading by the second reading unit 221 does not leak.

[0038] The placement unit 224 has the information processing apparatus 210 placed thereon. The placement unit 224 is arranged such that the display unit 212 of the information processing apparatus overlaps at least a part of the first reading area 231 of the second reading unit 221 of the gate apparatus 220 in the direction along the passage 227 (travel direction 228). When passing through the gate apparatus 220, the user may decelerate or stop near the display unit 212 in order to check the collation result described later. Therefore, with such a configuration, the second reading unit 221 can efficiently read an RFID tag or the like, and the user can efficiently pass through the gate apparatus 220. Further, it is more preferable that the reading area of the first reading unit 211 is arranged at a position overlapping at least a part of the first reading area 231 of the second reading unit 221 of the gate apparatus 220 in the travel direction 228. In other words, it is more preferable that the first reading unit 211 is arranged near the display unit 212. In the case of such a configuration, the user can pass through the gate apparatus 220 more efficiently.

[0039] The light emitting unit 225 is arranged on either the entrance side or the exit side of the side wall portion, and includes, for example, an LED. The light emitting unit 225 changes the emission color according to the state of the gate apparatus 220 or the collation result described later. Specifically, for example, if it is in an available state, it may light up green, and if it is in an unavailable state (for example, a failure state) or the collation result described later is an error, it may light up red. Note that the variations of the light emission are not limited to these.

[0040] The metal member 226 is arranged on the floor surface between the first side wall portion 223a and the second side wall portion 223b near the entrance and the exit of the gate apparatus 220, in other words, on the floor surface of the passage 227. The metal member 226 reduces the step with various wirings (including power lines and Ethernet cables) connecting between the first side wall portion 223a and the second side wall portion 223b so that a wheelchair or the like can easily pass through.

[0041] <Processing of the Purchase Support System> FIG. 5 is a flowchart showing the overall process flow of the purchase support system 1. Here, the overall process flow of the purchase support system 1 will be described, and the details of each step will be described later. In S400, the mobile terminal 100 performs a store mode activation process. In S500, the mobile terminal 100 performs a product selection process and accepts a product selection from the user. In S600, the mobile terminal 100 performs a settlement process based on an instruction from the user. In S700, the gate system 200 performs a store exit process.

[0042] <Store mode activation process> FIG. 6 is a flowchart of the store mode activation process. Each operation (step) shown in this flowchart is executed by controlling each part of the mobile terminal 100 by the CPU 112 provided in the mobile terminal 100.

[0043] In S401, when the mobile terminal 100 receives an app activation instruction from the user, the mobile terminal 100 activates an application related to purchase support (hereinafter, also simply referred to as an app) in the normal mode. Next, in S402, the trigger reception unit 104 determines whether it has received a trigger (activation trigger) for activating the store mode. Here, the activation trigger is, for example, a beacon signal emitted from a device installed in the store, a short-range wireless communication signal such as Bluetooth (trademark), and the location information within the store. In the case of a signal, the store ID may be embedded in the signal as it is. When using the location information, a table associating the store ID with the reference location information is held in an external server in advance, and the trigger reception unit 104 acquires the store ID and the reference location information close to the location information acquired from the GPS, and determines it as the location information within the store when the difference between the reference location information and the GPS location information is within the threshold. Also, it is possible that the reading unit 101 reads a code including the store ID and acquires the store ID as a trigger, or uses a combination of the above-mentioned multiple pieces of information as a trigger.

[0044] When a start trigger is received (S402, Yes), in S403, the processing unit 105 causes the display unit 103 to display a screen (store mode selection screen) for selecting (activating) the store mode of the store (corresponding store) corresponding to the received trigger. Here, if the store mode is not selected (S404, No), the process returns to S402. On the other hand, when the store mode is selected (S404, Yes), in S405, the processing unit 105 transitions the application to the store mode and holds it as check-in information in association with the store ID acquired by the reading unit 101 with the current time as the entry time. Note that when a start trigger is received, the processing unit 105 may automatically transition to the store mode.

[0045] When transitioning to the store mode, in S406, the processing unit 105 determines whether to acquire the floor map of the corresponding store. Here, for example, when the user selects to acquire the floor map by the input unit 102 (S406, Yes), in S407, the processing unit 105 acquires the floor map of the corresponding store from the store server 300 and causes the display unit 103 to display the acquired floor map. On the other hand, when it is not selected to acquire the floor map (S406, No), the process proceeds to the product selection process (S500).

[0046] In S407, the processing unit 105 determines whether to display, that is, map, on the floor map the positions of the products on the list of products that the user is considering purchasing, that is, the products registered in the favorite list (favorite products) within the store. The favorite list can register the products selected by the user in the normal mode. Of course, products can also be registered in the favorite list in the store mode. Here, for example, when the user selects to map by the input unit 102 (S408, Yes), in S409, the processing unit 105 maps the positions of the favorite products on the floor map and proceeds with the product selection process (S500). Here, note that, together with the favorite products or instead of the favorite products, the products placed in the cart in the normal mode may also be mapped on the floor map. Furthermore, the user may select the products to be displayed on the floor map, for example, from keyword search, product category, or product lineup, and map the positions of the selected products. On the other hand, when mapping is not selected (S408, No), the process proceeds to the product selection process (S500). Note that S406 to S409 may be processed in parallel only when the functions related to the floor map are called.

[0047] Note that even after transitioning to the store mode, the user may be able to use the normal mode by making a selection. For example, it is possible to execute the store mode and the normal mode in parallel. With such a configuration, the user can purchase some or all of the products via the Internet after checking the actual products in the physical store. Later, the form of transitioning to the normal mode by exiting the store mode will be described.

[0048] FIG. 7 is a diagram showing an example of a display screen when the store mode is activated. FIG. 7(A) is a diagram showing an example of a store mode selection screen 420 displayed in S403. On the store mode selection screen 420, the store mode of the store corresponding to the received activation trigger's store ID can be selected. On the store mode selection screen 420, the store name 421 corresponding to the store ID and an icon 422 for selecting the store mode are displayed.

[0049] FIG. 7(B) is a diagram showing an example of a screen of the store mode displayed in S405. When the store mode is activated, a menu screen 430 of the store mode is displayed. On the menu screen 430, a step display 431 is provided so that the user can easily grasp the processing in the store mode. As an example, "Check-in" in the step display 431 corresponds to the store mode activation process (S400), "Scan" corresponds to the product selection process (S500), "Payment" corresponds to the payment process (S600), and "Gate Pass" corresponds to the store exit process (S700).

[0050] Also, the menu screen 430 includes, for example, a scan icon 432, a floor map icon 433, and a favorite list icon 434. When the user selects the scan icon 432 by tapping or the like, it becomes possible to execute the product selection process described later. When the user selects the floor map icon 433, the acquisition of the floor map in S407 is executed. When the user selects the favorite list icon 434, it becomes possible to confirm the content of the favorite list on the display screen. Also, when the favorite list icon 434 is selected after the floor map is acquired, it becomes possible to execute the mapping of favorite products in S409.

[0051] FIG. 8 is a diagram showing an example of a display screen including a mapped floor map. The display screen 440 includes, for example, a thumbnail image 441 corresponding to a favorite product and a floor map 443 in which icons 442 indicating the position information of each favorite product are visibly displayed. Also, detailed information including the price of the selected favorite product, the expanded size and color of the product, etc., and inventory information (information 444) in the store may be displayed.

[0052] FIG. 9 is a diagram showing another example of the display screen when the store mode is activated. In the example of this figure, when a start trigger is received, first, the display screen 450 is displayed. On the display screen 450, a store mode selection display 451 is displayed. The store mode selection display 451 includes a store name 452 corresponding to the store ID and an icon 453 for selecting the store mode. Also, the store mode selection display 451 further displays an icon 454 for the user to check the details of the store mode. By the user selecting the icon 454, it becomes possible to check the details of the processing in the store mode and the operation method. Then, when the user selects the icon 453 for selecting the store mode, the store mode is activated and the display screen 460 is displayed. On the display screen 460, operation icons 461 for the user to operate the application in the store mode are displayed. For example, when the user selects the scan icon 462 among the operation icons 461, the display screen transitions to 470 and it becomes possible to execute a product selection process described later. Note that on the display screen 450, by the user selecting the store mode end icon 455 by tapping or the like, the store mode can be ended and the normal mode can be transitioned to.

[0053] When the trigger reception unit 104 receives a trigger (end trigger) for ending the store mode after the store mode is activated, the processing unit 105 ends the store mode and transitions to the normal mode. FIG. 10 is a flowchart of the store mode end process. Each operation (step) shown in this flowchart is executed under the control of each part of the mobile terminal 100 by the CPU 112 provided in the mobile terminal 100. In S410, the trigger reception unit 104 determines whether it has received an end trigger. Here, the end trigger is, for example, that a predetermined time has elapsed since the store entry time included in the check-in information, that position information of a position a predetermined distance away from the reference position information of the store during check-in, that is, the corresponding store, has been acquired, or that the user has instructed the end of the store mode. When the end trigger is received (S410, Yes), in S411, the processing unit 105 performs checkout processing such as clearing (deleting) the contents of the virtual cart in the store mode and deleting the held check-in information, and in S412, ends the store mode and transitions to the normal mode.

[0054] FIG. 11 is a diagram showing an example of the display screen when the store mode ends. FIG. 11(A) is a diagram showing an example of the store mode end selection screen. The store mode end selection screen 480 includes an icon 481 for ending the store mode. When the user selects the icon 481 for ending the store mode, the store mode ends and transitions to the normal mode. Note that even after transitioning to the normal mode, for example, when it is detected by the trigger reception unit 104 that the user is inside the store, as shown in FIG. 11(B), it is preferable to display a store mode selection display 492 including an icon 491 for selecting the store mode on the normal mode screen display 490. By having such a screen display, it becomes possible for the user to easily return to the store mode. Note that FIG. 11(B) is a diagram showing an example of the screen display in the normal mode after the store mode ends.

[0055] <Product Selection Process> FIG. 12 is a flowchart of the product selection process. Each operation (step) shown in this flowchart can be executed under the control of each part of the mobile terminal 100 by the CPU 112 provided in the mobile terminal 100.

[0056] In S501, the user uses the reading unit 101 to read a two-dimensional code such as a QR code marked on the tag attached to the product. In S502, the reading unit 101 determines whether the reading was performed normally, for example, whether the number of digits of the read content is correct or within the range that can be restored by the error correction code. If the reading was not performed normally (S502, No), the two-dimensional code is read again (S501). If the reading was performed normally (S502, Yes), the processing unit 105 checks whether the identification information overlaps with the products already added to the virtual cart. Here, the identification information is a number uniquely assigned to each individual product, and even for products of the same type, the identification information will be different if they are different individuals. For example, a 24-digit hexadecimal number can be used as the identification information, which is the same as the content stored in the RFID chip embedded in the tag attached to the product as an EPC (Electronic Product Code). The identification information can also be said to be an individual identification number. If there is an overlap in the identification information read by the reading unit 101 (S503, No), in S504, the processing unit 105 performs an error display on the display screen of the display unit 103. This is to prevent double settlement for the same individual. Note that, for example, as long as the user can recognize that there is an error, such as by emitting an error sound, other error notifications may also be used. On the other hand, if there is no overlap in the identification information (S503, Yes), in S505, the processing unit 105 adds the product to the virtual cart.

[0057] Then, in S506, the processing unit 105 checks whether the selection of products has been completed. If the selection of products has not been completed (S506, No), S501 to S505 are repeated until the selection of products is completed. On the other hand, if the selection of products has been completed (S506, Yes), in S507, the processing unit 105 outputs the identification information of all the products added to the virtual cart to the store server 300. The store server 300 records that the products are added to the virtual cart in the identification information of the products received from the mobile terminal 100. Also, at this time, the store server 300 may output, for example, the total amount of the products added to the virtual cart to the mobile terminal 100. Then, the process proceeds to the payment process.

[0058] FIG. 13 is a diagram showing an example of a display screen at the time of product selection. FIG. 13(A) is a diagram showing an example of a scan screen (reading screen). The scan screen 510 includes a scan area (reading area) 511. A two-dimensional code such as a QR code displayed on the tag of the product is positioned within this scan area 511, and the user captures the two-dimensional code with the reading unit 101. Thereby, the identification information of the product is read, and the product can be selected, in other words, added to the virtual cart. FIG. 13(B) is a diagram showing an example of a scan completion screen. In S502, when the reading is performed normally, the scan completion screen 520 is displayed. On the scan completion screen 520, the scan result 521 is displayed so that the user can visually confirm that the scan has been completed normally and the product has been added to the virtual cart. Also, a virtual cart icon 522 is displayed on the display screen at the time of product selection. By the user selecting this virtual cart icon 522 by tapping or the like, the products in the virtual cart can be confirmed. FIG. 13(C) is a diagram showing an example of a screen for confirming the products in the virtual cart. On the screen 530 for confirming the products in the virtual cart, detailed information 531 such as the product name, color, size, price, and thumbnail image of the products in the virtual cart is displayed. Also, by the user selecting the delete icon 532, the selected product can be deleted from the virtual cart. Further, on the screen 530, the total amount 533 of the products in the virtual cart is displayed. Further, a settlement icon 534 is displayed on the screen 530. When the user selects the settlement icon 534, it becomes possible to execute the settlement process described later.

[0059] FIG. 14 is a diagram showing another example of a scan screen. In the scan screen, for example, a scan frame (reading frame) 540 may be displayed. When the scan frame 540 is displayed, it can be used as an indicator of where the two-dimensional code should be positioned, making it possible for the user to more easily photograph the two-dimensional code. In the scan screen in store mode, for example, it is preferable to display the scan frame 540 in a color scheme different from the normal mode or to change the shape of the scan frame 540, that is, to have different screen displays. With such a configuration, it becomes possible for the user to intuitively recognize whether they are scanning in the normal mode or the store mode.

[0060] Note that the product selection process can also be executed in the normal mode. In the case of the normal mode, instead of reading a two-dimensional code containing individual identification number information uniquely assigned to each individual product such as a QR code, a two-dimensional code such as a barcode may be read to obtain type information such as a PLU (Price Look-up) code assigned to each product type. The type information includes one or more pieces of information for distinguishing the product type, such as the product number, color, size, and price of the product. That is, the same type information is assigned to products of the same type (for example, products with the same product number, color, and size). In the normal mode, since products can be purchased through the Internet, it is sufficient to obtain the product type information. Since the normal mode and the store mode can be executed in parallel, for example, a scan frame for reading a QR code for the store mode and a scan frame for reading a barcode for the normal mode may be displayed on a single scan screen. At this time, it is preferable to arrange the scan frame for the QR code and the scan frame for the barcode on the screen according to the arrangement of the QR code and the barcode on the tag attached to the product. Also, in the normal mode, for example, products may be selectable from keyword searches, product categories, or product lineups.

[0061] <Payment Process> FIG. 15 is a flowchart of the settlement process. Each operation (step) shown in this flowchart is executed under the control of each part of the mobile terminal 100 by the CPU 112 provided in the mobile terminal 100.

[0062] In S601, the user selects a payment method via, for example, the input unit 102. As the payment method, for example, credit payment, electronic money payment, immediate debit payment, point payment, and payment using a predetermined application also called smartphone payment can be selected. The smartphone payment may be incorporated into the mobile terminal 100 as a function of an application related to purchase support. Then, in S602, the processing unit 105 performs payment by the selected method. Specifically, the processing unit 105 transmits information necessary for payment to an external payment server (not shown) corresponding to the selected method and requests payment processing. In S603, the processing unit 105 determines whether the payment has been completed normally based on the response from the payment server. Here, if the payment has not been completed normally (S603, No), the processing unit 105 displays a payment error on the display screen of the display unit 103. Note that, for example, as long as the user can recognize that it is a payment error such as by emitting an error sound, other error notifications may be used. Then, S601 to S603 are repeated until the payment is completed normally. On the other hand, if the payment is completed normally (S603, Yes), in S605, the processing unit 105 outputs the identification information of the goods for which the payment has been completed to the store server 300. The store server 300 records that the payment for the identification information of the goods received from the mobile terminal 100 has been completed and sold. Then, in S606, the processing unit 105 generates a two-dimensional code (exit code) such as a QR code for exit associated with payment information including the identification information of all goods settled in S606 and the payment completion time, and in S607, causes the display unit 103 to display the exit code. Note that the exit code may be transmitted to the mobile terminal 100 by email or the like. Further, the payment information may be directly embedded in the QR code for exit, or the store server may hold the payment information and be configured to access the payment information held by the store server from a link embedded in the QR code for exit. Since the user can perform the payment process of the goods with the mobile terminal owned by the customer who is the user, the user does not need to line up at the cash register in the store, and it is possible to shorten the time required for payment.

[0063] FIG. 16 is a diagram showing an example of a display screen at the time of settlement. The display screen 610 is displayed, for example, when the settlement icon 534 shown in FIG. 13(C) is selected. The display screen 610 is a display screen when the settlement process is executed, and usable coupon information 611 may be displayed on the display screen 610. The user can perform settlement using a coupon by selecting a coupon to be used and selecting an icon 612 for performing settlement using the coupon. On the other hand, when not using a coupon, settlement can be performed without using a coupon by selecting an icon 613 for performing settlement without using a coupon. When the user selects the icon 612 or the icon 613, a settlement screen 620 is displayed and settlement (S602) is performed. When the settlement is successfully completed, a payment completion screen 630 is displayed, and the user can confirm that the settlement has been successfully completed. On the payment completion screen 630, for example, the date and time (usage date and time) 631 when the settlement was completed, the name of the store where the product was purchased (used store) 632, and the total amount of the purchased products (used amount) 633 are displayed. When the user selects an icon 634 to proceed to the next process, the screen transitions to the screen of FIG. 17.

[0064] FIG. 17 is a diagram showing an example of a display screen at the time of payment completion. On the display screen 640, a guide 641 (explanation) for the store exit process is displayed. The user can exit the store by passing through the gate device 220 according to the guide 641. Here, as an example, an example of using a membership card in which a member ID is embedded as an exit code will be described. When the user selects an icon 642 that approves having confirmed the guide 641, the screen transitions to a menu screen 650. On the menu screen 650, when the user selects a membership card icon 651, a membership card screen 660 is displayed. On the membership card screen 660, a two-dimensional code 661 such as a QR code including member information is displayed. This two-dimensional code 661 is a two-dimensional code as a membership card in which settlement information is associated with the member ID in an external member ID server (not shown) and the member ID is embedded. Such a two-dimensional code may be used as an exit code.

[0065] FIG. 18 is a diagram showing another example of a display screen at the time of completion of settlement. In the example of FIG. 18, a code for leaving the store is displayed after the completion of settlement. FIG. 18(A) is a diagram showing an example of a settlement procedure (purchase procedure) screen 670. This figure shows an example in which credit settlement is selected as the settlement method. On the settlement procedure screen 670, for example, the name of the store where the product was purchased (the store where you shop) 671, the selected settlement method (payment method) 672, the total points of the purchased products 673, and the total amount of the purchased products 674 are displayed. On the settlement procedure screen 670, when the user selects the confirmation icon 675, settlement (S602) is performed. FIG. 18(B) is a diagram showing an example of a settlement completion screen 680. The settlement completion screen 680 is a screen indicating that the settlement has been completed normally, and is a display that allows the user to intuitively recognize that the settlement has been completed normally. FIG. 18(C) is a diagram showing an example of a code display screen 690 for leaving the store. When the settlement is completed normally, the code display screen 690 for leaving the store is displayed. The code display screen 690 for leaving the store includes a code 691 for leaving the store. The user performs the leaving store process described later using the code 691 for leaving the store.

[0066] <Leaving store process> FIG. 19 is a flowchart of the leaving store process. Each operation (step) shown in this flowchart is executed by control of each part by the CPU provided in the gate device 220 or the information processing device 210.

[0067] In S701, the user causes the display unit 103 of the mobile terminal 100 to display the checkout code and causes the first reading unit 211 of the information processing apparatus 210 to read the checkout code. Then, the first reading unit 211 reads the checkout code. In S702, the first reading unit 211 determines whether the reading has been performed normally. If the reading has not been performed normally (S702, No), in S703, the display unit 212 displays a code reading error on the display screen. Note that, for example, as long as the user can recognize that there is an error such as by emitting an error sound, other error notifications may be used, or it is sufficient to simply not transition to the next state. Then, the reading of the checkout code (S701) is repeated until the reading is performed normally.

[0068] On the other hand, if the checkout code has been read normally (S702, Yes), in S704, the second reading unit 221 of the gate apparatus 220 reads the identification information of the product from the RFID tag of the product. Specifically, when the user enters the passage 227 of the gate apparatus 220 while holding the product purchased, the second reading unit 221 performs the reading. Note that the second reading unit 221 may be configured to read the RFID tag after the first reading unit 211 reads the checkout code. However, preferably, the imaging unit (first reading unit 211) of the information processing apparatus 210 may be configured to read the RFID tag when the user is detected. Also, the second reading unit 221 may constantly emit a reading radio wave. In S705, the second reading unit 221 determines whether the reading has been performed normally. If the reading has not been performed normally (S705, No), in S706, the display unit 212 displays an RFID reading error on the display screen. Note that, for example, as long as the user can recognize that there is an error such as by emitting an error sound, other error notifications may be used. Then, the reading of the RFID tag (S704) is repeated until the reading is performed normally.

[0069] When the RFID reading is performed normally (S705, Yes), in S707, the collation unit 222 collates (compares) the identification information of the merchandise for which settlement has been completed included in the settlement information that can be referred to from the checkout code, with the identification information of the merchandise read by the second reading unit 221. When the identification information of the settled merchandise and the identification information of the read merchandise match exactly without any excess or deficiency, the collation result is normal (S708, Yes), so the collation unit 222 outputs a signal indicating that the collation result is normal to the information processing apparatus 210. In S709, the display unit 212 of the information processing apparatus 210 displays a completion notice of the checkout process. On the other hand, when the collation result is not normal (S708, No), the collation unit 222 outputs a signal indicating that the collation result is an error to the information processing apparatus 210. In S710, the display unit 212 of the information processing apparatus 210 displays an error notice. Then, the process ends.

[0070] Note that the above-described checkout process can also be applied when performing accounting using the accounting machine in the store. When performing accounting using the accounting machine in the store, the checkout code generated (issued) by performing accounting using the accounting machine in the store may be used.

[0071] FIG. 20 is a diagram showing an example of a display screen of the information processing apparatus 210 at the time of checkout processing. FIG. 20(A) is a diagram showing an example of a checkout code scanning screen 720. The checkout code scanning screen 720 includes a guide display 721 for scanning the checkout code and a scanning area 722 for reading the checkout code. The guide display 721 is a display that allows the user to intuitively understand the method of scanning the checkout code. By positioning the checkout code within the scanning area 722 and taking a picture of the checkout code with the first reading unit 211, the checkout code is read (S701). For example, a scan frame 723 may be displayed on the checkout code scanning screen 720. When the scan frame 723 is displayed, it can be used as an indicator of where the checkout code should be positioned, making it easier for the user to scan the checkout code. FIG. 20(B) is a diagram showing an example of a screen 730 after the checkout code has been successfully read. When the reading of the checkout code is completed normally, the screen 730 is displayed. On the screen 730, all the product names 731 of the products included in the settlement information obtained by the information processing apparatus 210 reading the checkout code and the total points (settlement points) 732 of the products are displayed. FIG. 20(C) is a diagram showing an example of a screen 740 after the RFID tag has been successfully read by the second reading unit 221 of the gate apparatus 220. When the RFID tag reading by the second reading unit 221 of the gate apparatus 220 is completed normally, the screen 740 is displayed. Next to the product name corresponding to the product read by the second reading unit 221 among all the product names 731 of the products included in the settlement information, for example, an icon 741 indicating that the verification result is normal is displayed. Also, on the screen 740, the total points (points taken out) 742 of the products for which the RFID tag reading has been completed are displayed. When the verification result between the settlement information and the identification information of the products taken out is normal, the screen 750 is displayed. FIG. 20(D) is a diagram showing an example of a verification completion screen. The screen 750 in this figure shows an example when the verification result is normal. In the case where the verification result is an error, it is preferable to emphasize and display the product name 731 for which the identification information does not match, in other words, the product name 731 that is the cause of the error, for example, by using an emphasized color, surrounding it with a border, or flashing.Note that the highlighted display is not limited to this, and any display that is easy for the user to visually recognize is acceptable. With such a configuration, the user can easily grasp which product is the cause of the error.

[0072] FIG. 21 is a diagram for explaining the collation result of S707. In the present embodiment, as an example, the collation results of five patterns will be described. Note that, for the sake of simplicity of explanation, the identification information of the products shown in this figure (table) is in a simplified notation. Among the identification information, the Roman letter parts (」A」, 」B」, 」C」, and 」D」) indicate the types of products and show the type information assigned for each minimum management unit (SKU: Stock Keeping Unit). The numerical parts (」001」 and 」002」) indicate the numbers uniquely assigned to each individual product.

[0073] Pattern 1 is the case where the settlement information and the RFID read information (carry-out information) completely match. In Pattern 1, the total score of the settlement information and the carry-out information and the identification information of each product completely match. In this case, the collation unit 222 determines that the collation result is 」normal」. In this case, for example, the screen 750 shown in FIG. 20(D) is displayed on the display unit 212 of the information processing device 210, and the user can exit from the gate device 220 and leave the store.

[0074] In Pattern 2, the number of products included in the carry-out information is less than the number of products included in the settlement information. Specifically, in this example, the carry-out information does not include the identification information of 」C 001」. In this case, the collation unit 222 determines that the collation result is 」error」. In this case, it is conceivable that the user has left a product in the store. Therefore, for example, an error message 」The number of items is insufficient. Please check the products.」 is displayed on the display unit 212 of the information processing device 210.

[0075] In Pattern 3, the number of product points included in the carry-out information is larger than the number of product points included in the payment information. Specifically, in this example, the identification information of "C 002" which is not included in the payment information is included in the carry-out information. In this case, the verification unit 222 determines that the verification result is "error". In this case, it is conceivable that the user has taken out products for which payment has not been completed. Therefore, for example, an error message "It seems that you have something other than the paid products. Please wait while we call a staff member for confirmation." is displayed on the display unit 212 of the information processing device 210.

[0076] In Pattern 4, the number of product points in the payment information and the carry-out information is the same, but the types of some products do not match. Specifically, in this example, the product type of "C 001" in the payment information is different from the product type of "D 001" in the carry-out information. This means that the user is trying to take out a product of a different type from the product for which payment has been completed. In this case, the verification unit 222 determines that the verification result is "error". In this case, it is conceivable that the user has taken out the wrong product. Therefore, for example, an error message "It seems that you have something other than the paid products. Please wait while we call a staff member for confirmation." is displayed on the display unit 212 of the information processing device 210.

[0077] In Pattern 5, the number of items in the payment information and the number of items taken out are the same, but the item identification information does not match. However, the item type information matches. Specifically, in this example, the identification information "C 001" in the payment information and the identification information "C 002" in the taken-out information are different, but the type information "C" is the same. This means that the user has taken out a different individual of the same type of item as the one for which the payment was completed. That is, item "C 001" and item "C 002" have exactly the same item type (including one or more of item number, color, size, and price), and only differ in the individual. In this case, the collation unit 222 determines that the collation result is "normal" and causes the information processing apparatus 210 to display, on the display unit 212 thereof, a screen 750 shown in FIG. 20(D), for example, in the same manner as in Pattern 1. And at this time, the gate system 200 outputs, for example, the non-matching identification information (here, "C 001" and "C 002") to the store server 300. Then, it is preferable for the store server 300 to rewrite the non-matching identification information, such as by exchanging it. By performing such processing, it is possible to reduce the unnecessary hindrance to the user's leaving the store.

[0078] With such a configuration, the user can efficiently confirm whether the items held have been correctly paid for.

[0079] <Other Embodiments> In the above-described embodiment, the gate system 200 is configured to include a separate information processing apparatus 210 and a gate apparatus 220, but the information processing apparatus 210 and the gate apparatus 220 may be integrated. Also, the first reading unit 211 may be disposed near the entrance of the gate apparatus 220.

[0080] As described above in detail based on several drawings, the above embodiments are examples for explaining the present invention, and the present invention is not intended to be limited only to these embodiments. The present invention can be implemented in various forms without departing from its gist. When the processing in the mobile terminal 100, the information processing apparatus 210, the gate apparatus 220, and the store server 300 is realized by a computer, the processing contents of the functions that each part of these apparatuses should have are executed based on a program. The program describing the above processing contents can be recorded on a computer-readable recording medium. As the computer-readable recording medium, for example, any of a magnetic recording device, an optical disk, a magneto-optical recording medium, a semiconductor memory, etc. may be used. Also, the processing of each part may be configured by causing a predetermined program to be executed on a computer.

Explanation of Reference Numerals

[0081] 1 Purchase Support System 10 Network 100 Mobile Terminal 103 Display Unit 104 Trigger Reception Unit 105 Processing Unit 200 Gate System 210 Information Processing Apparatus 212 Display Unit 220 Gate Apparatus 222 Verification Unit 223a First Side Wall Portion 223b Second Side Wall Portion 224 Placement Unit 225 Light Emitting Unit 226 Metal Member 227 Passage 300 Store Server 301 Store Information Database

Claims

1. A purchase support system having a mobile terminal capable of executing a normal mode for supporting purchases by Internet communication sales and a store mode for supporting purchases at a physical store, and an accounting machine for executing settlement processing, wherein the mobile terminal processing means for starting the application in the normal mode when receiving a start instruction from a user and transitioning the application to the store mode when receiving a trigger while operating in the normal mode; reading means for reading a barcode attached to a product in the store mode by an imaging unit and extracting code information from the obtained image; display means for storing a product corresponding to the code information obtained by the reading means in a virtual cart different from the normal cart in the normal mode and displaying the total amount of the products in the virtual cart; and the accounting machine is set in the store and performs accounting for the total amount, characterized in that it is a purchase support system.

2. The purchase support system according to claim 1, wherein the trigger is that the reading means has read a code including a store ID.

3. The purchase support system according to claim 2, wherein the processing means holds the current time at the time of transitioning to the store mode as the entry time in association with the store ID.

4. The purchase support system according to claim 1, wherein the reading means notifies the user that there is a duplication when reading the same code information.

5. The purchase support system according to claim 1, wherein the processing means executes the normal mode and the store mode in parallel.

6. The purchase support system according to claim 1, wherein the display means displays a two-dimensional barcode for allowing another terminal to read and perform a checkout process.

7. The purchase support system according to claim 1, wherein the display means displays a scan frame for the reading screen to read the barcode.

8. A purchase support method for causing a mobile terminal capable of executing a normal mode for supporting purchases by Internet communication sales and a store mode for supporting purchases at a physical store to execute, a first step of starting the application in the normal mode when receiving a start instruction from a user and transitioning the application to the store mode when receiving a trigger while operating in the normal mode; A second step of capturing, by an imaging unit, a barcode attached to a product in the store mode and extracting code information from the obtained image; A third step of storing a product corresponding to the code information obtained in the second step in a virtual cart different from the normal cart in the normal mode and displaying the total amount of the products in the virtual cart, wherein the purchasing support method is characterized by comprising the third step.

9. The purchasing support method according to claim 8, wherein the trigger is that the imaging unit of the mobile terminal has read a code including a store ID.

10. The purchasing support method according to claim 9, wherein in the first step, when transitioning to the store mode, the current time at the time of transition to the store mode is associated with the store ID as the entry time and held in the mobile terminal.

11. The purchasing support method according to claim 8, wherein in the second step, when the same code information is read, the user is notified that there is a duplication.

12. The purchasing support method according to claim 8, further comprising a fourth step of displaying, on the screen of the mobile terminal, a two-dimensional barcode for allowing another terminal to read and perform a store exit process.

13. The purchasing support method according to claim 8, wherein in the second step, a scan frame for reading the barcode is displayed on the screen of the mobile terminal.

14. A mobile terminal capable of executing a normal mode for supporting purchases by Internet communication sales and a store mode for supporting purchases in a physical store, Processing means for starting a store mode for a store indicated by a store code by reading a two-dimensional code containing the store code; Reading means for capturing, by an imaging unit, a barcode attached to a product in the store mode and extracting code information from the obtained image; Display means for storing a product corresponding to the code information obtained by the reading means in a virtual cart different from the normal cart in the normal mode and displaying the total amount of the products in the virtual cart, wherein the mobile terminal is characterized by comprising the display means.

Images