Store system, information processing device, information processing method, and program
A system generates secondary identification information to track customer behavior in stores, allowing for marketing analysis without revealing personal details, thus addressing the need for confidential customer information handling.
Patent Information
- Application Number
- JP2022521854
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2020-05-12
- Filing Date
- 2021-05-06
- Publication Date
- 2024-11-13
- Estimated Expiration
- 2041-05-06
AI Technical Summary
There is a need to collect customer information in stores for marketing purposes while ensuring that personal information remains confidential.
A system is implemented where first personal identification information is acquired upon entry, and second personal identification information is generated for a separate system, allowing for the tracking of customer behavior without revealing personal details, and this information is used to associate purchased products with the customer for analysis.
Enables customer analysis in stores while keeping personal information secret, facilitating effective marketing strategies without compromising privacy.
Smart Images

Figure 0007582308000001 
Figure 0007582308000002 
Figure 0007582308000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a store system, an information processing device, an information processing method, and a program. [Background technology]
[0002] In recent years, advances in image recognition technology and the spread of cashless payments have led to the practical application of unmanned cashier-less stores. Technology for automatically identifying customers in a store is described in Patent Document 1. Patent Document 2 describes an information processing system that uses face recognition to manage customers. The system in Patent Document 2 performs face recognition by matching the customer's face information with registered information, and performs payment processing using member registration information.
[0003] Patent Document 3 describes a system for recording and managing products purchased by customers. The system in Patent Document 3 is configured to enable recording and reference of purchased products, while protecting personal information (for example, "when, where, and what a specific individual purchased").
[0004] Patent Document 4 describes a system for tracking customer purchases in an unmanned, automated checkout store. The system in Patent Document 4 identifies customers using authentication information such as IDs and biometric information, and when it detects that a customer has removed an item from a tray, it identifies the purchased item, automatically associates it with the cart, and performs accounting. Patent Document 4 also describes that by setting a tray on which items are placed exclusively for products from a specific product supplier, sales records of the items on the dedicated tray can be collected and used for marketing. [Prior art documents] [Patent documents]
[0005] [Patent Document 1] International Publication No. 2019 / 181364 [Patent Document 2] JP 2016-126749 A [Patent Document 3] JP 2019-20767 A [Patent Document 4] Special Publication No. 2017-521780 Summary of the Invention [Problem to be solved by the invention]
[0006] Thus, in store operations, it is necessary to collect information on customer behavior within the store, analyze customer needs, and use the information for marketing purposes. At the same time, however, it is necessary to protect the personal information of customers.
[0007] The present invention has been made in consideration of the above circumstances, and an object of the present invention is to provide a technique that makes it possible to easily perform customer analysis in a store while keeping personal information of the customers confidential. [Means for solving the problem]
[0008] In order to solve the above-mentioned problems, each aspect of the present invention employs the following configuration.
[0009] The first aspect relates to an information processing device. An information processing device according to a first aspect includes: a store entry management means for acquiring first personal identification information of a customer who enters a store, generating second personal identification information for a second system that is different from a first system that manages customer information, and storing the acquired first personal identification information and the generated second personal identification information in a storage means in association with each other; A transmitting means for transmitting the second personally identifying information to the second system; an acquisition means for acquiring the second individual identification information and purchased product information, which is information on products purchased by the customer, from the second system; an output means for identifying the first individual identifying information corresponding to the acquired second individual identifying information, and outputting the first individual identifying information and the purchased product information to a payment means; has.
[0010] The second aspect relates to an information processing method of an information processing device executed by at least one computer. An information processing method according to a second aspect of the present invention comprises: An information processing device, When first personal identification information of a customer who enters a store is acquired, second personal identification information for a second system that is separate from a first system that manages customer information is generated, and the acquired first personal identification information and the generated second personal identification information are stored in a storage means in association with each other; Transmitting the second personally identifiable information to the second system; acquire, from the second system, the second personal identification information and purchased product information, which is information on products purchased by the customer; The method includes identifying the first individual identifying information corresponding to the acquired second individual identifying information, and outputting the first individual identifying information and the purchased product information to a payment means.
[0011] The third aspect relates to the store system. The store system according to the third aspect is A first device for managing personal information; a second device that links customers and products in the store; The first device is an entrance management means for generating second individual identifying information for the second device when first individual identifying information of a customer who enters a store is acquired, and storing the acquired first individual identifying information and the generated second individual identifying information in a storage means in association with each other; A transmitting means for transmitting the second personally identifying information to the second device; an acquisition means for acquiring the second individual identification information and purchased product information, which is information on products purchased by the customer, from the second device; an output means for specifying the first individual identifying information corresponding to the acquired second individual identifying information by referring to the storage means, and outputting the first individual identifying information and the purchased product information to a payment means; The second device processes an image captured at the store to associate the second individual identifying information with the purchased item information.
[0012] Another aspect of the present invention may be a program for causing at least one computer to execute the method of the second aspect, or a computer-readable recording medium having such a program recorded thereon. This recording medium includes a non-transitory tangible medium. The computer program includes computer program code which, when executed by a computer, causes the computer to carry out the information processing method on an information processing device.
[0013] Any combination of the above components, and any transformation of the present invention into a method, device, system, recording medium, computer program, etc., are also effective as aspects of the present invention.
[0014] Furthermore, the various components of the present invention do not necessarily have to be independent entities, but may be formed as a single member by multiple components, one component may be formed from multiple components, one component may be a part of another component, or part of one component may overlap with part of another component, etc.
[0015] In addition, although the method and computer program of the present invention describe a number of steps in a sequential order, the order does not limit the order in which the steps are executed. Therefore, when implementing the method and computer program of the present invention, the order of the steps can be changed as long as it does not affect the content.
[0016] Furthermore, the steps of the method and computer program of the present invention are not limited to being executed at different timings, and therefore a step may occur while another step is being executed, or the execution timing of a step may overlap partially or entirely with the execution timing of another step, etc. Effect of the Invention
[0017] According to each of the above aspects, it is possible to provide a technology that allows a store to easily perform customer analysis while keeping personal information of the customers confidential. [Brief description of the drawings]
[0018] [Figure 1] FIG. 1 is a diagram illustrating an example of a configuration of a store system according to an embodiment of the present invention. [Diagram 2] FIG. 1 is a diagram for explaining an example of a store configuration. [Diagram 3] FIG. 2 is a block diagram illustrating a hardware configuration of a computer that realizes an information processing apparatus (first server) according to the embodiment. [Figure 4] 2 is a functional block diagram logically showing the configuration of an information processing device (first server) according to the present embodiment. FIG. [Diagram 5] FIG. 4 is a diagram illustrating an example of a data structure of user information. [Figure 6] FIG. 11 is a diagram showing an example of a data structure of store entry management information. [Figure 7] 5 is a flowchart showing an example of the operation of the information processing device (first server) of the present embodiment. [Figure 8] FIG. 1 is a diagram illustrating an example of the configuration of a store system according to an embodiment of the present invention. [Figure 9] 2 is a functional block diagram logically showing the configuration of an information processing device (first server) according to the present embodiment. FIG. [Figure 10] 4 is a flowchart showing an example of the operation of the store system of the present embodiment. [Figure 11] FIG. 4 is a diagram illustrating an example of a data structure of purchase information. [Figure 12] FIG. 13 is a diagram illustrating an example of a data structure of a store-specific product master. [Figure 13] 4 is a flowchart showing an example of the operation of the store system of the present embodiment. [Figure 14] FIG. 11 is a diagram illustrating an example of a data structure of store entry management information. [Figure 15] FIG. 4 is a diagram illustrating an example of a data structure of user information. [Figure 16] 4 is a flowchart showing an example of the operation of the store system of the present embodiment. [Figure 17] FIG. 1 is a diagram illustrating an example of the configuration of a store system according to an embodiment of the present invention. [Figure 18] FIG. 2 is a functional block diagram logically illustrating a configuration example of a store system according to the present embodiment. [Figure 19] 11A and 11B are diagrams illustrating an example of a data structure of cart information and customer information. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0019] Hereinafter, the embodiments of the present invention will be described with reference to the drawings. In all the drawings, the same components are given the same reference numerals, and the description will be omitted as appropriate. In each drawing, the configuration of the parts that are not related to the essence of the present invention is omitted and is not shown.
[0020] In the embodiment, "acquisition" includes at least one of the following: a device goes to retrieve data or information stored in another device or storage medium (active acquisition), and inputs data or information output from another device to the device (passive acquisition). Examples of active acquisition include making a request or inquiry to another device and receiving a reply, and accessing and reading information from another device or storage medium. Examples of passive acquisition include receiving information that is distributed (or transmitted, push notification, etc.). Furthermore, "acquisition" may mean selecting and acquiring data or information from received data or information, or selecting and receiving distributed data or information.
[0021] (First embodiment) <System Overview> FIG. 1 is a diagram showing an example of the configuration of a store system 1 according to an embodiment of the present invention. The store system 1 is a system that manages an unmanned, cashierless store. In the first embodiment, an example is described in which the store system 1 includes a first system 10 that manages customer information. In the fifth embodiment described later, an example is described in which the store system 1 includes the first system 10 and a second system 20 that manages the purchasing behavior of customers in the store.
[0022] In the present embodiment, a configuration example will be described in which the first system 10 does not include the settlement device 30. A configuration example in which the first system 10 includes the settlement device 30 will be described in an embodiment described later.
[0023] The first system 10 and the second system 20 may be systems managed by different companies, organizations, etc., or may be systems managed by the same company, organization, etc. In this embodiment, the first system 10 and the second system 20 are described as systems managed by different companies, organizations, etc.
[0024] The first system 10 includes a first server 100 (information processing device) and a first storage device 12. The second system 20 includes a second server 200 and a second storage device 22. The settlement device 30 is connected to a third storage device 32. The first server 100 of the first system 10 is connected to the second server 200 and the settlement device 30 of the second system 20 via a communication network 3.
[0025] The first storage device 12 stores various data and / or programs of the first server 100. The second storage device 22 stores various data and / or programs of the second server 200. The third storage device 32 stores various data and / or programs of the settlement device 30.
[0026] The first storage device 12 may be provided inside or outside the first server 100. In other words, the first storage device 12 may be a piece of hardware integrated with the first server 100, or may be a piece of hardware separate from the first server 100. The first server 100 and the first storage device 12 may be connected via a communication network 3.
[0027] The same applies to the second storage device 22 and the second server 200, and the third storage device 32 and the settlement device 30. In other words, the second storage device 22 may be provided inside the second server 200 or may be provided outside. The second storage device 22 may be hardware integrated with the second server 200, or may be hardware separate from the second server 200. The second server 200 and the second storage device 22 may be connected via a communication network 3.
[0028] Furthermore, the third storage device 32 may be provided inside or outside the settlement device 30. The third storage device 32 may be hardware integrated with the settlement device 30, or may be hardware separate from the settlement device 30. The settlement device 30 and the third storage device 32 may be connected via a communication network 3.
[0029] For example, the first system 10 is a system that manages personal information of a customer U who uses a store to shop, generates payment information for products purchased by the customer U at the store, and has the payment device 30 perform payment processing. In this embodiment, the payment device 30 is described as a system separate from the first system 10, but may be included in the first system 10 as described above.
[0030] The second system 20 is, for example, a system that collects and analyzes information such as the purchasing behavior of a customer U (a person using a store) at a store while keeping the personal information of the customer U who uses the store to shop confidential. In the second system 20, as long as the information does not identify the individual customer U, attribute information such as gender, age, residential area, marital status, family structure, occupation type, hobbies, and preferences may be acquired and managed.
[0031] As described above, in this embodiment, the first system 10 and the second system 20 are systems managed by different companies or organizations, and therefore the personal information of customer U managed by the first system 10 can be kept confidential from the second system 20, and the behavior of a person (customer U) in a store can be tracked without identifying customer U, allowing information such as the purchasing behavior of the person (customer U) to be collected and analyzed.
[0032] FIG. 2 is a diagram for explaining an example of the configuration of a store 60. The store 60 is equipped with at least one display shelf 62. The display shelf 62 here refers to a fixture having at least one shelf or bottom surface on which products 64 are placed, a refrigerated or frozen showcase, a gondola, or the like. A plurality of products 64 are displayed on the display shelf 62. A customer U enters the store 60 carrying a cart 66. However, the customer U does not have to carry the cart 66. The customer U may place the product 64 to be purchased in a container (such as a bag, satchel, or handbag) that he or she owns.
[0033] For example, a weight sensor 7 is provided on the shelf board or the bottom surface of the case of the display shelf 62. When a product 64 is taken out of the display shelf 62, the weight sensor 7 detects a change in weight, and thus it is detected that the product 64 has been taken out.
[0034] The store 60 is provided with an entrance gate 70 and an exit gate 72. The entrance gate 70 is provided with an entrance terminal 40, and a customer U enters the store 60 after performing authentication processing for entering the store at the entrance terminal 40. The customer U then places a product 64 that he or she wishes to purchase in a cart 66 and exits the store 60 through an exit gate 72.
[0035] A camera 5 is installed in the store 60, and generates images of customers U moving within the store 60. Although only one camera 5 is shown in the figure, multiple cameras 5 may be installed. The images generated by the camera 5 are at least one of a video, a still image, and a frame image at a predetermined interval.
[0036] The camera 5 further generates an image capturing an item 64 that the customer U has taken from the display shelf 62 and placed in the cart 66. In the second system 20, by processing the image generated by the camera 5, it is possible to track the movement of the person (customer U) within the store 60 and to recognize the item 64 that has been taken from the display shelf 62 and placed in the cart 66.
[0037] <Hardware configuration example> 3 is a block diagram illustrating an example of a hardware configuration of a computer 1000 that realizes the first server 100. The second server 200, the settlement device 30, the entrance terminal 40, and the user terminal 50 are also each realized by a similar computer 1000.
[0038] The computer 1000 has a bus 1010, a processor 1020, a memory 1030, a storage device 1040, an input / output interface 1050, and a network interface 1060.
[0039] The bus 1010 is a data transmission path for transmitting and receiving data among the processor 1020, memory 1030, storage device 1040, input / output interface 1050, and network interface 1060. However, the method of connecting the processor 1020 and the like to each other is not limited to a bus connection.
[0040] The processor 1020 is implemented by a central processing unit (CPU) or a graphics processing unit (GPU).
[0041] The memory 1030 is a main storage device realized by a RAM (Random Access Memory) or the like.
[0042] The storage device 1040 is an auxiliary storage device realized by a hard disk drive (HDD), a solid state drive (SSD), a memory card, a read only memory (ROM), or the like. The storage device 1040 stores program modules that realize each function of the first server 100 (information processing device) (for example, an entrance management unit 102, a transmission unit 104, an acquisition unit 106, an output unit 108, and the like, which will be described later). The processor 1020 loads each of these program modules onto the memory 1030 and executes them, thereby realizing each function corresponding to the program module. The storage device 1040 may also store, for example, various data and programs of the first storage device 12 of the first server 100.
[0043] The program module may be recorded in a recording medium. The recording medium for recording the program module may include a non-transitory tangible medium usable by the computer 1000, and the program code readable by the computer 1000 (processor 1020) may be embedded in the medium.
[0044] The input / output interface 1050 is an interface for connecting the computer 1000 to various input / output devices. The input / output interface 1050 also functions as a communication interface for performing short-range wireless communication such as Bluetooth (registered trademark) and NFC (Near Field Communication).
[0045] The network interface 1060 is an interface for connecting the computer 1000 to a communication network. This communication network is, for example, a LAN (Local Area Network) or a WAN (Wide Area Network). The method for connecting the network interface 1060 to the communication network may be a wireless connection or a wired connection.
[0046] The computer 1000 is then connected to necessary devices (eg, the entrance terminal 40, the camera 5, the weight sensor 7, etc.) via the input / output interface 1050 or the network interface 1060.
[0047] The camera 5 includes an imaging element such as a lens and a charge coupled device (CCD) image sensor. The camera 5 further includes a computer 1000, and communicates with the first server 100 or the second server 200 via the communication network 3.
[0048] The weight sensor 7 is, for example, a piezoelectric element provided on a shelf board or a case bottom surface of the display shelf 62. It detects the weight of the product 64 displayed on the display shelf 62 in the store 60. In this embodiment, by detecting a change in the weight of the product 64 displayed on the display shelf 62, it is possible to detect that the product 64 has been removed from the display shelf 62.
[0049] The store entrance terminal 40 includes a computer 1000, and, for example, a display, a code reader, an IC card reader, a camera, a speaker, and a microphone, all of which are not shown in the figure. The display may display a screen showing a message or the like for prompting the customer U to perform authentication processing required for store entrance.
[0050] The user terminal 50 is, for example, a mobile terminal such as a smartphone, a tablet terminal, etc. The user terminal 50 includes a computer 1000, and, for example, a display, a camera, a speaker, a microphone, an IC card, and a wireless communication unit, which are not shown.
[0051] <Example of functional configuration> 4 is a functional block diagram logically illustrating the configuration of the first server 100 (information processing device) of this embodiment. The first server 100 includes an entry management unit 102, a transmission unit 104, an acquisition unit 106, and an output unit 108.
[0052] Each component of the first server 100 (information processing device) of this embodiment in Fig. 4 is realized by any combination of hardware and software of the computer 1000 in Fig. 3. Those skilled in the art will understand that there are various modifications to the realization method and device. The functional block diagram showing the first server 100 (information processing device) of each embodiment shows blocks of logical function units, not a configuration of hardware units.
[0053] When the store entry management unit 102 acquires the first personal identification information of a customer U who has entered the store 60, the store entry management unit 102 generates second personal identification information for the second system 20 that is separate from the first system 10. Then, the store entry management unit 102 stores the acquired first personal identification information and the generated second personal identification information in the first storage device 12 in association with each other.
[0054] The first individual identifying information is information capable of uniquely identifying the customer U in the first system 10, and is, for example, a user ID described below. Also, for example, the store 60 may be part of a facility within a company or school. In that case, the first individual identifying information may be an employee number or a student ID number that is uniquely assigned to an employee of the company or a student of the school and capable of uniquely identifying the customer U, or information including at least a part of these numbers.
[0055] As described above, the store entry management unit 102 acquires the first individual identification information acquired by the store entry terminal 40. In the example of FIG. 2, the store entry terminal 40 is installed in front of the store entry gate 70 of the store 60. However, the store entry terminal 40 may be installed immediately after entering the store 60. Furthermore, the store entry terminal 40 may be installed at a position on the route from the store entry gate 70 of the store 60 to the area where the display shelves 62 are installed. The store entry management unit 102 acquires the user ID of the customer U read by the store entry terminal 40 at least before entering the store 60 or the area where the display shelves 62 are installed.
[0056] A customer U who uses the store 60 registers user information 140 in advance. Each customer U is assigned identification information (hereinafter referred to as a user ID) that uniquely identifies the customer U. As shown in FIG. 5(a), the user information 140 is stored in the first storage device 12 in such a manner that the user ID is associated with biometric information used to authenticate the customer U and payment information including information such as a card number used for payment for purchases. The user information 140 is not limited to this, and may include, for example, information such as a name, an address, a contact telephone number, and an email address as customer information.
[0057] The entrance terminal 40 recognizes the visit of the customer U by reading the user ID of the customer U who has visited the store. Hereinafter, in this embodiment, the first individual identifying information will be described as the customer U's user ID.
[0058] There are various possible methods for the entrance terminal 40 to obtain a user ID, and examples thereof are given below, but are not limited to these. (a1) A two-dimensional code such as a QR code (registered trademark) or a barcode indicating a user ID is displayed on the user terminal 50 of the customer U. The customer U holds the two-dimensional code displayed on the user terminal 50 over the code reader of the store entrance terminal 40. The store entrance terminal 40 reads the displayed two-dimensional code using the code reader and obtains the user ID. For example, the two-dimensional code can be displayed on the screen by starting a specific application on the user terminal 50. Alternatively, a specific browser can be started on the user terminal 50 to log in to a web page for members and display the two-dimensional code on the screen. (a2) The user ID is recorded in the IC memory of the user terminal 50 of the customer U. The customer U touches the user terminal 50 to the entrance terminal 40. The entrance terminal 40 reads the user ID from the IC memory of the user terminal 50 of the customer U using an IC card reader. (a3) The user ID is recorded on a magnetic card for membership that has been distributed to the customer U in advance. The customer U passes the magnetic card through the card reader of the entrance terminal 40. The entrance terminal 40 reads the user ID from the customer U's magnetic card using the card reader. (a4) The user ID is a two-dimensional code indicating the user ID written on the surface of a membership card made of paper, plastic, etc. that is distributed in advance to customer U. Customer U holds the two-dimensional code on the membership card over the code reader of store entrance terminal 40. Store entrance terminal 40 uses the code reader to read the two-dimensional code from customer U's membership card and obtains the user ID.
[0059] Furthermore, the entrance terminal 40 performs authentication processing by comparing facial features extracted from an image generated by photographing the face of customer U using a camera with facial features of customer U that have been registered in advance and correspond to the acquired user ID.
[0060] The camera that photographs the face of the customer U may be one installed on the front panel (not shown) of the entrance terminal 40, or may be a camera 5 installed on the ceiling of the store 60. However, the authentication process is not limited to one that uses facial features, and may be an authentication process that uses other biometric authentication information. The other biometric authentication information may include at least one feature of the iris, veins, auricle, fingerprint, voiceprint, gait, and physique (height, shoulder width, body length, bone structure, etc.). Alternatively, at least two pieces of biometric authentication information may be combined.
[0061] The second individual identifying information is used in the second system 20 as information for uniquely identifying a person (customer U) who uses the store. The second individual identifying information is false (dummy) identification information different from the first individual identifying information, which serves as a substitute for the first individual identifying information in order to conceal the first individual identifying information. The store entry management unit 102 generates second individual identifying information (hereinafter also referred to as a false user ID) which is different from the user ID acquired by the store entry terminal 40 and is used in the second system 20 in place of the user ID.
[0062] The transmitting unit 104 transmits the false user ID to the second server 200. Here, the timing for associating the user ID with the fake user ID may be each time the customer U enters the store 60, or it may be before entering the store, for example, when registering user information, or the previous time the customer U entered the store.
[0063] Depending on the timing of associating the user ID with the false user ID, the processing procedures of the entrance management unit 102 and the transmission unit 104 differ as exemplified below. (b1) When the store entry management unit 102 acquires the user ID of the customer U who has entered the store, it generates a fake user ID different from the user ID, and stores the generated fake user ID in association with the user ID in the user information 140. The transmission unit 104 transmits the generated fake user ID to the second server 200. (b2) A fake user ID that is generated in advance in association with the user ID is stored in the user information 140. When the store entry management unit 102 acquires the user ID of the customer U who has entered the store, it refers to the user information 140 and reads out the fake user ID that corresponds to the acquired user ID. The transmission unit 104 transmits the read fake user ID to the second server 200.
[0064] In the method (b1), even if the same customer U visits the store, a different fake user ID is assigned each time, so it is not possible to continuously collect information about that user. However, this has the advantage of simplifying information management and processing. In addition, it is more difficult to infer the identity of customer U than in (b2), so personal information can be protected more securely.
[0065] In the method (b2), the fake user ID corresponding to the user ID of customer U is fixed, so that the second system 20 can collect information on a customer U as the same person even if the customer U visits the store at a different date and time.
[0066] As shown in FIG. 5(b), the entrance management unit 102 stores the false user ID in association with the user ID of the user information 140 shown in FIG. 5(a).
[0067] Furthermore, as shown in FIG. 6, the store entry management unit 102 may store date and time information indicating the date and time when the customer U entered the store, the user ID acquired by the store entry terminal 40, and the generated fake user ID in association with each other as the store entry management information 142. The second individual identification information (fake user ID) may be any information. In the example shown in the figure, it is information consisting of alphanumeric characters of a predetermined number of digits, but is not limited to this. In this embodiment, the store entry management unit 102 generates a fake user ID every time the customer U of (b1) above visits the store and records it in the store entry management information 142, as will be described below.
[0068] The acquisition unit 106 acquires, from the second server 200, the second personal identification information and purchased product information, which is information on products purchased by a person (customer U) associated with the second personal identification information. The second system 20 acquires personal characteristic information indicating personal characteristics related to the behavior of the person (customer U) in the store 60, Purchased Items The first system 10 acquires the purchased product information collected by the second system 20 and analyzes the information.
[0069] The personal characteristic information is, for example, a person's "behavior," such as behavior related to purchasing, and is information indicating characteristics (or patterns) of a person's movement route, gestures, actions, etc. However, the personal characteristic information does not include information that can identify an individual.
[0070] In the second system 20, based on the weight sensor 7 provided on the display shelf 62 and the image generated by the camera 5, Person (Customer U) The system 10 then identifies the product 64 that the person (customer U) has placed in the cart 66 and passes, for example, the product code and the quantity of the product to the first system 10 in association with the pseudo user ID assigned to the person (customer U).
[0071] That is, the acquisition unit 106 receives the product code and the quantity of the product 64 associated with the false user ID from the second server 200 of the second system 20 via the communication network 3.
[0072] The output unit 108 refers to the store entry management information 142 in the first storage device 12 and identifies a user ID corresponding to the acquired false user ID. Then, the output unit 108 outputs the user ID and the purchased item information to the settlement device 30. Specifically, the output unit 108 associates the user ID with the item code and the quantity of the purchased item 64 and transmits them to the settlement device 30 via the communication network 3.
[0073] <Example of operation> FIG. 7 is a flowchart showing an example of the operation of the first server 100 of this embodiment. First, when a customer U enters a store 60, the user terminal 50 displays a two-dimensional code for store entry and holds it over the code reader of the store entry terminal 40. Then, the store entry terminal 40 reads the two-dimensional code using the code reader and acquires the user ID (first individual identification information).
[0074] When the store entry terminal 40 acquires a user ID (first individual identifying information) (YES in step S101), the store entry management unit 102 generates a fake user ID (second individual identifying information) different from the user ID (step S103). The store entry management unit 102 associates the acquired user ID (first individual identifying information) with the generated fake user ID (second individual identifying information) and stores them in the first storage device 12 (step S105). The transmission unit 104 transmits the fake user ID (second individual identifying information) to the second system 20 (step S107).
[0075] Steps S101 to S107 are processes performed from when the customer U arrives at the store 60 and when he or she shops at the store 60. After that, after the customer U finishes shopping and leaves the store 60 through the exit gate 72, the acquisition unit 106 acquires, from the second system 20, the false user ID (second individual identification information) and purchased product information of the person (customer U) associated with the false user ID (step S109).
[0076] As described above, the acquisition unit 106 may passively receive information sent from the second system 20, or may actively receive information by requesting the information from the second system 20 at a predetermined timing, or may combine both passive and active reception.
[0077] Examples of timings for acquiring information on purchased items of a person (customer U) include, but are not limited to, the following. In addition, a combination of multiple timings may be used. (c1) When it is detected that a person (customer U) has exited from the exit gate 72 of the store 60 (c2) After a certain period of time has elapsed since entry to the store was detected (c3) Periodically (e.g., at a fixed time after closing time, at a fixed time every day, at a fixed time every week, at a fixed time every month, or at the time of payment deadline) (c4) Every time a person (customer U) puts or takes out a product 64 from a cart 66
[0078] There are various possible methods for detecting that the person (customer U) in (c1) above has exited through the exit gate 72 of the store 60, and examples thereof are given below, but are not limited to these. Also, a combination of multiple methods may be used. (d1) Exit from the exit gate 72 is detected by tracking movement within the store 60 using images generated by the camera 5. (d2) An operation terminal for exiting the store (not shown) is provided at the exit gate 72, and exiting the store is detected by having customer U operate the operation terminal using customer U's user terminal 50 in the same manner as when entering the store, thereby obtaining customer U's user ID.
[0079] Then, the output unit 108 refers to the first storage device 12 to identify a user ID (first personal identification information) corresponding to the acquired fake user ID (second personal identification information) (step S111), and outputs the user ID (first personal identification information) and the purchased product information to the settlement device 30 (step S113).
[0080] There are various possible timings for the output unit 108 to output information to the settlement device 30, including, but not limited to, the following examples. A combination of the following may be used as long as there is no contradiction. (e1) Every time information is received by the acquisition unit 106 (e2) After a predetermined time has elapsed since the information was received by the acquisition unit 106 (e3) After the date and time when the information is received by the acquisition unit 106, periodically (for example, at a fixed time after closing time, at a fixed time every day, at a fixed time every week, at a fixed time every month, or at the time of payment deadline)
[0081] As described above, according to this embodiment, when the store entry management unit 102 acquires the user ID of the customer U who entered the store 60, it generates a fake user ID different from the user ID and passes it to the second system 20 that tracks the customer U. Meanwhile, the second system 20 manages the person (customer U) who entered the store with the fake user ID to collect personal characteristic information, and passes the purchased product information of the person (customer U) to the first system 10. Then, the first system 10 performs the process related to the settlement, that is, the process that needs to be performed by identifying the individual customer U. Therefore, the first system 10 can reliably perform the process related to the settlement related to the product purchase by the customer U in a state in which the individual customer U is identified, and the second system 20 can prevent the individual customer U from being identified. By managing the customer U with the fake user ID in the second system 20, it is possible to collect personal characteristic information related to the behavior of the person (customer U) in the store 60 without identifying the personal information.
[0082] The second system 20 can use the camera 5 and weight sensor 7 to collect purchase information of a person (customer U) who enters the store and personal characteristic information of the person (customer U) in the store 60, without identifying the customer U as an individual.
[0083] Second embodiment Fig. 8 is a diagram showing an example of the configuration of the store system 1 of this embodiment. Fig. 9 is a functional block diagram logically showing the configuration of the first server 100 (information processing device) of this embodiment. The store system 1 of this embodiment is similar to the above embodiment, except that the first system 10 includes a settlement device 30.
[0084] <Example of functional configuration> The first server 100 further includes a settlement processing unit 120 in addition to the configuration of the first server 100 in Fig. 4. At least one of the settlement device 30 and the third storage device 32 may be provided inside the first server 100 or may be provided externally. In other words, at least one of the settlement device 30 and the third storage device 32 may be hardware integrated with the first server 100 or hardware separate from the first server 100. The first server 100 and at least one of the settlement device 30 and the third storage device 32 may be connected via a communication network 3.
[0085] The settlement processing unit 120 executes the settlement for the product 64 to be purchased using a payment method corresponding to the user ID (first individual identification information). The payment method may be a credit card payment, an account transfer, a transfer from a convenience store, etc., and is designated in advance by the customer U. The payment method may include information such as the type of credit card, the card number, the expiration date, the name, the security code, or information such as the bank name, the branch name, the account type, the account number, the name of the transfer account. The designated payment method is stored in the above-mentioned user information 140 in association with the user ID. Furthermore, if the store 60 is within a company, the payment method may be payroll deduction.
[0086] <Example of operation> FIG. 10 is a flowchart showing an example of the operation of the store system 1 of this embodiment. First, the store entrance terminal 40 reads the two-dimensional code displayed on the user terminal 50 presented by the customer U, acquires the user ID, and transmits it to the first server 100 (step S201). Then, in the first server 100, the store entrance management unit 102 generates a fake user ID corresponding to the user ID received from the store entrance terminal 40, associates the user ID with the fake user ID, and stores it in the first storage device 12 as store entrance management information 142 (step S203).
[0087] Then, the transmitting unit 104 transmits the generated false user ID to the second server 200 (step S205). The second server 200 detects the entry of the person (customer U) into the store, and acquires the person characteristic information and purchased product information of the person (customer U) in the store 60 (step S207). A specific example of the processing of the second server 200 will be described in detail in the fifth embodiment described later.
[0088] Then, in the first server 100, the acquisition unit 106 receives the fake user ID of the person (customer U) and the purchased product information (product code and quantity) transmitted from the second server 200 (step S209). The output unit 108 refers to the store entry management information 142 to identify the user ID corresponding to the received fake user ID (step S211).
[0089] The output unit 108 outputs the purchased product information (product code and quantity) to the specified user ID. To The user ID and the product code may be associated and stored in the purchase information 144 in Fig. 11. In the purchase information 144, at least one pair of a product code and a quantity is associated with the user ID.
[0090] Then, the output unit 108 passes the user ID and the purchased product information of the customer U received in step S209 to the payment processing unit 120 (step S213). The purchased product information of the customer U includes the product code and the quantity.
[0091] The settlement processing unit 120 refers to the user information 140 and causes the settlement device 30 to execute settlement for the product 64 to be purchased by the customer U, using the payment method corresponding to the user ID (step S215). At this time, the settlement processing unit 120 transmits to the settlement device 30 information relating the purchased product information (including product code and quantity) of the customer U and the payment method of the customer U to the user ID of the customer U.
[0092] In this embodiment, the first server 100 is configured to manage the payment means of customer U. However, the payment means of customer U may also be configured to be managed by the settlement device 30. In other words, the settlement device 30 may be equipped with the functions of the settlement processing unit 120. In that case, the user information 140 in Fig. 5(a) and Fig. 5(b) will only have a user ID and biometric information. On the other hand, the user ID of customer U may be associated with the payment means of customer U and stored in the third storage device 32 as user information (not shown) that the settlement processing unit 120 can refer to.
[0093] According to this embodiment, since the first system 10 includes the settlement device 30, the first system 10 can execute up to the payment processing for the customer U, and can conceal information that can identify the individual of the customer U from the second system 20 that is separate from the first system 10. The second system 20 can collect tracking information of a person (customer U) in the store 60, as in the above embodiment.
[0094] Third embodiment This embodiment is similar to the first or second embodiment, except that a second system 20 is provided for each store 60, and the purchased product information of a customer U is managed for each store 60. Here, a configuration combined with the second embodiment will be described. Also, the configuration of this embodiment can be combined with any of the other embodiments to the extent that there is no contradiction. The second embodiment will be described below using the functional block diagram of FIG. 9.
[0095] <Example of functional configuration> The second system 20 is provided for each store 60 . The store entry management unit 102 acquires the user ID (first individual identifying information) together with the store identifying information, and stores the acquired store identifying information in association with the false user ID (second individual identifying information). The output unit 108 further transmits the store-specific information to the settlement device 30.
[0096] The store entry management unit 102 acquires identification information capable of identifying the store 60, for example, a store ID, together with the user ID from the store entry terminal 40. In other words, the store entry terminal 40 associates the user ID acquired from the user terminal 50 of the customer U with the store ID of the store 60, and transmits them to the first server 100.
[0097] The settlement device 30 stores a store-specific product master 146 in the third storage device 32. Fig. 12 is a diagram showing an example of the data structure of the store-specific product master 146. The store-specific product master 146 may be a table of product codes and prices for each store 60 as shown in Fig. 12(a), or may be a table of store IDs and prices for each product 64 as shown in Fig. 12(b).
[0098] The store-specific product master 146 stores at least the product code of the product 64 in association with the price of the product 64 for each store 60. The store-specific product master 146 may further store information such as the product name of the product 64 and a special sale period and special sale price for each store 60.
[0099] <Example of operation> FIG. 13 is a flowchart showing an example of the operation of the store system 1 of this embodiment. The flow in FIG. 13 includes steps S205 to S209 and step S215 that are the same as those in the flow in FIG. 10 of the second embodiment, and further includes steps S301, S303, S311, S313, and S315.
[0100] First, the store entrance terminal 40 reads the two-dimensional code displayed on the user terminal 50 presented by the customer U, acquires the user ID, and transmits it to the first server 100 together with the store ID (store identification information) of the store 60 (step S301). The store entrance terminal 40 stores the store ID in advance in the memory 1030 or the storage device 1040. Then, in the first server 100, the store entrance management unit 102 generates a fake user ID corresponding to the user ID received from the store entrance terminal 40, and associates the user ID, the fake user ID, and the store ID with each other and stores them in the first storage device 12 as store entrance management information 142 (step S303). Steps S205 to S209 are the same as those in FIG. 10.
[0101] Fig. 14 is a diagram showing an example of the data structure of the store entry management information 142 of this embodiment. In the example of Fig. 14(a), every time a customer U enters a store, the date and time of entry, the store ID (store identification information) of the store 60 entered, the user ID of the customer U, and a fake user ID different from the user ID are associated and stored in the store entry management information 142. In the example of Fig. 14(b), the store entry management information 142 is stored for each store in association with the store ID.
[0102] Returning to FIG. 13, the output unit 108 refers to the store entry management information 142 to identify the user ID and store ID corresponding to the received false user ID (step S311).
[0103] The output unit 108 outputs the purchased product information (product code and quantity) to the specified user ID. To The user ID and the product code may be associated and stored in the purchase information 144 in Fig. 11. In the purchase information 144, at least one pair of a product code and a quantity is associated with the user ID.
[0104] Then, the output unit 108 passes the user ID and store ID identified in step S311 and the purchased product information (product code and quantity) of the customer U received in step S209 to the payment processing unit 120 (step S313). The payment processing unit 120 refers to the store-specific product master 146 and identifies the price of the product 64 corresponding to the store ID (step S315).
[0105] Then, the settlement processing unit 120 refers to the user information 140 and causes the settlement device 30 to execute the settlement for the product 64 to be purchased by the customer U, using the payment method corresponding to the user ID (step S215).
[0106] According to this embodiment, even if different prices are set for products at each store 60, it is only necessary to transmit the settlement information by associating it with specific information of the store 60 used by the customer U. With a simple configuration, the settlement process can be performed at the price set for each store 60. Furthermore, this embodiment also has the same effects as the first embodiment.
[0107] (Fourth embodiment) This embodiment is similar to any of the above embodiments except that it has a configuration that can change the processing level required for tracking a person (customer U) in the store 60. A configuration combined with the second embodiment will be described. The configuration of this embodiment can be combined with any of the other embodiments to the extent that there is no contradiction. The following description will be given using the functional block diagram of FIG. 9 of the second embodiment.
[0108] <Example of functional configuration> The user ID (first individual identification information) is associated with processing level information indicating a processing level required for tracking the individual. As shown in Fig. 15, in the user information 140 in this embodiment, in addition to the example of Fig. 5(a), the user ID is further associated with processing level information. The transmitting unit 104 further transmits the processing level information to the second server 200 of the second system 20 in association with the user ID.
[0109] The second system 20 changes the processing level of tracking the person (customer U) according to the processing level indicated by the processing level information of the person (customer U) received from the first system 10. Tracking the person (customer U) includes tracking and recording the person (customer U) moving within the store 60 using images generated by the camera 5.
[0110] The tracking processing level includes, for example, the strictness of tracking that changes depending on the person (customer U). There are multiple purposes for tracking a person (customer U). For example, it may be possible to collect the behavior history of the person (customer U), collect data on the trajectory of the person (customer U) for analysis of the movement line within the store 60 (floor), detect suspicious individuals (shoplifters, robbers, fighters, etc.), etc. However, it is not limited to these.
[0111] The tracking of the person (customer U) is performed by analyzing the image generated by the camera 5. For example, the image resolution when performing the image analysis process, the number of frames within a predetermined time, etc. are changed according to the processing level. For example, when a person (customer U) who has a history of behaving suspiciously behind an object such as a display shelf 62 or a person (customer U) who is included in a so-called blacklist enters the store, the processing level is increased. Note that the blacklist stores the face image or feature amount of the person (customer U), and it may be possible to determine whether or not the person is included in the blacklist by matching the face image in the face recognition process when entering the store. For example, since the person (customer U) is considered to have a high possibility of committing shoplifting, etc., when photographing a pre-designated area of the store 60 where shoplifting, etc., is likely to occur, the image resolution may be increased, the person's (customer U's) hands or the product 64 may be zoomed in (enlarged), or the number of frames within a predetermined time may be increased.
[0112] On the other hand, for example, if the person (customer U) is a regular customer, the processing level may be set to low. For example, the image resolution may be lowered, the image may be photographed at life size, or the number of frames within a given time may be reduced. If the person (customer U) is an ordinary person, the processing level may be set to normal. In this way, the processing level may be set to three levels such as high, normal, and low, but is not limited to these.
[0113] Furthermore, the accuracy of the results of the image analysis processing detected by the weight sensor 7 of the product 64 or generated by the camera 5 may be reduced depending on the individual behavioral habits of the person (customer U), such as the way the person picks up the products 64 or the way the person puts the products 64 into the cart 66. In other words, the processing level may be set according to the history of the accuracy (error rate, etc.) of the results of the image analysis processing for each person (customer U), rather than whether or not the person is suspicious or a regular customer.
[0114] Also, based on the behavior history of a person (customer U), it may be checked whether the person (customer U) matches a specific behavior pattern, and if the person matches the specific behavior pattern, the processing level may be set high or low. Furthermore, if the person does not match the specific behavior pattern, the processing level may be set high or low.
[0115] The history of the accuracy (error rate, etc.) of the results of the above-mentioned image analysis processing and the results of the behavioral pattern analysis are transmitted from the second server 200 to the first server 100 in association with the fake user ID, so that the first server 100 receives them as information on the user ID corresponding to the fake user ID and can set the processing level.
[0116] Furthermore, the processing level may be set manually by an administrator of the first server 100. For example, the result of the matching process with a specific behavioral pattern may be displayed on a display of a terminal device (not shown) used by the administrator of the first server 100, and the processing level set by the administrator may be accepted. Alternatively, the processing level may be set automatically based on the matching result (degree of match) or the image analysis processing result (error history). <Example of operation> FIG. 16 is a flowchart showing an example of the operation of the store system 1 of this embodiment. The flow in FIG. 16 includes steps S201, S203, and S209 to S215 that are the same as those in the flow in FIG. 10 of the second embodiment, and further includes steps S405 and S407.
[0117] First, the store entrance terminal 40 reads the two-dimensional code displayed on the user terminal 50 presented by the customer U, acquires the user ID, and transmits it to the first server 100 (step S201). Then, in the first server 100, the store entrance management unit 102 generates a fake user ID corresponding to the user ID received from the store entrance terminal 40, associates the user ID with the fake user ID, and stores it in the first storage device 12 as store entrance management information 142 (step S203).
[0118] Then, the transmission unit 104 refers to the user information 140, acquires the processing level corresponding to the user ID of the customer U, and transmits the acquired processing level to the second server 200 in association with the generated fake user ID (step S405). The second server 200 detects the person (customer U) entering the store, and acquires the person characteristic information and purchased product information of the person (customer U) in the store 60. At this time, the second server 200 performs tracking processing of the person (customer U) according to the processing level of the person (customer U) of the fake user ID received from the first server 100 (step S407). A specific example of the processing of the second server 200 will be described in detail in the fifth embodiment described later. Hereinafter, the processing procedure from step S209 onwards is the same as that of the second embodiment.
[0119] According to this embodiment, the processing level of tracking of a person (customer U) in the store 60 can be changed for each person (customer U), so that information about the person (customer U) can be appropriately collected in the second system 20. By appropriately setting the processing level of the person (customer U), the accuracy of the image recognition result in the tracking process can be improved. Alternatively, it is possible to prevent unnecessarily high-precision image recognition processing from being performed, so that the load of the tracking process can be appropriately reduced. This embodiment also achieves the same effects as the first embodiment.
[0120] Fifth embodiment 17 is a diagram showing an example of the configuration of a store system 1 according to this embodiment. In this embodiment, the store system 1 is the same as at least one of the above-mentioned first to fourth embodiments, except that in addition to the first system 10, the store system 1 also includes a second system 20. In this embodiment, a combination of the store system 1 according to the first embodiment and the second system 20 will be described, but the store system 1 may be combined with any of the other embodiments as long as there is no contradiction.
[0121] The second server 200 of the second system 20 processes the image captured in the store 60 to associate the pseudo user ID (second individual identifying information) with the purchased item information.
[0122] <Example of functional configuration> FIG. 18 is a functional block diagram logically illustrating an example configuration of each of the first system 10, the second system 20, and the third system 300 of the store system 1 of this embodiment. In this embodiment, the first system 10, the second system 20, and the third system 300 are systems managed by different organizations. However, at least two of the first system 10, the second system 20, and the third system 300 may be systems managed by the same organization.
[0123] The first system 10 manages the personal information of customer U as well as the prices of products 64 by store. When the first system 10 receives information on products 64 that a person (customer U) has placed in a cart 66 from the second system 20, it generates settlement information and transmits it to the third system 300.
[0124] The second system 20 photographs a person (customer U) who enters the store with the camera 5 and tracks him / her, identifies the product 64 placed in the cart 66 with the camera 5 and weight sensor 7, registers the product, and hands it over to the first system 10.
[0125] In the first system 10 and the third system 300, the customer U is managed by a user ID, and in the second system 20, a person (customer U) is managed by a fake user ID. The second system 20 collects products 64 purchased by a person (customer U) associated with the fake user ID, personal characteristic information of the person (customer U) in the store 60, and the like.
[0126] The first server 100 of the first system 10 includes a visitor management unit 340 and a sales information generation unit 342. The first storage device 12 of the first system 10 includes a customer master 306, an actual product information storage unit 308, a product master 312, and a usage record information storage unit 314.
[0127] The second system 20 includes a video camera 352 and a weight sensor 354. The second server 200 of the second system 20 includes a product image capturing unit 350, a sensing unit 356, and a cart generating unit 360. The second storage device 22 of the second system 20 includes a store video storage unit 320, a product model 322, and a person feature model 324.
[0128] The third system 300 includes a payment system 330. The third storage device 32 of the third system 300 includes a product master 302 and a usage history information storage unit 304.
[0129] In the first system 10, the visitor management unit 340 corresponds to the visitor management unit 102 and the transmission unit 104 of the first server 100 in Fig. 4. The sales information generation unit 342 corresponds to the acquisition unit 106 and the output unit 108 of the first server 100 in Fig. 4.
[0130] The customer master 306 corresponds to the user information 140 in Fig. 5. The actual product information storage unit 308 stores product images or feature quantities of product images. The product master 312 corresponds to the store-specific product master 146 in Fig. 12. The usage record information storage unit 314 corresponds to the purchase information 144 in Fig. 11.
[0131] In the second system 20, the video camera 352 corresponds to the camera 5 in Fig. 1. The weight sensor 354 corresponds to the weight sensor 7 in Fig. 1.
[0132] In the actual product information storage unit 308, the product image is associated with information on the weight of the product 64. The product master 312 stores various information on the product 64. For example, the product master 312 stores information on the product 64 such as the product name, product code, price, and weight.
[0133] The product image photographing unit 350 acquires images of the display shelves 62 in the store 60 generated by the video camera 352, and also acquires the detection result of the weight sensor 354. Then, the product image photographing unit 350 extracts product images that match product images registered in the actual product information storage unit 308 from the images generated by the video camera 352. Then, the product image photographing unit 350 refers to the product master 312 and identifies the product code of the product 64 displayed on the display shelves 62 from the extracted product image. The product image photographing unit 350 further identifies the weight of the product 64 corresponding to the product image from the detection result of the weight sensor 354.
[0134] The product image photographing unit 350 associates information about the product 64, such as the product image, weight, and product code, and registers the information in the product model 322. The information registered in the product model 322 is used by the cart generation unit 360, which will be described later, to identify the product 64 that a person (customer U) has taken out from the display shelf 62.
[0135] The sensing unit 356 acquires images generated by the video camera 352 and records them in the store video storage unit 320. Furthermore, the sensing unit 356 acquires the detection results of the weight sensor 354. The sensing unit 356 outputs sensing data including the acquired images and the detection results of the weight sensor 354 to the cart generation unit 360.
[0136] The person feature model 324 stores person feature information indicating person features related to human behavior, etc. For example, a person's "appearance", such as height, gait, posture, facial features, facial expression, sex, age, clothing, etc., or a person's "behavior", such as a movement route, gestures, movements, etc., are registered. However, the person feature information indicating a person's features does not include information that can identify an individual.
[0137] When the cart generation unit 360 receives the fake user ID of the store visitor from the first system 10, it starts tracking the store visitor using the sensing unit 356. The cart generation unit 360 refers to the product model 322 and the person feature model 324, and identifies the product code and the quantity of the product 64 that the store visitor took out from the display shelf 62 and put into the cart 66.
[0138] Fig. 19(a) is a diagram showing an example of the data structure of cart information 240. In cart information 240, the store entry date and time, the fake user ID, and purchased product information (a set of product code and quantity) are stored in association with each other. Furthermore, cart generation unit 360 refers to the person characteristic model 324 to identify the person characteristic information of the store entry user, and stores it in customer information 242 in Fig. 19(b).
[0139] In the first system 10, after the customer U leaves the store, the sales information generating unit 342 receives the sales information of the person with the false user ID (customer U) from the second system 20. Purchased Items That is, the sales information generating unit 342 acquires a set of data of product code and quantity as information of the product 64 that a person (customer U) puts in the cart 66. Then, the sales information generating unit 342 identifies a user ID corresponding to the acquired fake user ID, and generates settlement information for the customer U of the identified user ID based on the acquired product information. The settlement information generated by the sales information generating unit 342 may be stored in the usage history information storage unit 314.
[0140] Then, the sales information generating unit 342 transmits the settlement information of the customer U to the third system 300.
[0141] In the third system 300, the product master 302 stores various information about the product 64. For example, the product master 302 stores information such as the product name, product code, price, and weight of the product 64. The usage history information storage unit 304 stores and accumulates the settlement information of the customer U transmitted from the first system 10 in association with the user ID. The payment system 330 corresponds to the settlement device 30 described above. The payment system 330 executes payment for the product 64 to be purchased by the customer U, based on the settlement information of the customer U (user ID).
[0142] <Example of operation> The operation of the store system 1 of this embodiment will be described below with reference to the flowchart of Fig. 10 used in the first embodiment. The settlement device 30 in Fig. 10 will be replaced with a third system 300 for the description.
[0143] First, the store entrance terminal 40 reads the two-dimensional code displayed on the user terminal 50 presented by the customer U, acquires the user ID, and transmits it to the first server 100 (step S201). Then, in the first server 100, the store entrance management unit 340 generates a fake user ID corresponding to the user ID received from the store entrance terminal 40, associates the user ID with the fake user ID, and stores it in the first storage device 12 as store entrance management information 142 (step S203).
[0144] Then, the store visitor management unit 340 transmits the generated fake user ID to the second server 200 (step S205). When the cart generation unit 360 of the second server 200 receives the fake user ID from the first server 100, the cart generation unit 360 associates the fake user ID with the person whose entry into the store is detected by the sensing unit 356 and who is the tracking target. The method (timing, etc.) of associating the person in the store with the fake user ID is not particularly limited, and can be appropriately determined according to the conditions of each store (for example, the structure of the entrance (gate), the method of entering the store, and the detection timing and sensing contents of the sensing unit 356). The cart generation unit 360 starts tracking the person using the sensing data detected by the sensing unit 356. Then, the cart generation unit 360 refers to the product model 322 and the person characteristic model 324 to identify the person characteristic information and purchased product information of the person in the store 60 (step S207). The identified information may be recorded in association with the fake user ID.
[0145] Specifically, the cart generation unit 360 analyzes and identifies the behavior of the person in the store 60. Furthermore, the cart generation unit 360 identifies the product code and the quantity of the product 64 that the person took out from the display shelf 62 and put into the cart 66.
[0146] Then, in the first server 100, the sales information generating unit 342 receives the person's fake user ID and the purchased product information (product code and quantity) transmitted from the second server 200 (step S209). The sales information generating unit 342 refers to the store entry management information 142 to identify the user ID corresponding to the received fake user ID (step S211).
[0147] The sales information generating unit 342 generates the purchased product information (product code and quantity) based on the specified user ID. To The information may be stored in the usage record information storage unit 314 in association with each other.
[0148] Then, the sales information generating unit 342 transmits the user ID and the purchased product information (product code and quantity) of the customer U received in step S209 to the payment system 330 of the third system 300 (step S213). At this time, the sales information generating unit 342 also instructs the payment system 330 to execute payment for the product 64 to be purchased by the customer U using the payment method corresponding to the user ID with reference to the user information 140 (step S215).
[0149] According to this embodiment, the same effects as those of the first embodiment are achieved.
[0150] Although the embodiments of the present invention have been described above with reference to the drawings, these are merely examples of the present invention, and various configurations other than those described above can also be adopted. For example, in the above embodiment, the purchased product information on the product 64 added to the cart by the person (customer U) was identified based on the image generated by the camera 5 and the detection result of the weight sensor 7. However, in other embodiments, an IC tag using RFID (Radio Frequency Identification) may be attached to the product 64, and the IC tag may be read at the store exit gate 72 to obtain the purchased product information (a set of product code and quantity) of the person (customer U).
[0151] Furthermore, in another embodiment, the third system 300 of the above-mentioned fifth embodiment may be the settlement device 30 of the store 60. As described above, purchased product information for each customer U is transmitted to the settlement device 30 from the first server 100 via the output unit 108. The settlement device 30 receives the purchased product information of the customer U from the first server 100. The received purchased product information is then stored in the third storage device 32 in association with the user ID of the customer U.
[0152] In this configuration example, the customer U simply places the product 64 to be purchased in the cart 66 to complete the product registration process, and the payment information is sent to the payment device 30. In other words, the payment device 30 is installed in the store 60, and a product registration device is not required.
[0153] After placing purchased items 64 in a cart 66 at a store 60, the customer U goes to the settlement device 30, which identifies the customer U and reads out purchased item information (i.e., settlement information) corresponding to the user ID of the customer U from the third storage device 32. The settlement device 30 then performs settlement processing based on the acquired settlement information. There are several possible methods for identifying the customer U, including but not limited to the following examples.
[0154] (f1) Obtain customer U's user ID. For example, similar to the entrance terminal 40, a two-dimensional code displayed on the user terminal 50 of the customer U is read using a code reader, and the user ID of the customer U is obtained.
[0155] (f2) Customer U’s face (biometrics) is authenticated. Instead of the user ID, the face of the customer U is photographed by a camera to generate a facial image, which is then collated with the facial image in the user information 140 to identify the user ID of the customer U.
[0156] (f3) Track a person (customer U) from the time he or she enters the store until the time he or she leaves. The camera 5 is used to continuously track a person (customer U) from the time the person enters the store to the time the person leaves the store, and the person (customer U) who operates the settlement device 30 is identified.
[0157] Although the present invention has been described above with reference to the embodiments and examples, the present invention is not limited to the above-mentioned embodiments and examples. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention. In the present invention, when information about a user is acquired and used, this shall be done lawfully.
[0158] A part or all of the above-described embodiments can be described as, but are not limited to, the following supplementary notes. 1. A store entry management means for acquiring first personal identification information of a customer who enters a store, generating second personal identification information for a second system that is separate from a first system that manages customer information, and storing the acquired first personal identification information and the generated second personal identification information in a storage means in association with each other; A transmitting means for transmitting the second personally identifying information to the second system; an acquisition means for acquiring the second individual identification information and purchased product information, which is information on products purchased by the customer, from the second system; an output unit that identifies the first individual identifying information corresponding to the acquired second individual identifying information, and outputs the first individual identifying information and the purchased product information to a payment settlement unit. 2. In the information processing device according to 1., The settlement means executes payment for the product to be purchased using a payment means corresponding to the first personally identifying information, the information processing device. 3. In the information processing device according to 1. or 2., The second system is provided for each store, The store entry management means acquires the first individual identifying information together with store identifying information, and further associates the acquired store identifying information with the second individual identifying information and stores the information; The output means further transmits the store specific information to the payment means. 4. In the information processing device according to any one of 1. to 3., the first personally identifiable information is associated with processing level information indicative of a level of processing required for tracking the individual; The information processing device, wherein the transmitting means further transmits the processing level information to the second system. 5. In the information processing device according to any one of 1. to 4., The store entry management means is an information processing device that acquires the first individual identifying information from a terminal located at an entrance of the store.
[0159] 6. An information processing device, When first personal identification information of a customer who enters a store is acquired, second personal identification information for a second system that is separate from a first system that manages customer information is generated, and the acquired first personal identification information and the generated second personal identification information are stored in a storage means in association with each other; Transmitting the second personally identifiable information to the second system; acquire, from the second system, the second personal identification information and purchased product information, which is information on products purchased by the customer; identifying the first individual identifying information corresponding to the acquired second individual identifying information, and outputting the first individual identifying information and the purchased product information to a payment means; Information processing methods. 7. In the information processing method according to 6., The settlement means executes payment for the product to be purchased using a payment means corresponding to the first personally identifying information. 8. In the information processing method according to 6. or 7., The second system is provided for each store, The information processing device, acquiring the first individual identifying information together with store identifying information, and storing the acquired store identifying information in association with the second individual identifying information; The store-specific information is further transmitted to the settlement means. 9. In the information processing method according to any one of 6. to 8., the first personally identifiable information is associated with processing level information indicative of a level of processing required for tracking the individual; The information processing device, The information processing method further comprises transmitting the processing level information to the second system. 10. In the information processing method according to any one of 6. to 9., The information processing device, The information processing method includes acquiring the first individual identifying information from a terminal located at an entrance of the store.
[0160] 11. On the computer: a step of acquiring first personal identification information of a customer who has entered a store, generating second personal identification information for a second system that is different from a first system that manages customer information, and storing the acquired first personal identification information and the generated second personal identification information in a storage means in association with each other; transmitting the second personally identifiable information to the second system; acquiring, from the second system, the second personal identification information and purchased product information, which is information on products purchased by the customer; a program for executing a procedure of identifying the first individual identifying information corresponding to the acquired second individual identifying information, and outputting the first individual identifying information and the purchased product information to a checkout means. 12. In the program according to 11., The settlement means is a program that executes payment for the product to be purchased using a payment means corresponding to the first personally identifying information. 13. In the program according to 11. or 12., The second system is provided for each store, a step of acquiring the first individual identifying information together with store identifying information, and storing the acquired store identifying information in association with the second individual identifying information; a step of transmitting the store-specific information to the settlement means. 14. In the program according to any one of 11 to 13, the first personally identifiable information is associated with processing level information indicative of a level of processing required for tracking the individual; Further, a program for causing a computer to execute a procedure for transmitting the processing level information to the second system. 15. In the program according to any one of 11. to 14., A program for causing a computer to execute a procedure for acquiring the first individual identifying information from a terminal located at an entrance of the store.
[0161] 16. A first device for managing personal information; a second device that links customers and products in the store; The first device is an entrance management means for generating second individual identifying information for the second device when first individual identifying information of a customer who enters a store is acquired, and storing the acquired first individual identifying information and the generated second individual identifying information in a storage means in association with each other; A transmitting means for transmitting the second personally identifying information to the second device; an acquisition means for acquiring the second individual identification information and purchased product information, which is information on products purchased by the customer, from the second device; an output means for identifying the first individual identifying information corresponding to the acquired second individual identifying information, and outputting the first individual identifying information and the purchased product information to a payment means; The second device associates the second individual identifying information with the purchased item information by processing an image captured at the store. 17. In the store system described in 16., The settlement means executes payment for the product to be purchased using a payment means corresponding to the first individual identifying information, in a store system. 18. In the store system described in 16. or 17., The second device is provided for each store, In the first device, The store entry management means acquires the first individual identifying information together with store identifying information, and further associates the acquired store identifying information with the second individual identifying information and stores the information; The output means further transmits the store specific information to the payment means. 19. In the store system according to any one of 16 to 18, the first personally identifiable information is associated with processing level information indicative of a level of processing required for tracking the individual; The transmission means of the first device further transmits the processing level information to the second device. 20. In the store system according to any one of 16 to 19, A store system, wherein the store entry management means of the first device acquires the first personal identification information from a terminal located at an entrance of the store.
[0162] This application claims priority based on Japanese Patent Application No. 2020-083888, filed on May 12, 2020, the disclosure of which is incorporated herein in its entirety. [Explanation of symbols]
[0163] 1 Store System 3. Communication Network 5. Camera 7 Weight Sensor 10. 1st System M 12 1st storage device 20. Second System 22 2nd storage device 30 Payment device 32 Third storage device 40 Entrance terminal 50 User terminals 60 stores 62 Display shelf 64 items 66 Cart 70 Entrance Gate 72 Exit Gate 100 First Server 102 Store Admission Management Department 104 Transmitter 106 Acquisition Department 108 Output section 120 Settlement Processing Unit 140 User Information 142 Store entry management information 144 Purchase Information 146 Store-specific product master 200 Second Server 240 Cart Information 242 Customer information 300 3rd System 302 Product Master 304 Usage record information storage unit 306 Customer Master 308 Actual product information storage unit 312 Product Master 314 Usage record information storage unit 320 Store video storage unit 322 Product Model 324 Person Feature Model 330 Payment Systems 340 Customer Management Department 342 Sales Information Generation Unit 350 Product Image Shooting Department 352 Video Camera 354 Weight Sensor 356 Sensing section 360 Cart Generation 1000 Computers 1010 Bus 1020 Processor 1030 Memory 1040 Storage Device 1050 Input / Output Interface 1060 Network Interface
Claims
1. an entrance management means for acquiring first personal identification information of a customer who has entered a store, generating second personal identification information for a second system that is separate from a first system that manages customer information, and storing the acquired first personal identification information and the generated second personal identification information in a storage means in association with each other; A transmitting means for transmitting the second personally identifying information to the second system; an acquisition means for acquiring the second individual identification information and purchased product information, which is information on products purchased by the customer, from the second system; an output unit that identifies the first individual identifying information corresponding to the acquired second individual identifying information and outputs the first individual identifying information and the purchased product information to a payment unit; the first personally identifying information is associated with processing level information indicative of a processing level required for tracking the individual; The transmitting means further transmits the processing level information to the second system; In the second system, an information processing device performs at least one of changing the image resolution, changing the number of frames within a specified time, and enlarging the image when performing image analysis processing for the tracking of the individual depending on the processing level.
2. In the information processing device according to claim 1, An information processing device, wherein the processing level of the processing level information is set based on at least one of a history of error rates of image analysis processing results due to the individual's behavioral habits and a specific behavior pattern of the individual.
3. 3. The information processing device according to claim 1, The settlement means executes payment for the product to be purchased using a payment means corresponding to the first personally identifying information.
4. 4. The information processing device according to claim 1, The second system is provided for each store, The store entry management means acquires the first individual identifying information together with store identifying information, and further associates the acquired store identifying information with the second individual identifying information and stores the information; The output means further transmits the store specific information to the payment means.
5. 5. The information processing device according to claim 1, The store entry management means is an information processing device that acquires the first individual identifying information from a terminal located at an entrance of the store.
6. An information processing device, When first personal identification information of a customer who has entered the store is acquired, second personal identification information for a second system that is separate from a first system that manages customer information is generated, and the acquired first personal identification information and the generated second personal identification information are stored in a storage means in association with each other; Transmitting the second personally identifiable information to the second system; acquiring the second individual identification information and purchased product information, which is information on products purchased by the customer, from the second system; Identifying the first individual identifying information corresponding to the acquired second individual identifying information, and outputting the first individual identifying information and the purchased product information to a payment means; the first personally identifying information is associated with processing level information indicative of a processing level required for tracking the individual; The information processing device, and transmitting the processing level information to the second system. An information processing method in which, in the second system, when performing image analysis processing for the tracking of the individual, at least one of changing the image resolution, changing the number of frames within a specified time, and enlarging the image is performed depending on the processing level.
7. On the computer, a step of acquiring first individual identifying information of a customer who has entered a store, generating second individual identifying information for a second system that is separate from a first system that manages customer information, and storing the acquired first individual identifying information and the generated second individual identifying information in a storage means in association with each other; transmitting the second personally identifiable information to the second system; acquiring, from the second system, the second individual identifying information and purchased product information, which is information on products purchased by the customer; a step of identifying the first individual identifying information corresponding to the acquired second individual identifying information, and outputting the first individual identifying information and the purchased product information to a payment means; the first personally identifying information is associated with processing level information indicative of a processing level required for tracking the individual; and transmitting the processing level information to the second system. A program in the second system, which performs at least one of changing the image resolution, changing the number of frames within a specified time, and enlarging the image when performing image analysis processing for the tracking of the individual depending on the processing level.
8. A first device for managing personal information; a second device that links customers and products in the store; The first device is an entrance management means for generating second individual identifying information for the second device when first individual identifying information of a customer who enters a store is acquired, and storing the acquired first individual identifying information and the generated second individual identifying information in a storage means in association with each other; a transmitting means for transmitting the second personally identifying information to the second device; an acquisition means for acquiring the second individual identification information and purchased product information, which is information on products purchased by the customer, from the second device; an output unit that identifies the first individual identifying information corresponding to the acquired second individual identifying information and outputs the first individual identifying information and the purchased product information to a payment unit; the second device processes an image captured at the store to associate the second individual identifying information with the purchased item information; the first personally identifying information is associated with processing level information indicative of a processing level required for tracking the individual; The transmitting means of the first device further transmits the processing level information to the second device; The second device performs at least one of changing the image resolution, changing the number of frames within a specified time, and enlarging the image when performing image analysis processing for the tracking of the individual depending on the processing level.
Citation Information
Patent Citations
Video processing apparatus, video processing method, and video processing program
JP2015128223A
Information processing system and information processing program
JP2016126749A
Article interaction and movement detection method
JP2016532932A
Computer-controlled unmanned automated checkout store outlet and related methods
JP2017521780A
Shopping history management system and shopping history management method
JP2019020767A
