Information processor, server device, and program

Abstract

To provide an information processor, a server device, and a program capable of supporting the purchase of articles subject to price reduction or discount.SOLUTION: An information processor includes: identification means for identifying a type of an article on the basis of an image obtained by imaging the article; first acquisition means for acquiring data corresponding to the type of the article identified by the identification means and satisfying a condition, from a server device for managing data in which the condition for applying price reduction or discount and a set value relating to an amount of price reduction or discount are associated with each other for each type of target articles subject to price reduction or discount; and first display control means for displaying, on a display unit, information relating to the type of the article identified by the identification means and information based on the data acquired by the first acquisition means.SELECTED DRAWING: Figure 10

Description

[Technical field]

[0001] An embodiment of the present invention relates to an information processing device, a server device, and a program. [Background technology]

[0002] Conventionally, in stores such as supermarkets, stickers indicating that a product is eligible for a discount (hereinafter, also referred to as discount stickers) are affixed to products that are eligible for a discount or discount (hereinafter, collectively referred to as discounts). For example, discount stickers are affixed to products that are sold at low prices during a limited time period, according to the applicable time. In such stores, when a store clerk registers the product (hereinafter, also referred to as sales registration) and settles the payment at a POS terminal, the discount according to the discount sticker is applied, thereby providing a discount service to consumers.

[0003] Recently, there are checkout systems in which consumers themselves use terminal devices such as smartphones provided by the store or their own smartphones or tablet terminals attached to shopping carts to register sales while shopping around the store. In checkout systems, consumers themselves also make payments using terminal devices or accounting devices installed in the store. Such checkout systems can reduce the waiting time of consumers who are waiting in line to make payments around the POS terminal, and are expected to reduce the number of employees required by stores.

[0004] However, when a discount service using discount stickers is applied to the above-mentioned checkout system, the sales of products are registered while the consumer is shopping around, which may lead to misreading of the discount stickers or fraudulent acts such as replacing the discount stickers with other products. In addition, since the work of attaching the discount stickers by store clerks is required, labor saving cannot be utilized. Summary of the Invention [Problem to be solved by the invention]

[0005] The problem to be solved by the present invention is to provide an information processing device, a server device, and a program capable of supporting the purchase of a product that is subject to a discount or reduction in price. [Means for solving the problem]

[0006] The information processing device of the embodiment comprises an identification means for identifying the type of product based on an image of the product, a first acquisition means for acquiring data that corresponds to the type of product identified by the identification means and satisfies the conditions from a server device that manages data that associates, for each type of target product subject to a discount or discount, conditions for applying a discount or discount with a set value related to the amount of the discount or discount, and a first display control means for displaying, on a display unit, information related to the type of product identified by the identification means and information based on the data acquired by the first acquisition means. [Brief description of the drawings]

[0007] [Figure 1] FIG. 1 is a diagram illustrating an example of a checkout system according to an embodiment. [Diagram 2] FIG. 2 is a side view showing an example of the configuration of a shopping cart according to an embodiment. [Diagram 3] FIG. 3 is a diagram illustrating an example of a hardware configuration of the terminal device according to the embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of a hardware configuration of a server according to the embodiment. [Diagram 5] FIG. 5 is a diagram illustrating an example of a data configuration of the product master according to the embodiment. [Figure 6] FIG. 6 is a diagram illustrating an example of a data configuration of a discounted item table according to the embodiment. [Figure 7] FIG. 7 is a diagram illustrating another example of the data configuration of the discounted item table according to the embodiment. [Figure 8] FIG. 8 is a diagram illustrating an example of a data configuration of a sales registration table according to the embodiment. [Figure 9]FIG. 9 is a diagram illustrating an example of a functional configuration of a terminal device and a server according to the embodiment. [Figure 10] FIG. 10 is a diagram showing an example of a screen displayed on the display unit of the terminal device according to the embodiment. [Figure 11] FIG. 11 is a diagram showing an example of a screen displayed on a display unit of a terminal device according to the embodiment. [Figure 12] FIG. 12 is a diagram showing an example of a screen displayed on the display unit of the terminal device according to the embodiment. [Figure 13] FIG. 13 is a sequence diagram illustrating an example of a sales registration process performed between the terminal device and the server according to the embodiment. [Figure 14] FIG. 14 is a flowchart illustrating an example of a discount determination process performed by the server according to the embodiment. [Figure 15] FIG. 15 is a sequence diagram illustrating an example of a recommendation process performed between the terminal device and the server according to the embodiment. [Figure 16] FIG. 16 is a flowchart illustrating an example of a recommended product extraction process performed by the server according to the embodiment. [Figure 17] FIG. 17 is a sequence diagram illustrating an example of a settlement process carried out among a terminal device, a server, and a checkout device according to an embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] The information processing device, server device, and program according to the present embodiment will be described in detail below with reference to the accompanying drawings. In the following embodiment, a terminal device attached to a shopping cart (hereinafter, also referred to as a cart) for transporting products used in a store will be described as an example of the information processing device. Note that the invention is not limited to this application example.

[0009] Fig. 1 is a diagram showing an example of a checkout system 1 according to an embodiment. As shown in Fig. 1, the checkout system 1 includes a terminal device 2, a server 4, and an accounting device 8. The server 4 and the accounting device 8 are communicatively connected via a network Na.

[0010] The network Na may be the Internet, a virtual private network (VPN), a local area network (LAN), a public communication network, a mobile communication network, or the like, either alone or in appropriate combination. As an example, the network Na may be a combination of the Internet and a mobile communication network.

[0011] In addition, a wireless access point 7 is connected to the network Na. The wireless access point 7 is connected to the terminal device 2 via a network Nb such as a wireless LAN. Therefore, the terminal device 2 can communicate with the server 4 and the accounting device 8.

[0012] The cart 3 includes a storage section 31 (see FIG. 2) for storing products displayed in the store. The top of the storage section 31 is open, and products are placed into the storage section 31 from the top. A consumer (hereinafter also referred to as a customer) using the store borrows the cart 3 at the store, and while moving around the store with the cart 3, stores the products he or she wishes to purchase from the products displayed in the storage section 31.

[0013] The terminal device 2 is an example of an information processing device or a product sales data processing device (registration device). The terminal device 2 is a terminal device operated by a customer using the cart 3, and is attached to the cart 3, for example. The terminal device 2 recognizes (hereinafter also referred to as "identification") the type of product inserted into the storage unit 31 from an image captured by the first imaging unit 34 described later, and executes a sales registration process related to the product. Herein, the sales registration process refers to a process of making the product identified by the terminal device 2 a purchase target. Specifically, the sales registration process refers to a process of registering information related to the identified product in a sales registration table 443 described later. Hereinafter, the information related to the product registered in the sales registration table 443 is also referred to as "sales registration data."

[0014] Furthermore, when the terminal device 2 accepts an operation to perform accounting for an item (hereinafter also referred to as payment), it executes a process to transfer the sales registration data for one transaction registered in the sales registration process to the accounting device 8. For example, the terminal device 2 encodes the sales registration data into a code symbol such as a two-dimensional code and displays it. In this case, the accounting device 8 reads the code symbol displayed on the terminal device 2 to obtain the sales registration data for one transaction registered in the terminal device 2, and executes accounting based on the sales registration data.

[0015] The server 4 is an example of a server device. The server 4 uses the terminal device 2 as a user interface terminal and performs information processing to provide services related to the buying and selling of goods in a store where the user interface terminal is used. The server 4 may be, for example, a store server provided in the store, or a server device provided outside the store. In this embodiment, the server 4 is realized by a single device, but may also be a cloud server (or a cloud system) realized by multiple devices connected to a network.

[0016] The server 4 stores and manages various data relating to merchandise buying and selling transactions, and controls the overall operation of the checkout system in cooperation with the terminal device 2 and the accounting device 8.

[0017] The accounting device 8 is an accounting device installed in a store. The accounting device 8 executes payment processing for products based on sales registration data. The payment processing includes displaying the total price and tax amount of products related to one transaction, calculating and displaying change based on the deposit received from the customer, and issuing a receipt on which product information and payment information (total price, deposit amount, change amount, etc.) are printed. Note that in this embodiment, the accounting device 8 is described as a self-service accounting device that allows a customer who has registered sales using the terminal device 2 to perform payment processing by themselves, but the accounting device is not limited to this and may be an accounting device operated by an employee such as a store clerk.

[0018] Next, the cart 3 will be described. FIG. 2 is a side view showing an example of the configuration of the cart 3. The X-axis shown in FIG. 2 is an axis that passes through the cart 3 from the front to the rear, and extends from the rear to the front of the cart 3. The Y-axis is an axis that passes through the cart 3 from the left to the right, and extends from the left to the right of the cart 3. The Z-axis is an axis that passes through the cart 3 from the top to the bottom, and extends from the bottom to the top of the cart 3. Hereinafter, the positive side of the X-axis is also referred to as the front side of the cart 3.

[0019] The cart 3 is equipped with a basket-shaped storage section 31 with an open top, rotating casters 32 arranged below the storage section 31, and a handle section 33 connected to the storage section 31 and casters 32 and which the customer grasps when moving the cart 3.

[0020] The storage section 31 has a generally rectangular side and bottom surrounded by a mesh-like lattice 311 and is open at the top, so that the products stored in the storage section 31 can be visually observed from the outside. The side and bottom may be formed of walls instead of the mesh-like lattice 311.

[0021] The cart 3 also includes a terminal device 2 near the handle portion 33. The cart 3 also includes a first imaging unit 34 near the edge of the opening of the storage unit 31. The first imaging unit 34 is realized by an imaging device such as a digital camera. The first imaging unit 34 is installed such that the imaging direction faces the opening of the storage unit 31. In other words, the imaging direction and imaging range of the first imaging unit 34 are set so that it can capture images of products being put in and taken out of the storage unit 31. The first imaging unit 34 may be configured to be included in the terminal device 2.

[0022] The first imaging unit 34 captures an image of a commodity stored in the storage unit 31 or a commodity taken out of the storage unit 31, and outputs the captured image to the terminal device 2. Here, an image means a still image or a video image in frame units.

[0023] The cart 3 also includes a second imaging unit 35 on the front or side of the cart 3. The second imaging unit 35 is realized by an imaging device such as a digital camera similar to the first imaging unit 34. The imaging direction of the second imaging unit 35 is directed toward the outside of the cart 3, and images the surroundings of the cart 3 moving around the store. For example, the second imaging unit 35 images a medium that holds position information that can identify the position in the store and is attached to a product shelf or the like. The position information is represented by a code symbol such as a two-dimensional code, for example, and is attached to a position that can be imaged by the second imaging unit 35.

[0024] The configuration of the cart 3 is not limited to the example shown in Fig. 2. For example, the number of first imaging units 34 is not limited to one, and multiple units may be provided. Furthermore, the terminal device 2 may be configured to be detachable from the cart 3. In this case, the terminal device 2 may be a mobile terminal (smartphone, tablet terminal, etc.) owned by the customer or rented by the store, which is attached to the cart 3.

[0025] From here, an example of the configuration of the main devices in the checkout system 1 will be described. First, the hardware configuration of the terminal device 2 will be described. FIG.

[0026] As shown in FIG. 3, the terminal device 2 includes a CPU (Central Processing Unit) 21, a ROM (Read Only Memory) 22, a RAM (Random Access Memory) 23, a storage unit 24, a display unit 25, an operation unit 26, a communication unit 27, and a connection unit 28.

[0027] The CPU 21 is an example of a processor, and controls the overall operation of the terminal device 2. The ROM 22 stores various programs. The RAM 23 is a workspace in which programs and various data are expanded.

[0028] The CPU 21, the ROM 22, and the RAM 23 are connected via a bus or the like to constitute a computer-configured control unit 200. In the control unit 200, the CPU 21 operates in accordance with a program stored in the ROM 22 or the storage unit 24 and loaded in the RAM 23, thereby executing various types of processing.

[0029] The storage unit 24 has a storage medium such as a HDD or a flash memory, and maintains the stored contents even when the power is cut off. The storage unit 24 stores programs that can be executed by the CPU 21 and various setting information. For example, an application program for cooperating with the checkout system 1 is pre-stored (installed) in the storage unit 24.

[0030] The storage unit 24 also stores product recognition data 241 and the like. The product recognition data 241 is a data set for recognizing and identifying the type of a product based on the external characteristics of the product. Examples of the external characteristics of a product include the design, pattern, color, texture, and shape of the product or its exterior package. Hereinafter, the process of identifying a product code that can identify the type of product based on the external characteristics of the product is also referred to as "package recognition."

[0031] The commodity recognition data 241 includes, for example, three types of learned model or dictionary data: an object detection model, a feature extraction model, and a matching dictionary.

[0032] The object detection model is a trained model for detecting the area of ​​an object in a captured image. When a captured image captured by the first imaging unit 34 is input, the object detection model detects and outputs an area showing a commodity (hereinafter, also referred to as an object image) from the captured image.

[0033] The feature extraction model is a trained model for extracting feature quantities that represent the external characteristics of a product from the product depicted in an area detected by the object detection model. When an object image or a captured image containing an object image is input, the feature extraction model extracts and outputs feature quantities that represent the external characteristics of the product depicted in the object image.

[0034] The matching dictionary is a dictionary for identifying products similar to the features of a product based on the features of the product. For example, the matching dictionary stores a plurality of products sold in a store in association with the features that represent the external characteristics of the product, for each product code corresponding to the type of the product.

[0035] In package recognition, an object detection model and a feature extraction model are used to compare the feature of a product extracted from an image with the feature of each product registered in a matching dictionary, thereby calculating the similarity (also called likelihood) between the features. Then, in package recognition, the product code of one product registered in the matching dictionary whose feature similarity is equal to or exceeds a threshold (e.g., 95%) is identified as the type of product that is the subject of the image.

[0036] The display unit 25 is a display device such as an LCD (Liquid Crystal Display). The display unit 25 displays various information under the control of the CPU 21. The operation unit 26 is an input device such as a keyboard or a pointing device. The operation unit 26 outputs operation contents input via the input device to the CPU 21. The operation unit 26 may be a touch panel provided on the display unit 25.

[0037] The communication unit 27 is a wired or wireless communication interface connectable to the network Nb. The communication unit 27 is communicatively connected to the wireless access point 7 via the network Nb. The control unit 200 communicates with external devices such as the server 4 and the accounting device 8 via the communication unit 27.

[0038] The connection unit 28 is an interface for connecting a peripheral device. The connection unit 28 is a wired or wireless interface that complies with a short-range wireless communication standard such as USB (Universal Serial Bus) or Bluetooth (registered trademark). In this embodiment, the connection unit 28 is connected to the first imaging unit 34 and the second imaging unit 35.

[0039] Next, a description will be given of a hardware configuration of the server 4. FIG 4 is a diagram showing an example of a hardware configuration of the server 4.

[0040] As shown in FIG. 4, the server 4 includes a CPU 41, a ROM 42, a RAM 43, a storage unit 44, a communication unit 45, and the like.

[0041] The CPU 41 is an example of a processor, and controls the overall operation of the server 4. The ROM 42 stores various programs. The RAM 43 is a workspace in which programs and various data are expanded.

[0042] The CPU 41, the ROM 42, and the RAM 43 are connected via a bus or the like to constitute a computer-configured control unit 400. In the control unit 400, the CPU 41 operates in accordance with a program stored in the ROM 42 or the storage unit 44 and loaded in the RAM 43, thereby executing various types of processing.

[0043] The storage unit 44 has a storage medium such as a HDD or a flash memory, and maintains the stored contents even when the power is cut off. The storage unit 44 stores programs that can be executed by the CPU 41 and various setting information. For example, the storage unit 44 stores various programs for implementing server functions in the checkout system 1, such as a database program and a Web application program.

[0044] The storage unit 44 also stores a product master 441, a discounted product table 442, a sales registration table 443, and the like.

[0045] The product master 441 is a data table for storing and managing information about products sold in a store. Fig. 5 is a diagram showing an example of the data configuration of the product master 441. As shown in Fig. 5, the product master 441 stores a department code, a product code, product information, and a display position in association with each other.

[0046] The department code is code information capable of identifying the department (genre) to which a product belongs. Products sold in a store are categorized by genre, such as fruits and vegetables and meat. The department code is stored in association with the product code of the product that belongs to the department of the department code. The product code is an example of identification information capable of identifying the type of product sold in a store. The product information is information about the product corresponding to the product code. The product information includes, for example, the product name and price. The display position is registered with location information indicating the display position of the product corresponding to the product code within the store. The location information may be, for example, the shelf number, floor information, floor number, or location coordinates indicating the position of the shelf where the product is placed.

[0047] It should be noted that the data configuration of the product master 441 is not limited to that shown in Fig. 5. For example, the product master 441 may store a department name corresponding to a department code in association with the department code.

[0048] The discounted item table 442 is a data table for storing and managing items that are subject to discounts in association with information related to the discounts. Fig. 6 is a diagram showing an example of the data configuration of the discounted item table 442. As shown in Fig. 6, the discounted item table 442 stores department codes, item codes, discount conditions, and discount setting values ​​in association with each other.

[0049] The department code and product code are registered with the department code and / or product code of the product that is eligible for the discount. For example, if only a department code is registered, all products that belong to that department code are eligible for the discount. Also, if a combination of a department code and a product code, or only a product code, is registered, the product that corresponds to that product code is eligible for the discount.

[0050] The discount conditions are registered as conditions related to the application of a discount. In this embodiment, conditions related to real time, such as the time when the sales of the product are registered, are set as the discount conditions. For example, as shown in FIG. 6, the discount conditions are set as a discount time that specifies the time period during which the discount is applied. The discount set value is registered as a set value related to the amount of the discount or discount. For example, when a specified amount is to be deducted from the price of the product, the amount of the deducted amount is registered as the discount set value. Also, when a specified percentage is to be deducted from the price of the product, that percentage is registered as the discount set value.

[0051] It should be noted that the data configuration of the discounted item table 442 is not limited to that shown in Fig. 6. For example, the discounted item table 442 may register discount setting values ​​for each weather-related condition as shown in Fig. 7.

[0052] 7 is a diagram showing another example of the data configuration of the discounted item table 442. In the discounted item table 442 of FIG. 7, the configuration of the discount setting values ​​is different from that of the discounted item table 442 of FIG.

[0053] Specifically, in the discounted item table 442 in Fig. 7, discount setting values ​​are registered for each weather, such as sunny weather and rainy weather. For example, in the discounted item table 442 in Fig. 7, a 30% discount is set for sunny weather, and a 50% discount is set for rainy weather. In this case, even if the discount conditions are met, the discount setting value is switched and applied according to the real-time weather.

[0054] In addition, in FIG. 7, the discount setting value is set for each weather, but the weather-related conditions may be set as the discount conditions. For example, a real-time condition may be set, such as discounting only when it rains. Also, the weather-related discount setting value and discount conditions may be specified not only by atmospheric conditions such as sunny weather and rainy weather, but also by temperature and humidity ranges.

[0055] The sales registration table 443 is a data table for storing and managing merchandise sales-registered in each of the terminal devices 2. FIG. 8 is a diagram showing an example of the data configuration of the sales registration table 443.

[0056] 8, the sales registration table 443 stores an identification ID, a product code, a product name, a price, a registration date and time, a discount set value, and the like in association with each other. Here, among the data configuration of the sales registration table 443, for example, a set of the product code, the product name, the price, the registration date and time, and the discount set value excluding the identification ID corresponds to the sales registration data. Also, a data entry including the identification ID may be regarded as the sales registration data.

[0057] The identification ID is information for identifying a transaction related to the purchase and sale of goods conducted via the terminal device 2. The identification ID may be, for example, a terminal ID for identifying each terminal device 2, or a customer ID of the customer operating the terminal device 2. The identification ID may also be a transaction ID issued by the server 4 for each transaction at the start of the transaction. When a transaction ID is used, the server 4 issues a unique transaction ID each time it is notified of the start of a transaction from the terminal device 2, and returns it to the terminal device 2 that sent the notification. The terminal device 2 that has received the transaction ID retains the transaction ID in the RAM 23 or the like, and notifies the server 4 of which transaction the communication is about by sending the transaction ID together with the server 4 each time the terminal device 2 communicates with the server 4.

[0058] The product code is a product code that can identify the type of product. The product name, price, etc. are product information of the product corresponding to the product code. The registration date and time is date and time information that indicates the date and time when the sales registration was made. The discount setting value is registered as the discount amount or discount rate applied to the product if the sales-registered product is a product eligible for discount. Also, if the sales-registered product is not eligible for discount, the discount setting value is left blank.

[0059] Of the data configuration of the sales registration table 443, for example, the data set of the product code, product name, price, registration date and time, and discount setting value excluding the identification ID corresponds to the sales registration data.

[0060] 4, the communication unit 45 is a wired or wireless communication interface that can be connected to the network Na. The communication unit is communicatively connected to external devices such as the terminal device 2 and the accounting device 8 via the network Na. The control unit 400 communicates with external devices such as the terminal device 2 and the accounting device 8 via the communication unit 45.

[0061] Next, a description will be given of the functional configuration of the terminal device 2 and the server 4. Fig. 9 is a diagram showing an example of the functional configuration of the terminal device 2 and the server 4.

[0062] As shown in FIG. 9, the terminal device 2 includes an image acquisition unit 201, a product identification unit 202, a position information acquisition unit 203, a registration processing unit 204, a recommended product presentation unit 205, and a payment processing unit 206 as functional components.

[0063] The functional configuration of the terminal device 2 is a software configuration realized by the processor of the terminal device 2 operating in accordance with a program stored in a ROM or memory unit, but is not limited to this. For example, some or all of the functional configuration of the terminal device 2 may be realized by hardware such as a dedicated circuit.

[0064] The image acquiring section 201 acquires images captured by the first imaging section 34 and the second imaging section 35 via the connection section 28. Specifically, the image acquiring section 201 acquires images captured by the first imaging section 34 and the second imaging section 35 (hereinafter also referred to as captured images) in a state in which the imaging sections that captured the images can be identified.

[0065] The product identification unit 202 is an example of an identification means. The product identification unit 202 identifies the type of product imaged by the first imaging unit 34 based on the image of the first imaging unit 34 acquired by the image acquisition unit 201. Specifically, the product identification unit 202 identifies the product code of the product to be put into the storage unit 31 of the cart 3 and the product to be taken out of the storage unit 31 based on the image captured by the first imaging unit 34.

[0066] For example, the product identification unit 202 extracts features representing the external characteristics of a product from an image of the product by using an object detection model and a feature extraction model of the product recognition data 241. Then, the product identification unit 202 identifies a product code of a product similar to the extracted features from the comparison dictionary by comparing the features of each product registered in the comparison dictionary. Note that the method of identifying a product is not limited to the method using the product recognition data 241, and a known technology such as a general object recognition technology may be used.

[0067] In addition, the product identification unit 202 detects the direction of movement of the product (e.g., a motion vector) from temporally consecutive images to determine whether the identified product is a product that has been inserted into the storage unit 31 or a product that has been removed from the storage unit 31.

[0068] Specifically, when the product moves from above to below (hereinafter also referred to as the insert direction), the product identification unit 202 determines that the product has been inserted into the storage unit 31. When the product moves from below to above (hereinafter also referred to as the remove direction), the product identification unit 202 determines that the product has been removed from the storage unit 31.

[0069] The location information acquisition unit 203 is an example of a second acquisition means. The location information acquisition unit 203 acquires location information indicating a location in a store where the terminal device 2 is located. Specifically, the location information acquisition unit 203 acquires location information that appears in an image based on an image of the second imaging unit 35 acquired by the image acquisition unit 201.

[0070] For example, when location information is attached in the form of a code symbol to each location (product shelf, etc.) within a store, the location information acquisition unit 203 detects the code symbol from the image and decodes the code symbol to acquire location information of the location where its own terminal device 2 is located.

[0071] The registration processing unit 204 is an example of a first acquisition means and a first display control means. The registration processing unit 204 executes a sales registration process based on the product code of the product identified by the product identification unit 202. Specifically, when the product identification unit 202 identifies a product and determines that the product has been inserted into the storage unit 31, the registration processing unit 204 transmits a sales registration request including the product code of the identified product to the server 4 together with the identification ID of its own terminal device 2. Here, the identification ID is any one or all of the above-mentioned terminal ID, customer ID, and transaction ID.

[0072] When the registration processing unit 204 acquires product information and discount information (described later) from the server 4 as a response to the sales registration request, the registration processing unit 204 temporarily stores the acquired product information and discount information in the RAM 23 or the like in association with the product code of the product identified by the product identification unit 202. Then, the registration processing unit 204 displays a screen based on the acquired product information and discount information on the display unit 25. For example, the registration processing unit 204 displays the product information and discount information of the product registered as sales on the display unit 25, or displays a list of each product registered as sales. An example of the screen displayed by the registration processing unit 204 will be described later.

[0073] In addition, when the registration processing unit 204 determines that a product has been identified by the product identification unit 202 and that the product has been removed from the storage unit 31, it transmits a registration cancellation request including the product code of the identified product to the server 4 together with the identification ID of its own terminal device 2.

[0074] When the registration processing unit 204 receives a notification of the completion of the cancellation from the server 4 as a response to the registration cancellation request, the registration processing unit 204 deletes the data entry related to the product code identified by the product identification unit 202 from the RAM 23. In addition, the registration processing unit 204 displays information notifying that the cancellation has been completed on the display unit 25 and updates the list display of the registered products.

[0075] In this way, in the checkout system 1, when a customer puts an item into the storage section 31 of the cart 3, the sales of that item are automatically registered. Also, in the checkout system 1, when a customer removes an item from the storage section 31 of the cart 3, the registration of that item is automatically cancelled.

[0076] The recommended product presentation unit 205 is an example of a third acquisition unit and a second display control unit. The recommended product presentation unit 205 transmits the location information acquired by the location information acquisition unit 203 to the server 4 together with the identification ID of its own terminal device 2. When the recommended product presentation unit 205 acquires recommendation information including product information of the recommended product and discount information (to be described later) from the server 4, it displays a screen based on the recommendation information on the display unit 25. An example of the screen displayed by the recommended product presentation unit 205 will be described later.

[0077] The payment processor 206 executes processing to settle the sales of registered products in response to customer operations. Specifically, the payment processor 206 executes processing to transfer sales registration data of registered products to the accounting device 8, thereby realizing a state in which the accounting device 8 can settle the sales.

[0078] For example, when the payment processing unit 206 receives an operation to instruct the end of sales registration or an operation to instruct the start of payment (hereinafter collectively referred to as a closing operation) via the operation unit 26, it encodes the identification ID of its own terminal device 2 into a code symbol such as a two-dimensional code and displays it on the display unit 25. In this case, the accounting device 8 reads the identification ID from the code symbol displayed on the display unit 25 of the terminal device 2, obtains sales registration data corresponding to this identification ID from the server 4, and performs accounting processing for the products for one transaction that have been registered as sales based on the obtained sales registration data.

[0079] Furthermore, for example, the payment processing unit 206 may transmit the identification ID of its own terminal device 2 to the accounting device 8 by short-range wireless communication such as Bluetooth (registered trademark). In this case, the accounting device 8 obtains from the server 4 the sales registration data corresponding to the identification ID transmitted from the terminal device 2, and performs accounting for the products for one transaction that have been registered as sales, based on the obtained sales registration data.

[0080] The payment of the products is not limited to the method using the accounting device 8, and may be made by the terminal device 2. For example, when the payment processing unit 206 receives an operation to instruct the start of payment via the operation unit 26, the payment processing unit 206 displays a screen on the display unit 25 that allows the user to select a payment method such as electronic money payment or credit card payment. When the payment method is selected, the payment processing unit 206 receives input of payment information for making the payment using the selected payment method, and executes a payment process to settle the total amount of the products registered for sale based on the input payment information by cooperating with an external payment server. Such payment information may be, for example, a credit card number or a two-dimensional code for code payment. The payment processing unit 206 may also receive input of a two-dimensional code for code payment via the first imaging unit 34 or the second imaging unit 35.

[0081] On the other hand, as shown in FIG. 9, the server 4 includes a data processing unit 401, a recommendation processing unit 402, and a cooperation processing unit 403 as functional components.

[0082] The functional configuration of server 4 is a software configuration realized by the processor of server 4 operating in accordance with a program stored in a ROM or memory unit, but is not limited to this. For example, some or all of the functional configuration of server 4 may be realized by hardware such as a dedicated circuit.

[0083] The data processing unit 401 is an example of a receiving unit, a reading unit, and a transmission unit. The data processing unit 401 performs various data processing such as data management of the sales registration table 443 based on a sales registration request and a registration cancellation request transmitted from each of the terminal devices 2.

[0084] When the data processing unit 401 receives the sales registration request and the identification ID sent from the terminal device 2, it reads out the product information corresponding to the product code from the product master 441 based on the product code specified in the sales registration request.

[0085] Furthermore, the data processing unit 401 judges whether or not the product corresponding to the product code specified in the sales registration request is a discounted product based on the discounted product table 442. Specifically, the data processing unit 401 judges whether or not the discounted product registered in the discounted product table 442 satisfies the discount conditions based on the product code specified in the sales registration request, the department code of the product corresponding to the product code, the date and time when the sales registration request was received, and the like.

[0086] More specifically, data processing unit 401 searches discounted item table 442 for a data entry including the department code and / or item code of the item specified in the sales registration request. If the search results in a corresponding data entry and the date and time of receipt of the sales registration request satisfy the discount condition (discount time) specified in the data entry, data processing unit 401 determines that the discount condition is met. Data processing unit 401 then reads out the discount condition and discount setting value as discount information from the data entry determined to satisfy the discount condition. Here, the pair of discount condition and discount setting value, that is, the discount information, is an example of data.

[0087] Next, the data processing unit 401 associates the identification ID transmitted together with the sales registration request, the product code indicated in the sales registration request, the product information read from the product master 441, the discount information (discount setting value) read from the discounted product table 442, and the date and time of receipt of the sales registration request, and registers them in the sales registration table 443. The data processing unit 401 also returns the product information read from the product master 441 and the discount information read from the discounted product table 442 to the terminal device 2 that transmitted the sales registration request.

[0088] If the discount conditions of each data entry are not met, the data processing unit 401 nullifies the discount information and returns the product information read from the product master 441 to the terminal device 2 that sent the sales registration request.

[0089] In accordance with the processing of the data processing unit 401 described above, the registration processing unit 204 of the terminal device 2 acquires the product information and discount information returned from the server 4. In other words, the registration processing unit 204 acquires a discount setting value that corresponds to the type of product identified by the product identification unit 202 and satisfies the discount conditions from the server 4, which manages, in association with each other, the discount conditions to which the discount is applied and the discount setting value related to the amount of the discount for each product code of the target product to be discounted. Then, based on the acquired product information and discount information, the registration processing unit 204 causes the display unit 25 to display a screen showing information on the product registered as a sales item and information on the discount of the product.

[0090] FIG. 10 is a diagram showing an example of a screen displayed on the display unit 25 of the terminal device 2, and shows an example of a sales registration screen that displays a list of products that have been registered as sales.

[0091] 10, the sales registration screen displays an area Ma in addition to information indicating the current date and time measured by the terminal device 2. Here, the area Ma is a display area provided for each product for which sales have been registered.

[0092] Area Ma displays the product name and price of the product registered for sale, and information indicating whether the product is eligible for discount. Fig. 10 shows an example in which one product has been registered for sale, with the product name "Product A" and price "100 yen" displayed along with discount information "Discount: 50 yen". Note that if the product registered for sale is not eligible for discount, the discount information is not displayed, and only the product name and price are displayed.

[0093] This allows the customer operating the terminal device 2 to check whether the registered product is eligible for discount by looking at the sales registration screen, and if so, to check the amount of discount. If the discount information includes a discount rate, the registration processing unit 204 may display the discount rate as is, or may calculate the amount to be reduced by the discount and display that amount.

[0094] When using the discounted item table 442 in Fig. 7, the data processing unit 401 selects the discount setting value according to the weather conditions at the time of receiving the sales registration request. There is no particular restriction on the method of acquiring information related to the weather (hereinafter, also referred to as weather information), and any known technology can be used.

[0095] For example, the data processing unit 401 may acquire weather information from a public weather information service via the network Na, and determine the discount set value to be used according to the weather conditions at the time of receiving the sales registration request. Also, for example, in a configuration in which the terminal device 2 is capable of acquiring weather information from a public weather information service, the registration processing unit 204 may transmit the weather information acquired at that time to the server 4 together with the sales registration request. In this case, the data processing unit 401 may determine the discount set value to be used based on the weather information transmitted from the terminal device 2 together with the sales registration request.

[0096] FIG. 11 is a diagram showing an example of a screen displayed on the display unit 25 of the terminal device 2, and shows an example of a sales registration screen when a discount set value is determined based on weather information.

[0097] 11 displays the current date and time measured by the terminal device 2, as well as a rain mark (umbrella mark) indicating the current weather information acquired by the terminal device 2. Note that the weather information may be acquired by, for example, the control unit 200, or may be acquired by a dedicated functional unit (for example, a weather information acquisition unit) not shown.

[0098] In addition, the sales registration screen in Figure 11 shows an example in which the product name and price of the registered product, as well as information regarding the discount of the product, are displayed in area Ma, including information "Time Sale" indicating that the date and time of the sales registration falls within the discount conditions (discount time), and a discount amount according to the weather (rainy weather) on that date and time, "Rainy weather discount: 50 yen."

[0099] This allows a customer operating terminal device 2 to look at the sales registration screen and, if the product registered for sale is subject to a discount, to confirm the amount of the discount as well as the reason why that amount was applied, i.e., the discount conditions, etc.

[0100] Furthermore, when the data processing unit 401 of the server 4 receives the registration cancellation request and the identification ID from the terminal device 2, it deletes the data entry corresponding to the pair of the identification ID and the product code specified in the registration cancellation request from the sales registration table 443. Then, the data processing unit 401 returns a cancellation completion notification to the terminal device 2 that sent the registration cancellation request, notifying that the cancellation of the registration of the specified product code has been completed.

[0101] In addition, in the terminal device 2 that receives the cancellation completion notification, the registration processing unit 204 updates the sales registration screen, for example, by deleting the area Ma relating to the product code specified in the registration cancellation request, thereby notifying the customer that the sales registration cancellation has been completed.

[0102] The recommendation processing unit 402 performs a process related to the promotion of discounted products that are present in the vicinity of the terminal device 2, based on the location information transmitted from each of the terminal devices 2.

[0103] Specifically, when the recommendation processing unit 402 receives location information and an identification ID from the terminal device 2, it refers to the product master 441 and identifies the department code and product code of the product corresponding to the received location information. More specifically, the recommendation processing unit 402 compares the location information received from the terminal device 2 with the location information of the display position of each product registered in the product master 441, and identifies the department code and product code of the product with matching location coordinates.

[0104] The specified targets are not limited to those with matching location information, and may include products displayed in the vicinity of the location information received from the terminal device 2 or in positions adjacent to the location information. In this case, for example, the recommendation processing unit 402 may specify display positions in the vicinity of the location information received from the terminal device 2 or adjacent display positions using map information or the like that specifies the positional relationship of display positions within a store.

[0105] Next, based on the department code and product code of each identified product, the recommendation processing unit 402 searches for a data entry including the department code and / or product code from the discounted product table 442. If the search results in a corresponding data entry, and the date and time when the location information was received (or the current date and time) satisfies the discount condition (discount time) defined in the data entry, the recommendation processing unit 402 determines that the discount condition is met.

[0106] Next, the recommendation processing unit 402 extracts (or identifies) the product code of the corresponding product as a recommended product based on the department code and product code specified in the data entry determined to satisfy the discount conditions. Next, the recommendation processing unit 402 reads product information of the extracted recommended product from the product master 441. In addition, the recommendation processing unit 402 reads the discount conditions and discount setting values ​​as setting information from the data entry determined to satisfy the discount conditions. Then, the recommendation processing unit 402 generates recommendation information including the product information of the recommended product read from the product master 441 and the setting information read from the discount product table 442, and returns the information to the terminal device 2 that transmitted the location information.

[0107] Here, the recommendation information indicates product information of products currently subject to discounts among products displayed near the terminal device 2 and information related to discounts of the products. In other words, the recommendation information is also information for notifying a customer of discounted products in the customer's vicinity.

[0108] The recommendation processing unit 402 may be configured to exclude from the recommended items the product code registered in the sales registration table 443 in association with the identification ID transmitted from the terminal device 2, based on the identification ID. This allows the recommendation processing unit 402 to avoid announcing an already registered product as a recommended item.

[0109] In accordance with the processing of the recommendation processing unit 402 described above, the recommended product presentation unit 205 of the terminal device 2 acquires the recommended information returned from the server 4. That is, the recommended product presentation unit 205 acquires product information and discount setting information of a target product that corresponds to the position information acquired by the position information acquisition unit 203 and satisfies the discount conditions from the server 4, which associates and manages position information indicating the placement position of the target product for each product code of the target product that is subject to discount. Then, the recommended product presentation unit 205 causes the display unit 25 to display a screen based on the acquired recommendation information (hereinafter also referred to as a recommendation screen).

[0110] Fig. 12 is a diagram showing an example of a screen displayed on the display unit 25 of the terminal device 2, and shows an example of a recommendation screen. As shown in Fig. 12, the recommendation screen displays area Mb in addition to information indicating the current date and time measured by the terminal device 2. Here, area Mb is a display area for displaying content based on recommendation information.

[0111] Area Mb displays content based on the product information and discount information included in the recommendation information. FIG. 12 shows an example in which the product name "Product A" is displayed at half price during the discount time "15:00-16:00". Here, the product name is based on the product information included in the recommendation information. Also, the discount time and discount rate are based on the discount conditions and discount set value included in the recommendation information.

[0112] This allows a customer operating the terminal device 2 to easily see which products are currently discounted from among the products displayed around him or her by looking at the recommendation screen. Also, the store can present the products eligible for discount to the customer in real time according to the customer's current location and date and time, which allows for efficient sales promotion of recommended products. When a customer wishes to purchase a product displayed on the recommendation screen, the customer simply places the product in the storage section 31 of the cart 3.

[0113] Returning to FIG. 9, the linkage processor 403 executes processing related to linking with the accounting device 8. Specifically, when the linkage processor 403 is notified of an identification ID from the accounting device 8, it reads the sales registration data related to the notified identification ID from the sales registration table 443. Next, the linkage processor 403 sends the read sales registration data to the accounting device 8 that sent the notification. As a result, the accounting device 8 calculates the total price of the products for which the customer has registered sales based on the sales registration data provided by the server 4, and performs payment processing.

[0114] Furthermore, when the cooperative processor 403 receives a settlement completion notice indicating a customer ID from the accounting device 8, it excludes the data entry in the sales registration table 443 related to the indicated identification ID from the processing target as settled.

[0115] For example, the cooperation processing unit 403 moves the data entry related to the notified identification ID to another data table that manages the settled sales registration data. Also, for example, the cooperation processing unit 403 adds flag information indicating that the data entry related to the notified identification ID has been settled, thereby excluding it from the settlement target.

[0116] An example of a process performed between the terminal device 2 and the server 4 will be described below. First, an example of a sales registration process performed between the terminal device 2 and the server 4 will be described with reference to Fig. 13. Fig. 13 is a sequence diagram showing an example of a sales registration process performed between the terminal device 2 and the server 4.

[0117] First, the image acquisition unit 201 of the terminal device 2 acquires an image captured by the first imaging unit 34 (step S11). Next, the product identification unit 202 determines whether or not the type of product has been identified (recognized) from the image captured by the first imaging unit 34 (step S12). If the product cannot be identified (step S12; No), the product identification unit 202 returns the process to step S11.

[0118] If the product can be identified in step S12 (step S12; Yes), the product identification unit 202 determines, based on the temporally consecutive images captured by the first imaging unit 34, whether the direction of movement of the product identified from the images is the direction of insertion into the storage unit 31 or the direction of removal from the storage unit 31 (step S13).

[0119] Here, if the direction of movement of the product is the direction of insertion into the storage section 31, the registration processing unit 204 sends a sales registration request indicating the product code of the product identified in step S12 to the server 4 together with the identification ID of its own terminal device 2 (step S21).

[0120] When the data processing unit 401 of the server 4 receives the sales registration request and the identification ID from the terminal device 2, it reads out the product information corresponding to the product code specified in the sales registration request from the product master 441 (step S22). Next, the data processing unit 401 executes a discount determination process to determine whether the product specified in the sales registration request is a discount target product or not (step S23). The discount determination process will be described later.

[0121] Next, the data processing unit 401 associates the identification ID sent from the terminal device 2, the product code indicated in the sales registration request, the product information read from the product master 441, the discount information read in the discount determination process of step S23, and the date and time of receipt of the sales registration request, and registers them in the sales registration table 443 (step S24).

[0122] Next, the data processing unit 401 returns the product information and discount information registered in the sales registration table 443 to the terminal device 2 that transmitted the sales registration request (step S25). If it is determined that the product is not eligible for discount in the discount determination process, the discount information is null.

[0123] When the registration processing unit 204 of the terminal device 2 receives the product information and discount information from the server 4 as a response to the sales registration request, it causes the display unit 25 to display a sales registration screen showing the registered products (step S26).

[0124] For example, when only product information is returned from the server 4, that is, when the product registered as a sale is not a product subject to discount, the registration processing unit 204 displays the product name and price included in the product information on the display unit 25. Also, when product information and discount information are returned from the server 4, that is, when the product registered as a sale is a product subject to discount, the registration processing unit 204 displays on the display unit 25 the product name and price included in the product information as well as information related to the discount, such as the discount conditions and discount amount included in the discount information.

[0125] On the other hand, if the direction of movement of the product is the direction of removal from the storage section 31, the registration processing unit 204 sends a registration cancellation request indicating the product code of the product identified in step S12 to the server 4 together with the identification ID of its own terminal device 2 (step S31).

[0126] When the data processing unit 401 of the server 4 receives the registration cancellation request and the identification ID from the terminal device 2, it deletes one of the data entries corresponding to the identification ID and the product code specified in the registration cancellation request from the sales registration table 443 (step S32). Then, the data processing unit 401 transmits a cancellation completion notification to the terminal device 2 that transmitted the registration cancellation request (step S33).

[0127] When the registration processing unit 204 of the terminal device 2 receives a cancellation completion notification from the server 4 as a reply to the registration cancellation request, it notifies the customer that the registration cancellation has been completed by updating the sales registration screen, etc. (step S34).

[0128] In addition, in the terminal device 2 and the server 4, the processes of steps S21 to S26 are executed every time a customer inserts a commodity into the storage unit 31. As a result, the commodity sales registered in each of the terminal devices 2 are registered in the sales registration table 443 of the server 4.

[0129] 14 is a flowchart showing an example of the discount determination process performed by the server 4. This process corresponds to the discount determination process in step S23 described with reference to FIG.

[0130] When the data processing unit 401 receives a sales registration request from the terminal device 2, it refers to the product master 441 and identifies the department code to which the product of the product code specified in the sales registration request belongs (step S41). Next, the data processing unit 401 searches the discounted product table 442 for a data entry including the product code and / or department code of the product specified in the sales registration request (step S42).

[0131] Here, if the corresponding data entry does not exist in the discounted item table 442 (step S43; No), the data processing unit 401 determines that the item corresponding to the item code indicated in the sales registration request is not eligible for discount, and proceeds to step S24 in Figure 13.

[0132] Also, if a corresponding data entry exists in the discounted item table 442 (step S43; Yes), the data processing unit 401 determines whether the date and time when the sales registration request was received satisfies the discount conditions (discount time) of the corresponding data entry (step S44).

[0133] Here, if the date and time of receipt of the sales registration request does not satisfy the discount conditions of the data entry (step S44; No), the data processing unit 401 determines that the product corresponding to the product code indicated in the sales registration request is not eligible for discount, and proceeds to step S24 in Figure 13.

[0134] Also, if the date and time of receipt of the sales registration request satisfies the discount condition of the data entry (step S44; Yes), the data processing unit 401 determines that the product corresponding to the product code specified in the sales registration request is subject to discount, and proceeds to step S45. In step S45, the data processing unit 401 reads out discount conditions, discount amount, etc. from the data entry that satisfies the discount condition as discount information (step S45), and proceeds to step S24 in FIG.

[0135] As a result, if the product corresponding to the product code indicated in the sales registration request is currently eligible for discount, discount information regarding the discount on that product will be registered in the sales registration table 443 together with the product information, and will also be provided to the terminal device 2.

[0136] Next, the recommendation process performed between the terminal device 2 and the server 4 will be described with reference to Fig. 15. Fig. 15 is a sequence diagram showing an example of the recommendation process performed between the terminal device 2 and the server 4. This process is executed in parallel (concurrently) with the sales registration process described in Fig. 13 until the closing operation is performed on the terminal device 2.

[0137] First, the image acquisition unit 201 of the terminal device 2 acquires an image captured by the second imaging unit 35 (step S51). Next, the position information acquisition unit 203 determines whether or not position information has been acquired from the image captured by the second imaging unit 35 (step S52). If position information cannot be acquired (step S52; No), the position information acquisition unit 203 returns the process to step S51.

[0138] Furthermore, if the location information can be acquired in step S52 (step S52; Yes), the recommended product presentation unit 205 transmits the acquired location information and the identification ID of its own terminal device 2 to the server 4 (step S53).

[0139] When the recommendation processing unit 402 of the server 4 receives the location information and the identification ID from the terminal device 2, the recommendation processing unit 402 executes a recommended product extraction process for extracting recommended products based on the location information (step S54). The recommended product extraction process will be described later.

[0140] When a recommended product is extracted in the recommended product extraction process, the recommendation processing unit 402 transmits recommendation information of the extracted recommended product to the terminal device 2 that has transmitted the location information (step S55).

[0141] When the recommended product presentation unit 205 of the terminal device 2 receives the recommended information from the server 4, it causes the display unit 25 to display a recommendation screen showing discounted products, i.e., recommended products, that are located in the vicinity of the location of the terminal device 2, based on the recommended information (step S56).

[0142] This allows customers to wander around the store while checking the products (recommended products) displayed on the recommendation screen, allowing them to efficiently pick out discounted products being sold in the store.

[0143] 16 is a flowchart showing an example of a recommended product extraction process performed by the server 4. This process corresponds to the recommended product extraction process in step S54 described with reference to FIG.

[0144] When the recommendation processing unit 402 receives location information from the terminal device 2, it identifies the department code and product code of the product corresponding to the received location information based on the product master 441 (step S61). Next, the recommendation processing unit 402 searches the discounted product table 442 for a data entry including the identified product code and / or department code (step S62).

[0145] Here, if the corresponding data entry does not exist in the discounted product table 442 (step S63; No), the recommendation processing unit 402 determines that a recommended product does not exist, and ends the process.

[0146] Furthermore, if a corresponding data entry exists in the discounted item table 442 (step S63; Yes), the recommendation processing unit 402 determines whether the date and time when the location information was received (or the current date and time) satisfies the discount conditions (discount time) of the corresponding data entry (step S64).

[0147] Here, if the reception date and time of the location information does not satisfy the discount condition of the data entry (step S64; No), the recommendation processing unit 402 determines that there is no recommended product, and ends the process.

[0148] Also, if the reception date and time of one piece of information satisfies the discount condition of the data entry (step S64; Yes), the recommendation processing unit 402 proceeds to step S65. Next, the recommendation processing unit 402 compares the product code specified by the data entry that satisfies the discount condition with the product code in the sales registration table 443 that is registered in association with the identification ID transmitted together with the location information, to determine whether the product code specified by the data entry has been registered for sales (step S65). Here, if the product code is registered for sales (step S65; Yes), the recommendation processing unit 402 determines that no recommended product exists, and ends this process.

[0149] If the product code is not a registered sales product code (step S65; No), the recommendation processing unit 402 extracts the product code specified by the data entry that satisfies the discount condition as a recommended product.Then, the recommendation processing unit 402 generates recommendation information based on the product information of the recommended product and the discount information included in the data entry (step S66), and proceeds to step S55 in FIG.

[0150] This allows a customer operating the cart 3 to easily check the recommended products currently subject to discount among the products present around the customer's position while wandering around the store. Therefore, the customer can easily purchase the products subject to discount based on the information about the recommended products displayed on the terminal device 2. In addition, the store can efficiently promote the recommended products, which increases the opportunities to purchase the products.

[0151] Next, an example of the payment process carried out between the terminal device 2, the server 4, and the accounting device 8 will be described with reference to Fig. 17. Fig. 17 is a sequence diagram showing an example of the payment process carried out between the terminal device 2, the server 4, and the accounting device 8. This process is executed when the closing operation is performed on the terminal device 2.

[0152] When the payment processing unit 206 of the terminal device 2 accepts the closing operation (step S71), it displays or outputs the identification ID of its own terminal device 2 by short-distance wireless communication (step S72). For example, when the payment processing unit 206 displays and outputs the identification ID, the identification ID may be output in the form of a code symbol such as a two-dimensional code.

[0153] When the accounting device 8 receives the input of the identification ID output by the terminal device 2 (step S73), it transmits a request to acquire sales registration data specifying that identification ID to the server 4 (step S74).

[0154] When the linking processor 403 of the server 4 receives the acquisition request from the accounting device 8, it reads the sales registration data related to the identification ID specified in the acquisition request from the sales registration table 443 (step S75). Next, the linking processor 403 returns the read sales registration data to the accounting device 8 that sent the acquisition request (step S76).

[0155] When the accounting device 8 receives the sales registration data from the server 4, it executes a settlement process based on the sales registration data (step S77). Specifically, the accounting device 8 calculates the total price of the products based on the sales registration data, and executes a process to settle the total price with the payment amount to be paid by the customer.

[0156] If discount information is set for the product (product code) included in the sales registration data, the total amount will be calculated by deducting the discount amount set in the discount information. In addition, there is no restriction on the payment method, such as cash, credit card payment, electronic payment, etc.

[0157] When the payment process is completed, the accounting device 8 sends a payment completion notice specifying the identification ID of the item to be paid to the server 4 (step S78).

[0158] When the linkage processing unit 403 of the server 4 receives a payment completion notification from the accounting device 8, it removes the data entry in the sales registration table 443 relating to the identification ID specified in the payment completion notification from the payment target by moving it to another data table (step S79), and terminates the processing.

[0159] As described above, the terminal device 2 of this embodiment identifies the product code of the product from an image of the product, and acquires discount information (discount set value) that corresponds to the product code of the identified product and satisfies the discount conditions from the server 4, which manages, for each product code of a target product that is subject to a discount or discount, the discount conditions for applying the discount or discount and the discount set value related to the amount of the discount or discount in association with each other. Then, the terminal device 2 displays a screen based on the product information of the identified product and the acquired discount information on the display unit 25.

[0160] In addition, when the server 4 of this embodiment accepts input of a product code indicating the type of product from the terminal device 2, it reads out discount information that corresponds to the accepted product code and satisfies the discount conditions from the discount product table 442, which stores, for each product code of the target product subject to discount or discount, the discount conditions for applying the discount or discount and the discount setting value related to the amount of the discount or discount in association with each other, and transmits the discount information to the terminal device 2.

[0161] This allows a customer operating terminal device 2 to easily check whether the photographed product is eligible for a discount and the discount amount by looking at the screen displayed on display unit 25. In this way, with checkout system 1 of this embodiment, customers themselves can easily check whether a product is eligible for a discount. Furthermore, with checkout system 1, there is no need to affix discount stickers to products, which prevents fraudulent acts such as replacing discount stickers and also eliminates the need for store clerks to affix stickers. Therefore, in a self-service checkout system 1 in which customers themselves register product sales, it is possible to efficiently support the purchase and sale of products eligible for discounts.

[0162] The above-described embodiment can be modified as appropriate by changing a part of the configuration or function of each of the above-described devices. Therefore, some modified examples of the above-described embodiment will be described below as other embodiments. Note that the following mainly describes the differences from the above-described embodiment, and a detailed description of the common points with the contents already described will be omitted. The modified examples described below may be implemented individually or in appropriate combination.

[0163] (Variation 1) In the above embodiment, the terminal device 2 is described as being attached to the cart 3, but the form of the terminal device 2 is not limited to this. For example, the terminal device 2 may be a mobile terminal such as a smartphone carried by a customer, or a mobile terminal such as a smartphone or tablet terminal lent to a customer by a store.

[0164] In this case, the terminal device 2 may be configured to cooperate with the cart 3 by wirelessly communicating with the first imaging unit 34 and the second imaging unit 35, or may be configured to be independent of the cart 3. In the latter case, the customer can register the sale of a product as in the above-mentioned embodiment by capturing an image of the product with a camera provided in the terminal device 2. When canceling the registration, the customer can select the product to be canceled from the list of registered products displayed on the screen of the terminal device 2, thereby canceling the registration as in the above-mentioned embodiment.

[0165] (Variation 2) In the above embodiment, the position information indicating the position of the terminal device 2 within the store is acquired from the image captured by the second imaging unit 35, but the method of acquiring the position information is not limited to this.

[0166] For example, the location information acquisition unit 203 of the terminal device 2 may acquire location information of its own terminal device 2 by using a positioning technology such as a global positioning system (GPS), beacon positioning, or RFID (Radio Frequency Identifier) ​​positioning. For example, when using beacon positioning, a beacon terminal that transmits location information indicating the location of the display shelf is provided on a display shelf in a store, and the location information acquisition unit 203 acquires the location information transmitted from the beacon terminal as the location information of its own terminal device 2. In this case, communication with the beacon terminal can be realized by short-distance wireless communication using the communication unit 27.

[0167] (Variation 3) In the above embodiment, the terminal device 2 recognizes (and identifies) the product from the image captured by the first imaging unit 34, but this is not limited to the above, and an external device such as the server 4 may perform this function.

[0168] In this case, the product identification unit 202 of the terminal device 2 transmits the image of the first imaging unit acquired by the image acquisition unit 201 to an external device that identifies the product. On the other hand, the external device holds, for example, product recognition data 241, and performs a process of recognizing (identifying) the product from the image transmitted from the terminal device 2 using the product recognition data 241, and returns the processing result to the terminal device 2.

[0169] Then, the product identification unit 202 of the terminal device 2 identifies the product imaged by the first imaging unit 34 based on the processing result of the external device. In this modified example, the product identification unit 202 or the external device may determine the moving direction of the product.

[0170] This allows the external device to collectively process the process of identifying products from images captured by each of the carts 3, thereby reducing the processing load on the terminal device 2.

[0171] (Variation 4) In the above embodiment, the discount determination process and the recommended product extraction process are performed by the server 4, but they may be performed by the terminal device 2. In this case, for example, the registration processing unit 204 of the terminal device 2 may be provided with a function related to the discount determination process of the data processing unit 401, so that discount information for the products registered as sales is extracted (obtained). Also, for example, the recommended product presentation unit 205 of the terminal device 2 may be provided with a function related to the recommended product extraction process of the recommendation processing unit 402, so that recommended products (products subject to discount) related to the location of the terminal device 2 and discount information are extracted (obtained).

[0172] This allows each of the terminal devices 2 to individually acquire discount information and recommendation information, thereby reducing the processing load on the server 4.

[0173] When the above configuration is adopted, the terminal device 2 may perform discount determination processing and recommended product extraction processing while referring to various tables held by the server 4. The terminal device 2 may also locally hold any or all of the tables held by the server 4 and perform discount determination processing and recommended product extraction processing by referring to the local tables. When the sales registration table is held locally, the registration processing unit 204 may store sales registration data relating to products registered in the terminal device 2 itself in the sales registration table.

[0174] (Variation 5) In the above-described embodiment, when a product is registered, a discount determination process is executed and discount information is presented to the customer, but the timing for presenting the discount information is not limited to when the product is registered.

[0175] For example, a customer may take an image of a product in order to check whether the product is eligible for a discount. Even in such a case, the system may be configured to determine whether the type of the imaged product is eligible for a discount and, if the discount conditions are met, to control the display unit 25 to display discount information.

[0176] This allows a customer to check whether or not a product is eligible for a discount before deciding to purchase the product (sales registration), thereby improving customer convenience regarding product purchases.

[0177] In the above embodiment, sales are registered when a product is put into the storage unit 31. Therefore, when the configuration of this modified example is adopted, for example, the registration processing unit 204 may notify the server 4 of the product code identified by the product identification unit 202 on the condition that an image is captured by the first imaging unit 34 while the product is held near the opening of the storage unit 31, that is, the product is captured in a state in which the direction of movement cannot be detected.

[0178] However, when the moving direction is not detected, it is preferable that the registration processing unit 204 notifies the server 4 of the product code as a sales registration request, but transmits it to the server 4 as another request (such as a discount confirmation request). Furthermore, when the data processing unit 401 of the server 4 receives a discount confirmation request, it does not register the product code in the sales registration table 443, but simply returns the processing result of the discount determination process (discount information) and the product information of the product specified in the discount confirmation request to the terminal device 2.

[0179] The programs executed by each device in the above-described embodiments (and the modified examples) are provided in a state where they are pre-installed in a ROM, a storage unit, etc. The programs executed by each device in the above-described embodiments may be provided by being recorded in a computer-readable recording medium such as a CD-ROM, a flexible disk (FD), a CD-R, or a digital versatile disk (DVD) in the form of an installable or executable file.

[0180] Furthermore, the programs executed by each device of the above-described embodiments may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. Also, the programs executed by each device of the above-described embodiments may be provided or distributed via a network such as the Internet.

[0181] Although the embodiment of the present invention has been described above, this embodiment is presented as an example and is not intended to limit the scope of the invention. These new embodiments and their modifications can be implemented in various other forms, and various omissions, substitutions, changes, and combinations can be made without departing from the gist of the invention. These embodiments and their modifications are included in the scope and gist of the invention, and are included in the scope of the invention and its equivalents described in the claims. [Explanation of symbols]

[0182] 1. Checkout System 2 Terminal Device 3 Cart (Shopping Cart) 4 Server 8. Accounting Equipment 200 Control section 201 Image Acquisition Unit 202 Product Specification Department 203 Location information acquisition unit 204 Registration processing section 205 Recommended Product Presentation Section 400 Control section 401 Data Processing Unit 402 Recommendation processing section 403 Collaboration Processing Unit [Prior art documents] [Patent documents]

[0183] [Patent Document 1] JP 2002-304671 A

Claims

1. An identification means for identifying a type of a product based on an image of the product; a first acquisition means for acquiring data corresponding to the type of product identified by the identification means and satisfying the conditions from a server device that manages data relating to a set value related to the amount of the discount or reduction and a condition for applying the discount or reduction for each type of target product that is subject to the discount or reduction; a first display control means for causing a display unit to display information regarding the type of the product identified by the identification means and information based on the data acquired by the first acquisition means; An information processing device comprising:

2. The terms and conditions define the period during which the discount or allowance is available; the first acquisition means acquires from the server device data corresponding to the type of the product identified by the identification means and in which the current date and time satisfies the condition; The information processing device according to claim 1 .

3. A second acquisition means for acquiring location information indicating a location of the information processing device; a third acquisition means for acquiring data corresponding to the position information acquired by the second acquisition means and satisfying the condition and the type of the target product from the server device that manages data in which position information indicating a placement position of the target product is associated with each type of the target product; a second display control means for causing the display unit to display information related to the type of the target product acquired by the third acquisition means and information based on the data; The information processing apparatus according to claim 1 , further comprising:

4. The terms and conditions define the period during which the discount or allowance is available; The third acquisition means acquires, from the server device, data corresponding to the location information acquired by the second acquisition means and for which the current date and time satisfy the condition, and a type of the target product. The information processing device according to claim 3 .

5. A server device capable of communicating with an information processing device, A receiving means for receiving input of information indicating a type of product from the information processing device; a reading means for reading, from a storage unit that stores data relating conditions for applying a discount or reduction to a set value related to the amount of the discount or reduction for each type of target product that is subject to a discount or reduction, data that corresponds to the type of product accepted by the accepting means and satisfies the conditions; a transmitting means for transmitting the data read by the reading means to the information processing device; A server device comprising:

6. The computer of the information processing device, An identification means for identifying a type of a product based on an image of the product; a first acquisition means for acquiring data corresponding to the type of product identified by the identification means and satisfying the conditions from a server device that manages data relating to a set value related to the amount of the discount or reduction and a condition for applying the discount or reduction for each type of target product that is subject to the discount or reduction; a first display control means for causing a display unit to display information regarding the type of the product identified by the identification means and information based on the data acquired by the first acquisition means; A program to make it function as such.

7. A computer of a server device capable of communicating with an information processing device, A receiving means for receiving input of information indicating a type of product from the information processing device; a reading means for reading, from a storage unit that stores data relating conditions for applying a discount or reduction to a set value related to the amount of the discount or reduction for each type of target product that is subject to a discount or reduction, data that corresponds to the type of product accepted by the accepting means and satisfies the conditions; a transmitting means for transmitting the data read by the reading means to the information processing device; A program to make it function as such.

Images