Commodity registration system

By setting up a camera device in the storage part of the shopping cart, identifying and adjusting the identification range, the problem of re-registration of registered goods in the product registration system is solved, and the accuracy of registration is improved.

CN119007352APending Publication Date: 2024-11-22TOSHIBA TEC KK
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410202030.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2023-05-19
Filing Date
2024-02-23
Publication Date
2024-11-22

AI Technical Summary

Technical Problem

When the existing product registration system photographs the purchased goods, it may cause the registered product to be registered incorrectly, resulting in the occurrence of incorrect registration.

Method used

By setting up a camera device in the storage part of the shopping cart, the product is photographed and identified, and the identification range is adjusted based on the identification results and the total volume or total number of registered products, thereby reducing the occurrence of incorrect registration.

Benefits of technology

It effectively reduces the error of re-registration of goods registered in the storage department and improves the accuracy of product registration.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119007352A_ABST
    Figure CN119007352A_ABST
Patent Text Reader

Abstract

The invention discloses a commodity registration system capable of reducing the occurrence of wrong registration of commodities. The commodity registration system includes: an imaging unit provided in a storage unit for storing a commodity to be purchased, the imaging unit being disposed so that an inner side of the storage unit is included in an imaging range; a specifying unit that recognizes the product from the image captured by the image capturing unit and specifies the product stored in the storage unit on the basis of the recognition result; a registration unit that registers the product specified by the specifying unit as a product to be purchased; and a changing unit that changes a recognition range of the image in which the specifying unit recognizes the commodity on the basis of the total number of the commodities registered by the registering unit or the image.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This application claims priority from Japanese patent application filed on May 19, 2023, with application number JP2023-083305, and cites the contents of the above application, the disclosure of which is incorporated herein by reference in its entirety. Technical Field

[0002] An embodiment of the present invention relates to a commodity registration system. Background Art

[0003] A technology is known in which a camera is installed at a location where a shopping cart or a shopping basket (hereinafter also referred to as a storage section) containing purchased goods can be photographed in a store that sells goods, and the goods are photographed when being stored in the storage section, so that the goods can be specified based on the photographed image. According to the related technology, the customer can register the specified goods as the transaction object by performing the action of storing the goods in the storage section.

[0004] In addition, the above-mentioned camera device is arranged above the storage section, near the edge of the opening of the storage section, etc., and the camera is set in a manner to include the interior of the storage section in the camera range so that tray-shaped goods such as bento boxes and vegetables that are not easy to tilt can be photographed from above.

[0005] However, in the above-mentioned prior art configuration, the camera device includes the interior of the storage unit in the camera range, but depending on the number of commodities stored in the storage unit, there is a case where the registered commodity enters the camera range, so the registered commodity may be mistakenly registered again. Therefore, a technology that can reduce the occurrence of mistakenly registered commodities is desired. Summary of the invention

[0006] In view of the above problems, the problem to be solved by the present invention is to provide a commodity registration system which can reduce the occurrence of erroneous commodity registration.

[0007] To solve the above-mentioned problem, the commodity registration system of the embodiment includes: a storage section for storing commodities to be purchased, and a camera section configured to include the inner side of the storage section within the camera range; a designated section for identifying commodities from images captured by the camera section, and specifying commodities stored in the storage section based on the identification result; a registration section for registering the commodities specified by the designated section as commodities to be purchased; and changing the designation based on the total amount of commodities registered by the registration section or the image.

[0008] According to the above-mentioned commodity registration system, it is possible to provide a commodity registration system capable of reducing the number of commodities in a storage section that are erroneously registered.

[0009] In the above-mentioned commodity registration system, the changing unit changes the recognition range based on the total volume of commodities registered by the registration unit.

[0010] According to the above-mentioned commodity registration system, the recognition range can be changed based on the total volume of the registered commodities, thereby reducing erroneous registrations.

[0011] In the above-mentioned commodity registration system, the changing unit changes the recognition range based on the total volume of commodities registered by the registration unit.

[0012] According to the above-mentioned commodity registration system, the recognition range can be changed based on the total number of registered commodities, thereby reducing erroneous registrations.

[0013] In the above-mentioned commodity registration system, when the commodity stored in the storage section is recognized from the image, the changing unit excludes a range including the recognized commodity from the recognition range.

[0014] According to the above-mentioned commodity registration system, by excluding the range including the recognized commodity from the recognition range, it is possible to reduce erroneous registration.

[0015] In the above-mentioned commodity registration system, the specifying unit specifies the commodity taken out from the storage unit based on the recognition result, and the registration unit excludes the commodity from the purchase targets when the specifying unit specifies the commodity taken out from the storage unit.

[0016] According to the above-mentioned commodity registration system, even when the commodity has been taken out from the storage unit, the recognition range is changed, thereby reducing erroneous registration.

[0017] In the above-mentioned commodity registration system, the changing unit compares the total volume of the commodity with a threshold value, and changes the recognition range when the total volume exceeds the threshold value.

[0018] According to the above-mentioned commodity registration system, the recognition range can be changed based on the preset volume threshold value.

[0019] In the above-mentioned commodity registration system, the changing unit compares the total volume of the commodity with the threshold values ​​of a plurality of stages and changes the recognition range in a plurality of stages.

[0020] According to the above-mentioned commodity registration system, the recognition range can be changed in multiple stages based on the volume threshold values ​​set in advance in multiple stages.

[0021] In the above-mentioned commodity registration system, the changing unit includes a driving unit that moves the camera unit up and down, outputs an instruction signal for driving the camera unit based on the total volume of commodities registered by the registration unit, and changes the recognition range by moving the camera unit.

[0022] According to the above-mentioned commodity registration system, the commodities in the storage section can be excluded from the imaging range by moving the imaging section.

[0023] In the above-mentioned product registration system, there are multiple camera units, the designation unit recognizes and designates products from images taken by each of the multiple camera units, the registration unit registers the products designated by the designation unit, and the change unit changes the recognition range of each camera unit.

[0024] According to the above-mentioned commodity registration system, the recognition range can be changed in the commodity registration system having a plurality of imaging units.

[0025] In the above-mentioned commodity registration system, the changing section calculates the total quantity after excluding the special commodities not put into the storage section.

[0026] According to the above-mentioned commodity registration system, even when commodities placed in the storage section and commodities not placed in the storage section are mixed, the recognition range can be appropriately changed. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 1 This is a schematic diagram showing an example of a schematic configuration of a system according to the embodiment.

[0028] Figure 2 This is a side view showing an example of a schematic structure of a shopping cart according to the embodiment.

[0029] Figure 3 This is a schematic diagram showing an example of the hardware configuration of the tablet terminal according to the embodiment.

[0030] Figure 4 This is a schematic diagram showing an example of the data structure of the product master file involved in the embodiment.

[0031] Figure 5 This is a schematic diagram showing an example of the data structure of the sales registration table involved in the embodiment.

[0032] Figure 6 It is a schematic diagram showing an example of the functional configuration of a tablet terminal according to the embodiment.

[0033] Figure 7 It is a schematic diagram showing the relationship between the imaging range of the imaging unit and the recognition range of the commodity recognition unit according to the embodiment.

[0034] Figure 8 It is a schematic diagram showing the relationship between the imaging range of the imaging unit and the recognition range of the commodity recognition unit according to the embodiment.

[0035] Fig. 9It is a schematic diagram showing the relationship between the imaging range of the imaging unit and the recognition range of the commodity recognition unit according to the embodiment.

[0036] Fig.10 This is a flowchart showing an example of processing performed by the tablet terminal according to the embodiment.

[0037] Fig.11 This is a side view showing an example of a schematic structure of a shopping cart according to Modification 1.

[0038] Description of Reference Numerals

[0039] 1 System 2 Tablet terminal 3 Shopping cart

[0040] 4 Server 8 Checkout Machine 200 Control Unit

[0041] 201 Image acquisition unit 202 Product recognition unit 203 Registration processing unit

[0042] 204 Recognition range change unit 205 Settlement processing unit 241 Product master file

[0043] 242 Sales Registration Form DETAILED DESCRIPTION

[0044] The following will describe in detail the commodity registration device and program involved in this embodiment with reference to the accompanying drawings. In the embodiment, as an example of the commodity registration device, a terminal device (hereinafter also referred to as a cart terminal) installed in a cart (hereinafter also referred to as a shopping cart) used in a store to transport commodities is described. In addition, this application example does not limit the invention.

[0045] Figure 1 1 is a schematic diagram showing an example of the schematic structure of the system 1 involved in the embodiment. Figure 1 As shown, the system 1 includes a tablet terminal 2, a server 4, and a checkout machine 8. The server 4 and the checkout machine 8 are connected to each other in a communicable manner via a network Na.

[0046] As the network Na, the Internet, VPN (virtual private network), LAN (local area network), public communication network, mobile communication network, etc. can be used alone or in appropriate combination. As an example of the network Na, the Internet and a mobile communication network are used in combination.

[0047] The wireless access point 7 is connected to the network Na. The wireless access point 7 is connected to the tablet terminal 2 via a network Nb such as a wireless LAN. Therefore, the tablet terminal 2 can communicate with the server 4 and the checkout machine 8.

[0048] The shopping cart 3 includes a storage portion 31 for storing commodities displayed in the store (see Figure 2 The storage section 31 has an open upper portion, and the commodities are stored in the storage section 31 from the upper portion. The customer rents the shopping cart 3 in the store, and stores the commodities to be purchased from the displayed commodities in the storage section 31 while moving with the shopping cart 3 in the store.

[0049] The tablet terminal 2 is configured to be mountable on the shopping cart 3. The tablet terminal 2 identifies the commodity stored in the storage section 31 based on the image captured by the camera section 34 described later, and performs sales registration processing related to the commodity. Here, the sales registration processing refers to the processing of the tablet terminal 2 treating the designated commodity as a purchase object. Specifically, the sales registration processing refers to the processing of registering information related to the identified commodity (hereinafter also referred to as sales registration data) in the sales registration table 242 described later. For example, in the sales registration processing, the sales registration data is registered in the sales registration table 242, and the sales registration data includes a commodity code that can identify the item of the commodity, the number of purchases of the commodity, etc.

[0050] In addition, when the tablet terminal 2 receives an operation from a customer to check out using the checkout machine 8, it executes a process of transferring the sales registration data related to a transaction to the checkout machine 8. For example, the tablet terminal 2 encodes the sales registration data into a code symbol such as a QR code and displays it. In this case, the checkout machine 8 reads the code symbol displayed on the tablet terminal 2 to obtain the sales registration data related to a transaction that has been sold and registered by the tablet terminal 2, and performs a checkout process based on the sales registration data.

[0051] The server 4 uses the tablet terminal 2 as a user interface terminal and performs information processing for providing services for the sale and purchase of goods in a store using the user interface terminal. The server 4 may be, for example, a store server installed in a store or a server device installed outside a store. In addition, in the present embodiment, the server 4 is implemented by a single device, but may also be a cloud server (or cloud system) implemented by multiple devices connected via a network.

[0052] The server 4 is an information processing device having a computer structure including a processor, a main storage device, an auxiliary storage device, etc. The server 4 stores a product master file in which product names, prices, etc. of products sold in a store are registered in a database or the like (not shown), and provides the file to the tablet terminal 2 and the checkout machine 8.

[0053] The register 8 is a register device installed in the store. The register 8 performs the settlement processing of the goods based on the sales registration data. The settlement processing refers to the processing of displaying the total amount of the goods involved in a transaction, the tax amount, calculating and displaying the change based on the amount prepaid by the customer, and issuing a receipt printed with the product information and settlement information (total amount, prepaid amount, change amount, etc.).

[0054] Next, the shopping cart 3 will be described. Figure 2 1 is a side view showing an example of the schematic structure of the shopping cart 3. The shopping cart 3 includes a shopping basket-shaped storage portion 31 with an open upper surface, rotatable casters 32 provided below the storage portion 31, and a handle portion 33 connected to the storage portion 31 and the casters 32 and held by a customer when moving the shopping cart 3.

[0055] The storage section 31 is formed by surrounding the side and bottom portions with a mesh grid 311 to form a substantially rectangular upper opening, so that the products stored in the storage section 31 can be observed from the outside. In addition, the side and bottom portions may be formed by walls instead of the mesh grid 311.

[0056] In addition, the shopping cart 3 is provided with the tablet terminal 2 detachably near the handle 33. In addition, the shopping cart 3 is provided with a camera 34 near the edge of the opening of the storage section 31. The camera 34 is an example of a camera, and is implemented by a digital camera or the like. The camera 34 is provided so that the camera direction faces the opening of the storage section 31. That is, the camera direction is set so that at least a part of the camera range of the camera 34 includes the inside of the storage section 31.

[0057] The imaging unit 34 captures an image of the commodity stored in the storage unit 31 or the commodity taken out from the storage unit 31, and outputs the captured image to the tablet terminal 2. Here, the image refers to a still image or a moving image in units of frames.

[0058] The hardware configuration of the tablet terminal 2 will be described below. Figure 3 It is a schematic diagram showing an example of the hardware configuration of the tablet terminal 2 .

[0059] like Figure 3 As shown, the tablet terminal 2 includes a CPU (Central Processing Unit) 21, a ROM (Read Only Memory) 22, a RAM (Random Access Memory) 23, a storage unit 24, a display unit 25, an operation unit 26, a communication unit 27, and a connection unit 28.

[0060] The CPU 21 is an example of a processor, and generally controls the operation of the tablet terminal 2. The ROM 22 stores various programs. The RAM 23 is a workspace for loading programs and various data.

[0061] CPU 21, ROM 22 and RAM 23 are connected via a bus or the like, and constitute a computer-structured control unit 200. In the control unit 200, CPU 21 operates using a program stored in ROM 22 or a storage unit RAM 24 and loaded into RAM 23, thereby executing various processes.

[0062] The storage unit 24 has a storage medium such as an HDD or a flash memory, and stores the stored contents even when the power is turned off. The storage unit 24 stores programs executable by the CPU 21 and various setting information. In addition, the storage unit 24 stores a product master file 241, a sales registration table 242, and the like.

[0063] The commodity master file 241 is a data table for managing commodities sold in a store. The sales registration table 242 is a data table for managing commodities registered for sale using the tablet terminal 2 of the user.

[0064] The display unit 25 is a display device such as an LCD (Liquid Crystal Display). The display unit 25 displays various information under the control of the CPU 21. The operation unit 26 is an input device such as a keyboard and a pointing device. The operation unit 26 outputs the operation content input via the input device to the CPU 21. In addition, the operation unit 26 may be a touch panel provided on the display unit 25.

[0065] The communication unit 27 is a wired or wireless communication interface that can connect to the network Nb. The communication unit 27 is connected to the wireless access point 7 via the network Nb so as to be communicable. The control unit 200 communicates with the server 4 and the checkout machine 8 via the communication unit 27.

[0066] The connection unit 28 is an interface for connecting to peripheral devices. The connection unit 28 is a wired or wireless interface that complies with standards such as USB (Universal Serial Bus) and Bluetooth (registered trademark). In this embodiment, the connection unit 28 is connected to the camera unit 34.

[0067] Figure 4 2 is a schematic diagram showing an example of the data structure of the commodity master file 241. Figure 4As shown, the commodity master file 241 stores the commodity code and the commodity information in association with each other. The commodity code is an example of identification information that can identify the type of commodity sold in the store. As the commodity code, for example, a JAN code can be used. The commodity information is information about the commodity corresponding to the commodity code. For example, the commodity name, price, volume information, etc. are registered in the commodity information. Here, the volume information is information indicating the size of the commodity corresponding to the commodity code, for example, information indicating the volume and capacity of the commodity including the packaging is registered.

[0068] In addition, the data structure of the product master file 241 is not limited to Figure 4 For example, a structure may be provided in which feature information representing the features of the appearance of a product corresponding to the product code is registered in association with the product code. The relevant feature information may be information used for comparison when identifying a product from an image. In addition, the feature information may be an image representing the appearance of the product or a feature quantity that quantitatively represents the characteristics of the appearance of the product.

[0069] In addition, there are special commodities that are not placed in the storage section 1. A special commodity mark (special commodity information) representing a special commodity can be registered in association with the commodity code. The special commodity mark is a one-bit data for identifying whether the commodity identified by the commodity code is a commodity that is not placed in the storage section 31. Special commodities refer to commodities that are packaged using packaging materials such as cardboard and plastic bags and have a volume that is approximately close to or greater than the volume of the storage section 31. Commodities such as a plurality of plastic bottled beverages or canned beverages packaged using cardboard, and commodities such as a plurality of toilet paper and tissue boxes packaged using plastic bags are equivalent to special commodities. For commodities that are not placed in the storage section 31, the special commodity mark is set to "1", and the special commodity marks of other commodities are set to "0".

[0070] In addition, in the present embodiment, the configuration of the product master file 241 is stored in the tablet terminal 2, but the configuration of the product master file 241 may be stored in the server 4. In this case, each of the tablet terminals 2 can refer to the product master file 241 stored in the server 4, thereby managing the product master file 241 in the same manner as if it were stored locally.

[0071] Figure 5 242 is a schematic diagram showing an example of the data structure of the sales registration table 242. Figure 5 As shown, the sales registration table 242 stores the product ID and the number of pieces in association with each other. The product ID is the product ID of the product that has been registered for sales, and corresponds to the product ID of the product master file 241. The number of pieces is the number of pieces registered for the same product that has been registered for sales. For example, in the number of pieces, 1 is registered in the default state.

[0072] In addition, the data structure of the sales registration table 242 is not limited to Figure 5 The data structure shown. For example, the structure may be such that the product information corresponding to the product ID is registered in association with the product ID. In addition, date and time information indicating the registration date and time may be registered in association with the product ID.

[0073] In addition, in the present embodiment, the structure of the sales registration table 242 is saved for the tablet terminal 2, but it is not limited to this, and the structure of the sales registration table 242 may also be saved for the server 4. In this case, the server 4 issues a transaction ID that can identify each transaction performed by each tablet terminal such as the tablet terminal 2, and saves the sales registration table 242 in association with the transaction ID, thereby managing the sales registration table 242 each time a transaction is performed.

[0074] Specifically, the server 4 notifies the tablet terminal 2 of the issued transaction ID, thereby causing the tablet terminal 2 to store the transaction ID during the transaction of the transaction ID. Then, the tablet terminal 2 sends the product ID of the product to be sold and registered to the server 4 together with the transaction ID, and instructs the server 4 to register the product ID of the product to be sold and registered in the sales registration table 242 corresponding to the transaction ID. In this way, the server 4 can centrally manage the products sold and registered by each tablet terminal 2. In addition, it is assumed that the tablet terminal 2 can refer to the sales registration table 242 of the transaction involved in its own terminal.

[0075] Next, the functional configuration of the tablet terminal 2 will be described. Figure 6 It is a schematic diagram showing an example of the functional configuration of the tablet terminal 2 .

[0076] like Figure 6 As shown, the tablet terminal 2 includes an image acquisition unit 201 , a commodity recognition unit 202 , a registration processing unit 203 , a recognition range change unit 204 , and a payment processing unit 205 as functional components.

[0077] The functional configuration of the tablet terminal 2 is a software configuration implemented by the processor of the tablet terminal 2 operating according to a program stored in the ROM or storage unit, but is not limited to this. For example, part or all of the functional configuration of the tablet terminal 2 can be implemented in the form of hardware such as a dedicated circuit.

[0078] The image acquisition unit 201 acquires the image captured by the camera unit 34 via the connection unit 28. The commodity recognition unit 202 is an example of a designation unit. The commodity recognition unit 202 designates the commodity photographed by the camera unit 34 based on the image acquired by the image acquisition unit 201. Specifically, when the commodity enters the imaging range of the camera unit 34 and the commodity is photographed by the camera unit 34, the commodity recognition unit 202 recognizes the commodity by using a known object recognition technology, etc., thereby designating the commodity code of the commodity. In addition, the commodity recognition unit 202 can designate the commodity code stored in the code symbol attached to the commodity by recognizing and decoding the code symbol.

[0079] Here, reference Figure 7 and Figure 8 The relationship between the imaging range of the imaging unit 34 and the identification range of the commodity identification unit 202 for identifying commodities from images will be described. Figure 7 and Figure 8 2 is a schematic diagram showing the relationship between the imaging range of the imaging unit 34 and the recognition range of the commodity recognition unit 202 .

[0080] exist Figure 7 In FIG. 1 , the rectangular frame area indicates the imaging range Aa. The imaging range Aa is set to include the interior of the storage section 31. That is, the image captured by the imaging section 34 includes the interior of the storage section 31.

[0081] In addition, in the imaging range Aa, the area shown by the hatching is the identification range Ab of the commodity identification unit 202. Figure 7 , the entire area of ​​the image captured by the camera unit 34 is shown as the recognition range Ab. In addition, the recognition range Ab and the camera range Aa are in an inclusive relationship.

[0082]

[0083] When a customer takes out a commodity that he wants to buy from the shelf and stores it in the storage section 31, Figure 8 As shown, the commodity G enters the imaging range Aa of the imaging unit 34. The commodity recognition unit 202 recognizes the commodity G from the recognition range Ab of the image acquired by the image acquisition unit 201, that is, the entire area of ​​the image.

[0084] Furthermore, when the commodity recognition unit 202 recognizes the commodity G from the image, it detects the direction in which the commodity G moves from the temporally continuous images. Specifically, the commodity recognition unit 202 detects the movement (for example, a motion vector) of the commodity G relative to the storage unit 31. That is, the commodity recognition unit 202 detects information that can determine whether the commodity G is stored in the storage unit 31 or the commodity G is taken out of the storage unit 31. In addition, it is assumed that the commodity recognition unit 202 once specifies a commodity code for the commodity recognized from a series of images.

[0085] Back to Figure 6 , the registration processing unit 203 is an example of a registration unit. The registration processing unit 203 performs sales registration processing on the commodity specified by the commodity identification unit 202. Specifically, when the commodity is identified by the commodity identification unit 202 and the commodity is detected to be moving downward, the registration processing unit 203 determines that the commodity is stored in the storage unit 31. In this case, the registration processing unit 203 registers the commodity code and the number of pieces of the commodity specified by the commodity identification unit 202 in the sales registration table 242. Specifically, the registration processing unit 203 increases the number of pieces of the commodity by 1 each time the same commodity is registered. In addition, when the registration processing unit 203 reads out the commodity name and price of the commodity corresponding to the registered commodity code from the commodity master file 241, it displays them together with the number of pieces on the display unit 25, thereby displaying a list of sales registered commodities in the order of registration.

[0086] Furthermore, when the commodity is identified by the commodity identification unit 202 and the commodity is detected to be moved upward, the registration processing unit 203 determines that the commodity has been taken out from the storage unit 31. In this case, the registration processing unit 203 deletes the commodity code of the commodity specified by the commodity identification unit 202 from the sales registration table 242, or subtracts 1 from the number of registered items. Specifically, when the number of registered items becomes 0, the registration processing unit 203 deletes the commodity code of the commodity from the sales registration table 242. Furthermore, the registration processing unit 203 notifies the commodity whose sales registration has been released by eliminating the display of the commodity deleted from the sales registration table 242 from the commodities displayed in the list or subtracting the number of items.

[0087] Thus, in the system 1, when the customer stores the commodity in the storage section 31, the sales registration of the commodity is automatically performed. In addition, in the system 1, when the customer takes out the commodity from the storage section 31, the registration of the commodity is automatically released.

[0088] Incidentally, since the commodities stored in the storage section 31 are stored in the storage section 31, as the number of commodities stored increases, the space occupied by the commodities in the storage section 31 increases. In addition, when relatively large commodities are stored in the storage section 31, the space occupied by the commodities in the storage section 31 also increases. In this case, when the commodities stored in the storage section 31 enter the recognition range Ab of the commodity recognition section 202, there is a possibility that the commodity recognition section 202 recognizes the commodities as new commodities even though they are already registered commodities, and the registration processing section 203 repeatedly performs erroneous registration of sales registration.

[0089] Therefore, in this embodiment, the identification range changing unit 204 changes the identification range Ab used by the commodity identification unit 202 to identify commodities based on the number of commodities stored in the storage unit 31 derived from the commodities registered for sale, thereby performing processing for reducing the occurrence of the above-mentioned erroneous registration. In addition, the identification range changing unit 204 is an example of a changing unit.

[0090] Specifically, the recognition range changing unit 204 reads the volume information of the commodity corresponding to each commodity code registered in the sales registration table 242 from the commodity master file 241. Next, the recognition range changing unit 204 calculates the total volume of the commodities stored in the storage unit 31 by adding the value of the read volume information. Here, the total volume of the commodities is an example of information indicating the state of the commodities stored in the storage unit 31. Then, the recognition range changing unit 204 changes the recognition range Ab according to the calculated total volume.

[0091] The recognition range changing unit 204 checks whether a special product mark (special product information) is registered when reading the volume information of the products corresponding to each product code registered in the sales registration table 242 from the product master file 241. When the special product mark is registered ("1"), the volume information of the product is not read from the product master file 241, and the volume information is not added. When the special product mark is not registered ("0"), the volume information of the product is read from the product master file 241. The recognition range changing unit 204 excludes the products with special product information (special products) to calculate the total amount. That is, among the registered products, the volume of the products placed in the storage unit 31 is added. The processing of excluding the products that are not placed in the storage unit 31 is performed.

[0092] Fig. 9 2 is a schematic diagram for explaining the operation of the recognition range changing unit 204, and shows the relationship between the imaging range Aa of the imaging unit 34 and the recognition range Ab of the commodity recognition unit 202. Fig. 9 , a state in which two commodities Ga and Gb are stored in the storage section 31 is shown.

[0093] In this case, the recognition range changing unit 204 changes the recognition range Ab according to the total volume of the commodities Ga and Gb. As an example, when the total volume exceeds a predetermined threshold, the recognition range changing unit 204 changes the recognition range Ab. The threshold is pre-stored in the storage unit 24. Fig. 9 , an example is shown in which the remaining area (upper half of the imaging range Aa) after the area representing the storage section 31 is excluded from the imaging range Aa is used as the recognition range Ab.

[0094] Thus, in the tablet terminal 2, since the registered commodities Ga and Gb stored in the storage section 31 can be excluded from the objects to be recognized, the occurrence of erroneous registration can be prevented. In addition, in the tablet terminal 2, since the area above the storage section 31 is used as the recognition range Ab, the newly stored commodity Gc can be recognized and the commodity Gc can be registered for sale.

[0095] In the above example, the identification range Ab is changed based on one threshold value, but the identification range Ab may be changed (reduced or expanded) in multiple stages by setting the threshold value in multiple stages (the storage unit 24 may store multiple stages of threshold values ​​in advance). In addition, the identification range Ab may be dynamically changed (reduced or expanded) in accordance with the change in the total volume.

[0096] Furthermore, in the above example, the composition of the identification range Ab is changed based on the total volume of the sales registered commodities, but the composition of the identification range Ab may be changed using other indicators. For example, the composition of the identification range Ab may be changed based on the total number of sales registered commodities. Here, the total number of commodities is an example of information indicating the state of commodities stored in the storage section 31. In addition, when calculating the total number of commodities, commodities registered with special commodity marks are also excluded from the objects of calculating the total number of commodities. That is, the total number of commodities placed in the storage section 31 among the registered commodities is calculated. The processing of excluding commodities that are not placed in the storage section 31 is performed.

[0097] In this case, the recognition range Ab may be changed (reduced or expanded) based on one or more thresholds of the total number of commodities, or the recognition range Ab may be dynamically changed (reduced or expanded) to follow changes in the total number.

[0098] Back to Figure 6 The settlement processing unit 205 performs the processing related to the settlement of the sales registered commodity according to the customer's operation. Specifically, the settlement processing unit 205 inputs data that can specify the sales registered commodity into the checkout machine 8, thereby achieving a state in which the checkout machine 8 can perform settlement.

[0099] For example, when the settlement processing unit 205 receives an operation instructing the start of settlement via the operation unit 26, the sales registration data registered in the sales registration table 242 is encoded into a code symbol such as a QR code and displayed on the display unit 25. In this case, the checkout machine 8 obtains the sales registration data by reading the code symbol displayed on the display unit 25 of the tablet terminal 2, and performs the checkout process of the commodity involved in the transaction that has been sold and registered based on the obtained sales registration data.

[0100] In addition, for example, the settlement processing unit 205 may transmit the sales registration data registered in the sales registration table 242 to the checkout machine 8 through near field wireless communication such as Bluetooth (registered trademark). In this case, the checkout machine 8 obtains the sales registration data transmitted from the tablet terminal 2, and performs the checkout process of the commodity involved in the transaction that has been sold and registered based on the obtained sales registration data.

[0101] In addition, for example, in the case of a configuration in which the sales registration table 242 is stored in the server 4, the settlement processing unit 205 encodes the transaction ID of the transaction into a code symbol such as a barcode or a two-dimensional code, and displays it on the display unit 25. In this case, the checkout machine 8 obtains the transaction ID by reading the code symbol displayed on the display unit 25 of the tablet terminal 2. Then, the checkout machine 8 obtains the sales registration data related to the obtained transaction ID from the server 4, and performs the checkout process of the commodity involved in the sales registration transaction based on the obtained sales registration data.

[0102] In addition, the settlement of goods is not limited to the method using the checkout machine 8, and can also be performed using the tablet terminal 2. For example, when the settlement processing unit 205 receives an operation instructing to start settlement via the operating unit 26, the display unit 25 displays a screen that allows selection of a settlement method such as electronic currency settlement, credit card settlement, etc. When the settlement method is selected, the settlement processing unit 205 receives input of settlement information for settlement using the selected settlement method, and performs settlement processing for the total amount of the registered goods sold based on the input settlement information by cooperating with an external settlement server. The relevant settlement information can be, for example, a credit card number or a two-dimensional code for code settlement. In addition, in the case of a two-dimensional code for code settlement, the input can be received via the camera unit 34.

[0103] Next, we will refer to Fig.10 An operation example of the tablet terminal 2 will be described. Fig.10 2 is a flowchart showing an example of processing performed by the tablet terminal 2. In addition, it is assumed that, as a premise of this processing, the recognition range Ab of the commodity recognition unit 202 is set to a range equal to the imaging range Aa of the imaging unit 34. In addition, in this processing, an operation example of changing the recognition range Ab of the commodity recognition unit 202 based on a threshold value will be described.

[0104] First, when the present process is started by an operation via the operation unit 26 , the control unit 200 of the tablet terminal 2 initializes the sales registration table 242 (step S11 ).

[0105] In addition, in the case of a configuration in which the sales registration table 242 is stored in the server 4, the control unit 200 requests the server 4 to issue a transaction ID, thereby causing the server 4 to store the sales registration table 242 associated with the transaction ID of the transaction. In addition, the control unit 200 obtains the issued transaction ID from the server 4 and stores it in the RAM 23 or the like.

[0106] Next, the image acquisition unit 201 acquires an image from the camera unit 34 (step S12). Next, the commodity recognition unit 202 determines whether a commodity has been recognized from the recognition range Ab of the image acquired in step S12 (step S13). If no commodity has been recognized (step S13; No), the process proceeds to step S21.

[0107] When the commodity recognition unit 202 recognizes a commodity from the recognition range Ab of the image obtained in step S12 (step S13; Yes), it specifies the commodity code of the commodity (step S14). Next, the commodity recognition unit 202 determines the moving direction of the recognized commodity (step S15). Here, in the case where the moving direction of the commodity is toward the bottom of the storage unit 31 (step S15; Yes), the registration processing unit 203 registers the commodity specified in step S14 in the sales registration table 242 (step S16) and transitions to step S18. In addition, in the case where the moving direction of the commodity is upward away from the storage unit 31 (step S15; No), the registration processing unit 203 deletes the commodity specified in step S14 from the sales registration table 242 (step S17), and the processing transitions to step S18.

[0108] Next, the recognition range changing unit 204 determines whether the total volume or total number of the commodities registered in the sales registration form 242 is below the threshold value (less than or equal to the threshold value) (step S18). When calculating the total volume or total number, check whether the registered commodities are special commodities that are not placed in the storage unit 31. Special commodities are excluded from the objects for calculating the total volume and total number, and the total volume or total number is calculated for commodities that are not special commodities. Here, when it is determined to be below the threshold value (step S18; Yes), the recognition range changing unit 204 sets the recognition range Ab of the commodity recognition unit 202 to the entire area of ​​the camera range Aa (step S19), and transitions to step S21. In addition, when it is determined to exceed the threshold value (step S18; No), the recognition range changing unit 204 sets the recognition range Ab of the commodity recognition unit 202 to the upper half of the camera range Aa excluding the storage unit 31 (step S20), and transitions to step S21.

[0109] Next, the control unit 200 determines whether the end of the sales registration has been instructed (step S21). If the end of the sales registration has not been instructed (step S21; No), the control unit 200 returns to the process of step S12. In addition, when the end of the sales registration has been instructed (step S21; Yes), the control unit 200 ends the process.

[0110] As described above, the system 1 includes: a camera unit 34 provided in the storage unit 31 for storing the goods to be purchased and configured to include the inside of the storage unit in the imaging range; a commodity recognition unit 202 of the tablet terminal 2 for recognizing the goods from the image captured by the camera unit 34 and specifying the goods stored in the storage unit 31 based on the recognition result; and a registration processing unit 203 of the tablet terminal 2 for registering the specified goods as the goods to be purchased. In addition, the recognition range changing unit 204 of the tablet terminal 2 changes the recognition range of the registration processing unit 203 based on the information related to the goods registered by the registration processing unit 203.

[0111] According to this, in the system 1, when the registered commodity may enter the imaging range of the imaging unit 34 due to the number of commodities stored in the storage unit 31, the recognition range changing unit 204 changes the recognition range, thereby excluding the registered commodity from the recognition range. Therefore, in the system 1, the occurrence of erroneous registration of commodities can be reduced.

[0112] In addition, the above-mentioned embodiment can also be appropriately implemented by changing a part of the composition or function of each device. Therefore, several modified examples involved in the above-mentioned embodiment are described as other embodiments below. In addition, the following will mainly describe the points different from the above-mentioned embodiment, and omit the description of the points common to the described content. In addition, the modified examples described below can be implemented individually or in appropriate combination.

[0113] (Variation 1)

[0114] In the above embodiment, the number of the camera unit 34 installed on the shopping cart 3 is one, but it is not limited thereto and a plurality of camera units 34 may be provided. Fig.11 As shown, it is also possible to provide another imaging unit 35 at a position different from the imaging unit 34. Here, Fig.11 It is a side view showing an example of a schematic configuration of a shopping cart 3 according to the first modification.

[0115] The imaging direction of the imaging unit 35 is directed toward the opening of the storage unit 31 similarly to the imaging unit 34, and the imaging unit 35 is provided so that at least a part of the imaging range includes the interior of the storage unit 31. The imaging unit 35 is connected to the tablet terminal 2 and outputs the captured images to the tablet terminal 2.

[0116] In this case, the image acquisition unit 201 of the tablet terminal 2 acquires an image captured by each of the imaging units 34 and 35. The commodity recognition unit 202 recognizes and specifies a commodity based on the image captured by each of the imaging units 34 and 35. The registration processing unit 203 performs sales registration of the commodity specified by the commodity recognition unit 202.

[0117] In this case, it is assumed that the registration processing unit 203 performs sales registration of the commodity only when a common commodity code is specified from each image of the camera unit 34 and the camera unit 35, or when a commodity code is registered from an image of either the camera unit 34 or the camera unit 35, in order to prevent the commodity from being registered multiple times. In addition, in this case, the registration processing unit 203 may be configured to collect information indicating the acquisition source (camera unit 34, camera unit 35) of the image that specifies the commodity when registering the commodity (hereinafter referred to as acquisition source information) and register it. In addition, when different commodity codes are specified from each image of the camera unit 34 and the camera unit 35, the registration processing unit 203 does not perform sales registration, but displays a message notifying an error on the display unit 25.

[0118] In addition, the recognition range changing unit 204 changes the recognition range Ab of the commodity recognition unit 202 based on the total volume or total number of the commodities that have been sold and registered, similarly to the above-mentioned embodiment. However, since a plurality of imaging units are provided, the recognition range changing unit 204 changes the recognition range Ab for each of the imaging units 34 and 35. In this case, the recognition range changing unit 204 may change the recognition range Ab for each of the imaging units 34 and 35 in the same manner, or may change it individually. In the latter case, the recognition range changing unit 204 calculates the total volume or total number of the commodities that have been sold and registered corresponding to the acquisition source of each image, for example, based on the acquisition source information registered in the sales registration table 242. Then, the recognition range changing unit 204 changes the recognition range Ab for each of the imaging units 34 and 35 individually based on the calculation result and the threshold value corresponding to the acquisition source of each image.

[0119] Thus, in the tablet terminal 2, for example, when the commodity stored in the storage section 31 is stored in a state where the commodity is stored in a part of the storage section 31, the recognition range Ab involved in the camera unit that captures the part can be changed individually. Therefore, in the tablet terminal 2 involved in this modification, since the recognition range Ab can be set according to the storage state of the commodity in the storage section 31, the commodity can be effectively recognized while preventing the occurrence of erroneous registration.

[0120] (Variation 2)

[0121] In the above embodiment, the imaging range Aa of the imaging unit 34 is fixed, but the present invention is not limited thereto. For example, the imaging range Aa may be moved in the up-down direction. In this case, for example, the imaging unit 34 includes a driving unit such as an actuator, which can move the imaging direction of the imaging unit 34 up-down. The driving unit can be driven by a driving signal input from the tablet terminal 2. In this case, the imaging range becomes the recognition range. That is, the recognition range changing unit 204 mechanically changes the recognition range Ab used by the commodity recognition unit 202 to recognize the commodity.

[0122] In addition, in this case, the recognition range changing unit 204 outputs an instruction signal for driving the driving unit to the camera unit 34 according to the total volume or total number of the goods that have been sold and registered by the registration processing unit 203 of the tablet terminal 2, thereby changing the camera range Aa of the camera unit 34, that is, the recognition range Ab for identifying the goods. The position to which the camera unit 34 moves is a position where the camera range Aa and the recognition range Ab do not include the goods in the storage unit. Specifically, when the total volume or total number of the goods that have been sold and registered by the registration processing unit 203 increases and exceeds a threshold, the recognition range changing unit 204 outputs a driving signal to move the camera unit 34 upward. The moved position is determined to be a position that does not include the goods based on the captured image. Check whether the captured image does not include the goods, and stop outputting the driving signal when the goods are not included. Accordingly, the goods in the storage unit will not be reflected in the image of the camera unit. The occurrence of erroneous registration can be reduced in the same way as in the above-mentioned embodiment.

[0123] (Variant 3)

[0124] In the above embodiment, the identification range Ab of the commodity identification unit 202 is changed based on the total volume or total number of commodities that have been sold and registered, but it is not limited to this, and the identification range Ab may be changed based on the image captured by the camera unit 34. Specifically, the identification range changing unit 204 recognizes the state of the commodities stored in the storage unit 31 from the image acquired by the image acquisition unit 201, and changes the identification range Ab according to the range in which the identified commodities exist. For example, when the identification range changing unit 204 recognizes the existence of commodities below the image, it changes the identification range Ab by excluding the range including the identified commodities from the identification range Ab. According to this, the occurrence of erroneous registration can be reduced in the same way as in the above embodiment.

[0125] The recognition range changing unit 204 can recognize commodities from images using the same method as the commodity recognizing unit 202. In addition, commodities stored in the storage unit 31 can be recognized based on the recognition results of the recognition range changing unit 204 and the commodity recognizing unit 202. For example, commodities that are substantially stationary in the continuous images can be recognized as commodities stored in the storage unit 31.

[0126] (Variant 4)

[0127] In the above embodiment, although the shopping cart 3 is described as a form in which the goods are stored in the storage section 31, the present invention is not limited thereto, and the goods may be stored in another form of the storage section 31. For example, a shopping basket used when carrying goods in a store may be used as an example of the storage section 31. In this case, the camera unit 34 is provided near the edge of the opening of the shopping basket, and is provided so that the inside of the shopping basket is included in at least a part of the camera range.

[0128] In this case, a portable terminal such as a smartphone having the same function as the tablet terminal 2 may be used instead of the tablet terminal 2. The shopping basket may be carried and moved directly by the customer, or may be moved while being placed in the storage section 31 of the shopping cart 3.

[0129] (Variant 5)

[0130] In the above embodiment, the tablet terminal 2 performs the identification (and specification) of the commodity based on the image captured by the camera unit 34, but the present invention is not limited thereto and may be performed by an external device such as the server 4. In this case, for example, the tablet terminal 2 sends the image captured by the image acquisition unit 201 to the server 4, and the server 4 may include a part or all of the commodity identification unit 202, the registration processing unit 203, and the identification range change unit 204. In this case, the server 4 only needs to be able to perform the identification (and specification) of the commodity and the sales registration process based on the image sent from the tablet terminal 2.

[0131] The program executed by each device of the above-mentioned embodiment (and its variant) is provided in a state of being pre-installed in a ROM, a storage unit, etc. The program executed in each device of the above-mentioned embodiment can be configured to be stored in a computer-readable storage medium such as a CD-ROM, a floppy disk (FD), a CD-R, or a DVD (Digital Versatile Disk) in an installable or executable form and provided.

[0132] Furthermore, the programs executed by the devices of the above embodiments may be stored in a computer connected to a network such as the Internet and provided by downloading the computer via the network. In addition, the programs executed by the devices of the above embodiments may be provided or distributed via a network such as the Internet.

[0133] Although the embodiments of the present invention have been described above, the embodiments are provided as examples and are not intended to limit the scope of the invention. These novel embodiments and their variations can be implemented in various other forms and can be omitted, replaced, changed and combined in various ways without departing from the scope of the invention. These embodiments and their variations are included in the scope and spirit of the invention and are included in the invention described in the claims and their equivalents.

Claims

1. A commodity registration system, characterized in that: include: The camera unit is provided in a storage unit for storing the purchased goods and is configured so that the inner side of the storage unit is included in the camera range; a designating unit that recognizes commodities from the image captured by the imaging unit and designates commodities stored in the storage unit based on the recognition result; a registering unit that registers the commodity designated by the designating unit as the commodity to be purchased; and The changing unit changes a recognition range of the image of the commodity that is recognized by the designating unit based on the total amount of the commodity registered by the registering unit or the image.

2. The commodity registration system according to claim 1, wherein: The changing unit changes the recognition range based on the total volume of commodities registered by the registering unit.

3. The commodity registration system according to claim 1, wherein: The changing unit changes the recognition range based on the total number of commodities registered by the registering unit.

4. The commodity registration system according to claim 1, wherein: When the commodity stored in the storage section is recognized from the image, the changing unit excludes a range including the recognized commodity from the recognition range.

5. The commodity registration system according to any one of claims 1 to 4, wherein: The specifying unit specifies the commodity taken out from the storage unit based on the recognition result. The registration unit excludes the commodity taken out from the storage unit from the purchase targets when the specifying unit specifies the commodity.

6. The commodity registration system according to claim 2, wherein: The changing unit compares the total volume of the product with a threshold value, and changes the recognition range when the total volume exceeds the threshold value.

7. The commodity registration system according to claim 6, wherein: The changing unit compares the total volume of the product with the threshold values ​​of a plurality of stages and changes the recognition range in a plurality of stages.

8. The commodity registration system according to claim 1, wherein: The changing unit includes a driving unit that moves the imaging unit up and down, outputs an instruction signal to drive the imaging unit based on the total volume of the commodities registered by the registration unit, and changes the recognition range by moving the imaging unit.

9. The commodity registration system according to claim 1, wherein: There are a plurality of the camera units, The specifying unit recognizes and specifies the commodity from the images captured by each of the plurality of imaging units. The registration unit registers the commodity specified by the specifying unit, The changing unit changes the recognition range of each imaging unit.

10. The commodity registration system according to claim 1, wherein: The changing unit calculates the total amount after excluding the special commodities that are not put into the storage unit.