POS terminal, control method, and program
The POS terminal adapts its processing mode based on image analysis to handle purchased and shipped items efficiently, enhancing customer convenience and operational efficiency.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- NEC CORP
- Filing Date
- 2024-10-30
- Publication Date
- 2026-05-15
AI Technical Summary
POS terminals face challenges in distinguishing between product settlement processing and shipping procedures, leading to inconsistent handling of purchased and shipped items.
A POS terminal equipped with image acquisition, determination, and control units to identify whether the process is payment or shipping size determination based on product images, switching modes accordingly.
Facilitates seamless processing by automatically adapting to payment or shipping size determination, reducing customer effort and improving operational efficiency.
Smart Images

Figure 2026079094000001_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to a POS (Point of Sales) terminal, a control method, and a program.
Background Art
[0002] There may be a POS terminal in a store that identifies products and performs settlement processing based on an image of the products that a customer intends to purchase.
[0003] In addition, a customer may not only purchase products at a store but also bring in products to be shipped. In this case, the customer performs a shipping procedure at the store.
[0004] Patent Document 1 describes a dimension measurement system that measures the outer dimensions of a package placed in a storage room and calculates the cost required for home delivery.
Prior Art Documents
Patent Documents
[0005]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0006] The processing by a POS terminal may differ between when performing settlement of products and when performing a shipping procedure of products.
[0007] One object of the present disclosure is to provide a POS terminal or the like that can perform processing in an appropriate processing mode according to a product.
Means for Solving the Problems
[0008] A POS terminal in one aspect of this disclosure includes acquisition means for acquiring an image of a placed product, determination means for determining whether the process to be executed based on the image is a payment process for the product or a process for determining the delivery size of the product, and control means for switching to a mode according to the determination result.
[0009] A control method in one aspect of this disclosure acquires an image of the placed product, determines based on the image whether the process to be executed is a payment processing process for the product or a process to determine the shipping size of the product, and switches to a mode according to the determination result.
[0010] A program in one aspect of this disclosure acquires an image of the placed product, determines based on the image whether the process to be executed is a payment processing process for the product or a process to determine the shipping size of the product, and causes the computer to execute a process to switch to a mode according to the determination result.
[0011] Each program may be stored on a non-temporary storage medium that is readable by the computer. [Effects of the Invention]
[0012] One example of the effect of this disclosure is that it will become easier for customers to use coupons. [Brief explanation of the drawing]
[0013] [Figure 1] This figure shows an example of a system configuration including a POS terminal. [Figure 2] This is an example of a display screen showing product information for recommended products. [Figure 3] This is an example of a display screen showing product information for recommended products. [Figure 4] This is an example of a display screen showing product information for recommended products. [Figure 5] This is a flowchart showing the operation of a POS terminal. [Figure 6] This block diagram shows an example of a POS terminal configuration. [Figure 7]It is a flowchart showing the operation of the POS terminal. [Figure 8] It is a diagram showing an example of the hardware configuration of the POS terminal.
Embodiment for Implementing the Invention
[0014] Embodiments of the present disclosure will be described in detail with reference to the drawings.
[0015] [Embodiment] Referring to FIG. 1, a configuration example of a system including the POS terminal 10 will be described. FIG. 1 is a diagram showing an example of the configuration of a system including the POS terminal 10.
[0016] The POS terminal 10 is used in a store. The store is, for example, a convenience store. Examples of stores are not limited to this. The POS terminal 10 is, for example, a device capable of product identification and settlement processing. Here, the product includes the purchase product that the customer intends to purchase and the delivery item that the customer delivers. The purchase product that the customer intends to purchase is the product sold in the store. The delivery item that the customer delivers is the product that the customer brings into the store and undergoes the delivery procedure. The delivery procedure includes, for example, the procedure in which the store clerk measures the size of the delivery item. Also, the delivery procedure may include the procedure in which the customer pays the delivery fee. Further, the delivery procedure may include, for example, the procedure in which the customer prepares a form for delivery and attaches it to the delivery item.
[0017] Referring to FIG. 1, the POS terminal 10 is connected to the camera 90 and the display device 91 by a wired or wireless network.
[0018] The camera 90 is an imaging device capable of capturing images. The customer places the product on the placement location. The placement location is, for example, a counter or a table installed beside the POS terminal 10. The placement location is not limited to this. Then, the camera 90 is installed at a position where it can capture images of the placed product. The camera 90 is, for example, installed at a position where it can capture images of the placement location from above. The installation location of the camera 90 is not limited to this. The camera 90 may be installed, for example, at a position where it can capture images of the placement location from the side. Referring to FIG. 1, there is one camera 90 connected to the POS terminal 10. The number of cameras 90 is not limited. There may be multiple cameras 90 connected to the POS terminal 10. The multiple cameras may be respectively installed at positions where they can capture images of the placement location from different angles. The camera 90 may be installed at a necessary number of required locations according to the size of the placement location, etc.
[0019] The display device 91 is a device capable of displaying information about the product. The display device 91 is installed at a position where it can be confirmed by the person using the POS terminal 10. For example, when the customer uses the POS terminal 10, the customer checks the content displayed on the display device 91. Therefore, the display device 91 is installed at a position where the customer can confirm the display content. The display device 91 may be built into the POS terminal 10. Also, the display device 91 may be externally attached to the POS terminal 10.
[0020] Referring to FIG. 1, there is one display device 91 connected to the POS terminal 10. The number of display devices 91 is not limited. The display device 91 may be one or multiple. The display device 91 is, for example, a display. Also, the display device 91 can use a tablet terminal or a mobile terminal. The display device 91 is not limited to these.
[0021] Referring to FIG. 1, the configuration of the POS terminal 10 will be described. The POS terminal 10 includes an acquisition unit 101, a determination unit 102, a product identification unit 103, a measurement unit 104, a control unit 105, a decision unit 106, an output unit 107, and a settlement unit 108.
[0022] The acquisition unit 101 is one embodiment of an acquisition means for acquiring images of placed products. The acquisition unit 101 acquires images of products captured by the camera 90. The acquisition unit 101 may acquire multiple images from the camera 90. Also, if multiple cameras 90 are installed, the acquisition unit 101 may acquire multiple images. If multiple cameras 90 are installed, the acquisition unit 101 may acquire images of products captured from different angles. For example, the acquisition unit 101 can acquire multiple images captured from different angles, such as images of products captured from above, images of products captured from the side, and images of products captured from diagonally above. The acquisition unit 101 may acquire images captured by the camera 90 in real time.
[0023] The acquisition unit 101 may, for example, acquire an image of the product when it detects that the product has been placed in the placement area. The placement of the product may also be detected by a change in the product's weight, which is measured by the measurement unit 104 described later. Alternatively, the placement of the product may be detected by a customer operation. For example, after the customer places the product, they perform an operation on the POS terminal 10 to indicate that the product has been placed. The acquisition unit 101 may detect that the product has been placed in the placement area based on the customer's operation. The operation to indicate that the product has been placed may also be an operation by the customer to start using the POS terminal 10. The acquisition unit 101 detects that the product has been placed in the placement area. The acquisition unit 101 may then acquire an image of the product captured by the camera 90 at that time. The method of detecting that the product has been placed is not limited to these.
[0024] The determination unit 102 is one form of determination means that determines, based on the image, whether the process to be executed is a payment process for the product or a process for determining the shipping size of the product. The payment process for the product is the process in which the POS terminal 10 identifies the purchased product and performs payment. The customer can purchase the product by performing payment for the purchased product. The process for determining the shipping size for the product is the process of determining the shipping size of the item. Shipping size is a classification of the item being shipped. Shipping size is used, for example, when a shipping company determines the shipping fee. Shipping size is determined, for example, based on the size of the item being shipped. Examples of shipping sizes are "60 size," "80 size," and "100 size." These shipping sizes are determined, for example, based on the sum of the lengths of the three sides of the item being shipped. In addition, shipping size is determined based on the weight of the item being shipped. For example, the shipping size may differ depending on whether the weight of the item is below a predetermined weight or above a predetermined weight. The predetermined weight is determined in advance by the shipping company or the like.
[0025] The method by which the determination unit 102 determines which process to execute will be explained below.
[0026] The determination unit 102 can determine the processing to be executed based on the type of product. Here, the type of product refers to the product that the customer intends to purchase and the delivery item that the customer is having delivered. In other words, the determination unit 102 can determine the processing to be executed depending on whether the product captured in the image is a product to be purchased or a delivery item. If the product captured in the image is a product to be purchased, the determination unit 102 determines that the processing to be executed is the payment processing for the product. On the other hand, if the product captured in the image is a delivery item, the determination unit 102 determines that the processing to be executed is the processing to determine the delivery size of the product. The identification of the type of product may be performed by the product identification unit 103.
[0027] The product identification unit 103 is one form of product identification means that identifies the type of product based on an image of the product. As mentioned above, the type of product refers to the product that the customer intends to purchase and the delivery item that the customer is having delivered. Based on the image of the product, the product identification unit 103 can identify whether the product captured in the image is a purchased product or a delivery item.
[0028] An example of how the product identification unit 103 identifies the type of product is described below. The product identification unit 103 analyzes the product image acquired by the acquisition unit 101. The product identification unit 103 then extracts the characteristic points of the product captured in the image. The extracted characteristic points are compared with a pre-registered product database. Based on the comparison result, the product identification unit 103 identifies the type of product.
[0029] The product database contains information describing the characteristics of products sold in stores. This information may also be information that identifies the classification of the products sold in the store. Examples of classifications include plastic bottles and rice balls. Furthermore, this information may also be information that identifies individual products sold in the store.
[0030] The product identification unit 103 compares the feature points of the product captured in the image with the feature points of the product registered in the product database. If the extracted feature points are registered in the product database, the product identification unit 103 can identify the product captured in the image as a purchased product. On the other hand, if the extracted feature points are not registered in the product database, the product can be identified as a delivered item.
[0031] The information registered in the product database is not limited to these. The product database may also contain information indicating the characteristic features of the delivered items. The product identification unit 103 compares the characteristic features of the product captured in the image with the characteristic features of the delivered items registered in the product database. If the extracted characteristic features are registered in the product database as a result of the comparison, the product identification unit 103 can identify the product captured in the image as a delivered item. On the other hand, if the extracted characteristic features are not registered in the product database, the product can be identified as a delivered item.
[0032] An example of how the product identification unit 103 identifies the type of product is described below. The product identification unit 103 may identify the type of product using a trained image recognition model. The image recognition model is, for example, trained using images of products sold in a store. The product identification unit 103 inputs the product image acquired by the acquisition unit 101 into the image recognition model. The image recognition model then outputs the type of product captured in the image. The product identification unit 103 obtains information about the type of product as the output of the image recognition model. As a result, the product identification unit 103 can identify the type of product.
[0033] The method of identifying the type of product by the product identification unit 103 is not limited to this. The product identification unit 103 may also identify the type of product by combining the above-described identification methods.
[0034] The determination unit 102 can determine the process to be executed based on the number of items. If there are multiple items captured in the image, the determination unit 102 determines that the process to be executed is the payment process for the items. When a customer has multiple items to be delivered, they may perform the delivery procedure for each item individually. Therefore, if there are multiple items placed in the storage location, those items may be items that the customer intends to purchase. Thus, if there are multiple items, the determination unit 102 can determine that the process to be executed is the payment process for the items. In this case, the number of items is detected based on the image of the items. The detection of the number of items is performed, for example, by the item identification unit 103. The item identification unit 103 detects the number of items included in the image. Known object detection techniques can be used to detect the number of items.
[0035] If there is only one item captured in the image, the determination unit 102 may further determine the process to execute based on the weight of the item. If there is only one item captured in the image and its weight is greater than the weight of any other item being sold, the determination unit 102 may determine that the process to execute is the process of determining the shipping size of the item. If there is only one item placed in the placement location and its weight is greater than the weight of any other item being sold in the store, the placed item is a shipping item. Product data, including the weight of each item sold in the store, is managed in advance. Therefore, the determination unit 102 refers to the product data and compares the weight of the placed item with the weight of each item being sold in the store. If the weight of the placed item is greater than the weight of any other item being sold, the determination unit 102 determines that the process to execute is the process of determining the shipping size of the item. At this time, the weight of the item is measured by the measurement unit 104.
[0036] The measuring unit 104 is one embodiment of a measuring means for measuring the weight of a product. The measuring unit 104 can measure the weight of a placed product using, for example, a weight sensor installed at the placement location. The method for measuring the weight of a product is not limited to this.
[0037] If the image captures only one product, and the weight of that product is less than or equal to the weight of any of the products being sold, the determination unit 102 can determine the process to be executed based on the type of product.
[0038] The method by which the determination unit 102 determines which process to execute is not limited to this. The determination unit 102 may also determine which process to execute by combining the type of product and the weight of the product. For example, stores may sell packaging materials for shipping. Examples of packaging materials for shipping include shipping envelopes and cardboard boxes. However, packaging materials for shipping are not limited to these. In this case, it may be difficult for the product identification unit 103 to distinguish whether the placed product is packaging material being sold or a shipping item that uses packaging material. Therefore, the determination unit 102 may determine which process to execute based on the type of product and the weight of the product.
[0039] The product identification unit 103 identifies the type of product based on the product image. The measurement unit 104 measures the weight of the product. The determination unit 102 compares the weight of the identified product, as included in the product data, with the weight of the measured product. If the difference between the weight of the identified product and the weight of the measured product is greater than or equal to a predetermined value, the determination unit 102 determines that the process to be executed is the process of determining the shipping size of the product. On the other hand, if the difference between the weight of the identified product and the weight of the measured product is less than the predetermined value, the determination unit 102 determines that the process to be executed is the product payment process. Here, the predetermined value is the weight value that allows for the identification of whether the placed product is a product for sale or a delivery item. The predetermined value is set in advance.
[0040] Let's take the example of a shipping envelope. In this case, if the difference between the weight of the envelope as a product being sold and the measured weight is greater than or equal to a predetermined value, the envelope may contain something. In other words, the placed product may be a delivery item. The determination unit 102 determines that the process to be executed is the process of determining the shipping size of the product. However, if the difference between the weight of the envelope as a product being sold and the measured weight is less than the predetermined value, the envelope may be empty. In other words, the placed product may be a product that a customer intends to purchase. Therefore, the determination unit 102 determines that the process to be executed is the payment process for the product.
[0041] The control unit 105 is one form of control means that switches to a mode according to the determination result. The control unit 105 switches the operating mode of the POS terminal 10 according to the determination result by the determination unit 102. If the process to be executed is the process of determining the shipping size of the product, the control unit 105 switches to the shipping size determination mode. The mode for executing the process of determining the shipping size of the product is the shipping size determination mode. Also, if the process to be executed is the payment process for the product, the control unit 105 switches to the product identification mode. The mode for executing the payment process for the product is the product identification mode.
[0042] The shipping size determination mode and the product identification mode will be explained separately.
[0043] The determination unit 106 is one embodiment of a determination means that determines the shipping size based on an image of the product in the shipping size determination mode. The determination unit 106 determines the shipping size based on an image of the product acquired by the acquisition unit 101. The determination unit 106 determines the shipping size based on the size of the product measured from the image of the product. As mentioned above, shipping size is a classification of the shipped item. Shipping size is determined, for example, based on the size of the shipped item. Specifically, shipping size is determined based on the sum of the lengths of the three sides of the shipped item. For each shipping size, a reference range for the sum of the lengths of the three sides that corresponds to that shipping size is predetermined. Then, the shipping size is determined according to which shipping size reference range the measured sum of the lengths of the three sides belongs to. For example, the reference range for "60 size" is a sum of the lengths of the three sides of 60 cm or less, and the reference range for "80 size" is 80 cm. In this case, if the measured sum of the lengths of the three sides of the shipped item is 65 cm, the shipping size of the shipped item is "80 size". Examples of shipping size reference ranges are not limited to this.
[0044] The measuring unit 104 measures the size of the product using the image of the product acquired by the acquisition unit 101. The acquisition unit 101 acquires an image of the product captured by a camera 90 capable of capturing the placement area from above. The measuring unit 104 can then measure the size of the product using the image acquired by the acquisition unit 101. The measuring unit 104 measures the lengths of the three sides of the product as the size of the product. The lengths of the three sides of the product are, for example, the vertical and horizontal lengths of the top surface of the product when placed on the placement area, and the height of the product. In the image captured by the camera 90 capable of capturing the placement area from above, the lengths of the three sides of the product are the vertical and horizontal lengths of the top surface of the product, and the depth of the product.
[0045] The method for measuring the size of a product using the measuring unit 104 will now be explained. The measuring unit 104 can measure the size of a product using known image processing techniques. For example, a length reference is set up in advance at the placement location. The measuring unit 104 can then measure the lengths of the three sides of the product based on the correspondence between the product captured in the image and the length reference. The method for measuring the size of a product is not limited to this.
[0046] The measuring unit 104 may measure the size of the product using multiple images acquired by the acquisition unit 101. The POS terminal 10 may be connected to multiple cameras 90. The multiple cameras are each installed in positions that allow them to capture images of the placement area from different angles. Therefore, the measuring unit 104 can measure the size of the product using images of the product captured from multiple angles.
[0047] Furthermore, the measuring unit 104 may decide to request a change in the placement of the product if there are sides that are difficult to measure in length. Difficulties in measuring length include, for example, cases where part of the product is hidden or where the length of all sides of the product cannot be measured. Difficulties in measuring length are not limited to these cases, but may also include cases where part or all of the product is not included in the range that the camera can capture. In such cases, the measuring unit 104 decides to request the customer to change the placement of the product. Changing the placement of the product means changing the placement so that the sides that are difficult to measure can be measured. Changing the placement of the product includes, for example, rotating the product and moving the position where the product is placed. Rotating the product includes horizontal and vertical rotation with respect to the placement location. Changing the placement of the product is not limited to these. If the measuring unit 104 decides to request a change in the placement of the product, the output unit 107, described later, outputs a request to change the placement of the product. The output of the request to change the placement will be explained later. When the placement of the product is changed, the acquisition unit 101 acquires a newly captured image of the product. Then, the measuring unit 104 measures the size of the product using the image of the product acquired by the acquisition unit 101.
[0048] Furthermore, if there are sides where measuring the length is difficult, the measuring unit 104 may specify a camera 90 to capture an image of the product. For example, the acquisition unit 101 acquires an image captured by a camera installed in a position that allows it to capture the placement area from above. However, if there are sides where measuring the length using that image is difficult, the measuring unit 104 may decide to use a different camera than the one that captured the image. The measuring unit 104 can specify a different camera than the one that captured the image as the camera 90 to capture an image of the product.
[0049] The measuring unit 104 identifies sides that are difficult to measure in length from an image captured by a camera positioned to capture the placement area from above. The measuring unit 104 can then determine which camera 90 is a different camera 90 that is positioned to capture the identified side. At this time, information regarding the installation positions of all cameras 90 and the angle at which they capture the placement area is pre-registered. The measuring unit 104 can then determine which camera 90 is capable of capturing the side that is difficult to measure in length, based on the information regarding its installation position and the angle at which it captures the placement area. The acquisition unit 101 then acquires an image of the product captured by the determined camera 90. The method of determining the camera is not limited to this.
[0050] In the shipping size determination mode, the determination unit 106 further determines the shipping size based on the weight of the product. The shipping size may be determined based on the sum of the lengths of the three sides of the product and the weight of the product. For each shipping size, a standard range for the sum of the lengths of the three sides and a standard range for the weight of the product that corresponds to that shipping size are predetermined. For example, "60 size" means that the sum of the lengths of the three sides of the product is 60 cm or less, and the weight is 2 kg or less. Therefore, the determination unit 106 determines the shipping size of the product to be the shipping size for which the measured sum of the lengths of the three sides of the product and the weight of the product fall within the standard range. Examples of standard ranges for shipping sizes are not limited to this.
[0051] The measuring unit 104 measures the size of the product. The measuring unit 104 also measures the weight of the product. Then, the determination unit 106 can determine the shipping size based on the size and weight of the product measured by the measuring unit 104.
[0052] The output unit 107 is one embodiment of an output means for outputting information regarding the shipping size. The output unit 107 outputs information regarding the shipping size determined by the determination unit 106. The information regarding the shipping size may include the sum of the lengths of the three sides of the product. The information regarding the shipping size may also include the weight of the product. The information regarding the shipping size is not limited to these. The information regarding the shipping size may include, for example, the shipping fee determined by the settlement unit 108, which will be described later.
[0053] The output unit 107 outputs information regarding the delivery size to, for example, the display device 91. The display device 91 displays the information regarding the delivery size on its screen. As a result, the customer can confirm the determined delivery size via the screen of the display device 91.
[0054] Figure 2 illustrates an example of a screen displaying information about the shipping size. Figure 2 shows an example of a screen displaying information about the shipping size. Referring to Figure 2, the screen displays the shipping size determined by the determination unit 106, and may also display the shipping fee corresponding to the shipping size. The method for determining the shipping fee will be explained later. The information displayed on the screen is not limited to this. For example, the screen may display an image of the product acquired by the acquisition unit 101. The screen may also display the size and weight of the product measured by the measurement unit 104. By looking at the example shown in Figure 2, the customer can recognize the determined shipping size.
[0055] The output unit 107 may output information regarding the delivery size to an audio output device (not shown). The output unit 107 may also output information regarding the delivery size to a printing device (not shown). The printing device can, for example, print information regarding the delivery size. The customer can then check the delivery size by looking at the printed document. The destinations for outputting information regarding the delivery size are not limited to these.
[0056] The output unit 107 may output a screen that displays the delivery size set in advance by the customer and the determined delivery size. For example, a customer may set the delivery size of their items before coming to the store. However, the delivery size set by the customer may differ from the determined delivery size. Therefore, the output unit 107 may output a screen that displays the delivery size set in advance by the customer and the determined delivery size. By outputting a screen that displays the delivery size set in advance by the customer and the determined delivery size, the customer can recognize that the delivery size set in advance and the determined delivery size are different. The output unit 107 may also output a screen that displays the delivery size set in advance by the customer and the determined delivery size even if they are the same.
[0057] Here, the shipping size pre-set by the customer is acquired by the acquisition unit 101. The acquisition unit 101 can acquire the shipping size pre-set by the customer through customer input. The customer can input the shipping size, for example, using the touch panel of the display device 91. The acquisition unit 101 can also acquire information about the shipping size pre-set by the customer from a barcode or two-dimensional code. If the customer is using a flea market service, the customer may have pre-set the shipping size through the flea market service. In the flea market service, a barcode or two-dimensional code containing information about the shipping size may be generated. Therefore, the acquisition unit 101 can acquire information about the shipping size pre-set by the customer by reading the barcode or two-dimensional code. The method of acquiring the shipping size pre-set by the customer is not limited to these.
[0058] The output unit 107 may display a screen to the display device 91 requesting the customer's consent to change the delivery size if the delivery size set by the customer differs from the determined delivery size. Figure 3 shows an example of a screen requesting consent to change the delivery size. Referring to Figure 3, the screen requesting consent to change the delivery size displays the delivery size set by the customer and the determined delivery size. The screen also displays the delivery fee for the delivery size set by the customer and the delivery fee for the determined delivery size. Furthermore, the screen requesting consent to change the delivery size displays a consent button to accept the change. When the customer presses the consent button, the delivery size is changed.
[0059] The content displayed on the screen requesting acceptance of a change in shipping size is not limited to these. The screen requesting acceptance of a change in shipping size may also display the difference between the shipping fee for the shipping size set by the customer and the shipping fee for the determined shipping size. The screen requesting acceptance of a change in shipping size may also display a reject button to refuse the change in shipping size. The screen requesting acceptance of a change in shipping size may also display an exit button to end the operation of the POS terminal 10. If the reject button or the exit button is pressed, the shipping size does not have to be changed from the shipping size set by the customer.
[0060] The output unit 107 may output a request to change the placement of the product if the measurement unit 104 decides to request a change in the placement of the product. The output unit 107 may also display a screen on the display device 91 requesting the customer to change the placement of the product. Figure 4 is an example of a screen requesting a change in the placement of the product. The screen requesting a change in the placement of the product displays an image of the product acquired by the acquisition unit 101. The screen also displays instructions to the customer on how to change the placement of the product. In the example shown in Figure 4, the customer is asked to rotate the product and reposition it. The information displayed on the screen requesting a change in the placement of the product is not limited to this.
[0061] The output unit 107 may output an instruction to the customer to place either the purchased product or the delivered item when the purchased product and the delivered item are placed in the placement location. When the determination unit 102 determines the type of product, if the product includes both the purchased product and the delivered item, the output unit 107 outputs an instruction to place either the purchased product or the delivered item. The output unit 107 can, for example, display an instruction to place either the purchased product or the delivered item on the screen of the display device 91. The customer can see the screen displaying the instruction to place either the purchased product or the delivered item. The customer then places the purchased product or the delivered item in the placement location. The acquisition unit 101 then acquires a new image of the product. At this time, the product is the purchased product or the delivered item placed by the customer.
[0062] The output unit 107 may print a form used for shipping the goods. The form is a printed document on which information necessary for shipping is printed. This information may include, for example, the shipping address, the shipping origin address, and the shipping size. The information may also include the weight of the goods. However, the information necessary for shipping is not limited to these. The form may also have a barcode or two-dimensional code printed on it that corresponds to the shipping address, shipping origin address, and shipping size. The shipping size printed on the form is the shipping size determined by the determination unit 106.
[0063] The output unit 107 outputs the information necessary for delivery to, for example, a printing device. The printing device prints a form containing at least some of the information necessary for delivery. The form is attached to the delivery item, for example.
[0064] The settlement unit 108 is one form of a settlement means that processes the settlement of shipping charges according to the size of the shipment. The settlement unit 108 determines the shipping charges corresponding to the size of the shipment determined by the determination unit 106. Then, the settlement unit 108 performs settlement processing for the shipping charges. Information regarding the determined shipping charges may be output to the display device 91 by the output unit 107. The customer can then confirm the shipping charges displayed on the screen of the display device 91.
[0065] Here, shipping fees are predetermined according to the shipping size. The settlement unit 108 determines the shipping fee by referring to a shipping fee list, for example, which associates shipping size with shipping fee. The shipping fee list may include shipping fees from multiple shipping companies. Also, shipping fees may vary depending on the shipping distance. Shipping distance is the distance between the shipping origin and the shipping destination. The shipping destination and shipping origin may be addresses or regions. The shipping fee list may have shipping fees set according to the shipping distance. The shipping fees included in the shipping fee list are not limited to these.
[0066] The settlement unit 108 may request the customer to specify a delivery company when determining the shipping fee corresponding to the delivery size. In this case, the output unit 107 may output a screen requesting the customer to specify a delivery company to the display device 91. The settlement unit 108 can determine the shipping fee corresponding to the delivery size using the delivery company specified by the customer. The settlement unit 108 may also request the customer to specify a delivery destination. In this case, the output unit 107 may output a screen requesting the customer to specify a delivery destination to the display device 91. The settlement unit 108 can determine the shipping fee corresponding to the delivery size based on the distance between the delivery source and the delivery destination specified by the customer. The settlement unit 108 may also request the customer to specify a delivery distance. In this case, the output unit 107 may output a screen requesting the customer to specify a delivery distance to the display device 91. The settlement unit 108 may determine the shipping fee corresponding to the delivery size based on the delivery distance. The method of requesting and accepting specifications for the delivery company, delivery destination, or delivery distance is not limited to these. These are not the only ways to determine shipping fees.
[0067] The payment unit 108 performs payment processing for the determined shipping fee. Payment methods include cash, credit card, electronic money, and code payment. However, payment methods are not limited to these, and any known payment method may be used. For example, store points or coupons may be used as payment methods. Customers can pay for shipping using their preferred payment method. The output unit 107 may, for example, output a screen to the display device 91 requesting the customer to select a payment method. The customer can select the payment method to be used from the options displayed on the display device 91 screen. The payment unit 108 can perform payment processing using the payment method selected by the customer.
[0068] Now, let's explain the mode switching by the control unit 105 again.
[0069] The control unit 105 switches to product identification mode when the process to be executed is product payment processing. Product identification mode is the mode for executing product payment processing. In product identification mode, the POS terminal 10 identifies the product that the customer intends to purchase and processes the payment for that product. In product identification mode, the customer can make a payment for the product they intend to purchase.
[0070] The product identification unit 103 identifies a product based on its image. In product identification mode, the product is the product the customer intends to purchase. Therefore, the product identification unit 103 identifies the purchased product. If there are multiple purchased products, the product identification unit 103 identifies each purchased product. The method for identifying purchased products can be the method described above. For example, the product identification unit 103 extracts feature points of the product from its image. Then, the product identification unit 103 can identify the purchased product by referring to a product database. Alternatively, the product identification unit 103 may identify the purchased product using an image recognition model that has been trained on products sold in stores. The methods for identifying products by the product identification unit 103 are not limited to these. Furthermore, when determining the processing to be executed by the determination unit 102, if the product identification unit 103 has identified an individual product, the identification result by the product identification unit 103 may be used in product identification mode.
[0071] The output unit 107 outputs information about the identified purchased items. This information includes the product name, price, and quantity. The output unit 107 can output the information about the purchased items to the display device 91. The customer can then view the information about the purchased items displayed on the display device 91.
[0072] The settlement unit 108 performs settlement processing for the purchased goods. Settlement processing is performed for the total amount of the purchased goods. The settlement processing is as described above. At this time, the output unit 107 may output settlement-related information to, for example, the display device 91.
[0073] Referring to Figure 5, the operation of the POS terminal 10, which includes an acquisition unit 101, a determination unit 102, a product identification unit 103, a measurement unit 104, a control unit 105, a decision unit 106, an output unit 107, and a payment unit 108, will be explained. Figure 5 is a flowchart showing an example of the operation of the POS terminal 10. First, in step S101, the acquisition unit 101 acquires an image of the placed product. In step S102, the determination unit 102 determines, based on the image, whether the process to be executed is a product delivery size determination process or not. In other words, the determination unit 102 determines, based on the image, whether the process to be executed is a product payment process or a product delivery size determination process.
[0074] If the answer in step S102 is Yes, in step S103 the control unit 105 switches to the shipping size determination mode. Then, in step S104 the measuring unit 104 measures the size of the product using an image of the product. In step S105 the determination unit 106 determines the shipping size based on the size of the product. In step S106 the payment unit 108 performs the payment processing for the shipping fee according to the shipping size. Then the POS terminal 10 terminates its operation.
[0075] If the answer in step S102 is No, then in step S107, the control unit 105 switches to product identification mode. Then, in step S108, the product identification unit 103 identifies the type of product based on the product image. In step S109, the payment unit 108 executes the payment process for the product. Then, the POS terminal 10 terminates its operation.
[0076] In this embodiment, the POS terminal 10's determination unit 102 determines, based on the product image, whether the process to be executed is product payment processing or product shipping size determination processing. The control unit 105 then switches to a mode according to the determination result. If the process to be executed is product shipping size determination processing, the control unit 105 switches to shipping size determination mode. If the process to be executed is product payment processing, the control unit 105 switches to product identification mode. The processing performed by the POS terminal 10 may differ depending on whether it is product payment processing or product shipping processing. Therefore, the configuration of the POS terminal 10 makes it possible to perform processing in an appropriate operating mode according to the product.
[0077] In a store, customers may not only purchase goods but also bring items they wish to ship. In this case, store staff may assist customers with shipping procedures at the store. The store may have a POS terminal 10 that identifies products based on images of the items the customer intends to purchase and processes payments. By having the POS terminal 10 determine the shipping size of the items, the effort required of store staff for shipping procedures can be reduced. Furthermore, when the customer places the items in the designated area, the POS terminal 10 switches to the appropriate mode, further reducing customer effort. In the POS terminal 10, a determination unit 102 determines the processing to be performed based on the product image, and a control unit 105 switches to a mode corresponding to the determination result. This configuration of the POS terminal 10 enables processing in the appropriate processing mode for each product. As a result, for example, processing is performed in the appropriate mode without the customer having to perform mode selection or other operations. This improves customer convenience.
[0078] In this embodiment, the POS terminal 10's determination unit 102 determines the processing to be performed based on the type of product. The type of product refers to the product the customer intends to purchase and the delivery item the customer is having delivered. The processing performed by the POS terminal 10 may differ depending on whether it is set up for payment of a purchased product or for processing a delivery item. Therefore, by having the determination unit 102 determine the processing to be performed based on the type of product, the POS terminal 10 can perform processing in an appropriate processing mode according to the product.
[0079] Furthermore, the POS terminal 10's product identification unit 103 identifies the type of product based on an image of the product. When a customer places a product on the designated area, the camera 90 captures an image of the product. The acquisition unit 101 then acquires the image of the product placed on the designated area. The determination unit 102 determines the processing to be performed based on the image of the product. Therefore, for example, processing is performed in the appropriate mode without the customer having to perform operations such as mode selection, thus reducing the effort required from the customer.
[0080] In this embodiment, the POS terminal 10 has a measuring unit 104 that measures the weight of the product, and a determination unit 102 that determines the process to be executed based on the type and weight of the product. In stores, for example, packaging materials for delivery may be sold. In this case, it may be difficult for the product identification unit 103 to determine whether the placed product is packaging material being sold or a delivery item using the packaging material. In other words, it may be difficult for the product identification unit 103 to identify the type of product. Therefore, by having the determination unit 102 determine the process to be executed based on the type and weight of the product, the accuracy of the determination can be improved.
[0081] In this embodiment, the POS terminal 10 has a measuring unit 104 that measures the size of the product based on an image of the product, and a determination unit 106 that determines the shipping size based on the size of the product. The shipping size is determined, for example, based on the size of the item being shipped. Specifically, the shipping size is determined based on the sum of the lengths of the three sides of the item being shipped. Therefore, the measuring unit 104 measures the size of the product using an image of the product acquired by the acquisition unit 101. Then, the determination unit 106 determines the shipping size based on the size of the product, thereby determining an appropriate shipping size. Furthermore, since the shipping size is determined based on an image of the product, for example, store staff may not need to measure the size of the item being shipped. In other words, it is possible to reduce the effort required for store staff in handling shipping procedures.
[0082] In this embodiment, the POS terminal 10's determination unit 106 determines the shipping size based on the size and weight of the product. The shipping size may be determined based on the size and weight of the product. For example, for each shipping size, a standard range for the sum of the lengths of the three sides and a standard range for the weight of the product corresponding to that shipping size are predetermined. Therefore, the measuring unit 104 measures the size and weight of the product, and the determination unit 106 determines the shipping size based on the size and weight of the product, thereby determining an appropriate shipping size. In addition, for example, store employees may not need to measure the size and weight of the shipped items. In other words, it is possible to reduce the effort required for store employees in handling shipping procedures.
[0083] In this embodiment, the POS terminal 10 has a payment unit 108 that processes the payment of shipping fees according to the size of the shipment. When a customer brings a shipment to a store, they may pay the shipping fee at the store. In this case, a store employee may handle the payment of the shipping fee. However, by having the payment unit 108 process the payment of shipping fees according to the size of the shipment, it may become unnecessary for a store employee to handle the transaction. In other words, it is possible to reduce the amount of work that store employees have to do for shipping procedures.
[0084] In this embodiment, the POS terminal 10 has an output unit 107 that outputs information regarding the delivery size. Delivery charges may vary depending on the delivery size. Therefore, customers may want to know the determined delivery size. To this end, the output unit 107 outputs information regarding the delivery size to, for example, a display device 91, an audio output device, or a printing device. Since the output unit 107 outputs information regarding the delivery size, customers can find out the delivery size.
[0085] [Second Embodiment] The second embodiment will be described in detail with reference to the drawings. To the extent that the description of this embodiment remains clear, any information that overlaps with the previous description will be omitted.
[0086] The configuration of the POS terminal 20 will be described with reference to Figure 6. Figure 6 is a block diagram showing an example of the configuration of the POS terminal 20. The POS terminal 20 comprises an acquisition unit 201, a determination unit 202, and a control unit 203.
[0087] The acquisition unit 201 is one embodiment of an acquisition means for acquiring an image of a placed product. The acquisition unit 201 acquires an image of the product captured by the camera 90.
[0088] The determination unit 202 is one form of determination means that determines, based on the image, whether the process to be executed is a payment processing process for the product or a process to determine the shipping size of the product. The payment processing for the product is the process in which the POS terminal 20 identifies the purchased product and performs payment. The process to determine the shipping size of the product is the process to determine the shipping size of the item.
[0089] The determination unit 202 can determine the process to be executed based on the type of product. The determination unit 202 may also determine the process to be executed based on the number of products. Furthermore, the determination unit 202 can determine the process to be executed based on the weight of the products. The method used by the determination unit 202 to determine the process to be executed is not limited to these. The determination unit 202 may also determine the process to be executed by combining the type of product and the weight of the products.
[0090] The control unit 203 is one form of control means that switches to a mode according to the determination result. The control unit 203 switches the operating mode of the POS terminal 20 according to the determination result by the determination unit 202. If the process to be executed is the process of determining the shipping size of the product, the control unit 203 switches to the shipping size determination mode. The mode for executing the process of determining the shipping size of the product is the shipping size determination mode. Also, if the process to be executed is the process of settling the payment for the product, the control unit 203 switches to the product identification mode. The mode for executing the payment for the product is the product identification mode.
[0091] Referring to Figure 7, the operation of the POS terminal 20, which includes an acquisition unit 201, a determination unit 202, and a control unit 203, will be explained. Figure 7 is a flowchart showing the operation of the POS terminal 20. First, in step S101, the acquisition unit 201 acquires an image of the placed product. In step S102, the determination unit 202 determines, based on the image, whether the process to be executed is a product delivery size determination process or not. In other words, the determination unit 202 determines, based on the image, whether the process to be executed is a product payment process or a product delivery size determination process. Then, in step S203, the control unit 203 switches to a mode according to the determination result. Then, the POS terminal 20 terminates its operation.
[0092] In this embodiment, the POS terminal 20's determination unit 202 determines, based on the product image, whether the process to be executed is product payment processing or product shipping size determination processing. The control unit 203 then switches to a mode according to the determination result. If the process to be executed is product shipping size determination processing, the control unit 203 switches to shipping size determination mode. If the process to be executed is product payment processing, the control unit 203 switches to product identification mode. The processing performed by the POS terminal 20 may differ depending on whether it is product payment processing or product shipping processing. Therefore, the configuration of the POS terminal 20 makes it possible to perform processing in an appropriate operating mode according to the product.
[0093] [Example Hardware Configuration] Figure 8 shows an example of the hardware configuration of the POS terminal 30 in this disclosure. The POS terminal 30 is implemented using a computer. The POS terminal 30 is an example of a case where the POS terminal 10 or POS terminal 20 is implemented using a computer.
[0094] The POS terminal 30 includes a processor 301, ROM (Read Only Memory) 302, RAM (Random Access Memory) 303, a storage device 304 such as a hard disk for storing programs, an input / output interface 305 for data input and output, and a communication interface 306 for network connection. Each component is connected via a bus 307.
[0095] The processor 301 controls the entire computer by running the operating system. Examples of the processor 301 include a CPU (Central Processing Unit), a DSP (Digital Signal Processor), and a GPU (Graphics Processing Unit). The processor 301 loads programs stored in, for example, a ROM 302 or a storage device 304. Then, the processor 301 executes each process coded in the program. The processor 301 may execute processes or instructions in the flowchart shown based on the program.
[0096] ROM 302 stores application programs, programs related to each embodiment, etc. RAM 303 is used as the work area of processor 301.
[0097] The storage device 304 may be, for example, a semiconductor memory such as flash memory, or a hard disk drive (HDD). The storage device 304 stores, for example, OS (Operating System) programs, application programs, programs according to each embodiment, and so on.
[0098] The input / output interface 305 is connected to peripheral devices (not shown). The connection method may be a wired network or a wireless network.
[0099] The communication interface 306 is connected to a communication network (not shown), such as a LAN (Local Network) or WAN (Wide Area Network), via a wireless or wired network. The communication network may consist of multiple communication networks. This allows the computer to connect to external devices via the communication network. The POS terminal 30 may have components other than those shown in Figure 8. For example, the POS terminal 30 may have a drive device. For instance, the processor 301 may be mounted on a drive device or the like and read programs and data stored on a non-temporary tangible recording medium into the RAM 303.
[0100] Although the present disclosure has been described above with reference to embodiments, the present disclosure is not limited to the embodiments described above. Various modifications to the configuration and details of the present disclosure are possible, as can be understood by those skilled in the art within the scope of the present disclosure. Furthermore, the configurations in each embodiment can be combined with one another, as long as they do not depart from the scope of the present disclosure.
[0101] Some or all of the above embodiments may also be described as follows, but are not limited to the following:
[0102] (Note 1) A means for acquiring images of the placed products, A determination means that determines whether the process to be executed based on the aforementioned image is the payment process for the product or the process for determining the shipping size of the product, A control means that switches to a mode according to the judgment result, A POS (Point of Sales) terminal equipped with [features / equipment].
[0103] (Note 2) The system further comprises product identification means for identifying the type of product based on the aforementioned image, The determination means determines the processing based on the type. The POS terminal described in Appendix 1.
[0104] (Note 3) The system further comprises a measuring means for measuring the weight of the aforementioned product, The determination means determines the process based on the weight. The POS terminal described in Appendix 2.
[0105] (Note 4) The control means switches to the delivery size determination mode if the process is the process for determining the delivery size of the product. A POS terminal as described in any one of the notes 1 through 3.
[0106] (Note 5) A measuring means for measuring the size of the product based on the aforementioned image, The delivery size determination mode further comprises determination means for determining the delivery size based on the dimensions, The POS terminal described in Appendix 4.
[0107] (Note 6) The measuring means further measures the weight of the product, The determination means further determines the shipping size based on the weight. The POS terminal described in Appendix 5.
[0108] (Note 7) The system further includes a payment method for processing payment of shipping charges according to the aforementioned shipping size. A POS terminal as described in any one of the appendices 4 through 6.
[0109] (Note 8) The system further includes an output means for outputting information regarding the delivery size. A POS terminal as described in any one of the appendices 4 through 6.
[0110] (Note 9) Retrieve the image of the placed product, Based on the aforementioned image, it is determined whether the process to be executed is the payment processing for the product or the process to determine the shipping size of the product. Switch to the mode according to the judgment result. Control method.
[0111] (Note 10) Retrieve the image of the placed product, Based on the aforementioned image, it is determined whether the process to be executed is the payment processing for the product or the process to determine the shipping size of the product. Switch to the mode according to the judgment result. A program that instructs a computer to perform a process.
[0112] (Note 11) Retrieve the image of the placed product, Based on the aforementioned image, it is determined whether the process to be executed is the payment processing for the product or the process to determine the shipping size of the product. Switch to the mode according to the judgment result. A recording medium that stores programs that cause a computer to perform a process.
[0113] Some or all of the configurations described in Appendix 2-8, which are dependent on Appendix 1 above, may also be dependent on Appendix 9-11 in the same manner as with Appendix 2-8. Not limited to Appendix 1 and 9-11, some or all of the configurations described as appendices may also be dependent on various hardware, software, various recording devices or systems for recording software, without departing from the embodiments described above. [Explanation of Symbols]
[0114] 10, 20, 30 POS terminals 101, 201 Acquisition Department 102, 202 Judgment section 103 Product Identification Section 104 Measuring section 105, 203 Control Unit 106 Decision Section 107 Output section 108 Payment Department 301 Processor 302 ROM 303 RAM 304 Storage device 305 Input / Output Interface 306 Communication Interface 307 Bus 90 Camera 91 Display device
Claims
1. A means for acquiring images of the placed products, A determination means that determines whether the process to be executed based on the aforementioned image is the payment process for the product or the process for determining the shipping size of the product, A control means that switches to a mode according to the judgment result, A POS (Point of Sales) terminal equipped with [a specific feature].
2. The system further comprises product identification means for identifying the type of product based on the aforementioned image, The determination means determines the processing based on the type. The POS terminal according to claim 1.
3. The system further comprises a measuring means for measuring the weight of the aforementioned product, The determination means determines the process based on the weight. The POS terminal according to claim 2.
4. The control means switches to the delivery size determination mode if the process is the process for determining the delivery size of the product. The POS terminal according to claim 1.
5. A measuring means for measuring the size of the product based on the aforementioned image, The delivery size determination mode further comprises determination means for determining the delivery size based on the dimensions, The POS terminal according to claim 4.
6. The measuring means further measures the weight of the product, The determination means further determines the shipping size based on the weight. The POS terminal according to claim 5.
7. The system further includes a payment method for processing payment of shipping charges according to the aforementioned shipping size. A POS terminal according to any one of claims 4 to 6.
8. The system further includes an output means for outputting information regarding the delivery size. A POS terminal according to any one of claims 4 to 6.
9. Retrieve the image of the placed product, Based on the aforementioned image, it is determined whether the process to be executed is the payment processing for the product or the process to determine the shipping size of the product. Switch to the mode according to the judgment result. Control method.
10. Retrieve the image of the placed product, Based on the aforementioned image, it is determined whether the process to be executed is the payment processing for the product or the process to determine the shipping size of the product. Switch to the mode according to the judgment result. A program that instructs a computer to perform a process.