Label issuing device and program
By integrating image matching and confirmation functions in the label issuing equipment, the operator's error problem is solved when labeling is applied, the label is accurately placed, and the operation accuracy and reliability are improved.
Patent Information
- Application Number
- JP2023185559
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-10-30
- Publication Date
- 2025-05-14
AI Technical Summary
In the prior art, it is not possible to effectively prevent operators from making mistakes in labeling, especially for unfamiliar workers, which are prone to sticking labels on the wrong products.
A label distribution device and program is designed, which includes the function of calling registered images, the function of shooting products, the image inspection function, the label image inspection function and the label distribution function. Through these functions, the device can confirm whether the captured image matches the registered image and output the tag after confirmation.
It effectively prevents operators from mistakes when labeling, ensures that the labels are accurately attached to the corresponding products, and improves the accuracy and reliability of operations.
Smart Images

Figure 2025074616000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a label issuing device and a program. [Background technology]
[0002] In the back yard of a store, workers are required to use a label issuing device that issues labels to be affixed to various products or product containers, and to affix corresponding labels appropriately to the products. For example, Patent Document 1 describes a technology that prompts users to confirm the items to be printed before printing. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2016-218947 A Summary of the Invention [Problem to be solved by the invention]
[0004] The technology described in Patent Document 1 uses a message to prompt the user to confirm the items to be printed, but inexperienced workers may end up sticking a label on the wrong product.
[0005] The present invention has been made in consideration of the above circumstances, and has an object to provide a label issuing device and program that can prevent errors in labeling and prompt an operator to apply an appropriate label that accurately corresponds to a product. [Means for solving the problem]
[0006] The label issuing device of the present invention has at least the following configuration. The label issuing device comprises a calling means for calling up a registered image from a memory means for storing a registered image of an item, a photographing means for photographing an item placed in a placement area, an image confirmation means for confirming whether the registered image and the image photographed by the photographing means are correct, a label image confirmation means for confirming a label image of the item, and a label issuing means, wherein the label issuing means issues a label when confirmation by the image confirmation means and confirmation by the label image confirmation means have been performed.
[0007] The program of the present invention has at least the following configuration. The program causes a computer of a label issuing device which includes a calling means for calling up a registered image from a memory means which stores a registered image of an item, a photographing means for photographing an item placed on a placement area, an image confirming means for confirming whether the image photographed by the photographing means is correct, a label image confirming means for confirming the label image of the item, and a label issuing means to execute an image confirming step for confirming whether the image photographed by the photographing means is correct, a label image confirming step for confirming the label image of the item after the image confirming step has confirmed that the image is correct, and a label issuance control step for outputting a label issuance command after the label image confirming step. Effect of the Invention
[0008] According to the present invention, it is possible to prevent erroneous labeling and to encourage workers to attach appropriate labels that accurately correspond to products. [Brief description of the drawings]
[0009] [Figure 1] 1 is a perspective view showing an external configuration of a label issuing device according to an embodiment of the present invention. [Diagram 2] 1 is a block diagram showing a functional configuration of a label issuing device according to an embodiment of the present invention. [Diagram 3] FIG. 4 is a flow chart showing an example of an operation and process in the label issuing device according to the embodiment of the present invention. [Figure 4] FIG. 11 is a flow diagram showing an example of operations and processes in the label issuing device according to the embodiment of the present invention, and is a flow diagram showing exception processing when products do not match. [Diagram 5] FIG. 5 is an image diagram showing an example of a product and label confirmation screen displayed by a label issuing device in an embodiment of the present invention, where FIG. 5(a) shows the case where an appropriate product has been placed, and FIG. 5(b) shows the case where an inappropriate product has been placed. [Figure 6] 11A to 11C are image diagrams showing an example of a product and label confirmation screen displayed by the label issuing device according to the embodiment of the present invention, illustrating screen transitions that accompany the progress of the confirmation process. [Figure 7] 13A to 13C are image diagrams showing another example of a product and label confirmation screen displayed by the label issuing device according to the embodiment of the present invention, illustrating screen transitions that accompany the progress of the confirmation process. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] <Label issuing device configuration> Hereinafter, an embodiment of the present invention will be described with reference to the drawings. Fig. 1 is a perspective view showing the external configuration of a label issuing device 1 in this embodiment. This label issuing device 1 is a device that is installed, for example, in the back yard of a store and issues labels to be affixed to various products or product containers, and is configured by installing an operation display unit 13 (touch panel) on the top surface of a base 10, installing a printing mechanism unit 17 (label issuing port) on the front surface of the base 10, and further connecting a weighing unit 30 (a scale for weighing products), a barcode reader (not shown), etc. with a cable (which may be wireless).
[0011] FIG. 2 is a block diagram showing the functional configuration of the label issuing device 1 in this embodiment. The label issuing device 1 includes an operation display unit 13, a control unit 20, a weighing unit 30, a printing unit 40, and an image capture unit 50. A barcode reader 60 is also connected to the operation display unit 13 (touch panel). The operation display unit 13 includes a liquid crystal display unit 13a and an operation input unit 13b. However, the liquid crystal display unit 13a and the operation input unit 13b are merely separate units in terms of function, and the liquid crystal display unit 13a and the operation input unit 13b are stacked on top of each other, allowing data to be displayed and input on the same surface, and are integrated in terms of appearance. The operation display unit 13 may include a key operation unit instead of or in addition to the touch panel. In this case, the key operation unit may be configured to include a numeric keypad, a print key, etc. The liquid crystal display unit 13a displays various data, product images, and label images. When the operator's finger touches the operation input unit 13b, it detects the touched position and accepts input according to the detected position. The weighing unit 30 is equipped with a load cell and weighs the weight of the product. The printing unit 40 has a printing mechanism unit 17 and is equipped with a label roll storage unit before printing and a label roll sending mechanism (neither shown). The printing mechanism unit 17 prints the label and discharges the printed label from the label issuing port. The photographing means 50 photographs the product placed on the weighing unit 30 and transmits the image to the control unit 20. The image data transmitted to the control unit 20 is used by being displayed for confirmation processing, saved and stored for data updating, etc. The barcode reader 60 is used by the operator to call up necessary data such as the registered image of the product by holding it over a barcode book (document). However, a configuration without using the barcode reader 60 is also possible in which numbers are input using the numbers displayed on the document.
[0012] The control unit 20 includes a CPU 21, a measurement control unit 22, a printing control unit 23, an operation control unit 24, a display control unit 25, a ROM 26, a RAM 27, a reader control unit 28, and an imaging control unit 29. The CPU 21 is mutually connected to each unit included in the control unit 20 via a bus.
[0013] The CPU 21 reads out the control program stored in the ROM 26 and various information stored in the RAM 27, and controls each part based on the read control program and various information. The CPU 21 also stores necessary information in the RAM 27. The weighing control unit 22 controls the load cell provided in the weighing unit 30. The printing control unit 23 controls the printing unit 40. The operation control unit 24 controls the operation input unit 13b, and performs a process of confirming whether the product or label is proper by tapping the screen of the product screen image or label image displayed on the liquid crystal display unit 13a. The display control unit 25 controls the liquid crystal display unit 13a. That is, the display control unit 25 outputs the product image stored in the storage means (not shown) of the label issuing device 1 or the master device (not shown) connected to the label issuing device 1, and displays the label image as a preview screen on the liquid crystal display unit 13a based on various format information and the like. The RAM 27 is a temporary storage area that stores information used by the CPU 21. The ROM 26 stores the control program. From the above explanation, it will be understood that the memory means for storing the registered image of an item may be provided in the label issuing apparatus 1, or in an external device with which the label issuing apparatus 1 communicates via wired or wireless communication.
[0014] <Operation and processing flow of the label issuing device> (Normal processing) Fig. 3 is a flow diagram showing an example of the operation and processing in the label issuing device according to the embodiment of the present invention. Fig. 5 and Fig. 6 are examples of the display screen of the label issuing device according to the embodiment of the present invention. Hereinafter, the operation and processing flow will be explained using the flow diagram and the display screen.
[0015] In step S101, an operator performing pricing work in the back yard of a store or the like inputs a product code by holding the barcode reader 60 connected to the label issuing device 1 over a barcode book (document). In a mode in which the barcode reader 60 is not connected to the label issuing device 1, the product code is input by operating the operation input unit 13b to enter the numeric code written on the document. Next, in step S102, the operator places a product on the weighing unit 30 that does not yet have a label attached.
[0016] In step S103, the label issuing device 1 judges whether the input product code is a fixed price product. If it is not a fixed price product, in step S105, a weighing process of the product placed on the weighing unit 30 is executed, and in step S106, a registered image of the product corresponding to the product code is read as a registered image from master images stored in a storage means (not shown) of the label issuing device 1 or a master device (not shown) connected to the label issuing device 1. If it is a fixed price product, in step S106, the registered image that is the registered image of the product corresponding to the product code is read as is. Also, although not shown in the flow diagram, in the case of a fixed price product with a different number of items, registered images of the next candidate product and the product next to the next candidate product with different quantities are also read together.
[0017] In parallel with the processes of steps S103 to S106, in step S104, an image capturing process is executed using the image capturing means 50 for the products placed on the weighing section 30.
[0018] In step S107, the loaded registered image and an image of the product placed on the weighing unit 30 are displayed side by side, and in step S108, the label issuing device 1 performs image recognition processing to determine whether the two images match. For the image recognition processing, an appropriate method of AI technology such as a neural network, a decision tree, a random forest, or an SVM may be used.
[0019] For example, in step S106, a screen showing only the product name and the registered image may be displayed first, and then in step S107, the image captured in step S104 may be added to the screen. In addition, with regard to step S108, if the label issuing device 1 does not execute image matching determination processing using image recognition processing, the processing in step S108 does not exist.
[0020] Returning to the flow chart, in step S108, if the product images match, the process proceeds to step S109, and if the product images do not match, the process proceeds to exception processing for product mismatch, which will be described later.
[0021] In step S109, a tap mark is displayed on the liquid crystal display unit 13a so as to be superimposed on the registered image of the product and the photographed image of the product, and the operator taps when confirming the image. FIG. 5 shows a product confirmation screen displayed by the label issuing device 1. In FIG. 5(a), the label issuing device 1 has determined that the registered image and the photographed image match, so that a tap mark is superimposed on each image. In FIG. 5(b), the label issuing device 1 has determined that the registered image and the photographed image do not match, so that a tap mark is not displayed. Note that steps S107 to S109 are flow diagrams for explaining the process, and the operator perceives the timing when the registered image and the photographed image with the tap mark are displayed and the timing when the registered image and the photographed image without the tap mark are displayed as being the same.
[0022] Although the label issuing device 1 has already determined that the registered image of the product matches the photographed image of the product, in steps S110 and S111, the operator taps the registered image and the photographed image in turn to confirm that the product information called up from the master by inputting the product code corresponds to the product actually placed on the weighing unit 30.
[0023] Fig. 6 shows the product and label confirmation screen displayed by the label issuing device 1, and illustrates screen transitions that occur as the confirmation process progresses. Fig. 6(a) illustrates how the label issuing device 1 has determined that the registered image and the captured image match, and thus a tap mark is displayed superimposed on each image. In step S111, when the operator taps the registered image and the captured image in turn, steps S112 and S113 are executed.
[0024] In step S112, the label image is enlarged and displayed on the liquid crystal display unit 13a, and a tap mark is superimposed on the label image. This state is shown in Fig. 6(b). At this time, it is effective to output the product name, price, etc. by voice to call the operator's attention. Since checking the label image is the final checking process for issuing a proper label, it is better to have more information that contributes to the check. On the other hand, in step S113, the captured image is stored and recorded. Even in the label issuing device 1 according to the embodiment of the present invention, there is a possibility that a mistake such as a wrong labeling may occur. For example, there may be a case where an operator does not check the screen carefully and performs a tap operation even if a tap mark is not displayed. For this reason, the image is recorded in order to ensure traceability. Although not shown in the flow chart, the captured image is stored as a set with the serial number, product name, and registered image so that the presence or absence of an error can be visually determined. The storage area may be within the label issuing device 1 or may be a storage device loaded in the label issuing device 1. Also, the captured image may be stored in a server connected to the label issuing device 1 so that it can be checked later by a management device. The captured image may be stored only when a tap operation is performed even if a tap mark is not displayed, or may be stored after all tap operations. The timing of saving does not have to be after step S112, but may be later, such as after tapping the label image in step S114 or after issuing the label in step S115, or may be earlier, such as step S104, if all images are to be saved. Even within the scope of step S104, any suitable timing may be used, such as immediately after placing the product on the weighing unit 30 or after waiting for the weight value to stabilize. If an image is taken after the weight value has stabilized, the image will be blur-free.
[0025] In step S114, as a final confirmation operation, the operator taps the tap mark superimposed on the label image, and the process proceeds to step S115.
[0026] In step S115, the labels are printed, and then in step S116, guidance on where to attach the labels is displayed on the liquid crystal display unit 13a. Figure 6(c) shows this state, with guidance messages such as "Attach the price label to the bottom right" and "Attach the advertising label to the top left" displayed.
[0027] In the above-described series of processes, the sensing area for the tapping operation of the tap mark may be only the vicinity of the tap mark, or the entire area of the product image or label image may be the sensing area. Also, a different operation menu may be displayed by pressing and holding instead of tapping.
[0028] (Exception handling when product mismatch occurs) The following describes exception processing in the event of product mismatch when product images do not match in step S108 of normal processing. Fig. 4 is a flow diagram showing an example of operation and processing in a label issuing device according to an embodiment of the present invention, and is a flow diagram showing exception processing in the event of product mismatch. Fig. 5 is an example of a display screen of the label issuing device according to an embodiment of the present invention. Below, the operation and processing flow will be described using the flow diagram and the display screen.
[0029] In step S108 of the normal process, the image recognition process of the label issuing device 1 determines that the registered image and the captured image do not match. Therefore, the tap mark is not superimposed on either image. Figure 5(b) shows this state, and as shown, "Authentic Western-style Hamburger" is displayed on the left side as the registered image, and "Hamburger with Fried Egg" is displayed on the right side as the captured image. And the tap mark is not displayed.
[0030] As described above, even if the tap mark is not displayed, it is possible to perform a tap operation. However, normally, as shown in steps S201 and onwards, a menu for exception handling is called up by pressing and holding either a registered image or a captured image.
[0031] If the operator realizes that the registered image that was called up is incorrect, in step S201, the operator presses and holds (long taps) the registered image. This causes a message to appear asking, "Do you want to re-enter the product code?". From the options "Yes" and "No, go back to normal," the operator selects "Yes" and re-enters the product code using a barcode reader or numeric keypad. The process returns to step S106 of the normal process, and the registered image is read (re-read).
[0032] If the product number of the registered image is correct but the number or amount of the side dishes is different, in step S203, the operator presses and holds (long taps) the captured image to display the long tap menu. In step S204, when the "Select another candidate" button in the menu is selected, in step S205, the next candidate registered image and the next candidate registered image with different numbers or amounts are displayed, and the correct one is selected and confirmed as the registered image. Then, the process returns to step S107 of the normal process, and in step S108, a match determination is performed again between the registered image and the captured image.
[0033] The long tap menu that appears when the captured image is long pressed also includes a command to replace the current captured image with a registered image and re-register it. When the product specifications are changed, the appearance may change, and a situation may arise in which the registered image is already an old image. In such a case, in step S207, the operator performs a registration operation to replace the current captured image with a registered image. The registration operation of PLU registration is called PLU registration, and at this time, weight information is also registered. The weight information may be registered by manual input, but may also be configured to be automatically registered using the weight value measured by the weighing unit 30.
[0034] In steps S204 and S206, if neither a request for a next candidate image nor registration of a captured image is made, other return processing will be appropriately selected in step S208. The exception processing described here is an example prepared especially for the purpose of explanation, and therefore the manner and order of operations can be appropriately changed. For example, the display of the next candidate registered image and the next next candidate registered image may be configured to display a long tap menu by long pressing of a registered image, not by long pressing of a captured image, and to display the long tap menu including items such as "re-enter product code" and "call another image candidate". In addition, appropriate operations can be added as exception processing.
[0035] Also, instead of or in addition to the exception handling by long press, it is possible to provide another exception handling. For example, in step S108, when the product does not match, instead of simply displaying as in FIG. 5(b), it is also possible to configure the system so that the tap mark is not displayed and the product corresponding to the captured image is searched for in the master and a message such as "Is this the product?" is displayed to the operator. In this case, when the operator confirms that the product is correct, the registered image is switched along with the product information. As for the screen transition, the captured image remains the same, and the registered image is switched, and the tap mark is also displayed.
[0036] (Another example of the display screen) Fig. 7 is an image diagram showing another example of a product and label confirmation screen displayed by the label issuing device in the embodiment of the present invention, and shows screen transitions accompanying the progress of the confirmation process. In the example screen of Fig. 6, the label image is displayed from the stage of the screen display in which the registered image of the product is compared with the photographed image, and the label image is enlarged and displayed on the liquid crystal display unit 13a in step S112 following the confirmation in steps S110 and S111 in the normal process. However, in the example screen of Fig. 7, the label image is not displayed at the stage of the screen display in which the registered image of the product is compared with the photographed image, and the label image is displayed for the first time on the liquid crystal display unit 13a in step S112 following the confirmation in steps S110 and S111 in the normal process. This configuration allows the operator to be more aware of the progress of the confirmation work.
[0037] <Another embodiment> In the embodiment described above, AI is used to judge whether or not the captured image matches the registered image in order to determine whether or not to display the tap mark, but AI can also be used in other situations. That is, in another embodiment, when a product is placed on the weighing unit 30 and photographed by the imaging means, AI is configured to call up the corresponding product information from the master, and display the registered image of the product information and the captured image. This eliminates the need to input a product code. On the other hand, after the registered image and the captured image are displayed side by side, the operator visually determines whether they match. In this way, the other embodiment can be thought of as a double check in which the operator confirms the content determined by the AI.
[0038] <Summary of the embodiment> [Technical field] The present invention relates to a label issuing device and a program. [Background technology] In the back yard of a store, workers are required to use a label issuing device that issues labels to be affixed to various products or product containers, and to affix corresponding labels appropriately to the products. For example, Patent Document 1 describes a technology that prompts users to confirm the items to be printed before printing. [Prior art document] [Patent documents] [Patent Document 1] JP 2016-218947 A [Summary of the invention] [Problem to be solved by the invention] The technology described in Patent Document 1 uses a message to prompt the user to confirm the items to be printed, but inexperienced workers may end up sticking a label on the wrong product. The present invention has been made in consideration of the above circumstances, and has an object to provide a label issuing device and program that can prevent errors in labeling and prompt an operator to apply an appropriate label that accurately corresponds to a product. [Means for solving the problem] (1) As described above, one aspect of this embodiment is a label issuing device (1) comprising: a calling means (13b, 21) for calling up a registered image from a storage means that stores a registered image of an item; a photographing means (50) for photographing an item placed in a placement area; an image confirmation means (13a, 13b, 21) for confirming whether the registered image and the image photographed by the photographing means are correct; a label image confirmation means (13a, 13b, 21) for confirming a label image of the item; and a label issuing means (40), wherein the label issuing means (40) issues a label when confirmation by the image confirmation means and confirmation by the label image confirmation means have been performed.
[0039] According to the above-mentioned configuration, it is possible to prevent erroneous application of labels and to apply appropriate labels that accurately correspond to products.
[0040] (2) One aspect of this embodiment is characterized in that, in the label issuing device (1) described in (1), it is provided with a display means (13a, 21) that displays an image captured by the photographing means (50) and a recalled registered image side by side, and a display means (13a, 21) that displays the recalled registered image, and the image confirmation means (13a, 13b, 21) confirms the image by touching the display area of the displayed captured image.
[0041] According to the above configuration, it is possible to prompt the operator to make a final confirmation.
[0042] (3) One aspect of this embodiment is that in the label issuing device (1) described in (2), the display means (13a, 21) switches from displaying the image to displaying a label image when confirmation is made by the image confirmation means.
[0043] According to the above configuration, the operator can be made more aware of the progress of the confirmation work.
[0044] (4) One aspect of this embodiment is characterized in that in the label issuing device (1) described in (2) or (3), when confirmation is performed by the image confirmation means, the captured image is stored.
[0045] According to the above-mentioned configuration, when a label attachment mistake occurs, it is possible to check where the mistake occurred, that is, traceability can be ensured.
[0046] (5) In one aspect of this embodiment, in the label issuing device (1) described in (3), the label issuing means (40) issues a label when the label image is confirmed, The display means (13a, 21) is characterized in that, when a label is issued, it switches to displaying a guide of the position where the label should be affixed to the article.
[0047] According to the above-mentioned configuration, in addition to being able to prevent the wrong label from being affixed by mistake, it is also possible to prevent the mistake of affixing a label in a position other than the appropriate position.
[0048] The label issuing device according to the embodiment of the present invention has been described above in detail with reference to the drawings, but the specific configuration is not limited to these embodiments, and the present invention includes design changes within the scope of the present invention. For example, from the viewpoint of enabling appropriate label attachment, the weighing plate of the weighing unit has been described as being used only as a stand for taking photographs, but even if the measured weight information is actively used for appropriate label attachment, it does not deviate from the technical idea of the present invention. At the same time, the use of measured weight information by itself constitutes a different inventive idea. From this perspective, a fixed-price product may also be placed on the scale, and the product information and the image captured by the camera may be automatically stored as weight information. By configuring in this way, it becomes possible to print multiple identical labels as long as there are no changes to the PLU or the quantity or content. Also, the system may be configured to compare the actual weight of the product (contents or weight per piece) or the weight obtained from the captured image (contents or number) with the weight registered in the product master (contents, number, weight per piece), and display a warning if there is an error. At this time, a warning may be displayed to encourage the user to change to the correct weight value or the product number determined from the captured image. By comparing the weight (contents or number) registered for the called product number with the actual weight and the number captured by the camera, it is possible to double-check the weight value and the image result. In addition, it may be possible to make it possible to exclude acquired information during sales or special offers when contents or quantities are increased, or when an operator manually changes information during a sale or special offer, the machine may compare the information with past data stored and display a warning if there are any discrepancies. [Explanation of symbols]
[0049] 1 Label issuing device 10 Foundations 13 Operation display section 13a LCD display section 13b Operation input section 17 Printing mechanism section 20 Control section 21 CPU 22 Measurement control section 23 Printing control section 24 Operation control section 25 Display control section 26 ROM 27 RAM 28 Reader control section 29 Shooting control section 30 Measuring part 40 Printing section 50 Shooting Method 60 Barcode Reader
Claims
1. A calling means for calling a registered image from a storage means for storing a registered image of an article; An imaging means for imaging an item placed in the placement area; an image confirmation means for confirming whether the registered image and the image photographed by the photographing means are correct; a label image confirmation means for confirming a label image of the article; A label issuing means, The label issuing means issues a label when confirmation by the image confirming means and confirmation by the label image confirming means are completed. A label issuing device comprising:
2. a display means for displaying the image photographed by the photographing means and the retrieved registered image side by side; The image confirmation means confirms the image by touching a display area of the photographed image being displayed.
2. The label issuing device according to claim 1.
3. The display means switches from displaying the image to displaying a label image when confirmation is made by the image confirmation means.
3. The label issuing device according to claim 2.
4. When confirmation is made by the image confirmation means, the photographed image is stored.
4. The label issuing device according to claim 2 or 3.
5. The label issuing means issues a label when the label image is confirmed, When the label is printed, the display means switches to a display showing a guide for a position where the label should be attached to the article.
4. The label issuing device according to claim 3.
6. A computer of a label issuing device including: a calling means for calling a registered image from a storage means for storing a registered image of an article; a photographing means for photographing an article placed on a placement area; an image confirming means for confirming whether an image photographed by the photographing means is correct; a label image confirming means for confirming a label image of the article; and a label issuing means, an image confirmation step for confirming whether the image captured by the photographing means is correct; a label image confirmation step of confirming a label image of the article after the image is confirmed to be correct in the image confirmation step; a label issuance control step of outputting a label issuance command after the label image confirmation step; A program characterized by executing the above.
Citation Information
Patent Citations
Commodity processing device and commodity processing system
JP2016218947A