Image processing device and label printing system

Abstract

To provide an image processing device and a label printing system that can easily acquire label data.SOLUTION: An image processing device includes a first interface, a second interface, a third interface, and a processor. The first interface communicates with a server. The second interface communicates with a printer that prints a label. The third interface acquires an image including a label image. The processor requests the server to generate label data on the basis of a label image cut out from the image acquired by the third interface, and transmits the label data acquired from the server to the printer.SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] Embodiments of the present invention relate to an image processing apparatus and a label printing system.

Background Art

[0002] Conventionally, labels attached to products and the like are created using a dedicated application program (label editing tool) that operates on a computer (PC) or the like. For example, a user uses a label editing tool operating on a PC to arrange lines, characters, etc., and designs a label by designating a barcode printing area or the like.

[0003] The PC converts the label designed by the user using the label editing tool into print data (label data), and supplies the label data to a barcode printer. Thereby, the barcode printer can print the label created by the user. However, a new label needs to be designed using a label editing tool. For this reason, there is a problem that it takes a lot of time and effort for the user to print a new label with a barcode printer.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] An object of the present invention is to provide an image processing apparatus and a label printing system that can easily acquire label data in order to solve the above-described problems.

Means for Solving the Problems

[0006] According to the embodiment, the image processing device has a first interface, a second interface, a third interface, and a processor. The first interface communicates with a server. The second interface communicates with a printer that prints labels. The third interface acquires an image including a label image. The processor extracts the label image from the image acquired by the third interface. The system detects the marked area and transmits the label image and information indicating the marked area in the label image. The system requests the server to generate label data based on the above, and then sends the label data obtained from the server to the printer. [Brief explanation of the drawing]

[0007] [Figure 1] Figure 1 is a schematic diagram showing an example of the configuration of a label printing system including a digital multifunction device that includes an image processing device according to an embodiment. [Figure 2] Figure 2 is a perspective view showing an example of the external configuration of a digital multifunction device including an image processing device according to the embodiment. [Figure 3] Figure 3 is a block diagram showing an example of the configuration of a control system in a digital multifunction device including an image processing device according to the embodiment. [Figure 4] Figure 4 is a block diagram showing an example configuration of a barcode printer in a label printing system according to an embodiment. [Figure 5] Figure 5 is a block diagram showing an example of the server configuration in the label printing system according to the embodiment. [Figure 6] Figure 6 shows an example of a label format created by the label printing system according to the embodiment. [Figure 7] Figure 7 shows an example of label data for a label created by the label printing system according to the embodiment. [Figure 8] Figure 8 shows an example of a label created by the label printing system according to the embodiment. [Figure 9] Figure 9 shows an example of label data for a label created by the label printing system according to the embodiment. [Figure 10]Figure 10 shows an example in which multiple printed labels are placed on the document glass of a digital multifunction device including an image processing device according to the embodiment. [Figure 11] Figure 11 shows an example of multiple label images extracted from a scanned image by a digital multifunction printer including an image processing device according to the embodiment. [Figure 12] Figure 12 shows an example of multiple label images acquired by the server of the label printing system according to the embodiment from a digital multifunction printer. [Figure 13] Figure 13 shows an example of label data generated by the server of the label printing system according to the embodiment, based on multiple label images. [Figure 14] Figure 14 is a sequence illustrating an example of the operation of the label printing system according to the embodiment. [Figure 15] Figure 15 is a flowchart illustrating an example of operation of a digital multifunction device including an image processing device according to the embodiment. [Modes for carrying out the invention]

[0008] This embodiment will be described below with reference to the drawings. First, the configuration of the label printing system 1, which includes a digital multifunction device (MFP, Multi-Functional Peripheral) 2 containing an image processing device according to the embodiment, will be described. Figure 1 is a schematic block diagram showing an example of the configuration of a label printing system 1 including a digital multifunction printer (MFP) 2 that includes an image processing device according to an embodiment. As shown in Figure 1, the label printing system 1 includes a digital multifunction device 2, a barcode printer (printer) 6, and a server 7. The digital multifunction device 2 is connected to the barcode printer 6 serially. Alternatively, the digital multifunction device 2 may be configured to connect to the barcode printer 6 via a local area network. The digital multifunction device 2 communicates with the server 7 via a network 8.

[0009] The digital multi-function device 2 has a scanner 12 (see FIG. 2) that reads images. The digital multi-function device 2 acquires an image (scan image) read by the scanner 12. The digital multi-function device 2 also has a system control unit 15 (see FIG. 3) that includes an image processing unit. The digital multi-function device 2 performs image processing on the scan image read by the scanner by the system control unit 15.

[0010] In the present embodiment, the digital multi-function device 2 reads an image including a label by the scanner and extracts a read image of the label from the scan image. The digital multi-function device 2 transmits the read image of the label extracted from the scan image to the server 7. The digital multi-function device 2 acquires label data which is print data for printing the label generated by the server 7 from the read image of the label. The digital multi-function device 2 supplies the label data acquired from the server 7 to the barcode printer 6.

[0011] The barcode printer 6 prints an image as a label on a medium to be used as a label. In the configuration example shown in FIG. 1, the barcode printer 6 is assumed to communicate with the digital multi-function device 2. For example, the barcode printer 6 acquires label data which is print data for printing a label from the digital multi-function device 2. The barcode printer 6 acquires text information, symbol images, and information necessary for each label such as barcodes to be printed on each label. The barcode printer 6 adds the information necessary for each label to the label data and prints an image as a label on the medium.

[0012] The server 7 is a computer having a configuration to communicate with the digital multi-function device 2. The server 7 acquires a read image of a label (label image) from the digital multi-function device 2. The server 7 analyzes a format as a label and the like for the label image acquired from the digital multi-function device 2. The server 7 generates label data including information indicating the format of the label based on the analysis result for the label image. The server 7 transmits the label data generated from the label image to the digital multi-function device 2.

[0013] Note that the digital multifunction peripheral 2 as the image processing apparatus according to the embodiment may include part or all of the configuration provided in the server 7 described later. For example, the label printing system 1 may be composed of the digital multifunction peripheral 2 including the server 7 and the barcode printer 6. Further, the digital multifunction peripheral 2 as the image processing apparatus according to the embodiment may include part or all of the configuration provided in the barcode printer 6 described later. For example, the label printing system 1 may be composed of the digital multifunction peripheral 2 including the barcode printer 6 and the server 7. Further, the label printing system 1 may be composed of only the digital multifunction peripheral 2 including the server 7 and the barcode printer 6.

[0014] Next, the configuration of the digital multifunction peripheral 2 as the image forming apparatus according to the embodiment will be described. FIG. 2 is a perspective view showing an external configuration example of the digital multifunction peripheral 2 as the image forming apparatus according to the embodiment.

[0015] As shown in FIG. 2, the digital multifunction peripheral 2 has a scanner 12, a printer 13, and an operation panel 14. The scanner 12 is installed on the upper part of the main body of the digital multifunction peripheral 2. The scanner 12 is an image reading device (image input device) that optically reads an image of a document. The scanner 12 has a document table 22 formed of a colorless and transparent member such as glass on which the document is placed. Further, the scanner 12 reads an image of the document set on the document table 22. The scanner 12 reads an image of the document on the document table 22 through the glass of the document table 22 by the image reading unit 21. Note that the scanner 12 may be configured with a camera or the like as long as it can acquire an image.

[0016] The printer 13 forms an image on paper. The printer 13 has an image forming unit 31 that forms an image on paper taken from the paper cassette. The image forming unit 31 may use any image forming method. For example, if the image forming unit 31 is an electrophotographic method, it forms a developer image on an image carrier such as a photosensitive drum and transfers the developer image to the paper. Alternatively, if the image forming unit 31 is an inkjet method, it forms an image on the paper using ink ejected by an inkjet head.

[0017] The operation panel 14 is a user interface. The operation panel 14 has a display unit 41, a touch panel 42, and a number of operation buttons 43. The display unit 41 displays operation instructions and the like. The touch panel 42 is located on the display screen of the display unit 41. The touch panel 42 detects the area on the display screen of the display unit 41 that the user touches.

[0018] Next, the configuration of the control system in the digital multifunction printer 2 according to this embodiment will be described. Figure 3 is a block diagram illustrating an example of the control system configuration in the digital multifunction printer 2 according to this embodiment. The digital multifunction device 2 includes a scanner 12, a printer 13, an operation panel 14, and a system control unit 15. In the digital multifunction device 2, the system control unit 15 is connected to the scanner 12, the printer 13, and the operation panel 14.

[0019] In the configuration example shown in Figure 3, the system control unit 15 includes a processor 50, memory 51, image memory 52, image processing unit 53, storage device 54, communication interface (I / F) 55, external interface (I / F) 56, interfaces (I / F) 57, 58, 59, etc.

[0020] The processor (first processor) 50 performs control and information processing of each part. The processor 50 is, for example, a CPU. The processor 50 executes programs stored in memory 51 or storage device 54. By executing programs, the processor 50 outputs operation instructions to each part and processes various information from each part. The processor 50 connects to the scanner 12, printer 13, and operation panel 14 via interfaces 57, 58, and 59.

[0021] Memory 51 includes RAM (Random Access Memory), ROM (Read-Only Memory), and NVM. RAM functions as working memory or buffer memory. ROM is non-rewritable, non-volatile memory. ROM functions as program memory. NVM is rewritable, non-volatile memory. NVM stores data such as programs, control data, and configuration information.

[0022] The image memory 52 stores image data. For example, the image memory 52 functions as a page memory for expanding the image data to be processed. The storage device 54 stores data such as programs, control data, and configuration information. The storage device 54 is composed of rewritable, non-volatile memory. For example, the storage device 54 is composed of a storage device such as an HDD (hard disk drive) or an SSD (solid state drive).

[0023] The communication interface (first interface) 55 is an interface for data communication with external devices. For example, communication interface 55 is a network interface that communicates with external devices such as a server 7 via network 8.

[0024] The external interface (second interface) 56 is an interface for connecting external devices. For example, the external interface 56 is connected to the barcode printer 6. The external interface 56 may connect to the external device via a wired connection or via a wireless connection.

[0025] The I / F (third interface) 57 is an interface for connecting to the scanner 12. For example, the processor 50 acquires image data read by the scanner 12 via the I / F 57. The I / F 57 as the third interface is an interface for acquiring the scanned image as an input image, which includes the image of the printed label. The I / F 57 as the third interface can be one that acquires an input image that includes the label image. For example, the I / F 57 as the third interface can acquire a captured image including the label image taken by an external camera as an input image.

[0026] I / F58 is an interface for connecting to the printer 13. I / F59 is an interface for connecting to the operation panel 14. For example, the processor 50 supplies data to be displayed on the display unit 41 to the operation panel 14 via I / F59. The processor 50 also acquires input data entered on the touch panel 42 or operation buttons 43 on the operation panel 14 via I / F59.

[0027] As shown in Figure 3, the scanner 12 includes a control unit (scanner control unit) 20 and an image reading unit (image reading mechanism) 21, among others. The control unit 20 consists of a processor such as a CPU, various types of memory, and interfaces. The control unit 20 controls the operation of the scanner 12 by executing a program stored in the memory by the processor. The control unit 20 is connected to the processor 50 via the I / F 57 in the system control unit 15. For example, the control unit 20 controls the operation of the scanner 12 in response to instructions from the system control unit 15. The control unit 20 also supplies the image data read by the image reading unit 21 to the system control unit 15.

[0028] The image reading unit 21 reads an image on the document glass 22. The image reading unit 21 includes, for example, illumination, an optical system, and a photoelectric conversion unit. The illumination irradiates light onto the document glass 22. The optical system guides reflected light from the surface of the document placed on the document glass 22 to the photoelectric conversion unit. The photoelectric conversion unit converts the light from the surface of the document into an electrical signal. For example, the image reading unit 21 reads the image of a label set on the document glass 22 and acquires a scanned image that includes the read image of the label.

[0029] As shown in Figure 3, the printer 13 includes a control unit (printer control unit) 30 and an image forming unit 31, among others. The control unit 30 consists of a processor such as a CPU, various memories, and interfaces. The control unit 30 controls the operation of the printer 13 by executing a program stored in the memory by the processor. The control unit 30 is connected to the processor 50 via an I / F 58 in the system control unit 15. For example, the control unit 30 executes the print process by the image forming unit 31 in response to operation instructions from the system control unit 15.

[0030] The image forming unit 31 forms an image on a medium such as paper. The image forming unit 31 is not limited to a specific image forming method. For example, the image forming unit 31 may be an electrophotographic image forming mechanism. An electrophotographic image forming unit 31 consists of a transport system, an exposure device, a photosensitive drum, a developing device, an intermediate transfer body, a transfer unit, and a fuser. The image forming unit 31 may also function as a barcode printer that prints a label image based on label data onto a medium used as a label.

[0031] As shown in Figure 3, the operation panel 14 includes a control unit (panel control unit) 40, a display unit (display) 41, a touch panel 42, and operation buttons 43, etc. The control unit 40 consists of a processor such as a CPU, various types of memory, and interfaces. The control unit 40 controls the operation of the operation panel 14 by executing a program stored in the memory by the processor. The control unit 40 is connected to the processor 50 via the I / F 59 in the system control unit 15. For example, the control unit 40 displays an image on the display unit 41 in response to instructions from the system control unit 15. The control unit 40 also notifies the system control unit 15 of input data entered by the user on the touch panel 42 or operation buttons 43.

[0032] The display unit 41's display content is controlled according to operation instructions from the control unit 40. The touch panel 42 is provided on the display screen of the display unit 41 and detects the touch position on the display screen. For example, the control unit 40 displays icons that can be selected on the touch panel 42 on the display screen of the display unit 41 along with operation guidance. The control unit 40 determines the information to be entered by the user according to the touch position detected by the touch panel 42. The operation buttons 43 consist of hard keys such as a start key and a reset key.

[0033] Next, the configuration of the barcode printer 6 in the label printing system 1 according to the embodiment will be described. Figure 4 is a block diagram illustrating an example of the control system configuration in the barcode printer 6 of the label printing system 1 according to this embodiment. The barcode printer 6 includes a processor 61, system memory 62, storage unit 63, external interface (I / F) 64, printer 65, display unit 66, and operation unit 67.

[0034] The processor 61 performs control and information processing for each component. The processor 61 is, for example, a CPU. The processor 61 executes programs stored in the system memory 62 or the storage unit 63. By executing programs, the processor 61 outputs operation instructions to each component and processes various information from each component.

[0035] System memory 62 includes memory such as RAM (Random Access Memory), ROM (Read-Only Memory), and NVM. RAM functions as working memory or buffer memory. ROM is non-rewritable, non-volatile memory. ROM functions as program memory. NVM is rewritable, non-volatile memory. NVM stores data such as programs, control data, and configuration information.

[0036] The memory unit 63 is composed of rewritable, non-volatile memory. For example, the storage device 54 is composed of a storage device such as an HDD (hard disk drive) or an SSD (solid state drive). The memory unit 63 stores, for example, image data. The memory unit 63 may also store data such as programs, control data, and setting information.

[0037] External I / F64 is an interface for connecting external devices. External I / F66 may connect to an external device via a wired connection or wirelessly. In the configuration example shown in Figure 1, External I / F64 is an interface for connecting to the digital multifunction printer 2.

[0038] The printer 65 prints the label image onto a medium to be used as a label. The printer 65 prints the label image onto a medium of a predetermined width (label width) to be used as a label. The printer 65 has a preset printable label width. Information indicating the maximum printable label width of the printer 65 is notified to the digital multifunction device 2.

[0039] The display unit 66 is composed of a display device such as a liquid crystal display. The display content of the display unit 66 is controlled according to operation instructions from the processor 61. The operation unit 67 is composed of a touch panel or operation buttons. For example, the display unit 66 and the operation unit 67 are composed of display devices with a touch panel. For example, the processor 61 displays icons that can be selected on the touch panel acting as the operation unit 67, along with operation instructions, on the display screen of the display unit 41. As a result, the processor 61 acquires input data corresponding to the touch position detected by the touch panel.

[0040] Next, the configuration of the server 7 in the label printing system 1 according to the embodiment will be described. Figure 5 is a block diagram illustrating an example of the control system configuration in the server 7 of the label printing system 1 according to this embodiment. Server 7 includes a processor 71, system memory 72, storage unit 73, and a communication interface (I / F) 74, among other things.

[0041] The processor (second processor) 71 performs control and information processing of each part. The processor 71 is, for example, a CPU. The processor 71 executes programs stored in the system memory 72 or the storage unit 73. By executing programs, the processor 71 outputs operation instructions to each part and processes various information from each part.

[0042] System memory 72 includes RAM (Random Access Memory), ROM (Read-Only Memory), and NVM. RAM functions as working memory or buffer memory. ROM is non-rewritable, non-volatile memory. ROM functions as program memory. NVM is rewritable, non-volatile memory. NVM stores data such as programs, control data, and configuration information.

[0043] The storage unit 73 is composed of rewritable non-volatile memory. For example, the storage unit 73 is composed of a storage device such as an HDD (hard disk drive) or an SSD (solid state drive). The storage unit 73 stores, for example, image data. The storage unit 73 may also store data such as programs, control data, and setting information. For example, the storage unit 73 stores a program that generates label data for printing a label by analyzing the read image of the label.

[0044] The communication interface (fourth interface) 74 is a communication interface for communicating with an external device. The communication interface 74 includes a network interface for communicating with an external device via network 8. The communication interface 74 may include an interface for communicating with an external device via a wired connection or an interface for communicating with an external device via a wireless connection. According to the configuration example shown in Figure 1, the communication interface 74 only needs to include an interface for communicating with the digital multifunction printer 2.

[0045] Next, we will describe the label data for which the barcode printer 6 prints labels in the label printing system 1 according to the embodiment. Figure 6 shows an example of a label format having multiple variable data image regions. Figure 7 shows an example of label data for printing a label in the format shown in Figure 6.

[0046] The label shown in Figure 6 has a format that includes image regions Aa, Ab, Ac, Ad, Ae, a dividing line Oa, and text Ob, Oc, Od. Image regions Aa, Ab, Ac, Ad, and Ae are areas where variable data is printed. The dividing line Oa is a horizontal line that divides the label's image region vertically. The image region Aa containing the variable data is positioned above the dividing line Oa in the label's image region.

[0047] The texts Ob, Oc, and Od are "Name," "Address," and "Phone." The texts Ob, Oc, and Od are arranged below the dividing line Oa. The variable data image regions Ab, Ac, and Ad are positioned corresponding to the texts Ob, Oc, and Od, respectively. The variable data image region Ae is positioned below the image regions Ab, Ac, and Ad, and below the texts Ob, Oc, and Od.

[0048] As shown in Figure 7, the label data defines the arrangement (format) of image regions Aa, Ab, Ac, Ad, Ae, the dividing line Oa, and the text Ob, Oc, Od. The label data also defines data regions Ba, Bb, Bc, Bd, Be, which store the variable data to be printed in the image regions Aa, Ab, Ac, Ad, Ae. When printing the label, the variable data to be printed in the image regions Aa, Ab, Ac, Ad, Ae is set in the respective data regions Ba, Bb, Bc, Bd, Be.

[0049] Furthermore, in the example shown in Figure 7, the label data defines which input device inputs variable data to data areas Ba, Bb, Bc, Bd, and Be. For example, the date, which is variable data to be set in data area Ba, is acquired by the barcode printer 6. The name string, which is variable data to be set in data area Bb, is entered by the operator using the control panel 67 of the barcode printer 6. The address string, which is variable data to be set in data area Bc, is entered by the operator using the control panel 67 of the barcode printer 6. The phone number string, which is variable data to be set in data area Bd, is entered by the operator using the control panel 67 of the barcode printer 6. The barcode, which is variable data to be set in data area Be, is acquired by the barcode printer 6.

[0050] Figure 8 shows an example of a label with variable data printed on the image region of each variable data. Figure 9 shows an example of label data for printing the label shown in Figure 8. The labels shown in Figure 8 have variable data, such as strings or barcodes, printed in the image regions Aa, Ab, Ac, Ad, and Ae shown in Figure 6. For example, the string of characters (or numbers) "Date&Time" is printed in image region Aa. "Data01" is printed in image region Ab, "Data02" in image region Ac, and "Data03" in image region Ad. A barcode is printed in image region Ae.

[0051] In the example shown in Figure 9, the data areas Ba, Bb, Bc, Bd, and Be of the label data are set with their respective data (variable data). Data areas Ba, Bb, Bc, and Bd store string data consisting of characters or numbers, which are variable data for each label. Data area Be stores data representing the barcode, which is variable data for each label.

[0052] The barcode printer 6, which prints the labels, acquires variable data to be set in the data areas Ba, Bb, Bc, Bd, and Be. Once the barcode printer 6 acquires the variable data for each area, it generates label data (print data) with the variable data embedded.

[0053] For example, when printing a label, the barcode printer 6 obtains the date and sets the date data in data area Ba. The barcode printer 6 sets the string representing the name entered by the operator using the control unit 67 in data area Bb. The barcode printer 6 sets the string representing the address entered by the operator using the control unit 67 in data area Bc. The barcode printer 6 sets the string representing the phone number entered by the operator using the control unit 67 in data area Bd. The barcode printer 6 obtains the barcode to print on the label and sets the data representing the barcode in data area Be.

[0054] Next, we will describe the processing of scanned images (input images) including label images by the digital multifunction printer 2 of the label printing system 1 according to the embodiment. Figure 10 shows an example of placing multiple printed labels on the document tray 22 of the digital multifunction printer 2. When the digital multifunction printer 2 acquires label data from printed labels, it scans the printed labels using the scanner 12. When acquiring label data from printed labels, the operator places the printed labels on the document glass 22 of the digital multifunction printer 2. If there are multiple printed labels, the operator places each label on the document glass 22 so that they do not overlap. However, the multiple printed labels do not need to be placed in the same orientation and may be placed randomly on the document glass 22.

[0055] The digital multifunction printer 2 reads an image, including a printed label placed on the document glass 22, using the scanner 12, in response to the operator's scan command. The system control unit 15 of the digital multifunction printer 2 acquires the scanned image (input image) including the printed label read by the scanner 12.

[0056] The system control unit 15 extracts individual label images (label images) from the scanned image. Furthermore, the system control unit 15 performs image processing, such as tilt correction, on the label images extracted from the scanned image. For example, the system control unit 15 recognizes the orientation (up and down) of each extracted label image. Based on the orientation recognition result for each label image, the system control unit 15 corrects the tilt of the label images.

[0057] Figure 11 shows an example of multiple label images extracted from a scanned image by the digital multifunction printer 2. When the digital multifunction printer 2 is instructed to scan with labels placed on the document glass 22, the scanner 12 acquires a scanned image that includes the labels. In this case, the scanned image will include the labels placed in any orientation. The system control unit 15 extracts individual label images from the scanned image and performs image processing such as tilt correction on each extracted label image.

[0058] For example, when a scan is instructed with multiple labels arranged as shown in Figure 10, the scanner 12 reads an image containing multiple label images. The scanner 12 supplies the scanned image (input image) containing multiple label images arranged in any orientation as shown in Figure 10 to the system control unit 15. The system control unit 15 extracts the individual label images 91, 92, 93, 94, and 95 arranged in any orientation from the scanned image acquired from the scanner 12. The system control unit 15 recognizes the top and bottom of the extracted individual label images 91, 92, 93, 94, and 95 and corrects the tilt based on the top and bottom recognition result. As a result, the system control unit 15 acquires five label images 91, 92, 93, 94, and 95 in the state shown in Figure 11.

[0059] The system control unit 15 requests the server 7 to generate label data for each label image acquired from the scanned image. For example, along with the request to generate label data, the system control unit 15 sends the processed label images 91, 92, 93, 94, and 95 to the server 7.

[0060] Here, the system control unit 15 may perform image processing for individual label images, specifically detecting a particular image region. For example, a particular image region to be detected from an individual label image could be a variable data region or a personal information display region. A variable data region is a region that needs to be identified when creating label data from a label image. A personal information display region is a region that is masked in the label image (a region where the image content is unrecognizable) in order to protect personal information.

[0061] Furthermore, one method for the system control unit 15 to detect a specific image region from the label image is to detect the marked region. For example, the operator places a label with a variable data area marked with a predetermined marker on the document glass 22. The digital multifunction printer 2 acquires a scanned image containing the image of the label with the specific area marked by the scanner 12. The system control unit 15 detects the marking image in each label image extracted from the scanned image. The system control unit 15 transmits information indicating the area (variable data area) explicitly marked by the marking, along with the individual label image, to the server 7.

[0062] This allows the digital multifunction printer 2 to provide the server 7 with information indicating the marked area in the label image. As a result, the server 7 can clearly recognize the marked area in the label image. If the marked area is a variable data area, the server 7 can easily identify the variable data area in the label image.

[0063] The operator may also place a label on the document glass 22 that has been marked to indicate the display area of ​​protected information, such as personal information, that should not be sent to the server 7. The digital multifunction printer 2 detects the marked image in each label image extracted from the scanned image acquired by the scanner 12. If the operation involves marking protected information, the system control unit 15 may send a label image to the server 7 with the marked area masked (converted to a state where the displayed content is unrecognizable). This allows the digital multifunction printer 2 to transfer a label image with the display area of ​​information that should be protected, such as personal information, masked, to the server 7, which is an external device. As a result, the risk of information that should be protected, such as personal information, in the label image being leaked on the communication path between the digital multifunction printer 2 and the server 7 can be reduced.

[0064] Another method for detecting specific image regions is to detect the display region of information related to a specific string based on its positional relationship to the display position of a specific string. For example, the system control unit 15 performs character recognition on a label image. The system control unit 15 detects a specific string from the results of the character recognition on the label image. The system control unit 15 then detects the image region at the position corresponding to the detected specific string (for example, the image region adjacent to the string "Name", "Address", or "Telephone Number").

[0065] This allows the digital multifunction printer 2 to detect the display area of ​​information that needs to be protected, such as personal information, through character recognition. In this case as well, the digital multifunction printer 2 can transfer a label image with the display area of ​​information that needs to be protected, such as personal information, masked, to the server 7, which is an external device. As a result, the risk of information that needs to be protected, such as personal information, in the label image being leaked on the communication path between the digital multifunction printer 2 and the server 7 can be reduced.

[0066] Next, an example of the label image analysis and label data generation process in the server 7 of the label printing system 1 according to this embodiment will be described. Figure 12 shows an example of multiple label images acquired by server 7 from digital multifunction printer 2. Figure 13 shows an example of a single label data generated based on the multiple label images shown in Figure 12. For example, the user places multiple printed labels of the same type on the document glass 22 and instructs the system to perform a scan. When the system is instructed to perform a scan, the digital multifunction device 2 reads an image containing the three labels on the document glass 22 using the scanner 12. The system control unit 15 acquires the scanned image from the scanner 12 and extracts the three label images contained in the scanned image. The system control unit 15 performs image processing, such as tilt correction, on each of the extracted label images. As a result, the system control unit 15 acquires the three label images 101, 102, and 103 shown in Figure 12. The system control unit 15 sends the three acquired label images 101, 102, and 103 to the server 7 along with a request to generate label data.

[0067] In response, Server 7 receives a request from the digital multifunction printer 2 to generate label data and three label images 101, 102, and 103. By analyzing the three acquired label images, Server 7 generates label data as shown in Figure 13.

[0068] Server 7 extracts the elements that make up a label from each of the three label images 101, 102, and 103. Server 7 extracts the image regions Aa, Ab, Ac, Ad, Ae, the dividing line Oa, and the text Ob, Oc, and Od from the three label images 101, 102, and 103. Server 7 also identifies that the coordinates of the image regions Aa, Ab, Ac, Ad, Ae, the dividing line Oa, and the text Ob, Oc, and Od match in the three label images. Server 7 may also determine that the three label images are of the same type based on the matching positions of multiple elements.

[0069] Server 7 identifies the image regions of variable data by comparing the image content of each element whose coordinates match. In the example shown in Figure 12, the three label images 101, 102, and 103 differ in the image content of image regions Aa, Ab, Ac, and Ad. Based on this, Server 7 identifies that image regions Aa, Ab, Ac, and Ad are regions of variable data.

[0070] For example, Server 7 recognizes through character recognition of image area Aa that the variable data printed in image area Aa is date data consisting of a sequence of numbers. Server 7 also recognizes through character recognition of text Ob and image area Ab that the variable data printed in image area Ab is a "name". Furthermore, Server 7 recognizes through character recognition of text Oc and image area Ac that the variable data printed in image area Ac is an "address". Furthermore, Server 7 recognizes through character recognition of text Od and image area Ad that the variable data printed in image area Ad is a "telephone number". Finally, Server 7 recognizes through image recognition of image area Ae that the variable data printed in image area Ae is a barcode.

[0071] Server 7 generates a single label data based on the analysis results of the three label images 101, 102, and 103 as described above. For example, Server 7 generates label data that defines the positions of each element extracted from the three label images 101, 102, and 103. Furthermore, as shown in Figure 13, Server 7 defines data areas Ba, Bb, Bc, and Bd in the label data to store variable data to be printed in image areas Aa, Ab, Ac, and Ad. In addition, Server 7 may add information to the label data that defines the input device for inputting the variable data to be stored in image areas Aa, Ab, Ac, and Ad.

[0072] Next, the overall operation of the label printing system 1 according to this embodiment will be described. Figure 14 is a sequence illustrating an example of the operation of the label printing system 1 according to the embodiment. First, the user places the printed label for which they want to generate label data on the document glass 22 of the digital multifunction printer 2 (ACT11). Once the printed label is placed, the user inputs a command to perform a scan using the operation buttons 43 on the control panel 14 or the touch panel 42 (ACT12).

[0073] The processor 50 of the system control unit 15 of the digital multifunction printer 2 receives a scan execution instruction from the operation panel 14. When the processor 50 receives a scan execution instruction, it executes the scan process using the scanner 12 (ACT 13). The scanner 12 scans the image including the label on the document glass 22 according to the instruction from the processor 50 and supplies the scanned image to the system control unit 15. The processor 50 of the system control unit 15 acquires the scanned image from the scanner 12 via the I / F 57. The processor 50 stores the scanned image (input image) acquired via the I / F 57 in the image memory 52 or storage device 54 (ACT 14).

[0074] When the processor 50 of the system control unit 15 saves the scanned image, it extracts individual label images from the saved scanned image (ACT 15). The processor 50 determines the orientation of each extracted label image and corrects the tilt of each label image (ACT 16). Furthermore, the processor 50 performs pre-configured image processing on each label image whose tilt has been corrected (ACT 17).

[0075] For example, as a first image processing example, the processor 50 performs a process to detect marked areas in a label image as variable data areas. In this case, the processor 50 detects marking images from individual label images and detects the areas indicated by the marking images (marking areas) as variable data areas. In this case, the processor 50 adds information indicating the marking areas to be used as variable data areas to the label image as additional information.

[0076] Furthermore, as a second example of image processing, the processor 50 may detect protected information such as personal information from the label image and mask the display area of ​​the protected information. For example, the processor 50 may detect the protected information and the display area of ​​the protected information based on the character recognition results for the label image. Alternatively, the processor 50 may detect a marking image from each label image and detect the area indicated by the marking image as the display area of ​​the protected information.

[0077] When the processor 50 detects a display area of ​​protective information in the label image, it performs a masking process (masking) to make the protective information unrecognizable. The masking process can be any process that makes the protective information unrecognizable. For example, the masking process could involve filling the display area of ​​the protective information with black or shading it. Alternatively, the masking process could involve abstracting the protective information or converting it into predetermined information.

[0078] The processor 50 of the digital multifunction printer 2 applies image processing to individual label images and then requests the server 7 to generate label data (ACT 18). The processor 50 communicates with the server 7 via the communication interface 55. Once communication with the server 7 is established, the processor 50 sends the request for label data generation and the individual label images that have undergone image processing to the server 7.

[0079] Server 7 receives a request to generate label data and individual label images via the communication interface 74. The processor 71 of Server 7 stores the received individual label images in the storage unit 73. After storing the individual label images in the storage unit 73, the processor 71 generates label data by analyzing the individual label images (ACT21).

[0080] For example, as described above, the processor 71 generates label data by extracting each element from individual label images and comparing them with elements from other label images. Alternatively, the processor 71 may generate label data by comparing it with previously received label images stored in the memory unit 73. Note that the method for generating label data is not limited to the example described above; any method that can generate label data from individual label images is acceptable.

[0081] When the label image generates label data, the processor 71 of server 7 stores the generated label data in the storage unit 73 (ACT22). The processor 71 of server 7 also sends the label data generated from the label image to the digital multifunction device 2, which requested the generation of the label data (ACT23).

[0082] The digital multifunction printer 2 acquires label data from the server 7 via the communication interface 55. The processor 50 of the system control unit 15 of the digital multifunction printer 2 sends a request to the server 7 to generate label data, and then waits to receive the label data from the server 7. When the processor 50 receives the requested label data from the server 7, it saves (stores) the label data from the server 7 in the storage device 54 (ACT24).

[0083] Furthermore, when the processor 50 obtains label data from the server 7, it sends the obtained label data to the barcode printer 6 via the external I / F 56 (ACT 25). Here, the processor 50 may also verify that the label data obtained by the server 7 is a label that the destination barcode printer 6 can print. For example, the processor 50 verifies that the width size of the label to be printed by the label data is a printable label width size. In this case, the processor 50 may not send label data whose width size is not a printable size to the barcode printer 6.

[0084] The barcode printer 6 acquires label data from the digital multifunction device 2 via an external interface 64. When the barcode printer 6's processor 61 receives label data from the digital multifunction device 2, it stores the received label data in the storage unit 63 (ACT26). As a result, the barcode printer 6 can read the label data stored in the storage unit 63 and print labels according to the operator's instructions.

[0085] As described above, the label printing system includes a digital multifunction printer with an image processing device, a server, and a barcode printer. The digital multifunction printer extracts printed label images from input images such as scanned images and requests the server to generate label data for each label image. The server generates label data for the label images by analyzing the label images from the digital multifunction printer and transmits the generated label data to the digital multifunction printer. The digital multifunction printer supplies the label data generated by the server to the barcode printer 6.

[0086] As a result, the label printing system according to this embodiment can acquire label data from printed labels without running a label editing tool on a PC. Consequently, the label printing system can reduce the effort required to generate label data and easily acquire it.

[0087] Next, the operation of the digital multifunction device 2, which includes an image processing device according to the embodiment, will be described. Figure 15 is a flowchart illustrating an example of operation of a digital multifunction device 2 including an image processing device according to an embodiment.

[0088] The system control unit 15 of the digital multifunction printer 2 receives a scan execution instruction via the operation panel 14. When the scan execution instruction is received, the processor 50 of the system control unit 15 performs a scan using the scanner 12 (ACT 111). Here, the system control unit 15 may acquire an image including the printed label image (label image) from another image reading device or camera instead of the scanner 12.

[0089] The processor 50 of the system control unit 15 acquires a scanned image from the scanner 12 via the I / F 57. The processor 50 stores the scanned image (input image) acquired via the I / F 57 in the image memory 52.

[0090] The processor 50 of the system control unit 15 performs the process of extracting individual label images from the scanned image, which is the input image (ACT 112). The processor 50 corrects the tilt of the extracted individual label images (ACT 113).

[0091] The processor 50 detects marking images (markers) in each tilt-corrected label image (ACT114). When the processor 50 detects a marker in the label image, it identifies the marking region indicated by the detected marker. The processor 50 adds information indicating the identified marking region as additional information to the label image. Here, if no marker is detected, or if no marker is detected, the processor 50 omits the processing of ACT114.

[0092] Furthermore, the processor 50 detects personal information and other protected information (masked information) in the label image (ACT115). When the processor 50 detects masked information, it performs a masking process to mask the display area of ​​the masked information in the label image. Here, if no masked information is detected, the processor 50 omits the ACT115 process.

[0093] The processor 50 of the digital multifunction printer 2 processes each label image and then sends a request to the server 7 to generate label data along with the individual label images (ACT116). After sending the generation request to the server 7, the processor 50 receives the label data from the server 7. In other words, the processor 50 waits for the label data to be received from the server 7 (ACT117, NO).

[0094] Furthermore, when the processor 50 obtains label data from the server 7 (ACT117, YES), it stores the label data obtained from the server 7 in the storage device 54 (ACT118).

[0095] Furthermore, when the processor 50 obtains label data from the server 7, it identifies the printing capabilities (such as printable size) of the barcode printer 6 to which the label data will be sent. For example, the processor 50 reads the printing capabilities of the barcode printer 6 stored in the storage device 54. Alternatively, the processor 50 may query the barcode printer 6 to which the label data will be sent for information about its printing capabilities.

[0096] Once the processor 50 determines the printing capability of the barcode printer 6, it determines whether or not it is possible to print labels using the label data obtained from the server 7 (ACT119). If the processor 50 determines that the barcode printer 6 is not capable of printing labels using the label data (ACT119, NO), it omits sending the label data and proceeds to ACT121. If the processor 50 determines that the barcode printer 6 is capable of printing labels using the label data (ACT119, YES), it sends the label data to the barcode printer 6 (ACT120).

[0097] When the processor 50 sends label data to the barcode printer 6, it determines whether the requested label data acquisition process is complete (ACT121). If the label data acquisition process is not complete (ACT121, NO), the processor 50 returns to ACT117 and executes processing for the next label data. If the label data acquisition process is complete (ACT121, YES), the series of processes ends.

[0098] As described above, the digital multifunction device including the image processing device according to the embodiment communicates with a barcode printer and a server. The digital multifunction device receives a scanned image containing images of printed labels as input and extracts individual label images from the scanned image. The digital multifunction device performs image processing, including tilt correction, on the individual label images extracted from the scanned image. The digital multifunction device sends a request for label data generation and the individual label images to the server. The digital multifunction device supplies the label data obtained from the server to the barcode printer. As a result, the digital multifunction device can provide the barcode printer with label data generated from images of scanned printed labels without the need for a label editing tool. Consequently, the label printing system including the digital multifunction device can reduce the effort required to create label data.

[0099] While several embodiments of the present invention have been described, these embodiments are presented as examples only and are not intended to limit the scope of the invention. These novel embodiments can be carried out in a variety of other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, as well as in the claims of the invention and its equivalents. [Explanation of symbols]

[0100] 1…Label printing system, 2…Digital multifunction printer (image processing device), 6…Barcode printer (printer), 7… Server, 12... Scanner, 13…Printer, 14…Control panel, 15...System control unit, 20... Control unit, 21...Image reading unit, 22... Manuscript stand, 30... Control unit, 31…Image forming unit, 40... Control unit, 41...display section, 42... Touch panel, 43... Operation buttons, 50…Processor (first processor), 51...memory, 53…Image Processing Unit, 54...Storage device, 55...Communication interface (first interface), 56…External interface (second interface), 57…Interface (Third Interface) 58… Interface, 59… Interface, 61…Processor, 62... System memory, 63...Storage section, 64...External interface, 71…Processor (second processor), 72... System memory, 73...Storage section, 74...Communication interface (fourth interface).

Claims

1. A first interface for communicating with the server, A second interface that communicates with the printer that prints the labels, A third interface for obtaining an image containing a label image, A processor that detects a marked area in a label image extracted from an image acquired by the third interface, transmits the label image and information indicating the marked area in the label image, requests the server to generate label data based on the label image, and transmits the label data acquired from the server to the printer, An image processing device having

2. The processor further detects the marked area in the label image as an image area of ​​variable data, and transmits the label image and information indicating the image area of ​​variable data in the label image to the server. The image processing apparatus according to claim 1.

3. The processor detects the marked area in the label image as the display area for protection information, and sends the label image with the display area for protection information masked to the server. The image processing apparatus according to claim 1.

4. The label data obtained from the server that falls within the printer's printing capacity is transmitted to the printer. The image processing apparatus according to claim 1.

5. A label printing system having an image processing device and a server, The aforementioned image processing device is A first interface that communicates with the aforementioned server, A second interface that communicates with the printer that prints the labels, A third interface for obtaining an image containing a label image, The system includes a processor that detects a marked area in a label image extracted from an image acquired by the third interface, transmits the label image and information indicating the marked area in the label image, requests the server to generate label data based on the label image, and transmits the label data acquired from the server to the printer. The aforementioned server, A fourth interface that communicates with the aforementioned image processing device, A second processor generates label data based on a label image acquired from the image processing device and information indicating a marked area in the label image, and transmits the generated label data to the image processing device. Label printing system.

Images