Image processing method, and image processing system

Abstract

To restrict output of a document image when the document image is confidential information.SOLUTION: In an image processing system Sy, an image forming apparatus 10 creates a template of a document shown by a document image, and transmits the created template to a confidential management server 30. When the template matches a prescribed template, the confidential management server 30 transmits, to the image forming apparatus 10, a prescribed keyword associated with the prescribed template. When the prescribed keyword is included in the document shown by the document image, the image forming apparatus 10 treats the document image as confidential information, transmits the prescribed template to an information processing apparatus 70 of a manager, and when receiving permission to output the document image from the information processing apparatus 70, processes the document image.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an image processing method and an image processing system for inputting and processing an original image, and more particularly to a technique for improving the security of the original image. [Background technology]

[0002] For example, in an image forming apparatus, an image reading unit reads an image of an original document, and an image forming unit forms the image of the original document on a recording sheet.

[0003] Furthermore, in the information processing device described in Patent Document 1, when a user posts a file to a chatbot participating in a chat room, the chatbot stores the file as a file to be printed. When a user posts an instruction to print the file to the chat room, the chatbot determines whether a printer ID is registered in association with the user, and if not, posts a message in the chat room requesting registration of a printer ID. When a user posts a printer ID to the chat room in response to this posting, the chatbot registers the printer ID in association with the user, and prints the file on the printer indicated by the printer ID. As a result, even if an instruction to print a file is posted to the chat room before the printer ID is registered, the instruction to print the file does not result in an error, and the file is printed on the printer indicated by the printer ID. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2020-71598 A Summary of the Invention [Problem to be solved by the invention]

[0005] In the image forming apparatus described above, the document image is read and formed on the recording paper, but if the document image contains confidential information, it is necessary to restrict the formation of the document image. Also, it is preferable to appropriately manage many document images representing various documents.

[0006] In Patent Document 1, files posted by users are stored as the files to be printed, and even if a printer ID is not registered in association with the user, when the user posts a printer ID in a chat room, a printer ID is registered in association with the user and the file is printed on that printer; however, the printing of many original images representing various documents is not properly managed.

[0007] The present invention has been developed in consideration of the above circumstances, and aims to make it possible to restrict the output of each original image showing various layout configurations in accordance with each layout configuration when the original image contains confidential information. [Means for solving the problem]

[0008] An image processing method according to one aspect of the present invention includes an input step of inputting an original image, a template generation step of generating a template for a document represented by the input original image, a template determination step of determining whether the generated document template matches a predetermined specified template, a keyword acquisition step of acquiring a predetermined specified keyword associated with the predetermined template when it is determined that the template matches the predetermined template, a keyword determination step of determining whether the document represented by the original image contains the specified keyword, a confidentiality setting step of setting the original image as confidential information when it is determined that the specified keyword is contained, a processing determination step of determining whether output of the original image is permitted based on the specified template when the original image is set as confidential information, and an image processing step of outputting the original image when it is determined that output of the original image is permitted.

[0009] According to one aspect of the present invention, there is provided an image processing system including a security management server, an information processing device, and an image forming device which performs data communication between the security management server and the information processing device, the image forming device having a first communication unit which performs data communication with the security management server, an image forming unit which forms an original image on recording paper, a template for a document represented by the inputted original image, and transmits the generated document template from the first communication unit to the security management server, and when a prescribed template which matches the generated document template and a prescribed keyword associated therewith are transmitted from the security management server and received by the first communication unit, determines whether or not the prescribed keyword is included in the document represented by the original image, and when it is determined that the prescribed keyword is included, causes the prescribed template to be transmitted from the first communication unit to the information processing device, and when permission to output the original image is transmitted from the information processing device and received by the first communication unit, causes the image forming device to output the original image by the image forming unit. and a control unit that forms a manuscript image on recording paper, the confidentiality management server comprises a second communication unit that performs data communication with the image forming device, a memory unit that stores the prescribed template and the prescribed keyword associated with the prescribed template, and a second control unit that, when the generated document template is transmitted from the image forming device and received by the second communication unit and the generated document template matches the prescribed template stored in the memory unit, reads the prescribed keyword associated with the prescribed template from the memory unit and causes the second communication unit to transmit it to the image forming device, and the information processing device comprises a third communication unit that performs data communication with the image forming device, a display unit, an operation unit operated by an administrator, and a control unit that, when the prescribed template is transmitted from the image forming device and received by the third communication unit, displays the prescribed template on the display unit, and, when a permission instruction to permit output of the manuscript image is input to the operation unit, causes the third communication unit to transmit the permission instruction to the image forming device.

[0010] According to one aspect of the present invention, there is provided an image processing system including a security management server, an information processing device, and an image forming device which performs data communication between the security management server and the information processing device, the image forming device having a first communication unit which performs data communication with the security management server, an image forming unit which forms an original image on a recording paper, and a first operation unit which is operated by a user, the image forming device generates a template for a document indicated by the inputted original image and transmits the generated document template from the first communication unit to the security management server, and when a prescribed template which matches the generated document template and a prescribed keyword associated therewith are transmitted from the security management server and received by the first communication unit, determines whether the prescribed keyword is included in the document indicated by the original image, and when it is determined that the prescribed keyword is included, causes the prescribed template to be transmitted from the first communication unit to the information processing device, a password is transmitted from the information processing device and received by the first communication unit, and the received password is transmitted to the information processing device. and a control unit that causes the image forming unit to form the document image on recording paper when a password entered by the user through operation of the first operation unit matches a password entered by operation of the first operation unit; the confidentiality management server comprises a second communication unit that performs data communication with the image forming device, a storage unit that stores the predefined template and the predefined keyword associated with the predefined template, and a second control unit that reads out the predefined template and the predefined keyword associated with the predefined template from the storage unit and causes the second communication unit to transmit them to the image forming device when the generated document template is transmitted from the image forming device and received by the second communication unit and the generated document template matches the predefined template stored in the storage unit; the information processing device comprises a third communication unit that performs data communication with the image forming device, a third operation unit operated by an administrator, and a control unit that causes the third communication unit to transmit the password to the image forming device when the predefined template is transmitted from the image forming device and received by the third communication unit and the password is set by operation of the third operation unit;The present invention is provided with the following features. Effect of the Invention

[0011] According to the present invention, when an original image contains confidential information, output of each original image showing various layout configurations can be restricted in accordance with each layout configuration. [Brief description of the drawings]

[0012] [Figure 1] 1 is a block diagram showing an image processing system according to one embodiment of the present invention, and a configuration of an image forming apparatus, a configuration of a secret management server, a configuration of a chatbot server, and a configuration of an information processing apparatus in the image processing system. [Diagram 2] 2 is a diagram conceptually showing management data stored in a storage unit of a secret management server. FIG. [Diagram 3] 13A and 13B are diagrams illustrating examples of prescribed templates. [Figure 4] This is a flowchart showing a control procedure for generating a template for a document represented by an original image, obtaining a specified keyword associated with the specified template if the generated template matches a specified template, and setting the original image as confidential information if the document represented by the original image contains the specified keyword. [Diagram 5] 11 is a diagram illustrating an example of keywords included in a text area in a document image. FIG. [Figure 6] 11 is a flowchart showing a control procedure until the original image is formed on a recording sheet when a prescribed template of a document represented by an original image is notified to an administrator and the administrator permits output of the original image. [Figure 7] FIG. 13 is a diagram showing a warning screen displayed on a display unit of the information processing device. [Figure 8] FIG. 13 is a diagram showing an answer screen displayed on a display unit of the information processing device. [Figure 9] FIG. 13 is a diagram showing a password entry screen displayed on a display unit of the information processing device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] An image processing system according to an embodiment of the present invention will be described below with reference to the drawings. Fig. 1 is a block diagram showing an image processing system according to an embodiment of the present invention, and the configuration of an image forming device, a security management server, a chatbot server, and an information processing device in the image processing system. In the image processing system Sy of this embodiment, an image forming device 10, a security management server 30, a chatbot server 50, and an information processing device 70 are connected via a network (such as an intranet) N.

[0014] In this image processing system Sy, the image forming device 10 is an MFP (multi-function peripheral) having multiple functions such as a copy function and a scanner function. The image forming device 10 includes a display unit 11, an operation unit 12, a touch panel 13, a communication unit 14, an image reading unit 15, an image forming unit 16, a storage unit 18, and a control unit 19. These components are capable of transmitting and receiving data or signals to and from each other via a bus.

[0015] The display unit 11 is configured with a liquid crystal display (LCD) or an organic light-emitting diode (OLED) display.

[0016] A touch panel 13 is overlaid on the screen of the display unit 11. The touch panel 13 detects contact (touch) of a user's finger or the like on the touch panel 13 together with the contact position, and outputs a detection signal indicating the coordinates of the contact position to a control unit 21 of a control unit 19. This makes it possible to operate a GUI (Graphical User Interface) or the like displayed on the screen of the display unit 11 through the touch panel 13. Thus, the touch panel 13 functions as an operation unit into which user operations on the screen of the display unit 11 are input.

[0017] The operation unit 12 includes hardware keys such as a numeric keypad, a decision key, and a start key.

[0018] The image reading unit 15 has a scanner that optically reads an image of a document, and generates image data that represents the document image.

[0019] Image forming unit 16 includes a photosensitive drum, a charging device that uniformly charges the surface of the photosensitive drum, an exposure device that exposes the surface of the photosensitive drum to form an electrostatic latent image on the surface of the photosensitive drum, a developing device that develops the electrostatic latent image on the surface of the photosensitive drum into a toner image, and a transfer device that transfers the toner image (image) on the surface of the photosensitive drum to recording paper, and prints an image represented by the image data on the recording paper.

[0020] The communication unit 14 is a communication interface equipped with a communication module such as a LAN chip. The communication unit 14 is connected to the secret management server 30 and the chatbot server 50 via a network (such as an intranet) N, and performs data communication with the secret management server 30 and the chatbot server 50.

[0021] The storage unit 18 is a large-capacity storage device such as a solid state drive (SSD) or a hard disk drive (HDD), and stores various application programs and various data.

[0022] The control unit 19 is composed of a processor, a RAM (Random Access Memory), a ROM (Read Only Memory), etc. The processor is, for example, a CPU (Central Processing Unit), an ASIC (Application Specific Integrated Circuit), or an MPU (Micro Processing Unit), etc. This control unit 19 functions as a control unit 21 by the processor executing a control program stored in the ROM or the storage unit 18.

[0023] The control unit 19 is responsible for the overall control of the image forming apparatus 10. The control unit 19 is also connected to the display unit 11, the operation unit 12, the touch panel 13, the communication unit 14, the image reading unit 15, the image forming unit 16, and the storage unit 18, and controls each of the above components and transmits and receives signals or data to and from each of the components.

[0024] The control unit 21 serves as a processing unit that executes various processes and has a function of controlling the display unit 11, the communication unit 14, the image reading unit 15, and the image forming unit 16.

[0025] In the image processing system Sy, the security management server 30 is a server that stores and manages management data of multiple subscribers who use the image forming device 10, and corresponds to the server in the claims. The security management server 30 is connected to the image forming device 10 via a network N, and transmits and receives data to and from the image forming device 10. The security management server 30 includes a communication section 34, a storage section 38, and a control unit 39, and these components are capable of transmitting and receiving data or signals to and from each other via a bus.

[0026] The communication unit 34 is a communication interface, and is connected to the image forming apparatus 10 via the network N to transmit and receive data to and from the image forming apparatus 10. The storage unit 38 is a storage device such as an SSD or HDD, and stores programs and various data.

[0027] The control unit 39 is composed of a processor, RAM, ROM, etc., and is responsible for the overall control of the confidential information management server 30. The control unit 39 functions as a control unit 41 by the above-mentioned processor executing a program stored in the above-mentioned ROM or memory unit 38.

[0028] Furthermore, in the image processing system Sy, the chatbot server 50 is connected to the image forming apparatus 10 and the information processing apparatus 70 via the network N, and transmits and receives data to and from the image forming apparatus 10 and the information processing apparatus 70. The chatbot server 50 includes a communication unit 54, a storage unit 58, a control unit 59, and the like, and these components are capable of transmitting and receiving data or signals to and from each other via a bus.

[0029] The communication unit 54 is a communication interface, and is connected to the image forming apparatus 10 and the information processing apparatus 70 through the network N, and transmits and receives data to and from the image forming apparatus 10 and the information processing apparatus 70. The storage unit 58 is a storage device such as an SSD or HDD, and stores programs and various data.

[0030] The control unit 59 is composed of a processor, RAM, ROM, etc., and is responsible for the overall control of the chatbot server 50. The control unit 59 functions as a control unit 61 by the above-mentioned processor executing a program stored in the above-mentioned ROM or memory unit 58.

[0031] Furthermore, in the image processing system Sy, the information processing device 70 is, for example, a portable terminal device, which is connected to the chatbot server 50 via the network N and transmits and receives data to and from the chatbot server 50. The information processing device 70 includes a display unit 71, a touch panel 73 provided on the screen of the display unit 71, a communication unit 74, a memory unit 78, and a control unit 79, and these components are capable of transmitting and receiving data or signals to and from each other via a bus.

[0032] The communication unit 74 is a communication interface, and is connected to the chatbot server 50 via the network N to transmit and receive data to and from the chatbot server 50. The storage unit 78 is a storage device such as an SSD or HDD, and stores programs and various data.

[0033] The control unit 79 is composed of a processor, RAM, ROM, etc., and is responsible for the overall control of the information processing device 70. The control unit 79 functions as a control unit 81 by the above-mentioned processor executing a program stored in the above-mentioned ROM or storage unit 78.

[0034] Here, in the image forming apparatus 10, an original image obtained by reading an original by the image reading unit 15 is formed on a recording sheet by the image forming unit 16. However, if the original image obtained by reading an original by the image reading unit 15 is confidential information, it is necessary to restrict the output of the original image. Furthermore, if the original image is confidential information, it is preferable to restrict the output of each original image showing various layout configurations in accordance with each layout configuration.

[0035] Therefore, in the image processing system Sy of this embodiment, when the document image read by the image reading unit 15 contains confidential information, the image forming device 10, the confidentiality management server 30, the chatbot server 50, and the administrator's information processing device 70 cooperate to restrict the output of the document image.

[0036] The control unit 21 of the image forming apparatus 10 analyzes the original image obtained by document reading using the image reading unit 15, generates a template of the document represented by the original image, and transmits this template from the communication unit 14 to the confidentiality management server 30 via the network N.

[0037] In the confidential information management server 30, when a template is received by the communication unit 34, the control unit 41 determines whether the template matches a predetermined default template, and if it is determined that the template matches the default template, transmits the default template and the default keyword associated with the default template from the communication unit 34 to the image forming device 10 via the network N.

[0038] In the image forming device 10, when the prescribed template and prescribed keyword are received by the communication unit 14, the control unit 21 determines whether or not the prescribed keyword is included in the document shown by the original image, and sets the original image as confidential information if it is determined that the prescribed keyword is included. Then, the control unit 21 of the image forming device 10 transmits the received prescribed template that matches the template of the document shown by the original image, a request to start interactive communication with an administrator, and the like from the communication unit 14 to the chatbot server 50 via the network.

[0039] In the chatbot server 50, when the communication unit 54 receives a specified template and a request to start interactive communication with an administrator, the control unit 61 transmits alert information indicating that the scanned manuscript is confidential information and including the specified template from the communication unit 54 via the network N to the administrator's information processing device 70, and starts interactive communication with the information processing device 70.

[0040] In the information processing device 70, when the alert information is received by the communication unit 74, the control unit 81 causes a prescribed template or the like to be displayed on the display unit 71. When an instruction for permission to permit output of an original image set as confidential information is input by an administrator through an operation of a GUI or the like displayed on the display unit 71, the control unit 81 transmits permission information indicating that output of the original image is permitted from the communication unit 74 to the chatbot server 50 via the network in accordance with the instruction for permission.

[0041] The permission information is received by the chatbot server 50 and transmitted from the chatbot server 50 to the image forming apparatus 10 via the network N.

[0042] In the image forming apparatus 10, when the permission information is received by the communication unit 14, the control unit 21 causes the image forming unit 16 to form, on a recording sheet, an original image obtained by the image reading unit 15 reading the original.

[0043] Here, a plurality of prescribed templates and respective prescribed keywords associated with each prescribed template are stored in the storage unit 38 of the confidentiality management server 30. For example, the prescribed templates and prescribed keywords are stored in the storage unit 38 of the confidentiality management server 30 as management data DT as shown in Fig. 2. In the management data DT, for example, a subscriber's license key, a prescribed template, and at least one prescribed keyword are stored in association with each other.

[0044] Each of the prescribed templates and each of the prescribed keywords are arbitrarily set by a plurality of subscribers who use the image forming system Sy. Each subscriber is given a license key by the administrator, accesses the confidentiality management server 30 from his / her terminal device through the network N, sets his / her license key and his / her prescribed template that he / she wants to manage as confidential information, and further arbitrarily sets a prescribed keyword (e.g., a character string such as "important document", "confidential information", "confidential", etc.) associated with the prescribed template, and stores the prescribed template and the prescribed keyword together with his / her license key in the management data DT in the storage unit 38 of the confidentiality management server 30. Therefore, another user who is not given a license key cannot store or update the prescribed template and the prescribed keyword. In addition, the administrator receives the alert information, decides whether or not to permit output of the document image based on the alert information, and transmits information indicating the decision result from his / her information processing device 70 to the image forming device 10. This makes it possible to restrict the output of the document image, which is confidential information. Incidentally, granting a license key means notifying the license key.

[0045] Fig. 3(A) shows an example of a default template. As shown in Fig. 3(A), the default template TP1 is defined by the positions of a plurality of text regions TR11, TR12, TR13, a signature region SR11, and a date region HR11. The default keyword associated with the default template TP1 is included in any of the regions in the default template TP1. The default template TP1 and the default keyword associated with the default template TP1 are stored in management data DT in the memory unit 38 of the confidential information management server 30.

[0046] Fig. 3(B) shows another example of a default template. As shown in Fig. 3(B), the default template TP2 is defined by the positions of a plurality of text regions TR21, TR22, TR23, a text image region TGR21, an image region GR21, a signature region SR21, and a date region HR21. The default keyword associated with the default template TP2 is included in one of the regions in the default template TP2. The default template TP2 and the default keyword associated with the default template TP2 are stored in management data DT in the memory unit 38 of the confidential information management server 30.

[0047] Here, a process for generating a template of a document represented by an original image in the image forming apparatus 10 will be described.

[0048] In the image forming apparatus 10, when an original image is read by the image reading unit 15, the control unit 21 recognizes a text group included in the original image by, for example, a known OCR (Optical Character Reader) function or an AI (artificial intelligence)-OCR function, and recognizes a rectangular area consisting only of the text group as a text area. Furthermore, the control unit 21 recognizes a signature area (area of ​​a person's name) and a date area included in the original image by the OCR function or a function combining AI-OCR and NER (Named Entity Recognition).

[0049] For example, the control unit 21 determines whether or not the text constituting the text area includes a preset signature character string suggesting a signature (e.g., character strings such as "signature" and "name"). If the control unit 21 determines that a signature character string is present, it determines whether an area indicating a margin is adjacent to the signature character string and exists with a prescribed size or larger. If there is a margin area adjacent to the signature character string and with a prescribed size or larger, the control unit 21 recognizes the area consisting of the signature character string and the margin area as a signature area.

[0050] Furthermore, for example, the control unit 21 determines whether or not the text constituting the text area includes a preset date string suggesting a date (for example, a string such as a character group consisting of a combination of "year," "month," and "day"). If the control unit 21 determines that a date string exists, it determines whether or not an area indicating a blank space exists between each character constituting the date string. If there is a blank space between the characters constituting the date string, the control unit 21 recognizes the area consisting of the date string and the blank space as a date area.

[0051] Also, for example, the control unit 21 recognizes an area consisting only of an image included in the document image as an image area. Furthermore, the control unit 21 recognizes a text image area consisting of a text area and an image area adjacent to each other.

[0052] Then, the control unit 21 generates a template indicating the arrangement position of each area in the document image based on the determination result of each area. The control unit 21 transmits this template from the communication unit 14 to the confidential information management server 30 via the network N.

[0053] Next, a method for determining whether a template received from the image forming apparatus 10 is identical to a stored default template in the confidential information management server 30 will be described.

[0054] In the confidentiality management server 30, when the communication unit 34 receives a template indicating the arrangement position of each area in the document image, the control unit 41 judges, for each of the prescribed templates TP1, TP2, ... stored in the management data DT in the storage unit 38 of the confidentiality management server 30, whether or not the arrangement position of each area in the received template matches the arrangement position of each area in the prescribed template, and judges the prescribed template in which the arrangement positions of the areas match. For example, when the control unit 41 judges that the arrangement positions of each text area in the received template match the arrangement positions of each text area TR11-TR13 in the prescribed template TP1, and also judges that the arrangement positions of the signature area and date area in the received template match the arrangement positions of the signature area SR11 and the date area HR11 in the prescribed template TP1, it judges the prescribed template TP1 as the template that matches the template indicating the arrangement positions of each area in the document image.

[0055] Alternatively, when the control unit 41 of the confidentiality management server 30 determines that the position of each text area in the received template matches the position of each text area TR21-TR23 in the prescribed template TP2, and also determines that the position of the text image area and image area in the received template matches the position of the text image area TGR21 and image area GR21 in the prescribed template TP2, and further determines that the position of the signature area and date area in the received template matches the position of the signature area SR21 and date area HR21 in the prescribed template TP2, it determines that the prescribed template TP2 is a template that matches the template indicating the position of each area in the document image. That is, in this case, the received template matches the prescribed keyword stored as confidential information.

[0056] Note that the above-mentioned "match" includes cases where the placement positions differ within a predetermined range (for example, a value that can be determined as an error).

[0057] Then, the control unit 41 of the confidentiality management server 30 reads out the specified keyword associated with the specified template that matches the received template from the management data DT in the memory unit 38, and transmits this specified keyword from the communication unit 34 to the image forming device 10 via the network N.

[0058] In the image forming apparatus 10, when the communication unit 14 receives the specified keyword and the control unit 21 determines that the document represented by the original image contains the specified keyword, the original image is set as confidential information.

[0059] Next, a process for setting an original image as confidential information in the image processing system Sy will be described with reference to the flowchart shown in FIG.

[0060] In image forming apparatus 10, when a user places a document in image reading unit 15, operates the GUI on the screen of display unit 11 to input an instruction to select a copy job, and operates the start key on operation unit 12, control unit 21 accepts the instruction to select a copy job via touch panel 13 and starts the copy job, causes image reading unit 15 to read the document, and stores the document image obtained by reading the document in memory unit 18 (S101).

[0061] Based on the document image, the control unit 21 recognizes the text, text area, text image area, image area, signature area, and date area contained in the document image by the above-mentioned method, and creates a template indicating the arrangement position of each area (S102).Then, the control unit 21 transmits this template from the communication unit 14 to the confidentiality management server 30 via the network N (S103).

[0062] In the confidentiality management server 30, when a template is received by the communication unit 34 (S201), the control unit 41 compares the received template with each of the standard templates TP1, TP2, ... stored in the management data DT in the memory unit 38, and determines whether there is a standard template that matches the received template.The control unit 41 transmits the determination result, i.e., information indicating whether there is a standard template that matches the template indicated by the original image, from the communication unit 34 to the image forming apparatus 10 via the network N (S202).

[0063] In the image forming apparatus 10, the above information is received by the communication unit 14 (S104), and when the control unit 21 determines that the above information indicates that there is no prescribed template that matches the template indicated by the document image (S105 "No"), the document image obtained by document reading by the image reading unit 15 is not set as confidential information (S106). The control unit 21 causes the image forming unit 16 to form the document image on recording paper (S107). Therefore, if the document image is not confidential information, the document image is immediately formed on recording paper.

[0064] On the other hand, when the control unit 21 determines that the above information indicates that there is a specified template that matches the template indicated by the document image (S105 "Yes"), the control unit 21 sends a request for the specified keyword from the communication unit 14 to the confidentiality management server 30 via the network N (S108).

[0065] In the confidentiality management server 30, when a request for a specified keyword is received by the communication unit 34 (S203), the control unit 41 reads out the specified keyword associated with the specified template determined in S202 from the management data DT in the memory unit 38, and transmits the specified keyword from the communication unit 34 to the image forming device 10 via the network N (S204).

[0066] In the image forming apparatus 10, when the communication unit 14 receives the specified keyword (S109), the control unit 21 determines whether or not the specified keyword is included in the text in the text area recognized in S102, the text in the text image area, the name in the signature area, and the date in the date area (S110). For example, when the control unit 21 determines that the specified keyword is not included (S110 "No"), it does not set the document image read by the image reading unit 15 as confidential information (S106), and causes the image data representing the document image to be input from the storage unit 18 to the image forming unit 16, and causes the image forming unit 16 to form the document image on a recording sheet (S107).

[0067] Furthermore, when the control unit 21 of the image forming device 10 determines that the specified keyword is included (S110 "Yes"), it sets the document image read by the image reading unit 15 as confidential information (S111) and suspends the formation of the document image on recording paper by the image forming unit 16 (S112).

[0068] For example, when a plurality of prescribed keywords Kw are set in association with the prescribed template TP1, the control unit 21 determines whether any of the prescribed keywords Kw is included in the text group included in the document image obtained by document reading by the image reading unit 15, and when it determines that none of the prescribed keywords Kw is included, it does not set the document image as confidential information, and causes the image forming unit 16 to form the document image on recording paper. Also, as shown in Fig. 5, when the control unit 21 determines that at least one prescribed keyword Kw is included in the text group included in the document image obtained by document reading by the image reading unit 15, it sets the document image as confidential information, and suspends the formation of the document image on recording paper by the image forming unit 16.

[0069] Next, the process of obtaining output permission for an original image from an administrator and outputting the image will be described in detail with reference to the flowchart shown in FIG.

[0070] In the process shown in FIG. 4, when the control unit 21 of the image forming device 10 sets the original image as confidential information in S111 and puts the formation of the original image on hold in S112, the control unit 21 transmits a template (predefined template) indicating the position of each area in the original image created in S102, the name of the image forming device 10, the IP address of the image forming device 10, the current date and time, and a request to start interactive communication with the administrator from the communication unit 14 to the chatbot server 50 via the network (S113).

[0071] In the chatbot server 50, when the communication unit 54 receives the specified template, the name and IP address of the image forming device 10, the current date and time, and a request to start conversational communication with the administrator (S301), the control unit 61 accesses the IP address of the administrator's information processing device 70 (i.e., the administrator's information processing device 70) pre-stored in the memory unit 58 via the network N in order to start conversational communication with the administrator, and transmits a standard warning screen read from the memory unit 58 and alert information including information indicating that the original image is confidential information (the specified template, the name and IP address of the image forming device 10, the current date and time, etc.) from the communication unit 54 via the network N to the administrator's information processing device 70 (S302).

[0072] In the information processing device 70, when the alert information and the warning screen are received by the communication unit 74, the control unit 81 causes the display unit 71 to display a warning screen including the information indicated by the alert information (S401). For example, when the template indicated by the document image matches a prescribed template TP1 including each of the text areas TR11 to TR13, the signature area SR11, and the date area HR11 as shown in Fig. 3(A), a warning screen G1 as shown in Fig. 7 is displayed on the display unit 71 of the information processing device 70. The prescribed template TP1 is displayed on the warning screen G1, and a message E1 indicating that the document image is confidential information, the name M1 of the image forming device 10, the IP address A1, and the current date and time D1 are also displayed.

[0073] The administrator of the information processing device 70 judges whether or not to permit output of the original image by looking at the specified template TP1, message E1, name M1 of the image forming device 10, IP address A1, current date and time D1, etc. displayed on the display unit 71. When the administrator inputs a response screen request by operating the touch panel 73 on the information processing device 70, the control unit 81 causes the communication unit 74 to transmit the response screen request to the chatbot server 50 (S402).

[0074] In the chatbot server 50, when a request for an answer screen is received by the communication unit 54 (S303), the control unit 61 reads out from the memory unit 58 a standard answer screen including a message asking whether to allow the output of the manuscript image and respective keys for selecting whether to allow or not allow the output of the manuscript image, and transmits data showing the answer screen from the communication unit 54 to the administrator's information processing device 70 via the network N (S304).

[0075] In the information processing device 70, when the data for the answer screen is received by the communication unit 74, the control unit 81 causes the display unit 71 to display an answer screen G2 as shown in Fig. 8, which is indicated by the data for the answer screen (S403). For example, the answer screen G2 shown in Fig. 8 displays a message E2 asking whether or not to permit output of the original image, a key K11 for instructing permission to output the original image, a key K12 for instructing not to permit output of the original image, a message E1, the name M1 of the image forming device 10, an IP address A1, and the current date and time D1.

[0076] In the information processing device 70, when an administrator touches key K11 or key K12 to input a permission instruction to permit output of a document image or a disallowance instruction to disallow output of the document image, the control unit 81 transmits the input permission instruction or disallowance instruction as a judgment result from the communication unit 74 to the chatbot server 50 via the network N (S404).

[0077] When the communication unit 54 receives the permission instruction, the chatbot server 50 transmits the permission instruction from the communication unit 54 to the image forming apparatus 10 via the network N (S305).

[0078] In the image forming device 10, when the above permission instruction is received by the communication unit 14 (S114), the control unit 21 determines that output of the original image is permitted (S115 "Yes"), resumes the image formation that was put on hold in S112 in the processing shown in FIG. 4, and causes the image forming unit 16 to form the original image on recording paper (S116).

[0079] Therefore, even if the document image is set as confidential information, if the administrator of the information processing device 70 permits the document image to be output, the document image is output by the image forming device 10.

[0080] Furthermore, in the chatbot server 50, when the communication unit 54 receives the non-permission instruction, the communication unit 54 transmits the non-permission instruction to the image forming apparatus 10 through the network N (S305).

[0081] In the image forming device 10, when the above-mentioned disallowance instruction is received by the communication unit 14 (S114), the control unit 21 determines that the output of the original image is not permitted (S115 "No") and deletes the stored original image without causing the image forming unit 16 to form the original image on recording paper, i.e., without resuming the image formation that was put on hold in S112 in the processing shown in FIG. 4.

[0082] In this manner, in the image processing system of this embodiment, a prescribed template and a prescribed keyword associated with the prescribed template are set for each of a plurality of subscribers, a template of a document shown by an original image is generated, and if the generated template matches the prescribed template, the prescribed keyword associated with the prescribed template is acquired, and if the document shown by the original image contains the prescribed keyword, the original image is set as confidential information, and if the administrator permits the formation of the original image, the original image is formed on recording paper. This makes it possible to restrict the output of each original image showing various layout configurations according to each layout configuration when the original image is confidential information.

[0083] When the chatbot server 50 receives the non-permission instruction through the communication unit 54, the control unit 61 of the chatbot server 50 may transmit a standard password input screen G3 (image data thereof; the same applies below for each screen) as shown in FIG. 9 from the communication unit 54 to the administrator's information processing device 70 through the network N. When the password input screen G3 is received through the communication unit 74 in the information processing device 70, the control unit 81 causes the display unit 71 to display the password input screen G3. The administrator of the information processing device 70 inputs a password into the password input field PW1 of the password input screen G3 through the touch panel 73. This password is a password that is notified in advance to the user who uses the image forming device 10 in order to resume the image formation that was put on hold in S112 in the process shown in FIG. 4, even if the non-permission instruction is received. When the user inputs the password in the information processing device 70, the password is transmitted from the information processing device 70 to the image forming device 10 via the chatbot server 50.

[0084] In image forming apparatus 10, when a password is received by communication unit 14, a password entry field is displayed on the screen of display unit 11. A user of image forming apparatus 10 operates operation unit 12 to input a previously notified password through the entry field. When the password input through the entry field matches the password received by communication unit 14, control unit 21 of image forming apparatus 10 causes image forming unit 16 to form an original image on recording paper, i.e., resumes image formation that was put on hold in S112 in the process shown in FIG. 4.

[0085] Furthermore, if the input password does not match the password received by the communication unit 14, the control unit 21 of the image forming device 10 deletes the original image without forming an original image on recording paper by the image forming unit 16. Furthermore, after relaying the password from the information processing device 70 to the image forming device 10, the control unit 61 of the chatbot server 50 deletes the password that was input in the password input field PW1 and stored in, for example, an internal memory. This prevents the password from being leaked.

[0086] Also, the warning screen G1, the answer screen G2, and the password input screen (a password input screen when a password is not entered in the password input field) G3 transmitted from the chatbot server 50 to the information processing device 70 may be transmitted from the chatbot server 50 to the image forming device 10, and the control unit 21 of the image forming device 10 may display those screens G1, G2, and G3 on the display unit 11. However, when a user who is not the administrator (a user who has caused the image reading unit 15 to read a document) is logged in to the image forming device 10, the control unit 21 does not accept password input via the operation unit 12 or the touch panel 13 for the above-mentioned screens G1, G2, and G3 displayed on the display unit 11 of the image forming device 10. In other words, the user of the image forming device 10 only wants to understand the conversational communication between the chatbot server 50 and the administrator.

[0087] Furthermore, the control unit 61 of the chatbot server 50 may perform conversational communication with the information processing device 70 of multiple administrators in parallel. In this case, the control unit 61 transmits a warning screen G1 to each of the information processing devices 70 of the multiple administrators, and enables conversational communication between each of the multiple administrators and the chatbot server 50. After that, when conversational communication is started in the chatbot server 50 with the information processing device 70 of any administrator, the control unit 61 transmits an answer screen G2, a password input screen G3, etc. from the communication unit 54 only to the information processing device 70 of the administrator who has started conversational communication, and performs conversational communication only with the information processing device 70 of the administrator.

[0088] In addition, while the above embodiment uses the chatbot server 50, the chatbot server 50 may be omitted and the image forming device 10 may store the warning screen G1, answer screen G2, and password input screen G3 in its memory unit 189. The control unit 21 may then transmit these screens G1, G2, and G3 from the communication unit 14 to the information processing device 70, thereby enabling conversational communication between the image forming device 10 and the information processing device 70.

[0089] The present invention is not limited to the configuration of the above embodiment, and various modifications are possible. For example, in the above embodiment, the output of the document image to be restricted when the document image is confidential information is described by taking the image formation by the image forming unit 16 as an example, but in addition to or instead of this, other output processes such as a process of transmitting the document image obtained by document reading by the image reading unit 15 from the communication unit 14 to an external device, or a process of storing and saving the document image in the storage unit 18 may be restricted.

[0090] In the above-mentioned embodiments, the configurations and processes of the above-mentioned embodiments explained using FIG. 1 to FIG. 9 are merely examples of the present invention, and the present invention is not limited to these configurations and processes. [Explanation of symbols]

[0091] 10 Image forming device 11 Display section 12 Control section 13 Touch Panel 14 Communications Department 15 Image reading unit 16 Image forming section 18 Memory section 19 Control Unit 21 Control section 30 Secret Management Server 34 Communications Department 38 Memory section 39 Control Unit 41 Control section 50 Chatbot Servers 54 Communications Department 58 Memory section 59 Control Unit 61 Control section 70 Information processing equipment 71 Display section 73 Touch Panel 74 Communications Department 78 Memory section 79 Control Unit 81 Control Unit

Claims

1. an input step of inputting an original image; a template generating step of generating a template of a document represented by the input original image; a template determination step of determining whether the template of the generated document matches a preset specified template; a keyword acquiring step of acquiring a predetermined keyword that is associated with the predetermined template when it is determined that the predetermined template matches the predetermined template; a keyword determination step of determining whether the document represented by the original image includes the specified keyword; a confidentiality setting step of setting the document image as confidential information when it is determined that the specified keyword is included; a process determination step of determining whether or not to permit output of the document image based on the specified template when the document image is set as confidential information; an image processing step of outputting the document image when it is determined that the output of the document image is permitted.

2. 2. The image processing method according to claim 1, wherein the processing determination step includes: a step of notifying an administrator of an alert indicating that the template of the generated document is the specified template; and a step of receiving from the administrator whether or not to permit output of the original image.

3. 2. The image processing method according to claim 1, wherein the processing determination step includes a step of notifying an administrator of an alert indicating that the template of the generated document is the specified template, a step of receiving a password from the administrator, a step of inputting the password, and a step of allowing output of the original image if the input password matches the password received from the administrator.

4. 2. The image processing method according to claim 1, wherein, in the image processing step, when it is determined that output of the document image is not permitted, the document image is erased.

5. An image processing system including a security management server, an information processing device, and an image forming device that performs data communication between the security management server and the information processing device, The image forming apparatus includes: A first communication unit that performs data communication with the secret management server; an image forming section for forming an image of an original on a recording sheet; a control unit that generates a document template represented by the input original image, and transmits the generated document template from the first communication unit to the security management server, and when a prescribed template that matches the generated document template and a prescribed keyword associated therewith are transmitted from the security management server and received by the first communication unit, determines whether or not the document represented by the original image includes the prescribed keyword, and when it is determined that the prescribed keyword is included, causes the prescribed template to be transmitted from the first communication unit to the information processing device, and when permission to output the original image is transmitted from the information processing device and received by the first communication unit, causes the image forming unit to form the original image on recording paper, The security management server includes: A second communication unit that performs data communication with the image forming apparatus; a storage unit that stores the predetermined template and the predetermined keyword associated with the predetermined template; a second control unit that, when the template of the generated document is transmitted from the image forming device and received by the second communication unit, and the template of the generated document matches a prescribed template stored in the storage unit, reads out the prescribed keyword associated with the prescribed template from the storage unit and causes the second communication unit to transmit the prescribed keyword to the image forming device; The information processing device includes: a third communication unit that performs data communication with the image forming apparatus; A display unit; an operation unit operated by an administrator; a control unit that, when the specified template is transmitted from the image forming device and received by the third communication unit, causes the display unit to display the specified template, and, when a permission instruction to permit output of the document image is input to the operation unit, causes the third communication unit to transmit the permission instruction to the image forming device.

6. Equipped with a chatbot server, a first control unit of the image forming device, when it is determined that the specified keyword is included, transmits the specified template from the first communication unit to the information processing device through the chatbot server, and when permission to output the document image is transmitted from the information processing device and received by the first communication unit through the chatbot server, causes the image forming unit to form the document image on recording paper; The image processing system of claim 5, wherein a third control unit of the information processing device, when the specified template is transmitted from the image forming device and received by the third communication unit via the chatbot server, causes the third control unit to display the specified template on the display unit, and, when output of the original image is permitted by operation of the operation unit, causes permission to output the original image to be transmitted from the third communication unit via the chatbot server to the image forming device.

7. An image processing system including a security management server, an information processing device, and an image forming device that performs data communication between the security management server and the information processing device, The image forming apparatus includes: A first communication unit that performs data communication with the secret management server; an image forming section for forming an image of an original on a recording sheet; A first operation unit operated by a user; a control unit that generates a document template indicated by the input original image, and transmits the generated document template from the first communication unit to the security management server, and when a prescribed template that matches the generated document template and a prescribed keyword associated therewith are transmitted from the security management server and received by the first communication unit, determines whether or not the document indicated by the original image includes the prescribed keyword, and when it is determined that the prescribed keyword is included, causes the prescribed template to be transmitted from the first communication unit to the information processing device, and when a password is transmitted from the information processing device and received by the first communication unit, causes the image forming unit to form the original image on recording paper when the received password matches a password input by operating the first operation unit, The security management server includes: A second communication unit that performs data communication with the image forming apparatus; a storage unit that stores the predetermined template and the predetermined keyword associated with the predetermined template; a second control unit that, when the generated document template is transmitted from the image forming device and received by the second communication unit, and the generated document template matches a prescribed template stored in the storage unit, reads out the prescribed template and the prescribed keyword associated therewith from the storage unit and transmits them from the second communication unit to the image forming device; The information processing device includes: a third communication unit that performs data communication with the image forming apparatus; a third operation unit operated by an administrator; a control unit that, when the specified template is transmitted from the image forming device and received by the third communication unit, and the password is set by operating the third operation unit, transmits the password from the third communication unit to the image forming device.

8. Equipped with a chatbot server, a first control unit of the image forming device, when it is determined that the specified keyword is included, transmits the specified template from the first communication unit through the chatbot server to the information processing device, and when the password is transmitted from the information processing device and received by the first communication unit through the chatbot server, and the received password matches a password input by operating the first operation unit, causes the image forming unit to form the document image on recording paper; The image processing system according to claim 7 , wherein the chatbot server erases the stored password after the password is transmitted from the information processing device and received by the image forming device via the chatbot server.

Images