Information processing device

The information processing device addresses the challenge of controlling image data leakage by embedding digital watermarks, enabling easy retrieval and tracing of outputted data, thus strengthening data management.

JP2024158509AInactive Publication Date: 2024-11-08KYOCERA DOCUMENT SOLUTIONS INC
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
JP2023073765
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-04-27
Publication Date
2024-11-08
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

Existing image data management techniques fail to control the source of leakage and facilitate easy search and tracing of outputted image data.

Method used

An information processing device with an acquisition unit, output unit, input unit, and control unit that generates and embeds digital watermarks in image data, allowing for easy retrieval and tracing of outputted data based on tag information.

Benefits of technology

Facilitates easy search and tracing of outputted image data, enhancing data management by enabling tracking of leakage sources through digital watermarks.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024158509000001_ABST
    Figure 2024158509000001_ABST
Patent Text Reader

Abstract

To further strengthen the management of image data by making it easier to search for the image data and also allowing the source of outflow or the like of output image data to be tracked or analyzed.SOLUTION: When a control unit 10 receives an instruction to specify tag information and image data via an operation unit 16, the control unit generates a digital watermark including a tag indicating the tag information and embeds it in the specified image data. When the control unit 10 receives tag information and an instruction to output tagged image data via the operation unit 16, the control unit extracts the tagged image data having the digital watermark including the tag indicating the tag information from among multiple pieces of image data, and causes an image forming unit 12 or the like or a communication unit 22 to output it.SELECTED DRAWING: Figure 3B
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an information processing apparatus, and more particularly to a technique for managing a plurality of image data. [Background technology]

[0002] There are known techniques for managing image data, etc. For example, Patent Document 1 discloses a technique for registering scanned data in advance in association with a tag, and searching for scanned data from a database using the tag. Patent Document 2 discloses a technique for attaching a tag to all confidential documents having watermark information in advance, and printing tagged documents together with the watermark information. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2007-188479 A [Patent Document 2] JP 2002-373063 A Summary of the Invention [Problem to be solved by the invention]

[0004] Incidentally, the technologies disclosed in Patent Documents 1 and 2 can facilitate the search for image data and the management of confidential documents, but are not technologies capable of managing the source of the output image data, etc.

[0005] The present invention has been developed in consideration of the above-mentioned circumstances, and aims to further strengthen the management of image data by making it easier to search for image data and by making it possible to trace or analyze the source of output image data.

[0006] The present invention has been developed in consideration of the above-mentioned circumstances, and aims to further strengthen the management of image data by making it easier to search for image data and by making it possible to trace or analyze the source of output image data. [Means for solving the problem]

[0007] An information processing device according to one aspect of the present invention includes an acquisition unit that acquires multiple image data, an output unit that outputs the image data, an input unit to which a user's instructions are input, and a control unit that, upon receiving an instruction to specify tag information and image data via the input unit, generates a digital watermark including a tag indicating the tag information and embeds the digital watermark in the specified image data. Upon receiving an instruction to output tagged image data and the tag information via the input unit, the control unit extracts tagged image data having a digital watermark including a tag indicating the input tag information from among the multiple image data, and outputs the extracted data to the output unit. Effect of the Invention

[0008] According to the present invention, a user can extract image data to be output from among multiple image data by a simple operation of inputting tag information, making it easy to search for image data. In addition, since a digital watermark is used for tagging, it becomes possible to trace or analyze the source of the output image data based on the digital watermark, and the management of image data can be further strengthened. [Brief description of the drawings]

[0009] [Figure 1] 1 is a front cross-sectional view showing a configuration of an image forming apparatus. [Diagram 2] 1 is a block diagram showing an internal configuration of an image forming apparatus; [Figure 3A] 13 is a flowchart showing a scanning process. [Figure 3B] 13 is a flowchart showing a scanning process. [Figure 4] FIG. 11 is a diagram showing an example of a first selection screen. [Diagram 5] FIG. 11 is a diagram showing an example of a first input screen. [Figure 6] FIG. 11 is a diagram showing an example of a second selection screen. [Figure 7] FIG. 13 is a diagram showing an example of a third selection screen. [Figure 8A] 13 is a flowchart showing a tagging process. [Figure 8B] 13 is a flowchart showing a tagging process. [Figure 9] FIG. 13 is a diagram showing an example of a fourth selection screen. [Figure 10A] 13 is a flowchart showing a tagged data output process. [Figure 10B] 13 is a flowchart showing a tagged data output process. [Figure 10C] 13 is a flowchart showing a tagged data output process. [Figure 10D] 13 is a flowchart showing a tagged data output process. [Figure 11] FIG. 13 is a diagram showing an example of a fifth selection screen. [Figure 12] FIG. 13 is a diagram showing an example of a sixth selection screen. [Figure 13] FIG. 13 is a diagram showing an example of a second input screen. [Figure 14] FIG. 13 is a diagram showing an example of a seventh selection screen. [Figure 15] FIG. 13 is a diagram showing an example of an eighth selection screen. [Figure 16] FIG. 13 is a diagram showing an example of a ninth selection screen. [Figure 17] FIG. 13 is a diagram showing an example of a tenth selection screen. [Figure 18] FIG. 17 is a diagram showing an example of an eleventh selection screen. [Figure 19A] 13 is a flowchart showing a tag editing process. [Figure 19B] 13 is a flowchart showing a tag editing process. [Figure 19C] 13 is a flowchart showing a tag editing process. [Figure 20] FIG. 15 is a diagram showing an example of a twelfth selection screen. [Figure 21] FIG. 13 is a diagram showing an example of a change screen. [Figure 22] 13 is a flowchart showing a user setting process. [Diagram 23] FIG. 13 is a diagram showing an example of a thirteenth selection screen. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, an image forming apparatus as an information processing apparatus according to an embodiment of the present invention will be described with reference to the drawings. Fig. 1 is a front cross-sectional view showing the configuration of an image forming apparatus 1 according to an embodiment of the present invention. Fig. 2 is a block diagram showing the internal configuration of the image forming apparatus 1.

[0011] 1, the image forming apparatus 1 is a color multifunction machine having multiple functions such as a facsimile function, a copy function, a printer function, a scan function, etc. The housing of the image forming apparatus 1 contains an image reading unit 11, an image forming unit 12, a fixing unit 13, a paper feeding unit 14, etc.

[0012] The image reading unit 11 is an ADF (Auto Document Feeder) including an original transport unit 6 that transports an original placed on an original table, and a scanner that optically reads an original transported by the original transport unit 6 or an original placed on a platen glass 7. The image reading unit 11 reads the original by illuminating the original with a light irradiation unit and receiving reflected light with a CCD (Charge-Coupled Device) sensor, thereby generating image data (hereinafter referred to as "scan data"). The image reading unit 11 is an example of an acquisition unit in the claims.

[0013] The image forming unit 12 includes a photoconductor drum, a charging device, an exposure device, a developing device, and a transfer device. The image forming unit 12 forms a toner image on the recording paper P conveyed from the paper feed unit 14 based on the image data generated by the image reading unit 11.

[0014] The fixing unit 13 heats and pressurizes the recording paper P on which the toner image has been formed by the image forming unit 12, thereby fixing the toner image to the recording paper P. The recording paper P on which the toner image has been fixed by the fixing unit 13 is discharged to the discharge tray 8.

[0015] The paper feed unit 14 includes a manual feed tray and a paper feed cassette. The paper feed unit 14 pulls out recording paper P stored in the paper feed cassette or recording paper P placed on the manual feed tray one sheet at a time and feeds the paper toward the image forming unit 12. The image forming unit 12, the fixing unit 13, the paper feed unit 14, and a transport mechanism 18 described later are examples of an output unit within the scope of the claims.

[0016] 2, the image forming apparatus 1 includes a control unit 100. The control unit 100 includes a processor, a random access memory (RAM), a read only memory (ROM), etc. The processor is, for example, a central processing unit (CPU), a micro processing unit (MPU), or an application specific integrated circuit (ASIC).

[0017] The control unit 100 functions as a control unit 10 by the processor executing a control program stored in a ROM or a HDD (Hard Disk Drive) 17. The control unit 10 is responsible for the overall control of the image forming apparatus 1. More specifically, the control unit 10 controls the operation of each part of the image forming apparatus 1 and communication with an external device 23 and the like connected via a network. Note that the control unit 10 may be configured by a logic circuit, regardless of the operation based on the control program.

[0018] The control unit 100 is electrically connected to an image reading unit 11, an image forming unit 12, a fixing unit 13, a paper feeding unit 14, a display unit 15, an operation unit 16, a HDD 17, a conveying mechanism 18, an image processing unit 19, an image memory 20, a facsimile communication unit 21, and a communication unit 22, etc.

[0019] The display unit 15 is a display device configured with a liquid crystal display, etc. The display unit 15 displays various screens relating to various functions that can be executed by the image forming apparatus 1.

[0020] The operation unit 16 includes a plurality of hard keys such as a start key 16A for instructing the start of execution of various functions. The operation unit 16 also includes a touch panel 16B disposed on top of the display unit 15. A user inputs various information such as instructions regarding various functions that can be executed by the image forming apparatus 1 via the operation unit 16. The operation unit 16 is an example of an input unit in the claims.

[0021] The HDD 17 is a large-capacity storage device for storing various data such as image data generated by the image reading unit 11. The HDD 17 is an example of an acquisition unit in the claims. The HDD 17 stores, for each user, a password corresponding to the user ID of a user permitted to log in to the image forming apparatus 1 as authentication information to be used for login authentication.

[0022] The HDD 17 stores user information for identifying each user. In this embodiment, the user information includes a user ID, a user name, and information indicating a user type (general user or administrator).

[0023] The HDD 17 may also store restriction information indicating that tagging is restricted, in association with the user information. The control unit 10 causes the HDD 17 to store the restriction information in association with at least one of the multiple pieces of user information, in accordance with an instruction from an administrator input via the operation unit 16, for example.

[0024] The HDD 17 stores various control programs for implementing general operations of the image forming apparatus 1. The HDD 17 stores a first control program for executing a scan process described later, a second control program for executing a tagging process described later, a third control program for executing a tagged data output process described later, and a fourth control program for executing a tag editing process. The HDD 17 also stores an OCR program for executing a general OCR process.

[0025] The transport mechanism 18 is composed of a transport roller pair 18A and a discharge roller pair 18B, etc. The transport mechanism 18 transports the recording paper P along a transport path toward the discharge tray 8 set as the discharge destination.

[0026] The image processing unit 19 performs image processing as necessary on the image data generated by the image reading unit 11. The image memory 20 includes an area for temporarily storing the image data to be output that is generated by the image reading unit 11. The facsimile communication unit 21 connects to a public line and transmits and receives image data via the public line.

[0027] The communication unit 22 includes a communication module such as a LAN (Local Area Network) board. The image forming apparatus 1 performs data communication with an external device 23 and the like connected via a network via the communication unit 22. The communication unit 22 is an example of an output unit in the claims.

[0028] Each part of the image forming apparatus 1 is connected to a power source, and each part of the image forming apparatus 1 operates when power is supplied from the power source.

[0029] In this embodiment, the control unit 10 operates in accordance with the first control program or the second control program, and when it receives an instruction to specify image data via the operation unit 16, it generates an electronic watermark including a tag indicating tag information and executes a scanning process or tagging process to embed the watermark in the specified image data.

[0030] The control unit 10 also operates according to a third control program, and when it receives an output instruction for tagged image data and tag information via the operation unit 16, it executes a tagged data output process to extract tagged image data having an electronic watermark including a tag indicating the tag information from among the multiple image data, and output the extracted image data to the image forming unit 12, etc. or the communication unit 22.

[0031] [Operation] The operation of the image forming apparatus 1 will be described below. In the following description, it is assumed that the power of the image forming apparatus 1 is turned on. It is also assumed that the image data to be tagged is made up of a plurality of pages, including a mixture of pages including only text and pages including images. It is also assumed that the document does not include a digital watermark.

[0032] (1) Login authentication When performing login authentication, the user inputs a user ID and password using operation unit 16. If the input user ID and password match the authentication information stored in HDD 17, control unit 10 permits login to image forming apparatus 1. On the other hand, if the input user ID and password do not match the authentication information, control unit 10 does not permit login to image forming apparatus 1 and causes display unit 15 to display an error message indicating that login is not possible.

[0033] (2) Scanning Figures 3A and 3B are flowcharts showing the scan process. When a user who is permitted to log in (hereinafter, referred to as the "logged-in user") inputs an instruction to execute the scan process using the operation unit 16, the control unit 10 starts the execution of the scan process shown in Figures 3A and 3B. First, the control unit 10 repeats the process of determining that an instruction to start reading has not been accepted until the start key 16A is pressed (NO in step S10).

[0034] In this situation, it is assumed that the user places multiple documents on the document table of document transport unit 6 and presses start key 16A. When start key 16A is pressed, control unit 10 determines that a reading start instruction has been received (YES in step S10), and causes document transport unit 6 to transport the documents one by one, and also causes image reading unit 11 to sequentially read the images of the documents to generate scan data (step S11).

[0035] After the process of step S11, the control unit 10 causes the display unit 15 to display the first selection screen 40 shown in Fig. 4 (step S12). After the process of step S12, the control unit 10 repeats the process of determining that an instruction to perform tagging has not been accepted (NO in step S13) and the process of determining that an instruction not to perform tagging has not been accepted (NO in step S14) until a touch operation is received on the key 41 for inputting an instruction to perform tagging or on the key 42 for inputting an instruction not to perform tagging.

[0036] In this situation, when the user touches key 41, control unit 10 determines that an instruction to perform tagging has been received (YES in step S13), and determines whether tagging is restricted based on whether restriction information is stored in HDD 17 in association with the user information of the logged-in user (step S15). On the other hand, when the user touches key 42, control unit 10 determines that an instruction not to perform tagging has been received (YES in step S14), and stores the scan data in a predetermined scan folder in HDD 17 without executing the first embedding process and the second embedding process described below (step S28).

[0037] If the HDD 17 does not store the above-mentioned restriction information, the control unit 10 determines that tagging is not restricted (NO in step S15) and causes the display unit 15 to display the first input screen 50 shown in Fig. 5 (step S16). On the other hand, if the HDD 17 stores the above-mentioned restriction information, the control unit 10 determines that tagging is restricted (YES in step S15) and causes the display unit 15 to pop up and display a first error screen indicating that tagging is restricted (step S17). After the process of step S17, the control unit 10 executes the process of step S28 in the same manner as described above.

[0038] After the process of step S16, the control unit 10 repeats the process of determining that a confirmation instruction has not been received until a touch operation on the key 53 for inputting a confirmation instruction for confirming the input contents is received (NO in step S18). In this situation, when the user inputs tag information such as "TOR" using the operation unit 16, the control unit 10 causes the display unit 15 to display the input tag information in the input field 51A. After inputting the tag information, when the user touches the key 52 for inputting an instruction to add an input field, the control unit 10 causes the display unit 15 to display a new input field 51B.

[0039] The user repeats the above-mentioned operations to sequentially input, for example, tag information "STI" and tag information "TEST TAG". The control unit 10 causes the display unit 15 to display the input tag information in the added input fields 51B and 51C, respectively. It is assumed that the user checks the display contents of the input fields 51A to 51C and touches the key 53. When the control unit 10 receives the touch operation on the key 53, it determines that a confirmation instruction has been received (YES in step S18), and causes the display unit 15 to display the second selection screen 60 shown in FIG. 6 (step S19).

[0040] After the process of step S19, the control unit 10 repeats the process of determining that the confirmation instruction has not been accepted until a touch operation on the key 63 for inputting the confirmation instruction is accepted (NO in step S20). In this situation, it is assumed that the user checks the radio button 61 for selecting "all pages" and touches the key 63. When the control unit 10 accepts the touch operation on the key 63, it determines that the confirmation instruction has been accepted (YES in step S20), and determines that "all pages" has been selected (YES in step S21), and executes the first embedding process (step S22).

[0041] Specifically, in the first embedding process, the control unit 10 generates a digital watermark including tags indicating the input tag information (in this case, a tag indicating "TOR", a tag indicating "STI", and a tag indicating "TEST TAG") and user information stored in the HDD 17 in association with the user information of the logged-in user. The control unit 10 embeds the generated digital watermark in all pages of the scan data.

[0042] On the other hand, if the user checks radio button 62 for selecting "only pages containing images" and touches key 63, control unit 10 determines that the confirmation instruction has been received (YES in step S20), determines that "all pages" has not been selected (NO in step S21), and executes the second embedding process (step S23). Specifically, in the second embedding process, control unit 10 generates a digital watermark in the same manner as in the first embedding process, and embeds the generated digital watermark only in pages that contain images in the scan data.

[0043] After the process of step S22 or step S23, the control unit 10 causes the display unit 15 to display the third selection screen 70 shown in Fig. 7 (step S24). After the process of step S24, the control unit 10 repeats the process of determining that a restriction instruction has not been accepted (NO in step S25) and the process of determining that a permission instruction has not been accepted (NO in step S26) until a touch operation is accepted on the key 71 for inputting a tagging restriction instruction or the key 72 for inputting a tagging permission instruction.

[0044] In this situation, when the user touches the key 71, the control unit 10 determines that the restriction instruction has been received (YES in step S25), and adds the restriction information as attribute information to the tagged scan data (step S27). After the process of step S27, the control unit 10 stores the tagged scan data in a scan folder in the HDD 17 (step S28).

[0045] On the other hand, when the user touches the key 72, the control unit 10 determines that the permission instruction has been received (YES in step S26), and stores the tagged scan data in the scan folder in the HDD 17 without adding any restriction information (step S28). After the process of step S28, the control unit 10 ends the scan process.

[0046] (3) Tagging process 8A and 8B are flowcharts showing the tagging process. When the logged-in user inputs an instruction to execute the tagging process using the operation unit 16, the control unit 10 starts the tagging process shown in Fig. 8A and 8B. The control unit 10 first causes the display unit 15 to display a fourth selection screen 90 shown in Fig. 9 (step S30). After the process of step S30, the control unit 10 repeats the process of determining that a confirmation instruction has not been received (NO in step S31) until a touch operation on the key 92 for inputting a confirmation instruction is received.

[0047] In this situation, the user touches and selects one of the four folders indicated by images 91A to 91D, selects the desired image data in the folder indicated by the selected image, and touches key 92. When control unit 10 receives the touch operation on key 92, it determines that a confirmation instruction has been received (YES in step S31), and causes display unit 15 to display first selection screen 40 shown in Fig. 4 (step S32).

[0048] After the process of step S32, the control unit 10 repeats the process of determining that an execution instruction has not been accepted (NO in step S33) and the process of determining that a non-execution instruction has not been accepted (NO in step S34) until a touch operation on the key 41 or the key 42 is accepted.

[0049] In this situation, when the user touches key 41, control unit 10 determines that an instruction to perform has been received (YES in step S33), and determines whether tagging is restricted based on whether restriction information is stored in HDD 17 in association with the user information of the logged-in user and whether restriction information has already been added to the selected image data (step S35).On the other hand, when the user touches key 42, control unit 10 determines that an instruction not to perform has been received (YES in step S34), and ends the tagging process without executing the first embedding process and the second embedding process.

[0050] If the HDD 17 does not store the above-mentioned limiting information and the limiting information has not been added to the selected image data, the control unit 10 determines that tagging is not limited (NO in step S35) and causes the display unit 15 to display the first input screen 50 shown in Fig. 5 (step S36). On the other hand, if at least one of the cases where the HDD 17 stores the above-mentioned limiting information and the case where the limiting information has already been added to the selected image data is met, the control unit 10 determines that tagging is limited (YES in step S35), causes the display unit 15 to pop up and display the above-mentioned first error screen (step S37), and ends the tagging process without executing the first embedding process and the second embedding process.

[0051] After the process of step S36, the control unit 10 repeats the process of determining that a confirmation instruction has not been received until a touch operation on the key 53 is received (NO in step S38). In this situation, it is assumed that the user inputs the tag information "TOR", the tag information "STI", and the tag information "TEST TAG" using the operation unit 16 in the same manner as described above, and touches the key 53.

[0052] When control unit 10 receives a touch operation on key 53, it determines that a confirmation instruction has been received (YES in step S38), and causes display unit 15 to display second selection screen 60 shown in Fig. 6 (step S39). After the process of step S39, control unit 10 repeats the process of determining that a confirmation instruction has not been received until it receives a touch operation on key 63 (NO in step S40).

[0053] In this situation, it is assumed that the user checks radio button 61 and touches key 63. When control unit 10 receives the touch operation on key 63, it determines that a confirmation instruction has been received (YES in step S40), and determines that "all pages" has been selected (YES in step S41), and executes the first embedding process to embed the above-mentioned digital watermark in all pages of the selected image data (step S42).

[0054] On the other hand, if the user checks radio button 62 and touches key 63, the control unit 10 determines that the confirmation instruction has been received (YES in step S40), and determines that "all pages" has not been selected (NO in step S41), and executes the second embedding process to embed the above-mentioned electronic watermark only in pages that contain images in the selected image data (step S43).

[0055] After the process of step S42 or step S43, the control unit 10 causes the display unit 15 to display the third selection screen 70 shown in Fig. 7 (step S44). After the process of step S44, the control unit 10 repeats the process of determining that a restriction instruction has not been accepted (NO in step S45) and the process of determining that a permission instruction has not been accepted (NO in step S46) until a touch operation on the key 71 or the key 72 is accepted.

[0056] In this situation, when the user touches the key 71, the control unit 10 determines that a restriction instruction has been received (YES in step S45), and determines whether or not restriction information has already been added based on the attribute information of the tagged image data (step S47). If restriction information has not been added (NO in step S47), the control unit 10 adds the restriction information as attribute information to the tagged image data (step S48).

[0057] On the other hand, if the control unit 10 determines that the user has accepted the permission instruction by touching key 72 (YES in step S46) and if restriction information has already been added to the tagged image data (YES in step S47), the control unit 10 terminates the tagging process without adding the restriction information.

[0058] (4) Tagged data output processing Figures 10A to 10D are flowcharts showing the tagged data output process. When the logged-in user inputs an instruction to execute the tagged data output process using the operation unit 16, the control unit 10 starts the execution of the tagged data output process shown in Figures 10A to 10D. The control unit 10 first causes the display unit 15 to display a fifth selection screen 110 shown in Figure 11 (step S50).

[0059] After the process of step S50, the control unit 10 repeats the process of determining that the confirmation instruction has not been received until a touch operation on the key 113 for inputting the confirmation instruction is received (NO in step S51). In this situation, it is assumed that the user checks the radio button 111 for selecting "any folder" as the search target for tagged image data, and touches the key 113.

[0060] When the control unit 10 receives a touch operation on the key 113, it determines that a confirmation instruction has been received (YES in step S51), and determines that "Scan Folder" has not been selected (NO in step S52), and causes the display unit 15 to display the sixth selection screen 120 shown in Fig. 12 (step S53). After the process of step S53, the control unit 10 repeats the process of determining that a confirmation instruction has not been received until it receives a touch operation on the key 122 for inputting a confirmation instruction (NO in step S54).

[0061] In this situation, the user touches and selects one of images 121A to 121D (in this case, image 121A) representing each of a plurality of selectable folders, and then touches key 122. When control unit 10 receives a touch operation on key 122, it determines that a confirmation instruction has been received (YES in step S54), and determines whether tagged image data exists in the folder to be searched (in this case, the folder corresponding to image 121A) (step S55).

[0062] On the other hand, if the user checks radio button 112 to select "Scan Folder" as the search target for tagged image data and touches key 113, the control unit 10 determines that a confirmation instruction has been received (YES in step S51), determines that "Scan Folder" has been selected (YES in step S52), and determines whether tagged image data exists in the folder to be searched (in this case, the scan folder) (step S55) without executing the processing of steps S53 and S54.

[0063] If the control unit 10 is able to extract image data having an electronic watermark including a tag from among the multiple image data stored in the folder to be searched, it determines that tagged image data exists (YES in step S55), and then determines whether or not tagged image data corresponding to the logged-in user exists among the extracted tagged image data (step S56).

[0064] On the other hand, if the control unit 10 cannot extract image data having an electronic watermark including a tag from among the multiple image data stored in the folder to be searched, it determines that tagged image data does not exist (NO in step S55), pops up a second error screen on the display unit 15 indicating that tagged image data does not exist (step S57), and terminates the tagged data output process.

[0065] If the control unit 10 is able to extract image data having an electronic watermark including user information of the logged-in user from the extracted tagged image data, it determines that tagged image data corresponding to the logged-in user exists (YES in step S56), and causes the display unit 15 to display the second input screen 130 shown in FIG. 13 (step S59).

[0066] On the other hand, if the control unit 10 cannot extract image data having an electronic watermark including user information of the logged-in user from the extracted tagged image data, it determines that tagged image data corresponding to the logged-in user does not exist (NO in step S56), and causes a third error screen to pop up on the display unit 15 indicating that tagged image data corresponding to the logged-in user does not exist (step S58), and terminates the tagged data output process.

[0067] After the process of step S59, control unit 10 repeats the process of determining that a confirmation instruction has not been received until a touch operation on key 132 for inputting a confirmation instruction is received (NO in step S60). In this situation, it is assumed that the user inputs tag information "TOR" using operation unit 16. Control unit 10 causes display unit 15 to display the input tag information in input field 131. It is assumed that the user checks the display content of input field 131 and touches key 132.

[0068] When the control unit 10 receives a touch operation on the key 132, it determines that a confirmation instruction has been received (YES in step S60), and determines whether or not tagged image data corresponding to the input tag information exists among the extracted tagged image data corresponding to the login user (step S61). Here, the control unit 10 extracts two pieces of tagged image data having a digital watermark including a tag indicating "TOR" from the tagged image data corresponding to the login user.

[0069] In this case, the control unit 10 determines that tagged image data corresponding to the input tag information exists (YES in step S61), and determines that there are two or more tagged image data corresponding to the input tag information (YES in step S62), and causes the display unit 15 to display the seventh selection screen 140 shown in Fig. 14 (step S64). After the process of step S64, the control unit 10 repeats the process of determining that a confirmation instruction has not been accepted until a touch operation on the key 144 for inputting a confirmation instruction is accepted (NO in step S65).

[0070] On the other hand, if the control unit 10 cannot extract tagged image data having an electronic watermark including a tag indicating the input tag information from the tagged image data corresponding to the logged-in user, it determines that tagged image data corresponding to the input tag information does not exist (NO in step S61), causes the display unit 15 to pop up a fourth error screen indicating that tagged image data corresponding to the input tag information does not exist (step S63), and terminates the tagged data output process.

[0071] The user checks images 141A and 141B showing two tagged image data corresponding to the input tag information, and checks radio button 142 to select further narrowing down the tagged image data using an automatic search tag generation function (hereinafter referred to as "AGST (Auto-Generated Search Tags)"), and touches key 144.

[0072] When the control unit 10 receives a touch operation on the key 144, it determines that a confirmation instruction has been received (YES in step S65), and determines that the AGST function will be used (YES in step S66), and performs OCR processing on all tagged image data corresponding to the input tag information to generate text data (step S67).

[0073] After the process of step S67, the control unit 10 extracts character strings that follow a predetermined rule from the generated text data, and generates tags that indicate the extracted character strings (step S68). In this case, the control unit 10 extracts character strings that respectively indicate a name, an ID number, a date, and a title from the generated text data in accordance with the predetermined rule.

[0074] After the process of step S68, control unit 10 causes display unit 15 to display eighth selection screen 150 shown in Fig. 15 (step S69). After the process of step S69, control unit 10 repeats the process of determining that a confirmation instruction has not been accepted until a touch operation on key 159 for inputting a confirmation instruction is accepted (NO in step S70).

[0075] Here, the control unit 10 causes the display unit 15 to display images 151 to 154 indicating tags generated from one of the two extracted tagged image data, and images 155 to 158 indicating tags generated from the other tagged image data, on an eighth selection screen 150. It is assumed that the user checks the eighth selection screen 150, touches and selects one of the images 151 to 158 (in this case, image 152), and then touches key 159.

[0076] When control unit 10 receives a touch operation on key 159, it determines that a confirmation instruction has been received (YES in step S70), and causes display unit 15 to display ninth selection screen 160 shown in Fig. 16 (step S71). Here, control unit 10 causes display unit 15 to display, on ninth selection screen 160, an image (image 141A in this case) indicating tagged image data corresponding to the selected tag (the tag indicated by image 152 in this case).

[0077] On the other hand, when the control unit 10 extracts only one tagged image data having a digital watermark including a tag indicating "TOR" from among the tagged image data corresponding to the logged-in user, it determines that image data corresponding to the input tag information exists (YES in step S61), and determines that there are not two or more tagged image data corresponding to the input tag information (NO in step S62), and executes the process of step S71 without executing the processes of steps S64 to S70. In this case, the control unit 10 causes the display unit 15 to display an image indicating only the one extracted tagged image data on the ninth selection screen 160.

[0078] Furthermore, if the user checks images 141A and 141B on seventh selection screen 140, checks radio button 143 for selecting not to narrow down the image data, and touches key 144, control unit 10 determines that the confirmation instruction has been received (YES in step S65), determines that the AGST function will not be used (NO in step S66), and executes the process of step S71 without executing the processes of steps S67 to S70. In this case, control unit 10 causes display unit 15 to display images (in this case, images 141A and 141B) showing all the extracted tagged image data on ninth selection screen 160.

[0079] After processing in step S71, the control unit 10 repeats the process of determining that a confirmation instruction has not been accepted (NO in step S72) and the process of determining that a cancel instruction has not been accepted (NO in step S73) until it receives a touch operation on the key 161 for inputting a confirmation instruction to confirm the selection of image data, or on the key 162 for inputting an instruction to cancel the selection of image data.

[0080] In this situation, when the user touches key 161, control unit 10 determines that a confirmation instruction has been received (YES in step S72), and executes output processing of the tagged image data shown on ninth selection screen 160 (step S74). Specifically, control unit 10 executes, as output processing, an image forming process for causing image forming unit 12 or the like to form an image indicated by the tagged image data to be output on recording paper P, or a transmission process for causing communication unit 22 to transmit the tagged image data to be output to external device 23, in accordance with the user's instruction received via operation unit 16.

[0081] On the other hand, if the user touches key 162, control unit 10 determines that a cancel instruction has been accepted (YES in step S73), and returns to the process of step S59.

[0082] After the process of step S74, the control unit 10 causes the display unit 15 to display a tenth selection screen 170 shown in Fig. 17 (step S75). After the process of step S75, the control unit 10 repeats the process of determining that a deletion instruction has not been accepted (NO in step S76) and the process of determining that a maintenance instruction has not been accepted (NO in step S77) until a touch operation is accepted on the key 171 for inputting an instruction to delete a tag or the key 172 for inputting an instruction to maintain a tag.

[0083] In this situation, when the user touches key 171, control unit 10 determines that a delete instruction has been received (YES in step S76), and causes display unit 15 to display eleventh selection screen 180 shown in Fig. 18 (step S78). On the other hand, when the user touches key 172, control unit 10 determines that a maintain instruction has been received (YES in step S77), and ends the tagged data output process without executing the processes in steps S78 to S80 described below.

[0084] After the process of step S78, the control unit 10 repeats the process of determining that the confirmation instruction has not been received until a touch operation on the key 185 for inputting the confirmation instruction is received (NO in step S79). In this situation, it is assumed that the user touches and selects at least one of the images 181 to 184 (in this case, images 183 and 184) indicating the tag contained in the digital watermark (i.e., the digital watermark containing the user information corresponding to the logged-in user) of the tagged image data that has been output, and then touches the key 185.

[0085] When the control unit 10 receives a touch operation on the key 185, it determines that a confirmation instruction has been received (YES in step S79), and deletes the selected tags (in this case, the tag indicating "TEST TAG" and the tag indicating "MY_SECLET_TAG") from the digital watermark contained in the tagged image data that has been output (step S80). After the process of step S80, the control unit 10 ends the tagged data output process.

[0086] (5) Tag editing process 19A to 19C are flowcharts showing the tag editing process. The processes in steps S110 to S118 in the tag editing process are the same as those in steps S50 to S58 in the tagged data output process. In the following description of the tag editing process, the same processes as those in the tagged data output process will not be described.

[0087] When the logged-in user inputs an instruction to execute tag editing processing using the operation unit 16, the control unit 10 starts executing the tag editing processing shown in Figures 19A to 19C. The control unit 10 first executes the processing of steps S110 to S118.

[0088] When the control unit 10 determines that tagged image data corresponding to the logged-in user exists among the tagged image data extracted in step S115 (YES in step S116), the control unit 10 causes the display unit 15 to display a twelfth selection screen 200 shown in Fig. 20 (step S119). After the process of step S119, the control unit 10 repeats the process of determining that a confirmation instruction has not been accepted until a touch operation on the key 205 for inputting a confirmation instruction is accepted (NO in step S120).

[0089] (5-1) When "Add tag" is selected It is assumed that the user checks twelfth selection screen 200, checks radio button 201 for selecting "add tag" as the editing content, and touches key 205. When control unit 10 receives the touch operation on key 205, it determines that a confirmation instruction has been received (YES in step S120), determines that "add tag" has been selected (YES in step S121), and causes display unit 15 to display first input screen 50 shown in Fig. 5 (step S122).

[0090] After the process of step S122, control unit 10 repeats the process of determining that a confirmation instruction has not been received until a touch operation on key 53 is received (NO in step S123). In this situation, when the user inputs tag information "MY_SECLET_TAG" using operation unit 16, control unit 10 causes display unit 15 to display the input tag information in input field 51A. It is assumed that the user touches key 53 after checking the display content of input field 51A.

[0091] When the control unit 10 receives a touch operation on the key 53, it determines that a confirmation instruction has been received (YES in step S123), and adds a tag indicating the input tag information (in this case, a tag indicating "MY_SECLET_TAG") to the digital watermark contained in the tagged image data corresponding to the login user extracted in step S116 (step S124). After the process of step S124, the control unit 10 ends the tag editing process.

[0092] (5-2) When "Delete tag" is selected It is assumed that the user checks twelfth selection screen 200, checks radio button 202 for selecting "delete tag" as the editing content, and touches key 205. When control unit 10 receives the touch operation on key 205, it determines that a confirmation instruction has been received (YES in step S120). Control unit 10 further determines that "add tag" has not been selected (NO in step S121), and determines that "delete tag" has been selected (YES in step S125), and causes display unit 15 to display eleventh selection screen 180 shown in FIG. 18 (step S126).

[0093] After the process of step S126, control unit 10 repeats the process of determining that a confirmation instruction has not been received until a touch operation on key 185 for inputting a confirmation instruction is received (NO in step S127). In this situation, it is assumed that the user touches and selects at least one of images 181 to 184 (images 183 and 184 in this case) indicating the tag contained in the digital watermark of the tagged image data corresponding to the logged-in user extracted in step S116, and then touches key 185.

[0094] When the control unit 10 receives a touch operation on the key 185, it determines that a confirmation instruction has been received (YES in step S127), and deletes the selected tags (in this case, the tag indicating "TEST TAG" and the tag indicating "MY_SECLET_TAG") from the digital watermark of the tagged image data corresponding to the logged-in user (step S128). After the process of step S128, the control unit 10 ends the tag editing process.

[0095] (5-3) When "Change Tag" is selected It is assumed that the user checks twelfth selection screen 200, checks radio button 203 for selecting "change tag" as the editing content, and touches key 205. When control unit 10 receives a touch operation on key 205, it determines that a confirmation instruction has been received (YES in step S120) and determines that "add tag" has not been selected (NO in step S121).

[0096] Control unit 10 further determines that "Delete tag" has not been selected (NO in step S125), and determines that "Change tag" has been selected (YES in step S129), and causes display unit 15 to display change screen 210 shown in Fig. 21 (step S130). After the process of step S130, control unit 10 repeats the process of determining that a confirmation instruction has not been accepted until a touch operation on key 215 for inputting a confirmation instruction is accepted (NO in step S131).

[0097] In this situation, it is assumed that the user touches and selects one of images 211 to 214 (in this case, image 211) indicating the tag contained in the digital watermark of the tagged image data corresponding to the logged-in user extracted in step S116, and changes the tag information indicated by image 211 from "TOR" to "TOR01" using operation unit 16. After changing the tag information, it is assumed that the user touches key 215.

[0098] When the control unit 10 receives a touch operation on the key 215, it determines that a confirmation instruction has been received (YES in step S131), and updates the tag included in the digital watermark of the tagged image data corresponding to the logged-in user to a tag indicating the changed tag information (step S132). After the process of step S132, the control unit 10 ends the tag editing process.

[0099] (5-4) When "Remove tag restrictions" is selected It is assumed that the user checks twelfth selection screen 200, checks radio button 204 for selecting "Remove tag restriction" as the editing content, and touches key 205. When control unit 10 receives a touch operation on key 205, it determines that a confirmation instruction has been received (YES in step S120) and determines that "Add tag" has not been selected (NO in step S121).

[0100] The control unit 10 further determines that "Delete tag" has not been selected (NO in step S125) and that "Change tag" has not been selected (NO in step S129), and deletes the restriction information added as attribute information to the tagged image data corresponding to the logged-in user (step S133). After the process of step S133, the control unit 10 ends the tag editing process.

[0101] According to the above embodiment, when the control unit 10 receives an instruction to specify tag information and image data via the operation unit 16, the control unit 10 generates a digital watermark including a tag indicating the tag information and embeds it in the specified image data. When the control unit 10 receives an instruction to output tagged image data and tag information via the operation unit 16, the control unit 10 extracts tagged image data having a digital watermark including a tag indicating the tag information from among multiple image data, and outputs the extracted data to the image forming unit 12 or the communication unit 22.

[0102] This allows users to easily search for image data by simply inputting tag information, allowing them to extract the image data to be output from among multiple image data. In addition, since digital watermarks are used for tagging, it becomes possible to trace or analyze the source of the output image data based on the digital watermark, further strengthening the management of image data.

[0103] Furthermore, according to the above embodiment, when multiple pieces of tagged image data are extracted, the control unit 10 extracts multiple character strings that follow a predetermined rule from all of the tagged image data, and causes the display unit 15 to display multiple tags indicating the multiple extracted character strings, respectively. Furthermore, when the control unit 10 receives an instruction to select one of the multiple tags via the operation unit 16, the control unit 10 causes the image forming unit 12 or the like or the communication unit 22 to output the tagged image data corresponding to the selected tag.

[0104] This allows the user to easily select desired image data from among the multiple extracted tagged image data, thus further improving user convenience.

[0105] According to the above embodiment, the control unit 10 generates a digital watermark including a tag indicating tag information and user information corresponding to the logged-in user, and embeds the digital watermark in the designated image data. This makes it possible to track or analyze the logged-in user as the source of the output image data based on the digital watermark, further strengthening the management of image data.

[0106] Furthermore, according to the above embodiment, the control unit 10 extracts tagged image data having a digital watermark including a tag indicating user information corresponding to the logged-in user and the input tag information from among the multiple image data, and outputs the extracted image data to the image forming unit 12 or the communication unit 22. The control unit 10 also does not extract tagged image data having a digital watermark including user information that does not correspond to the logged-in user.

[0107] This makes it possible to prevent image data with tags that do not correspond to the logged-in user from being output, thus further strengthening the management of image data.

[0108] Furthermore, according to the above embodiment, if HDD 17 does not store restriction information associated with the user information of the logged-in user, control unit 10 embeds a digital watermark, and if HDD 17 stores restriction information associated with the user information of the logged-in user, control unit 10 does not embed a digital watermark. This makes it possible to limit the users who can embed a digital watermark, further strengthening the management of image data.

[0109] According to the above embodiment, the control unit 10 adds restriction information as attribute information to at least one of the multiple image data. If the restriction information is not added to the specified image data, the control unit 10 embeds a digital watermark, and if the restriction information is added to the specified image data, the control unit 10 does not embed a digital watermark. This makes it possible to limit the image data for which digital watermark embedding can be performed, thereby further strengthening the management of image data.

[0110] Furthermore, according to the above embodiment, the control unit 10 causes the display unit 15 to display images 181 to 184 indicating tags contained in digital watermarks including user information corresponding to the logged-in user, and does not cause the display unit 15 to display images indicating tags contained in digital watermarks including user information not corresponding to the logged-in user. When the control unit 10 receives an instruction via the operation unit 16 to select, for example, images 183 and 184, it deletes the tags corresponding to the selected images 183 and 184 from the digital watermark.

[0111] In this way, images showing tags that do not correspond to the logged-in user are not displayed on the display unit 15, so it is possible to prevent the logged-in user from deleting tags created by other users, thereby further improving user convenience.

[0112] (First Modification) In the above embodiment, any logged-in user can use the AGST function, but the present invention is not limited to such an embodiment. In a first modification of the above embodiment, the control unit 10 restricts users of the AGST function according to the user settings of the AGST function.

[0113] Specifically, when the user of the AGST function is set to "administrator only," the control unit 10 executes the processes of steps S67 to S70 in the tagged data output process only when the user information of the logged-in user stored in the HDD 17 includes information indicating the administrator. Also, when the user of the AGST function is set to "general user," the control unit 10 executes the processes of steps S67 to S70 in the tagged data output process regardless of the content of the user information of the logged-in user stored in the HDD 17.

[0114] The operation of the image forming device 1 when performing user setting of the AGST function will be described below. Fig. 22 is a flowchart showing the user setting process. In the first modification, the HDD 17 stores a fifth control program for executing the user setting process.

[0115] When the logged-in user inputs an instruction to execute a user setting process using the operation unit 16, the control unit 10 starts executing the user setting process shown in Fig. 22. The control unit 10 first determines whether or not the logged-in user has administrator authority based on the user information of the logged-in user stored in the HDD 17 (step S140).

[0116] If the user information includes information indicating an administrator, control unit 10 determines that the logged-in user has administrator authority (YES in step S140), and causes display unit 15 to display thirteenth selection screen 230 shown in Fig. 23 (step S141). After the process of step S141, control unit 10 repeats the process of determining that a confirmation instruction has not been accepted until a touch operation on key 233 for inputting a confirmation instruction is accepted (NO in step S142).

[0117] In this situation, it is assumed that a user with administrator authority checks radio button 231 for selecting "administrator only" as the user of the AGST function, and touches key 233. When the control unit 10 receives the touch operation on key 233, it determines that a confirmation instruction has been received (YES in step S142), and determines that "administrator only" has been selected (YES in step S143), and sets the user of the AGST function to "administrator only" (step S144). After processing step S144, the control unit 10 ends the user setting process.

[0118] On the other hand, if the user checks the radio button 232 for selecting "general user" as the user of the AGST function and touches the key 233, the control unit 10 determines that the confirmation instruction has been received (YES in step S142), and determines that "administrator only" has not been selected (NO in step S143), and sets the user of the AGST function to "general user" (step S145). After the process of step S145, the control unit 10 ends the user setting process.

[0119] In addition, if the user information of the logged-in user stored in HDD 17 includes information indicating a general user, the control unit 10 determines that the logged-in user does not have administrator authority (NO in step S140), and terminates the user setting process without executing the processes of steps S141 to S145.

[0120] (Other variations) In the above embodiment, in step S15 of the scan process and step S35 of the tagging process, the control unit 10 determines whether tagging of image data is restricted based on whether restriction information is stored in the HDD 17, but the present invention is not limited to such an embodiment. For example, the control unit 10 may execute an OCR process on the image data to be tagged to generate text data, and determine that tagging of the image data is restricted when the generated text data contains a predetermined character string such as "confidential."

[0121] In the above embodiment, the control unit 10 extracts character strings indicating a name, an ID number, a date, and a title from the generated text data in step S68 of the tagged data output process according to a predetermined rule, but the present invention is not limited to such an embodiment. For example, the control unit 10 may extract character strings that are detected a predetermined number of times or more (i.e., that appear frequently) from the generated text data.

[0122] In the above embodiment, in the tagged data output process, the control unit 10 executes the processes of steps S75 to S80 for deleting tags after the process of step S74 for outputting tagged image data, but the present invention is not limited to such an embodiment. For example, the control unit 10 may execute the processes of steps S75 to S80 immediately before the process of step S74.

[0123] In the above embodiment, the image forming unit 12 etc. formed an image on the recording paper P, but the present invention is not limited to such an embodiment. The image forming unit 12 etc. may form an image on other recording media, not limited to the recording paper P. An example of the other recording media is an overhead projector (OHP) sheet.

[0124] The present invention is not limited to the configuration of the above embodiment, and various modifications are possible. For example, in the above embodiment, a color multifunction machine is used as one embodiment of the image forming apparatus according to the present invention, but this is only one example, and other electronic devices such as a monochrome multifunction machine or a facsimile machine may also be used.

[0125] Moreover, the configuration and processing shown in the above embodiment with reference to FIGS. 1 to 23 are merely one embodiment of the present invention, and the present invention is not limited to these configurations and processing. [Explanation of symbols]

[0126] 1. Image forming device 10 Control section 12 Image forming section 15 Display section 16 Control section 17 HDD 22 Communications Department

Claims

1. An acquisition unit that acquires a plurality of image data; an output unit that outputs image data; an input unit for inputting user instructions; a control unit that, when receiving an instruction to specify tag information and image data via the input unit, generates a digital watermark including a tag indicating the tag information and embeds the digital watermark in the specified image data; When the control unit receives an instruction to output tagged image data and the tag information via the input unit, it extracts tagged image data having the electronic watermark including a tag indicating the input tag information from among the multiple image data, and outputs the extracted image data to the output unit.

2. Further comprising a display unit, when a plurality of pieces of tagged image data are extracted, the control unit extracts a plurality of character strings that conform to a predetermined rule from all of the tagged image data, and causes the display unit to display a plurality of tags that respectively indicate the plurality of extracted character strings; The information processing device according to claim 1 , wherein when the control unit receives an instruction to select one of the plurality of tags via the input unit, the control unit causes the output unit to output the tagged image data corresponding to the selected tag.

3. A storage unit that stores user information for identifying a user for each user, The information processing apparatus according to claim 1 , wherein the control unit generates a digital watermark including a tag indicating the tag information and the user information corresponding to a logged-in user, and embeds the digital watermark in the specified image data.

4. 4. The information processing device of claim 3, wherein the control unit extracts tagged image data having an electronic watermark including a tag indicating the user information corresponding to a logged-in user and the input tag information from among the plurality of image data and outputs the extracted image data to the output unit, and does not extract tagged image data having an electronic watermark including the user information that does not correspond to the logged-in user.

5. The control unit causes the storage unit to store restriction information indicating that tagging is restricted in association with at least one of the plurality of pieces of user information; 4. The information processing device of claim 3, wherein the control unit executes embedding of the electronic watermark when the memory unit does not store the restriction information in correspondence with the user information of the logged-in user, and does not execute embedding of the electronic watermark when the memory unit stores the restriction information in correspondence with the user information of the logged-in user.

6. the control unit adds the restriction information as attribute information to at least one of the plurality of image data; 2. The information processing device according to claim 1, wherein the control unit executes embedding of the electronic watermark when the restriction information is not added to the specified image data, and does not execute embedding of the electronic watermark when the restriction information is added to the specified image data.

7. Further comprising a display unit, the control unit causes the display unit to display an image indicating the tag included in the digital watermark including the user information corresponding to a logged-in user, and does not cause the display unit to display an image indicating the tag included in the digital watermark including the user information not corresponding to the logged-in user; The information processing device according to claim 1 , wherein the control unit, when receiving an instruction to select an image showing the tag via the input unit, deletes the tag corresponding to the selected image from the digital watermark.

Citation Information

Patent Citations

  • System, method and computer program for managing documents

    JP2002373063A

  • Scanned image management device

    JP2007188479A