Image processing apparatus, image processing method, and program

Abstract

To provide an image processing apparatus, an image processing method, and a program that prevents a user from finding them annoying.SOLUTION: An image processing apparatus 10 comprises an image processing unit, a first determination processing unit 151, a second determination processing unit 152, and restraining processing unit 153. The image processing unit executes, on a sheet, at least one of reading of an image and formation of an image as image processing. The first determination processing unit 151 determines the possibility of peeping for a target area where the sheet can be arranged on the basis of a picked-up image of a peripheral area of the target area. The second determination processing unit 152 determines the security level of an image to be subjected to the image processing. The restraining processing unit 153 performs restraining processing on the basis of result of determination made by both the first determination processing unit 151 and second determination processing unit 152.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to an image processing device, an image processing method, and a program. [Background technology]

[0002] As a related technology, a (monitoring) device is known that monitors whether other people are looking at the content displayed by an image processing device due to an operator's operation, the medium on which the image is output, or the original document to be read (see, for example, Patent Document 1).

[0003] A monitoring device according to a related art determines whether or not people, excluding the operator, among those identified by personal information indicating people present within a predetermined range from an image processing device, have a predetermined relationship with the operator. This monitoring device controls to output warning information if it determines that even one of the identified people does not have the predetermined relationship, and suppresses the output of warning information if it determines that all of the identified people have the predetermined relationship. For example, people who belong to the same department as the operator are considered to have a predetermined relationship with the operator (related parties) and are therefore allowed to peek inside. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Publication No. 2022-187290 Summary of the Invention [Problem to be solved by the invention]

[0005] However, in the configuration of the above-mentioned related technology, even if the image being printed or read does not contain any confidential information, if there is someone within a specified range who does not have a specified relationship with the operator, the image processing device will output warning information, which may be annoying to the user.

[0006] An object of the present invention is to provide an image processing device, an image processing method, and a program that are less bothersome to the user. [Means for solving the problem]

[0007] An image processing device according to one aspect of the present invention includes an image processing unit, a first determination processing unit, a second determination processing unit, and a check processing unit. The image processing unit performs image processing, such as at least one of image reading and image formation, on a sheet. The first determination processing unit determines the possibility of peeping into a target area based on a captured image of a surrounding area of ​​the target area where the sheet can be placed. The second determination processing unit determines the security level of the image that is the target of the image processing. The check processing unit performs check processing based on the determination results of both the first determination processing unit and the second determination processing unit.

[0008] An image processing method according to another aspect of the present invention includes image processing, a first determination process, a second determination process, and a check process. The image processing involves performing at least one of image reading and image formation on a sheet. The first determination process involves determining the possibility of peeping into a target area based on a captured image of the periphery of the target area where the sheet can be placed. The second determination process involves determining the security level of the image that is the target of the image processing. The check process is performed based on the determination results of both the first determination process and the second determination process.

[0009] A program according to another aspect of the present invention is a program for causing one or more processors to execute image processing, first determination processing, second determination processing, and deterrence processing. The image processing involves performing at least one of image reading and image formation on a sheet. The first determination processing involves determining the possibility of peeping into a target area based on a captured image of the periphery of the target area where the sheet can be placed. The second determination processing involves determining the security level of the image that is the target of the image processing. The deterrence processing is performed based on the determination results of both the first determination processing and the second determination processing. [Effects of the Invention]

[0010] According to the present invention, it is possible to provide an image processing device, an image processing method, and a program that are less bothersome to the user. [Brief explanation of the drawings]

[0011] [Figure 1] FIG. 1 is a schematic diagram showing the external appearance and internal configuration of an image processing device according to the first embodiment. [Figure 2] FIG. 2 is a schematic block diagram of the image processing device according to the first embodiment. [Figure 3] FIG. 3 is a schematic diagram of the image processing device according to the first embodiment and the surrounding area as viewed from above. [Figure 4] FIG. 4 is a schematic diagram showing an example of an image captured by the image processing device according to the first embodiment. [Figure 5] FIG. 5 is a flowchart illustrating an example of the operation of the image processing device according to the first embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0012] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The following description will discuss preferred embodiments of the present invention with reference to the accompanying drawings. The preferred embodiments are merely examples of the present invention and are not intended to limit the technical scope of the present invention.

[0013] (Embodiment 1) [1] Overall configuration of image processing device First, the overall configuration of an image processing device 10 according to this embodiment will be described with reference to FIGS.

[0014] For ease of explanation, the vertical direction in the installation state where the image processing device 10 is usable (the state shown in FIG. 1) is defined as the up-down direction D1. Furthermore, the direction perpendicular to the plane of the image processing device 10 shown in FIG. 1 is defined as the front-back direction D2, and the surface on the front side in FIG. 1 is defined as the front (front face). Furthermore, the surface on the left side of the plane of FIG. 1 is defined as the left side, and the left-right direction D3 is defined.

[0015] The image processing device 10 according to this embodiment is, for example, a multifunction peripheral having multiple functions, such as a scanning function for acquiring an image (image data) from an original, a printing function for forming an image based on the image data, a facsimile function, and a copying function. The image processing device 10 may be a printer, scanner, facsimile machine, copier, etc., as long as it has an image processing function including at least one of an image forming function and an image reading function.

[0016] 1, the image processing device 10 includes a sheet conveying device 2, an image reading unit 11, an image forming unit 12, a paper feed unit 13, an operation display unit 14, a control unit 15, and an imaging device 3. In this embodiment, the image processing device 10 includes a housing 100, as shown in FIG. 2. The sheet conveying device 2, the image reading unit 11, the image forming unit 12, the paper feed unit 13, the operation display unit 14, the control unit 15, and the imaging device 3 are provided in the housing 100.

[0017] In this embodiment, the sheet transporting device 2 is an automatic document feeder (ADF). The sheet transporting device 2 transports a sheet Sh1 (document) as a reading object (image processing object) whose image is read by the image reading unit 11. The sheet transporting device 2 has a sheet stacking tray 21, a sheet discharge tray 22, etc. The sheet transporting device 2 transports the sheet Sh1 set on the sheet stacking tray 21 to the sheet discharge tray 22, passing through an image reading position by the image reading unit 11.

[0018] The image reading unit 11 reads an image from a sheet Sh1 (original) and outputs image data corresponding to the read image. The image reading unit 11 includes a document table, a light source, a plurality of mirrors, an optical lens, a CCD (Charge Coupled Device), and the like.

[0019] The image forming unit 12 forms an image on the sheet Sh2 based on image data output from the image reading unit 11. The image forming unit 12 also forms an image on the sheet Sh2 based on image data input from an information processing device external to the image processing device 10, such as a personal computer. As an example, in this embodiment, as shown in FIG. 1 , the image forming unit 12 includes a transfer device 121, a fixing device 122, and a paper output tray 123, and forms an image on the sheet Sh2 by electrophotography. The image forming unit 12 is not limited to a configuration that forms a monochrome image, and may also be configured to form a full-color image using four colors: C (cyan), M (magenta), Y (yellow), and K (black). The image forming unit 12 may also be configured to form an image on the sheet by an image forming method other than electrophotography, such as an inkjet method.

[0020] The image forming unit 12 forms an image on the sheet Sh2 using toner as a developer. Specifically, the image forming unit 12 forms an electrostatic latent image on the surface of a charged photosensitive drum by irradiating the surface with laser light, and develops the electrostatic latent image with toner to form a toner image on the surface of the photosensitive drum. A transfer device 121 transfers the toner image to the sheet Sh2 being transported along a transport path. A fixing device 122 melts and fixes the toner image transferred to the sheet Sh2 to the sheet Sh2. For example, the fixing device 122 includes a fixing roller and a pressure roller, and heats the toner image transferred to the sheet Sh2 and applies pressure to the sheet Sh2 to fix the toner image to the sheet Sh2. The sheet Sh2 after image formation is discharged to a paper output tray 123. When the image forming unit 12 forms an image using an inkjet system, ink (another example of a developer) is supplied instead of toner.

[0021] The paper feed unit 13 supplies the sheet Sh2 to the image forming unit 12. The paper feed unit 13 has a plurality of paper feed cassettes 131, a manual feed tray, a plurality of transport rollers, etc. The paper feed unit 13 transports the sheet Sh2 from the plurality of paper feed cassettes 131 or the manual feed tray, etc., through a transport path using a plurality of transport rollers, etc., and supplies the sheet Sh2 to the image forming unit 12. The image forming unit 12 forms an image on the sheet Sh2 supplied from the paper feed unit 13 through the transport path.

[0022] The operation display unit 14 is a user interface in the image processing device 10. The operation display unit 14 has a display unit such as a liquid crystal display that displays various information in response to control instructions from the control unit 15, and an operation unit such as a switch or touch panel that inputs various information to the control unit 15 in response to user operations. The image processing device 10 may also include, for example, an audio output unit and an audio input unit as a user interface in addition to or instead of the operation display unit 14. The operation display unit 14 may also be, for example, an external device provided separately from the housing 100. In this case, the image processing device 10 can use the operation display unit 14 as a user interface by performing data communication with the external device.

[0023] The control unit 15 performs overall control of the image processing device 10. The control unit 15 is primarily configured as a computer system having one or more processors and one or more memories. In the image processing device 10, the functions of the control unit 15 are realized by the one or more processors executing programs. The programs may be pre-recorded in one or more memories, provided via a telecommunications line such as the Internet, or provided by being recorded on a non-transitory recording medium readable by a computer system, such as a memory card or an optical disk. The one or more processors are composed of one or more electronic circuits including semiconductor integrated circuits. Furthermore, the computer system referred to in this disclosure includes a microcontroller having one or more processors and one or more memories. The control unit 15 may be a control unit provided separately from the main control unit that performs overall control of the image processing device 10.

[0024] The imaging device 3 is a camera that has an image sensor, optical elements, etc., and captures an image of a peripheral area R2 (see FIG. 3) of a target area R1 (see FIG. 3). The "target area" here refers to an area in which sheets Sh1 and Sh2 can be placed, and includes, for example, the sheet stacking tray 21 and sheet discharge tray 22 of the sheet conveying device 2 in which sheet Sh1 (document) as the target for image reading can be placed, and the discharge tray 123 of the image forming unit 12 in which sheet Sh2 on which an image has been formed can be placed. The imaging device 3 is a camera that has, within its field of view, a peripheral area R2 around the target area R1 in which sheets Sh1 and Sh2 as the target for image processing can be placed.

[0025] The imaging device 3 captures the surrounding area R2 and outputs the captured image to the control unit 15. The captured image may be either a moving image or a still image, and may be either a monochrome image or a color image. In the present embodiment, as an example, the captured image is a moving image and a color image. The surrounding area R2 is not limited to the shape shown in FIG. 3 and may have any shape, and further, the shape may be variable.

[0026] The image processing device 10 further includes a storage unit, a communication unit, a power supply unit, etc. The storage unit includes one or more non-volatile memories and stores information such as control programs for causing the control unit 15 to execute various processes. The communication unit is an interface that executes data communication between the image processing device 10 and an external device connected via a communication network such as the Internet or a LAN (Local Area Network). The power supply unit is a power supply circuit that generates (outputs) power for the operation of the image processing device 10.

[0027] Incidentally, a related technology to this type of image processing device 10 is a (monitoring) device that monitors other people looking at the content displayed by the image processing device due to the operator's operation, the medium on which the drawing is output, or the original document to be read.

[0028] A monitoring device according to a related art determines whether or not people, excluding the operator, among those identified by personal information indicating people present within a predetermined range from an image processing device, have a predetermined relationship with the operator. This monitoring device controls to output warning information if it determines that even one of the identified people does not have the predetermined relationship, and suppresses the output of warning information if it determines that all of the identified people have the predetermined relationship. For example, people who belong to the same department as the operator are considered to have a predetermined relationship with the operator (related parties) and are therefore allowed to peek inside.

[0029] However, in the configuration of the above-mentioned related technology, even if the image being printed or read does not contain any confidential information, if there is someone within a specified range who does not have a specified relationship with the operator, the image processing device will output warning information, which may be annoying to the user.

[0030] In contrast to this, in this embodiment, the configuration described below realizes an image processing device 10, an image processing method, and a program that are less likely to be bothersome to the user.

[0031] That is, the image processing device 10 according to this embodiment includes an image processing unit (image reading unit 11 and image forming unit 12) that performs image processing, such as at least one of image reading and image formation, on sheets Sh1 and Sh2. The image processing device 10 further includes a first determination processing unit 151, a second determination processing unit 152, and a deterrence processing unit 153. The first determination processing unit 151 determines the possibility of peeping into the target area R1 based on a captured image of a peripheral area R2 of the target area R1 where the sheet Sh1 can be placed. The second determination processing unit 152 determines the security level of the image to be processed. The deterrence processing unit 153 performs deterrence processing based on the determination results of both the first determination processing unit 151 and the second determination processing unit 152. In this embodiment, the first determination processing unit 151, the second determination processing unit 152, and the deterrence processing unit 153 are all provided in the control unit 15 as functions of the control unit 15.

[0032] The "deterrent process" in the present disclosure refers to a process for deterring peeping at the target area R1, and includes, for example, issuing a warning, stopping image processing by the image processing device 10, or sending a notification to the terminal of the administrator of the image processing device 10. The "warning" here includes, for example, notifying the operator H1 (see FIG. 3) operating the image processing device 10 of the peeping act by display (including screen display and light emission from the light-emitting unit, etc.) and / or sound output (including buzzer sound output and voice output, etc.). Furthermore, the "warning" may be a process for urging the third party H2 (see FIG. 3) who is peeping to stop peeping.

[0033] According to the above-described configuration, the image processing device 10 according to this embodiment has the advantage of being less bothersome to the user. That is, the deterrence processing unit 153 performs deterrence processing based on both the possibility of peeping into the target area R1 determined by the first determination processing unit 151 and the security level of the image to be processed determined by the second determination processing unit 152. Therefore, even if a third party H2 who does not have a predetermined relationship with the operator H1 is present in the surrounding area R2 and the third party H2 is suspected of peeping into the target area R1, deterrence processing such as issuing a warning will not be performed depending on the security level of the image to be processed. Therefore, for example, if the image to be printed or scanned does not contain any confidential information, deterrence processing such as issuing a warning will not be performed even if the third party H2 is suspected of peeping into the target area R1, and the user (including the operator H1) will not feel bothered.

[0034] [2] Details of the control unit Next, the configuration of the control unit 15 of the image processing device 10 according to this embodiment will be described in more detail with reference to FIG.

[0035] The control unit 15 has an acquisition processing unit 150, a first determination processing unit 151, a second determination processing unit 152, and a check processing unit 153. That is, in this embodiment, the image processing device 10 has the acquisition processing unit 150 as one function of the control unit 15, in addition to the first determination processing unit 151, the second determination processing unit 152, and the check processing unit 153.

[0036] The acquisition processing unit 150 acquires a captured image Im1 (see FIG. 4) of the surrounding area R2 captured by the imaging device 3. Specifically, the acquisition processing unit 150 acquires image data of the captured image Im1 of the surrounding area R2 captured by the imaging device 3 as an electrical signal from the imaging device 3. The captured image Im1 acquired by the acquisition processing unit 150 is temporarily stored in one or more memories. The acquisition processing unit 150 may acquire the captured image Im1 from a source other than the imaging device 3.

[0037] The first determination processing unit 151 determines the possibility of peeping into the target area R1 based on the captured image Im1 of the surrounding area R2. That is, the first determination processing unit 151 determines the possibility that peeping into the target area R1 is taking place (peeping possibility) based on the captured image Im1 acquired by the acquisition processing unit 150. In the present embodiment, as an example, the "peeping possibility" is expressed as a percentage, and the higher the possibility of peeping, the closer (larger) the peeping possibility is to 100%.

[0038] Specifically, the first determination processing unit 151 automatically extracts a human face from the captured image Im1 and distinguishes between the operator H1 of the image processing device 10 and a third party H2 from the face. If the third party H2 (their face) is reflected in the captured image Im1, the first determination processing unit 151 calculates the possibility of peeking based on various determination conditions such as the position of the third party H2 (including the distance from the target area R1), the direction of the line of sight of the third party H2 (whether or not they are facing the target area R1), and / or whether the third party H2 has remained for a certain period of time or more.

[0039] For example, the closer the distance from the image processing device 10 to the third party H2 and the closer the gaze direction is to the target region R1, the higher the likelihood of peeping is determined by the first determination processing unit 151. The recognition process from the captured image Im1 performed by the first determination processing unit 151 may be a general process using HOG (Histgrams of Oriented Gradients) features or the like, or may be gaze estimation using a neural network such as deep learning or machine learning.

[0040] The second determination processing unit 152 determines the security level of the image to be subjected to image processing. In the present disclosure, "security level" refers to the level of security (confidentiality) of the image to be subjected to image processing, and the more confidential (or secret) the image, such as a confidential document, the higher the security level. In this embodiment, as an example, the "security level" is expressed in multiple stages, and the higher the confidentiality, the higher the security level. More specifically, four security levels are set: "Top Secret" = "Level 4," "Confidential" = "Level 3," "Company Confidential" = "Level 2," and "Public" = "Level 1."

[0041] Specifically, the second determination processing unit 152 determines the security level of an "image" read by the image reading unit 11 from a sheet Sh1 (document) as an object to be read (object to be image processed) and / or an "image" formed on a sheet Sh2 by the image forming unit 12. For example, if an image to be subjected to image processing (reading or forming) includes a "TOP CONFIDENTIAL" stamp, the second determination processing unit 152 determines that the image is "TOP CONFIDENTIAL" and determines the security level to be the highest "Level 4." On the other hand, if an image to be subjected to image processing (reading or forming) includes a "CONFIDENTIAL" stamp, the second determination processing unit 152 determines that the image is "CONFIDENTIAL" and determines the security level to be "Level 2."

[0042] In this way, the second determination processing unit 152 can determine the security level based on information (such as a stamp, barcode, or background pattern) embedded in an "image" read from the sheet Sh1 (document) as the object to be read (object to be image processed) by the image reading unit 11. In other words, when an image is read as image processing, the second determination processing unit 152 determines the security level based on the embedded information included in the image. As a result, for example, when embedded information such as a stamp, barcode, or background pattern is included in the image, the second determination processing unit 152 can accurately determine the security level.

[0043] Furthermore, if an image to be processed (read or formed) is associated with a security level in advance, the second determination processing unit 152 may determine the security level of the image based on the association. For example, at least for the data of an "image" formed on the sheet Sh2 by the image forming unit 12, a security level is associated in advance for each piece of image data. The second determination processing unit 152 can then determine the security level of the image based on the security level corresponding to the "image" formed on the sheet Sh2 by the image forming unit 12. In other words, when an image is formed as image processing, the second determination processing unit 152 determines the security level based on the association information associated with the image. As a result, for example, if association information is set, the second determination processing unit 152 can accurately determine the security level.

[0044] The check processing unit 153 performs check processing based on the determination results of both the first determination processing unit 151 and the second determination processing unit 152. In this embodiment, the check processing unit 153 performs check processing when the possibility of peeping is equal to or greater than a first threshold and the security level is equal to or greater than a second threshold. In other words, when at least one of the following is satisfied: the possibility of peeping determined by the first determination processing unit 151 is less than the first threshold, and the security level determined by the second determination processing unit 152 is less than the second threshold, the check processing unit 153 does not perform check processing. Here, the first threshold and the second threshold are predetermined values ​​and may be the same value or different values.

[0045] As a result, only when a third party H2 who does not have a predetermined relationship with the operator H1 is present in the surrounding area R2 and it is suspected that the third party H2 is peeking into the target area R1, and the security level of the image to be processed is high, will deterrent processing such as a warning be performed. For example, if the image to be printed or read does not contain any confidential information, deterrent processing such as a warning will not be performed even in a situation where it is suspected that the third party H2 is peeking into the target area R1, and users (including the operator H1) are unlikely to feel bothered.

[0046] In the present embodiment, as an example, the "check processing" performed by the check processing unit 153 is the output (display and / or sound) of a warning to the operator H1 from the operation display unit 14. However, in addition to or instead of outputting a warning, the check processing unit 153 may also perform check processing such as stopping (including suspending and interrupting) image processing by the image processing device 10, or notifying the terminal of the administrator of the image processing device 10.

[0047] [3] Image processing method Next, an image processing method according to this embodiment, that is, the operation of the image processing device 10, will be described with reference to Figures 3 to 5. Figure 4 shows an example of a captured image Im1. The reference numerals and leading lines shown in Figure 4 are added for the purpose of explanation and are not actually included in the captured image Im1.

[0048] 3, a scene is assumed in which an operator H1 and a third party H2 are present within a peripheral area R2 that is the field of view of the imaging device 3. The operator H1 is a person operating the image processing device 10 (an authenticated user who has performed user authentication), and the third party H2 is a person other than the operator H1.

[0049] First, an operator H1 stands in front of the image processing device 10 to use it, and performs user authentication to make the image processing device 10 ready to execute a job of image processing (reading and / or forming an image). The user authentication is performed by facial authentication using a captured image Im1 captured by the imaging device 3, or by inputting a user ID or the like. The image processing device 10 temporarily stores the authentication information used for the user authentication, and uses the authentication information to identify the operator H1 and distinguish him / her from a third party H2.

[0050] 4, when a third party H2 other than the operator H1 (authenticated user) is detected in a captured image Im1 captured by the imaging device 3, the image processing device 10 determines (calculates) the possibility of peeping by the third party H2 based on the captured image Im1. At this time, the first determination processing unit 151 extracts the face of the third party H2 from the captured image Im1 and determines (calculates) the possibility of peeping based on determination conditions such as the position of the face of the third party H2 (including the distance from the image processing device 10), the direction of the line of sight of the third party H2, and / or whether the third party H2 has remained for a certain period of time or more. As an example, when the distance from the image processing device 10 to the third party H2 is short and the direction of the line of sight is close to the target region R1, the first determination processing unit 151 determines that the possibility of peeping is high (for example, 90%).

[0051] If the likelihood of peeping is equal to or greater than a first threshold (e.g., 70%), the image processing device 10 determines the security level of the image to be processed (read and / or formed). At this time, the second determination processing unit 152 determines whether the security level of the image is Level 4 (=Top Secret), Level 3 (=Confidential), Level 2 (=Company Confidential), or Level 1 (=Open) based on embedded information contained in the image to be processed or corresponding information associated with the image. As an example, if the image to be read as image processing is a "Top Secret" confidential document, the second determination processing unit 152 determines the security level to be Level 4.

[0052] If the possibility of peeping is equal to or greater than the first threshold and the security level is equal to or greater than the second threshold (e.g., level 2), the deterrence processing unit 153 outputs a warning (display and / or sound) to the operator H1 from the operation display unit 14 as deterrence processing.

[0053] Here, the check processing unit 153 may change the content of the check processing in relation to the timing when the image processing unit (image reading unit 11 or image forming unit 12) executes an image processing job. For example, if it is determined that the possibility of peeping is equal to or greater than a first threshold and the security level is equal to or greater than a second threshold at the timing when the image processing job is started, the check processing unit 153 not only outputs a warning but also puts the image processing job on hold without starting it. On the other hand, if it is determined that the possibility of peeping is equal to or greater than the first threshold and the security level is equal to or greater than a second threshold while the image processing job is being executed, the check processing unit 153 not only outputs a warning but also interrupts (pauses) the job being executed.

[0054] Furthermore, when an image to be processed (formed) by the image forming unit 12 is previously associated with a security level as correspondence information, and the second determination processing unit 152 determines the security level of the image based on the correspondence information, the correspondence information may be included in the image and formed (printed) on the sheet Sh2. For example, when an image associated with "Top Secret" (=Level 4) as correspondence information is formed on the sheet Sh2, a "Top Secret" stamp may be embedded in the image and formed on the sheet Sh2. In short, the image processing unit (image reading unit 11 or image forming unit 12) forms an image on the sheet Sh2 including the correspondence information. This makes it possible to form the security level on the sheet Sh2.

[0055] Furthermore, in this embodiment, the first determination processing unit 151 determines the possibility of peeping when a third party H2 other than the operator H1 is detected in the captured image Im1. In other words, if a third party H2 other than the operator H1 is not detected in the captured image Im1, the first determination processing unit 151 does not determine the possibility of peeping. This makes it possible to avoid unnecessary determinations of the possibility of peeping and reduce the processing load related to the determination process of the possibility of peeping.

[0056] 5 represent the numbers of the processing procedures (steps) executed by the control unit 15. The control unit 15 mainly comprises a computer system having one or more processors and one or more memories, and the following processing is realized by the one or more processors executing programs.

[0057] <Step S1> First, in step S1, the first determination processing unit 151 detects a "person" within the surrounding area R2 from the captured image Im1. If a person is not detected from the captured image Im1 (S1: No), the first determination processing unit 151 repeatedly executes step S1. On the other hand, if a person is detected from the captured image Im1 (S1: Yes), the first determination processing unit 151 transitions the process to step S2.

[0058] <Steps S2 and S3> In step S2, the first determination processing unit 151 extracts a face image of a person from the captured image Im1. In the next step S3, the first determination processing unit 151 performs face authentication on the extracted face image and determines whether or not the person is the same as the authenticated user (operator H1). If the extracted face image is the same as the operator H1 (S3: Yes), the first determination processing unit 151 returns the process to step S2 and extracts the face image of the next (different) person. If the extracted face image is not the same as the operator H1 (S3: No), the first determination processing unit 151 determines that a third party H2 is present and proceeds to step S4.

[0059] <Step S4> In step S4, the first determination processing unit 151 calculates the possibility of peeking based on the face image of the third party H2 in the captured image Im1. At this time, the first determination processing unit 151 determines (calculates) the possibility of peeking based on determination conditions such as the position of the face of the third party H2 (including the distance from the image processing device 10), the direction of the line of sight of the third party H2, and / or whether the third party H2 remains for a certain period of time or more.

[0060] <Step S5> In step S5, it is determined whether the possibility of peeping is equal to or greater than a first threshold (for example, 70%). If the possibility of peeping is equal to or greater than the first threshold (S5: Yes), the control unit 15 shifts the process to step S6. On the other hand, if the possibility of peeping is less than the first threshold (S5: No), the control unit 15 returns the process to step S2 and extracts the face image of the next (different) person.

[0061] <Step S6> In step S6, the second determination processing unit 152 determines the security level of the image to be subjected to image processing (reading and / or formation), and determines whether the security level is equal to or greater than a second threshold value (e.g., level 2). If the security level is equal to or greater than the second threshold value (S6: Yes), the control unit 15 shifts the process to step S7. On the other hand, if the security level is less than the second threshold value (S6: No), the control unit 15 returns the process to step S2 and extracts the facial image of the next (different) person.

[0062] <Step S7> In step S7, the check processing unit 153 outputs (displays and / or sounds) a warning to the operator H1 from the operation display unit 14 as check processing.

[0063] The procedure of the image processing method described above is merely an example, and the order of the processes shown in the flowchart of FIG. 5 may be changed as appropriate, or processes may be added.

[0064] In this embodiment, the second threshold value set for the security level of an image to be processed is not a fixed value but a variable value. In particular, the second threshold value varies depending on a preset alert level. The "alert level" here can be arbitrarily set by a user such as an administrator of the image processing device 10, and is determined depending on the installation location of the image processing device 10.

[0065] As an example, if the image processing device 10 is installed in a company office and the image processing device 10 is installed on a floor that is off-limits to people outside the company, the alert level is set in advance to "confidential or higher." In this case, the second threshold value varies depending on the alert level (confidential or higher) and is set to level 3 (=confidential). As a result, the check processing is limited to only cases where the security level of the image to be processed is level 4 (=top confidential) or level 3 (=confidential); for example, if the security level of the image to be processed is level 2 (=confidential), the check processing is not performed.

[0066] On the other hand, when the image processing device 10 is installed in a company office, if the image processing device 10 is installed on a floor that is off-limits to outsiders, the alert level is set in advance to "top secret or higher." In this case, the second threshold value varies depending on the alert level (top secret or higher) and is set to level 4 (=top secret). As a result, the check processing is limited to only cases where the security level of the image to be processed is level 4 (=top secret); for example, if the security level of the image to be processed is level 3 (=confidential), the check processing is not performed.

[0067] In this way, by varying the second threshold value depending on the alert level, unnecessary check processing can be suppressed.

[0068] [4] Variation Multiple components included in the image processing device 10 may be distributed across multiple housings. For example, the first determination processing unit 151, the second determination processing unit 152, the check processing unit 153, etc. are not limited to being configured as a function of the control unit 15, and may be provided in a housing separate from the control unit 15. In other words, at least some of the first determination processing unit 151, the second determination processing unit 152, and the check processing unit 153 do not have to be integrated with the housing 100 of the image processing device 10, and may be provided in a housing separate from the control unit 15.

[0069] It is not essential that the imaging device 3 be provided in the housing 100 of the image processing device 10. For example, the imaging device 3 may be installed outside the image processing device 10, and the control unit 15 (acquisition processing unit 150) may acquire the captured image Im1 from the imaging device 3 by communication or the like. Furthermore, the imaging device 3 may also be used as a camera for authentication, or may be a dedicated camera for determining the possibility of peeping.

[0070] Furthermore, the sheet conveyed by the sheet conveying device 2 may be a sheet Sh2 on which an image is to be formed by the image forming unit 12, that is, a sheet supplied by the paper feed unit 13. In this case, for example, the manual feed tray of the paper feed unit 13 corresponds to the sheet stacking tray of the sheet conveying device 2, and the paper discharge tray 123 of the image forming unit 12 corresponds to the sheet discharge tray of the sheet conveying device 2.

[0071] [Appendix to the invention] The following is a summary of the invention extracted from the above-described embodiment. Note that the configurations and processing functions described in the following supplementary notes can be selected and combined as desired.

[0072] <Appendix 1> an image processing unit that performs at least one of image reading and image formation as image processing on a sheet; a first determination processing unit that determines whether the target area can be viewed based on a captured image of a peripheral area of ​​the target area where the seat can be placed; a second determination processing unit that determines a security level of the image that is the target of the image processing; a check processing unit that performs check processing based on the determination results of both the first determination processing unit and the second determination processing unit, Image processing device.

[0073] <Appendix 2> the first determination processing unit determines the possibility of peeping when a third party other than the operator is detected in the captured image. 2. The image processing device according to claim 1.

[0074] <Appendix 3> The check processing unit executes the check processing when the possibility of peeping is equal to or greater than a first threshold and the security level is equal to or greater than a second threshold. 3. The image processing device according to claim 1 or 2.

[0075] <Appendix 4> The second threshold value varies depending on a preset alert level. 4. The image processing device according to claim 3.

[0076] <Appendix 5> When the image processing is performed by reading the image, the second determination processing unit determines the security level based on embedded information included in the image. 5. The image processing device according to any one of Supplementary Notes 1 to 4.

[0077] <Appendix 6> When the image is formed as the image processing, the second determination processing unit determines the security level based on correspondence information associated with the image. 6. An image processing device according to any one of appendices 1 to 5.

[0078] <Appendix 7> the image processing unit forms the image including the correspondence information on the sheet; 7. The image processing device according to claim 6. [Explanation of symbols]

[0079] 3. Imaging device 10 Image processing device 11 Image reading unit (image processing unit) 12 Image forming unit (image processing unit) 151 First determination processing unit 152 second determination processing unit 153 Check Processing Unit H1 Operator H2 Third party Im1 image R1 Target Area R2 surrounding area Sh1, Sh2 seats

Claims

1. an image processing unit that performs at least one of image reading and image formation as image processing on a sheet; a first determination processing unit that determines whether the target area can be viewed based on a captured image of a peripheral area of ​​the target area where the seat can be placed; a second determination processing unit that determines a security level of the image that is the target of the image processing; a check processing unit that performs check processing based on the determination results of both the first determination processing unit and the second determination processing unit, Image processing device.

2. the first determination processing unit determines the possibility of peeping when a third party other than the operator is detected in the captured image. The image processing device according to claim 1 .

3. the check processing unit executes the check processing when the possibility of peeping is equal to or greater than a first threshold and the security level is equal to or greater than a second threshold.

3. The image processing device according to claim 1 or 2.

4. The second threshold value varies depending on a preset alert level. The image processing device according to claim 3 .

5. When the image processing is performed by reading the image, the second determination processing unit determines the security level based on embedded information included in the image.

3. The image processing device according to claim 1 or 2.

6. When the image is formed as the image processing, the second determination processing unit determines the security level based on correspondence information associated with the image.

3. The image processing device according to claim 1 or 2.

7. the image processing unit forms the image including the correspondence information on the sheet; The image processing device according to claim 6 .

8. image processing for performing at least one of reading an image and forming an image on a sheet; a first determination process for determining whether the target area can be peeped based on a captured image of a periphery of the target area where the seat can be placed; a second determination process for determining a security level of the image that is the target of the image processing; a check processing that performs check processing based on the determination results of both the first determination processing and the second determination processing, Image processing methods.

9. image processing for performing at least one of reading an image and forming an image on a sheet; a first determination process for determining whether the target area can be peeped based on a captured image of a periphery of the target area where the seat can be placed; a second determination process for determining a security level of the image that is the target of the image processing; a check processing for performing check processing based on the determination results of both the first determination processing and the second determination processing; A program for executing the above on one or more processors.

Images