Authentication device with display function

Abstract

To provide an authentication device with a display function that can suitably perform personal authentication even when there are differences in the brightness of the imaging environment.SOLUTION: An authentication device with a display function includes an imaging unit, a display unit having a screen with adjustable brightness, authentication means for authenticating a user using an image captured by the imaging unit, and setting means for setting the brightness of the screen to a brightness for authentication when imaging for authentication is performed by the authentication means. The authentication device with a display function also includes acquisition means for acquiring the brightness of the imaging environment on the basis of the illuminance around the imaging unit or the image captured by the imaging unit, and the setting means sets the brightness for authentication when the brightness of the imaging environment is low to be higher than the brightness for authentication when the brightness of the imaging environment is high.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present invention relates to an authentication device with a display function. [Background technology]

[0002] Conventionally, there have been known techniques for authenticating users using captured images. For example, Patent Document 1 discloses a face recognition device that adjusts the aperture, gain, and shutter speed of a camera when a lighting environment determination unit determines that the lighting is too bright. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2005-84815 Summary of the Invention [Problem to be solved by the invention]

[0004] In an authentication device that authenticates a user using a captured image, it is desirable to be able to authenticate the user more effectively.

[0005] The present invention is intended to solve such problems, and has an object to provide an authentication device with a display function that can more effectively authenticate a user using a captured image. [Means for solving the problem]

[0006] The authentication device with display function of the present invention comprises an imaging unit, a display unit having a screen with adjustable brightness, an authentication means for authenticating a user using an image captured by the imaging unit, and a setting means for setting the brightness of the screen to the brightness for authentication when imaging for authentication is performed by the authentication means.

[0007] Furthermore, the authentication device with display function according to the present invention further comprises an acquisition means for acquiring the brightness of the imaging environment based on the illuminance around the imaging unit or the image captured by the imaging unit, and it is preferable that the setting means sets the brightness of the screen to be higher when the imaging environment is dark than when the imaging environment is bright.

[0008] Furthermore, in the authentication device with a display function according to the present invention, it is preferable that the setting means sets the brightness of the screen to a brightness for authentication when a user requests authentication.

[0009] Furthermore, in the authentication device with a display function according to the present invention, it is preferable that the setting means changes the brightness of the screen from a predetermined brightness for display to a brightness for authentication when an authentication request is made.

[0010] Furthermore, in the authentication device with display function according to the present invention, it is preferable that the display unit is a display operation unit that accepts an authentication request operation by a user, and that the setting means, when the display operation unit accepts the authentication request operation as an authentication request, changes the brightness of the screen from the brightness for displaying the operation to the brightness for authentication.

[0011] Furthermore, it is preferable that the authentication device with display function according to the present invention further comprises a sensor that detects objects in the vicinity of the imaging unit, the authentication means starts authenticating the user when the object is detected by the sensor, and the setting means sets the brightness of the screen to the brightness for authentication when the authentication request is executed if authentication is not successful from the start of authentication until the user executes an authentication request.

[0012] Furthermore, it is preferable that the authentication device with display function according to the present invention further comprises a sensor that detects objects around the imaging unit, the authentication means starts authenticating a user when an object is detected by the sensor within a first predetermined range, and the setting means sets the brightness of the screen to the brightness for authentication if the authentication of the user is not successful when the user is detected within a second predetermined range that is narrower than the first predetermined range. [Effects of the Invention]

[0013] According to the present invention, it is possible to provide an authentication device with a display function that can more effectively authenticate a user using a captured image. [Brief explanation of the drawings]

[0014] [Figure 1] 1 is a functional block diagram of a monitoring system 1 according to a first embodiment. [Figure 2] 1A is a diagram showing the data structure of a registrant information table 131, and FIG. 1B is a diagram showing the data structure of a sensor information table 132. FIG. [Figure 3] 3 is a flowchart showing the flow of a monitoring process executed by the security device 10 of the monitoring system 1. FIG. [Figure 4] FIG. 10 is a flowchart showing the flow of a brightness setting process. [Figure 5] FIG. 10 is a flowchart showing the flow of authentication processing. [Figure 6] 10 is a flowchart showing the flow of a luminance setting authentication process in the monitoring system 1 according to the first modification. DETAILED DESCRIPTION OF THE INVENTION

[0015] The monitoring system according to the present invention will be described below with reference to the drawings. However, it should be noted that the technical scope of the present invention is not limited to the embodiments, but extends to the inventions set forth in the claims and their equivalents.

[0016] (Configuration and Functions of Monitoring System 1 According to Embodiment 1) FIG. 1 is a functional block diagram of a monitoring system 1 according to a first embodiment. The monitoring system 1 monitors intrusions (intrusion anomalies) into a monitoring area. The monitoring area is, for example, a building of a facility such as a residence, a commercial facility, an office, or a public facility. The monitoring area may include the perimeter of the building or the land on which the building is built. The monitoring system 1 has a security device 10, multiple monitoring sensors 30, a security center device 40, and a communication terminal 50. The monitoring sensor 30 is communicatively connected to the security device 10. The security center device 40 and the communication terminal 50 are communicatively connected to the security device 10 via a network 60.

[0017] The security device 10 is an example of an authentication device with a display function, and is placed inside a monitored area. For example, the security device 10 is placed inside a building that is the monitored area. The security device 10 monitors the monitored area in response to operations by facility users, and if an abnormality that may be an intrusion into the monitored area is detected, it reports it to a security center device 40. The security device 10 has an interface unit 11, a communication unit 12, a memory unit 13, a display operation unit 14, an imaging unit 15, an audio output unit 16, an illuminance sensor 17, a distance measurement sensor 18, and a processing unit 20.

[0018] The interface unit 11 is a component that enables the security device 10 to communicate with the monitoring sensor 30, and includes an interface circuit. The interface circuit is, for example, a communication interface circuit for a wired LAN (Local Area Network) or a wireless LAN. The interface circuit may also be an image transmission interface circuit for an HD-SDI (High Definition Serial Digital Interface). The interface unit 11 supplies data supplied from the monitoring sensor 30 to the processing unit 20.

[0019] The communication unit 12 is a component that enables the security device 10 to communicate with the security center device 40 and the communication terminal 50, and includes a communication interface circuit. The communication interface circuit is, for example, a communication interface circuit for a wired LAN, a wireless LAN, LTE (Long Term Evolution), or the like. The communication unit 12 supplies data received from the security center device 40 and the communication terminal 50 to the processing unit 20, and transmits data supplied from the processing unit 20 to the security center device 40 or the communication terminal 50.

[0020] The storage unit 13 is configured to store data and programs, and includes, for example, a semiconductor memory. The storage unit 13 stores an operating system program, a driver program, an application program, data, and the like used in processing by the processing unit 20. The programs are installed into the storage unit 13 from a computer-readable, non-transitory, portable storage medium such as a CD (Compact Disc)-ROM (Read Only Memory) or a DVD (Digital Versatile Disc)-ROM. The programs may also be stored in a storage medium owned by a predetermined server and installed via a network.

[0021] The storage unit 13 stores, as data, security mode information indicating the current security mode. The storage unit 13 also stores, as data, authentication criteria information indicating the authentication criteria used to authenticate a user. The storage unit 13 also stores, as data, hold time information indicating a hold time, for example, one minute. The storage unit 13 also stores a registrant information table 131 and a sensor information table 132.

[0022] The display operation unit 14 is an example of a display unit, and is configured to accept user operations on the security device 10 and display images. The display operation unit 14 has a touch panel equipped with a screen such as a liquid crystal display or an organic EL (Electro Luminescence) display, an output interface circuit that outputs image data to the display, and an input interface circuit that acquires signals from the touch panel.

[0023] The display operation unit 14 generates a signal in response to a user's operation and supplies it to the processing unit 20. In one example, the display operation unit 14 accepts an authentication request operation by the user, generates a signal in response to the authentication request operation, and supplies it to the processing unit 20. The authentication request operation is any operation related to an authentication request that requires user authentication, such as an operation to change the security mode or to change various settings. The display operation unit 14 also generates and displays an image based on the signal supplied from the processing unit 20. The brightness of the screen of the display operation unit 14 can be adjusted by changing the amount of light from the backlight or by changing the magnitude of the voltage supplied.

[0024] The imaging unit 15 is configured to capture images of the periphery of the security device 10 and includes a camera. The camera includes an imaging optical system for forming an image on a light-receiving surface, photoelectric conversion elements such as CCD (Charge Coupled Device) sensors that are two-dimensionally arranged on the light-receiving surface and output an electrical signal according to the amount of incident light, and an image generation circuit that generates an image based on the output of the photoelectric conversion elements. The imaging unit 15 captures an image of the user's face and supplies the acquired image to the processing unit 20 as an input face image. The imaging unit 15 may also be configured as a means for acquiring captured images from an externally connected camera.

[0025] The audio output unit 16 is configured to output audio and includes a speaker. The audio output unit 16 outputs audio based on a signal supplied from the processing unit 20.

[0026] The illuminance sensor 17 is configured to detect the brightness around the security device 10. The illuminance sensor 17 has a light-receiving element such as a photodiode that outputs a current according to the amount of incident light, and a signal generation circuit that generates a signal based on the output of the light-receiving element. The illuminance sensor 17 supplies the signal generated when the imaging unit 15 captures an image of the user's face to the processing unit 20 as a signal indicating the illuminance at the time the image of the user's face was captured.

[0027] The distance measurement sensor 18 is an example of a sensor that detects objects around the imaging unit 15, such as a LiDAR that measures the distance to a measurement target. The distance measurement sensor 18 can detect objects that are farther away than the range in which the imaging unit 15 can capture an image of the user's face.

[0028] The processing unit 20 is configured to comprehensively control the operation of the security device 10 and includes one or more processors and their peripheral circuits. The processing unit 20 includes, for example, a CPU (Central Processing Unit). The processing unit 20 may also include a DSP (Digital Signal Processor), an LSI (Large Scale Integration), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), etc. The processing unit 20 executes processing based on a program stored in the memory unit 13. The processing unit 20 also controls the operation of each component of the security device 10 so that processing is executed appropriately.

[0029] The processing unit 20 has, as functional blocks, an acquisition means 21, a timing means 22, an authentication means 23, a reception means 24, a determination means 25, a setting means 26, and a notification means 27. These functional blocks are functional modules realized based on a program executed by the processing unit 20. These functional blocks may also be firmware implemented in the security device 10.

[0030] The multiple monitoring sensors 30, also simply referred to as sensors, are arranged in a monitored area and detect intrusions into the monitored area. The multiple monitoring sensors 30 detect abnormalities in the monitored area that may be suspected to be intrusions into the monitored area, and output a detection signal indicating the detection of the abnormality to the security device 10. The detection signal includes the sensor ID of the monitoring sensor 30. For example, the monitoring sensor 30 is a magnetic sensor that detects the opening and closing of a door, window, or other part of a building as an abnormality in the monitored area. The monitoring sensor 30 may be an infrared sensor that detects a moving object within the monitored area as an abnormality in the monitored area based on a change in the amount of received infrared light. The monitoring sensor 30 may also be an image sensor that detects a moving object within the monitored area as an abnormality in the monitored area based on a differential signal between a captured image and a pre-stored background image.

[0031] The security center device 40 is an information processing device such as a server or a PC (Personal Computer) that is located in a security center where security guards are stationed. The security center device 40 receives a report from the security device 10. When the security center device 40 receives a report, it notifies the security guards stationed at the security center of the report content by, for example, displaying the report content.

[0032] The communication terminal 50 is an information processing terminal such as a smartphone or a mobile phone owned by a user. The communication terminal 50 transmits to the security device 10 a predetermined input signal for operating the security device 10.

[0033] 2(A) is a diagram showing the data structure of a registrant information table 131 that is stored in the storage unit 13 and manages information about registrants. A registrant is a facility user who has been registered in advance as someone who will operate the security device 10. The registrant information table 131 stores registrant IDs, registered face images, etc., in mutual association with each other.

[0034] The registrant ID is information that uniquely identifies the registrant, and may be, for example, an arbitrary character string. The registered face image is an image of the registrant's face. The data in the registrant information table 131 is set in advance by the administrator of the security device 10. The registrant information table 131 may also include a notification destination for notifying the registrant.

[0035] 2(B) is a diagram showing the data structure of a sensor information table 132 that is stored in the storage unit 13 and manages information related to the monitoring sensor 30. The sensor information table 132 stores sensor IDs, hold time settings, etc. in association with one another.

[0036] The sensor ID is information that uniquely identifies the monitoring sensor 30, and may be, for example, an arbitrary character string. The hold time setting is information indicating whether a hold time is set for each monitoring sensor 30. The hold time is the time that the security device 10 holds off reporting to the security center device 40 after the monitoring sensor 30 outputs a detection signal. If a monitoring sensor 30 for which a hold time is not set outputs a detection signal, the security device 10 immediately reports to the security center device 40 that there has been an intrusion into the monitored area. If a monitoring sensor 30 for which a hold time is set outputs a detection signal, the security device 10 holds off reporting for the hold time corresponding to the hold time information stored in the memory unit 13, and then reports to the security center device 40 that there has been an intrusion into the monitored area.

[0037] Furthermore, if an abnormality cancellation operation is performed to cancel the detection of an abnormality, i.e., to cancel it, during the hold time after detection by the monitoring sensor 30, the security device 10 will not notify the security center device 40 that there has been an intrusion into the monitored area, even after the hold time has elapsed.

[0038] The security device 10 is set to one of the security modes, i.e., the out-of-doors security mode and the disabled mode. In the out-of-doors security mode, the security device 10 monitors intrusions into the monitored area. On the other hand, in the disabled mode, the security device 10 does not monitor intrusions into the monitored area. Note that the security device 10 may have security modes other than the out-of-doors security mode and the disabled mode.

[0039] For example, if the monitored area is a registrant's residence, the registrant sets the security device 10 to out-of-home security mode when leaving the residence, and cancels the out-of-home security mode and sets the security device 10 to the disabled mode when returning home. Because the security device 10 is located inside the monitored area, the monitoring sensor 30 detects the registrant's return as an entry into the monitored area between the time the registrant returns home and the time the security device 10 is set to the disabled mode. To prevent the security device 10 from determining that an intrusion into the monitored area has occurred and reporting it to the security center device 40, the security device 10 withholds reporting for a predetermined holding time, which is the standard time between the time the monitoring sensor 30 detects an entry and the time the registrant cancels the out-of-home security mode. If the out-of-home security mode is canceled during the holding time after the registrant is detected by the monitoring sensor 30, no reporting is made.

[0040] The data in the sensor information table 132 is set in advance by the administrator of the security device 10. In particular, the hold time setting data is set based on the location where each monitoring sensor 30 is installed. For example, if the monitoring area is the residence of a registrant, a hold time is set for the monitoring sensor 30 that first detects the registrant when the registrant returns home, and no hold time is set for the other monitoring sensors 30. An example of a monitoring sensor 30 for which a hold time is set is a magnetic sensor that detects the opening and closing of a front door. Examples of monitoring sensors 30 for which a hold time is not set are a magnetic sensor that detects the opening and closing of a window, an infrared sensor that detects moving objects, etc.

[0041] 3 is a flow diagram showing the flow of the monitoring process executed by the security device 10 of the monitoring system 1. The monitoring process is realized by the processing unit 20 cooperating with each component of the security device 10 based on a program stored in the storage unit 13.

[0042] First, the acquisition means 21 acquires the current security mode (S101). The acquisition means 21 acquires, as the current security mode, the security mode indicated in the security mode information stored in the storage unit 13. Next, the acquisition means 21 determines whether the current security mode acquired in the processing of S101 is the deactivated mode (S102).

[0043] When the acquisition means 21 determines that the current security mode is not the cancellation mode (S102-NO), it determines whether or not the detection signal output from the monitoring sensor 30 has been acquired via the interface unit 11 (S103).

[0044] Next, when it is determined that the acquisition means 21 has acquired a detection signal (S103-YES), the timing means 22 determines whether or not a hold time has been set for the monitoring sensor 30 that output the detection signal (S104). The timing means 22 refers to the sensor information table 132, and determines that a hold time has been set if the hold time setting for the sensor ID included in the detection signal is set to "Yes".

[0045] If a hold time is set for the monitoring sensor 30 that output the detection signal (S104-YES), the processing unit 20 executes a brightness setting process (S105). In the brightness setting process, the processing unit 20 sets the brightness of the screen of the display operation unit 14 to a brightness for authentication. The brightness for authentication is a brightness that is set when an image is captured for authentication. The brightness setting process will be described in detail later.

[0046] Next, the timing means 22 starts timing the hold time (S106). For example, the timing means 22 stores the time when the detection signal is acquired as the start time of the hold time in the storage unit 13. Note that the order of S105 and S106 may be reversed.

[0047] Next, the reception means 24 receives a change operation by the user to change the security mode (S107). If the current security mode is the away security mode, the reception means 24 displays information indicating whether or not to cancel the security mode on the display operation unit 14, and receives the change operation. Note that the reception means 24 can also receive operations other than the change operation to set the security mode in the monitored area.

[0048] Next, the determination means 25 determines whether or not a change operation has been accepted on the display operation unit 14 (S108). The determination means 25 determines that a change operation has been accepted when a signal corresponding to a cancel operation or a cancel operation is supplied from the display operation unit 14.

[0049] If the change operation has not been accepted (S108-NO), the timing means 22 determines whether or not a preset hold time has elapsed since the start time stored in the process of S106 (S109).

[0050] If the reservation time has not elapsed (S109-NO), the monitoring process returns to S107, and the reception unit 24 again receives the change operation. The reception unit 24 repeatedly receives the change operation until the reservation time has elapsed or the change is received.

[0051] When the change operation is accepted (S108-YES), the authentication means 23 executes an authentication process (S110) to authenticate the user by comparing the registered face image stored in the registrant information table 131 with the input face image acquired by the imaging unit 15. In the authentication process, the authentication means authenticates the user using the input face image acquired by the imaging unit 15. Details of the authentication process will be described later.

[0052] Next, the authentication means 23 determines whether or not the authentication of the user has been successful in the authentication process (S111).

[0053] If the user authentication is not successful (S111-NO), the timing means 22 determines whether a preset hold time has elapsed since the start time stored in the processing of S106 (S112).

[0054] If the hold time has not elapsed (S112-NO), the monitoring process returns to S110, and the authentication means 23 authenticates the user again. The authentication means 23 repeatedly authenticates the user until the hold time has elapsed or the user authentication is successful.

[0055] If the user authentication is successful (S111-YES), the determination means 25 determines that there has been no intrusion into the monitored area (S113). The determination means 25 determines that there has been no intrusion into the monitored area if a change operation is accepted and the user authentication is successful during the holding time after the detection signal is acquired from the monitoring sensor 30. The determination means 25 determines that there has been an intrusion into the monitored area if a change operation is not accepted during the holding time after the detection signal is acquired, or if a change operation is accepted but the user authentication is not successful.

[0056] Next, the setting means 26 changes the security mode of the security device 10 in accordance with the processing of S108 (S114). If a signal corresponding to a cancellation operation is supplied in the processing of S108, the setting means 26 changes the security mode information stored in the memory unit 13 to information indicating the cancellation mode. Furthermore, if a signal corresponding to a cancellation operation is supplied in the processing of S108, the setting means 26 does not change the security mode information stored in the memory unit 13. This completes the monitoring processing.

[0057] If the current security mode is the deactivation mode (YES in S102) or if a detection signal is not acquired (NO in S103), the reception means 24 receives a change operation to change the security mode (S115), similar to the process in S107. The reception means 24 displays information indicating whether or not to set the security mode on the display operation unit 14, and receives the change operation.

[0058] Next, the determination means 25 determines whether or not a change operation on the display operation unit 14 has been accepted (S116), similar to the process of S108. The determination means 25 determines that a change operation has been accepted when a signal corresponding to setting the security mode is supplied from the display operation unit 14. If a change operation has not been accepted (S116-NO), the process returns to S101. If a change operation has been accepted (S116-YES), the authentication means 23 executes authentication processing (S117), similar to the process of S110.

[0059] Next, the authentication means 23 determines whether or not the authentication of the user has been successful (S118), similarly to the process of S111. If the authentication of the user has not been successful (S118-NO), the process returns to S101.

[0060] If the user authentication is successful (S118-YES), the setting means 26 changes the security mode in accordance with the signal supplied in response to the processing of S115 (S119), and the processing returns to S101. When a signal corresponding to the going-out security setting operation is supplied, the setting means 26 changes the security mode information stored in the memory unit 13 to information indicating the going-out security mode. Note that if a signal to change the security mode is not received after the processing of S115, the authentication means 23 does not change the security mode.

[0061] If the hold time is not set for the monitoring sensor 30 that output the detection signal (S104-NO), if the hold time has elapsed before the change operation is accepted (S109-YES), or if the hold time has elapsed before the user authentication is successful (S112-YES), the determination means 25 outputs a warning (S120). The determination means 25 displays a predetermined warning on the display operation unit 14 and causes the audio output unit 16 to output a predetermined warning sound.

[0062] Next, the determination means 25 determines that an intrusion into the monitored area has occurred (S121). That is, the determination means 25 determines that an intrusion into the monitored area has occurred if a change operation is not accepted within the hold time after the detection signal is acquired from the monitoring sensor 30, or if user authentication is not successful within the hold time after the detection signal is acquired.

[0063] Next, the notification means 27 notifies the security center device 40 that there has been an intrusion into the monitored area (S122). The notification means 27 generates a notification signal including the sensor ID of the monitoring sensor 30 that output the detection signal. The notification means 27 transmits the notification signal to the security center device 40 via the communication unit 12. This completes the monitoring process.

[0064] 4 is a flowchart showing the flow of the brightness setting process, which is executed in S105 of FIG.

[0065] First, the acquisition means 21 acquires the brightness of the imaging environment based on the illuminance around the imaging unit 15 or the captured image captured by the imaging unit 15 (S201). The brightness of the imaging environment is a quantified value of the illuminance or luminance when the imaging unit 15 captures an image, such as an illuminance parameter or a luminance distribution parameter. The illuminance parameter is an index indicating whether the lighting environment around the imaging unit 15 is good or bad when the imaging unit 15 captures an image, i.e., whether the imaging environment reduces authentication accuracy. In one example, the illuminance parameter is the illuminance around the imaging unit 15 when the input face image is captured. The illuminance around the imaging unit 15 is detected by the illuminance sensor 17. The luminance distribution parameter is an index indicating whether the luminance distribution of the captured image captured by the imaging unit 15 is good or bad, i.e., whether the imaging environment reduces authentication accuracy. In one example, the luminance distribution parameter is the average luminance of each pixel included in the captured image. The acquisition means 21 acquires the brightness of the imaging environment by calculating the illuminance parameter or the luminance distribution parameter. The acquisition means 21 may obtain both the illuminance parameter and the luminance distribution parameter when acquiring the brightness of the imaging environment.

[0066] Next, the determination means 25 determines whether the brightness of the imaging environment is bright, i.e., whether the brightness of the imaging environment is good (S202). If the illuminance parameter or luminance distribution parameter calculated in the process of S201 is equal to or greater than a first threshold, the determination means 25 determines that the brightness of the imaging environment is bright, i.e., the brightness of the imaging environment is good. On the other hand, if the illuminance parameter or luminance distribution parameter is less than the first threshold, the determination means 25 determines that the brightness of the imaging environment is not bright, i.e., the brightness of the imaging environment is not good. In one example, the first threshold is set, through a prior experiment, to a value between the illuminance parameter or luminance distribution parameter when a person is correctly authenticated and the illuminance parameter or luminance distribution parameter when a person is not correctly authenticated.

[0067] If the determination means 25 determines that the imaging environment is bright (S202-YES), the setting means 26 sets the brightness of the screen of the display / operation unit 14 to low (S203). The setting means 26 sets the brightness of the screen of the display / operation unit 14 to low by setting the light intensity of the backlight of the display / operation unit 14 to a light intensity less than a first light intensity threshold, or by setting the magnitude of the voltage supplied to the display / operation unit 14 to a voltage less than a first voltage threshold. The first light intensity threshold and the first voltage threshold are set to a value obtained by adding a margin to the minimum light intensity or voltage value at which user authentication was successful in a preliminary experiment in which authentication was performed while changing the light intensity of the backlight of the display / operation unit 14 or the voltage supplied to the display / operation unit 14 with the illuminance parameter or luminance distribution parameter at the first threshold. Note that if the imaging environment is bright, the setting means 26 may omit setting the brightness of the screen of the display / operation unit 14. That is, when the brightness of the imaging environment is good, the setting means 26 may maintain the brightness of the screen of the display operation unit 14 at the startup brightness. The startup brightness is the brightness of the screen when the screen of the display operation unit 14 is started up, and is set in advance as an initial setting of the security device 10. The startup brightness is an example of a predetermined display brightness.

[0068] On the other hand, when the determination means 25 determines that the brightness of the imaging environment is not bright, i.e., that the brightness of the imaging environment is not good (S202-NO), it determines whether the brightness of the imaging environment is normal (S204). If the brightness of the imaging environment is normal, it indicates that the brightness of the imaging environment is not good. If the illuminance parameter or luminance distribution parameter calculated in the process of S201 is equal to or greater than the second threshold, the determination means 25 determines that the brightness of the imaging environment is normal. On the other hand, if the illuminance parameter or luminance distribution parameter calculated in the process of S201 is less than the second threshold, the determination means 25 determines that the brightness of the imaging environment is not normal. The second threshold is a value smaller than the first threshold, and in one example, is set based on a prior experiment, similar to the first threshold.

[0069] If the determination means 25 determines that the brightness of the imaging environment is normal (S204-YES), the setting means 26 sets the brightness of the screen of the display / operation unit 14 to medium brightness (S205). The setting means 26 sets the brightness of the screen of the display / operation unit 14 to medium brightness by setting the light intensity of the backlight of the display / operation unit 14 to a light intensity that is less than the second light intensity threshold and equal to or greater than the first light intensity threshold, or by setting the magnitude of the voltage supplied to the display / operation unit 14 to a voltage that is less than the second voltage threshold and equal to or greater than the first voltage threshold. The second light intensity threshold and the second voltage threshold are set to values ​​greater than the first light intensity threshold and the first voltage threshold, respectively. The second light intensity threshold and the second voltage threshold are set to values ​​that add a margin to the minimum light intensity or voltage value at which user authentication was successful in a preliminary experiment in which authentication was performed while changing the light intensity of the backlight or the voltage supplied to the display / operation unit 14 with the illuminance parameter or luminance distribution parameter at the second threshold.

[0070] On the other hand, if the determination means 25 determines that the brightness of the imaging environment is not normal (S204-NO), it determines that the brightness of the imaging environment is dark, and the setting means 26 sets the brightness of the screen of the display operation unit 14 to high brightness (S206). The setting means 26 sets the light intensity of the backlight of the display operation unit 14 to a light intensity equal to or greater than the second light intensity threshold, or sets the magnitude of the voltage supplied to the display operation unit 14 to a voltage equal to or greater than the second voltage threshold, thereby setting the brightness of the screen of the display operation unit 14 to high brightness. This ends the brightness setting process.

[0071] As described above, when a hold time is set in the monitoring sensor 30, the setting means 26 sets the brightness of the screen of the display operation unit 14 to the brightness for authentication when the authentication means 23 performs image capture for authentication. This allows the security device 10 to properly authenticate users while the hold time is set, and prevents the security device 10 from erroneously outputting a warning when a legitimate user enters the monitored area. Furthermore, the setting means 26 sets the brightness of the display operation unit 14 to a higher brightness when the imaging environment is dark than when the imaging environment is bright. This allows the security device 10 to properly authenticate users even when the imaging environment is not bright enough, and prevents the security device 10 from erroneously outputting a warning when a legitimate user enters the monitored area.

[0072] When the brightness of the imaging environment is normal and the startup brightness is set to medium brightness, the setting means 26 may maintain the brightness of the screen of the display operation unit 14 at the startup brightness.

[0073] Furthermore, the brightness of the screen of the display operation unit 14 need not be set in three stages, namely, low brightness, medium brightness, and high brightness, but may be set in two stages, for example, low brightness or high brightness, or in four or more stages.

[0074] In addition, the setting means 26 may set the brightness of the screen of the display operation unit 14 to low brightness when the brightness of the shooting environment is normal, taking into account the influence of reflection from the glasses when the user is wearing glasses, and may set the brightness of the screen of the display operation unit 14 to medium brightness or startup brightness when the brightness of the shooting environment is bright.

[0075] 5 is a flow diagram showing the flow of the authentication process, which is executed in S110 and S117 of FIG.

[0076] First, the authentication means 23 determines whether a human face has been detected from the input face image acquired by the imaging unit 15 (S301). The authentication means 23 extracts change areas having temporal changes in brightness values ​​from multiple input images captured sequentially, for example, using inter-frame subtraction processing or background subtraction processing. The authentication means 23 extracts change areas that are likely to represent a human as human regions based on feature quantities such as the size and shape of each extracted change area. The authentication means 23 extracts edge pixels from the extracted human region using a Sobel filter or the like to determine the gradient direction of the brightness change. The authentication means 23 detects an elliptical edge distribution of a predetermined size that approximates the outline shape of a head from the extracted edge pixels, for example, using a generalized Hough transform, and extracts the region surrounded by the edge distribution as a facial region. Note that the authentication means 23 may extract a facial region using other known methods, such as an Adaboost classifier. If the authentication means 23 determines that a human face has not been detected (S301-NO), the authentication process ends.

[0077] When the authentication means 23 determines that a person's face has been detected (S301-YES), it extracts a face area from the input face image acquired by the imaging unit 15 (S302). The authentication means 23 extracts, as a face area, a change area that is thought to be the person's face extracted in the process of S301.

[0078] Next, the authentication means 23 calculates an authentication score, which is a similarity parameter indicating the degree of similarity between the input face image and each registered face image of the registrant registered in the registrant information table 131, from the face region extracted in the process of S302 (S303). The authentication means 23 detects each part from the face region in the input image based on the features such as the position or shape of each part, such as the corners of the eyes, the tip of the nose, and the corners of the mouth, and calculates the feature amounts. The feature amounts are Haar-Like features or HOG (Histogram of Oriented Gradient) features, etc. The authentication means 23 detects each part from the registered face images stored in the registrant information table 131 based on the features such as the position or shape of each part, and calculates the feature amounts. The feature amounts calculated from the registered face images are the same as the feature amounts calculated from the face region in the input image. The authentication means 23 calculates the degree of similarity between each feature calculated from the input face image and each feature calculated from the registered face image, weights the calculated degrees of similarity, and adds them up to calculate an authentication score. The degree of similarity may be, for example, normalized cross-correlation. The authentication means 23 stores the calculated authentication score in association with the registrant ID of the registrant stored in the registrant information table 131.

[0079] Next, the authentication means 23 extracts candidates from among the registrants registered in the registrant information table 131 based on the authentication score obtained in the process of S303 (S304). The authentication means 23 extracts as a candidate the registrant indicated by the registrant ID stored in association with the largest authentication score among the authentication scores obtained in the process of S303.

[0080] Next, the authentication means 23 authenticates the user using the authentication criteria corresponding to the authentication criteria information stored in the storage unit 13 (S305). The authentication means 23 determines that the authentication of the user has been successful if the authentication score stored in association with the registrant ID corresponding to the candidate extracted in the processing of S304 is equal to or greater than the authentication criteria corresponding to the authentication criteria information stored in the storage unit 13. The authentication means 23 does not determine that the authentication of the user has been successful if the authentication score stored in association with the registrant ID corresponding to the candidate extracted in the processing of S304 is less than the authentication criteria corresponding to the authentication criteria information stored in the storage unit 13. In this way, the authentication means 23 authenticates the user using the image captured by the imaging unit. This completes the authentication process.

[0081] (Operations and Effects of Monitoring System 1 According to Embodiment 1) In the security device 10 of this surveillance system 1, the authentication means 23 authenticates the user using an image captured by the imaging unit 15, and the setting means 26 sets the brightness of the screen of the display operation unit 14 to the brightness for authentication when the authentication means 23 captures an image for authentication. By utilizing the brightness of the screen of the display operation unit 14, the security device 10 can more effectively authenticate the user using the captured image. Furthermore, the security device 10 can effectively authenticate the user without providing an illumination unit such as an LED light-emitting device dedicated to authentication, thereby suppressing increases in device cost and size.

[0082] Furthermore, in the security device 10 of this surveillance system 1, the acquisition means 21 acquires the brightness of the imaging environment based on the illuminance around the imaging unit 15 or the image captured by the imaging unit 15, and the setting means 26 sets the brightness for authentication when the brightness of the imaging environment is poor to be higher than the brightness for authentication when the brightness of the imaging environment is good. This allows the security device 10 to brighten the imaging environment by increasing the brightness of the screen of the display / operation unit 14 when the brightness of the imaging environment is poor. Therefore, the security device 10 can properly authenticate users without relying on the brightness of the imaging environment.

[0083] Furthermore, in the security device 10 of the present monitoring system 1, when a hold time has been set, the setting means 26 sets the brightness of the screen of the display operation unit 14 to the brightness for authentication. This allows the security device 10 to set the brightness of the screen of the display operation unit 14 to the brightness for authentication in a situation where it is expected that the user of the security device 10 will perform authentication, thereby enabling the security device 10 to properly authenticate the user.

[0084] (Modification 1 of Embodiment 1) In the monitoring system 1 according to the first modification, the processing unit 20 executes the brightness setting authentication process in accordance with the flow shown in FIG.

[0085] Fig. 6 is a flow diagram showing the flow of the brightness setting authentication process of the monitoring system 1 according to Modification 1. The brightness setting authentication process shown in Fig. 6 is realized by the processing unit 20 working in cooperation with each component of the security device 10 based on a program stored in the storage unit 13.

[0086] First, the processing unit 20 waits until an object is detected by the distance measurement sensor 18 within a first predetermined range (for example, within 1.5 m from the security device 10) (S401).

[0087] Next, the setting means 26 maintains the brightness of the screen of the display operation unit 14 at the startup brightness (S402). That is, when an object is detected within the first predetermined range by the distance measurement sensor 18, the setting means 26 maintains the brightness of the screen of the display operation unit 14 at the startup brightness and does not change the brightness of the screen of the display operation unit 14 to the brightness for authentication. Note that when the screen of the display operation unit 14 is in the sleep state, the brightness of the screen may be changed to the startup brightness upon detection of an object, but the brightness is not changed to the brightness for authentication at this point.

[0088] Next, the authentication means 23 executes the authentication process similar to the process of S110 (S403). That is, the authentication means 23 starts authenticating the user when the distance measuring sensor 18 detects an object.

[0089] Next, the authentication means 23 determines whether or not the authentication of the user has been successful in the authentication process (S404).

[0090] If the user authentication has not been successful (S404-NO), the determination means 25 determines whether a first predetermined time has elapsed (S405). The first predetermined time is set in advance to the maximum time required to authenticate a user who is located at the maximum distance that can be detected by the distance measuring sensor 18. Note that the first predetermined time may be set by the user's operation on the display operation unit 14. If the first predetermined time has elapsed (S405-YES), the determination means 25 determines that the user authentication has failed, and the brightness setting authentication process ends.

[0091] On the other hand, if the first predetermined time has not elapsed (S405-NO), the determination means 25 determines whether the reception means 24 has received an authentication request operation by the user (S406). When the display operation unit 14 has received the authentication request operation, the reception means 24 receives a signal corresponding to the authentication request operation from the display operation unit 14, thereby receiving the authentication request operation. The authentication request operation by the user using the display operation unit 14 is an example of an authentication request.

[0092] If the reception means 24 has not received the authentication request operation (S406-NO), the brightness setting authentication process returns to S403, and the authentication means 23 executes the authentication process again.

[0093] On the other hand, when the accepting means 24 accepts an authentication request operation (S406-YES), that is, when an authentication request is made by the user, the processing unit 20 executes a brightness setting process (S407) similar to the process of S105. That is, when authentication is not successful from the start of authentication until the user makes an authentication request, the setting means 26 sets (changes) the brightness of the screen of the display operation unit 14 from the startup brightness, which is the brightness for displaying acceptance of an authentication request operation, to the brightness for authentication.

[0094] Next, the authentication means 23 executes the authentication process similar to the process of S110 (S408).

[0095] Next, the authentication means 23 determines whether or not the authentication of the user has been successful in the authentication process (S409).

[0096] If the user authentication has not been successful (S409-NO), the determination means 25 determines whether a second predetermined time has elapsed (S410). The second predetermined time is set in advance as the maximum time required for authentication of a user positioned in front of the display operation unit 14. Note that the second predetermined time may be set by an operation on the display operation unit 14 by the user.

[0097] If the second predetermined time has not elapsed (S410-NO), the brightness setting authentication process returns to S408, and the authentication means 23 authenticates the user again.

[0098] On the other hand, if the second predetermined time has elapsed (S410-YES), the determination means 25 determines that the authentication of the user has failed, and the brightness setting authentication process ends.

[0099] If the user authentication is successful (S404-YES or S409-YES), the reception unit 24 receives a predetermined operation (S411). The predetermined operation is any operation on the security device 10, such as an operation to change the security mode, a setting operation on the security device 10, or a display operation to display specific information.

[0100] Next, the processing unit 20 executes a process according to the operation accepted by the accepting unit 24 (S412), and the brightness setting authentication process ends.

[0101] (Operations and Effects of Monitoring System 1 According to Modification 1) In the security device 10 of the present monitoring system 1, when the reception means 24 receives an authentication request operation, the setting means 26 sets the brightness of the screen of the display operation unit 14 to the brightness for authentication. This allows the security device 10 to improve the brightness of the imaging environment when the user authentication is performed reliably.

[0102] In addition, in the security device 10 of this surveillance system 1, the authentication means 23 begins authenticating the user when the distance sensor 18 detects an object. The setting means 26 does not change the brightness of the screen of the display / operation unit 14 when the distance sensor 18 detects an object. If the authentication means 23 has not successfully authenticated the user when the reception means 24 receives an authentication request operation, the setting means 26 sets the brightness of the screen of the display / operation unit 14 to the authentication brightness. This allows the security device 10 to prevent unnecessary changes to the brightness of the screen of the display / operation unit 14 when it is unclear whether the user will perform an operation requiring authentication. Furthermore, by starting authentication before the user operates the display / operation unit 14, the security device 10 can immediately accept operations from the user when the user arrives at the display / operation unit 14. On the other hand, if authentication has not been successful when the user arrives at the display / operation unit 14, the security device 10 sets the brightness of the screen of the display / operation unit 14 to the authentication brightness, thereby enabling appropriate user authentication even when the brightness of the imaging environment varies.

[0103] (Other variations) The processing of steps S401 to S406 may be omitted, and when the reception means 24 receives an authentication request operation, that is, when an authentication request is executed, the setting means 26 may set the brightness of the screen of the display operation unit 14 to the brightness for authentication. At this time, the setting means 26 may change the brightness of the screen of the display operation unit 14 from the startup brightness (predetermined display brightness) to the brightness for authentication.

[0104] Furthermore, in the process of step S406, instead of determining whether an authentication request operation has been received, the determination means 25 may determine whether an authentication request has been executed. For example, when a user approaches the display operation unit 14, i.e., when the distance sensor 18 detects the user within a second predetermined range (e.g., within 0.5 m from the security device 10) that is narrower than the first predetermined range, the authentication request may be deemed to have been executed, and the brightness setting process of step S407 may be executed. In this case, the authentication means 23 may start authenticating the user when the distance sensor 18 detects an object within the first predetermined range, and the setting means 26 may set the brightness of the screen of the display operation unit 14 to the brightness for authentication if the user is detected within the second predetermined range and the authentication of the user has not been successful.

[0105] In another example, the authentication means 23 may start authenticating the user when an object is detected by the distance sensor 18, and if authentication is not successful from the start of authentication until the user makes an authentication request, the setting means 26 may set the brightness of the screen of the display operation unit 14 to the brightness for authentication when the authentication request is made.

[0106] Furthermore, if an object is detected by the distance measuring sensor 18 in step S401, the processing unit 20 may execute a brightness setting process before the authentication means 23 executes the authentication process in step S403. The approach of a user to the display operation unit 14 is an example of an authentication request. In this case, the processes of steps S406 to S410 may be omitted.

[0107] Furthermore, in step S406, the setting means 26 may set the brightness of the screen of the display operation unit 14 to the brightness for authentication when it detects contact by the user, rather than when the display operation unit 14 accepts the authentication request operation. Contact by the user with the display operation unit 14 is an example of an authentication request. In this case, the security device 10 can set the brightness of the screen of the display operation unit 14 to the brightness for authentication before the user performs the authentication request operation, thereby enabling authentication to be completed more quickly.

[0108] Also, in step S406, the accepting means 24 may accept the authentication request operation by receiving a signal corresponding to the authentication request operation from the communication terminal 50 via the communication unit 12, rather than from the display operation unit 14. The authentication request operation by the user using the communication terminal 50 is an example of an authentication request.

[0109] Furthermore, the authentication means 23 may authenticate the user using an iris image or a QR code (registered trademark) instead of using a face image.

[0110] Furthermore, the display operation unit 14 does not have to be a touch panel that functions as both a display unit and an operation unit, and the display unit and the operation unit may be provided separately.

[0111] Furthermore, while the configuration of the security device 10 has been described as an example of an authentication device with a display function, the authentication device with a display function is not limited to a security device and may be, for example, a PC or a smartphone. When the authentication device with a display function is a PC or a smartphone, the processing unit executes a brightness setting process when unlocking the PC or smartphone. At this time, the processing unit may execute an authentication process in conjunction with or after the brightness setting process. A typical PC or smartphone has a function for lowering the screen brightness when the surroundings of the device are dark to improve the visibility of the display unit, but does not have a function for increasing the screen brightness in such cases. When capturing an image for authentication, the authentication device with a display function according to this embodiment sets the screen brightness to the authentication brightness, particularly when the capturing environment is dark. This allows the authentication device with a display function to more effectively authenticate users using the captured image.

[0112] Furthermore, the sensor that detects objects around the imaging unit 15 is LiDAR, but is not limited to this and may be, for example, an infrared sensor or an image sensor. Furthermore, if the monitoring sensor 30 is disposed around the imaging unit 15, the security device 10 may use the monitoring sensor 30 to detect objects around the imaging unit 15.

[0113] Furthermore, the brightness setting process may be executed at a timing other than the timings shown in the first embodiment and the first modification. In one example, the processing unit 20 may execute the brightness setting process when it is determined that the authentication means 23 has detected a person's face. That is, the setting means 26 may set the brightness of the screen of the display operation unit 14 to the brightness for authentication when the authentication means 23 detects a person's face and starts authenticating the user.

[0114] In the first embodiment including the first modification, the security device 10 does not include an illumination unit, but the security device 10 may include an illumination unit.

[0115] It should be understood by those skilled in the art that various changes, substitutions, and alterations can be made to the present invention without departing from the spirit and scope of the present invention. For example, the above-described embodiments and modifications may be appropriately combined within the scope of the present invention. [Explanation of symbols]

[0116] 1. Surveillance System 10 Security Devices 14 Display operation section 15 Imaging unit 17 Illuminance sensor 18 Distance measurement sensor 21 Acquisition method 23 Authentication Methods 24 Reception methods 25 Judgment means 26 Setting Method

Claims

1. An imaging unit; a display unit having a screen with adjustable brightness; an authentication means for authenticating a user using an image captured by the imaging unit; a setting means for setting the brightness of the screen to a brightness for authentication when the authentication means performs image capture for authentication; An authentication device with a display function.

2. The image capturing device further includes an acquisition unit that acquires brightness of an imaging environment based on the illuminance around the imaging unit or the captured image captured by the imaging unit, the setting means sets the luminance of the screen higher when the imaging environment is dark than when the imaging environment is bright. The authentication device with a display function according to claim 1.

3. the setting means sets the brightness of the screen to the brightness for authentication when an authentication request is made by a user.

3. The authentication device with a display function according to claim 1 or 2.

4. the setting means changes the brightness of the screen from a predetermined brightness for display to a brightness for authentication when the authentication request is executed.

4. The authentication device with a display function according to claim 3.

5. the display unit is a display operation unit that accepts an authentication request operation by a user, the setting means, when the display operation unit accepts the authentication request operation as the authentication request, changes the luminance of the screen from a luminance for displaying acceptance of the authentication request operation to a luminance for the authentication.

5. The authentication device with a display function according to claim 4.

6. Further, a sensor for detecting an object around the imaging unit is provided, the authentication means starts authenticating the user when the object is detected by the sensor; and when the authentication is not successful from the start of the authentication until the authentication request is made by the user, the setting means sets the brightness of the screen to the brightness for authentication when the authentication request is made. The authentication device with a display function according to claim 1.

7. Further, a sensor for detecting an object around the imaging unit is provided, the authentication means starts authenticating the user when the sensor detects an object within a first predetermined range; the setting means sets the brightness of the screen to the brightness for authentication when the user is detected within a second predetermined range narrower than the first predetermined range and authentication of the user has not been successful. The authentication device with a display function according to claim 1.

Images