Imaging control device and imaging control method

Abstract

To provide an imaging control unit that allows efficient exposure control.SOLUTION: An imaging control device comprises: detection means that detects a subject included in an image input from an imaging apparatus; determination means that determines if the subject detected by the detection means is a subject authenticated in advance; and control means that performs exposure control of the imaging apparatus. When the determination means determines that the subject is not the subject authenticated in advance, the control means performs the exposure control for the subject, and when the determination means determines that the subject is the subject authenticated in advance, does not perform the exposure control for the subject.SELECTED DRAWING: Figure 6

Description

Technical Field

[0001] The present invention relates to an imaging control apparatus and an imaging control method.

Background Art

[0002] A technique is known in which a face region of a subject is detected from an imaged image, and imaging conditions and the like are set based on the importance of the detected face (Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] An object of the present invention is to provide an imaging control apparatus that enables efficient exposure control.

Means for Solving the Problems

[0005] To achieve the above object, an imaging control apparatus according to one aspect of the present invention includes detection means for detecting a subject included in an image input from an imaging device, determination means for determining whether the subject detected by the detection means is a pre-authenticated subject, and control means for performing exposure control of the imaging device. When the determination means determines that the subject is not a pre-authenticated subject, the control means performs the exposure control on the subject. When the determination means determines that the subject is a pre-authenticated subject and is determined, the exposure control is not performed on the subject.

Effects of the Invention

[0006] According to the present invention, efficient exposure control becomes possible.

Brief Description of the Drawings

[0007]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Mode for Carrying Out the Invention

[0008] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. Note that the following embodiments do not limit the present invention, and not all combinations of the features described in this embodiment are essential for the solution means of the present invention. The configuration of the embodiment can be appropriately modified or changed according to the specifications of the device to which the present invention is applied and various conditions (usage conditions, usage environments, etc.). The technical scope of the present invention is determined by the scope of the claims and is not limited by the following individual embodiments. Also, a configuration may be formed by appropriately combining a part of each of the embodiments described later.

[0009] Note that one or more of the functional blocks shown in FIG. 4 described later may be implemented by hardware such as an ASIC or a programmable logic array (PLA), or may be implemented by a programmable processor such as a CPU or MPU executing software. It may also be implemented by a combination of software and hardware. Therefore, in the following description, even if different functional blocks are described as the operating entity, the same hardware may be implemented as the main body. ASIC is an abbreviation for Application Specific Integrated Circuit. CPU is an abbreviation for Central Processing Unit. MPU is an abbreviation for Micro-Processing Unit.

[0010] Embodiment 1 Embodiment 1 of the present invention will be described with reference to FIGS. 1 to 7. (Basic Configuration) FIG. 1 is a diagram exemplarily illustrating the configuration of an imaging control system 100 according to Embodiment 1.

[0011] The imaging control system 100 includes a surveillance camera 101, a network 102, a client device 103, an input device 104, and a display device 105. The surveillance camera 101 is an imaging device for acquiring a moving image and is a device capable of imaging a subject and performing image processing. The surveillance camera 101, the client device 103, the input device 104, and the display device 105 each have a communication function. The surveillance camera 101 and the client device 103 are connected to be communicable with each other via the network 102. The client device 103 is connected to the input device 104 and the display device 105 in a communicable state. Since the client device 103 is a device that processes various information, it may also be referred to as an information processing device. Further, since the client device 103 is a device that controls the imaging of the surveillance camera 101 (for example, performs exposure control), it may also be referred to as an imaging control device. The subject is, for example, a person.

[0012] The input device 104 is composed of a mouse, a keyboard, etc., and is operated by the user of the client device 103. The display device 105 is a device equipped with a monitor or the like that displays the image received from the client device 103. Note that the display device 105 can also function as a UI such as a touch panel. In this case, the display device 105 can also function as an input device for inputting instructions, information, data, etc. to the client device 103. UI is an abbreviation for User Interface.

[0013] In FIG. 1, the client device 103, the input device 104, and the display device 105 are depicted as independent devices, but the present embodiment is not limited to such a configuration. For example, the client device 103 and the display device 105 may be integrated, or the input device 104 and the display device 105 may be integrated. Also, the client device 103, the input device 104, and the display device 105 may be integrated. When the client device 103 and the display device 105 are integrated, the integrated device takes the form of, for example, a personal computer, a tablet terminal, or a smartphone.

[0014] (Structure of the surveillance camera) FIG. 2 is a block diagram exemplarily explaining the internal configuration of the surveillance camera 101. The surveillance camera 101 includes an imaging optical system 201, an image sensor 202, a camera CPU 203, a ROM 204, a RAM 205, an imaging system control unit 206, a communication control unit 207, an A / D conversion unit 208, an image processing unit 209, an encoder unit 210, and a network I / F 211. Each part (203 - 211) of the surveillance camera 101 is interconnected by a system bus 212. ROM is an abbreviation for Read Only Memory. RAM is an abbreviation for Random Access Memory. A / D is an abbreviation for Analog / Digital. I / F is an abbreviation for interface.

[0015] The imaging optical system 201 is composed of a zoom lens, a focus lens, an image stabilization lens, a diaphragm, a shutter, etc., and is a group of optical members that collect the light information of a subject. The imaging optical system 201 is connected to the imaging device 202. The imaging device 202 is a charge accumulation type solid-state imaging device such as a CMOS or a CCD that converts the light beam collected by the imaging optical system 201 into a current value (signal value), and is an imaging unit that acquires color information by combining with a color filter, etc. CMOS is the abbreviation of Complementary Metal Oxide Semiconductor. CCD is the abbreviation of Charge-Coupled Device. The imaging device 202 is connected to the A / D conversion unit 208.

[0016] The camera CPU 203 is a control unit that comprehensively controls the operation of the surveillance camera 101. The camera CPU 203 reads the instructions stored in the ROM 204 and the RAM 205, and executes the processing according to the results. The imaging system control unit 206 controls each part of the surveillance camera 101 based on the instructions from the camera CPU 203. For example, the imaging system control unit 206 performs controls such as focus control, shutter control, and diaphragm adjustment on the imaging optical system 201. The communication control unit 207 performs control to transmit the control commands (control signals) from the client device 103 to each part of the surveillance camera 101 to the camera CPU 203 through communication with the client device 103.

[0017] The A / D conversion unit 208 converts the current value received from the imaging device 202 into a digital signal (image data). The A / D conversion unit 208 transmits the digital signal to the image processing unit 209. The image processing unit 209 performs image processing on the image data of the digital signal received from the A / D conversion unit 208. The image processing unit 209 is connected to the encoder unit 210. The encoder unit 210 performs processing to convert the image data processed by the image processing unit 209 into a file format such as Motion Jpeg, H264, or H265. The encoder unit 210 is connected to the network I / F 211. The network I / F 211 is an interface used for communication via the network 102 with an external device such as the client device 103, and is controlled by the communication control unit 207.

[0018] The network 102 is an IP network that connects the surveillance camera 101 and the client device 103. The network 102 is composed of a plurality of routers, switches, cables, etc. that conform to a communication standard such as Ethernet (registered trademark). In this embodiment, the network 102 only needs to be able to communicate between the surveillance camera 101 and the client device 103, regardless of its communication standard, scale, configuration, etc. For example, the network 102 may be composed of the Internet, a wired LAN (Local Area Network), a wireless LAN (Wireless LAN), a WAN (Wide Area Network), etc.

[0019] (Configuration of the client device) FIG. 3 is a block diagram exemplarily explaining the internal configuration of the client device 103. The client device 103 has a client CPU 301, a main storage device 302, an auxiliary storage device 303, an input I / F 304, an output I / F 305, and a network I / F 306. Each element of the client device 103 is communicably connected to each other via a system bus 307.

[0020] The client CPU 301 is a central processing unit that comprehensively controls the operation of the client device 103. Note that the client CPU 301 may execute overall control of the surveillance camera 101 via the network 102. The main storage device 302 is a storage device such as a RAM that functions as a temporary storage location for data of the client CPU 301. For example, the main storage device 302 stores in advance patterns for pattern matching (patterns corresponding to characteristic parts of a face or characteristic parts of a human body) used when the client device 103 performs face detection or human body detection. The auxiliary storage device 303 is a storage device such as an HDD, ROM, or SSD that stores various programs, various setting data, etc. In the auxiliary storage device 303, an authenticated ID list that stores past authentication histories is saved. Also, in the auxiliary storage device 303, a database (face authentication database) that associates pre-registered face images with person information is saved. HDD is an abbreviation for Hard Disk Drive. SSD is an abbreviation for Solid State Drive.

[0021] The input I / F 304 is an interface used when the client device 103 receives an input (signal) from the input device 104 or the like. The output I / F 305 is an interface used when the client device 103 outputs information (signal) to the display device 105 or the like. The network I / F 306 is an interface used for communication via the network 102 with an external device such as the surveillance camera 101. When the client CPU 301 executes processing based on the program stored in the auxiliary storage device 303, the functions and processing of the client device 103 shown in FIG. 4 are realized. The details will be described with reference to FIG. 4.

[0022] (Functions of the client device) FIG. 4 is a diagram exemplarily explaining the functions executed by the client device 103. In other words, each part (function block) illustrated in FIG. 4 is a function that can be executed by the client CPU 301, and each part is synonymous with the client CPU 301. As shown in FIG. 4, the client CPU 301 of the client device 103 includes an input information acquisition unit (input signal acquisition unit) 401, a communication control unit 402, an input image acquisition unit 403, a camera information acquisition unit 404, and a detection method setting unit 405. The client CPU 301 also includes a subject detection unit 406, an exposure determination unit 407, a display control unit 408, and a face authentication processing unit 409. Note that the client device 103 may execute the functions of each of the units 401 to 409 illustrated in FIG. 4 by hardware (or software) different from the client CPU 301.

[0023] The input information acquisition unit 401 receives an input from a user via the input device 104. The communication control unit 402 executes control for receiving an image transmitted from the surveillance camera 101 (an image captured by the surveillance camera 101) via the network 102. The communication control unit 402 also executes control for transmitting a control command from the client device 103 to the surveillance camera 101 via the network 102. The input image acquisition unit 403 acquires, as an image to be subjected to subject detection processing (an image to which subject detection processing is applied), the image received from the surveillance camera 101 via the communication control unit 402. Details of the detection processing will be described later.

[0024] The camera information acquisition unit 404 acquires, via the communication control unit 402, camera information (imaging information) when the surveillance camera 101 captures a subject. The camera information (imaging information) is various information when capturing a subject to acquire an image. The camera information is, for example, an exposure parameter such as an aperture value. The detection method setting unit 405 sets a predetermined (appropriate) detection method from among various detection methods including detection of a face region (face detection) and detection of a human body region (human body detection) for the image acquired by the input image acquisition unit 403. When performing face detection, the subject detection unit 406 preferentially detects the face region in the image. When performing human body detection, the subject detection unit 406 preferentially detects the human body region in the image. The face region is a region including a face, and the human body region is a region including a human body.

[0025] In this embodiment, the detection method setting unit 405 sets (selects) the detection method for face detection or the detection method for human body detection. Note that this embodiment is not limited to such settings. For example, a detection method for detecting a feature area of a part of a person, such as a partial area of a person's upper body, head, or parts of a person's face such as eyes, nose, and mouth, may be set (made selectable). Also, in this embodiment, the subject to be detected is a person, but a configuration capable of detecting a specific area related to a predetermined subject other than a person may also be used. For example, a configuration may be used that can detect a predetermined subject preset in the client device 103, such as an animal's face or a motor vehicle (vehicle).

[0026] The exposure determination unit 407 determines an exposure level based on the image information of the subject area obtained from the subject detection unit 406, and transmits the exposure level to the surveillance camera 101 via the communication control unit 402. Then, exposure control is executed in the surveillance camera 101 via the communication control unit 207. Details of the processing related to the camera information acquisition unit 404, the detection method setting unit 405, the subject detection unit 406, and the exposure determination unit 407 will be described later with reference to the flowchart of FIG. 5.

[0027] The display control unit 408 outputs to the display device 105 a captured image in which the exposure correction determined by the exposure determination unit 407 is reflected, in accordance with an instruction from the client CPU 301. The face authentication processing unit 409 performs face authentication processing on the captured image in which the exposure correction determined by the exposure determination unit 407 is reflected, in accordance with an instruction from the client CPU 301. The face authentication processing collates with a database in which a pre-registered face image and personal information are associated, and outputs the personal information with the highest similarity with a similarity of the face image being equal to or higher than a predetermined value. For calculating the similarity, matching of feature information, use of a neural network, or the like can be used. In the present embodiment, the subject to be authenticated is a human face, but the present invention is not limited thereto. For example, a configuration may be adopted in which a predetermined subject preset in the client device 103, such as an animal face or a license plate of an automobile, can be authenticated. Further, the face authentication processing unit 409 may be configured to be included in a device externally connected via the network 102 instead of inside the client device 103.

[0028] (Subject detection processing · Exposure determination processing) Hereinafter, the exposure control processing according to the present embodiment will be described with reference to the flowchart shown in FIG. 5. In the imaging control system 100 of FIG. 1, it is assumed that the power supplies of the monitoring camera 101, the client device 103, the input device 104, and the display device 105 are turned on, and the connection (communication) between the monitoring camera 101 and the client device 103 is established. Also, in this state, it is assumed that imaging of the subject by the monitoring camera 101, transmission of image data from the monitoring camera 101 to the client device 103, and image display on the display device 105 are repeated at a predetermined update cycle. Then, in response to the input of the captured image of the subject from the monitoring camera 101 to the client device 103 via the network 102, the processing of the flowchart of FIG. 5 is started by the client CPU 301. In the following description, S is an abbreviation for step.

[0029] First, in S501, the detection method setting unit 405 sets face detection for the subject detection unit 406, and the subject detection unit 406 performs face detection processing on the input image. Next, in S502, the detection method setting unit 405 sets the detection of a human body for the subject detection unit 406, and the subject detection unit 406 performs human body detection processing on the input image.

[0030] In the main storage device 302 of the client device 103, patterns corresponding to the characteristic parts of the face and patterns corresponding to the characteristic parts of the human body are stored in advance, and the subject detection unit 406 detects the face area by pattern matching based on the patterns. When detecting the face area, generally, the face can be detected with high accuracy, and the face area of the subject and the area other than the face area can be clearly distinguished. However, when the face orientation, face size, face brightness, etc. are not conditions suitable for face detection, the face area cannot be accurately detected. On the other hand, when performing human body detection, the area where a person exists can be detected regardless of the face orientation, face size, face brightness, etc. Note that the human body detection in this embodiment does not necessarily need to detect the whole body, and the upper body, bust-up, or head area (for example, the area above the shoulders) may also be used. FIG. 7(a) is a diagram of a face area detection example, and FIG. 7(b) is a diagram of a human body area detection example. The human body area in FIG. 7(b) is an area of a part of the upper body (bust-up). The upper body includes the face. Note that the human body area is not limited to the area shown in FIG. 7(b). For example, the human body area may be the whole body of a person or the entire upper body. Also, when the face in the image is dark due to backlight or the like, the human body area may be the head area. The head area is an area where the shape of the head can be grasped and includes, for example, the shoulders, neck, and face. FIGS. 7(a) and (b) are diagrams when a surveillance camera 101 is installed at the entrance or gate of a building such as a building or stadium, and a person entering the building from the outside of the building is imaged by the surveillance camera 101. Note that the building is not limited to a building or stadium, and may be, for example, a parking lot. When the building is a parking lot, the subject may be, for example, a vehicle entering the parking lot. When the vehicle is the subject, the area to be detected may be, for example, the vehicle body area (the area including the vehicle body of the vehicle and its surroundings) or the license plate area (the area including the license plate of the vehicle and its surroundings).

[0031] When adopting the pattern matching method as a method for detecting a subject, as the pattern used in pattern matching, a pattern (discriminator) created using statistical learning may be used. Alternatively, subject detection may be performed by a method other than pattern matching. For example, subject detection may be performed using the luminance gradient within a local area. That is, the method for detecting a subject is not limited to a specific detection method, and various methods such as detection based on machine learning and detection based on distance information can be adopted.

[0032] In S503, the face authentication processing unit 409 determines whether a face or a human body has been detected. If a face or a human body has been detected, the process proceeds to S504. If a face or a human body has not been detected, the process ends. In S504, the face authentication processing unit 409 performs face authentication processing. FIG. 6 shows the face authentication processing as a subroutine. Hereinafter, the face authentication processing will be described with reference to FIG. 6. Note that the face authentication processing is performed for all faces and human bodies detected by the subject detection unit 406. As shown in FIG. 6, in S601, the face authentication processing unit 409 acquires a face image, a face ID, and a human body ID from the subject detection unit 406. Here, if no face has been detected, the face image and the face ID are not acquired. The face ID is a value generated from features of the face, and if they are the same person, the face ID is the same. The same applies to the human body ID. That is, the human body ID is a value generated from features of the human body, and if they are the same person, the human body ID is the same.

[0033] In S602, the face authentication processing unit 409 determines whether the face ID or the human body ID has not been authenticated in the past. This determination is made by referring to an authenticated ID list that stores the past authentication history. That is, in S602, it is determined whether the detected subject is a subject that has been authenticated in advance. If it is determined that it has not been authenticated in the past (in advance), the process proceeds to S603, and if it is determined that it has been authenticated in the past, the process proceeds to S604.

[0034] In S603, the face authentication processing unit 409 performs face authentication processing. The face authentication processing extracts feature information from a face image, and outputs, as an authentication result, the attribute information with the highest similarity of the feature information from a database in which the feature information is associated with attribute information such as a person's name in advance. Note that if the similarity of the feature information does not meet a predetermined threshold, authentication is not possible. Also, if a face image has not been acquired, that is, if a face has not been detected, authentication is not possible either. In S604, the face authentication processing unit 409 notifies the exposure determination unit 407 that the face or human body detected by the subject detection unit 406 has been authenticated (sends a signal indicating that it has been authenticated), and ends this processing.

[0035] In S605, the face authentication processing unit 409 determines whether face authentication was successful in S603. If it is determined that face authentication was successful, the process proceeds to S606. If it is determined that face authentication could not be performed, this processing ends. In S606, the face authentication processing unit 409 adds the face ID and the human body ID corresponding to that face to the authenticated ID list indicating that face authentication has been performed, and ends this processing. The explanation of the subroutine regarding face authentication processing is as above. Returning to FIG. 5, the explanation of the exposure control processing will be continued.

[0036] In S505, a region of interest used in S506 is set. The region of interest is set to at least one of the face of a subject for which an authenticated notification has not been obtained in S504 and the human body of the subject. Among these, if there are a plurality of faces or human bodies, if there is a face or human body that has already been set as the region of interest in the processing of the captured image of the previous frame, this is preferentially set. If not, for example, it may be determined according to the application based on the detection order, the distance from the monitoring camera 101, the position in the image, etc.

[0037] As an example, the case of assuming a walk-through authentication in which the surveillance camera 101 is installed near the entrance of a building or the like will be described. In walk-through authentication, a person closer to the surveillance camera 101 will pass by earlier. Therefore, when using the distance from the surveillance camera 101, it is preferable to perform exposure control processing with priority given to a person closer. That is, when there are a plurality of subjects for which exposure control is to be performed, the order of performing exposure control may be determined based on the distance between the surveillance camera 101 (imaging device) and the subject. Also, when using the position within the image, if the surveillance camera 101 is installed so as to look down on a person, it is considered that a position lower in the image is closer to the surveillance camera 101, and thus the priority order may be raised. That is, when there are a plurality of subjects for which exposure control is to be performed, the order of performing exposure control may be determined based on the position of the subject within the image. Also, when both the face and the human body of the same subject are detected, it is preferable to give priority to the face area.

[0038] In S506, the exposure determination unit 407 calculates the average luminance value of the attention area set in S505. Specifically, information regarding the position of the attention area and the size of the attention area is applied to the following formula (1).

[0039]

Equation

[0040] Here, I(x, y) represents the luminance value of the two-dimensional coordinate position (x, y) in the horizontal direction (x-axis direction) and the vertical direction (y-axis direction) within the image. Also, (v, h) represents the center coordinates of the attention area, k represents the size of the attention area in the horizontal direction, and l represents the detected size of the attention area in the vertical direction. The left side of formula (1) is the average luminance value of the attention area.

[0041] In S507, the exposure determination unit 407 determines the exposure correction amount EVcorrection based on the average luminance value calculated in S506. First, the exposure determination unit 407 calculates the difference value between the average luminance value Iobject of the target area calculated in S506 and the target luminance value Iobject target of the target area as shown in Equation (2). Note that the target luminance value Iobject target of the target area may be arbitrarily set by the user, for example, or may be set to a value that improves the accuracy in light of the authentication accuracy at the time of face authentication.

[0042]

Number

[0043] Next, the exposure determination unit 407 determines the correction amount EVcorrection as shown in Equation (3). Note that EVcurrent is the EV value in APEX conversion based on the subject luminance value (BV value), and is set based on the program diagram related to exposure control stored in the client device 103 in advance.

[0044]

Number

[0045] Here, the parameter β is a coefficient that affects the degree (speed) of correction when correcting the exposure to the under-exposure side or over-exposure side of the exposure centered on the current exposure value EVcurrent. When the value of the parameter β is set large, the processing speed (or time) required to reach the target value becomes high, but when a false determination occurs in the detection result or when the detection of the subject is not stable, the brightness of the entire screen fluctuates steeply. On the other hand, when the value of the parameter β is set small, the processing speed (or time) required for the exposure to reach the target becomes slow, but it becomes robust against false detection and imaging conditions. The parameter β is set as the exposure correction value for the current exposure value EVcurrent when the difference ΔDiff is equal to or greater than the set threshold Th.

[0046] In S508, the exposure determination unit 407 communicates with the surveillance camera 101 via the communication control unit 402, sets the exposure correction value calculated in S507 in the surveillance camera 101, and ends this process.

[0047] As described above, in the present embodiment, for the face and the human body for which the face authentication process by the face authentication processing unit 409 has been completed, exposure control is not performed, and exposure control is performed for the face and the human body for which the face authentication has not been completed. By doing so, even when a plurality of persons are present in the image, by sequentially narrowing down the target person for exposure control based on the face authentication result, it is possible to perform exposure control suitable (efficient) for face authentication. Further, the face authentication result manages not only the face but also the ID (identification information) of the human body in association with each other. Thereby, even when the face cannot be detected due to a change in exposure or face orientation, it is possible to avoid repeatedly performing exposure control on the person for whom the face authentication has been completed.

[0048] Embodiment 2 Hereinafter, with reference to FIG. 8, Embodiment 2 of the present invention will be described. In Embodiment 1, when the person being subjected to exposure control is not registered in the face authentication database, exposure control of other persons may not be performed until passing through the surveillance camera 101. As a result, depending on the installation status and use of the surveillance camera 101, exposure control of other persons may be delayed, which may affect face authentication. In the present embodiment, a method will be described in which it is determined whether the target (subject) for which exposure control has been performed is unregistered, and when it is determined that the target is unregistered, exposure control for that person is interrupted (exposure control based on the exposure correction value is not performed), and the process proceeds to exposure control of other persons. Note that the same components and processes as those in Embodiment 1 are denoted by the same reference numerals, and detailed descriptions thereof are omitted.

[0049] S501 to S504 and S506 to S508 are the same as those in FIG. 3 (Embodiment 1). After S504, the process proceeds to S801. In S801, the exposure determination unit 407 sets the region of interest used in S506 and S802. In S801, unlike S505 of Embodiment 1, with reference to an unregistered person list described later, a subject having an ID existing in the unregistered person list is not set as a target for setting the region of interest. Also, when both the face and the body of the same subject are detected, the face region is preferentially set as the region of interest.

[0050] In S802, the exposure determination unit 407 determines whether the face ID corresponding to the region of interest set (selected) in S801 is the same as that in the previous frame. If the determination result is Yes, the process proceeds to S803; if the determination result is No, the process proceeds to S506. When there is no face ID, that is, when the face region is not set as the region of interest, the process also proceeds to S506. In S803, the exposure determination unit 407 determines whether the exposure control performed in S508 of the previous frame has reached the target value (whether the exposure control is completed). Specifically, it is determined based on whether EVcorrection = EVcurrent in S507 and whether the operations of the aperture of the imaging optical system 201, the shutter speed of the imaging device 202, and the gain are completed. If it is determined that the exposure control is completed, the process proceeds to S804; otherwise, the process proceeds to S506.

[0051] In S804, the exposure determination unit 407 determines whether the face ID corresponding to the region of interest set in S801 has been the same continuously for a predetermined number of times in the immediate past. This predetermined number of times is set as an interval from when the exposure control is completed until the face authentication is completed. That is, if the face authentication is not completed a predetermined number of times or more (if the authentication cannot be completed within a predetermined time) despite the exposure control being completed, it is determined that the corresponding person is not registered in the face authentication database. If the determination result in S804 is Yes (if it is determined that the corresponding person is not registered in the face authentication database), the process proceeds to S805; otherwise, the process proceeds to S506.

[0052] In S805, the exposure determination unit 407 adds (registers) the face ID corresponding to the target area set in S801 and the human body ID corresponding to that face to the unregistered person list. The unregistered person list is stored in, for example, the auxiliary storage device 303. That is, the auxiliary storage device 303 registers the information (face ID, human body ID) of the subject for which authentication cannot be completed within a predetermined time. In S806, the exposure determination unit 407 determines whether there is another face or human body in the captured image. If there is, it returns to S801; if not, this process ends.

[0053] Note that in this embodiment, in S804, it is determined whether the face ID is the same a predetermined number of times or more to determine whether it is unregistered, but this determination can also be made by other methods. For example, the face authentication similarity of the corresponding face ID may be received from the face authentication processing unit 409, and the determination may be made based on whether the state where the value of the face authentication similarity is low continues. Alternatively, the orientation of the face may be detected, and if the face authentication is not completed even though the orientation of the face is close to the front, it may be determined that the person is an unregistered person.

[0054] Also, when the exposure determination unit 407 determines that the person is an unregistered person (when the subject is added to the unregistered person list), it may transmit the face image to the face authentication processing unit 409 as a registration image. This is because at the time of determination, exposure control suitable for the face of the person has been performed, so the face image is a suitable face image as a registration image. Furthermore, by detecting the orientation of the face and transmitting the one with the face orientation close to the front, it is possible to transmit a more suitable face image.

[0055] Note that in the above-described Embodiment 1 and Embodiment 2, the surveillance camera 101 has been described as an example of the imaging device, but the present invention can also be applied to imaging devices other than surveillance cameras.

[0056] Other Embodiments The present invention can also be realized by supplying a program that implements one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium and causing one or more processors in a computer of the system or apparatus to read and execute the program. It can also be realized by a circuit (for example, ASIC) that implements one or more functions. The program in this case is readable by a computer and is a program corresponding to the flowchart illustrated in the above-described embodiments.

Explanation of Signs

[0057] 100... Imaging control system, 101... Surveillance camera, 102... Network, 103... Client device, 301... CPU, 402... Communication control unit, 403... Input screen acquisition unit, 405... Detection method setting unit, 406... Subject detection unit, 407... Exposure determination unit, 409... Face authentication processing unit

Claims

1. Detection means for detecting a subject in an image input from an imaging device; Determination means for determining whether the subject detected by the detection means is a pre - authenticated subject; Control means for performing exposure control of the imaging device, and comprising: When the determination means determines that the subject is not a pre - authenticated subject, the control means performs the exposure control on the subject, and when the determination means determines that the subject is a pre - authenticated subject, the control means does not perform the exposure control on the subject. An imaging control device characterized by this.

2. The detection means detects a plurality of regions related to the subject, the determination means makes the determination based on at least one of the regions, and stores the result of the determination in association with identification information assigned to each of the plurality of regions. The imaging control device according to claim 1, characterized by this.

3. The imaging control device further comprises authentication means for authenticating the subject; When the authentication means cannot complete the authentication of the subject within a predetermined time, the control means does not perform the exposure control on the subject. The imaging control device according to claim 1 or 2, characterized by this.

4. The control means transmits an image of a subject that the authentication means cannot complete the authentication within a predetermined time to the determination means. The imaging control device according to claim 3, characterized by this.

5. The imaging control device further comprises registration means for registering information of a subject that the authentication means cannot complete the authentication within a predetermined time; The control means determines whether the subject is a subject that the authentication means cannot complete the authentication within a predetermined time by referring to the registration means. The imaging control device according to claim 3 or 4, characterized by this.

6. When there are a plurality of subjects for which the exposure control should be performed, the control means determines the order of performing the exposure control based on the distance between the imaging device and the subject. The imaging control device according to any one of claims 1 to 5, characterized by this.

7. When there are a plurality of subjects for which the exposure control should be performed, the control means determines the order of performing the exposure control based on the position of the subject in the image. The imaging control device according to any one of claims 1 to 5, characterized by this.

8. The subject is a person, and the plurality of regions related to the subject are a region including the human body of the person in the image and a region including the face of the person. The imaging control device according to claim 2, characterized in that.

9. The region including the human body is any one of the whole body, upper body, bust-up, and head region of the person. The imaging control device according to claim 8, characterized in that.

10. The subject is a vehicle, and the plurality of regions related to the subject are a region including the vehicle body of the vehicle in the image and a region including the license plate of the vehicle. The imaging control device according to claim 2, characterized in that.

11. A step of detecting a subject included in an image input from an imaging device; A step of determining whether the subject detected by the detecting step is a pre-authenticated subject; When it is determined by the determining step that the subject is not a pre-authenticated subject, performing exposure control on the subject, and when it is determined by the determining step that the subject is a pre-authenticated subject, not performing the exposure control on the subject; An imaging control method, characterized by comprising:

12. A program for causing a computer to function as each means of the imaging control device according to any one of claims 1 to 10.

Images