Imaging apparatus, method for controlling the imaging apparatus, and program

Abstract

To make it possible to avoid a situation in which information displayed on an external device becomes difficult to see due to lighting by lighting means, when a subject to be imaged by the imaging apparatus visually confirms the information.SOLUTION: A network camera (imaging apparatus) 101 for imaging a subject includes: an LED unit 303 for performing lighting in accordance with the operating state of the network camera 101; and an LED control unit 313 for controlling the LED unit 303 so that lighting is not performed when the subject is imaged with information being displayed on a prompter apparatus (external apparatus) 120 so as to be visible to the subject.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to an imaging device, a control method for an imaging device, and a program. [Background technology]

[0002] BACKGROUND ART When a speaker is photographed as a subject with an imaging device in television shooting or the like, a prompter device is known that projects a manuscript displayed on a monitor onto a half mirror placed in front of the imaging device, allowing the speaker to read the manuscript without taking their eyes off the imaging device.

[0003] Meanwhile, imaging devices are equipped with indicator units such as LEDs as lighting means to notify users of the operating status of the imaging device. Patent Document 1 describes that a remote control camera platform system that rotates an imaging device uses a prompter device when shooting with the imaging device, and that the system is equipped with an indicator unit that lights up depending on the operating status of the imaging device. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2007-19730 Summary of the Invention [Problem to be solved by the invention]

[0005] In the technology described in Patent Document 1, when an image of a speaker using a prompter is captured by an imaging device, there is a concern that the illumination of the indicator unit (lighting means) may be reflected through the half mirror of the prompter, which displays the information on the manuscript. In this case, the speaker, who is the subject being imaged by the imaging device, may find it difficult to see the information on the manuscript displayed on the prompter, which is an external device.

[0006] The present invention has been made in view of such problems, and aims to prevent a situation in which, when a subject imaged by an imaging device views information displayed on an external device, the information becomes difficult to see due to lighting of a lighting means. [Means for solving the problem]

[0007] The imaging device of the present invention is an imaging device that images a subject, and has a lighting means that turns on the imaging device depending on the operating state of the imaging device, and a control means that controls the lighting means not to turn on when the subject is being imaged in a state where the subject is displaying information that is visible on an external device. [Effects of the Invention]

[0008] According to the present invention, when a subject imaged by an imaging device views information displayed on an external device, it is possible to avoid the information becoming difficult to see due to lighting of the lighting means. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a diagram illustrating an example of a schematic configuration of an imaging system according to a first embodiment. [Figure 2] 1 is a diagram illustrating an example of a schematic configuration of a prompter device according to a first embodiment. [Figure 3] 1 is a diagram showing an example of a schematic configuration of a network camera (imaging device) according to a first embodiment. [Figure 4] 10 is a diagram illustrating an example of a lighting pattern table showing the correspondence between the operating state of the network camera (image capture device) and the lighting pattern of the LED unit according to the first embodiment. FIG. [Figure 5] 5 is a flowchart showing an example of a processing procedure in a control method for a network camera (imaging device) according to the first embodiment. [Figure 6] 6 is a flowchart showing an example of detailed processing procedures in step S503 of FIG. 5. [Figure 7]10 is a diagram illustrating an example of a lighting pattern table showing the correspondence between the operating state of the network camera (image capture device) and the normal lighting pattern and non-lighting pattern of the LED unit according to the first embodiment. FIG. [Figure 8] FIG. 2 is a diagram showing an example of a WebUI display screen related to a network camera used in the imaging system according to the first embodiment. [Figure 9] FIG. 10 is a diagram illustrating an example of a schematic configuration of an imaging system according to a second embodiment. [Figure 10] FIG. 10 is a diagram illustrating an example of a schematic configuration of an imaging system according to a third embodiment. [Figure 11] 10 is a flowchart showing an example of a processing procedure in a control method for an imaging system according to a third embodiment. [Figure 12] FIG. 11 is a diagram showing an example of a WebUI display screen related to a network camera used in an imaging system according to a third embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[0011] (First embodiment) First, the first embodiment will be described.

[0012] Fig. 1 is a diagram showing an example of a schematic configuration of an image capture system 100-1 according to the first embodiment. As shown in Fig. 1, the image capture system 100-1 includes a network camera 101 and a network camera 102, which are examples of image capture devices according to the present embodiment, a client device 110, a prompter device 120, and a network 130.

[0013] The network cameras 101 and 102 are imaging devices that are capable of delivering video and controlling the cameras via a wired or wireless network 130 .

[0014] The client device 110 is communicably connected to the network cameras 101 and 102 via a network 130, and controls the network cameras 101 and 102 and outputs information via a browser.

[0015] The prompter device 120 is an external device that is installed between the network cameras 101 and 102 and the subject H who is speaking, and that can display information that can be seen by the subject H. In this embodiment, the prompter device 120 transmits drive information to the network camera 101 via serial communication. Here, in this embodiment, the drive information of the prompter device 120 is information indicating whether the power of the prompter device 120 is on and whether the information of the document is being output (displayed), but the present invention is not limited to this form. For example, the drive information of the prompter device 120 may be information notifying the start and end of the output (display) of the information of the document.

[0016] 1, the network 130 is a network that connects the network camera 101, the network camera 102, and the client device 110 so that they can communicate with each other. Furthermore, the network 130 distributes, for example, images captured by the network camera 101 or the network camera 102 to an external device such as a recording server. Note that in this embodiment, the communication format of the network 130 is a wired LAN, but it may also be a wireless LAN.

[0017] The subject H, who is the speaker, is the subject whose state is captured by the network camera 101 while reading out information from a manuscript output (displayed) on the prompter device 120 .

[0018] Fig. 2 is a diagram showing an example of the schematic configuration of the prompter device 120 according to the first embodiment. In Fig. 2, components similar to those shown in Fig. 1 are denoted by the same reference numerals, and detailed description thereof will be omitted.

[0019] As shown in FIG. 2 , the prompter device 120 includes a half mirror 201 having a glass surface, a light source (monitor) 202, and an information terminal device 203. The prompter device 120 allows the subject H, who is the speaker, to view the document information by reflecting the document information output by the light source (monitor) 202 on the glass surface of the half mirror 201. At this time, as the optical path of the document information output from the light source (monitor) 202 is shown by the arrow, the document information output from the light source (monitor) 202 is not visible from the network camera 101. Therefore, the subject H, who is the speaker, can maintain a state of looking straight ahead at the network camera 101 while viewing and reading aloud the document information displayed on the prompter device 120. The document information output from the light source (monitor) 202 is controlled by the information terminal device 203.

[0020] Fig. 3 is a diagram showing an example of a schematic configuration of a network camera (imaging device) 101 according to the first embodiment. In Fig. 3, components similar to those shown in Fig. 1 are denoted by the same reference numerals, and detailed description thereof will be omitted.

[0021] 3, the network camera 101 includes an imaging unit 301, a lens drive control unit 302, an LED unit 303, an A / D conversion unit 311, a camera signal processing unit 312, an LED control unit 313, a storage unit 314, a video analysis unit 315, and a compression / decompression unit 316. Furthermore, the network camera 101 includes a network communication processing unit 317, a serial communication processing unit 318, a bus 319, and a CPU 320, as shown in FIG.

[0022] The imaging unit 301 is a component that captures an image of a speaker or the like, which is the subject H. The imaging unit 301 is configured to include a zoom lens, a focus lens, an aperture, and an image sensor. The zoom lens and the focus lens move along the optical axis under the control of the lens drive control unit 302, and the aperture is driven and operated under the control of the lens drive control unit 302. The image sensor photoelectrically converts light that has passed through the zoom lens, the focus lens, and the aperture, to generate an analog image signal. The analog image signal generated by the image sensor is subjected to amplification processing by sampling, and then output to the A / D conversion unit 311.

[0023] The lens drive control unit 302 controls the driving of the zoom lens, focus lens, and diaphragm of the imaging unit 301 based on the control of the CPU 320, for example.

[0024] The LED unit 303 displays multiple operating states of the network camera 101 by lighting colors and lighting patterns to notify the user of the operating state of the network camera 101. The LED unit 303 controls the lighting colors and lighting patterns based on the control of the LED control unit 313. In this embodiment, the LED unit 303 corresponds to lighting means that lights up in accordance with the operating state of the network camera 101, which is an imaging device. Note that in this embodiment, the LED unit 303 is configured with one LED, but the present invention is not limited to this form. For example, the LED unit 303 may be equipped with multiple LEDs depending on the number of patterns of the operating state of the network camera 101 to be displayed.

[0025] The A / D conversion unit 311 converts the analog image signal output from the imaging unit 301 into a digital image signal, and outputs the digital image signal to the camera signal processing unit 312 .

[0026] The camera signal processing unit 312 generates a video signal by performing various types of image processing (signal processing) on ​​the digital image signal output from the A / D conversion unit 311. In this case, the various types of image processing include, for example, offset processing, gamma correction processing, gain processing, RGB interpolation processing, noise reduction processing, color correction processing, etc.

[0027] The LED control unit 313 controls the color and lighting pattern of the LED unit 303 depending on the operating state of the network camera 101 .

[0028] FIG. 4 illustrates an example of a lighting pattern table 400 showing the correspondence between the operating states of the network camera (imaging device) 101 and the lighting patterns of the LED unit 303 according to the first embodiment. The lighting pattern table 400 shown in FIG. 4 is stored in, for example, the storage unit 314. In the example shown in FIG. 4, the operating states 410 of the network camera 101 are shown as a power-on state (power on) 411, a normal startup state 412, an initialization processing state (initialization processing in progress) 413, an abnormal device state 414, and a power-off state 415. In addition, in the example shown in FIG. 4, the lighting patterns 420 of the LED unit 303 are shown as a flashing green light 421 corresponding to the power-on state 411, a lit green light 422 corresponding to the normal startup state 412, and a flashing orange light 423 corresponding to the initialization processing state 413. In addition, in the example shown in FIG. 4, the lighting patterns 420 of the LED unit 303 are shown as a lit red light 424 corresponding to the abnormal device state 414 and an off light 425 corresponding to the power-off state 415. In this way, when the network camera 101 is powered on, the LED unit 303 flashes green 421, and when startup is complete, the LED unit 303 changes to a steady green 422. When initialization is performed during normal startup of the network camera 101, the LED unit 303 flashes orange 423, and when an abnormality occurs, such as when normal operation is no longer possible due to a hardware abnormality, the LED unit 303 lights red 424 to notify the user. When the network camera 101 is powered off, the LED unit 303 goes out 425. Note that the lighting pattern table 400 shown in FIG. 4 is merely an example, and the type and number of lighting patterns are not important as long as the operating status of the network camera 101 is notified to the user by lighting up.

[0029] Here, we return to the explanation of FIG. The storage unit 314 includes a RAM, a ROM, and a storage device. The RAM is, for example, a volatile memory such as an SRAM or a DRAM. The ROM is, for example, a non-volatile memory such as an EEPROM or a flash memory. The storage device is, for example, an HDD (hard disk drive) or an SSD (solid state drive). Programs for realizing the functions of the network camera 101, which is the imaging device according to this embodiment, and data used when the programs are executed are stored in the ROM or storage device of the storage unit 314. These programs and data stored in the storage unit 314 are loaded into the RAM of the storage unit 314 as appropriate under the control of the CPU 320, and are executed by the CPU 320 to function as each component of the network camera 101 according to this embodiment. Various data obtained by the control and processing of the CPU 320 are stored in the storage device, etc. of the storage unit 314.

[0030] The video analysis unit 315 performs analysis processing on the video signal output from the camera signal processing unit 312, etc., including various detection processing such as human body detection, face detection, and moving object detection. In this embodiment, as an example of video analysis, it is assumed that a human body region or a face region is detected in an image frame based on the video signal output from the camera signal processing unit 312, etc., but the video analysis is not limited to this form. Depending on the use scene, for example, moving object detection or object detection may also be performed as an example of video analysis. The video analysis results by the video analysis unit 315 are transmitted to the CPU 320 via the bus 319.

[0031] The compression / decompression unit 316 performs compression processing on a captured image based on a video signal output from the camera signal processing unit 312 or the like under the control of the CPU 320 via the bus 319 to generate compressed data.

[0032] In this embodiment, the network communication processing unit 317 performs processing for network communication with the client device 110 via the network 130 .

[0033] In this embodiment, the serial communication processing unit 318 transmits and receives information via serial communication to and from the prompter device 120, which is an external device. Note that, although the serial communication processing unit 318 is shown as being connected via serial communication to the prompter device 120 in this embodiment, it may also be connected via serial communication to other external devices. For example, the serial communication processing unit 318 may be connected via serial communication to a controller device, which is an external device that enables camera control by transmitting and receiving specific control commands, and the network camera 101 may be controlled thereby.

[0034] The CPU 320 is a central processing unit that performs overall control of the operation of the network camera 101 and also performs various processes. As shown in Fig. 3, the CPU 320 has an operation status management unit 321, a speaker recognition unit 322, an external device detection unit 323, and a speaker face direction determination unit 324. Each component (321 to 324) of the CPU 320 will be described below.

[0035] The operating state management unit 321 manages the operating state of the network camera 101. For example, the operating state management unit 321 instructs the LED control unit 313 on the lighting pattern of the LED unit 303 according to the operating state of the network camera 101.

[0036] The speaker recognition unit 322 performs processing to recognize whether the subject H is a speaker stored in advance in the storage unit 314 based on the video analysis result by the video analysis unit 315 .

[0037] The external device detection unit 323 performs processing to detect whether an external device (for example, the prompter device 120 in this embodiment) is connected and whether the external device is being used by receiving the operating status of the external device. In this embodiment, the external device detection unit 323 performs processing to detect whether the prompter device 120 is being used (whether the prompter device 120 is operating) based on information (operation information) received from the prompter device 120 by the serial communication processing unit 318.

[0038] The speaker face direction determination unit 324 performs processing to determine the direction of the speaker's face based on the speaker's face area recognized by the speaker recognition unit 322 via the video analysis unit 315.

[0039] In the above description, the schematic configuration shown in FIG. 3 has been described as the schematic configuration of the network camera 101, but in this embodiment, the schematic configuration of the network camera 102 also adopts the schematic configuration shown in FIG.

[0040] FIG. 5 is a flowchart showing an example of a processing procedure in a control method for the network camera (image capture device) 101 according to the first embodiment.

[0041] First, in step S501 of Fig. 5, the CPU 320 of the network camera 101 performs control to start capturing an image of a speaker, who is subject H. Here, the start of capturing in S501 is determined to be when the CPU 320 starts distributing a video signal in response to an HTTP (Hypertext Transfer Protocol) request transmitted from the client device 110 via the network 130. Note that any method can be used as long as it is possible to determine that the network camera 101 has started capturing an image. For example, the start of capturing in S501 may be determined to be when the CPU 320 of the network camera 101 starts recording data based on the video signal into the storage unit 314.

[0042] 5, the external device detection unit 323 of the CPU 320 determines whether the prompter device 120 is operating based on information received from the prompter device 120 by the serial communication processing unit 318. Specifically, in this embodiment, when the prompter device 120 is displaying information about a document to the speaker who is subject H, it transmits operation information indicating that the document information is being output to the network camera 101 by serial communication. Then, when the serial communication processing unit 318 receives the operation information from the prompter device 120, the external device detection unit 323 determines that the prompter device 120 is operating.

[0043] In step S502 of FIG. 5, if the external device detection unit 323 determines that the prompter device 120 is operating (S502 / Yes), the process proceeds to step S503. 5, the speaker recognition unit 322 and the speaker face direction determination unit 324 of the CPU 320 determine whether the speaker, who is subject H, faces the network camera 101. An example of the detailed processing content of step S503 will be described below with reference to FIG.

[0044] FIG. 6 is a flowchart showing an example of a detailed processing procedure in step S503 of FIG.

[0045] When the processing of step S503 in Figure 5 starts, first, in step S601 in Figure 6, the speaker recognition unit 322 of the CPU 320 determines whether or not the speaker's face has been detected from the captured image based on the video analysis results by the video analysis unit 315.

[0046] In step S601 of FIG. 6, if the speaker recognition unit 322 determines that the face of the speaker has been detected from the captured image (S601 / Yes), the process proceeds to step S602. 6, the speaker recognition unit 322 of the CPU 320 determines whether the face of the speaker detected in step S601 is a pre-registered face. Specifically, the network camera 101 stores information about the faces of speakers registered in advance in the storage unit 314. Therefore, in this embodiment, the speaker recognition unit 322 performs a process of comparing the face of the speaker detected in step S601 with the faces of speakers registered in advance in the storage unit 314, and determines whether the face of the speaker detected in step S601 is a pre-registered face.

[0047] In step S602 of FIG. 6, if the speaker recognition unit 322 determines that the face of the speaker detected in step S601 is a face that has been registered in advance (S602 / Yes), the process proceeds to step S603. 6, the speaker face direction determination unit 324 of the CPU 320 determines whether the speaker's face is facing forward, based on the speaker's facial area recognized by the speaker recognition unit 322 via the video analysis unit 315. Specifically, the speaker face direction determination unit 324 obtains feature points, such as the speaker's eyes, nose, and mouth, that are elements of the speaker's facial area, and determines whether the speaker's face is facing forward (with respect to the network camera 101) based on the ratio of the vertical and horizontal distances between the feature points. Note that the determination process in the speaker face direction determination unit 324 described here is merely an example, and any method may be used as long as it can determine whether the speaker's face is facing forward.

[0048] In step S603 of FIG. 6, if the speaker face direction determining unit 324 determines that the speaker's face is facing forward (S603 / Yes), the process proceeds to step S604. When the process proceeds to step S604 in FIG. 6, the speaker face direction determination unit 324 (or the speaker recognition unit 322) of the CPU 320 determines that the speaker, who is the subject H, is facing forward relative to the network camera 101.

[0049] Also, in step S603 of FIG. 6, if the speaker face direction discriminating unit 324 determines that the speaker's face is not facing forward (S603 / No), the process proceeds to step S605. When the process proceeds to step S605 in FIG. 6, the speaker face direction determination unit 324 (or the speaker recognition unit 322) of the CPU 320 determines that the speaker, who is the subject H, is not facing forward relative to the network camera 101.

[0050] 6, if the speaker recognition unit 322 determines that the speaker's face has not been detected from the captured image (S601 / No), the process proceeds to step S606. Furthermore, if the speaker recognition unit 322 determines that the speaker's face detected in step S601 is not a pre-registered face (S602 / No), the process proceeds to step S606. 6, the speaker face direction determination unit 324 (or the speaker recognition unit 322) of the CPU 320 determines that there is no speaker who is subject H. That is, in step S606, the speaker face direction determination unit 324 (or the speaker recognition unit 322) of the CPU 320 determines that the speaker who is subject H is not facing forward toward the network camera 101.

[0051] When the processing of step S604 in Fig. 6 is completed, when the processing of step S605 in Fig. 6 is completed, or when the processing of step S606 in Fig. 6 is completed, the processing of the flowchart shown in Fig. 6 is completed. The processing of step S503 in Fig. 5 is performed by the processing of the flowchart shown in Fig. 6 described above.

[0052] Here, we return to the explanation of FIG. 5, if the speaker recognition unit 322 and the speaker face direction determination unit 324 determine that the speaker, who is subject H, is facing forward toward the network camera 101 (S503 / Yes), the process proceeds to step S504. Note that when proceeding to step S504 in Fig. 5, since the results are steps S502 / Yes and S503 / Yes, the CPU 320 of the network camera 101 determines that information is being displayed on the prompter device 120, which is an external device, so that subject H can see the information. 5, the LED control unit 313 controls the LED unit 303 not to light up, based on the control of the operation state management unit 321 of the CPU 320. An example of the detailed processing content of step S504 will be described below with reference to FIG.

[0053] Fig. 7 shows the first embodiment and is a diagram illustrating an example of a lighting pattern table 700 indicating the correspondence between the operating state of the network camera (imaging device) 101 and the normal lighting pattern and non-lighting pattern of the LED unit 303. In Fig. 7, components similar to those shown in Fig. 4 are assigned the same reference numerals, and detailed description thereof will be omitted. The lighting pattern table 700 shown in Fig. 7 is stored in, for example, the storage unit 314.

[0054] In the example shown in Figure 7, the operating states 410 of the network camera 101 are shown as follows, similar to Figure 4: power-on state (power on) 411, normal startup state 412, initialization processing state (initialization processing in progress) 413, device abnormality state 414, and power-off state 415.

[0055] 7 shows a non-illumination pattern 730 of the LED unit 303 in addition to the normal illumination pattern 420 of the LED unit 303, which corresponds to the illumination pattern 420 of the LED unit 303 shown in Fig. 4. Specifically, in the example shown in Fig. 7, the non-illumination patterns 730 of the LED unit 303 include an off state 731 corresponding to the power-on state 411, an off state 732 corresponding to the normal startup state 412, and an off state 733 corresponding to the initialization processing state 413. Furthermore, in the example shown in Fig. 7, the non-illumination patterns 730 of the LED unit 303 include a red illumination state 734 corresponding to the device abnormal state 414 and an off state 735 corresponding to the power-off state 415.

[0056] In step S504 of Fig. 5, the LED control unit 313, under the control of the operation status management unit 321 of the CPU 320, controls the LED unit 303 according to a non-illumination pattern 730 of the LED unit 303 rather than the normal illumination pattern 420 of the LED unit 303 shown in Fig. 7. In the example shown in Fig. 7, the LED control unit 313 controls to turn off the LED unit 303 when the operation status 410 of the network camera 101 is the power-on state 411, the normal startup state 412, the initialization processing state 413, or the power-off state 415. Also, in the example shown in Fig. 7, the LED control unit 313 controls to turn the LED unit 303 on in red 734 when the operation status 410 of the network camera 101 is the device abnormality state 414, which is considered to be a state that requires a high level of notification to the user. Note that the non-illumination pattern 730 of the LED unit 303 shown in Fig. 7 is merely an example, and is not limited to the pattern shown in Fig. 7 as long as the LED unit 303 is not illuminated in a manner that is distinct from the normal illumination pattern 420 of the LED unit 303 shown in Fig. 7. For example, the user may be allowed to set in advance a non-illumination pattern of the LED unit 303.

[0057] Here, we return to the explanation of FIG. When the processing of step S504 in Fig. 5 is completed, the process proceeds to step S505. Also, in step S502 in Fig. 5, if the external device detection unit 323 determines that the prompter device 120 is not operating (S502 / No), the process proceeds to step S505. Furthermore, in step S503 in Fig. 5, if the speaker recognition unit 322 and the speaker face direction determination unit 324 determine that the speaker, who is subject H, is not facing forward toward the network camera 101 (S503 / No), the process proceeds to step S505. 5, the CPU 320 of the network camera 101 determines whether or not to end the shooting of the speaker, who is subject H. Here, the determination of whether or not to end the shooting in step S505 is made by determining whether or not to end the distribution of the video signal in response to an HTTP request sent from the client device 110, similar to step S501 described above. Note that any form is acceptable as long as the network camera 101 can determine whether or not to end the shooting.

[0058] In step S505 of FIG. 5, if the CPU 320 determines not to end the shooting of the speaker who is the subject H (S505 / No), the process returns to step S502 and the processes from step S502 onwards are performed again.

[0059] Also, in step S505 of FIG. 5, if the CPU 320 determines that imaging of the speaker who is the subject H has been completed (S505 / Yes), the process proceeds to step S506. 5, the LED control unit 313 controls the LED unit 303 to light up under the control of the operation state management unit 321 of the CPU 320. Specifically, in step S506 of FIG. 5, the LED control unit 313 controls the LED unit 303 according to a normal lighting pattern 420 of the LED unit 303 shown in FIG. 7 under the control of the operation state management unit 321 of the CPU 320. In the example shown in FIG. 7, the LED control unit 313 causes the LED unit 303 to flash green 421 when the operation state 410 of the network camera 101 is a power-on state 411, and causes the LED unit 303 to light up green 422 when the operation state 410 of the network camera 101 is a normal startup state 412. Also, in the example shown in FIG. 7, the LED control unit 313 causes the LED unit 303 to flash orange 423 when the operation state 410 of the network camera 101 is an initialization processing state 413, and causes the LED unit 303 to light up red 424 when the operation state 410 of the network camera 101 is an abnormal device state 414. Furthermore, in the example shown in FIG. 7, the LED control unit 313 turns off 425 the LED unit 303 when the operating state 410 of the network camera 101 is the power OFF state 415 .

[0060] When the process of step S506 in FIG. 5 is completed, the process in the flowchart shown in FIG. 5 is completed.

[0061] Next, the WebUI display screen used in this embodiment will be described. Fig. 8 is a diagram showing an example of a WebUI display screen 800 related to the network camera 101 used in the imaging system 100-1 according to the first embodiment. The WebUI display screen 800 shown in Fig. 8 is a display screen that is displayed on the client device 110 via a browser under the control of the CPU 320 of the network camera 101, for example.

[0062] The WebUI display screen 800 shown in FIG. 8 is a display screen related to the network camera 101 and includes a video display area 810, an operation status display area 820, and a toggle switch 830. The video display area 810 is an area for displaying video captured by the network camera 101. In the example shown in FIG. 8, the video display area 810 displays video including subject H, who is speaking. The operation status display area 820 is an area for displaying the operation status of the network camera 101 and is displayed on the WebUI display screen 800 as an alternative to displaying the LED unit 303 of the network camera 101. In this case, the CPU 320 of the network camera 101 may perform control to display the lighting state of the LED unit 303 in the operation status display area 820 of the WebUI display screen 800 while capturing an image of the speaker, who is subject H. In this embodiment, the operation status display area 820 displays the lighting pattern of the LED unit 303 of the network camera 101, but the present invention is not limited to this. In the present invention, any form is acceptable as long as it displays the operating status of the network camera 101 indicated by the LED unit 303 of the network camera 101. For example, the operating status display area 820 may display a character string indicating the operating status of the network camera 101. The toggle switch 830 is operated by a user and switches between enabling and disabling the function of linking with the prompter device 120, which is an external device. The state of the toggle switch 830 shown in FIG. 8 represents a state in which the function of linking with the prompter device 120 is enabled. Note that in this embodiment, the toggle switch 830 is used to switch between enabling and disabling the function of linking with the prompter device 120, but this switching means is not limited to the toggle switch 830 and any form is acceptable. Furthermore, the description of the WebUI display screen 800 shown in FIG. 8 above is merely an example, and any form is acceptable.

[0063] The network camera 101 according to the first embodiment is an imaging device that captures an image of a subject H who is speaking, and has the following configuration: The network camera 101 is provided with an LED unit 303, which is lighting means that turns on the LED unit 303 depending on the operating state of the network camera 101. The network camera 101 also has an LED control unit 313, which is control means that controls the LED unit 303 not to light up when capturing an image of the subject H in a state where the subject H is displaying information visibly on the prompter device 120, which is an external device. With this configuration, when the subject H imaged by the network camera 101 visually checks the information displayed on the prompter device 120, which is an external device, it is possible to avoid the information becoming difficult to see due to the LED unit 303 being lit.

[0064] Specifically, the LED control unit 313 performs control not to light up the LED unit 303 when the operating state of the network camera 101 is not an abnormal device state (411 to 413, 415), as shown by the non-lighting pattern 730 of the LED unit 303 in Fig. 7. Furthermore, the LED control unit 313 performs control to light up the LED unit 303 when the operating state of the network camera 101 is an abnormal device state (414), as shown by the non-lighting pattern 730 of the LED unit 303 in Fig. 7. According to this configuration, when the network camera 101 is capturing an image of the subject H, it is possible to notify the user that an abnormality has occurred in the network camera 101.

[0065] (Second embodiment) Next, a second embodiment will be described. In the following description of the second embodiment, matters common to the first embodiment will be omitted, and only matters different from the first embodiment will be described.

[0066] Fig. 9 is a diagram showing an example of a schematic configuration of an imaging system 100-2 according to the second embodiment. As shown in Fig. 9, the imaging system 100-2 includes a network camera 101 and a network camera 102, which are examples of imaging devices according to the present embodiment, a client device 110, a prompter device 120, and a network 130.

[0067] 1, the prompter device 120 performs serial communication with the network camera 101 to operate in cooperation with the network camera 101. That is, in the first embodiment, the prompter device 120 transmits operation information to the network camera 101 via serial communication.

[0068] 9, the prompter device 120 is connected to a network 130 and operates in cooperation with the network camera 101 via the network 130. That is, in the second embodiment, the prompter device 120 transmits operation information to the network camera 101 via the network 130.

[0069] The schematic configuration of the prompter device 120 according to the second embodiment is similar to the schematic configuration of the prompter device 120 according to the first embodiment shown in Fig. 2. The schematic configurations of the network camera 101 and the network camera 102 according to the second embodiment are similar to the schematic configurations of the network camera 101 and the network camera 102 according to the first embodiment shown in Fig. 3.

[0070] In the second embodiment, the network camera 101 receives operation information indicating the operating state of the prompter device 120 from the prompter device 120 via the network communication processing unit 317. Then, the CPU 320 (external device detection unit 323) of the network camera 101 detects that the prompter device 120 is operating based on the operation information transmitted from the prompter device 120, which is an external device, via network communication. Note that the processing performed by the network camera 101 after detecting that the prompter device 120 is operating is the same as in the first embodiment described above, and therefore a description thereof will be omitted.

[0071] In the second embodiment, the network camera 101 transmits a request to the prompter device 120 via the network 130, thereby acquiring operation information from the prompter device 120. In this regard, the present invention does not limit the form as long as the network camera 101 can acquire operation information from the prompter device 120. For example, the client device 110 transmits a request to the prompter device 120 via the network 130, and the client device 110 receives the operation information from the prompter device 120. The network camera 101 may then acquire the operation information of the prompter device 120 from the client device 110. In this form, the client device 110 can also transmit operation information of the prompter device 120 to the network camera 102 that belongs to the same network 130, thereby sharing the operating status of the prompter device 120.

[0072] In the second embodiment, the same effects as those in the first embodiment can be obtained.

[0073] (Third embodiment) Next, a third embodiment will be described. In the following description of the third embodiment, matters common to the first and second embodiments will be omitted, and only matters different from the first and second embodiments will be described.

[0074] Fig. 10 is a diagram showing an example of a schematic configuration of an imaging system 100-3 according to the third embodiment. As shown in Fig. 10, the imaging system 100-3 includes a network camera 101 and a network camera 102, which are examples of imaging devices according to this embodiment, a client device 110, a prompter device 120, and a network 130.

[0075] 1, the prompter device 120 performs serial communication with the network camera 101 to operate in cooperation with the network camera 101. That is, in the first embodiment, the prompter device 120 transmits operation information to the network camera 101 via serial communication.

[0076] 10, the image capturing system 100-3 according to the third embodiment does not include a communication means for the prompter device 120. Specifically, in the third embodiment, the network camera 101 detects the operation of the prompter device 120 based on information acquired from a video signal captured by a network camera 102, which is another image capturing device belonging to the same network 130.

[0077] FIG. 11 is a flowchart showing an example of a processing procedure in a control method for the imaging system 100-3 according to the third embodiment.

[0078] 11, the CPU 320 of the network camera 101 performs processing to enable the function of linking with the prompter device 120, which is an external device. Specifically, when the user operates the toggle switch 830 on the WebUI display screen 800 of FIG. 8 to enable prompter device linkage, the CPU 320 of the network camera 101 detects this and enables the function of linking with the prompter device 120.

[0079] Next, in step S1121 of FIG. 11, the CPU 320 of the network camera 102 performs processing to enable the function of detecting the prompter device 120, which is an external device.

[0080] Fig. 12 is a diagram showing an example of a WebUI display screen 1200 related to the network camera 102 used in the imaging system 100-3 according to the third embodiment. The WebUI display screen 1200 shown in Fig. 12 is a display screen that is displayed on the client device 110 via a browser under the control of the CPU 320 of the network camera 102, for example.

[0081] The WebUI display screen 1200 shown in FIG. 12 is a display screen related to the network camera 102 and includes a video display area 1210, an operation status display area 1220, a toggle switch 1230, and a notification destination IP address input area 1240. The video display area 1210 displays video captured by the network camera 102. In the example shown in FIG. 12, the video display area 1210 displays video including the subject H who is speaking and the prompter device 120. The operation status display area 1220 displays the operation status of the network camera 102 and is displayed on the WebUI display screen 1200 as an alternative to displaying the status using the LED unit 303 of the network camera 102. The toggle switch 1230 is operated by the user to enable or disable the detection function of the prompter device 120, which is an external device. The state of the toggle switch 1230 shown in FIG. 12 represents a state in which the detection function of the prompter device 120 is enabled. The destination IP address input area 1240 is operated and input by the user, and in this embodiment, it is assumed that the IP address of the network camera 101 is input as the destination. In this embodiment, the user operates the toggle switch 1230 to enable prompter device detection, and inputs the IP address of the network camera 101 to which detection result information is to be sent when the prompter device 120 is detected, into the destination IP address input area 1240. Note that the method described in this embodiment is merely an example, and any form is acceptable as long as it enables the prompter device detection function and allows setting the destination to which the detection result information is to be sent.

[0082] Specifically, in step S1121 of Fig. 11, the CPU 320 of the network camera 102 performs processing to enable the function of detecting the prompter device 120, which is an external device, in accordance with the WebUI display screen 1200 of Fig. 12. That is, when the user operates the toggle switch 1230 on the WebUI display screen 1200 of Fig. 12 to enable prompter device detection, the CPU 320 of the network camera 102 detects this and enables the function of detecting the prompter device 120.

[0083] 11, the CPU 320 (external device detection unit 323) of the network camera 102 determines whether or not the prompter device 120 has been detected based on the video signal obtained by the network camera 102. Note that in this embodiment, it is determined whether or not the prompter device 120 has been detected based on the video signal captured by the network camera 102, but the present invention is not limited to this form.

[0084] In step S1122 of FIG. 11, if the CPU 320 of the network camera 102 determines that the prompter device 120 has not been detected (S1122 / No), the process returns to step S1121 and the processes from step S1121 onwards are performed again.

[0085] Also, in step S1122 of FIG. 11, if the CPU 320 of the network camera 102 determines that the prompter device 120 has been detected (S1122 / Yes), the process proceeds to step S1123. 11, the CPU 320 (external device detection unit 323) of the network camera 102 first detects the operating state of the prompter device 120 from the video signal obtained by the network camera 102. If the CPU 320 of the network camera 102 detects, for example, an LED light illuminating, which indicates that the prompter device 120 is powered on, from the video signal, the CPU 320 determines that the prompter device 120 is operating and generates operating information. In this case, the CPU 320 of the network camera 102 transmits the operating information of the prompter device 120 to the network camera 101 via the network 130. At this time, the destination of the operating information of the prompter device 120 is the IP address set in the notification destination IP address input field 1240 on the WebUI display screen 1200 of FIG. 12 (in this embodiment, the IP address of the network camera 101).

[0086] 11, the CPU 320 of the network camera 101 first receives operation information of the prompter device 120 transmitted from the network camera 102 via the network communication processing unit 317. Next, the CPU 320 (external device detection unit 323) of the network camera 101 determines that the prompter device 120 is operating based on the received operation information of the prompter device 120. Note that in the network camera 101, the processing from step S1112 onwards in Fig. 11 is the same as in the first embodiment described above, and for example, the processing from step S503 onwards in Fig. 5 is performed.

[0087] In the third embodiment, the same effects as those in the first embodiment can be obtained.

[0088] (Fourth embodiment) Next, a fourth embodiment will be described. In the following description of the fourth embodiment, matters common to the first to third embodiments will be omitted, and only matters different from the first to third embodiments will be described.

[0089] In the imaging system 100-1 according to the first embodiment shown in Fig. 1, the network camera 101 detects the operation of the prompter device 120 by serial communication with the prompter device 120. In the imaging system 100-2 according to the second embodiment shown in Fig. 9, the network camera 101 detects the operation of the prompter device 120 by communicating with the prompter device 120 via the network 130. In the imaging system 100-3 according to the third embodiment shown in Fig. 10, the network camera 101 detects the operation of the prompter device 120 based on information acquired from a video signal captured by the network camera 102.

[0090] The schematic configuration of the imaging system according to the fourth embodiment is similar to the schematic configuration of the imaging system 100-3 according to the third embodiment shown in Fig. 10. In the fourth embodiment, a sensor device capable of wireless communication with each other is attached to each of the network camera 101 and the prompter device 120. In the fourth embodiment, the external device detection unit 323 of the network camera 101 detects the operation of the prompter device 120 based on detection result information from the sensor devices attached to the network camera 101 and the prompter device 120.

[0091] In the fourth embodiment, the same effects as those in the first embodiment can be obtained.

[0092] (Other embodiments) The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that realizes one or more functions. This program and a computer-readable storage medium storing the program are included in the present invention.

[0093] It should be noted that the above-described embodiments of the present invention are merely illustrative examples of the implementation of the present invention, and the technical scope of the present invention should not be construed as being limited by these. In other words, the present invention can be implemented in various forms without departing from its technical concept or main features.

[0094] The disclosure of this embodiment includes the following configuration, method, and program. [Configuration 1] An imaging device for capturing an image of a subject, lighting means for lighting the imaging device in accordance with the operating state of the imaging device; a control means for controlling the lighting means not to light up when an image of the subject is captured in a state in which the subject is displaying information visibly on an external device; An imaging device comprising: [Configuration 2] The control means When the operating state of the imaging device is not an abnormal state, the lighting means is controlled not to be turned on; When the operating state of the imaging device is the abnormal state, the lighting means is controlled to be turned on. 2. The imaging device according to claim 1, [Configuration 3] The control means determines that, when the external device is operating and the subject faces the imaging device, the external device is displaying information in a manner that is visible to the subject. 3. The imaging device according to configuration 1 or 2. [Configuration 4] a detection means for detecting that the external device is operating; a determination means for determining whether the subject faces the front of the imaging device; and The control means When the detection means detects that the external device is operating and the determination means determines that the subject is facing forward with respect to the imaging device, It is determined that the external device is operating and the subject faces the front of the imaging device. 4. The imaging device according to configuration 3. [Configuration 5] The detecting means detects that the external device is operating based on operation information transmitted from the external device via serial communication. 5. The imaging device according to configuration 4. [Configuration 6] The detecting means detects that the external device is operating based on operation information transmitted from the external device via network communication. 5. The imaging device according to configuration 4. [Configuration 7] The detection means detects whether the external device is operating based on detection result information from sensor devices attached to the imaging device and the external device. 5. The imaging device according to configuration 4. [Configuration 8] The detection means detects that the external device is operating based on acquired information acquired from a video captured by another imaging device that belongs to the same network as the imaging device. 5. The imaging device according to configuration 4. [Configuration 9] The control means further controls to display the lighting state of the lighting means on a display screen while the subject is being imaged. 9. The imaging device according to any one of configurations 1 to 8, wherein: [Configuration 10] Whether or not the imaging device and the external device are to be linked can be set on a display screen that the control means controls to display. 10. The imaging device according to any one of configurations 1 to 9. [Method 1] A control method for an imaging device that captures an image of a subject, comprising: a lighting step of lighting a lighting means in accordance with an operating state of the imaging device; a control step of controlling the lighting means not to light up when the subject is imaged in a state in which the subject is displaying information visibly on an external device; 10. A method for controlling an imaging device, comprising: [Program 1] A program for causing a computer to execute a control method for an imaging device that captures an image of a subject, a lighting step of lighting a lighting means in accordance with an operating state of the imaging device; a control step of controlling the lighting means not to light up when the subject is imaged in a state in which the subject is displaying information visibly on an external device; A program that causes a computer to execute the following. [Explanation of symbols]

[0095] 100: imaging system, 101, 102: network cameras, 110: client device, 120: prompter equipment, 130: network, 201: half mirror, 202: light source (monitor), 203: information terminal device, 301: imaging unit, 302: lens drive control unit, 303: LED unit, 311: A / D conversion unit, 312: camera signal processing unit, 313: LED control unit, 314: memory unit, 315: video analysis unit, 316: compression / expansion unit, 317: network communication processing unit, 318: serial communication processing unit, 319: bus, 320: CPU, 321: operation status management unit, 322: speaker recognition unit, 323: external device detection unit, 324: speaker face direction discrimination unit, H: subject

Claims

1. An imaging device for capturing an image of a subject, lighting means for lighting the imaging device in accordance with the operating state of the imaging device; a control means for controlling the lighting means not to light up when an image of the subject is captured in a state in which the subject is displaying information visibly on an external device; An imaging device comprising:

2. The control means When the operating state of the imaging device is not an abnormal state, the lighting means is controlled not to be turned on; When the operating state of the imaging device is the abnormal state, the lighting means is controlled to be turned on.

2. The imaging device according to claim 1.

3. The control means determines that, when the external device is operating and the subject faces the imaging device, the external device is displaying information in a manner that is visible to the subject.

2. The imaging device according to claim 1.

4. a detection means for detecting that the external device is operating; a determination means for determining whether the subject faces the front of the imaging device; and The control means determines that the external device is operating and the subject is facing the front of the imaging device when the detection means detects that the external device is operating and the determination means determines that the subject is facing the front of the imaging device.

4. The imaging device according to claim 3.

5. The detecting means detects that the external device is operating based on operation information transmitted from the external device via serial communication.

5. The imaging device according to claim 4.

6. The detecting means detects that the external device is operating based on operation information transmitted from the external device via network communication.

5. The imaging device according to claim 4.

7. The detection means detects whether the external device is operating based on detection result information from sensor devices attached to the imaging device and the external device.

5. The imaging device according to claim 4.

8. The detection means detects that the external device is operating based on acquired information acquired from a video captured by another imaging device that belongs to the same network as the imaging device.

5. The imaging device according to claim 4.

9. The control means further controls to display the lighting state of the lighting means on a display screen while the subject is being imaged.

2. The imaging device according to claim 1.

10. Whether or not the imaging device and the external device are to be linked can be set on a display screen that the control means controls to display.

2. The imaging device according to claim 1.

11. A control method for an imaging device that captures an image of a subject, comprising: a lighting step of lighting a lighting means in accordance with an operating state of the imaging device; a control step of controlling the lighting means not to light up when the subject is imaged in a state in which the subject is displaying information visibly on an external device; 10. A method for controlling an imaging device, comprising:

12. A program for causing a computer to execute a control method for an imaging device that captures an image of a subject, a lighting step of lighting a lighting means in accordance with an operating state of the imaging device; a control step of controlling the lighting means not to light up when the subject is imaged in a state in which the subject is displaying information visibly on an external device; A program that causes a computer to execute the following.

Images