Imaging apparatus, method for controlling imaging apparatus, and program

Abstract

To provide an imaging apparatus that can appropriately give a warning to a person to be warned.SOLUTION: An imaging apparatus has: a first imaging unit that can change an imaging direction; a second imaging unit that can change the imaging direction to a direction different from the imaging direction of the first imaging unit; a sound output unit that can change a direction to emit a sound on the basis of the imaging directions of the first imaging unit and the second imaging unit; and a control unit that, on the basis of information on a selection operation to select at least one of the first imaging unit and the second imaging unit, and information on a change of the imaging direction of the selected imaging unit, which are received from an external device, changes the direction in which the sound output unit emits the sound to the same direction as the imaging direction of the selected imaging unit.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an imaging device, a control method for an imaging device, and a program. [Background technology]

[0002] A network camera has been proposed that has a camera that can be independently driven for panning, tilting, and zooming, and also has a speaker that can be independently driven for panning and tilting. The speaker is installed in the network camera mainly to warn people. Furthermore, the speaker has directionality. Therefore, in a network camera equipped with the speaker, when the camera is moved in the direction of a person to be warned, unless the warning is given in a direction that takes into account the directionality of the speaker, there is a possibility that the sound will not reach the person to whom the warning is actually to be given sufficiently. Therefore, there is a possibility that an appropriate warning will not be given to the person to whom the warning is actually to be given.

[0003] Patent Document 1 proposes a technology related to an AV (Audio Visual) system. In the AV system in Patent Document 1, a camera-equipped speaker device is proposed that includes a speaker body and a camera that captures the direction in which the speaker body outputs sound in order to reproduce sound in a manner that is favorable to the listener. The camera is configured as one unit with the speaker body. The camera-equipped speaker device in Patent Document 1 also has a moving mechanism for changing the orientation of the speaker body. When the moving mechanism is driven, the speaker body and the camera that are configured as one unit move in conjunction with the driving direction of the moving mechanism, so that the orientations of the speaker body and the camera always change in the same direction. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2010-206451 A Summary of the Invention [Problem to be solved by the invention]

[0005] As described above, in the camera-equipped speaker device of Patent Document 1, the speaker body and the camera move simultaneously in conjunction with the driving direction of the driving device, and cannot be operated separately. Therefore, depending on the relationship between the position of the person and the directivity of the speaker, there is a possibility that the sound will not reach the person to be warned sufficiently, and an appropriate warning may not be given.

[0006] In view of the above circumstances, an object of the present invention is to provide an imaging device that is capable of appropriately issuing a warning to a person to whom the warning should be given. [Means for solving the problem]

[0007] In order to achieve the above-mentioned object, an imaging device according to one aspect of the present invention is characterized in having a first imaging unit capable of changing an imaging direction, a second imaging unit capable of changing the imaging direction to a direction different from the imaging direction of the first imaging unit, a sound output unit capable of changing a direction for outputting sound based on the imaging directions of the first imaging unit and the second imaging unit, and a control unit that changes the direction in which sound is output from the sound output unit to the same direction as the imaging direction of the selected imaging unit based on information received from an external device regarding a selection operation for selecting at least one of the first imaging unit or the second imaging unit and information regarding the change in the imaging direction of the selected imaging unit. Effect of the Invention

[0008] According to the present invention, it is possible to properly issue a warning to a person to whom the warning should be given. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of a network camera according to a first embodiment. [Diagram 2] FIG. 2 is a conceptual diagram of a network camera according to the first embodiment. [Diagram 3] 5 is a flowchart showing a process of the network camera according to the first embodiment. [Figure 4] 10 is a flowchart showing a process of the network camera according to the second embodiment. [Diagram 5] 10 is a flowchart showing a process of the network camera according to the second embodiment. [Figure 6] FIG. 11 is a diagram showing an example of the imaging angle of view of each of the first and second imaging units of the network camera according to the third embodiment, and an example of the midpoint of a line connecting the centers of the imaging angles of view. [Figure 7] 13 is a diagram showing an example of the imaging angle of view of each of the first and second imaging units of the network camera according to the fourth embodiment, and an example of the center point of an area where the imaging angles of view overlap each other. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, the embodiment for carrying out the present invention will be described in detail with reference to the attached drawings. The embodiment described below is one example of a means for realizing the present invention, and should be appropriately modified or changed depending on the configuration of the device to which the present invention is applied and various conditions, and the present invention is not limited to the following embodiment.

[0011] <Embodiment 1> 1 is an example of a block diagram of a network camera 100 according to the first embodiment. The network camera (imaging device) 100 in the first embodiment also functions as a warning device. The network camera 100 in the first embodiment has a first imaging section 108, a second imaging section 128, a video signal processing section 103, a network processing section 106, a network interface 107, a memory 111, a control section 112, and a sound output section 140. Furthermore, the network camera 100 has pan-tilt driving sections 113, 123, and 141, and lens driving sections 114 and 124. The network camera 100 is also connected to an information terminal (information processing device) such as a PC and a display device such as a display via a network.

[0012] The first imaging unit 108 is composed of an imaging lens 101 and an imaging element 102. The imaging lens 101 has an imaging optical system such as a zoom lens and a focus lens, and further has an aperture mechanism, and collects light from a subject on the light receiving surface of the imaging element 102. The zoom lens moves in the optical axis direction, and is capable of changing the shooting magnification. The focus lens moves in the optical axis direction, and is capable of adjusting the focus. The aperture mechanism is capable of adjusting the amount of light passing through the optical system. The optical zoom function using the zoom lens performs optical zoom drive by controlling a lens drive unit 114 by a control unit 112 described later. The focus lens and the aperture mechanism also have drive units (drive mechanisms) not shown, and their drive is controlled by the control unit 112 described later.

[0013] The second imaging unit 128 is composed of an imaging lens 121 and an imaging element 122. The imaging lens 121 has an imaging optical system such as a zoom lens and a focus lens, and further has an aperture mechanism, and collects light from a subject on the light receiving surface of the imaging element 102. The zoom lens moves in the optical axis direction, and is capable of changing the shooting magnification. The focus lens moves in the optical axis direction, and is capable of adjusting the focus. The aperture mechanism is capable of adjusting the amount of light passing through the optical system. The optical zoom function using the zoom lens performs optical zoom drive by controlling the lens drive unit 124 by the control unit 112 described later. The focus lens and the aperture mechanism also have drive units (drive mechanisms) not shown, and are respectively driven and controlled by the control unit 112 described later.

[0014] The imaging element 102 and the imaging element 122 have semiconductor elements such as a CCD (Charge Coupled Device) sensor or a CMOS (Complementary Metal Oxide Semiconductor) sensor. The imaging element 102 and the imaging element 122 convert a subject image formed by an imaging optical system into a video signal and output the video signal. The video signal processing unit 103 performs processes such as noise removal, gain adjustment, A / D conversion, color conversion processing, gamma correction, and pixel interpolation processing on the sensor signals output from the imaging element 102 and the imaging element 122, and outputs the video signals that have been subjected to these processes.

[0015] The first imaging unit 108 is held (supported) by a drive mechanism (first drive unit) (not shown) that allows it to rotate in a pan direction (first direction) that is a horizontal direction and a tilt direction (second direction) that is a vertical direction. Similarly, the second imaging unit 128 is held (supported) by a drive mechanism (second drive unit) (not shown) that allows it to rotate in a pan direction (first direction) and a tilt direction (second direction) like the first imaging unit 108.

[0016] The pan / tilt driving unit 113 drives a driving mechanism (first driving unit) that holds the first imaging unit 108 based on a control signal transmitted from the control unit 112. By driving the driving mechanism, the first imaging unit 108 rotates around an axis in the pan direction or an axis in the tilt direction. This makes it possible to change the imaging direction (shooting direction) of the first imaging unit 108 to any direction.

[0017] The pan / tilt driving unit 123 drives a driving mechanism (second driving unit) that holds the second imaging unit 128 based on a control signal transmitted from the control unit 112. By driving the driving mechanism, the second imaging unit 128 rotates around an axis in the pan direction or an axis in the tilt direction. This allows the imaging direction of the second imaging unit 128 to be changed to any direction.

[0018] The control unit 112 may control the imaging angles of view of the first imaging unit 108 and the second imaging unit 128 to be changed depending on the imaging unit, for example, the first imaging unit 108 for telephoto use and the second imaging unit 128 for wide angle use.

[0019] The network processing unit 106 compresses and encodes the video signal output from the video signal processing unit 103, and outputs the compressed and encoded video data. The network interface 107 distributes the video signal output from the network processing unit 106 to an external device (an information terminal such as a PC or a display device such as a display) via a network such as a LAN (Local Area Network).

[0020] The network processing unit 106 may be communicably connected to a network processing unit of a network camera other than the network camera 100 in this embodiment directly or via a network hub, etc. In this manner, the network cameras may be communicably connected to each other via a line.

[0021] The memory 111 is made up of a semiconductor memory, and functions as a processing buffer for the video signal processing unit 103 and a storage device that stores a control program (computer program) executed by the control unit 112 described later. The network camera 100 may also have a secondary storage device. The secondary storage device is a rewritable storage medium such as a hard disk or flash memory, and stores data received via the network processing unit 106, for example.

[0022] The control unit 112 is composed of at least one computer (for example, a microcomputer) including a CPU function. The control unit 112 executes a control program stored in the memory 111, and performs overall control of each component of the network camera 100. For example, by executing the control program, the control unit 112 controls the video signal processing unit 103, the driving of each driving unit capable of pan rotation and tilt rotation, and the optical zoom of each lens driving unit.

[0023] The sound output unit 140 is configured with a mechanism capable of outputting sound, such as a speaker. The sound output unit 140 outputs a predetermined sound under the control of the control unit 112, based on data acquired (communicated) via the network processing unit 106. In this embodiment, the sound output unit 140 mainly issues a warning to a person using a predetermined sound. The predetermined sound may be any sound or voice. For example, it may be a warning sound, a voice containing the contents of the warning, or a combination of these.

[0024] The sound output unit 140 is held by a drive mechanism (third drive mechanism) (not shown) that allows it to rotate in a pan direction (first direction) and a tilt direction (second direction). The pan / tilt drive unit 141 drives the drive mechanism (third drive mechanism) that holds the sound output unit 140 based on a control signal transmitted from the control unit 112. By driving the drive mechanism, the sound output unit 140 rotates around an axis in the pan direction or an axis in the tilt direction. This allows the imaging direction of the sound output unit 140 to be changed to any direction.

[0025] In this way, the first imaging unit 108, the second imaging unit 128, and the sound output unit 140 are each held rotatably in the pan direction and the tilt direction by an independent driving mechanism (pan-tilt mechanism). The control unit 112 transmits a control signal to each of these driving mechanisms, so that each of these driving mechanisms can independently perform pan rotation and tilt rotation.

[0026] 2 is a conceptual diagram of the configuration of the network camera 100 according to embodiment 1. As described above, in this embodiment, the first imaging section 108, the second imaging section 128, and the sound output section 140 are each disposed in the network camera 100. Furthermore, the first imaging section 108, the second imaging section 128, and the sound output section 140 are each held by an independent driving mechanism (pan-tilt mechanism).

[0027] In this embodiment, the first imaging unit 108 or the second imaging unit 128 can be selected in response to a user operation from an information terminal (information processing device) such as a PC via the network interface 107 and the network processing unit 106. Also, the imaging direction of the imaging unit selected by the user operation (hereinafter, the selected imaging unit) can be freely changed. Furthermore, when the imaging direction of the selected imaging unit is changed, the direction in which sound is output from the sound output unit 140 changes in conjunction with the selected imaging unit.

[0028] Specifically, when the control unit 112 changes the imaging direction of the selected imaging unit by a user operation, the control unit 112 rotates the sound output unit 140 in the same rotation direction as the rotation direction of the selected imaging unit in conjunction with the rotation of the selected imaging unit. At this time, the control unit 112 determines the rotation amount of the sound output unit 140 based on the rotation amount (movement amount) of the selected imaging unit, and changes the direction in which the sound output unit 140 outputs sound by rotating the sound output unit 140 by the determined rotation amount. More specifically, the control unit 112 determines the rotation amount of the sound output unit 140 from the pan / tilt amount of the selected imaging unit. As described above, when the control unit 112 changes the imaging direction of the selected imaging unit, the control unit 112 controls the pan / tilt driving unit 113 or the pan / tilt driving unit 123 to drive one of the driving mechanisms holding these imaging units. Furthermore, when the control unit 112 changes the direction in which the sound output unit 140 outputs sound, the control unit 112 controls the pan / tilt driving unit 141 to drive the driving mechanism holding the sound output unit 140.

[0029] As described above, the direction in which sound is output from the sound output unit 140 changes in conjunction with the change in the imaging direction of the selected imaging unit, but the direction of the sound output unit 140 may also be freely changed by user selection. In this way, for example, after the sound output unit 140 rotates in conjunction with the rotation of the selected imaging unit, the direction of the sound output unit 140 can be adjusted. This allows the direction in which the sound output unit 140 outputs sound to be more closely aligned with the target person.

[0030] As a user operation, for example, a user's input may be received using an operation screen (setting screen) displayed on a display device such as a display that is integrated with the PC or connected via a line. In this case, the user can select a UI, GUI, etc. displayed on the operation screen using an input device that is composed of a mouse, keyboard, touch panel, etc. that is integrated with the PC or connected via a line.

[0031] The UI or GUI displayed on the operation screen is, for example, buttons that allow the first imaging unit 108 and the second imaging unit 128 to be selected by a click operation, etc. In addition to the imaging units, a button that allows the sound output unit 140 to be selected, a cancel button that allows neither to be selected, etc. may be displayed.

[0032] Also, for example, the UI or GUI displayed on the operation screen includes four buttons indicating the direction of rotation of the imaging unit, i.e., a button indicating the left direction for pan rotation, a button indicating the right direction, and a button indicating the up direction and the down direction for tilt rotation. The user can arbitrarily change the imaging direction of the imaging unit by clicking or pressing and holding these buttons with an input device or the like. An example of the button in this case is, for example, an arrow, a triangle, or an icon indicating the direction of rotation.

[0033] Alternatively, a vertical scroll bar, a horizontal scroll bar, and scroll bar sliders corresponding to each scroll bar may be displayed on the operation screen. The selected imaging unit may be rotated by operating the scroll bar slider of the scroll bar displayed on the operation screen. In this case, for example, the selected imaging unit can be rotated to a pan rotation position corresponding to the drop position by dragging and dropping the scroll bar slider of the horizontal scroll bar left and right using an input device. Also, the selected imaging unit can be rotated to a tilt rotation position corresponding to the drop position by dragging and dropping the scroll bar slider of the vertical scroll bar up and down using an input device. Note that it is also possible to change the direction of the imaging unit by operating the input device without using the operation screen.

[0034] Similarly, the sound output unit 140 can also be rotated in any direction using a UI or GUI displayed on the operation screen. In this manner, in this embodiment, the directions of the first imaging unit 108, the second imaging unit 128, and the sound output unit 140 selected by the method described above can be freely changed. In this embodiment, the operation screen also functions as a setting means for selecting the first imaging unit 108, the second imaging unit 128, or the sound output unit 140 by a user operation and for changing (setting) the imaging direction of the selected imaging unit or the direction in which sound is output from the sound output unit 140.

[0035] Fig. 3 is a flowchart showing the processing in the network camera 100 according to the first embodiment. Note that each operation (process) shown in the flowchart in Fig. 3 is controlled by the control unit 112 of the network camera 100 executing a control program. Also, each process (step) is represented with an S at the beginning to omit the representation of the process (step).

[0036] First, in S301, the control unit 112 determines whether or not a command (information) regarding the user's selection operation of the imaging unit has been received (acquired) from an information terminal (information processing device) such as a PC via the network processing unit 106. If a command regarding the user's selection operation of the imaging unit has been received, the process proceeds to S301. On the other hand, if a command regarding the user's selection operation of the imaging unit has not been received, the process waits until a command regarding the user's selection operation is received.

[0037] Next, in S302, the control unit 112 determines whether or not the command related to the selection operation received from an information terminal (information processing device) such as a PC via the network processing unit 106 includes information related to the first imaging unit 108. In other words, the control unit 112 determines whether or not the user has selected the first imaging unit 108. If the received command related to the selection operation includes information related to the first imaging unit 108, the process proceeds to S303. On the other hand, if the received command related to the selection operation does not include information related to the first imaging unit 108, the process proceeds to S305.

[0038] Next, in S303, the control unit 112 determines whether or not a command (information) to change the imaging direction of the first imaging unit 108 has been received from an information terminal (information processing device) such as a PC via the network processing unit 106. If a command to change the imaging direction of the first imaging unit 108 has been received, the process proceeds to S304. On the other hand, if a command to change the imaging direction of the first imaging unit 108 has not been received, the process returns to S301 and the same process is repeated.

[0039] Next, in S304, the control unit 112 changes the direction in which sound is output from the sound output unit 140 based on a command to change the imaging direction of the first imaging unit 108 (according to the orientation of the first imaging unit) to the same direction as the imaging direction of the first imaging unit 108. Then, the process proceeds to S308.

[0040] Next, in S305, the control unit 112 determines whether or not the command related to the selection operation received via the network processing unit 106 includes information related to the second imaging unit 128. That is, the control unit 112 determines whether or not the user has selected the second imaging unit 128. If the received command related to the selection operation includes information related to the second imaging unit 128, the process proceeds to S306. On the other hand, if the received command related to the selection operation does not include information related to the second imaging unit 128, the process returns to S301 and the same process is repeated.

[0041] Next, in S306, the control unit 112 determines whether or not a command to change the imaging direction of the second imaging unit 128 has been received from an information terminal (information processing device) such as a PC via the network processing unit 106. If a command to change the imaging direction of the second imaging unit 128 has been received, the process proceeds to S307. On the other hand, if a command to change the imaging direction of the second imaging unit 128 has been received, the process returns to S301 and the same process is repeated.

[0042] Next, in S307, the control unit 112 changes the direction in which sound is output from the sound output unit 140 based on a command to change the imaging direction of the second imaging unit 128 (according to the orientation of the second imaging unit) to the same direction as the imaging direction of the second imaging unit 128. Then, the process proceeds to S308.

[0043] Next, in S308, the control unit 112 judges whether or not to end the process. As an example, it judges whether a command related to an operation to stop the shooting or warning process of the network camera 100 has been received, or whether an operation to turn off the power supply of the network camera 100 has been performed. Then, if it is judged that the process should be ended, the process in this flow is ended. On the other hand, if it is judged that the process should not be ended, the process returns to S301, and the same process is repeated.

[0044] Here, the network camera 100 may have a lighting unit (not shown) capable of emitting light instead of the sound output unit 140. By having the lighting unit, it is possible to illuminate the imaging direction with light. Furthermore, it is also possible to issue a warning using light by emitting light to a person who is the target of warning. In this case, the configuration of the lighting unit can be the same as that of the sound output unit 140 described above. That is, the lighting unit is held by a driving mechanism (third driving mechanism) (not shown) that can rotate in a pan direction (first direction) and a tilt direction (second direction). Then, the pan-tilt driving unit 141 drives the driving mechanism that holds the lighting unit based on a control signal transmitted from the control unit 112. By driving the driving mechanism, the lighting unit rotates around an axis in the pan direction or an axis in the tilt direction. This allows the direction in which the light from the lighting unit is irradiated to be changed to any direction.

[0045] Also, the sound output unit 140 may be provided with a lighting unit. In this case, a warning can be given using both sound and light by irradiating light to a person to be warned. Also, not only the sound output unit 140 but also the first imaging unit 108 and the second imaging unit 128 may be provided with a lighting unit. Also, a lighting unit may be provided independently at a location different from the sound output unit 140, the first imaging unit 108, and the second imaging unit 128. In this case, similarly to the above, the lighting unit is held by a driving mechanism (fourth driving mechanism) (not shown) that can rotate in a pan direction (first direction) and a tilt direction (second direction). Then, the pan-tilt driving unit 141 drives the driving mechanism that holds the lighting unit based on a control signal transmitted from the control unit 112. By driving the driving mechanism, the lighting unit rotates around an axis in the pan direction or an axis in the tilt direction. This allows the direction in which the light of the lighting unit is irradiated to be changed to any direction independent of the first imaging unit 108, the second imaging unit 128, and the sound output unit 140.

[0046] As described above, according to the network camera 100 of the first embodiment, the direction in which the sound is output from the sound output unit 140 changes in conjunction with a change in the imaging direction of the imaging unit selected by the user, making it possible for the user to appropriately issue a warning to a person to whom the user wishes to warn. Similarly, even in the case where a lighting unit is provided, the direction in which the light from the lighting unit is irradiated changes in conjunction with a change in the imaging device of the imaging unit selected by the user, making it possible to illuminate the imaging direction with light or illuminate a person to be warned.

[0047] <Embodiment 2> The network camera 100 according to the second embodiment will be described below. Note that the configuration of the network camera 100 in the second embodiment is similar to that of the network camera 100 in the first embodiment, and therefore the description will be omitted. That is, the same numbers as those in the first embodiment indicate the same components, and therefore the description will be omitted in the second embodiment.

[0048] In the network camera 100 of the second embodiment, both the first imaging section 108 and the second imaging section 128 can be selected by a user operation. When selecting both imaging sections, a UI or GUI such as a button that allows both the first imaging section 108 and the second imaging section 128 to be selected by a click operation or the like is displayed on an operation screen displayed on a display device such as a display in the second embodiment. Note that, as in the first embodiment, a UI or GUI such as a button that allows both the first imaging section 108 and the second imaging section 128 to be selected by a click operation or the like is also displayed.

[0049] Furthermore, in the second embodiment, when both imaging units are selected and the imaging direction of one of the imaging units is changed, the direction in which the sound is output from the sound output unit 140 is changed to the same direction as that of the imaging unit. Hereinafter, a description will be given with reference to Figs. 4 and 5.

[0050] Figures 4 and 5 are flowcharts of the network camera 100 having the configuration according to the second embodiment. Each operation (process) shown in the flowcharts of Figures 4 and 5 is controlled by the control unit 112 of the network camera 100 executing a control program. Each process (step) is represented by adding an S to the beginning of the process (step) to omit the representation of the process (step).

[0051] First, in S401, the control unit 112 determines whether or not a command related to a user's selection operation of the imaging unit has been received from an information terminal (information processing device) such as a PC via the network processing unit 106. If a command related to a user's selection operation of the imaging unit has been received, the process proceeds to S402. On the other hand, if a command related to a user's selection operation of the imaging unit has not been received, the process waits until a command related to a user's selection operation of the imaging unit is received.

[0052] Next, in S402, the control unit 112 determines whether or not the command related to the selection operation received from an information terminal (information processing device) such as a PC via the network processing unit 106 includes information related to the first imaging unit 108 and the second imaging unit 128. That is, the control unit 112 determines whether or not the user has selected both imaging units, that is, the first imaging unit 108 and the second imaging unit 128. If the received command related to the selection operation includes information related to the first imaging unit 108 and the second imaging unit 128, the process proceeds to S403. On the other hand, if the received command related to the selection operation does not include information related to the first imaging unit 108 and the second imaging unit 128, the process proceeds to S407.

[0053] Next, in S403, the control unit 112 determines whether or not a command to change the imaging direction of the first imaging unit 108 has been received from an information terminal (information processing device) such as a PC via the network processing unit 106. If a command to change the imaging direction of the first imaging unit 108 has been received via the network processing unit 106, the process proceeds to S404. On the other hand, if a command to change the imaging direction of the first imaging unit 108 has not been received via the network processing unit 106, the process proceeds to S405.

[0054] Next, in S404, the control unit 112 changes the direction in which sound is output from the sound output unit 140 based on the command to change the imaging direction of the first imaging unit 108 to the same direction as the imaging direction of the first imaging unit 108. Then, the process proceeds to S413.

[0055] Next, in S405, the control unit 112 determines whether or not the command related to the selection operation received via the network processing unit 106 includes information related to the second imaging unit 128. If the received command related to the selection operation includes information related to the second imaging unit 128, the process proceeds to S406. On the other hand, if the received command related to the selection operation does not include information related to the second imaging unit 128, the process returns to S401 and the same process is repeated.

[0056] Next, in S406, the control unit 112 changes the direction in which sound is output from the sound output unit 140 based on the command to change the imaging direction of the second imaging unit 128 to the same direction as the imaging direction of the second imaging unit 128. Then, the process proceeds to S413.

[0057] Next, in S407, the control unit 112 determines whether or not the command related to the selection operation received via the network processing unit 106 includes information related to the first imaging unit 108. That is, the control unit 112 determines whether or not the user has selected the first imaging unit 108. If the command related to the selection operation received via the network processing unit 106 includes information related to the first imaging unit 108, the process proceeds to S408. On the other hand, if the command related to the selection operation received via the network processing unit 106 does not include information related to the first imaging unit 108, the process proceeds to S410. Note that the process of S407 is similar to the process of S302 in the first embodiment, and therefore a detailed description thereof will be omitted.

[0058] Next, in S408, the control unit 112 determines whether or not a command to change the imaging direction of the first imaging unit 108 has been received via the network processing unit 106. When a command to change the imaging direction of the first imaging unit 108 has been received via the network processing unit 106, the process proceeds to S409. On the other hand, when a command to change the imaging direction of the first imaging unit 108 has not been received via the network processing unit 106, the process returns to S401 and the same process is repeated. Note that the process of S408 is similar to the process of S303 in the first embodiment, and therefore a detailed description thereof will be omitted.

[0059] Next, in S409, the control unit 112 changes the direction in which sound is output from the sound output unit 140 based on the command to change the imaging direction of the first imaging unit 108 to the same direction as the imaging direction of the first imaging unit 108. Then, the process proceeds to S413.

[0060] Next, in S410, the control unit 112 determines whether or not the command related to the selection operation received via the network processing unit 106 includes information related to the second imaging unit 128. That is, the control unit 112 determines whether or not the user has selected the second imaging unit 128. If the command related to the selection operation received via the network processing unit 106 includes information related to the second imaging unit 128, the process proceeds to S411. On the other hand, if it is not determined that the command related to the selection operation received via the network processing unit 106 includes information related to the second imaging unit 128, the process returns to S401 and the same process is repeated. Note that the process of S410 is the same as the process of S305 in the first embodiment, and therefore a detailed description thereof will be omitted.

[0061] Next, in S411, the control unit 112 determines whether or not a command to change the imaging direction of the second imaging unit 128 has been received via the network processing unit 106. If a command to change the imaging direction of the second imaging unit 128 has been received via the network processing unit 106, the process proceeds to S412. On the other hand, if a command to change the imaging direction of the second imaging unit 128 has not been received via the network processing unit 106, the process returns to S401 and the same process is repeated. Note that the process of S411 is similar to the process of S306 in the first embodiment, and therefore a detailed description thereof will be omitted.

[0062] Next, in S412, the control unit 112 changes the direction in which sound is output from the sound output unit 140 based on the command to change the imaging direction of the second imaging unit 128 to the same direction as the imaging direction of the second imaging unit 128. Then, the process proceeds to S413.

[0063] Next, in S413, the control unit 112 judges whether or not to end the process. If it is judged that the process is to be ended, the process in this flow is ended. On the other hand, if it is judged that the process is not to be ended, the process returns to S401 and the same process is repeated. Note that the process of S413 is the same as the process of S308 in the first embodiment, and therefore a detailed description thereof will be omitted.

[0064] Incidentally, the second embodiment may also have an illumination unit, similar to the first embodiment. Since the configuration of the illumination unit can be the same as the first embodiment, detailed description of the configuration of the illumination unit will be omitted.

[0065] As described above, according to the network camera 100 of the second embodiment, when the user selects both imaging units, the direction in which the sound output unit 140 outputs sound changes in conjunction with the change in the imaging direction of the imaging unit to which the user has changed the direction. This not only provides the same effect as the first embodiment, but also eliminates the need for the user to perform an operation to select an imaging unit for each process. The same applies when a lighting unit is included.

[0066] <Embodiment 3> The network camera 100 of the third embodiment will be described below. Note that the configuration of the network camera 100 in the third embodiment is similar to that of the network camera 100 in the first and second embodiments, and therefore the description will be omitted. That is, the same numbers as those in the first and second embodiments indicate the same components, and the description will be omitted here.

[0067] In the network camera 100 of the third embodiment, the user can select both the first imaging section 108 and the second imaging section 128. When selecting both imaging sections, a UI or GUI such as a button that allows both the first imaging section 108 and the second imaging section 128 to be selected by a click operation or the like is displayed on the operation screen displayed on a display device such as a display in the third embodiment. Note that, similarly to the first embodiment, a UI or GUI such as a button that allows both the first imaging section 108 and the second imaging section 128 to be selected by a click operation or the like is also displayed.

[0068] Furthermore, in the third embodiment, when both imaging units are selected, control unit 112 controls so that the center of the direction in which sound output unit 140 outputs sound is positioned halfway between the center of the imaging angle of view (imaging angle of view) of first imaging unit 108 and the center of the imaging angle of view of second imaging unit 128. Note that the center of the direction in which sound output unit 140 outputs sound refers to the position where sound output unit 140 emits sound or the center of the device when sound output unit 140 faces the direction of the person issuing the warning.

[0069] FIG. 6 is a diagram showing an example of the imaging angle of view of each of the first imaging section 108 and the second imaging section 128 of the network camera 100 according to the third embodiment, and an example of the midpoint of a line connecting the centers of the imaging angles of view.

[0070] In Fig. 6, 601 represents an example of the imaging angle of view of the first imaging unit 108. Also, 602 represents an example of the imaging angle of view of the second imaging unit 128. Also, 603 represents the center of the imaging angle of view of the first imaging unit 108, and 604 represents the center of the imaging angle of view of the second imaging unit 128. The dashed line in Fig. 6 represents a straight line connecting the center 603 of the imaging angle of view of the first imaging unit 108 and the center 604 of the imaging angle of view of the second imaging unit 128. 605 represents a point on the straight line that is equidistant from both center points.

[0071] Here, when both imaging units are selected by a user operation, the control unit 112 calculates a point 605 that is equidistant based on information about the imaging angle of view center 603 of the first imaging unit 108 and the imaging angle of view center 604 of the second imaging unit 128. Then, based on the calculated point 605, the control unit 112 drives the pan-tilt driving unit 141 so that the center of the direction in which sound is output from the sound output unit 140 is located at the position of the point 605, thereby changing the direction in which sound is output from the sound output unit 140. Note that the center of the direction in which sound is output from the sound output unit 140 does not need to be perfectly aligned with the point 605, and it is sufficient if there is a certain degree of error within a predetermined tolerance range.

[0072] Note that the control unit 112 calculates point 605 in the same manner as above even when both imaging units are selected and the imaging direction is changed by driving either imaging unit, thereby changing the imaging angle of view. Then, based on the calculated point 605, the pan / tilt driving unit 141 is driven so that the center of the direction in which sound is output from the sound output unit 140 is located at the position of point 605, thereby changing the direction in which sound is output from the sound output unit 140. Note that the same can be done even when the first imaging unit 108 or the second imaging unit 128 is selected instead of both imaging units, and when the imaging direction of the selected imaging unit is changed.

[0073] Note that the third embodiment may also have an illumination unit, similar to the first embodiment. The configuration of the illumination unit may be the same as the first embodiment, and therefore detailed description of the configuration of the illumination unit will be omitted.

[0074] As described above, according to the third embodiment, when both imaging units are selected by the user's operation, the control unit 112 calculates a point equidistant from the center of the imaging angle of view of the first imaging unit 108 and the center of the imaging angle of view of the second imaging unit 128. Then, the position of the sound output unit 140 can be changed so that the center of the direction in which the sound is output from the sound output unit 140 is located at the calculated point. Note that, even when the selected imaging unit is driven and the imaging angle of view is changed, the point is calculated based on the imaging angle of view of each imaging unit in the same way, and the center of the direction in which the sound is output from the sound output unit 140 can be aligned with the point in conjunction with the movement of the driven imaging unit. Then, in the third embodiment, it is possible to eliminate the need for the user to select an imaging unit every time, as in the second embodiment. The same applies to the case where a lighting unit is provided.

[0075] <Embodiment 4> The network camera 100 according to the fourth embodiment will be described below. Note that the configuration of the network camera 100 in the fourth embodiment is similar to that of the network camera 100 in the first to third embodiments, and therefore a description thereof will be omitted. That is, the same numbers as those in the first to third embodiments indicate the same components, and a description thereof will be omitted here.

[0076] In the network camera 100 of the fourth embodiment, the user can select both the first imaging section 108 and the second imaging section 128. When selecting both imaging sections, a UI or GUI such as a button that allows both the first imaging section 108 and the second imaging section 128 to be selected by a click operation or the like is displayed on the operation screen displayed on a display device such as a display in the fourth embodiment. Note that, similarly to the first embodiment, a UI or GUI such as a button that allows both the first imaging section 108 and the second imaging section 128 to be selected by a click operation or the like is also displayed.

[0077] Furthermore, in embodiment 4, when both imaging units are selected, the control unit 112 controls the center of the direction in which sound is output from the sound output unit 140 to be located at the center of the area where the imaging angle of view of the first imaging unit 108 and the imaging angle of view of the second imaging unit 128 overlap.

[0078] FIG. 7 is a diagram showing an example of the imaging angle of view of each of the first imaging unit 108 and the second imaging unit 128 of the network camera 100 of embodiment 4, and an example of the center point of the area where the imaging angles of view overlap.

[0079] In Fig. 7, 701 represents an example of the imaging angle of view of the first imaging unit 108. Also, 702 represents an example of the imaging angle of view of the second imaging unit 128. Also, 703 in Fig. 7 represents an overlapping area (overlapping area) between the imaging angle of view 701 of the first imaging unit 108 and the imaging angle of view 702 of the second imaging unit 128. The overlapping area 703 is an area indicated by diagonal lines in Fig. 7. Also, 705 represents the center point (center position) of the overlapping area 703.

[0080] Here, when both imaging units are selected by a user operation, the control unit 112 calculates a center point 705 of an overlapping area 703, which is an area where the two imaging angles of view overlap, based on an imaging angle of view 701 of the first imaging unit 108 and an imaging angle of view 702 of the second imaging unit 128. Then, based on the calculated point 705, the control unit 112 drives the pan-tilt driving unit 141 so that the center of the direction in which sound is output from the sound output unit 140 is located at the position of the point 705, thereby changing the direction in which sound is output from the sound output unit 140. Note that the center of the direction in which sound is output from the sound output unit 140 does not have to be perfectly aligned with the point 705, and it is sufficient if there is a certain degree of error within a predetermined tolerance range.

[0081] Note that the control unit 112 calculates point 705 in the overlapping area 703 in the same manner as above even when both imaging units are selected and the imaging direction is changed by driving either imaging unit, thereby changing the imaging angle of view. Then, based on the calculated point 705, the pan / tilt driving unit 141 is driven so that the center of the direction in which sound is output from the sound output unit 140 is located at the position of point 705, thereby changing the direction in which sound is output from the sound output unit 140. Note that the same can be done even when the first imaging unit 108 or the second imaging unit 128 is selected instead of both imaging units, and when the imaging direction of the selected imaging unit is changed.

[0082] Note that the fourth embodiment may also have an illumination unit, similar to the first embodiment. The configuration of the illumination unit may be the same as the first embodiment, and therefore detailed description of the configuration of the illumination unit will be omitted.

[0083] As described above, according to the fourth embodiment, when both imaging units are selected by the user's operation, the control unit 112 calculates the center point of the area where the imaging angle of view of the first imaging unit 108 and the imaging angle of view of the second imaging unit 128 overlap. Then, the position of the sound output unit 140 is changed so that the center of the direction in which the sound output unit 140 outputs sound is at the position of the calculated point. Note that, even when the selected imaging unit is driven and the imaging angle of view is changed, the control unit 112 calculates the point of the area where the imaging angles of view of each imaging unit overlap, and can adjust the center of the direction in which the sound output unit 140 outputs sound to the calculated point in conjunction with the movement of the driven imaging unit. Then, in the fourth embodiment, it is possible to eliminate the need for the user to select an imaging unit every time, as in the second embodiment. The same applies to the case where a lighting unit is provided.

[0084] Although the preferred embodiments of the present invention have been described above using examples and drawings, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of the gist of the present invention.

[0085] The disclosure of this embodiment includes the following configuration, method, and program.

[0086] (Configuration 1) A first imaging unit capable of changing an imaging direction; A second imaging unit capable of changing an imaging direction to a direction different from the imaging direction of the first imaging unit; a sound output unit capable of changing a direction in which sound is output based on an imaging direction of the first imaging unit and the second imaging unit; and a control unit that changes a direction in which sound is output from the sound output unit to the same direction as the imaging direction of the selected imaging unit, based on information regarding a selection operation for selecting at least one of the first imaging unit or the second imaging unit, which is received from an external device, and information regarding a change in the imaging direction of the selected imaging unit. 1. An imaging device comprising:

[0087] (Configuration 2) a first drive unit that rotates the first imaging unit around an axis in a first direction and a second direction; A second drive unit that rotates the second imaging unit around an axis in the first direction and an axis in the second direction. 2. The imaging device according to configuration 1,

[0088] (Configuration 3) 3. The imaging device according to configuration 1 or 2, further comprising a third drive unit that rotates the sound output unit around an axis in a first direction and a second direction.

[0089] (Configuration 4) 4. The imaging device according to any one of configurations 1 to 3, wherein the control unit determines an amount of movement of the sound output unit based on an amount of movement of the imaging unit whose imaging direction has been changed.

[0090] (Configuration 5) an illumination unit capable of changing a direction of irradiating light based on an imaging direction of the first imaging unit and the second imaging unit; The imaging device described in any one of configurations 1 to 4, characterized in that the control unit changes the direction in which light from the illumination unit is irradiated to the same direction as the imaging direction of the selected imaging unit based on selection information that selects at least one of the first imaging unit or the second imaging unit, and information regarding a change of the selected imaging unit.

[0091] (Configuration 6) The imaging device according to configuration 5, further comprising a fourth drive unit that rotates the illumination unit around an axis in a first direction and a second direction.

[0092] (Configuration 7) 7. The imaging device according to configuration 6, wherein the control unit determines the amount of movement of the illumination unit based on the amount of movement of the imaging unit whose imaging direction has been changed.

[0093] (Configuration 8) The imaging device described in any one of configurations 1 to 7, characterized in that when the information regarding the selection operation includes information indicating that the first imaging unit and the second imaging unit have been selected, the control unit changes the direction of the sound output unit to the same direction as the imaging direction of the imaging unit whose imaging direction has been changed, based on the imaging unit whose direction has been changed, out of the first imaging unit and the second imaging unit.

[0094] (Configuration 9) The imaging device described in any one of configurations 1 to 8, characterized in that when the information regarding the selection operation includes information indicating that the first imaging unit and the second imaging unit have been selected, the control unit calculates a point that is equidistant from the center of the angle of view of the first imaging unit and the center of the angle of view of the second imaging unit, and changes the direction of the sound output unit so that the center of the sound output unit is positioned at the calculated point.

[0095] (Configuration 10) The imaging device described in any one of configurations 1 to 8, characterized in that when the information regarding the selection operation includes information indicating that the first imaging unit and the second imaging unit have been selected, the control unit calculates a center position of an overlapping area of ​​an angle of view of the first imaging unit and an angle of view of the second imaging unit, and changes a direction of the sound output unit so that the center of the sound output unit is located at the calculated center position.

[0096] (Configuration 11) the first direction is a horizontal direction; 3. The imaging device according to configuration 2, wherein the second direction is a vertical direction.

[0097] (Configuration 12) A method for controlling an imaging device including a first imaging unit capable of changing an imaging direction, a second imaging unit capable of changing an imaging direction to a direction different from an imaging direction of the first imaging unit, and a sound output unit capable of changing a direction of outputting sound based on the imaging directions of the first imaging unit and the second imaging unit, a control step of changing a direction in which sound is output from the sound output unit to the same direction as the imaging direction of the selected imaging unit, based on information regarding a selection operation for selecting at least one of the first imaging unit or the second imaging unit and information regarding a change in the imaging direction of the selected imaging unit, the information being received from an external device. 23. A method for controlling an imaging apparatus comprising the steps of:

[0098] (Configuration 13) A program for causing a computer to execute a control method for an imaging device including a first imaging unit capable of changing an imaging direction, a second imaging unit capable of changing an imaging direction to a direction different from the imaging direction of the first imaging unit, and a sound output unit capable of changing a direction of outputting sound based on the imaging directions of the first imaging unit and the second imaging unit, the program causing the computer to: A program characterized by executing a control process of changing the direction in which sound is output from the sound output unit to the same direction as the imaging direction of the selected imaging unit, based on information regarding a selection operation for selecting at least one of the first imaging unit or the second imaging unit, received from an external device, and information regarding a change in the imaging direction of the selected imaging unit.

[0099] The present invention can be realized by a process of reading and executing a program that realizes one or more functions of the above-mentioned embodiments. The program is supplied to a system or device via a network or a storage medium, and is read and executed by one or more processors in the computer of the system or device. The present invention can also be realized by a circuit (e.g., an ASIC (Application Specific Integrated Circuit)) that realizes one or more functions. [Explanation of symbols]

[0100] 100 Network Cameras 101 Imaging lens 102 Image sensor 103 Video signal processing section 106 Network Processing Unit 107 Network Interface 108 First Imaging Unit 111 Memory 112 Control section 113 Pan-tilt drive unit 114 Lens drive unit 121 Imaging lens 122 Image sensor 123 Pan-tilt drive unit 124 Lens drive unit 128 Second Imaging Unit 140 Sound output section 141 Pan-tilt drive unit

Claims

1. A first imaging unit capable of changing an imaging direction; A second imaging unit capable of changing an imaging direction to a direction different from the imaging direction of the first imaging unit; a sound output unit capable of changing a direction in which sound is output based on an imaging direction of the first imaging unit and the second imaging unit; and a control unit that changes a direction in which sound is output from the sound output unit to the same direction as the imaging direction of the selected imaging unit, based on information regarding a selection operation for selecting at least one of the first imaging unit or the second imaging unit, which is received from an external device, and information regarding a change in the imaging direction of the selected imaging unit.

1. An imaging device comprising:

2. a first drive unit that rotates the first imaging unit around an axis in a first direction and a second direction; a second driving unit that rotates the second imaging unit around an axis in the first direction and an axis in the second direction; 2. The imaging device according to claim 1 .

3. 2. The imaging device according to claim 1, further comprising a third drive unit that rotates the sound output unit around an axis in a first direction and an axis in a second direction.

4. The imaging device according to claim 1 , wherein the control unit determines the amount of movement of the sound output unit based on the amount of movement of the imaging unit whose imaging direction has been changed.

5. an illumination unit capable of changing a direction of irradiating light based on an imaging direction of the first imaging unit and the second imaging unit; The imaging device according to claim 1, characterized in that the control unit changes the direction in which light from the illumination unit is irradiated to the same direction as the imaging direction of the selected imaging unit based on selection information that selects at least one of the first imaging unit or the second imaging unit, and information regarding a change of the selected imaging unit.

6. 6. The imaging device according to claim 5, further comprising a fourth drive unit that rotates the illumination unit around an axis in a first direction and an axis in a second direction.

7. The imaging device according to claim 6 , wherein the control unit determines the amount of movement of the illumination unit based on the amount of movement of the imaging unit whose imaging direction has been changed.

8. The imaging device according to claim 1, characterized in that when the information regarding the selection operation includes information indicating that the first imaging unit and the second imaging unit have been selected, the control unit changes the direction of the sound output unit to the same direction as the imaging direction of the imaging unit whose imaging direction has been changed, based on the imaging unit whose direction has been changed, out of the first imaging unit and the second imaging unit.

9. The imaging device according to claim 1, characterized in that, when the information regarding the selection operation includes information indicating that the first imaging unit and the second imaging unit have been selected, the control unit calculates a point that is equidistant from the center of the angle of view of the first imaging unit and the center of the angle of view of the second imaging unit, and changes the direction of the sound output unit so that the center of the sound output unit is positioned at the calculated point.

10. 2. The imaging device according to claim 1, wherein, when the information regarding the selection operation includes information indicating that the first imaging unit and the second imaging unit have been selected, the control unit calculates a center position of an overlapping area of ​​an angle of view of the first imaging unit and an angle of view of the second imaging unit, and changes a direction of the sound output unit so that a center of the sound output unit is located at the calculated center position.

11. the first direction is a horizontal direction; 3. The imaging device according to claim 2, wherein the second direction is a vertical direction.

12. A method for controlling an imaging device including a first imaging unit capable of changing an imaging direction, a second imaging unit capable of changing an imaging direction to a direction different from an imaging direction of the first imaging unit, and a sound output unit capable of changing a direction of outputting sound based on the imaging directions of the first imaging unit and the second imaging unit, a control step of changing a direction in which sound is output from the sound output unit to the same direction as the imaging direction of the selected imaging unit, based on information regarding a selection operation for selecting at least one of the first imaging unit or the second imaging unit and information regarding a change in the imaging direction of the selected imaging unit, the information being received from an external device; 23. A method for controlling an imaging apparatus comprising the steps of:

13. A program for causing a computer to execute a control method for an imaging device including a first imaging unit capable of changing an imaging direction, a second imaging unit capable of changing an imaging direction to a direction different from an imaging direction of the first imaging unit, and a sound output unit capable of changing a direction of outputting sound based on the imaging directions of the first imaging unit and the second imaging unit, the program causing the computer to: A program characterized by executing a control process of changing the direction in which sound is output from the sound output unit to the same direction as the imaging direction of the selected imaging unit, based on information regarding a selection operation for selecting at least one of the first imaging unit or the second imaging unit, received from an external device, and information regarding a change in the imaging direction of the selected imaging unit.

Images