Imaging device, control device, computer program, storage medium, and control method

Abstract

To solve the problem that, when a dead spot is generated among imaging units, it is difficult for a user to determine the presence or absence of the dead spot by looking at an image displayed on a client terminal device or the like.SOLUTION: An imaging apparatus includes: a first imaging unit and a second imaging unit, each of which is capable of changing a position; an acquisition unit that acquires information on a dead angle region that does not enter a photographic range of the first imaging unit and a photographic range of the second imaging unit, based on at least the positions of the first imaging unit and the second imaging unit; a transmission unit for transmitting a first image acquired from the first imaging unit, a second image acquired from the second imaging unit, and the information about the dead angle region to an external control device.SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] The present invention relates to an imaging device used for applications such as monitoring.

Background Art

[0002] Network cameras that can display captured images in real time on a client terminal device such as a PC have become widespread.

[0003] In recent years, there are also network cameras equipped with a plurality of cameras, and the acquired images from each camera can be displayed on the viewer of the above-described client terminal device. For example, Patent Document 1 proposes an imaging device capable of photographing a wide area using a plurality of cameras.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] In the imaging device described in Patent Document 1, when the user adjusts the direction of the optical axis and the field angle of each camera, dead angles are generated, but it is difficult for the user to determine the presence or absence and degree of dead angles by looking at the images displayed on the above-described viewer. Therefore, an object of the present invention is to provide an imaging device that enables easy determination of the presence or absence of dead angles and the like.

Means for Solving the Problems

[0006] To solve the above object, the imaging device according to the present invention is Adjacent first and second imaging units each capable of changing at least one of the position, shooting direction, or angle of view, An acquisition unit that acquires information indicating that there is an area that does not fall within either the shooting range of the first imaging unit or the shooting range of the second imaging unit based on at least one of the position, shooting direction, or angle of view of the first imaging unit and the second imaging unit; A transmission unit that, when the area exists, transmits display information for causing the display unit of the control device to display the existence of the area to the control device. The Obtained from the first imaging unit First image 、 The Obtained from the second imaging unit Second image and When are simultaneously displayed on the display unit of the control device, the information about the area based on the display information is changed according to the angle of view of the first imaging unit and the angle of view of the second imaging unit, and among the frame areas of the image display frame of the first image and the frame area of the image display frame of the second image, it is displayed on at least one of the frame areas on the adjacent side of the first image and the second image. The area of the area based on the display information is larger when the zoom ratio is high than when the zoom ratio is low. It is characterized by this.

Effect of the Invention

[0007] According to the present invention, an imaging device capable of easily determining the presence or absence of a blind spot or the like can be obtained.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Mode for Carrying Out the Invention

[0009] Hereinafter, with reference to the accompanying drawings, preferred embodiments of the present invention will be described using examples. In each figure, the same members or elements are denoted by the same reference numerals, and duplicate descriptions are omitted or simplified.

[0010] Also, in the examples, an example of applying to a network camera as the imaging device will be described. However, the imaging device includes electronic devices having an imaging function such as a digital still camera, a digital movie camera, a smartphone with a camera, a tablet computer with a camera, and an in-vehicle camera.

Examples

[0011] Hereinafter, with reference to FIG. 1, the configuration of the imaging device according to the first embodiment will be described. FIG. 1 is a block diagram showing the configuration of the imaging device according to the first embodiment. Reference numeral 111 denotes an imaging device typified by a network camera, which includes a first camera unit 101, a second camera unit 102, and an information processing unit 114. The information processing unit 114 includes a network processing unit 109 and a control unit 110.

[0012] The first camera unit 101 includes a first pan change unit 103, a first imaging unit 105, and a first detection unit 107. The second camera unit 102 includes a second pan change unit 104, a second imaging unit 106, and a second detection unit 108.

[0013] The first pan change unit 103 and the second pan change unit 104 each have a drive mechanism (not shown), and the user can electrically and independently adjust the pan direction (pan angle) of the optical axis for each imaging unit manually or by remote operation from the client terminal device 113. The first imaging unit and the second imaging unit are respectively arranged on a predetermined circumference of a plane parallel to the pan direction, and the angular positions on the circumference are respectively held so as to be changeable.

[0014] That is, when the angular positions of the first imaging unit and the second imaging unit along the circumferential direction are changed by a predetermined angle as viewed from the center of the circumference, the optical axis of the first imaging unit or the second imaging unit changes in the pan direction by the amount of the predetermined angle. The movement in the circumferential direction is also configured to be electrically performed for each imaging unit manually or by remote operation from the client terminal device 113.

[0015] Here, the first pan change unit 103 and the second pan change unit 104 are respectively configured to control the change of the pan angle of the first imaging unit itself and the second imaging unit itself, and the change of the pan angle accompanying the change of the angular position on the circumference. Note that the adjustment (change) of the tilt direction of the optical axis for each imaging unit may be configured to be possible, and this will be described in the third embodiment.

[0016] In addition, in the embodiment, the first imaging unit and the second imaging unit may be configured to be able to change their positions along a direction different from the pan direction. In this case, a table stores how the shooting ranges of the first imaging unit and the second imaging unit change according to the position, and the shooting ranges of the first imaging unit and the second imaging unit may be obtained based on the data stored in the table.

[0017] The first imaging unit 105 and the second imaging unit 106 include a zoom lens group, an actuator, a control circuit, an imaging element, and an image processing circuit (not shown). In addition, the imaging element converts an optical image formed on the light-receiving surface of the imaging element via an imaging optical system (not shown) into an electrical signal, amplifies the electrical signal to a predetermined signal level, and inputs a video signal to the image processing circuit.

[0018] In addition, the image processing circuit performs development processing on the video signal from the imaging element and generates image data in a desired format. The generated image data is distributed to a client terminal device 113 such as a computer terminal (desktop PC, tablet terminal, or smartphone) via a network processing unit 109 described later.

[0019] The first detection unit 107 and the second detection unit 108 are each constituted by an angle displacement acquisition means (not shown) such as a rotary encoder. Then, the first imaging unit 105 and the second imaging unit 106 acquire angle information (information related to the shooting range) in the horizontal direction (pan direction) of the optical axes and transmit the information to a control unit 110 described later. In addition, the angle of view of the first imaging unit 105 and the angle of view of the second imaging unit 106 are obtained by counting the number of pulse signals of the drive pulse signal applied to the drive mechanism from the initial zoom position.

[0020] Note that information regarding the moving position in the circumferential direction is also acquired and transmitted to the control unit 110. Here, the method for obtaining the direction of the optical axis is not limited to the one described above. For example, it may be a method in which a user inputs an arbitrary pan angle value (or the displacement amount and displacement direction from the current pan angle) from the client terminal device 113 described later.

[0021] That is, when controlling the circumferential movement position of each imaging unit, and the shooting ranges such as pan, tilt, and zoom from the client terminal device 113 via the control unit 110, the information on the above shooting ranges may be directly obtained from the client terminal device 113 side or the control unit 110.

[0022] Note that the shooting range information such as the zoom magnification (zoom amount) may be obtained from each imaging unit. The network processing unit 109 includes a network processing circuit, and can convert the image signal output from the video processing circuit into a format compliant with the communication protocol, and then distribute it to the network 112.

[0023] Also, a control signal for controlling the imaging device 111 can be transmitted and received in accordance with the communication protocol. In the above embodiment, the client terminal device 113 as the imaging control device and the imaging device 111 are separated via the network 112 as the communication path, and an example in which an imaging system is constructed by both of them is used for explanation.

[0024] However, they may be integrated. In that case, the integrated one can also be called an imaging device (imaging control device or imaging system). The control unit 110 incorporates a CPU as a computer and can control each component.

[0025] Also, the information processing unit 114 includes a memory 115, and various controls of the entire imaging device 111 are performed by the control unit 110 executing the program stored in the memory 115. Note that the memory 115 may also function as a work area during program execution in addition to the storage area for the program executed by the control unit 110.

[0026] Note that the client terminal device 113 also incorporates a CPU as a computer, and can control each component of the client terminal device and the imaging device based on a computer program stored in a memory (not shown). The control unit 110 can calculate the blind spot θZ of the first imaging unit 105 and the second imaging unit 106 from the zoom amounts of the first imaging unit 105 and the second imaging unit 106 respectively, and the detection results of the first detection unit 107 and the second detection unit 108.

[0027] When the blind spot θZ is greater than 0°, the control unit 110 issues a display instruction or the like regarding the blind spot display unit 306 to be described later to the GUI (Graphical User Interface) 301 to be described later. Note that when the blind spot θZ is 0° or less, the control unit 110 issues an instruction to pop up and display an icon, a comment, or the like for indicating to the user that there is no blind spot on the GUI 301 to be described later.

[0028] In addition, the control unit 110 sets a predetermined threshold value θα different from 0° described above for the calculated blind spot θZ, and may change the display or non-display regarding the presence or absence of the blind spot in the blind spot display unit 306 to be described later according to whether it is greater than θα. More specifically, for example, the control unit 110 sets a threshold value of θα = 180° for θZ. When the calculated blind spot θZ is 180° or more, the control unit 110 may issue a non-display instruction for the blind spot display unit 306 to be described later.

[0029] As described above, by switching the display or non-display of the blind spot display unit according to a preset threshold value, the user can display the blind spot display unit only when a blind spot of the size defined (set) by the user occurs. Note that the threshold value θα may be a value smaller than 0°. That is, if the shooting ranges of the first imaging unit 105 and the second imaging unit 106 do not overlap by a predetermined angle or more, it may be determined that a blind spot has occurred and that fact may be displayed.

[0030] This is because when the first imaging unit 105 and the second imaging unit 106 are installed at a predetermined distance apart, there may be a blind spot even when the threshold value θα is less than 0°. Further, the control unit 110 may be configured to change the display / non-display of the blind spot display unit 306 described later by the user's pan operation.

[0031] More specifically, when at least one of the pan direction of the optical axis of each imaging unit and the zoom angle received from the first detection unit 107 and the second detection unit 108 is changed, the control unit 110 recalculates the blind spot θZ. Here, when the newly calculated θZ is greater than the threshold value θα or greater than the value of the blind spot calculated last time, the control unit 110 issues a display instruction for the blind spot display unit 306 described later.

[0032] On the other hand, when θZ is less than the threshold value θα or the value of the blind spot θZ is less than the value calculated last time, the control unit 110 issues a non-display instruction for the blind spot display unit 306 described later. The information processing unit 114 stores in the memory 115 a table describing the blind spot θZ and the display correction data corresponding thereto. The display correction data is, for example, parameters such as the saturation and brightness of the color of the window display frame of the image according to the size of the blind spot area, or the area of a predetermined blind spot area.

[0033] Based on the calculated blind spot θZ, the control unit 110 can refer to the table, acquire the display correction data, and change the display state of the blind spot display unit 306. For example, the greater the calculated blind spot θZ, the control unit 110 changes the parameters of the blind spot display unit 306 so that, for example, the brightness of the window display frame of the image becomes lower.

[0034] Note that, as described above, the parameters to be changed are not limited to this, and may be other parameters such as saturation, transparency, hue, and area. For example, by changing the color of the blind spot display unit 306 from blue to red as the blind spot area increases, it is possible to make it more conspicuous and prompt attention when the blind spot is larger.

[0035] As described above, by changing the display state (brightness, chroma, transparency, hue, area, etc.) of, for example, a part of the image window display frame (dead angle display part 306) according to the size of the dead angle, the user can visually and intuitively determine the degree of the dead angle between each camera.

[0036] The network 112 is composed of a LAN cable, a network hub, etc., and can transmit and receive various signals by connecting the imaging device 111 and the client terminal device 113 through a network connection. Note that the imaging device 111 may, for example, support PoE (Power over Ethernet), and may be supplied with power from the network hub via the LAN cable.

[0037] As described above, 113 is a client terminal device such as a computer terminal, and has a display unit 116 for displaying the image signal distributed via the network 112. In addition, it is provided with an input unit 117 etc. that enables UI (User Interface) operations by the user.

[0038] Here, the input unit includes a pointing device represented by a mouse, and the user can use the input unit to operate the GUI 301 etc. displayed on the screen of the display unit.

[0039] In addition, the client terminal device 113 is in a state where it can communicate with the imaging device 111 via the network 112 using a communication unit (not shown). Also, the client terminal device 113 can receive the first image, the second image, information regarding the dead angle area, etc. transmitted from the network processing unit 109 of the imaging device.

[0040] Hereinafter, with reference to FIG. 2, a method for calculating the dead angle will be described. FIG. 2 is a diagram showing an example of the installation environment of the imaging device 111, and represents the directions of the optical axes of the first imaging unit 105 and the second imaging unit 106, the shooting angle of view, and the blind spot. It is assumed that 201 is a wall perpendicular to the ground. Also, it is assumed that the imaging device 111 is fixed to the wall 201. However, the imaging device 111 is not limited to being installed on the wall 201, and it may be installed on a horizontal ceiling or the like.

[0041] Point 202 is the rotation axis in the pan direction of the first pan change unit 103 and the second pan change unit 104, and represents a pan axis perpendicular to the paper surface. The first imaging unit 105 and the second imaging unit 106 can change the direction of the optical axis around point 202. In this embodiment, on the wall 201, the angle on the right side of the paper surface centered on point 202 is defined as 0°.

[0042] The first imaging unit 105 (not shown) has stopped rotating by θA around point 202. Here, θA is the sum of the pan angle due to the rotation of the first imaging unit 105 itself and the pan angle corresponding to the angular position of the first imaging unit 105 on the circumference. Also, the second imaging unit 106 has stopped rotating by a pan angle θB in the pan direction around point 202.

[0043] Here, θB is the sum of the pan angle due to the rotation of the second imaging unit 106 itself and the pan angle corresponding to the angular position of the second imaging unit 106 on the circumference. Also, it is assumed that the optical axis 203 of the first imaging unit 105 and the optical axis 204 of the second imaging unit 106 intersect the wall 201 at point 202, respectively. Actually, since the first imaging unit 105 and the second imaging unit 106 can move on the circumference, the optical axes of the two do not intersect at point 202, but here, for simplicity, it is assumed as above.

[0044] The first imaging unit 105 has a horizontal viewing angle θA’, and θA’ is represented by the interior angle between the half-line 205 and the half-line 206 with the point 202 as an end. Also, the second imaging unit 106 has a horizontal viewing angle θB’, and θB’ is represented by the interior angle between the half-line 207 and the half-line 208 with the point 202 as an end. θZ is the interior angle between the half-line 206 and the half-line 207, and represents the blind spot between the first imaging unit 105 and the second imaging unit 106.

[0045] Note that the blind spot θZ is calculated by the control unit 110 using the following formula (1). θZ = (θA - θA’ / 2) - (θB + θB’ / 2) = θA - θA’ / 2 - θB - θB’ / 2 ······ (1)

[0046] Hereinafter, with reference to FIG. 3, the GUI 301 of the display unit 116 of the client terminal device 113 in the first embodiment will be described. FIG. 3 is a diagram for explaining the GUI of the imaging device in the first embodiment. For this GUI, information regarding the blind spot area is generated in the imaging device 111 and transmitted to the client terminal device 113 as an external control device via the network 112.

[0047] At that time, in this embodiment, an image indicating the blind spot area based on the information regarding the blind spot area is transmitted separately from the captured image, and is synthesized and displayed with the captured image on the display unit, or is superimposed and displayed on the captured image. However, it is also possible to transmit from the imaging device 111 to the client terminal device 113 after superimposing an image indicating the blind spot area based on the information regarding the blind spot area on the captured image.

[0048] By doing so, the display unit 116 of the client terminal device only needs to simply display the received image and the information regarding the blind spot area as they are, so there is an advantage when the processing ability of the client terminal device is low. Conversely, when the processing ability of the client terminal device is sufficiently high, an image based on the information regarding the blind spot area may be created and synthesized and displayed with the received captured image, or the information regarding the blind spot area for the GUI may be calculated on the client terminal device side.

[0049] Regarding the same configuration as that in FIG. 1, the same reference numerals are given and the description thereof is omitted. FIG. 3(A) shows an example of the GUI 301 in a state where information regarding the blind spot area for displaying the blind spot display unit 306 is not transmitted from the control unit 110. The GUI 301 is composed of a first image display unit indicated by 302, a second image display unit indicated by 303, a pointer indicated by 304, and the like.

[0050] The first image display unit 302 is for displaying a first image generated by the video processing circuit of the first imaging unit 105, and the second image display unit 303 is for displaying a second image generated by the video processing circuit of the second imaging unit 106 within a window-shaped display frame. And each image display unit is displayed on the GUI 301 of the display unit 116. The pointer 304 indicates the position where the user gives an instruction in the GUI 301, and the user can change the position of the pointer 304 by operating the input unit 117.

[0051] FIG. 3(B) is a diagram showing a modification example of FIG. 3(A). The blind spot setting unit 305 is composed of a group of buttons for switching between display and non-display of the blind spot display unit 306 described later, and can be clicked by the pointer 304 via the input unit 117. The details when clicked will be described later.

[0052] Note that the blind spot setting unit 305 can display a display or non-display button based on the information regarding the blind spot area from the control unit 110. More specifically, when the calculated blind spot θZ is greater than 0°, for example, the control unit 110 outputs information for displaying the blind spot setting unit 305 on the GUI 301. On the other hand, when the blind spot θZ is 0° or less, for example, information is output such that the blind spot setting unit 305 is not displayed or is grayed out or semi-transparently displayed on the GUI 301.

[0053] In this case, for example, as information regarding the blind spot area, it may be information indicating that there is no blind spot, or it may be configured to indicate that there is no blind spot by virtue of the absence of information regarding the blind spot area. The blind spot display unit 306 also serves as at least a part of the frames of the first image display unit 302 and the second image display unit 303 (or overlaps at least a part of the frames), and is displayed on the GUI 301 based on the information regarding the blind spot area from the control unit 110.

[0054] The information regarding the blind spot area includes information regarding the size of the blind spot. And, for example, according to the size of the blind spot, information for changing so that the size (area) of the blind spot area becomes larger as the blind spot is larger, and information for changing the color so that the color of the blind spot area approaches the red system from the blue system or the like as the blind spot is larger is included. Note that the blind spot display unit 306 is not limited to the thick frame as illustrated, and may be in another display form such as a circle or a double-headed arrow.

[0055] Here, when the first image display unit 302 and the second image display unit 303 are adjacent on the GUI, the first image display unit 302 and the second image display unit 303 may be shifted left and right respectively so that a blind spot display unit 306 with a predetermined width can be displayed. More specifically, the first image display unit 302 is translated parallel to the left, the second image display unit 303 is translated parallel to the right, and an area for displaying such that the blind spot display unit 306 with a predetermined width is sandwiched between the first image display unit 302 and the second image display unit 303 is secured.

[0056] Particularly when the blind spot is large, for example, when this area is to be made larger, the relative shift amount between the first image display unit 302 and the second image display unit 303 is increased. Note that when the first image display unit 302 or the second image display unit 303 is set to, for example, the full-screen display mode, an area for displaying the blind spot display unit 306 on the GUI 301 cannot be secured.

[0057] In that case, the aspect ratio of each image display unit may be changed to secure a display area, or the blind spot display unit 306 may be superimposed and displayed on each image display unit. Alternatively, when switching to full-screen display or the like, instead of increasing the area of the blind spot display unit 306 according to the size of the blind spot, the size of the blind spot may be displayed by changing the brightness, color, etc. again. Note that the display and non-display of the blind spot display unit 306 can be switched by the user operating the input unit of the client terminal device to operate the blind spot setting unit 305.

[0058] That is, when the "display" button of the blind spot setting unit 305 is clicked, the GUI 301 of the client terminal device displays the blind spot display unit 306. On the other hand, when the "non-display" button of the blind spot setting unit 305 is clicked, the GUI 301 of the client terminal device makes the blind spot display unit 306 non-displayed.

[0059] Here, the switching between the display and non-display of the blind spot display unit 306 is not limited to the case where the button of the blind spot setting unit 305 is operated on the GUI of the client terminal device described above. For example, it may be performed when the user performs another operation with the pointer 304.

[0060] For example, when the user moves the pointer 304 near the left end of the first image display unit 302 and near the right end of the second image display unit 303, the blind spot display unit 306 may be displayed on the GUI 301.

[0061] And when the user moves the pointer 304 outside the above-mentioned places, the blind spot display unit 306 on the GUI 301 may be made non-displayed. Here, making the blind spot display unit 306 "non-displayed" includes not only the case of completely making it non-displayed, but also cases such as gray display or semi-transparent display, which are display forms different from the "display" state.

[0062] FIG. 3(C) is a modified example of the display in FIG. 3(B). The blind spot display section 306 is configured to display one separated blind spot display section 306 at the right end of the first image display section 302 and one at the left end of the second image display section 303 respectively. Here, whether to display only one blind spot display section 306 as in FIG. 3(B) or to display two separated blind spot display sections 306 on the left and right as in FIG. 3(C) may be configured to be changeable by the user operating the input section.

[0063] More specifically, for example, a change menu button (not shown) may be provided on the GUI 301, and the number of displayed blind spot display sections 306 may be changed to either 1 or 2 according to the operation of the change menu button using the pointer 304 by the user. Note that instead of displaying the blind spot display section 306 on both the left and right, the blind spot display section 306 may be displayed only at one of the ends.

[0064] Whether to display the blind spot display section 306 on the left or right may be made changeable by the user operating the GUI 301, or may be automatically determined by the control unit 110 based on parameters such as the viewing angle and optical axis direction of each imaging section. As described above, by configuring the display and non-display and the number of displayed blind spot display sections 306 to be changeable according to the operation of the GUI, the user can confirm the presence or absence of blind spots in the display form desired by the user when necessary.

[0065] FIG. 3(D) is a modified example of the display example in FIG. 3(A), and shows the GUI 301 when the display areas (window sizes) of the first image display section 302 and the second image display section 303 are different. As shown in FIG. 3(D), when the display areas of the respective image display sections are different, the blind spot display section 306 is displayed on both the left and right, and the display area is adjusted to match the upper and lower ends (the entire vertical sides of the frame) of each image.

[0066] As described above, in this embodiment, since the first image, the second image, and the information regarding the blind spot area are each displayed separately, the state of the blind spot and the like can be grasped promptly. Further, since the blind spot area is displayed so as to include at least a part of the frame area of the image display frame for displaying the images from the first imaging unit and the second imaging unit, the screen can be used effectively.

[0067] Next, FIG. 4 is a flowchart for explaining the control flow of the first embodiment. Referring to the flowchart of FIG. 4, the control flow of the first embodiment will be described. The processing of the flowchart in FIG. 4 is executed by the control unit 110 based on a computer program. In step S401, when the imaging device 111 is activated or the position in the pan direction of the first imaging unit 105 or the position in the pan direction of the second imaging unit 106 is changed, the control unit 110 starts this control flow. Then, the process proceeds to step S402.

[0068] In step S402, the first detection unit 107 acquires the direction θA of the optical axis of the first imaging unit 105, and the process proceeds to step S403. In step S403, the second detection unit 108 acquires the direction θB of the optical axis of the second imaging unit 106, and the process proceeds to step S404. In step S404, based on the zoom magnification of the first imaging unit 105, the horizontal angle of view θA' of the first imaging unit 105 is calculated (judged), and the process proceeds to step S405.

[0069] In step S405, based on the zoom magnification of the second imaging unit 106, the horizontal angle of view θB' of the second imaging unit 106 is calculated (judged), and the process proceeds to step S406. In step S406, the blind spot θZ is calculated based on the above-described formula (1), and the process proceeds to step S407.

[0070] In step S406, the control unit 110 functions as an acquisition unit that acquires information regarding a dead angle region that does not fall within the shooting ranges of the first imaging unit and the second imaging unit based on at least the (angle) positions of each of the first imaging unit and the second imaging unit. Note that the acquisition unit acquires information regarding the dead angle region based on the angular positions on the circumferences of the first imaging unit and the second imaging unit.

[0071] Further, the acquisition unit may acquire information regarding the dead angle region based on the rotation angle of view of the first imaging unit itself and the rotation angle of view of the second imaging unit itself. Further, the acquisition unit may acquire information regarding the presence or absence of the dead angle region as information regarding the dead angle region by comparing the size of the dead angle with a predetermined threshold value.

[0072] Determine whether θZ calculated in step S407 is greater than 0° and less than θα. If it is greater than 0° and less than θα, proceed to step S408. On the other hand, if it is 0° or less or θα or more, end the process. At this time, in order to display information indicating that there is no dead angle on the GUI 301, as information regarding the dead angle region, for example, information such as "no dead angle" is transmitted to the client terminal device 113 via the network processing unit 109.

[0073] In step S408, refer to the table, acquire display correction data based on the dead angle θZ, and proceed to step S409. In step S409, change the parameters of the dead angle display unit 306 and proceed to step S410. Note that when the imaging device 111 is activated, since the dead angle display unit 306 is not set, this step shall be skipped.

[0074] In step S410, an image based on information about a blind spot area (such as the size of the blind spot) of the blind spot setting unit 305 and the blind spot display unit 306 is displayed on the GUI 301. For this purpose, via the network processing unit, an image showing the blind spot area based on the information about the blind spot area is transmitted to the client terminal device as an external control device (external device), together with the first image and the second image, and the process ends.

[0075] As described above, in this embodiment, when there is a blind spot, information such as the existence of the blind spot and detailed information about the blind spot area are transmitted (notified) to the client terminal device as an external imaging control device. Therefore, the user can quickly determine the presence or absence of a blind spot between each camera and the position of the blind spot.

Embodiment

[0076] FIG. 5 is a block diagram showing the configuration of the imaging device according to Embodiment 2. Referring to FIG. 5, the configuration of the imaging device according to Embodiment 2 will be described. Embodiment 2 relates to the display of a blind spot when the zoom ratio is different for each imaging unit. Regarding the same configuration as in Embodiment 1, the same reference numerals are given and the description thereof is omitted.

[0077] In this embodiment, it is assumed that the zoom ratio (zoom amount, field angle) information is obtained from the first detection unit 107 and the second detection unit 108, respectively, but it may also be obtained from each imaging unit, the control unit 110, or the client terminal device.

[0078] The first zoom change unit 501 and the second zoom change unit 502 are composed of an actuator and a control circuit (not shown), and can independently adjust the zoom ratio for each imaging unit according to a control signal from the control unit 110. In this embodiment, the control unit 110 stores a table in the memory 115 that describes the correction value Q and the area information of the blind spot display unit 306 corresponding thereto. Details will be described later.

[0079] Hereinafter, with reference to FIG. 6, the GUI of the imaging device according to the second embodiment will be described. FIG. 6 is a diagram for explaining the GUI of the imaging control device according to the second embodiment. Here, regarding the same configuration as in the first embodiment, the same reference numerals are given and the description thereof is omitted. FIG. 6(A) is a diagram showing a modified example of the display example in FIG. 3(B), and shows the GUI 301 when the zoom magnification of the first imaging unit 105 is set to be higher by the first zoom change unit 501.

[0080] When the zoom magnification in each imaging unit is changed, the blind spot display unit 306 changes its area based on the control signal from the control unit 110. More specifically, when the zoom magnification of each imaging unit is changed, the control unit 110 calculates the correction value Q of the blind spot display unit 306 according to the changed zoom magnification, and changes the area of the blind spot display unit 306 based on that value. The correction value Q will be described later.

[0081] FIG. 6(B) is a diagram showing a modified example of the display example in FIG. 3(C), and shows the GUI 301 when the zoom magnification of the first imaging unit 105 is set to be higher, similar to FIG. 6(A). The blind spot display unit 306 is configured to display one blind spot display unit 306 with different sizes at the right end of the first image display unit 302 and the left end of the second image display unit 303, respectively.

[0082] Similar to FIG. 6(A), in the case of FIG. 6(B), the correction value Q is calculated according to the zoom magnification, and the area of the blind spot display unit 306 is changed based on that value. Hereinafter, the calculation of the correction value Q will be described.

[0083] First, the control unit 110 calculates (judges) the vertical viewing angle θA” from the acquired zoom magnification (viewing angle) of the first imaging unit 105 and the vertical viewing angle θB” from the zoom magnification (viewing angle) of the second imaging unit 106. Based on the calculated vertical viewing angle, the control unit 110 calculates the correction value Q (vertical viewing angle difference) from the following formula (2). Q = θA” - θB” ··· (2)

[0084] The control unit 110 refers to the table based on the calculated correction value Q, acquires the area information corresponding to the correction value Q, and changes the area of the blind spot display unit 306. More specifically, when Q < 0, as shown in the figure of FIG. 6(A), the control unit 110 changes the area so that the right side of the blind spot display unit 306 becomes a trapezoid shorter than the left side. On the other hand, when Q > 0, the control unit 110 changes the area so that the left side of the blind spot display unit 306 becomes a trapezoid shorter than the right side.

[0085] Here, the area ratio between the left side and the right side of the blind spot display unit 306 may be determined based on the above-described correction value Q. When Q = 0, the above-described change in area is not performed. Also, as shown in FIG. 6(B), even when the blind spot display unit 306 is divided into two on the left and right, the area may be similarly changed according to the value of Q.

[0086] More specifically, when Q < 0, as shown in the figure of FIG. 6(B), the control unit 110 changes the area so that the right blind spot display unit 306 becomes shorter than the left blind spot display unit 306. On the other hand, when Q > 0, the control unit 110 changes the area so that the left blind spot display unit 306 becomes shorter than the right blind spot display unit 306. Here, the area ratio between the left and right blind spot display units 306 may be determined based on the above-described correction value Q, similar to the case of FIG. 6(A).

[0087] FIG. 6(C) is a diagram showing a modified example of the display example of FIG. 3(D), and similar to FIG. 6(A), shows the GUI 301 when the zoom magnification of the first imaging unit 105 is set to be higher. Here, when the display areas of the respective image display units are different, a plurality of blind spot display units 306 are displayed, and the display areas of the respective blind spot display units 306 are adjusted respectively.

[0088] More specifically, for example, as shown in FIG. 6(C), when the area of the first image display unit 302 is larger than the area of the second image display unit 303, the left blind spot display unit 306 adjusts its area to match the right side of the first image display unit 302. On the other hand, the right blind spot display unit 306 determines its area based on the area ratio determined by the correction value Q and the ratio of the vertical lengths of the first image display unit 302 and the second image display unit 303.

[0089] For example, when the ratio of the vertical lengths of the first image display unit 302 and the second image display unit 303 is 2:1, the area (or vertical length) of the right blind spot display unit 306 determined in FIG. 6(B) is changed to half the area (or vertical length). As described above, in this embodiment, the information regarding the blind spot area generated by the control unit 110 includes information for changing the display state of the blind spot area according to the difference in the shooting angles of view of the first imaging unit and the second imaging unit etc.

[0090] Next, referring to FIG. 7, the control flow of the second embodiment will be described. FIG. 7 is a flowchart for explaining the control flow of the second embodiment. The processing of the flowchart in FIG. 7 is performed by the control unit 110 executing based on a computer program. Regarding steps S701 to S706, since they are the same as steps S401 to S406 in FIG. 4, the description is omitted. In step S707, it is determined whether θZ is greater than 0°. If it is greater than 0°, the process proceeds to step S708.

[0091] In step S708, based on the zoom magnification of the first imaging unit 105 acquired from the first detection unit 107, the vertical angle of view θA’’ is calculated and the process proceeds to step S709. In step S709, based on the zoom magnification of the second imaging unit 106 acquired from the second detection unit 108, the vertical angle of view θB’’ is calculated and the process proceeds to step S710. In step S710, the correction value Q is calculated using the method for determining the correction value Q according to the above-described formula (2), and the process proceeds to step S711.

[0092] Determine whether Q calculated in step S711 is 0°. If it is 0°, proceed to step S714. On the other hand, if it is other than 0°, proceed to step S712. In step S712, refer to the table, obtain the area information of the blind spot display unit 306 according to the magnitude of the correction value Q, and proceed to step S713.

[0093] In step S713, change the area of the blind spot display unit 306 and proceed to step S714. Since step S714 is the same as step S410 in FIG. 7, the description is omitted.

[0094] Note that after the process ends, if the pan or zoom magnification of any imaging unit is changed, the process from step S701 is repeated again. From the above, when the user changes the zoom magnification of each imaging unit, it becomes possible to quickly grasp the position where the blind spot occurs.

Example

[0095] Hereinafter, with reference to FIG. 8, the configuration of the imaging device according to the third embodiment will be described. FIG. 8 is a block diagram showing the configuration of the imaging device according to the third embodiment. The third embodiment relates to a method for displaying a blind spot when the tilt direction is different for each imaging unit. Regarding the same configuration as in the first embodiment, the same reference numerals are given and the description thereof is omitted.

[0096] The first tilt change unit 801 and the second tilt change unit 802 are composed of a drive mechanism (not shown), and the user can independently adjust the tilt direction of the optical axis for each imaging unit electrically manually or by remote operation from the client terminal device 113 described later. Here, it is assumed that the first detection unit 107 and the second detection unit 108 can obtain the tilt angle in the vertical direction of the optical axis of each imaging unit and transmit it to the control unit 110 described later.

[0097] In this embodiment, the control unit 110 stores in the memory a table that describes the correction value R described later and the area information of the dead angle display unit 306 corresponding thereto. Hereinafter, with reference to FIG. 9, the GUI of the imaging device according to the third embodiment will be described. FIG. 9 is a diagram for explaining the GUI of the imaging control device according to the third embodiment. Here, regarding the same configuration as that of the first embodiment, the same reference numerals are given and the description thereof is omitted.

[0098] FIG. 9(A) is a diagram showing a modified example of the display example of FIG. 3(B), and shows the GUI 301 when the tilt direction of the optical axis of the first imaging unit 105 is changed by the first tilt change unit 801.

[0099] When the tilt direction of the optical axis of each imaging unit is changed, the dead angle display unit 306 changes its area based on the information regarding the dead angle area from the control unit 110. That is, when the tilt direction of the optical axis of each imaging unit is changed, the control unit 110 calculates the correction value R of the dead angle display unit 306 according to the changed tilt direction, and changes the area based on that value. The correction value R will be described later.

[0100] FIG. 9(B) is a diagram showing a modified example of the display example of FIG. 3(C), and shows the GUI 301 when the tilt direction of the first imaging unit 105 is changed, similar to FIG. 9(A). The dead angle display unit 306 is configured to display one dead angle display unit 306 each having a different position at the right end of the first image display unit 302 and the left end of the second image display unit 303.

[0101] Also in the case of FIG. 9(B), similar to FIG. 3(B), the correction value R is calculated according to the tilt direction, and the area is changed based on that value. Hereinafter, the calculation of the correction value R will be described. First, the control unit 110 acquires the tilt angle θA''' in the vertical direction of the optical axis of the first imaging unit 105 from the first detection unit 107, and the tilt angle θB''' in the vertical direction of the optical axis of the second imaging unit 106 from the second detection unit 108.

[0102] Based on the obtained tilt angle, the control unit 110 calculates the correction value R from the following formula (3). R = θA''' - θB''' ··· (3) Based on the calculated correction value R, the control unit 110 refers to the table pre-stored in the memory 115, acquires the area information corresponding to the correction value R, and sends the information regarding the dead angle area to the client terminal device to change the area of the dead angle display unit 306.

[0103] That is, when R > 0, as shown in FIG. 6(A), the control unit 110 reduces the left and right sides of the dead angle display unit 306 and sends the information for changing them so that the left side aligns with the lower end of the first image display unit 302 and the right side aligns with the upper end of the second image display unit 303. On the other hand, when R < 0, the control unit 110 reduces the left and right sides of the dead angle display unit 306 and sends the information for changing them so that the left side aligns with the upper end of the first image display unit 302 and the right side aligns with the lower end of the second image display unit 303.

[0104] Note that when R = 0, the area is not changed. Also, as shown in FIG. 9(B), even when the dead angle display unit 306 is divided into two on the left and right, the area may be changed similarly according to the value of R. When R > 0, as shown in the figure of FIG. 9(B), the left and right dead angle display units 306 are reduced, the left dead angle display unit 306 is aligned downward so that its lower side and lower end align with the lower side of the first image display unit 302, and the right dead angle display unit 306 is aligned upward so that its upper side and upper end align with the upper side of the second image display unit 303.

[0105] When R < 0, the left and right dead angle display units 306 are reduced, the left dead angle display unit 306 is aligned downward so that its upper side and upper end align with the upper side of the first image display unit 302, and the right dead angle display unit 306 is aligned downward so that its lower side and lower end align with the lower side of the second image display unit 303. Note that when R = 0, the area is not changed.

[0106] Here, as shown in the diagram of FIG. 9(B), after changing the areas of the two blind spot display units 306 and aligning them with the upper or lower side of each image, the method described above is used. However, it is not limited to this. For example, a method of changing only the display position without changing the area may also be used. More specifically, when R > 0, the left blind spot display unit 306 is slid downward, and the right blind spot display unit 306 is slid upward. On the other hand, when R < 0, the left blind spot display unit 306 is slid upward, and the right blind spot display unit 306 is slid downward.

[0107] Note that when R = 0, the above change in the display position is not performed. In addition, the control unit 110 may provide a predetermined threshold value θβ different from the aforementioned 0° to the calculated R, and change the display / non-display of the blind spot display unit 306 according to the θβ. More specifically, for example, the control unit 110 is provided with a threshold value of θβ ± 45°. When the calculated R is 45° or more or -45° or less, the control unit 110 may issue a non-display instruction for the blind spot display unit 306.

[0108] FIG. 9(C) is a diagram showing a modification example of the display example in FIG. 3(D), and similar to FIG. 9(A), it shows the GUI 301 when the tilt direction of the first imaging unit 105 is changed. Here, when the display areas of the respective image display units are different, a plurality of blind spot display units 306 are displayed, and the display areas of the respective blind spot display units 306 are adjusted.

[0109] That is, when the area of the first image display unit is larger than the area of the second image display unit as shown in FIG. 9(C), the area of the right blind spot display unit 306 is determined from the area determined by the correction value R and the ratio of the vertical lengths of the first image display unit 302 and the second image display unit 303.

[0110] For example, when the ratio of the vertical lengths of the first image display unit 302 and the second image display unit 303 is 2:1, the area (or vertical length) of the right blind spot display unit 306 determined in FIG. 9(B) is changed to half the area (or vertical length). As described above, in this embodiment, the information regarding the blind spot area from the control unit 110 includes information for changing the display state of the blind spot area according to the difference between the tilt angle of the optical axis of the first imaging unit and the tilt angle of the optical axis of the second imaging unit.

[0111] Hereinafter, with reference to FIG. 10, the control flow of Embodiment 3 will be described. FIG. 10 is a flowchart for explaining the control flow of Embodiment 3. Note that the processing of the flowchart in FIG. 10 is executed by the control unit 110 based on a computer program. Regarding steps S1001 to S1007, since they are the same as steps S701 to S707 in FIG. 7, the description thereof will be omitted.

[0112] In step S1008, the tilt angle θA''' in the vertical direction of the optical axis of the first imaging unit 105 is acquired, and the process proceeds to step S1009. In step S1009, the tilt angle θB''' in the vertical direction of the optical axis of the second imaging unit 106 is acquired, and the process proceeds to step S1010. In step S1010, the correction value R is calculated using the method for determining the correction value R based on the above-described formula (3), and the process proceeds to step S1011.

[0113] It is determined whether the R calculated in step S1011 is 0°. If it is 0°, the process proceeds to step S1017. On the other hand, if it is other than 0°, the process proceeds to step S1012. In step S1012, the table is referred to, and the area information of the blind spot display unit 306 based on the correction value R is acquired, and the process proceeds to step S1013. In step S1013, the area of the blind spot display unit 306 is changed, and the process proceeds to step S1014.

[0114] It is determined whether Q calculated in step S1014 is greater than 0°. If it is greater than 0°, the process proceeds to step S1015. On the other hand, if it is less than 0°, the process proceeds to step S1016. In step S1015, change the display position of the left blind spot display section 306 to be aligned downward and the display position of the right blind spot display section 306 to be aligned upward, and proceed to step S1017 for processing.

[0115] In step S1016, change the display position of the left blind spot display section 306 to be aligned upward and the display position of the right blind spot display section 306 to be aligned downward, and proceed to step S1017 for processing. Since step S1017 is the same as step S714 in FIG. 7, the description thereof is omitted.

[0116] Note that after the processing is completed, if the pan direction or tilt direction of the optical axis of any imaging section is changed, the processing from step S1001 is repeated again. From the above, when the user changes the tilt direction (tilt angle) of the optical axis of each imaging section, it becomes possible to visually grasp at which position and to what extent blind spots are generated.

Embodiment

[0117] Hereinafter, with reference to FIG. 11, the configuration of the imaging device 111 according to Embodiment 4 will be described. FIG. 11 is a block diagram showing the configuration of the imaging device according to Embodiment 4. Embodiment 4 relates to a display example when there are three or more imaging sections. The same components as those in FIG. 1 are denoted by the same reference numerals, and the description thereof is omitted. 1101 indicates a third camera section, which has a third pan change section 1102, a third imaging section 1103, and a third detection section 1104.

[0118] The third pan change section 1102 is constituted by a drive mechanism (not shown). Then, the user can electrically change the pan direction (shooting range) of the optical axis of the third imaging section 1103 independently of the first imaging section and the second imaging section manually or by a remote operation from a client terminal device 113 described later. Since the third imaging section 1103 has the same configuration as the first imaging section 105, the description thereof is omitted.

[0119] The third detection unit 1104 is composed of an angle displacement acquisition means (not shown) typified by a rotary encoder, acquires the horizontal angle of the optical axis of the third imaging unit 1103, and transmits it to the control unit 110. Note that the zoom magnification (zoom amount) information and the like are directly acquired from each imaging unit, the control unit 110, or the client terminal device.

[0120] The control unit 110 can calculate the dead angle θZ between the first imaging unit and the second imaging unit, the dead angle θZ' between the second imaging unit and the third imaging unit, and the dead angle θZ'' between the third imaging unit and the first imaging unit from the zoom amounts of the three imaging units and the detection results of the three detection units. That is, the control unit 110 as a calculation unit can calculate a dead angle area that does not fall within the shooting range from the first imaging unit to the third imaging unit. The calculation methods of the dead angles θZ' and θZ'' will be described later.

[0121] When the dead angle θZ' is greater than 0°, the control unit 110 issues a display instruction for a dead angle display unit 1302 (to be described later) to the GUI 301. Also, when the dead angle θZ'' is greater than 0°, the control unit 110 issues a display instruction for a dead angle display unit 1303 (to be described later) to the GUI 301.

[0122] When the dead angle θZ' is 0° or less, the control unit 110 issues a display instruction such as a pop-up icon or a comment to the GUI 301 to indicate that there is no dead angle between the second imaging unit 106 and the third imaging unit 1103. Also, when the dead angle θZ'' is 0° or less, the control unit 110 issues a display instruction such as a pop-up icon or a comment to the GUI 301 to indicate that there is no dead angle between the third imaging unit 1103 and the first imaging unit 105.

[0123] Here, similar to θZ, the control unit 110 sets a predetermined threshold value θγ different from 0° described above for the calculated θZ', and may change the display / non-display of the dead angle display unit 1302 (to be described later) according to whether it is greater than θγ. Similarly, a threshold value θη is set for θZ'', and the display / non-display of the dead angle display unit 1303 (to be described later) may be changed according to whether it is greater than θη.

[0124] More specifically, for example, the control unit 110 sets threshold values of θγ = 90° and θη = 90°. When the calculated θZ’ is 90° or more, the control unit 110 issues a non-display instruction for a blind spot display unit 1302 described later. Also, when the calculated θZ’’ is 90° or more, the control unit 110 issues a non-display instruction for a blind spot display unit 1303 described later.

[0125] As described above, by switching the display and non-display of the blind spot display unit according to the threshold values set for each of the plurality of cameras, the user can display the blind spot display unit only when a blind spot defined for each camera occurs.

[0126] Further, the control unit 110 may compare the sizes of the blind spots of θZ, θZ’, and θZ’’, and change the display and non-display of three blind spot display units including the blind spot display unit 1302 and the blind spot display unit 1303 described later according to the comparison result.

[0127] More specifically, for example, as shown in FIG. 12, when θZ < θZ’, θZ’ > θZ’’, and θZ’’ > θZ, the control unit 110 displays the blind spot display unit 306 and the blind spot display unit 1303 described later, and makes the blind spot display unit 1302 described later non-display. Further, the control unit 110 may change the arrangement of three image display units including a third image display unit 1301 described later according to the comparison result of the size of each blind spot. Details will be described later.

[0128] Here, similar to the blind spot θZ, the control unit 110 stores a table in the memory that describes display correction data corresponding to θZ’ and θZ’’, and based on θZ’ and θZ’’, refers to the table to change the display of each blind spot display unit. Hereinafter, with reference to FIG. 12, a method for calculating the blind spot θZ’ and the blind spot θZ’’ will be described.

[0129] FIG. 12 is a diagram showing an example of the installation environment of the imaging device 111 in Example 4, and shows the directions of the optical axes of the first imaging unit 105, the second imaging unit 106, and the third imaging unit 1103, the photographing angle of view, and the blind spots. For the same configuration as in FIG. 2, the same reference numerals are given and the description thereof is omitted. A third imaging unit 1103 (not shown) can change the pan direction of the optical axis about point 202. The third imaging unit 1103 is stopped in a state of being rotated by a pan angle θC about point 202.

[0130] Also, the optical axis 1201 of the third imaging unit 1103 intersects the wall 201 at point 202. The third imaging unit 1103 has a horizontal angle of view θC’, and θC’ is represented by the interior angle between the half-line 1202 and the half-line 1203 having point 202 as an end point. θZ’ is the interior angle between the half-line 208 and the half-line 1202, and represents the blind spot between the second imaging unit 106 and the third imaging unit 1103.

[0131] The blind spot θZ’ is calculated by the control unit 110 using the following formula (4). θZ’ = 360 + (θB - θB’ / 2) - (θC + θC’ / 2) = 360 + θB - θB’ / 2 - θC - θC’ / 2 ······ (4) θZ’’ is the interior angle between the half-line 1203 and the half-line 205, and represents the blind spot between the third imaging unit 1103 and the first imaging unit 105.

[0132] The blind spot θZ’’ is calculated by the control unit 110 using the following formula (5). θZ’’ = (θC - θC’ / 2) - (θA + θA’ / 2) = θC - θC’ / 2 - θA - θA’ / 2 ······ (5)

[0133] Hereinafter, with reference to FIG. 13, an example of the configuration of the GUI will be described. FIG. 13 is a diagram for explaining the GUI of the imaging control device of Example 4. For the same configuration as in Example 1, the same reference numerals are given and the description thereof is omitted.

[0134] FIG. 13(A) is a diagram showing a modified example of the display example of FIG. 3(B), and shows the GUI 301 when there are three imaging units and there are blind spots between the imaging units. The third image display unit 1301 is a window frame on which the third image data generated by the video processing circuit of the third imaging unit 1103 is displayed, and is displayed on the GUI 301 in the same manner as the first image display unit 302 and the second image display unit 303.

[0135] The blind spot display unit 1302 is a part of the frames of the first image display unit 302 and the second image display unit 303, and is displayed on the GUI 301 based on a display instruction from the control unit 110. The blind spot display unit 1303 is a part of the frames of the third image display unit 1301 and the first image display unit 302, and is displayed on the GUI 301 based on a display instruction from the control unit 110. Here, the blind spot display unit 1303 is configured to display one blind spot display unit 1303 at each of the right end of the third image display unit 1301 and the left end of the first image display unit 302.

[0136] Here, the blind spot display unit 1302 and the blind spot display unit 1303 are not limited to the frames as shown in the figure, and may be in another display form such as a circle or a double-headed arrow. Here, when the second image display unit 303 and the third image display unit 1301 are adjacent on the GUI, each image display unit may be shifted parallel to each other so that the blind spot display unit 1302 can be displayed.

[0137] Also, when set to the full-screen display mode or the like and the display areas of the blind spot display unit 1302 and the blind spot display unit 1303 cannot be secured on the GUI 301, the aspect ratio of each image display unit may be changed to secure the display area. Also, the blind spot display unit 306 may be superimposed and displayed on each image display unit. Note that the switching between the display and non-display of the blind spot display unit 1302 and the blind spot display unit 1303 can be performed by operating the blind spot setting unit 305 in the same manner as the blind spot display unit 306.

[0138] FIG. 13(A) depicts a configuration with one "display" button and one "non-display" button each as an example, but it is not limited to this. For example, a configuration where three "display" buttons and three "non-display" buttons are provided respectively, and the display and non-display of each blind spot display section can be controlled individually, may also be acceptable. Here, the switching of the display and non-display of the blind spot display section 1302 and the blind spot display section 1303 may be performed according to the distance between the pointer 304 and each blind spot display section, similar to the blind spot display section 306.

[0139] Here, when a non-display instruction is received from the control unit 110, instead of turning off the display, the blind spot display section 1302 and the blind spot display section 1303 may adopt other display means, such as gray display or semi-transparent display. FIG. 13(B) is a diagram showing a modified example of the display example in FIG. 3(C). Similar to FIG. 13(A), it shows the GUI 301 when there are three imaging units and there are blind spots between the imaging units.

[0140] The blind spot display section 1302 is configured to display one blind spot display section 1302 at the right end of the second image display section 303 and at the left end of the third image display section 1301 respectively. Similar to FIG. 13(A), the blind spot display section 1303 is configured to display one blind spot display section 1303 at the right end of the third image display section 1301 and at the left end of the first image display section 302 respectively.

[0141] Here, whether to display one blind spot display section 1302 as in FIG. 13(A) or to display two blind spot display sections 1302 as in FIG. 13(B) may be configured to be changeable by the user operating the input unit 117, similar to the blind spot display section 306. Alternatively, a group of change buttons (not shown) may be provided on the GUI 301 so that the number of displays can be controlled individually for each blind spot display section, and the number of displays of any blind spot display section can be changed individually according to the input operation by the user.

[0142] As described above, by adopting a configuration that enables changing the display or non-display, the number of displays, and the display location of the blind spot display unit according to the user's GUI operations, the user can confirm the presence or absence of blind spots in the form they desire and only at the necessary locations when necessary. FIG. 13(C) is a diagram showing a modified example of the display example in FIG. 13(A), and shows the GUI 301 when the arrangement of each image display unit is changed from FIG. 13(A) according to the comparison result of the sizes of each blind spot.

[0143] As shown in FIG. 12, when θZ < θZ’, θZ’ > θZ’’, and θZ’’ > θZ, the arrangement is changed so that, from the left, the third image display unit 1301, the first image display unit 302, and the second image display unit 303 are in this order. That is, the arrangement of each image display unit is changed so that the blind spot display unit 1302 corresponding to θZ’ with the largest blind spot comes to the left and right ends of the GUI 301.

[0144] Here, in FIG. 13(C), a configuration for displaying the blind spot display unit 1302 is described as a representative, but it is not limited to this, and a configuration for making the blind spot display unit 1302 non-display may also be used. As described above, in this embodiment, the information regarding the blind spot area transmitted from the control unit 110 includes information for changing the display state of the blind spot area and the arrangement of the images from the first to third imaging units according to the size of the blind spot.

[0145] As described above, by changing the number of displays and the arrangement of each image display unit according to the calculated size of the blind spot, it is possible to further improve the visibility in the user's GUI. Hereinafter, with reference to FIGS. 14 and 15, the control flow of the fourth embodiment will be described. FIG. 14 is a partial flowchart for explaining the control flow of the fourth embodiment, and FIG. 15 is another partial flowchart for explaining the control flow of the fourth embodiment.

[0146] Note that the processes in the flowcharts of FIGS. 14 and 15 are executed by the control unit 110 based on a computer program. Regarding steps S1401 to S1406, since they are the same as steps S401 to S406 in FIG. 4, the description is omitted. In step S1407, the third detection unit 1104 acquires the pan direction θC of the optical axis of the third imaging unit 1103 and proceeds to step S1408 for processing.

[0147] In step S1408, based on the zoom ratio of the third imaging unit 1103, the horizontal viewing angle θC’ of the third imaging unit 1103 is calculated and the process proceeds to step S1409. In step S1409, using the method for determining the blind angle θZ’ based on the above-described formula (4), the blind angle θZ’ is calculated and the process proceeds to step S1410.

[0148] In step S1410, using the method for determining the blind angle θZ’’ based on the above-described formula (5), the blind angle θZ’’ is calculated and the process proceeds to step S1411. In step S1411, it is determined whether θZ calculated is greater than 0° and less than θα. If it is greater than 0° and less than θα, the process proceeds to step S1412.

[0149] On the other hand, if it is 0° or less or θα or more, the process proceeds to step S1415. At this time, an instruction may be issued to display information indicating that there is no blind angle θZ on the GUI 301. Regarding steps S1412 to S1414, since they are the same as steps S408 to S410 in FIG. 4, the description is omitted. After the process of step S1414, the process proceeds to step S1415.

[0150] In step S1415, it is determined whether θZ calculated is greater than 0° and less than θγ. If it is greater than 0° and less than θγ, the process proceeds to step S1416. On the other hand, if it is 0° or less or θγ or more, the process proceeds to step S1419. At this time, an instruction may be issued to display information indicating that there is no blind angle θZ’ on the GUI 301.

[0151] In step S1416, refer to the table, obtain display correction data based on the blind angle θZ’, and proceed to step S1417 for processing. In step S1417, change the parameters of the blind angle display unit 1302, and proceed to step S1418 for processing.

[0152] In step S1418, display the blind angle display unit 1302 on the GUI 301, and proceed to step S1419 for processing. In step S1419, determine whether the calculated θZ is greater than 0° and less than θη. If it is greater than 0° and less than θη, proceed to step S1420 for processing. On the other hand, if it is 0° or less or θη or more, end the process.

[0153] At this time, an instruction may be issued to display information indicating that the blind angle θZ’’ does not exist on the GUI 301. In step S1420, refer to the table, obtain display correction data based on the blind angle θZ’’, and proceed to step S1421 for processing. In step S1421, change the parameters of the blind angle display unit 1303, and proceed to step S1422 for processing.

[0154] In step S1422, display the blind angle display unit 1303 on the GUI 301, and end the process. Note that after the process ends, if the pan direction of the optical axis of any imaging unit is changed, the process from step S1401 is repeated again. Note that in this embodiment, the configuration when the imaging device 111 includes three camera units has been described as a representative, but the configuration may also be such that there are four or more camera units.

[0155] In that case, using the same calculation method as θZ, θZ’, and θZ’’, calculate the blind angle for each imaging unit, and individually control the display and non-display of each blind angle display unit based on an instruction from the control unit 110. As described above, in an imaging device having three or more camera units, it becomes possible for the user to easily determine which cameras have dead angles and the degree of such dead angles.

[0156] As described above, the present invention has been described in detail based on its preferred embodiments. However, the present invention is not limited to the above embodiments, and various modifications are possible based on the gist of the present invention, and they are not excluded from the scope of the present invention. For example, in the above embodiments, an example has been described in which the processes of the flowcharts of FIGS. 4, 7, 10, 14, and 15 are executed by the control unit 110 based on a computer program.

[0157] That is, information regarding the dead angle region is generated by the control unit 110 as a calculation unit, and together with the first image and the second image, it is transmitted to an external imaging control device via the network processing unit 109 as a transmission unit. However, at least a part of the processes of the above flowcharts may be executed by a computer on the client terminal device side based on a computer program. That is, information regarding the dead angle region may be generated by a computer as a calculation unit on the client terminal device side, and the information regarding the dead angle region may be displayed on the display unit 116.

[0158] Also, the calculation in the embodiments is not limited to performing operations using functional expressions such as expressions (1) to (5). That is, for example, a table corresponding to these functional expressions is stored in advance in a memory (not shown), and those that directly obtain the same result as the operation result based on the functional expression using the table are included.

[0159] Note that a part or all of the control in the present embodiment may be supplied to the imaging device or the imaging control device via a network or various storage media by a computer program that realizes the functions of the above-described embodiments. Then, a computer (or a CPU, MPU, etc.) in the imaging device or the imaging control device may read out and execute the program. In that case, the program and the storage medium storing the program will constitute the present invention.

Description of Reference Numerals

[0160] 101 First camera unit 102 Second camera unit 103 First pan change unit 104 Second pan change unit 105 First imaging unit 106 Second imaging unit 107 First detection unit 108 Second detection unit 109 Network processing unit 110 Control unit 111 Imaging device 112 Network 113 Client terminal device 114 Information processing unit

Claims

1. An adjacent first imaging unit and second imaging unit each capable of changing at least one of a position, a shooting direction, or an angle of view, An acquisition unit that acquires information indicating that there is an area that does not fall within either the shooting range of the first imaging unit or the shooting range of the second imaging unit based on at least one of the position, the shooting direction, or the angle of view of the first imaging unit and the second imaging unit, A transmission unit that, when the area exists, transmits display information for causing the display unit of the control device to display the existence of the area to the control device, When the first image obtained from the first imaging unit and the second image obtained from the second imaging unit are simultaneously displayed on the display unit of the control device, the information regarding the area based on the display information is changed according to the angle of view of the first imaging unit and the angle of view of the second imaging unit, and among the frame areas of the image display frame of the first image and the frame area of the image display frame of the second image, it is displayed on at least one of the frame areas on the adjacent side of the first image and the second image, and the area of the area based on the display information is larger when the zoom ratio is higher than when the zoom ratio is lower. An imaging device characterized by the above.

2. The first imaging unit and the second imaging unit are each arranged on a predetermined circumference and can each change the angular position on the circumference, The imaging device according to claim 1, wherein the acquisition unit acquires the display information based on the angular position on the circumference of the first imaging unit and the angular position on the circumference of the second imaging unit.

3. The imaging device according to claim 1 or 2, wherein the acquisition unit acquires the display information based on the rotational angle of view of the first imaging unit itself and the rotational angle of view of the second imaging unit itself.

4. The imaging device according to claim 1, wherein the acquisition unit acquires the display information by comparing the size of the area with a predetermined threshold value.

5. The imaging device according to claim 1, wherein the display information includes information corresponding to the size of the region.

6. The imaging device according to any one of claims 1 to 5, wherein the display information is changed according to the tilt angle of the first imaging unit and the tilt angle of the second imaging unit.

7. The imaging device according to any one of claims 1 to 6, wherein the imaging device has a third imaging unit different from the first imaging unit and the second imaging unit, and the driving means can independently change the imaging range of the third imaging unit from the first imaging unit and the second imaging unit.

8. The imaging device according to claim 7, wherein the acquisition unit acquires a region that does not enter the imaging range of the third imaging unit from the first imaging unit.

9. The imaging device according to claim 8, wherein the display information includes information regarding the display state of the display region corresponding to the size of the display region or the arrangement of images from the first to third imaging units.

10. A computer program for controlling each part of the imaging device according to any one of claims 1 to 9 by a computer.

11. A computer-readable storage medium storing the computer program according to claim 10.

12. In the control device that receives the first image, the second image, and the information from the transmission unit of the imaging device according to any one of claims 1 to 9, the control device has an input unit that enables an input operation by a user and a display unit, and The control device is characterized in that, according to an operation via the input unit, the display or non-display or the number of displays of an image indicating the region based on the display information on the display unit can be changed.

13. A control device for controlling an imaging device having adjacent first and second imaging units each capable of changing at least one of a position, a shooting direction, or an angle of view, an acquisition unit that acquires information indicating that there is an area that does not fall within the shooting range of the first imaging unit and the second imaging unit based on at least one of the position, the shooting direction, or the angle of view of the first imaging unit and the second imaging unit; a display unit that, when the area exists, displays display information for causing the display unit of the control device to display the existence of the area separately from a first image obtained from the first imaging unit and a second image obtained from the second imaging unit; when the first image and the second image are simultaneously displayed on the display unit of the control device, information regarding the area based on the display information is changed according to the angle of view of the first imaging unit and the angle of view of the second imaging unit, and is displayed on at least one of the frame areas on the adjacent sides of the first image and the second image among the frame area of the image display frame of the first image and the frame area of the image display frame of the second image, and the area of the area based on the display information is larger when the zoom ratio is higher than when the zoom ratio is lower. A control device characterized by the above.

14. A computer program for controlling each part of the control device according to claim 12 by a computer.

15. A computer-readable storage medium storing the computer program according to claim 14.

16. A control method for an imaging device including adjacent first and second imaging units each capable of changing at least one of a position, a shooting direction, or an angle of view, an acquisition step of acquiring information indicating that there is an area that does not fall within the shooting range of the first imaging unit and the shooting range of the second imaging unit based on at least one of the position, the shooting direction, or the angle of view of the first imaging unit and the second imaging unit; When the area exists, a transmission step of transmitting display information for causing the display unit of the control device to display the existence of the area to the control device; When the first image obtained from the first imaging unit and the second image obtained from the second imaging unit are simultaneously displayed on the display unit of the control device, information regarding the area based on the display information is changed according to the angle of view of the first imaging unit and the angle of view of the second imaging unit, and is displayed in at least one of the frame areas on the adjacent side of the first image and the second image among the frame area of the image display frame of the first image and the frame area of the image display frame of the second image. The area of the region based on the display information is larger when the zoom ratio is high than when the zoom ratio is low. A method for controlling an imaging device, characterized by the above.

Images