Control device, control method, and storage medium

Abstract

This invention provides a control device, a control method, and a storage medium. The camera device includes a drive unit configured to drive panning of a camera element. The control device for the camera device includes: a field-of-view setting unit configured to set a field-of-view angle; a focus setting unit configured to set focus after setting the field-of-view angle; and a pan angle setting unit configured to set a pan angle according to user operation after setting the field-of-view angle and focusing.

Description

[0001] (This application is a divisional application of the application filed on May 8, 2019, with application number 201910380699.1 and title "Control Device, Control Method, and Storage Medium".) Technical Field

[0002] The present invention relates to a control device, control method, and storage medium for a camera device including a drive unit configured to drive the tilt of a camera element. Background Technology

[0003] To date, there exists a situation where a surveillance camera is mounted high up, with its optical axis pointing diagonally downwards, to monitor people crossing the road and capture images of vehicles and their license plates. Normally, the focal plane of a camera for image capture lies in a plane perpendicular to its optical axis. However, when a camera mounted high up attempts to capture an image of a subject below (e.g., on the road), the camera's optical axis points diagonally downwards, so its focal plane may not be aligned with the actual image plane of the subject being captured. Therefore, only a portion of the subject may be in focus. Consequently, only a portion of the image shown may be in focus, while the rest of the subject in the image may be out of focus. To address this problem, a method exists to close the aperture of the optical system to increase the depth of field and thus prevent defocusing. However, to capture images in low light, the surveillance camera needs to open the aperture fully or almost fully. However, opening the aperture to this extent results in a reduced depth of field, and therefore the entire image may become out of focus, resulting in an image being captured in a defocused state. To address this problem, one method involves using, for example, a TS lens (tilt-shift lens) to tilt the lens relative to the imaging element in the camera, thereby increasing the depth of field. On the other hand, there are techniques for tilting the imaging element relative to a lens to increase the depth of field.

[0004] Japanese Patent Application Publication No. 2017-173802 discloses a technique that uses a mechanism capable of tilting an imaging element relative to an "optical axis orthogonal plane" orthogonal to the optical axis of the imaging system and multiple focus detection areas, and tilts the imaging element based on the defocus amount detected from the multiple focus detection areas. Furthermore, Japanese Patent Application Publication No. 2000-13665 discloses a technique that uses a mechanism configured to freely tilt an imaging element to detect the pan angle and pan direction, thereby controlling the pan angle and pan direction of the imaging element based on the detected information.

[0005] In the case of a camera (e.g., a device that uses a technique to adjust the pan angle of the image sensor after setting the pan angle of the image sensor, the zoom lens moves, thus changing the relative position between the zoom lens and the image sensor. This changes the focal point, and therefore requires readjustment of the pan angle. Summary of the Invention

[0006] Therefore, according to an embodiment of the present invention, a control device for a camera device is provided, the camera device including a drive unit configured to drive panning of a camera element, and the control device including: a field-of-view setting unit configured to set a field-of-view; a focus setting unit configured to set focus after setting the field-of-view; and a panning angle setting unit configured to set the panning angle of the camera element according to a user operation after setting the field-of-view and the focus.

[0007] According to an embodiment of the present invention, a control method is provided for a control device of a camera device, the camera device including a drive unit configured to drive panning of a camera element, the control method comprising: setting a field of view; setting a focus after setting the field of view; and setting a panning angle according to a user operation after setting the field of view and the focus.

[0008] According to one embodiment of the present invention, a non-transitory storage medium is provided, which stores programs for enabling a computer to function as various units of the control device described above.

[0009] Other features of the invention will become apparent from the following description of typical embodiments with reference to the accompanying drawings. Attached Figure Description

[0010] Figure 1 This is an overall diagram illustrating the monitoring system in the first embodiment of the present invention.

[0011] Figure 2 It is a hardware structure diagram used to illustrate the monitoring system.

[0012] Figure 3 This is an example image used to illustrate the zoom settings screen.

[0013] Figure 4 This is a diagram used to illustrate a display example of the focus settings screen.

[0014] Figure 5 This is a diagram used to illustrate a display example of the tilt angle setting screen.

[0015] Figure 6 This is a flowchart used to illustrate the setup process.

[0016] Figure 7 This is a flowchart used to illustrate the setup process.

[0017] Figure 8 This is a flowchart used to illustrate the setup process.

[0018] Figure 9 This is a diagram illustrating an example of a screen for setting the tilt angle in a second embodiment of the present invention.

[0019] Figure 10 This is a flowchart used to illustrate the display process of the tilt angle setting screen.

[0020] Figure 11 This is an example diagram used to illustrate the tilt angle setting screen in the second embodiment.

[0021] Figure 12 This is a diagram illustrating an example of a screen for setting the tilt angle in a third embodiment of the present invention. Detailed Implementation

[0022] Preferred embodiments of the present invention will now be described in detail with reference to the accompanying drawings.

[0023] First Embodiment

[0024] Figure 1 This is an overall diagram illustrating the surveillance system according to a first embodiment of the present invention. The surveillance camera 100 and the control device 110 are connected to each other via a network 120 in a manner that enables communication between the surveillance camera 100 and the control device 110. The control device 110 is configured to send various commands to the surveillance camera 100. The surveillance camera 100 is configured to send responses corresponding to these commands to the control device 110. The zoom and focus of the surveillance camera 100 can be adjusted.

[0025] Figure 2 This is a hardware structure diagram illustrating a surveillance system. The surveillance camera 100 includes an image capture unit 201, an image processing unit 202, a system control unit 203, and a storage unit 204. The surveillance camera 100 also includes a lens drive unit 205, a field of view control unit 206, a focus control unit 207, an image sensor drive unit 208, an image sensor control unit 209, and a communication unit 210.

[0026] The imaging unit 201 includes a lens and an imaging element, and is configured to capture an image of a subject and convert the image into an electrical signal. The imaging element may be a CMOS image sensor, a CCD image sensor, or other types of image sensors. The image processing unit 202 is configured to perform predetermined image processing and compression encoding processing on the signal of the image captured by the imaging unit 201 and converted by photoelectric conversion, thereby generating image data.

[0027] The system control unit 203 is configured to control the entire control device 110. The system control unit 203 analyzes camera control commands sent from the control device 110 and performs processing corresponding to those commands. For example, the system control unit 203 receives request commands for real-time images from the control device 110 and distributes image data generated by the image processing unit 202 via the communication unit 210.

[0028] Furthermore, the system control unit 203 receives request commands for setting values ​​of zoom, focus, and pan angles for the monitoring camera 100, and distributes the setting values ​​for the field-of-view control unit 206, focus control unit 207, and image sensor control unit 209 via the communication unit 210 according to each request command. Additionally, when the system control unit 203 receives a setting command from the control device 110, it instructs the corresponding control unit (e.g., the field-of-view control unit 206, focus control unit 207, and / or image sensor control unit 209) to perform control based on the setting values. As a result, the setting values ​​related to the zoom, focus, and / or pan angles set by the control device 110 are reflected in the monitoring camera 100.

[0029] The storage unit 204 is configured to record images to internal memory and / or external memory. The functions and processing of the surveillance camera 100, which will be described later, are implemented by the system control unit 203 reading and executing the program stored in the storage unit 204.

[0030] The field-of-view control unit 206 is configured to instruct the lens drive unit 205 to change the position of the zoom lens based on the zoom setting value sent from the system control unit 203. The focus control unit 207 is configured to instruct the lens drive unit 205 to change the position of the focus lens based on the focus setting value sent from the system control unit 203. The image sensor control unit 209 is configured to instruct the image sensor drive unit 208 to change the image sensor pan angle based on the pan angle setting value sent from the system control unit 203.

[0031] The communication unit 210 is configured to distribute image data to the control device 110 via the network 120. Furthermore, the communication unit 210 receives various commands sent from the control device 110 and sends these commands to the system control unit 203. The commands sent from the control device 110 mainly include request commands for real-time images, request commands for setting values ​​of the zoom, focus, and pan angles of the camera 100, and setting commands for monitoring the zoom, focus, and pan angles of the camera 100.

[0032] The control device 110 includes a communication unit 221, a display unit 222, a system control unit 223, and an input unit 224. The communication unit 221 is configured to receive various types of data distributed from the surveillance camera 100 and to send various types of commands issued from the control device 110. The various types of data mainly include, for example, information related to the camera's field of view including zoom, information related to focus adjustment, information related to the panning of the surveillance camera 100, and image data. The display unit 222 is, for example, a liquid crystal display device. The display unit 222 is configured to display images acquired from the surveillance camera and a GUI for controlling the camera.

[0033] System control unit 223 is configured to generate camera control commands based on user GUI operations and send these commands to monitoring camera 100 via communication unit 221. Furthermore, system control unit 223 displays image data received from monitoring camera 100 via communication unit 221 and data representing setting values ​​including zoom field of view, focus, and pan angle on display unit 222. A keyboard and pointing device (e.g., mouse) are used for input unit 224. The user of the client device operates the GUI via input unit 224.

[0034] Figure 3 This diagram illustrates an example of a zoom setting screen 300. The zoom setting screen 300 is a GUI displayed on the display unit 222 of the control device 110. User operations on the zoom setting screen 300 are performed via the input unit 224. The image display area 301 displays an image. The text display area 302 displays text. The zoom control slider 303 controls the zoom. The zoom-in button 304 zooms in to display the magnified image. The zoom-out button 305 zooms out to display the reduced image. The "Apply" button 306 completes the zoom setting to enter the focus setting screen. The control device 110 receives zoom information from the monitoring camera 100 and displays the zoom information on the zoom setting screen 300. Here, the zoom information is information about zoom and includes zoom setting values. The zoom information is displayed on the zoom setting screen 300 in various forms, such as using numerical values, text, and sliders.

[0035] The live image emitted from the surveillance camera 100 is displayed in the image display area 301. In the text display area 302, information instructing the user to set the zoom level and information related to the camera's field of view, including the current zoom setting value, are displayed. Descriptions of the various buttons and sliders on the zoom setting screen 300 are also displayed in the text display area 302.

[0036] Users can control the zoom of the surveillance camera 100 using the slider 303 and buttons 304 and 305. When the user operates any of the slider 303 and buttons 304 and 305, the control device 110 sends a zoom setting command to the surveillance camera 100 via the network 120. When the user moves the zoom control slider 303 upward or presses the zoom button 304, the surveillance camera 100 captures a magnified image from the field of view displayed on the image display area 301 of the control device 110. Conversely, when the user moves the zoom control slider 303 downward or presses the zoom-out button 305, the surveillance camera 100 captures a reduced image from the field of view displayed on the image display area 301 of the control device 110.

[0037] The control device 110 receives a real-time image from the monitoring camera 100 after the field of view has been changed by zooming, and displays the real-time image on the image display area 301. When the user presses the "Apply" button 306, the display on the display unit 222 switches from the zoom setting screen 300 to... Figure 4 The focus settings shown are at 400. You can consider... Figure 3 Various methods, such as mouse wheel type and text box type, as well as button type and slider type, are shown as methods for setting zoom. When the surveillance camera 100 includes a pan drive mechanism, a tilt drive mechanism, and a tilt drive mechanism for the lens barrel, a setting interface for these mechanisms can be displayed on the zoom setting screen 300.

[0038] Figure 4 This diagram illustrates a display example of the focus setting screen 400 displayed on the display unit 222 of the control device 110. The image display area 401 displays an image. The text display area 402 displays text. The display bar 403 displays the focus mode. The "Execute" button 404 is used to perform a single autofocus (hereinafter referred to as AF) only once. The near-side adjustment button 405 is used to adjust the focus to a closer point. The far-side adjustment button 406 is used to adjust the focus to a farther point. The "Apply" button 407 is used to complete the focus settings to enter the pan angle setting screen. The control device 110 receives focus-related setting values ​​from the monitoring camera 100 and displays these setting values ​​on the focus setting screen 400.

[0039] In this context, one could conceive of manual focus mode, autofocus mode, fixed infinity focus mode, and other such modes as the focusing modes of the monitoring camera 100. Manual focus mode is a mode where the user manually adjusts the lens position of the focusing lens. Autofocus mode is a mode where the lens position of the focusing lens is continuously and automatically adjusted so that, for example, the monitoring camera 100 focuses on the central area of ​​the field of view. Fixed infinity focus mode is a mode where the monitoring camera 100 moves the focusing lens to a position recorded within the focusing lens so that it can focus on infinity. This mode is used for capturing images of distant scenes and distant subjects. Subjects appearing nearby cannot be focused in fixed infinity focus mode. Furthermore, single AF is a function that, while the focusing mode is manual focus mode, causes the monitoring camera 100 to perform AF only once for the field of view, and then returns the focusing mode to manual focus mode.

[0040] The live image emitted from the surveillance camera 100 is displayed in the image display area 401. The text display area 402 displays information instructing the user to set the focus, information related to the focus settings, descriptions of the various buttons on the focus setting screen 400, and other such information. Figure 4 In a typical illustration, the focus mode is fixed as manual focus mode in the pan setting, so only manual focus mode is displayed as the focus mode in the display bar 403 used for focus mode.

[0041] The user can press the "Execute" button 404 for single AF to execute AF only once, thereby enabling the center area of ​​the field of view of the surveillance camera 100 to be focused. Furthermore, when the user presses the near-side adjustment button 405, the focus can be adjusted to the near side of the field of view of the surveillance camera 100. Conversely, when the user presses the far-side adjustment button 406, the focus can be adjusted to the far side of the field of view. When the user operates either button 405 or 406, the control device 110 sends a focus setting command to the surveillance camera 100 via the network 120. When the user presses the "Apply" button 407, the display unit 222 of the control device 110 switches the GUI from the focus setting screen to the pan angle setting screen.

[0042] Figure 5This diagram illustrates a display example of the pan angle setting screen 500 displayed on the display unit 222 of the control device 110. Image display area 501 displays an image. Text display area 502 displays text. A specification box 503 is used to specify the area to be extracted. When the specification box 503 is set to the desired position by user operation, the system control unit 223 receives the specification of the portion of the area contained in the specification box 503. Then, the system control unit 223 displays the portion of the area in a magnified display area 504. The process of receiving the specification of the portion of the area is an example of area receiving processing. The pan control interface 505 is used to control the panning of the camera element. An up / down pan control slider 506 is used to control the up / down panning of the camera element. A left / right pan control slider 507 is used to control the left / right panning of the camera element. A display bar 508 displays the up / down pan angle of the camera element. A display bar 509 displays the left / right pan angle of the camera element. The "Apply" button 510 is used to complete the shaking settings.

[0043] On the pan angle setting screen 500, the control device 110 does not accept user operations that could change camera parameter settings that might affect the pan angle adjustment. The control device 110 receives pan-related information from the monitoring camera 100 and displays that information on the pan angle setting screen 500.

[0044] The live image emitted from the surveillance camera 100 is displayed in the image display area 501. The text display area 502 displays information for instructing the user to set the pan angle, including the pan angle setting value and pan-related information such as the pan direction that can be set, a description of the control interface and image displayed on the pan angle setting screen 500, and other such information.

[0045] The screen 500, configured for panning angle settings, allows for the extraction and magnification of the image displayed on the image display area 501, enabling the user to confirm that a subject appearing at a small, distant location is in focus. The user can configure at least one designated frame 503 for extracting the corresponding image on the image display area 501. The extracted image in the designated area is displayed in magnified form in the magnified display area 504. The image extraction process can be performed by the surveillance camera 100 or the control device 110.

[0046] Various rotation axes are conceivable as rotation axes for panning the camera element. These rotation axes include axes for up / down panning and axes for left / right panning. Up / down panning causes the camera element to rotate about an axis horizontal relative to the imaging direction of the surveillance camera 100. Left / right panning causes the camera element to rotate about an axis vertical relative to the imaging direction of the surveillance camera 100. As an example, in the pan control interface 505, the user drags the three-dimensional model of the camera element displayed in the interface 505 while inspecting at least one area of ​​the image display area 501 and the magnified display area 504 to rotate the model in the up / down and left / right directions. As a result, the up / down pan angle and the left / right pan angle of the camera element of the surveillance camera 100 can be set. Furthermore, the pan axis and pan direction that can be controlled for the camera element of the surveillance camera 100 can also be displayed on the pan control interface 505. Additionally, the user can adjust the up / down and left / right pan angles of the camera element by sliding the bars representing the pan angle on the up / down control slider 506 and the left / right pan control slider 507. Furthermore, the effective range of the up / down and left / right pan angles is also displayed at both ends of the sliders 506 and 507.

[0047] When the user operates the interface 505 and the sliders 506 and 507, the control device 110 sends a setting command for the pan angle to the monitoring camera 100 via the network 120. The sent pan angle setting command includes pan information such as the pan axis, pan direction, and the set pan angle. The pan control interface 505, the up / down pan control slider 506, and the left / right pan control slider 507 are examples of user interface images. The display bar 508 for the up / down pan angle and the display bar 509 for the left / right pan angle respectively display the effective range and setting value of the up / down swing angle and the effective range and setting value of the left / right pan angle from the pan information received from the monitoring camera 100 related to the imaging element. When the user presses the "Apply" button 510, the control device 110 completes the pan setting.

[0048] Figures 6 to 8 This is a flowchart illustrating the setup process of the control device 110. Figure 6 In step S600, the system control unit 223 determines whether the monitoring camera 100 includes a zoom control mechanism based on capability information previously obtained from the monitoring camera 100. If so, it determines whether zoom can be controlled from the control device 110. If zoom can be controlled ("Yes" in step S600), the system control unit 223 proceeds to step S601. If zoom cannot be controlled ("No" in step S600), the system control unit 223 proceeds to step S700. Figure 7 ).

[0049] In step S601, the system control unit 223 requests zoom information related to the monitoring camera 100 from the monitoring camera 100. Then, in step S602, the system control unit 223 receives the zoom information related to the monitoring camera 100 from the monitoring camera 100. Then, in step S603, the system control unit 223 displays the zoom setting screen 300 and the received zoom information on the display unit 222.

[0050] Then, in step S604, the system control unit 223 determines whether zoom has been set according to user operation. When the user sets zoom on the zoom setting screen 300, the system control unit 223 receives a zoom setting instruction. Then, the system control unit 223 sets the zoom according to the setting instruction. This process is an example of a field-of-view setting process that sets zoom based on input operation on the display screen. When the user positions the mouse cursor on the zoom control slider 303 and moves the slider while holding down the mouse button, the system control unit 223 performs zoom setting according to user operation. In addition, the user can position the mouse cursor on either the zoom-in button 304 or the zoom-out button 305 and click the mouse button to perform a zoom operation. If zoom has been set ("Yes" in step S604), the system control unit 223 causes the process to proceed to step S605. If zoom has not been set ("No" in step S604), the system control unit 223 causes the process to proceed to step S700.

[0051] In step S605, the system control unit 223 sends a zoom setting command to the monitoring camera 100. The zoom setting command is sent when the user releases a mouse button on any of the zoom control slider 303, zoom-in button 304, or zoom-out button 305 on the zoom setting screen 300. The system control unit 223 sends the specified zoom setting value along with the zoom setting command to the monitoring camera 100. The zoom setting is now complete.

[0052] Then, in Figure 7 In step S700, the system control unit 223 determines whether the monitoring camera 100 includes a focusing control mechanism based on capability information previously obtained from the monitoring camera 100. If so, it determines whether focusing can be controlled from the control device 110. If focusing can be controlled ("Yes" in step S700), the system control unit 223 proceeds to step S701. If focusing cannot be controlled ("No" in step S700), the system control unit 223 proceeds to step S800. Figure 8 ).

[0053] In step S701, the system control unit 223 requests focusing information related to the monitoring camera 100 from the monitoring camera 100. The focusing information is information related to focusing and includes focusing settings. Then, in step S702, the system control unit 223 receives focusing information related to the monitoring camera 100 from the monitoring camera 100. Then, in step S703, the system control unit 223 determines whether the focusing mode of the monitoring camera 100 is AF mode. If the focusing mode is AF mode ("Yes" in step S703), the system control unit 223 proceeds to step S705. If the focusing mode is not AF mode ("No" in step S703), the system control unit 223 proceeds to step S704.

[0054] When the focusing mode is not AF mode, the central area of ​​the camera's field of view may not be in focus. Therefore, in step S704, the system control unit 223 sends a command to the monitoring camera 100 to execute a single AF, so that the central area of ​​the camera's field of view is in focus. Then, in step S705, the system control unit 223 sends a command to the monitoring camera 100 to change the focusing mode to manual focusing mode. Then, the system control unit 223 displays "Manual" as the focusing mode in the focusing mode display bar 403. Then, in step S706, the system control unit 223 displays the focusing setting screen 400 and the received focusing information on the display unit 222.

[0055] Then, in step S707, the system control unit 223 determines whether focus has been set according to the user's manual operation. When the user presses the near adjustment button 405 or the far adjustment button 406 for focusing to manually adjust the focus, the system control unit 223 receives an instruction to set focus. Then, the system control unit 223 sets focus according to the setting instruction. This process is an example of focus setting process. If focus has been set ("Yes" in step S707), the system control unit 223 causes the process to proceed to step S708. If focus has not been set ("No" in step S707), the system control unit 223 causes the process to proceed to step S800. Figure 8 In step S708, the system control unit 223 sends a setting command for manual focus adjustment to the monitoring camera 100. The focus setting is now complete.

[0056] Then, in Figure 8In step S800, the system control unit 223 requests capability information related to the surveillance camera 100 from the surveillance camera 100. This capability information includes information regarding whether the surveillance camera 100 includes a pan control mechanism for an image sensor and whether the pan angle can be controlled from the control device 110. In step S801, the system control unit 223 receives capability information from the surveillance camera 100. In step S802, the system control unit 223 determines whether the surveillance camera 100 includes a pan control mechanism for an image sensor and whether the pan angle can be controlled from the control device 110. If the pan angle can be controlled ("Yes" in step S802), the system control unit 223 proceeds to step S803. If the pan angle cannot be controlled ("No" in step S802), the system control unit 223 terminates the setting process.

[0057] In step S803, the system control unit 223 requests a live image from the surveillance camera 100. Then, in step S804, the system control unit 223 displays a pan angle setting screen 500 on the display unit 222, and displays the live image received from the surveillance camera 100 in the image display area 501 on the pan angle setting screen 500. Then, in step S805, the system control unit 223 displays text as a guide for use until the pan angle is set in the text display area 502 on the pan angle setting screen 500.

[0058] Then, in step S806, the system control unit 223 requests panning information related to the imaging element of the surveillance camera 100 from the surveillance camera 100. This panning information is about panning and includes the controllable panning axis and direction, the current value of the panning angle, and the effective range of the panning angle. Then, in step S807, the system control unit 223 receives information related to the panning of the imaging element from the surveillance camera 100. Then, the system control unit 223 displays a panning angle setting screen 500. The system control unit 223 displays an image showing the controllable panning axis and direction, and the current posture of the imaging element, on the panning control interface 505 of the panning angle setting screen 500. Additionally, the system control unit 223 displays the current value and effective range of the up / down panning angle in the up / down panning control slider 506, and the current value and effective range of the left / right panning angle in the left / right panning control slider 507. Then, the system control unit 223 displays the current value and effective range of the up / down tilt angle in the display bar 508, and displays the current value and effective range of the left / right tilt angle in the display bar 509.

[0059] Then, in step S808, the system control unit 223 determines whether the pan angle has been set. When the pan angle is set via the pan control interface 505, the up / down pan control slider 506, and the left / right control slider 507, the system control unit 223 receives a setting instruction and sets the pan angle according to the setting instruction. This process is an example of the pan angle setting process. If the pan angle has been set ("Yes" in step S808), the system control unit 223 causes the process to proceed to step S809. If the pan angle has not been set ("No" in step S808), the system control unit 223 causes the process to proceed to step S810. In step S809, the system control unit 223 sends a setting command for the pan angle to the monitoring camera 100. The sent setting command for the pan angle includes pan-related information such as the pan axis, pan direction, and the set pan angle.

[0060] Then, in step S810, the system control unit 223 determines whether the "Apply" button 510 on the tilt angle setting screen 500 has been pressed, thereby completing the tilt angle setting. If the tilt angle setting is completed ("Yes" in step S810), the system control unit 223 ends the setting process. If the tilt angle setting is not completed ("No" in step S810), the system control unit 223 causes the process to proceed to step S803 and continues the process.

[0061] As described above, when the pan angle needs to be set via user operation, the control device 110 first displays the zoom setting screen 300, thereby performing the zoom setting according to the user's operation. Then, the control device 110 displays the focus setting screen 400, thereby performing the focus setting according to the user's operation. After zooming and focusing are set, the control device 110 displays the pan angle setting screen 500, thereby setting the pan angle according to the user's operation while zooming and focusing are set. The control device 110 can control the setting sequence in this way.

[0062] When the focus and zoom are not fixed during panning, the optimal panning angle cannot be set. In contrast, as described above, the control device 110 according to the first embodiment sets the panning angle after setting the field of view, which includes at least the zoom setting and the focus setting. As a result, advantageously, the optimal panning angle can be set while the focus and zoom are set. In addition, the user can observe the magnified display area 504, which is displayed in magnified form on the panning angle setting screen 500 for the area of ​​interest specified in the image display area 501. Then, when the user confirms that the subject, which appears in a small size at a distant position, is in focus, the user can adjust the panning angle by operating the three-dimensional model that visually represents the state of the panning angle of the imaging element through the panning control interface 505. As described above, the user can easily set the panning angle for increasing the depth of field. That is, the control device 110 can appropriately set the panning angle desired by the user without complicated operations. Furthermore, the control device 110 can smoothly set the parameters of the surveillance camera 100.

[0063] Furthermore, the panning angle included in the setting command sent to the surveillance camera 100 can be expressed using various expressions such as angle values ​​and values ​​standardized for the effective range of the panning angle.

[0064] Second Embodiment

[0065] The main focus now is on describing the differences between the monitoring system in the second embodiment of the present invention and the monitoring system in the first embodiment. In the monitoring system of the second embodiment, the control device 110 displays images captured when the imaging element is tilted in various directions about the controllable tilt axis on the display unit 222. As a result, the user can intuitively understand the amount by which the imaging element is tilted to increase the depth of field of the monitoring camera 100.

[0066] Figure 9This is a diagram illustrating an example of the pan angle setting screen 900 in the second embodiment. Text display area 901 displays text. Pan control interface 902 controls the panning of the camera element. Up / down pan axis 903 serves as the axis for panning the camera element in the up / down direction. Left / right pan axis 904 serves as the axis for panning the camera element in the left / right direction. Display area 905 displays an image captured when the camera element is tilted to its maximum upward direction around the up / down pan axis. Display area 906 displays an image captured when the camera element is tilted to its maximum downward direction around the up / down pan axis. Display area 907 displays an image captured when the camera element is tilted to its maximum left direction around the left / right pan axis. Display area 908 displays an image captured when the camera element is tilted to its maximum right direction around the left / right pan axis. In other words, multiple images corresponding to various panning angles at the maximum tilt points are displayed in areas 905, 906, 907, and 908.

[0067] Display area 909 displays the up / down pan angle when capturing the image displayed in area 905. Display area 910 displays the up / down pan angle when capturing the image displayed in area 906. Display area 911 displays the left / right pan angle when capturing the image displayed in area 907. Display area 912 displays the left / right pan angle when capturing the image displayed in area 908. Display area 913 displays the current up / down pan angle of the camera element. Display area 914 displays the current left / right pan angle of the camera element. The "Apply" button 915 is used to complete the pan settings.

[0068] The text display area 901 displays information for instructing the user to set the pan angle, pan-related information including the pan angle setting value and the pan direction that can be set, a description of the control interface and image displayed on the pan angle setting screen 900, and other such information. The pan control interface 902 has the function of displaying real-time images distributed from the surveillance camera 100. The user can adjust the pan angle of the image sensor of the surveillance camera 100 by tilting the pan control interface 902 in any direction in the up / down and left / right directions around the up / down pan axis 903 and the left / right pan axis 904, which serve as rotation axes.

[0069] On the pan angle setting screen 900, images captured when the camera element is tilted to its maximum in each direction are displayed in display areas 905, 906, 907, and 908. The user views these images in these display areas to determine the pan axis and pan direction of the camera element, which enables the surveillance camera 100 to achieve a greater depth of field. The user then drags the control interface 902 to tilt the camera element in the direction that provides the increased depth of field, thereby adjusting the camera element of the surveillance camera 100 to the optimal pan angle.

[0070] When the user operates the control interface 902, the control device 110 sends a setting command for the pan angle to the surveillance camera 100 via the network 120. The effective range and current value of the up / down pan angle and the left / right pan angle, from the information received from the surveillance camera 100 related to the panning of the image sensor, are displayed in the display area 913 for the current up / down pan angle and the display area 914 for the current left / right pan angle. When the user presses the "Apply" button 915, the control device 110 ends the panning setting.

[0071] Figure 10 This is a flowchart illustrating the display process of the pan angle setting screen of the control device 110 according to the second embodiment. This process is performed in place of the processes described in steps S806 and S807 of the first embodiment. In step S1000, the system control unit 223 requests pan information from the monitoring camera 100. Then, in step S1001, the system control unit 223 receives pan information from the monitoring camera 100. Then, in step S1002, the system control unit 223 performs control to display the received pan information. Specifically, the system control unit 223 displays the controllable pan axes among the up / down pan axis 903 and the left / right pan axis 904. Furthermore, the system control unit 223 displays the maximum tilt angle when the camera element is tilted to its maximum in each controllable pan direction in display areas 909, 910, 911, and 912, and displays the current value of the pan angle in display bars 913 and 914.

[0072] Then, in step S1003, the system control unit 223 requests the maximum tilt image captured when the imaging element is tilted to its maximum in each controllable panning direction. Then, in step S1004, the system control unit 223 receives the maximum tilt image. Then, in step S1005, the system control unit 223 displays the received maximum tilt images in display areas 905, 906, 907, and 908 of the panning angle setting screen 900. The display process now ends.

[0073] As described above, in the second embodiment, the control device 110 displays images captured when the imaging element tilts in various directions about the controllable pan axis on the pan angle setting screen 900. Therefore, the user can visually grasp the direction of tilt about the controllable pan axis in order to increase the depth of field of the surveillance camera 100.

[0074] As a variation of the second embodiment, the control device 110 only needs to display multiple images captured when the imaging element is tilted in multiple different directions. The display can be... Figure 11 The form shown. In Figure 11 In the form shown, the images displayed in display areas 905, 906, 907, and 908 are displayed in the same direction as the images displayed in the shake control interface 902.

[0075] Third Embodiment

[0076] The main focus here is a description of the differences between the monitoring system in the third embodiment of the present invention and the monitoring system in the first embodiment. In the first embodiment, the display unit of the control device 110 sequentially displays screens 300, 400, and 500. On the other hand, in the third embodiment, a notification is displayed on the pan angle setting screen 500 indicating that zoom and focus settings need to be configured before setting the pan angle.

[0077] As described above, for example in the third embodiment, by prompting the user to set the zoom and focus before setting the pan angle, the pan angle does not need to be adjusted again, thus smoothly setting the parameters of the camera device.

[0078] The embodiments of the present invention can also be implemented by providing software (programs) that perform the functions of the above embodiments to a system or device via a network or various storage media, and the computer or central processing unit (CPU) or microprocessor unit (MPU) of the system or device reads out and executes the program.

[0079] Although the invention has been described with reference to exemplary embodiments, it should be understood that the invention is not limited to the disclosed exemplary embodiments. The scope of the appended claims is to be interpreted in the broadest sense to include all such modifications, equivalent structures, and functions.

Claims

1. A control device for a camera device, the camera device including an imaging element, the panning angle of the imaging element being changeable relative to an orthogonal plane orthogonal to the optical axis of the camera optical system, and the control device comprising: A view setting unit, which is configured to set the view; The display unit is configured as follows: Upon request, the zoom settings screen, focus settings screen, and pan angle settings screen are displayed sequentially. The tilt angle setting display screen includes a first display area for displaying the received image, a second display area for displaying a portion of the received image in a magnified manner, and a third display area for displaying a user interface image for setting the tilt angle. The system control unit is configured as follows: The system requests the display unit to display the zoom setting display screen, sets the zoom value based on the user input on the zoom setting display screen, and sends a setting command for the zoom value to the camera device. After sending a setting command for the zoom value to the camera device, the system requests the display unit to display the focus setting display screen, sets the focus based on user input on the focus setting display screen, and sends a setting command for the focus to the camera device. After sending a focus setting command to the camera device, the system requests the display unit to display the pan angle setting display screen. Based on user input in the third display area of ​​the pan angle setting display screen, the system sets the pan angle of the camera element and sends a setting command for the pan angle to the camera device. The imaging element is capable of tilting relative to an orthogonal plane orthogonal to the optical axis of the imaging optical system, and the tilting angle is the angle between the imaging element and the orthogonal plane. The control device further includes: The acquisition unit is configured to acquire multiple images corresponding to multiple different panning angles; and A display processing unit is configured to control the display of the plurality of images. The acquisition unit is configured to receive multiple images corresponding to various rocking angles, each rocking angle being a rocking angle at the maximum tilt corresponding to multiple different directions.

2. The control device according to claim 1 further includes a communication unit, the communication unit being configured to send information related to the viewing angle, information related to focus information, and information related to the panning angle to the camera device, wherein... The panning angle of the camera element is changed based on information related to the panning angle received from the control device.

3. A control method for a camera device, the camera device including an imaging element, the panning angle of the imaging element being changeable relative to an orthogonal plane orthogonal to the optical axis of the camera optical system, and the control method comprising: Set the viewpoint; When requested, the zoom setting display screen, focus setting display screen and pan angle setting display screen are displayed sequentially using the display unit. The pan angle setting display screen includes a first display area for displaying the received image, a second display area for displaying a portion of the received image in a magnified manner, and a third display area for displaying a user interface image for setting the pan angle. The system requests the display unit to display the zoom setting display screen, sets the zoom value according to the user input operation on the zoom setting display screen, and sends a setting command for the zoom value to the camera device. After sending a setting command for the zoom value to the camera device, the system requests the display unit to display the focus setting display screen, sets the focus based on user input on the focus setting display screen, and sends a setting command for the focus to the camera device; and After sending a focus setting command to the camera device, the system requests the display unit to display the pan angle setting display screen. Based on user input in the third display area of ​​the pan angle setting display screen, the system sets the pan angle of the camera element and sends a setting command for the pan angle to the camera device. The imaging element is capable of tilting relative to an orthogonal plane orthogonal to the optical axis of the imaging optical system, and the tilting angle is the angle between the imaging element and the orthogonal plane. The control method further includes: Acquire multiple images corresponding to multiple different tilting angles; and Control is performed to display the multiple images. In the acquisition process, multiple images corresponding to various sway angles are received, each sway angle being the sway angle at the maximum tilt corresponding to multiple different directions.

4. A non-transitory storage medium storing a program for enabling a computer to implement the control method according to claim 3.

5. A computer program product comprising a program for causing a computer to implement the control method according to claim 3.

Images