Imaging controller, method for controlling imaging, and program

Abstract

To keep a picture of a crop region at high quality when an order to change a crop region as a region cut out from an imaging region is issued.SOLUTION: A control command to move the position of a crop region is received from a controller and the position of the crop region is moved to a specific moving direction in the range of an imaged region. If the crop region is moved to overlap with the area of the imaged region, pan tilt function is controlled so that the imaging direction is moved.SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] The present invention particularly relates to an imaging control device, an imaging control method, and a program suitable for use in cropping a partial area from an image and outputting the image.

Background Art

[0002] In recent years, in video production, video editing and distribution systems using IP (Internet Protocol) networks such as the Internet have been increasing. In such a system, generally, video data such as video and audio output from a camera connected to an IP network is received by a video editing device such as a switcher, and is edited as broadcast video as needed and then distributed / output.

[0003] Also, in recent years, a personal computer (PC) or a controller has been used to control the image quality setting and pan / tilt / zoom of a camera remotely via an IP network. Furthermore, the acquisition of the captured video of a camera via an IP network instead of a conventional video cable such as SDI (Serial Digital Interface) has also been increasing. As a result, the number of cases where there is no cameraman at the shooting site is also increasing.

[0004] Also, a camera having a function of cropping a partial area from the video of the shooting angle and outputting the video is known. In such a camera, when cropping the video outside the shooting angle and outputting it, a two-step operation of controlling the pan / tilt / zoom of the camera so that the area to be cropped is included in the shooting angle and then setting the crop area is required. Therefore, in order to simplify the operation, a technique has been proposed in which the camera pans / tilts / zooms in conjunction with the setting of the crop area, so that the video outside the shooting angle can be cropped and output only by the setting operation of the crop area.

[0005] Patent Document 1 discloses a method of setting an area for performing image processing such as cropping or masking in a display area where an image captured by a camera is displayed. In this method, the image processing area in the displayed image of the display unit is moved to a position corresponding to the edge of the captured image, and when a predetermined condition is satisfied, the imaging direction of the camera is controlled to move in the direction corresponding to the edge.

[0006] Also, Patent Document 2 discloses a method of transmitting angle-of-view change information from a mobile terminal to a camera to improve the speed of changing the angle of view of a displayed image. In this method, when the camera receives angle-of-view change information for moving a crop area to a position outside the captured angle of view, after moving the crop area to the edge of the captured angle of view, the imaging direction of the camera is operated according to the angle-of-view change information.

Prior Art Documents

Patent Documents

[0007]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0008] However, in the methods described in Patent Documents 1 and 2, since the control of the imaging direction is performed at the timing when the crop area touches the edge of the captured angle of view, the movement of the crop area temporarily stops, and the crop area cannot be moved smoothly. Therefore, the quality of the cropped video is degraded due to the temporary stop at the timing of control switching, and there is a possibility that the operation of the crop area does not reflect the user's intention.

[0009] In view of the above problems, an object of the present invention is to be able to maintain the quality of the video of the crop area at a high level when a change in the crop area for cutting out a partial area from a captured image is instructed.

Means for Solving the Problem

[0010] The imaging control device according to the present invention includes an acquisition unit that acquires a captured image generated by an imaging unit, an image processing unit that sets a partial region of the captured image as a crop region and changes the range of the crop region within the range of the captured image by receiving a request to change the range of the crop region, a control unit that controls the imaging range of the imaging unit, and a setting unit that sets an area for determining whether to execute control according to the change in the range of the crop region set by the image processing unit in a region corresponding to the imaging range of the imaging unit. The control unit performs control to change the imaging range of the imaging unit so that the crop region does not interfere with the area due to the change in the range of the crop region.

Advantages of the Invention

[0011] According to the present invention, when an instruction to change a crop region for cutting out a partial region from a captured image is given, the video of the crop region can be kept of high quality.

Brief Description of the Drawings

[0012]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Embodiments for Carrying Out the Invention

[0013] Hereinafter, embodiments for carrying out the present invention will be described in detail with reference to the accompanying drawings. It should be noted that the embodiments described below are examples of the means for realizing the present invention, and should be appropriately modified or changed according to the configuration of the device to which the present invention is applied and various conditions, and the present invention is not limited to the following embodiments.

[0014] (First Embodiment) FIG. 1 is a diagram showing a schematic configuration example of an imaging system according to the present embodiment. The imaging system is configured such that a camera 100 and a controller 200 are interconnected via an IP network 300. As a basic operation, the camera 100 transmits camera images captured via the IP network 300 to the controller 200. In the present embodiment, the camera 100 is a PTZ camera (pan-tilt-zoom camera) capable of pan, tilt, and zoom. The controller 200 is connected to the camera 100 via the IP network 300, and acquires camera images from the camera 100 and controls the camera 100. In the example shown in FIG. 1, only one camera is taken as an example, but a configuration in which a plurality of cameras are controlled by one controller may also be used.

[0015] FIG. 2 is a block diagram showing a hardware configuration example of the camera 100 and the controller 200. First, the configuration of the camera 100 will be described. In the camera 100, a CPU 110, a RAM 120, a ROM 130, an image capture I / F 140, a network I / F 150, and a drive control unit 180 are interconnected via an internal bus 160.

[0016] The CPU 110 controls the entire camera 100. The RAM 120 is a volatile storage device such as a DRAM, in which an OS, various programs, and various data are loaded, and which is also used as a work area for the OS and various programs. The ROM 130 is a non-volatile storage device represented by a flash memory, an HDD (Hard Disk Drive), an SSD (Solid State Drive), an SD card, etc. The ROM 130 is used as a permanent storage area for the OS, various programs, and various data, and is also used as a storage area for various short-term data.

[0017] The image capture I / F 140 is connected to an image sensor 170 composed of an imaging device such as a CCD or CMOS. It converts the image data acquired from the image sensor 170 into a predetermined format, compresses it if necessary, and transfers it to the RAM 120. Also, the image capture I / F 140 performs image quality adjustment processes such as zoom, focus, and exposure control when acquiring image data from the image sensor 170, and a crop process of cutting out a partial area of the image data as a crop area. The drive control unit 180 controls the pan-tilt according to an instruction from an external communication device such as the controller 200 via the network I / F 150.

[0018] The network I / F 150 is an interface for connecting to the aforementioned IP network 300 and is responsible for communication with an external communication device such as the controller 200 via a communication medium such as Ethernet (registered trademark). The communication performed in this embodiment is, for example, the transmission and reception of requests and responses from the controller 200, and the transmission of camera video to the controller 200. In this embodiment, for the sake of simplicity, an example of remotely controlling the camera 100 via the network I / F 150 will be described, but other I / Fs such as a serial communication I / F (not shown) may be provided. Similarly, for the sake of simplicity, the transmission of the video captured by the camera 100 is assumed to be performed via the network I / F 150, but it may also be performed via other video output I / Fs. For example, the transmission of camera video may be performed via an HDMI (registered trademark) (High-Definition Multimedia Interface) or SDI (not shown) and other video output I / Fs.

[0019] Next, the configuration of the controller 200 will be described. In the controller 200, a CPU 210, a RAM 220, a ROM 230, a user input / output I / F 240, and a network I / F 250 are interconnected via an internal bus 260. Here, since the CPU 210, the RAM 220, the ROM 230, and the network I / F 250 are the same as the CPU 110, the RAM 120, the ROM 130, and the network I / F 150 of the camera 100, respectively, the description thereof will be omitted.

[0020] The user input / output I / F 240 is an interface for receiving operations from the user for the controller 200 and outputting video and the like to the user. As an example of the user input / output I / F 240, an interface for connecting to a button, a dial, a joystick, a display, a touch panel, etc. can be mentioned. Here, the touch panel and the display may be configured as an integrated type such as a touch panel-mounted display where the touch position can be known. Through these user input / output I / Fs 240, the user can control the connected camera. Also, it is possible to display the camera image on the display.

[0021] FIG. 3 is a diagram showing an example of the software configuration in the camera 100 and the controller 200. Hereinafter, the details of the software configuration of each of the camera 100 and the controller 200 will be described.

[0022] FIG. 3(a) is a diagram showing an example of the software configuration of the camera 100. When the CPU 110 executes a program, as shown in FIG. 3(a), the program is loaded into the RAM 120. Specifically, an OS 401, an imaging processing program 402, an image processing program 403, a drive control program 404, a communication control program 405, and a management program 406 are loaded onto the RAM 120.

[0023] OS401 is the basic program that controls the entire camera 100. The imaging processing program 402 controls the image capture I / F 140, and generates the data obtained from the image sensor 170 as image data according to an image acquisition request from an external communication device, an instruction from another program, or the like. The image processing program 403 performs various image processes on the image data generated by the imaging processing program 402 according to an instruction from an external communication device, another program, or the like. Here, the various image processes include, in addition to processes such as brightness, color tone, size change, setting and change of the crop area, etc., processes of converting the image data into still image data such as JPEG or moving image data such as H.264. The image data (camera video) subjected to various image processes and the result information of various image processes are passed to the communication control program 405.

[0024] The drive control program 404 controls the drive control unit 180 and the image capture I / F 140, and controls the pan / tilt / zoom position of the camera 100 according to a pan / tilt / zoom control request from an external communication device, an instruction from another program, or the like. The communication control program 405 controls the network I / F 150 and communicates with an external communication device such as the controller 200 via the IP network 300. For example, the communication control program 405 receives an acquisition request for the camera video obtained from the image sensor 170, an image process request for the camera video, a control request for the crop area such as pan / tilt / zoom, etc. Then, these requests are passed to the management program 406. Also, the communication control program 405 transmits the camera video and the result information of various image processes received from the image processing program 403 to the external communication device as a response to the image process request or an update notification of the camera information.

[0025] The management program 406 sets the control start area of the shooting area described later with respect to the shooting angle of view of the camera 100, and detects the positional relationship with the position of the crop area. Note that the control start area of the shooting area is an area set to limit the movement of the crop area, and details thereof will be described later. This control start area serves as an area for determining whether to execute control according to changes in the range of the crop area. Further, the management program 406 determines whether to control the position of the crop area or perform control of the camera's pan / tilt / zoom in response to the detection result of this positional relationship with respect to the control request of the crop area. Then, an instruction is issued to the image processing program 403 or the drive control program 404 according to the determination result. Note that the above-described acquisition request, image processing request, and control request may use a general communication protocol such as http (HyperText Transfer Protocol).

[0026] FIG. 3(b) is a diagram showing an example of the software configuration of the controller 200. When the CPU 210 executes a program, as shown in FIG. 3(b), the program is loaded into the RAM 220. Specifically, the OS 411, the input control program 412, the display control program 413, and the communication control program 414 are loaded onto the RAM 220.

[0027] The OS 411 is a basic program that controls the entire controller 200. The input control program 412 controls the user input / output I / F 240 and receives user operation information from buttons, dials, joysticks, touch panels, etc. Then, various control commands corresponding to the received operation information are generated and passed to the communication control program 414. Further, if necessary, user setting information corresponding to the operation information is generated and passed to the display control program 413.

[0028] The display control program 413 controls the user input / output I / F 240 according to the information received by the communication control program 414, and performs OSD display of the camera video captured by the camera 100 and the result information of various image processes on a display member such as a display. Further, the display control program 413 also performs OSD display of the user setting information received from the input control program 412.

[0029] The communication control program 414 receives a control command from the input control program 412, controls the network I / F 250, and performs communication processes such as transmission of requests and reception of responses with an external communication device such as the camera 100. When a response is received from the external communication device, the response is passed to the display control program 413. For example, the communication control program 414 transmits an acquisition request for the camera video obtained by the camera 100, an image process request such as various image processes, and a control request for a crop area such as pan / tilt / zoom, and receives responses to these requests. Further, the communication control program 414 also receives an update notification of camera information from the camera 100 and passes it to the display control program 413. Note that even when the camera 100 is controlled by a device other than the controller 200, the camera 100 transmits an update notification of camera information, and in this case as well, the update notification of camera information is received and passed to the display control program 413.

[0030] Next, when the user instructs the setting and control of the crop region via the input / output I / F 240 of the controller 200, the crop region information to be held as user setting information will be described with reference to FIG. 4. When the user operates a touch panel or the like and instructs the setting of the crop region via the input / output I / F 240, the input control program 412 generates the crop region information, and the display control program 413 performs OSD display of the crop region information. When performing OSD display, as shown in FIG. 4, a layout setting screen for displaying the crop region is displayed. In the layout setting screen, as the crop region information, the resolution of the camera image acquired from the camera 100, the number, arrangement of the crop regions, and the crop regions for each output terminal are also displayed so that the user can select from the layout setting screen.

[0031] As shown in FIG. 4, the crop region information includes the coordinates (x, y), width w, height h of the crop region with respect to the camera image, and the priority setting of the display region for each output terminal. Also, the spherical coordinates of the four points of the crop region corner calculated from camera information such as the coordinates, width, height, pan / tilt / zoom position, and image inversion state with respect to the camera image may be displayed as the crop region information.

[0032] Also, in this embodiment, an instruction to change the crop region shown in FIG. 4 by moving or scaling can be given, and when moving the crop region, direction-specifying control for specifying the moving direction and moving speed of the crop region shall be performed. In this case, the input control program 412 generates a control command for direction specification specifying the moving direction and moving speed and passes it to the communication control program 414. Then, the communication control program 414 transmits this control command to the camera 100 as a control request.

[0033] Next, with reference to FIGS. 5 and 6, the imaging control process for the crop region and the imaging region of the camera 100 when performing direction designation control of the crop region with respect to the camera 100 will be described. FIG. 5 is a flowchart showing an example of the processing procedure for direction designation control of the crop region by the camera 100 in the present embodiment. It is assumed that the crop region information of the already set crop region is stored in the ROM 130 of the camera 100. When a control request related to the direction designation control of the crop region is received from the controller 200, the processing is started.

[0034] First, in S501, the CPU 110 starts moving the crop region within the range of the imaging region according to the moving direction and moving speed specified by the received control request by the image processing program 403. By this processing, the CPU 110 gives an instruction for crop processing to the image capture I / F 140 and stores (updates) the position of the moved crop region in the ROM 130 as crop region information.

[0035] Next, in S502, the CPU 110 sets a control start area of the imaging region, which is a frame-shaped region with a specific width starting from the angle-of-view end within the angle of view of the imaging range of the camera 100, by the management program 406. FIG. 6(b) shows an example of the control start area 604 of the imaging region, but an area outside the angle of view of the imaging range is also set as the control start area. Regarding the width from the angle-of-view end of the control start area of the imaging region, the width from the angle-of-view end may be determined with reference to the moving speed of the crop region and the speed information of the drive control unit 180. Further, the control start area of the imaging region may be set for each of the pan, tilt, and zoom directions.

[0036] Next, in S503, the CPU 110 refers to the crop area information stored in the ROM 130 to obtain the current position of the crop area. Then, in S504, the CPU 110 determines, by means of the management program 406, whether the current position of the obtained crop area interferes with (overlaps) the control start area of the shooting area. As a result of this determination, if the current position of the crop area does not interfere with the control start area of the shooting area, the process returns to S503 to obtain the current position of the crop area again. On the other hand, if the current position of the crop area interferes with the control start area of the shooting area, the process proceeds to S505.

[0037] In S505, the CPU 110 sends, by means of the drive control program 404, a start command for the direction designation control of the pan / tilt to the drive control unit 180 to move the shooting area of the camera 100. When performing the direction designation control of the pan / tilt, the drive control unit 180 may directly inherit the designated direction of the direction designation control of the crop area. Alternatively, in consideration of the spherical coordinates, the movements of the pan / tilt may be combined so as to come closest to the designated direction of the direction designation control of the crop area.

[0038] Next, in S506, the CPU 110 stops the movement of the crop area and ends the direction designation control of the crop area by means of the image processing program 403. By this process, the CPU 110 instructs the image capture I / F 140 to stop the movement of the crop area.

[0039] FIG. 6 is a diagram for explaining the crop area, the control start area of the shooting area, and the shooting area of the camera when the direction designation control of the crop area is performed in the right direction of the angle of view. FIG. 6(a) shows the state before starting the direction designation control of the crop area for the camera 100. In the state shown in FIG. 6(a), the crop area is cut out at position 602 with respect to the shooting area 601 of the camera 100.

[0040] FIG. 6(b) shows a state where the crop region has moved from position 602 to position 603 when the direction designation control of the crop region is performed for the camera 100. In the state shown in FIG. 6(b), the control start area 604 of the imaging region is set by the process of FIG. 5, and at this stage, the crop region does not interfere with the control start area 604 of the imaging region.

[0041] FIG. 6(c) shows a state where the imaging region of the camera has moved to the right due to the crop region interfering with the control start area 604 of the imaging region. When the crop region interferes with the control start area 604 of the imaging region, the pan-tilt direction designation control for the imaging region of the camera 100 is started, and the imaging region of the camera 100 moves to the right. On the other hand, the movement of the crop region stops at position 606. As a result, in the imaging region 605 of the camera 100 after the movement, the crop region does not interfere with the control start area 604 of the imaging region.

[0042] As described above, according to the present embodiment, when the direction designation control of the crop region is performed on the imaging device, the user can operate the crop region without being conscious of the imaging direction of the camera.

[0043] (Second Embodiment) In the present embodiment, an example of performing position designation control for directly designating the pan-tilt position of the crop region when moving the crop region will be described. Note that the internal configurations of the respective devices of the imaging system in the present embodiment are the same as those in the first embodiment, and thus the description thereof is omitted. Hereinafter, only the differences from the first embodiment will be described.

[0044] When performing the position designation control, in the controller 200, the input control program 412 generates a control command for setting the crop region according to the crop region information and passes it to the communication control program 414. Then, the communication control program 414 transmits this control command to the camera 100 as a control request.

[0045] Hereinafter, with reference to FIGS. 7 and 8, the imaging control process for the crop area and the imaging area of the camera when performing position designation control of the crop area with respect to the camera 100 will be described. FIG. 7 is a flowchart showing an example of the processing procedure for position designation control of the crop area by the camera 100 in the present embodiment. It is assumed that the crop area information of the already set crop area is stored in the ROM 130 of the camera 100. When receiving a control request related to the position designation control of the crop area from the controller 200, the process starts.

[0046] In S701, the CPU 110 sets a control start area of the imaging area, which is a frame-shaped area of a specific width, from the imaging angle end of the camera 100 by the management program 406. This process is basically the same as the process of S502 in FIG. 5.

[0047] Next, in S702, the CPU 110 refers to the current crop area information and determines whether the position of the current crop area is the same as the target position of the designated crop area. As a result of this determination, if the current crop area position is already the same as the target position, the position designation control of the crop area is terminated. On the other hand, if the current crop area position is different from the target position, the process proceeds to S703.

[0048] In S703, the CPU 110 determines by the management program 406 whether the target position of the crop area interferes with the control start area of the imaging area. As a result of this determination, if the target position of the crop area interferes with the control start area of the imaging area, the process proceeds to S704. On the other hand, if the target position of the crop area does not interfere with the control start area of the imaging area, the process proceeds to S705.

[0049] In S704, the CPU 110 sends a start command for position designation control of the pan / tilt to the drive control unit 180 by the drive control program 404 to move the imaging area of the camera 100. By moving the imaging area of the camera 100, the target position of the crop area is made not to interfere with the control start area of the imaging area.

[0050] Next, in S705, the CPU 110 moves the current crop area to the target position with respect to the image capture I / F 140 by the image processing program 403, and ends the position designation control of the crop area.

[0051] FIG. 8 is a diagram for explaining the crop area, the control start area of the shooting area, and the shooting area of the camera when the position designation control of the crop area is performed to the target position. FIG. 8(a) shows a state before starting the position designation control of the crop area with respect to the camera 100. In the state shown in FIG. 8(a), the crop area is cut out at the position 802 with respect to the shooting area 801 of the camera 100. Here, the target position 803 of the crop area is specified by the control request related to the position designation control, and the target position 803 interferes with the control start area 804 of the current shooting area.

[0052] FIG. 8(b) shows a state in which the shooting area of the camera has moved to the right because the target position 803 of the crop area interferes with the control start area 804 of the shooting area. Since the shooting area of the camera 100 has moved, the target position 803 of the crop area no longer interferes with the control start area 804 of the shooting area.

[0053] FIG. 8(c) shows a state in which the crop area has moved from the position 802 to the position 806. Since the target position 803 of the crop area no longer interferes with the control start area 804 of the shooting area, the crop area can be moved.

[0054] As described above, according to the present embodiment, when the position designation control of the crop area is performed on the imaging device, the user can operate the crop area without being conscious of the shooting direction of the camera.

[0055] (Third Embodiment) In this embodiment, the processing for the crop area and the shooting area of the camera when the user performs an operation to expand or contract the size of the crop area will be described. Note that either direction-specifying control or position-specifying control may be used for the expansion / contraction operation of the crop area. Also, since the internal configuration and processing procedures of each device of the imaging system in this embodiment are the same as those in the first or second embodiment, the description thereof will be omitted. Hereinafter, only the points different from the first and second embodiments will be described.

[0056] FIG. 9 is a diagram for explaining the crop area, the control start area of the shooting area, and the shooting area of the camera when the user performs an operation to reduce the size of the crop area from the output resolution. FIG. 9(a) shows the state before the user performs the reduction operation on the crop area. In the state shown in FIG. 9(a), the crop area is cut out in the range 902 with respect to the shooting area 901 of the camera 100. Here, when a control request related to the reduction operation of the crop area is received, the control start area 903 of the shooting area is set. When the reduction operation is performed by the user, the control start area of the shooting area is set as an area having a size corresponding to the output resolution with the center coordinates of the crop area as the center.

[0057] FIG. 9(b) shows the state in which the crop area is reduced from the range 902 to the range 904 by direction-specifying control when the user performs the reduction operation on the crop area. In the state shown in FIG. 9(b), due to the reduction of the crop area, the crop area completely coincides with the control start area of the shooting area. In the first embodiment, when the moved crop area overlaps the control start area of the shooting area, the shooting area is moved. On the other hand, in the case of the reduction operation of this embodiment, at the timing when the reduced crop area interferes with (is completely included in) the control start area of the shooting area, the zoom of the shooting area is changed.

[0058] FIG. 9(c) shows a state in which the camera shooting area is reduced when the cropped area after movement interferes with (is completely included in) the control start area 903 of the shooting area. At the timing when the cropped area after reduction is completely included in the control start area of the shooting area, the CPU 110 controls the image capture I / F 140 to move the zoom of the camera 100 toward the tele side. In addition, the CPU 110 controls the pan / tilt of the camera 100 so that the center coordinates of the cropped area do not move with respect to the drive control unit 180. Thereby, in the reduced shooting area 905 of the camera 100, the cropped area can be reduced to the target range along the range of the control start area 903 of the shooting area.

[0059] Also, when the user performs a reduction operation on the cropped area and reduces the cropped area by position designation control, the same procedure is followed. Specifically, when the target position (target range) of the cropped area is completely included in the control start area of the shooting area, the range of the cropped area may be made to coincide with the target range by changing the zoom of the shooting area.

[0060] FIG. 10 is a diagram for explaining the cropped area, the control start area of the shooting area, and the shooting area of the camera when the user performs an operation to expand the size of the cropped area. FIG. 10(a) shows a state before the user performs an expansion operation on the cropped area. In the state shown in FIG. 10(a), the cropped area is cut out in the range 1002 with respect to the shooting area 1001 of the camera. Here, when a control request related to the expansion operation of the cropped area is received, the control start area 1003 of the shooting area is set. When the expansion operation is performed by the user, the control start area of the shooting area is the same as in the first and second embodiments, but it is not necessary to set the outside of the angle of view of the imaging area in the control start area.

[0061] Figure 10(b) shows the state where the crop area has been expanded from range 1002 to range 1005 by direction - specified control when the user performs an expansion operation on the crop area. Upon receiving a control request related to the expansion operation of the crop area, the CPU 110 expands the crop area with respect to the image capture I / F 140. Then, the CPU 110 further controls the pan - tilt with respect to the drive control unit 180 so that the crop area does not interfere with the control start area 1003 of the shooting area, and moves the shooting area of the camera 100.

[0062] Figure 10(c) shows the state where the crop area has been further expanded to range 1007 by direction - specified control. In the state shown in Figure 10(c), even when moving the shooting area 1006 of the camera while expanding the crop area, the crop area interferes with the control start area 1003 of the shooting area.

[0063] Figure 10(d) shows the state where the shooting area of the camera has been expanded when it becomes impossible to expand the crop area without interfering with the control start area 1003 of the shooting area. At the timing when it becomes impossible to expand the crop area, the CPU 110 controls the image capture I / F 140 to move the zoom of the camera 100 to the wide - side. Also, the CPU 110 controls the pan - tilt of the camera 100 with respect to the drive control unit 180 so that the center coordinates of the crop area do not move. Thereby, the crop area can be expanded to the target range without interfering with the control start area 1003 of the shooting area.

[0064] On the other hand, when the user performs an operation to expand the crop area and the crop area is expanded by position-specifying control, the following procedure is followed. First, the CPU 110 controls the pan / tilt of the camera 100 so that the center coordinates of the shooting area match the center coordinates of the target range of the crop area, and moves the shooting area of the camera 100. Then, when the target range of the crop area interferes with the control start area 1003 of the shooting area, the zoom of the camera 100 may be controlled to move to the wide side until it no longer interferes with the control start area 1003 of the shooting area.

[0065] As described above, according to the present embodiment, when an operation to expand or contract the size of the crop area is performed on the imaging device, the user can operate the crop area without being conscious of the shooting direction of the camera while maintaining the image quality of the output crop video.

[0066] (Fourth Embodiment) In the first embodiment, an example in which one crop area is set in the shooting area of the camera 100 has been described. In this embodiment, processing when a plurality of crop areas are set will be described. Note that the internal configuration of each device of the imaging system in this embodiment is the same as that in the first embodiment, and thus the description thereof will be omitted. Hereinafter, only the differences from the first embodiment will be described.

[0067] When a plurality of crop areas are set, priorities are assigned to each crop area. For example, when two crop areas are set, the processing contents differ depending on whether the crop area with the lower priority is moved or the crop area with the higher priority is moved. It is assumed that the crop area information of each crop area stored in the ROM 130 of the camera 100 also includes priority information. Hereinafter, the processing procedures in each case will be described.

[0068] FIG. 11 is a diagram for explaining a crop area, a control start area of a shooting area, and a shooting area of a camera when the crop area with a higher priority is controlled to be directed to the right corner direction. FIG. 11(a) shows a state before starting the direction designation control of the crop area with a higher priority for the camera 100. In the state shown in FIG. 11(a), the crop area with a higher priority is cut out at position 1102 with respect to the shooting area 1101 of the camera 100, and the crop area with a lower priority is cut out at position 1103. Further, a control start area 1104 of the shooting area is set.

[0069] FIG. 11(b) shows a state in which the crop area to be moved has moved from position 1102 to position 1105 when the direction designation control of the crop area with a higher priority is performed for the camera 100. The shooting area 1106 of the camera 100 is moved so that the crop area to be moved does not interfere with the control start area 1104 of the shooting area. In the state shown in FIG. 11(b), neither of the crop areas interferes with the control start area 1104 of the shooting area.

[0070] FIG. 11(c) shows a state in which the crop area to be moved has moved to position 1107 when the direction designation control of the crop area with a higher priority is performed for the camera 100. The shooting area 1108 of the camera 100 is moved so that the crop area to be moved does not interfere with the control start area 1104 of the shooting area. However, since the crop area that is not the target of movement has a lower priority, it remains interfering with the control start area 1104 of the shooting area.

[0071] FIG. 11(d) shows a state in which the crop region with the higher priority has moved to the target position 1109 when performing direction designation control for the crop region with the higher priority with respect to the camera 100. In the state shown in FIG. 11(d), the crop region with the lower priority is partially protruding from the imaging region 1110 of the camera 100. When moving the crop region with the higher priority as described above, the crop region and the imaging region of the camera 100 are moved so as to ignore the existence of the crop region with the lower priority. The same applies when performing position designation control for the crop region with the higher priority with respect to the camera 100.

[0072] FIG. 12 is a diagram for explaining the crop region, the control start area of the imaging region, and the imaging region of the camera when performing direction designation control for the crop region with the lower priority in the right direction of the viewing angle. FIG. 12(a) shows a state before starting the direction designation control for the crop region with the lower priority with respect to the camera 100. In the state shown in FIG. 12(a), the crop region with the lower priority is cut out at position 1202 with respect to the imaging region 1201 of the camera 100, and the crop region with the higher priority is cut out at position 1203. In addition, the control start area 1204 of the imaging region is set.

[0073] FIG. 12(b) shows a state in which the crop region to be moved has moved from position 1202 to position 1205 when performing direction designation control for the crop region with the lower priority with respect to the camera 100. The imaging region 1206 of the camera 100 is moved so that the crop region to be moved does not interfere with the control start area 1204 of the imaging region. In the state shown in FIG. 12(b), neither crop region interferes with the control start area 1204 of the imaging region.

[0074] Figure 12(c) shows the state where the crop region to be moved has moved to position 1207 when the direction designation control of the crop region with the lower priority is performed for camera 100. Since the crop regions that are not the target of movement have a higher priority, it is necessary to prevent them from interfering with the control start area 1204 of the shooting area. Therefore, the CPU 110 controls the image capture I / F 140 to move the zoom of camera 100 toward the wide side. In the state shown in Figure 12(c), in the shooting area 1208 of camera 100, none of the crop regions interfere with the control start area 1204 of the shooting area and this state is maintained.

[0075] Figure 12(d) shows the state where the crop region to be moved has moved to the target position 1209 when the direction designation control of the crop region with the lower priority is performed for camera 100. After zooming in camera 100, the shooting area 1210 of camera 100 is moved again, and the crop region to be moved is moved to the target position 1209. Note that the zoom of camera 100 may be moved toward the wide side while maintaining the state where the high-priority crop regions that are not the target of movement are in contact with the control start area 1204 of the shooting area, and the crop region to be moved may be moved to the target position 1209. Also, when performing the position designation control of the crop region with the lower priority for camera 100, the following procedure is adopted. Specifically, the zoom of camera 100 is moved toward the wide side until neither the high-priority crop regions that are not the target of movement nor the target position of the crop region to be moved interfere with the control start area of the shooting area. Then, the crop region to be moved may be moved to the target position.

[0076] As described above, according to this embodiment, when a plurality of crop regions are set and position designation control of one of the crop regions is performed on the imaging device, the user can operate the crop region without being conscious of the shooting direction of the camera.

[0077] (Other Embodiments) The present invention can also be implemented by supplying a program that realizes one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and causing one or more processors in a computer of the system or apparatus to read and execute the program. It can also be implemented by a circuit (for example, an ASIC) that realizes one or more functions.

[0078] The disclosure of the present embodiment includes the following configurations, methods, and programs.

[0079] (Configuration 1) An acquisition unit that acquires a captured image generated by an imaging unit; An image processing unit that sets a partial area of the captured image as a crop area and changes the range of the crop area within the range of the captured image by accepting a request to change the range of the crop area; A control unit that controls the imaging range of the imaging unit; A setting unit that sets an area for determining whether to execute control according to a change in the range of the crop area set by the image processing unit in an area corresponding to the imaging range of the imaging unit; Comprising The control unit performs control to change the imaging range of the imaging unit so that the crop area does not interfere with the area due to a change in the range of the crop area. An imaging control apparatus characterized by this.

[0080] (Configuration 2) The image processing unit moves the position of the crop area within the range of the captured image by accepting a request to move the position of the crop area, When the area and the crop area overlap due to the movement of the crop area, the control unit performs control to change the imaging direction of the imaging unit. The imaging control apparatus according to Configuration 1, characterized by this. (Configuration 3) The imaging control apparatus according to Configuration 2, wherein when the image processing means receives a request to move the position of the crop region by designating a moving direction, and when the area and the crop region overlap due to the movement of the crop region, the control means performs control to change the imaging direction of the imaging means in the same direction as the moving direction of the crop region so that the crop region does not overlap the area. (Configuration 4) The imaging control apparatus according to Configuration 2, wherein when the image processing means receives a request to move the position of the crop region by designating a target position, and when the area and the crop region overlap due to the movement of the crop region, the control means performs control to change the imaging direction of the imaging means so that the crop region does not overlap the area. (Configuration 5) The imaging control apparatus according to any one of Configurations 2 to 4, wherein the area is an area outside the angle of view of the imaging range and a frame-shaped area having a specific width from the angle-of-view edge within the angle of view of the imaging range.

[0081] (Configuration 6) When the image processing means receives a request to reduce the range of the crop region, the setting means sets, as the area, an area that coincides with the center coordinates of the crop region within the angle of view of the imaging range and has a size corresponding to the output resolution. The imaging control apparatus according to Configuration 1, wherein the control means performs control to reduce the imaging range of the imaging means along the area due to the reduction of the crop region. (Configuration 7) When the image processing means receives a request to expand the range of the crop region, the setting means sets, as the area, a frame-shaped area having a specific width from the angle-of-view edge within the angle of view of the imaging range. The imaging control apparatus according to Configuration 1, wherein the control means performs control to change the imaging direction of the imaging means so that the area and the crop region do not overlap due to the expansion of the crop region and control to expand the imaging range.

[0082] (Configuration 8) The imaging control device according to any one of Configurations 1 to 7, wherein the setting means sets the area for each of pan, tilt, and zoom. (Configuration 9) The imaging control device according to Configuration 5, wherein the setting means sets the width of a framed area in the area based on the imaging range of the imaging means and the moving speed of the crop area. (Configuration 10) The image processing means sets a plurality of crop areas and holds information on the priorities in the plurality of crop areas, When the image processing means receives a request to move one of the plurality of crop areas, the control means controls to change the imaging direction of the imaging means so that the area does not overlap with the crop area to be moved and a crop area having a higher priority than the crop area. The imaging control device according to any one of Configurations 2 to 5.

[0083] (Method) An acquisition step of acquiring a captured image generated by an imaging means; An image processing step of setting a partial area of the captured image as a crop area and changing the range of the crop area within the range of the captured image by receiving a request to change the range of the crop area; A control step of controlling the imaging range of the imaging means; A setting step of setting an area for determining whether to execute control corresponding to a change in the range of the crop area set in the image processing step in an area corresponding to the imaging range of the imaging means; Comprising In the control step, control is performed to change the imaging range of the imaging means so that the crop area does not interfere with the area due to a change in the range of the crop area. An imaging control method characterized by this.

[0084] (Program) An acquisition step of acquiring a captured image generated by an imaging means; An image processing step of setting a partial region of the captured image as a crop region and changing the range of the crop region within the range of the captured image by receiving a request to change the range of the crop region; A control step of controlling the imaging range of the imaging means; A setting step of setting an area for determining whether to execute control according to a change in the range of the crop region set by the image processing step in a region corresponding to the imaging range of the imaging means; Causing a computer to execute; In the control step, a program characterized in that control is performed to change the imaging range of the imaging means so that the crop region does not interfere with the area due to a change in the range of the crop region.

Explanation of Signs

[0085] 110 CPU, 140 Image Capture I / F, 170 Image Sensor, 180 Drive Control Unit

Claims

1. An acquisition means for acquiring a captured image generated by an imaging means; An image processing means for setting a partial area of the captured image as a crop area and changing the range of the crop area within the range of the captured image by receiving a request to change the range of the crop area; A control means for controlling the imaging range of the imaging means; A setting means for setting an area for determining whether to execute control according to a change in the range of the crop area set by the image processing means in an area corresponding to the imaging range of the imaging means; comprising: The control means performs control to change the imaging range of the imaging means so that the crop area does not interfere with the area due to a change in the range of the crop area. An imaging control device characterized by this.

2. The image processing means moves the position of the crop area within the range of the captured image by receiving a request to move the position of the crop area, When the area and the crop area overlap due to the movement of the crop area, the control means performs control to change the imaging direction of the imaging means. The imaging control device according to claim 1, characterized by this.

3. When the image processing means receives a request to move the position of the crop area by designating a moving direction and the area and the crop area overlap due to the movement of the crop area, the control means moves the crop area in the same direction as the moving direction of the crop area so that the crop area does not overlap with the area. The imaging control device according to claim 2, characterized by performing control to change the imaging direction of the imaging means.

4. The image processing means receives a request to move the position of the crop area by specifying a target position, and when the area and the crop area overlap due to the movement of the crop area, the control means performs control to change the imaging direction of the imaging means so that the crop area does not overlap the area. The imaging control apparatus according to claim 2, characterized in that.

5. The area is an area outside the angle of view of the imaging range and a frame-shaped area having a specific width from the angle-of-view end within the angle of view of the imaging range. The imaging control apparatus according to claim 2, characterized in that.

6. When the image processing means receives a request to reduce the range of the crop area, the setting means sets, as the area, an area that coincides with the center coordinates of the crop area within the angle of view of the imaging range and has a size corresponding to the output resolution. The control means performs control to reduce the imaging range of the imaging means so as to follow the area due to the reduction of the crop area. The imaging control apparatus according to claim 1, characterized in that.

7. When the image processing means receives a request to expand the range of the crop area, the setting means sets, as the area, a frame-shaped area having a specific width from the angle-of-view end within the angle of view of the imaging range. The control means performs control to change the imaging direction of the imaging means so that the area and the crop area do not overlap due to the expansion of the crop area and control to expand the imaging range. The imaging control apparatus according to claim 1, characterized in that.

8. The setting means sets the area for each of pan, tilt, and zoom. The imaging control apparatus according to claim 1, characterized in that.

9. The setting means sets the width of the frame-shaped area in the area based on the imaging range of the imaging means and the moving speed of the crop area. The imaging control apparatus according to claim 5, characterized in that.

10. The image processing means sets a plurality of crop regions and holds information on the priorities in the plurality of crop regions. When the image processing means receives a request to move one of the plurality of crop regions, the control means performs control to change the imaging direction of the imaging means so that the area does not overlap with the crop region to be moved and a crop region having a higher priority than the crop region. The imaging control apparatus according to claim 2, characterized in that.

11. An acquisition step of acquiring a captured image generated by an imaging means; An image processing step of setting a partial region of the captured image as a crop region and changing the range of the crop region within the range of the captured image by receiving a request to change the range of the crop region; A control step of controlling the imaging range of the imaging means; A setting step of setting an area for determining whether to execute control according to a change in the range of the crop region set in the image processing step in a region corresponding to the imaging range of the imaging means; Comprising In the control step, control is performed to change the imaging range of the imaging means so that the crop region does not interfere with the area due to a change in the range of the crop region. An imaging control method characterized by that.

12. An acquisition step of acquiring a captured image generated by an imaging means; An image processing step of setting a partial region of the captured image as a crop region and changing the range of the crop region within the range of the captured image by receiving a request to change the range of the crop region; A control step of controlling the imaging range of the imaging means; A setting step of setting an area for determining whether to execute control according to a change in the range of the crop region set in the image processing step in a region corresponding to the imaging range of the imaging means; Causing a computer to execute In the control step, a program is characterized in that control is performed to change the imaging range of the imaging means so that the crop area does not interfere with the area due to a change in the range of the crop area.

Images