Imaging device, control method for imaging device, and program

Abstract

The present invention provides an imaging device that allows for controllable settings of the imaging range while preventing unwanted areas from being captured. [Solution] An imaging device comprising: an imaging means; a direction changing means capable of changing the imaging direction in the imaging means; a control means for setting a first range as the control range of the direction changing means; and when a cropped area, which is a region cut out from a part of the imaging area currently being imaged, is set, the control means sets the first range according to the position and size of the cropped area.

Description

Technical Field

[0006] , , , , , , , ,

[0005] ,

[0001] The present invention relates to an imaging device, a control method for the imaging device, and a program.

Background Art

[0002] In recent years, in video production, video editing and distribution systems using an IP (Internet Protocol) network such as the Internet have been increasing. In a general system, a video stream such as video and audio output from a camera connected to an IP network is received by a video editing device such as a switcher, edited as broadcast video as needed, and then distributed / output. [[ID=1))

[0003] In addition, cameras used in such systems are not only of the type that a person holds for shooting, but also the type that performs pan-tilt-zoom control remotely from a distance has been increasing. In such a system, there may be a case where an area that is not desired to be photographed can be photographed by controlling the pan-tilt-zoom.

[0004] There is known a visible range limiting function that limits the imaging range by setting a limit on the visible range based on the angle of view, such as not photographing when the pan-tilt-zoom operation range is 30 degrees or more to the right or 12 degrees or less downward, so that an area that is not desired to be photographed cannot be photographed.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0006] However, when used in combination with a cropping function that cuts out and outputs a portion of the image, such as in Patent Document 1, if the visible range is set to match the full-screen image, only a narrower area than the desired area can be displayed. Alternatively, if the visible range is set to match the cropping area, changing the cropping position or size may result in displaying areas that were not intended to be shown.

[0007] Therefore, the object of the present invention is to provide an imaging device that allows control settings of the imaging range while preventing unwanted areas from being captured. [Means for solving the problem]

[0008] To achieve the above objective, an imaging device as one aspect of the present invention comprises an imaging means, a direction changing means capable of changing the imaging direction in the imaging means, a control means for setting a first range as the control range of the direction changing means, and the control means, when a cropped area is set which is a region cut out from a part of the imaging area currently being imaged, sets the first range according to the position and size of the cropped area. [Effects of the Invention]

[0009] According to the present invention, it is possible to provide an imaging device that allows control settings of the imaging range while preventing unwanted areas from being captured. [Brief explanation of the drawing]

[0010] [Figure 1] This is a block diagram showing examples of the configuration of the imaging device in each embodiment. [Figure 2] This figure shows examples of the control range, camera field of view, and cropping area in each embodiment. [Figure 3] This figure shows an example of the control range corresponding to the cut-out area in Embodiment 1. [Figure 4] This figure shows another example of the control range corresponding to the cut-out area in Embodiment 1. [Figure 5]This is a flowchart showing the process for changing the control range in Embodiment 1. [Figure 6] This figure shows the region for determining the control range for multiple cut-out regions in Embodiment 1. [Figure 7] This flowchart shows the process of changing the control range according to the cropping area setting set in the video output unit in Embodiment 1. [Figure 8] This figure shows the process of reflecting the cropping area when the cropping area is set outside the imaging permission range in Embodiment 1. [Figure 9] This flowchart shows the process of reflecting the cropping area when the cropping area is set outside the imaging permission range in Embodiment 1. [Figure 10] This flowchart shows other processes to reflect the cropping area when the cropping area is set outside the imaging permission range in Embodiment 1. [Figure 11] This figure shows an example of how the control range changes when the zoom is controlled in Embodiment 2. [Figure 12] This flowchart shows the process of changing the control range when controlling the zoom in Embodiment 2. [Modes for carrying out the invention]

[0011] The embodiments of the present invention will be described in detail below with reference to the attached drawings. The embodiments described below are merely examples of means for realizing the present invention. They should be modified or changed as appropriate depending on the configuration of the apparatus to which the present invention is applied and various conditions, and the present invention is not necessarily limited to the embodiments described below. Furthermore, not all combinations of configurations described in the embodiments are essential to the solutions of the present invention. Also, the term "image" below does not necessarily refer only to moving images, but may also refer to still images.

[0012] <Embodiment 1> Next, the configuration of the imaging device (control device) 1 in Embodiment 1 will be described with reference to FIG. 1. FIG. 1 is a block diagram showing a configuration example of the imaging device 1 of the present embodiment. In the present embodiment, as an example, the imaging device 1 is provided with a function as a control device inside, but the function as a control device may be separate from the imaging device 1.

[0013] The imaging device 1 of the present embodiment includes a system control unit 11, an imaging unit 12, an image processing unit 13, a lens drive unit 14, a zoom control unit 15, a focus control unit 16, a pan drive unit 17, a tilt drive unit 18, and a pan / tilt control unit 19.

[0014] In addition, the imaging device 1 has a recording unit 20 that records imaging conditions, image data, video data, cutout areas, etc. The imaging device 1 also has a program memory 21 that stores a control program, and a communication unit 30 that communicates with external devices such as a client device (information processing device) and a server (not shown) via a network 2. The imaging device 1 also has a video output unit 22 that outputs image data or video data to a display device (not shown). Note that the video output unit 22 may be configured to be able to output image data and video data to a plurality of display devices. The imaging device 1 also functions as an imaging system with an external device such as a client device or a server that is communicably connected via a line. Note that the number of external devices such as client devices or servers communicably connected to the imaging device 1 is not limited to one, and a plurality of them may be connected. In that case as well, the imaging device 1 functions as an imaging system with a plurality of client devices or external devices such as servers.

[0015] The recording unit 20 records the shooting angle setting values (pan value, tilt value, or zoom value) with respect to an internal storage or an external storage. Further, the recording unit 20 records parameters indicating imaging conditions such as image quality setting values, image data, video data, and settings of a cut-out area such as a cut-out position and size. Note that the recording unit 20 has a nonvolatile memory such as a flash memory or an EEPROM (Electrically Erasable Programmable Read-Only Memory). Incidentally, parameters indicating imaging conditions such as shooting angle setting values, image quality setting values, and cut-out area setting values can be stored in the nonvolatile memory.

[0016] The program memory 21 is a memory that stores a camera control program. The system control unit 11 may execute various processes in the imaging device 1 based on the camera control program recorded in the program memory 21.

[0017] The video output unit 22 also functions as output means for transmitting and receiving a control signal of a video signal (or an image signal). For example, the video output unit 22 may send a video signal (or an image signal) compliant with a communication standard such as HDMI (registered trademark) (High Definition Multimedia Interface). Also for example, the video output unit 22 may send a video signal (or an image signal) compliant with a communication standard such as SDI (Serial Digital Interface).

[0018] The system control unit 11 is control means for comprehensively controlling the entire imaging device 1. The system control unit gives processing instructions to each unit (imaging unit 12 to communication unit 30) in the imaging device 1. Further, the system control unit 11 analyzes a camera control command received from a client device via the communication unit 30, and causes each unit to execute processing according to the camera control command. Here, the camera control command includes an imaging angle control (imaging direction control) command for controlling pan, tilt, zoom, etc., an image quality control command for controlling imaging conditions such as gamma and color matrix, and a request command for requesting acquisition of image data, video data, and setting values.

[0019] The system control unit 11 outputs video data (or image data) generated by the image processing unit 13 from the video output unit 22. When a request for video data is sent from a client device, the system control unit 11 transmits the video data generated by the image processing unit 13 to the client device via the communication unit 30. Furthermore, the system control unit 11 receives a request command from the client device requesting information indicating the settings of the imaging device 1, such as zoom, focus, and pan / tilt. Upon receiving the request command, the system control unit 11 reads the requested settings (pan value, tilt value, zoom value) from the image processing unit 13, zoom control unit 15, focus control unit 16, and pan / tilt control unit 19, and transmits them to the client device via the communication unit 30. Note that the settings for zoom, focus, pan / tilt, etc., include not only the current values ​​but also related information such as the range of values ​​that can be set on the imaging device 1.

[0020] When the system control unit 11 receives an angle of view control command for setting or changing zoom, focus, pan, and tilt, it controls the image processing unit 13, zoom control unit 15, focus control unit 16, and pan / tilt control unit 19 according to the setting value indicated by the command. In this way, the system control unit 11 performs zoom control to change the zoom value in the imaging device 1. The system control unit 11 also performs pan control to change the imaging direction in the imaging means in the pan direction, and tilt control to change the imaging direction in the tilt direction. In this way, the system control unit 11 controls the zoom, pan, and tilt of the imaging device 1.

[0021] Furthermore, when the system control unit 11 receives a control command to set the field of view control range, it sets the control range for the zoom control unit 15 and the pan / tilt control unit 19 according to the setting value indicated in the command.

[0022] The image processing unit 13, zoom control unit 15, focus control unit 16, and pan / tilt control unit 19 control the operation of the imaging unit 12, lens drive unit 14, pan drive unit 17, and tilt drive unit 18, respectively, in response to control from the system control unit. This ensures that the zoom, focus, pan, and tilt settings configured on the client device are reflected in the imaging device 1. If a control range is set, the zoom, pan, and tilt settings configured on the client device are limited to the set control range.

[0023] Furthermore, when the system control unit 11 receives a control command to set the cropping area, it controls the operation of the image processing unit 13 according to the setting value indicated in the command. The image processing unit 13 generates video data by cropping a portion of the video data captured by the imaging unit 12, in response to the control from the system control unit 11.

[0024] Furthermore, when the system control unit 11 receives an image quality control command to set gamma or other parameters, it controls the operation of the image processing unit 13 according to the setting value indicated in the command. The image processing unit 13 controls the operation of the imaging unit 12 in response to the control from the system control unit 11. As a result, the gamma setting value set on the client device is reflected in the imaging device 1.

[0025] The imaging unit 12 includes a lens (optical element) and an image sensor, and performs imaging of the subject and conversion to an electrical signal. The image sensor has a semiconductor element such as a CMOS (Complementary Metal Oxide Semiconductor) sensor or a CCD (Charge Coupled Device) sensor. The image processing unit 13 performs predetermined image processing, resolution conversion processing, and compression encoding processing on the electrical signal captured and photoelectrically converted by the imaging unit 12 to generate image data and video data. The image data and video data generated by the image processing unit 13 are transmitted to the display device by the video output unit 22 and to the client device via the network 2 by the communication unit 30. In this embodiment, the imaging unit 12 and the image processing unit 13 also function as imaging means.

[0026] The lens drive unit 14 includes the drive system for the focus lens and zoom lens of the imaging unit 12, as well as a motor that serves as its drive source, and is controlled by the zoom control unit 15 and the focus control unit 16.

[0027] The zoom control unit 15 instructs the lens drive unit 14 to change the zoom lens position based on the zoom setting value instructed by the system control unit 11. Here, the zoom control unit 15 manages the focal length as the zoom setting value. The focus control unit 16 instructs the lens drive unit 14 to change the focus lens position based on the focus setting value instructed by the system control unit 11. The focus position is changed as the position of the focus lens is changed.

[0028] The pan drive unit 17 is equipped with a mechanical drive system and a motor that perform panning, and performs panning in response to control from the pan / tilt control unit 19. In other words, the pan drive unit 17 changes the imaging direction in the pan direction. The tilt drive unit 18 is equipped with a mechanical drive system and a motor that perform tilting, and performs tilting in response to control from the pan / tilt control unit 19. In other words, the tilt drive unit 18 changes the imaging direction in the pan direction. In this embodiment, the pan drive unit 17 and the tilt drive unit 18 also function as imaging direction changing means that can change the imaging direction of the imaging device 1. In addition to the pan drive unit 17 and the tilt drive unit 18, a lens drive unit 14 that can adjust the position of the zoom lens and the focus lens may also be included and function as an imaging direction changing means.

[0029] The pan-tilt control unit 19 controls the operation of the pan drive unit 17 and the tilt drive unit 18 based on the pan-tilt setting values ​​instructed by the system control unit 11, thereby changing the imaging direction in the pan and tilt directions.

[0030] The operation of the imaging device 1 of this embodiment will be described below with reference to Figures 2 to 10. Figure 2 is a diagram showing an example of the control range, camera field of view, and cropping area of ​​the imaging device 1 in this embodiment. In Figure 2, the imaging range (second range) 100 is the range that can be captured by the imaging means described above, and the area currently being captured by the imaging device 1 is the imaging area 110. A cropping area 120 is set within the imaging area 110. The cropping area 120 is an area extracted from a part of the image or video captured by the imaging device 1. Therefore, the cropping area 120 can be set within the imaging area 110, which is the area currently being captured by the imaging device 1 as described above. The cropping area is set when the user operates the client device to set the area to be cropped within the imaging area 110, a control command related to the setting of the cropping area is sent to the imaging device 1, and the system control unit 11 sets the cropping area upon receiving the control command. Note that if the user operates the client device to set the area to be cropped within the imaging area 110, the client device may also be configured to set the cropping area.

[0031] Here, when the user operates the client device and sets the control range for the imaging direction of the imaging device 1, the system control unit 11 sets the control range (first range) 130. The control range 130 is the driveable range (drive control range) of the direction changing means described above in the imaging device 1. In other words, it is also the control range (operating range) when the pan-tilt control unit 19 controls the operation of the direction changing means. The control range 130 is a range narrower than the imaging range 100. The control range 130 is the range shown by the dashed line (single dot chain line) in Figure 2. In this way, the control range for the imaging direction, which can be arbitrarily set by the user, can be set so that, for example, the imaging direction is controlled for a range narrower than the imaging range 100. By setting the control range, the imaging range can be limited, and areas that are not to be photographed can be prevented from being photographed.

[0032] The imaging permission range (third range) 140 is the range in which imaging is permitted by the imaging device 1. In other words, it is the range in which imaging is possible by the imaging device 1 when the control range 130 is set. The imaging permission range 140 is wider than the control range 130. That is, the imaging permission range 140 is narrower than the imaging-possible range 100, and the control range is narrower than the imaging permission range 140. The imaging permission range 140 is set by the user. Alternatively, the imaging permission range 140 may be set by the system control unit 11 based on the first range, the control range 130. For example, when the control range 130 is set by the user, the system control unit 11 calculates and sets the control range 130 according to its position and size relative to the imaging-possible range 100.

[0033] Figure 3 shows an example of a control range corresponding to the cropping area in this embodiment. In Figure 3(A), the cropping area 120 is set to the center of the imaging area 110. At this time, the imaging device 1 can output video data or image data of the cropping area 120, which is a part of the imaging area 110. Here, for example, if the imaging device 1 has a control range 130 shown by a dashed line set, and the imaging area 110 is output, the imaging permission area 140 can be imaged. However, if the cropping area 120 is output, it becomes impossible to image a part of the imaging permission area 140. At this time, if a control range 131, which is a different range (different area) from the control range 130, can be set, the imaging permission area 140 can be imaged even if the cropping area 120 is output. However, at this time, if the imaging area 111 is output instead of the cropping area 120, it will output a part of the area outside the imaging permission area 140. The control range 131 is the range shown by a dashed line in Figure 3(B).

[0034] Figure 4 shows another example of the control range corresponding to the cropping area in this embodiment. In Figure 4, cropping area 121 is set at a different position from cropping area 120 in Figure 3. In this case, as in the case of Figure 3, if a control range is set for cropping area 121 so that the imaging permission area 140 can be imaged, it is necessary to set the control range 132 shown by the dashed line in Figure 4(B). When the control range 132 is set and the imaging area 112 is output, it will output with a portion of the area outside the imaging permission area 140 shifted, as in Figure 3(B).

[0035] Thus, when the position and size settings of the cropped area relative to the imageable range differ, the control range that needs to be set also differs. Therefore, users had to manually set the control range each time according to the position and size of the cropped area relative to the imageable range.

[0036] Figure 5 is a flowchart illustrating the process for changing the control range of the imaging device 1 in this embodiment. The process for changing the control range of the imaging device 1 shown in the flowchart of Figure 5 will be described below. Note that each operation (process) shown in the flowchart of Figure 5 is controlled by the system control unit 11 executing a control program recorded in the program memory 21, etc. In addition, the notation of each process (step) is omitted by prefixing it with S.

[0037] In S200, the system control unit 11 determines whether or not there has been a change in the cropping area settings. If the determination shows that there has been no change in the cropping area settings, it waits until a change occurs. On the other hand, if there has been a change in the cropping area settings, the process proceeds to S201. In S200, the system control unit 11 determines that there has been a change in the cropping area settings when the user operates the client device and camera control is performed to instruct the imaging device 1 to change the position or size of the cropping area. In other words, the system control unit 11 determines that there has been a change in the cropping area settings when the imaging device 1 receives a camera control command from the client device instructing a change in the position or size of the cropping area in response to user operation.

[0038] In S201, the system control unit 11 calculates the range (control range) that should be set as the control range for each drive unit in accordance with the position and size of the modified cropping area. If a control range has already been set, the system control unit 11 recalculates a new control range based on the position and size of the modified cropping area relative to the imaging range.

[0039] Furthermore, in S201, a new control range may be determined based on the position and size of the modified cropping area and the control range matched to the imaging area. Alternatively, a new control range may be determined based on the position and size of the cropping area before modification, the amount of change in the position and size of the modified cropping area, and the current control range. In addition, the corresponding values ​​may be recorded in the recording unit 20 according to each method of determination.

[0040] In S202, the system control unit 11 reflects (sets) the control range calculated in S201. That is, the system control unit 11 sets a control range for the pan / tilt control unit and the imaging angle control unit that matches the position and size of the modified cropping area acquired in S201.

[0041] In this manner, when there is a change in the setting of the cropping area, the system control unit 11 changes the currently set first range, which is the control range, based on the position and size of the changed cropping area relative to the imageable area. If a control range has already been set, the system control unit 11 changes the currently set first range, which is the control range, to become the new control range according to the calculation result in S201. The system control unit 11 also records the control range calculated in S201 in the recording unit 20.

[0042] As described above, when the cropped area, which is a portion of the currently imaging area, is changed, the system control unit 11 automatically changes the currently set control range based on the position and size of the cropped area relative to the imaging range. However, the system control unit 11 does not only change the control range when the cropped area is changed. That is, when a newly set cropped area is created, such as by deleting an initially set or previously set cropped area, the system control unit 11 sets the control range based on the position and size of the cropped area relative to the imaging range.

[0043] This allows the user to control the imaging direction in the imaging device 1 to meet the user-defined imaging permission range without having to issue instructions to change the control range using another device or input means, such as a client device.

[0044] Figure 6 shows the region for determining the control range for multiple cropping regions in a modified example of this embodiment. In Figure 6, an example is shown where cropping regions 122 and 123 are set for the imaging region 110. As shown, there is not limited to one cropping region, but multiple regions may be set.

[0045] Here, we assume that cropping regions 122 and 123 are set in the imaging device 1. In this case, in order for both cropping regions 122 and 123 to satisfy the imaging permission range 140, it is necessary to calculate the control range for the encompassing region 150 that includes cropping regions 122 and 123. Thus, when multiple cropping regions are set for the imaging region 110, it is necessary to determine the control range for the region that encompasses the multiple cropping regions. The calculation and setting of the encompassing region 150 is performed by the system control unit 11. That is, when multiple cropping regions are set, the system control unit 11 calculates and sets a encompassing region that includes the multiple cropping regions based on the position and size of the multiple cutouts. At this time, the multiple cropping regions may overlap or may encompass other cropping regions.

[0046] Figure 7 is a flowchart showing the process of changing the control range in a modified example of this embodiment. The process shown in Figure 7 will be described below. Note that each operation (process) shown in the flowchart of Figure 7 is controlled by the system control unit 11 executing a control program recorded in the program memory 21, etc. Also, each process (step) is indicated by prefixing it with S, thus omitting the notation of the process (step). Here, processes similar to those in Figure 5 are denoted with the same reference numerals. Therefore, a detailed explanation of processes similar to those in Figure 5 will be omitted.

[0047] In S210, the system control unit 11 determines whether there has been a change in the settings of the cropping area, which is set to be output to the video output unit 22, or set to be output from the video output unit 22. If the determination shows that there has been no change in the settings of the cropping area, the system control unit 11 waits until there has been a change in the settings of the cropping area. On the other hand, if there has been a change in the settings of the cropping area, the system proceeds to S211. Here, the system control unit 11 determines that there has been a change in the settings of the cropping area, for example, if multiple cropping areas are set and one of the cropping areas is changed, or if multiple cropping areas are changed. In other words, if multiple cropping areas are set and one or more of the settings of the cropping area are changed, the system control unit 11 determines that there has been a change in the settings of the cropping area. Furthermore, in S210, the system control unit 11 determines that there has been a change in the settings of the cropping area when the user operates the client device and camera control is performed to instruct the camera to change the position or size of the cropping area of ​​the imaging device 1. Furthermore, in S210, the system control unit 11 may determine whether or not there has been a change in the settings of the cropping area, as shown in S200 of Figure 5, regardless of whether or not there has been a change in the settings of the cropping area that is set to be output to the video output unit 22.

[0048] In S211, the system control unit 11 calculates an inclusive region as a region that matches the position and size of multiple cropping regions, including the modified cropping region. In S212, the system control unit 11 calculates the control range based on the inclusive region calculated in S211. That is, the system control unit 11 calculates the range that should be set as the range for controlling each drive unit (control range) based on the position and size of the inclusive region relative to the imaging range.

[0049] In S202, the system control unit 11 reflects (sets) the control range calculated in S212. If a control range has already been set, the system control unit 11 sets the control range calculated in S212 as a new technical range in S202.

[0050] As described above, when at least one of the multiple cropping regions is changed, the system control unit 11 calculates an inclusive region based on the position and size of the multiple cropping regions, including the changed cropping region, relative to the imaging range. Then, based on the calculated inclusive region, it automatically changes the currently set control range. Note that the setting of the control range by the system control unit 11 is not limited to when the cropping region is changed. That is, when at least one of the initially set or previously set cropping regions is deleted, etc., and a new cropping region is set, the system control unit 11 calculates an inclusive region based on the multiple cropping regions. Then, it sets the control range based on the position and size of the inclusive region relative to the imaging range.

[0051] Figure 8 shows the process of reflecting the cropping area when it is set outside the imaging permission range 140 in this embodiment. Figure 8(A) shows an example in which the cropping position and size are changed to cropping area 125, starting from a state in which the imaging area 110 and cropping area 124 are set within the imaging permission range 140. Figure 8(B) shows an example in which the position of the cropping area 125 is changed again so that the cropping area is included within the range 140 of the imaging permission range 140.

[0052] In this embodiment, if the currently set cropping area 124 is set to be outside the imaging permission range 140, the system control unit 11 will reconfigure the position for setting the modified cropping area 125. When this reconfiguration is performed, the imaging area 110 is not changed, and the cropping area 126 is reconfigured to be within the imaging permission range 140 as the modified cropping area.

[0053] Figure 8(C) shows an example where the cropping area settings after changing the zoom, pan, and tilt are reflected so that the cropping area is included within the imaging permission range 140. In the case shown in Figure 8(C), the imaging area 110 is changed to imaging area 113 so that the modified cropping area 125 is within the imaging permission range 140, and then the cropping area 125 is reset. Thus, in this embodiment, as shown in Figure 8(B), if the cropping area is set outside the imaging permission range, it is possible to reset only the cropping area so that it is within the imaging permission range without changing the imaging area. Furthermore, as shown in Figure 8(C), it is also possible to reset the imaging area so that the cropping area is within the imaging permission range 140, and then reset the cropping area.

[0054] Figure 9 is a flowchart showing the process for reflecting the cropped area when the cropped area is set outside the imaging permission range in this embodiment. Figure 10 is a flowchart showing another process for reflecting the cropped area when the cropped area is set outside the imaging permission range in this embodiment.

[0055] The following describes the process of changing the control range in the imaging device 1, as shown in the flowchart of Figure 9. Each operation (process) shown in the flowchart of Figure 9 is controlled by the system control unit 11 executing a control program recorded in the program memory 21, etc. Furthermore, each step is preceded by an "S" to omit the notation of the step itself.

[0056] In S220, the system control unit 11 determines whether there has been a change in the settings for the cut-out area. If the determination shows that there has been no change in the settings for the cut-out area, it waits until a change occurs in the settings for the cut-out area. On the other hand, if there has been a change in the settings for the cut-out area, it proceeds to S221. Note that S220 is the same process as S200, so a detailed explanation is omitted.

[0057] In S221, the system control unit 11 determines whether the cropping area set in S220 is set outside the permitted imaging range. If the result of the determination is that the cropping area is set outside the permitted range, the process proceeds to S222. On the other hand, if the cropping area is not set outside the permitted imaging range, the process proceeds to S224. In addition, in S221, the system control unit 11 may control the zoom control unit 15 and the pan / tilt control unit 19 so that the cropping area is within the permitted imaging range at the position and size of the cropping area set in S220.

[0058] In S222, the system control unit 11 adjusts at least the position of the cropping area set in S220 so that it falls within the imaging permission range. The system control unit 11 may also adjust the size of the cropping area in addition to its position to ensure that the cropping area set in S220 is contained within the imaging permission range.

[0059] In S223, the system control unit 11 reflects the cutout area changed in S222 (reconfigures the cutout area). Alternatively, in S223, the system control unit 11 may record the information of the cutout area changed in S222 in the recording unit 20.

[0060] In S224, the system control unit 11 calculates and sets the range (control range) that should be set as the control range for each drive unit in accordance with the position and size of the modified cutout area. Note that S224 is the same process as S201, so a detailed explanation is omitted.

[0061] The following describes the process of changing the control range in the imaging device 1, as shown in the flowchart of Figure 10. Each operation (process) shown in the flowchart of Figure 10 is controlled by the system control unit 11 executing a control program recorded in the program memory 21, etc. Furthermore, the notation of each process (step) is omitted by prefixing it with "S".

[0062] In S230, the system control unit 11 determines whether there has been a change in the settings for the cut-out area. If the determination shows that there has been no change in the settings for the cut-out area, it waits until a change occurs in the settings for the cut-out area. On the other hand, if there has been a change in the settings for the cut-out area, it proceeds to S231. Note that S230 is the same process as S200, so a detailed explanation is omitted.

[0063] In S231, the system control unit 11 determines whether the cropping area set in S230 is set outside the permitted imaging range. If the result of the determination is that the cropping area is set outside the permitted range, the process proceeds to S232. On the other hand, if the cropping area is not set outside the permitted imaging range, the process proceeds to S234.

[0064] In S232, the system control unit 11 controls the zoom control unit 15 and the pan / tilt control unit 19 so that the cropped area is within the imaging permission range at the position and size of the cropped area set in S230. In S232, the position and size of the cropped area set in S230 are also changed so that it is within the imaging permission range. When changing the cropped area, the system control unit 11 may change at least the position of the cropped area so that the cropped area set in S230 is within the imaging permission range.

[0065] In S233, the system control unit 11 reflects the cutout area changed in S232 (reconfigures the cutout area). Alternatively, in S233, the system control unit 11 may record the information of the cutout area changed in S232 in the recording unit 20.

[0066] In S234, the system control unit 11 calculates and sets the range (control range) that should be set as the control range for each drive unit in accordance with the position and size of the modified cutout area. Note that S234 is the same process as S201, so a detailed explanation is omitted.

[0067] As shown in the processing flows in Figures 9 and 10, the system control unit 11 modifies the cropping area, or the image area and cropping area, so that the cropping area is within the image permission range if the cropping area is changed to be outside the image permission range. This allows the user to change the cropping area without having to be aware of the image permission range set by the user.

[0068] In this embodiment, at S200, the system control unit 11 determines whether or not there has been a change in the setting of the cropping region. However, as shown in Figure 7, the system control unit 11 may also determine whether or not there has been a change in the setting of the cropping region that is set to be output to the video output unit 22. For example, suppose a first cropping region setting and a second cropping region setting are set in the imaging device 1, and the first cropping region setting is set for the video output unit 22. In that case, the system control unit 11 may determine whether or not the setting of the first cropping region has been changed. Similarly, if a second cropping region setting is set for the video output unit 22, the system control unit 11 may determine whether or not the setting of the second cropping region has been changed. Furthermore, suppose a multiple cropping region setting, for example, a first cropping region setting and a second cropping region setting, is set for the video output unit 22. In that case, the system control unit 11 may determine whether or not the setting of either or both cropping regions has been changed.

[0069] In this embodiment, in S201, the system control unit 11 determines the range to be set as the control range according to the position and size of the modified cropped area. However, as shown in Figure 7, the system control unit 11 may determine the range to be set as the control range according to the position and size of the modified cropped area of ​​the cropped area set to be output to the video output unit 22. For example, suppose a first cropped area setting and a second cropped area setting are set in the imaging device 1, and the first cropped area setting is set for the video output unit 22. In that case, the system control unit 11 may determine the control range according to the position and size of the modified first cropped area. Similarly, if a second cropped area setting is set for the video output unit 22, the system control unit 11 may determine the control range according to the position and size of the second cropped area. Furthermore, suppose a case is assumed where multiple cropped area settings are set for the video output unit 22, for example, both the first cropped area setting and the second cropped area setting are set. In that case, the system control unit 11 may determine the control range according to the position and size that encompass the positions and sizes of both modified cropped areas.

[0070] As described above, the imaging device 1 of Embodiment 1 can automatically change the control range in response to changes in the cropping area, etc. This makes it possible to set an appropriate control range according to the position and size of the cropping area. Therefore, the user can control the imaging direction to satisfy the imaging permission range that they have set, without having to be aware of the imaging permission range or the control range.

[0071] <Embodiment 2> The imaging device of Embodiment 2 will be described below with reference to Figures 11 and 12. Note that explanations of parts similar to those of Embodiment 1 will be omitted as appropriate. Embodiment 1 described above explained how to change the control range when the cropping area is changed. In Embodiment 2, the system control unit 11 determines whether the zoom in the imaging device 1 has been changed and changes (sets) the control range according to the changed zoom setting. The details of Embodiment 2 will be described below with reference to Figures 11 and 12.

[0072] Figure 11 shows an example of changing the control range when controlling the zoom of the imaging device 1 in this embodiment. In Figure 11(A), a cropping area 120 is set at the center of the imaging area 110. At this time, the controllable range in the imaging direction relative to the permitted imaging range 140 is the control range 130. Figure 11(B) shows an example where, starting from the state in Figure 11(A), the zoom is controlled in the telephoto direction so that the imaging area becomes 114, and pan and tilt are controlled so that the cropping area 120 touches the boundary of the permitted imaging range 140. At this time, the controllable range in the imaging direction relative to the permitted imaging range 140 is the control range 133. Thus, even when there is no change in the cropping area, it is necessary to change the imaging range by controlling the zoom.

[0073] Figure 12 is a flowchart showing the process of changing the control range when controlling the zoom in Embodiment 2. The process shown in Figure 7 will be described below. Note that each operation (process) shown in the flowchart of Figure 12 is controlled by the system control unit 11 executing a control program recorded in the program memory 21, etc. Also, each process (step) is indicated by prefixing it with S, and the notation of the process (step) is omitted. Here, processes similar to those in Figure 5 are given the same reference numerals. Therefore, a detailed explanation of processes similar to those in Figure 5 will be omitted.

[0074] In S240, the system control unit 11 determines whether the zoom has been changed. If the result of the determination is that the zoom has not been changed, it waits until the zoom is changed. On the other hand, if the zoom has been changed, it proceeds to S241. In S240, the system control unit 11 determines that the zoom has been changed when the user operates the client device and camera control is performed to instruct the imaging device 1 to change the zoom setting. In other words, the system control unit 11 determines that the zoom has been changed when the imaging device 1 receives a camera control command instructing a change in zoom that is transmitted from the client device in response to user operation.

[0075] In S241, the system control unit 11 calculates the range to be set as the control range for each drive unit (control range). In S241, the system control unit 11 calculates the control range according to the changed zoom setting value. Specifically, the system control unit 11 determines the control range from the changed zoom setting value, the position and size of the cropping area, and the control range set to match the imaging area (currently set control range). Alternatively, the system control unit 11 may determine the control range from the zoom setting value before and after the change, the position and size of the cropping area, and the current control range.

[0076] In S202, the system control unit 11 reflects (sets) the control range calculated in S241. If a control range has already been set, the system control unit 11 sets the control range calculated in S241 as the new technical range in S202.

[0077] Furthermore, the term "zoom" (zoom operation) used here may include not only zoom control that instructs a change in the zoom lens position, but also zoom control through image processing such as digital zoom and digital teleconverter.

[0078] Furthermore, if multiple cropping regions are set, the same process as in S211 of Figure 7 in Embodiment 1 may be performed. That is, in that case, the system control unit 11 calculates an inclusive region as a region that matches the position and size of the multiple cropping regions, including the modified cropping region. Then, the system control unit 11 calculates and sets the control range based on the position and size of the calculated inclusive region and the modified zoom setting value.

[0079] Furthermore, if changing the zoom setting causes at least one of the imaging area or cropping area to fall outside the permitted imaging range, the cropping area may be modified to bring it within the permitted imaging range, similar to the process in Figure 9. Alternatively, the process shown in Figure 10 may be modified to control pan and tilt so that they remain within the permitted imaging range.

[0080] As described above, according to the imaging device 1 of Embodiment 2, even when the control range changes according to the position and size of the cropping area due to a change in zoom, it is possible to automatically set the control range to satisfy the imaging permission range set by the user.

[0081] Although embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of its gist. Furthermore, the present invention can take the form of, for example, a system, apparatus, method, program, or recording medium.

[0082] The present invention can also be realized by supplying a program that implements one or more of the functions of each of the above embodiments to a system or device via a network or storage medium, and by a process in which one or more processors in the computer of that system or device read and execute the program. Furthermore, the present invention can also be realized by a circuit (e.g., an ASIC) that implements one or more of the functions of each of the above embodiments.

[0083] Furthermore, the control means (control device) in each of the above embodiments may be implemented by hardware or by software.

[0084] Furthermore, the present invention is not limited to the embodiments described above, and various modifications are possible without departing from the spirit of the invention. For example, combinations of the embodiments and modifications are also included in the disclosure of this specification.

[0085] This embodiment includes the following configurations, methods, and programs.

[0086] (Composition 1) Imaging means, The imaging means includes a direction changing means that can change the imaging direction, A control means for setting a first range as the control range of the direction changing means, When a cropped area, which is a region extracted from a part of the currently imaging area, is set, the control means sets the first range according to the position and size of the cropped area. An imaging device characterized by the following features.

[0087] (Configuration 2) The imaging apparatus according to Configuration 1, characterized in that the control means changes the currently set first range based on the position and size of the cropping region relative to the second range which is the range in which imaging is possible in the imaging means.

[0088] (Composition 3) The imaging apparatus according to configuration 1 or 2, characterized in that, when there is a change in the setting of the cropping area, the control means changes the currently set first range based on the position and size of the changed cropping area relative to the second range which is the range that can be imaged by the imaging means.

[0089] (Composition 4) The imaging apparatus according to any one of configurations 1 to 3, characterized in that the first range is a range in which the imaging area is narrower than the second range, which is the region in the imaging means where imaging is possible.

[0090] (Composition 5) The first range is narrower than the third range, which is the range in which imaging is permitted by the imaging means. The imaging apparatus according to any one of configurations 1 to 4, characterized in that the third range is a narrower range than the second range.

[0091] (Composition 6) When multiple cutting regions are set, the control means calculates an inclusive region that encompasses the multiple cutting regions based on the position and size of the multiple cutting regions. An imaging device according to any one of configurations 1 to 5, characterized in that the first range is set based on the aforementioned inclusive region.

[0092] (Composition 7) If there is a change in the setting of one or more of the multiple cutting regions, the control means calculates an inclusive region that encompasses the multiple cutting regions based on the position and size of the multiple cutting regions, including the changed cutting region. An imaging device according to any one of configurations 1 to 5, characterized in that the first range is set based on the aforementioned inclusive region.

[0093] (Composition 8) The system includes output means for outputting at least one of the cropped area or the imaging area to a display device, The imaging apparatus according to any one of configurations 1 to 7, characterized in that, when there is a change in the cropping area set to be output from the output means, the control means changes the currently set first range based on the position and size of the changed cropping area relative to the second range which is the range that can be imaged by the imaging means.

[0094] (Composition 9) The imaging apparatus according to any one of configurations 1 to 8, characterized in that the control means readjusts the cropping area to be within the third range when the cropping area is set outside the third range which is the range in which imaging is permitted by the imaging means.

[0095] (Composition 10) The imaging apparatus according to any one of configurations 1 to 8, characterized in that, when the cropping area is set outside the third range which is the range in which imaging is permitted by the imaging means, the control means controls the direction changing means to change the imaging direction so that the cropping area is within the third range, and then readjusts the position and size of the cropping area.

[0096] (Composition 11) The imaging apparatus according to any one of configurations 1 to 10, characterized in that the control means sets the control range based on the zoom setting value of the imaging means.

[0097] (Composition 12) The imaging apparatus according to any one of configurations 1 to 11, characterized in that when the zoom of the imaging means is changed, the control means sets a new first range based on the changed zoom setting value, the position and size of the cropping area, and the currently set first range.

[0098] (Composition 13) A method for controlling an imaging device, The system includes a setting step of setting a first range as the control range of a direction changing means that can change the imaging direction in the imaging means, In the setting step, if a cropped area, which is a region extracted from a part of the currently imaging area, is set, the first range is set according to the position and size of the cropped area. A control method for an imaging device, characterized by the following:

[0099] (Composition 14) A program for causing a computer to execute a control method for an imaging device, wherein the program causes the computer to: A setting step is performed to set a first range as the control range of the direction changing means that can change the imaging direction in the imaging means. In the setting step, if a cropped area, which is a region extracted from a part of the currently imaging area, is set, the first range is set according to the position and size of the cropped area. A program characterized by the following features. [Explanation of symbols]

[0100] 11 System Control Unit 12 Imaging Unit 19 Pan-Tilt Control Unit 15 Zoom Control Unit 20 Records Section 22 Video output section 30 Communications Department

Claims

1. Imaging means, The imaging means includes a direction changing means that can change the imaging direction, The system includes a control means for setting a first range as the control range of the direction changing means, When a cropped area, which is a region extracted from a part of the currently imaging area, is set, the control means sets the first range according to the position and size of the cropped area. An imaging device characterized by the following features.

2. The imaging apparatus according to claim 1, characterized in that the control means changes the currently set first range based on the position and size of the cropping region relative to the second range which is the range in which imaging is possible in the imaging means.

3. The imaging apparatus according to claim 1, characterized in that, when there is a change in the setting of the cropping area, the control means changes the currently set first range based on the position and size of the changed cropping area relative to the second range which is the range in which imaging is possible by the imaging means.

4. The imaging apparatus according to claim 1, characterized in that the first range is narrower than the second range, which is the region in the imaging means where imaging is possible.

5. The first range is narrower than the third range, which is the range in which imaging is permitted by the imaging means. The imaging apparatus according to claim 1, characterized in that the third range is a narrower range than the second range.

6. When multiple cutting regions are set, the control means calculates an inclusive region that encompasses the multiple cutting regions based on the position and size of the multiple cutting regions. The imaging apparatus according to claim 1, characterized in that the first range is set based on the aforementioned comprehensive region.

7. When the setting of one or more of the multiple cutting regions is changed, the control means calculates an inclusive region that encompasses the multiple cutting regions, based on the position and size of the multiple cutting regions, including the changed cutting region. The imaging apparatus according to claim 1, characterized in that the first range is set based on the aforementioned comprehensive region.

8. The system includes output means for outputting at least one of the cropped area or the imaging area to a display device, The imaging apparatus according to claim 1, characterized in that, when there is a change in the cropping area set to be output from the output means, the control means changes the currently set first range based on the position and size of the changed cropping area relative to the second range which is the range that can be imaged by the imaging means.

9. The imaging apparatus according to claim 1, characterized in that the control means readjusts the cropping area to be within the third range if the cropping area is set outside the third range which is the range in which imaging is permitted by the imaging means.

10. The imaging apparatus according to claim 1, characterized in that, if the cropping area is set outside the third range which is the range in which imaging is permitted by the imaging means, the control means controls the direction changing means to change the imaging direction so that the cropping area is within the third range, and then readjusts the position and size of the cropping area.

11. The imaging apparatus according to claim 1, characterized in that the control means sets the control range according to the zoom setting value of the imaging means.

12. The imaging apparatus according to claim 1, characterized in that when the zoom in the imaging means is changed, the control means sets a new first range based on the changed zoom setting value, the position and size of the cropping area, and the currently set first range.

13. A method for controlling an imaging device, The system includes a setting step of setting a first range as the control range of a direction changing means that can change the imaging direction in the imaging means, In the setting step, if a cropped area, which is a region extracted from a part of the currently imaging area, is set, the first range is set according to the position and size of the cropped area. A control method for an imaging device, characterized by the following:

14. A program for causing a computer to execute a control method for an imaging device, wherein the program causes the computer to: A setting step is performed to set a first range as the control range of the direction changing means that can change the imaging direction in the imaging means. In the setting step, if a cropped area, which is a region extracted from a part of the currently imaging area, is set, the first range is set according to the position and size of the cropped area. A program characterized by the following features.

Images