Image capture device, image capture device control method and program

The imaging device addresses inconsistent image movement in PTZ cameras by calculating target speeds and controlling acceleration/deceleration times based on the angle of view, ensuring smooth image transitions.

JP7581006B2Active Publication Date: 2024-11-12CANON KK
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2020170628
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2020-10-08
Publication Date
2024-11-12
Estimated Expiration
2040-10-08

AI Technical Summary

Technical Problem

The acceleration or deceleration required to reach a target panning or tilting speed varies with the angle of view in PTZ cameras, leading to inconsistent movement of captured images, causing discomfort to users.

Method used

An imaging device with pan-tilt driving means and control logic that calculates target speeds based on the angle of view, ensuring constant acceleration and deceleration times to maintain consistent image movement.

Benefits of technology

Reduces the sense of discomfort from captured images by maintaining consistent movement regardless of the angle of view.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007581006000001
    Figure 0007581006000001
  • Figure 0007581006000002
    Figure 0007581006000002
  • Figure 0007581006000003
    Figure 0007581006000003
Patent Text Reader

Abstract

To reduce discomfort felt from a photographed video.SOLUTION: An imaging apparatus comprises: an imaging unit 1001 that photographs an image; a zoom driving unit 1003 that controls the angle of view of the imaging unit 1001; a pan driving unit 1004 that rotates the imaging unit 1001 in a pan direction and a tilt driving unit 1005 that rotates the imaging unit in a tilt direction; and pan-tilt control means that controls the pan driving unit 1004 and the tilt driving unit 1005. The pan-tilt control means controls, based on the angle of view controlled by the zoom driving unit 1003, the acceleration or deceleration of the pan driving unit 1004 and the tilt driving unit 1005 so that the acceleration time or the deceleration time of the movement of the video photographed by the imaging unit 1001 becomes constant.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an imaging device, a video distribution system, and a control method and program for an imaging device. [Background technology]

[0002] In surveillance systems and video distribution systems, there are cameras equipped with a pan-tilt (PT) mechanism that rotates the camera head, which can be controlled remotely via a network or dedicated line. Such cameras are equipped with a pan mechanism that rotates the camera horizontally and a tilt mechanism that rotates the camera vertically. Pan-tilt-zoom (PTZ) cameras with electric zoom can freely change the shooting direction and shooting angle of view, and can capture moving subjects. Since PTZ cameras are used in a variety of scenes, it is necessary to change the zoom to suit the subject, and the size of the angle of view also changes accordingly, so the pan / tilt speed may be changed according to the angle of view. Specifically, in order to reduce the sense of discomfort felt by the user, the pan / tilt speed may be controlled to be faster when the angle of view is large (wide angle) and slower when the angle of view is small (telephoto) so that the apparent movement of the image is constant regardless of the angle of view.

[0003] Patent Document 1 discloses a method of determining a PT speed for a zoom position using a previously determined relationship between a zoom position and an angle of view for various lenses with different angles of view. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2007-282069 A Summary of the Invention [Problem to be solved by the invention]

[0005] If the pan speed (or tilt speed) required to point the shooting direction to the target position differs depending on the angle of view, and the acceleration and deceleration required to reach the target pan speed (or tilt speed) are fixed regardless of the angle of view, the acceleration time and deceleration time required to reach the target pan speed (or tilt speed) will differ depending on the angle of view. As a result, the apparent movement in the image during acceleration or deceleration may change depending on the angle of view.

[0006] The present invention has been made in consideration of the above-mentioned problems, and has an object to reduce the sense of discomfort felt from captured video. [Means for solving the problem]

[0007] The present invention relates to an imaging device that captures an image, a zoom driving device that controls the angle of view of the imaging device, a pan / tilt driving device that rotates the imaging device in a pan direction and a tilt direction, and a pan / tilt control device that controls the rotation of the pan / tilt driving device in the pan direction and the tilt direction. a calculation means for calculating a target speed from a field angle controlled by the zoom driving means and a preset speed designation value; The pan-tilt control means comprises: Based on at least one of a preset acceleration time or a preset deceleration time and the target speed calculated by the calculation means, The acceleration or deceleration of the pan / tilt driving means is controlled so that the acceleration time or deceleration time of the image movement captured by the imaging means becomes constant. Effect of the Invention

[0008] According to the present invention, it is possible to reduce the sense of discomfort felt from a captured image. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram illustrating a configuration of an imaging device according to a first embodiment. [Diagram 2] 1A and 1B are a plan view and a side view of an imaging device according to a first embodiment. [Diagram 3] 5 is a flowchart showing a pan control process of the imaging apparatus of the first embodiment. [Figure 4] 5A to 5C are diagrams illustrating acceleration and deceleration control at different angles of view of the imaging apparatus of the first embodiment. [Diagram 5] 11A and 11B are diagrams illustrating control commands indicating pan-tilt drive instructions for the imaging device. [Figure 6] FIG. 13 is a diagram showing a command for specifying a pan / tilt speed based on a ratio of an angle of view. [Figure 7] FIG. 13 is a diagram showing a command for setting the pan / tilt acceleration / deceleration time. [Figure 8] 10 is a flowchart showing a pan control process of the imaging apparatus of the second embodiment. [Figure 9] 13 is a flowchart showing electronic pan control processing of the imaging apparatus of the second embodiment. [Figure 10] FIG. 13 is a diagram illustrating the configuration of a video distribution system in a third embodiment. [Figure 11] 13 is a flowchart showing a pan control process in the third embodiment. [Figure 12] 11A and 11B are diagrams illustrating control commands indicating pan / tilt acceleration / deceleration settings of the imaging device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, the best mode according to the present embodiment will be described with reference to the drawings.

[0011] (First embodiment) Fig. 1 is a diagram illustrating the configuration of an imaging device 1000 according to this embodiment. Fig. 2(a) is a plan view showing the imaging device 1000. Fig. 2(b) is a side view showing the imaging device 1000. The imaging device 1000 includes an imaging unit 1001 , an image processing unit 1002 , a zoom driving unit 1003 , a pan driving unit 1004 , a tilt driving unit 1005 , a system control unit 1006 , and a communication unit 1007 .

[0012] The imaging unit 1001 captures an image of a subject. The imaging unit 1001 includes a lens, an image sensor, and a control circuit for the same, and is electrically connected to an image processing unit 1002. The imaging unit 1001 receives light from the subject that is imaged by the imaging optical system of the lens, and converts the optical image of the subject into an electrical signal by photoelectric conversion.

[0013] The image processing unit 1002 acquires the signal photoelectrically converted by the imaging unit 1001 and generates image data by performing development processing, compression / encoding processing, etc. The image processing unit 1002 can also perform image cropping processing such as electronic pan / tilt control. The image processing unit 1002 is connected to the system control unit 1006 and transmits the generated image data to the system control unit 1006.

[0014] The zoom driving unit 1003 controls the imaging angle of view of the imaging unit 1001. Specifically, it changes the shooting angle of view of the imaging unit 1001. The zoom driving unit 1003 is connected to the system control unit 1006, and has a lens mechanism that performs optical zoom, and a stepping motor, for example, an electric motor, which is an actuator.

[0015] The pan driving unit 1004 is a driving unit that performs panning of the imaging device 1000. The pan driving unit 1004 is communicably connected to a system control unit 1006. The pan driving unit 1004 performs panning using a mechanism that performs panning, an electric motor such as a stepping motor that serves as an actuator, and an encoder that detects a pan angle. In this embodiment, the pan driving unit 1004 is built into either a bottom case 1101 or a turntable 1102, which will be described later.

[0016] The bottom case 1101 functions as a base unit for the entire imaging device 1000 including the pan driving unit 1004. The bottom case 1101 is disposed below the turntable 1102.

[0017] The turntable 1102 carries a camera head support 1103 (described later) and rotates about a vertical axis to drive the turntable in the pan direction, that is, to pan the imaging device 1000. The turntable 1102 can rotate in the pan direction from -175 degrees to +175 degrees.

[0018] That is, the pan driving unit 1004 can incorporate the mechanism, actuator, and encoder that perform the panning operation into either the bottom case 1101 or the turntable 1102. This allows the imaging unit 1001 to rotate in the pan direction from -175 degrees to +175 degrees. In addition, in this embodiment, the pan driving unit 1004 is built into either the bottom case 1101 or the turntable 1102, but it may have another configuration.

[0019] The tilt driving unit 1005 is a driving unit that performs a tilt operation of the imaging device 1000. The tilt driving unit 1005 is communicably connected to a system control unit 1006. The tilt driving unit 1005 performs tilt drive using a mechanism that performs a tilt operation, an electric motor such as a stepping motor that serves as an actuator, and an encoder that detects the tilt angle. In this embodiment, the tilt driving unit 1005 is built into either a camera head support 1103 or a camera head 1104, which will be described later.

[0020] The camera head support 1103 is a support that supports the camera head 1104. The camera head support 1103 is disposed on the central axis of the turntable 1102, and connects the camera head 1104 to the side opposite the turntable 1102.

[0021] The camera head 1104 is an independent imaging means of the imaging device 1000. The camera head 1104 has therein an imaging unit 1001 which is an imaging means, and a zoom driving unit 1003 which is a zoom driving means. The camera head 1104 drives in the tilt direction, that is, tilts the imaging device 1000, with an axis perpendicular to the vertical axis as the central axis. The camera head 1104 can also rotate from -45 degrees diagonally downward to +90 degrees directly upward, with the horizontal direction being 0 degrees.

[0022] That is, the tilt driving unit 1005 can incorporate a mechanism, actuator, and encoder for performing the tilt operation into either the camera head support 1103 or the camera head 1104. This allows the imaging unit 1001 to rotate from -45 degrees diagonally downward to +90 degrees directly upward. In addition, in this embodiment, the tilt drive unit 1005 is built into either the camera head support 1103 or the camera head 1104, but it may have another configuration.

[0023] In this way, the imaging device 1000 of this embodiment can capture images by changing the capture direction by rotating the camera head 1104 in the pan direction and tilt direction. Note that the driving ranges of the pan direction and tilt direction of this embodiment are merely examples and are not limited to these. The pan driving unit 1004 and the tilt driving unit 1005 are used together as a pan / tilt driving unit that performs pan / tilt driving. In addition, pan-tilt driving also drives the imaging unit 1001, so the captured image also moves. Here, image movement refers to the movement of the image captured by the imaging means, and refers to making the captured image appear to be moving by operating the imaging unit 1001, etc., or by cutting out and processing the captured image, etc.

[0024] The system control unit 1006 controls the entire imaging device 1000. The system control unit 1006 includes a CPU (Central Processing Unit) and is connected to a client device, which is an information processing device (not shown), via a communication unit 1007, and communicates commands and responses with the client device to control the imaging device 1000. That is, the system control unit 1006 receives a camera control command transmitted from the client device, analyzes the acquired camera control command, and executes processing according to the command. Then, the system control unit 1006 transmits a response to the camera control command to the client device. For example, the system control unit 1006 controls the image processing unit 1002 based on an instruction of an image quality adjustment command, and controls the pan driving unit 1004, the tilt driving unit 1005, and the zoom driving unit 1003 based on an instruction of a PTZ command for operating the PTZ.

[0025] The communication unit 1007 is connected to the network 5000 and is connected to a client device (not shown) so as to be capable of communicating with each other and transmitting instructions from the system control unit 1006. The communication unit 1007 receives commands from the client device via the network 5000 and transmits responses from the system control unit 1006 to the client device.

[0026] Fig. 3 is a flowchart showing the pan control of the imaging device 1000. The flowchart in Fig. 3 is started when a pan drive instruction is received, with the pan speed designated according to the angle of view ratio, as well as the acceleration time and deceleration time set in the imaging device 1000. Also, although the pan drive is described below, the same applies to the tilt drive.

[0027] FIG. 4 shows acceleration / deceleration control at two angles of view, where FIG. 4(a) shows the pan acceleration / deceleration setting when the horizontal angle of view is 60 degrees (large angle of view), and FIG. 4(b) shows the pan acceleration / deceleration setting when the horizontal angle of view is 20 degrees (small angle of view). Additionally, V1 indicates the target pan speed when the horizontal angle of view is 60 degrees, and V2 indicates the target pan speed when the horizontal angle of view is 20 degrees. Similarly, A1 indicates the pan acceleration when the horizontal angle of view is 60 degrees, A2 indicates the pan acceleration when the horizontal angle of view is 20 degrees, D1 indicates the pan deceleration when the horizontal angle of view is 60 degrees, and D2 indicates the pan deceleration when the horizontal angle of view is 20 degrees. Additionally, Ta indicates the acceleration time and Td indicates the deceleration time, which are the same for both horizontal angles of view of 60 degrees and 20 degrees.

[0028] In S1001, the system control unit 1006 acquires a current pan speed designated value. For example, 50% / second (hereinafter, s) is acquired as the pan speed designated value based on the angle of view ratio.

[0029] In S1002, the system control unit 1006 acquires the current horizontal angle of view of the zoom driving unit 1003. For example, 60 degrees is acquired as the current horizontal angle of view.

[0030] In S1003, the system control unit 1006 obtains a panning speed from the obtained horizontal angle of view. The panning speed is expressed as the product of a designated panning speed value and the horizontal angle of view. For example, when calculating pan speed V1 from the horizontal angle of view (60 degrees) shown in S1002 and the pan speed setting (50% / s) based on the angle of view ratio shown in S1001, V1 = 50% / s × 60 degrees = 30 degrees / s. Also, if the horizontal angle of view obtained by S1002 is 20 degrees, the pan speed V2 is V2 = 50% / s × 20 degrees = 10 degrees / s.

[0031] In S1004, the system control unit 1006 obtains the pan acceleration and pan deceleration from the obtained speed and the set acceleration time and deceleration time. The pan acceleration and pan deceleration are indicated by the quotient obtained by dividing the pan acceleration time by the pan speed. For example, when calculating the pan acceleration from the pan speed (30 degrees / s) when the horizontal angle of view is 60 degrees as exemplified in S1003, V1 is 30 degrees / s. If Ta is 1 s, the pan acceleration A1 is as follows: A1 = 30 degrees / s ÷ 1s = 30 degrees / s 2 It is. Similarly, when calculating the pan acceleration from a pan speed (10 degrees / s) with a horizontal angle of view of 20 degrees, V2 is 10 degrees / s. If Ta is 1 s, the pan acceleration A2 is A2 = 10 degrees / s ÷ 1s = 10 degrees / s 2 It is.

[0032] In addition, when the pan deceleration is calculated from the pan speed (30 degrees / s) when the horizontal angle of view is 60 degrees as exemplified in S1003, V1 is 30 degrees / s. If Td is 1 s, the pan deceleration D1 is as follows: D1 = 30 degrees / s ÷ 1s = 30 degrees / s 2 It is. Similarly, when calculating the pan deceleration from a pan speed (10 degrees / s) with a horizontal angle of view of 20 degrees, V2 is 10 degrees / s. If Td is 1 s, the pan deceleration D2 is D2 = 10 degrees / s ÷ 1s = 10 degrees / s 2 It is. In this way, when the angle of view is increased by the zoom driving unit 1003, the pan speed acceleration and pan speed deceleration are increased, and when the angle of view is changed to a smaller value, the pan speed acceleration and pan speed deceleration are decreased. This makes the acceleration time and deceleration time constant even if the pan speed changes.

[0033] In S1005, the system control unit 1006 controls the pan driving unit 1004 based on the determined pan speed, pan acceleration, and pan deceleration, and similarly controls the tilt driving unit 1005 based on the determined tilt speed, tilt acceleration, and tilt deceleration. Fig. 5 is a diagram showing a command for instructing pan / tilt driving, Fig. 6 is a diagram showing a command for specifying a pan / tilt speed according to a ratio of an angle of view, and Fig. 7 is a diagram showing a command for setting a pan / tilt acceleration / deceleration time. The system control unit 1006 receives control commands from the client device based on the values ​​calculated in S1003 and S1004, interprets the control commands, and executes the instructed control. The control commands include a command 2100 indicating a pan / tilt drive instruction, a command 2200 indicating a pan / tilt speed designation based on the angle of view ratio, and a command 2300 indicating a pan / tilt acceleration / deceleration time setting.

[0034] A command 2100 is a command for issuing a pan / tilt drive instruction. The command 2100 has a command identifier 2101, a parameter 2102, and a parameter 2103.

[0035] The command identifier 2101 is a command that identifies the type of command. For example, "0100" indicates that the command is for instructing pan-tilt driving. Parameter 2102 is a parameter that indicates the direction type, and a value indicating pan or tilt is specified. Parameter 2103 is a parameter indicating the direction of movement, and if the movement direction is pan drive, a value indicating right or left is designated, and if the movement direction is tilt drive, a value indicating up or down is designated.

[0036] Next, a command 2200 is a command that specifies a pan / tilt speed based on the angle of view ratio. The command 2200 has a command identifier 2101, a parameter 2102, and a parameter 2103.

[0037] The command identifier 2201 is a command that identifies the type of command. For example, "0200" indicates that the command is a command that specifies the pan / tilt speed based on the angle of view ratio. Parameter 2202 is a parameter that indicates the direction type, and a value indicating pan or tilt is specified. Parameter 2103 is a parameter indicating a speed designation value, and designates a value from "0% / s to 100% / s" as the speed designation value according to the angle of view ratio, for example.

[0038] Next, command 2300 is a command that indicates a pan / tilt acceleration / deceleration time setting. Command 2300 has a command identifier 2301, a parameter 2302, a parameter 2303, and a parameter 2304.

[0039] The command identifier 2301 is a command that identifies the type of command. For example, "0300" indicates that this is a command for setting the acceleration time and deceleration time of the PT. Parameter 2302 is a parameter that indicates the direction type, and a value indicating pan or tilt is specified. Parameter 2303 is a parameter that indicates the acceleration time, and specifies the time required for acceleration up to the designated speed in "milliseconds." Parameter 2304 is a parameter that indicates the deceleration time, and specifies the time required to decelerate to the designated speed in "milliseconds".

[0040] Furthermore, the parameters of each command may all be input by the user, or some or all of the parameters may be automatically input. For example, a setting means may be provided that allows the user to set the acceleration time in the parameter 2303.

[0041] In this way, according to the imaging device 1000 of this embodiment, when specifying the pan / tilt speed based on the angle of view ratio in an imaging device equipped with a PTZ, the acceleration and deceleration can be set so that the acceleration time and deceleration time are constant. Therefore, even if the horizontal angle of view is changed by zoom driving and becomes a different angle of view, the movement of the captured image during acceleration and deceleration of the PT operation can be made to be the same.

[0042] Second embodiment The imaging device 2000 shown in the second embodiment uses electronic pan-tilt control in addition to the pan-tilt driving unit, and can cut out the captured image at any position and move the position of the image to be displayed. Note that the same components as those in the first embodiment are given the same reference numerals and the description is omitted as appropriate. The flowchart in Fig. 8 is a flowchart showing pan control of the image capture device 2000 of this embodiment. The flowchart in Fig. 8 is started when a speed designation based on the angle of view ratio, an acceleration time, and a deceleration time are set in the image capture device 2000 and a pan drive instruction is received.

[0043] In S2001, the system control unit 1006 acquires the current pan speed designation value, for example, 100% / s as the pan speed designation value based on the angle of view ratio.

[0044] In S2002, the system control unit 1006 acquires the current horizontal angle of view of the zoom driving unit 1003. For example, 120 degrees is acquired as the current horizontal angle of view.

[0045] In S2003, the system control unit 1006 obtains a panning speed from the obtained horizontal angle of view. The panning speed is expressed as the product of a designated panning speed value and the horizontal angle of view. For example, if you calculate the pan speed from the horizontal angle of view (120 degrees) shown in S2002 and the pan speed setting (100% / s) based on the angle of view ratio shown in S2001, you get the following: 100% / s × 120 degrees = 120 degrees / s.

[0046] In S2004, the system control unit 1006 obtains acceleration and deceleration from the obtained speed and the set acceleration time and deceleration time. The pan acceleration and pan deceleration are indicated by the quotient obtained by dividing the pan acceleration time by the pan speed. For example, the pan acceleration is calculated from the pan speed (120 degrees / s) when the horizontal angle of view is 120 degrees as shown in S2003. If the pan acceleration time is 0.2 seconds, the pan acceleration is calculated as follows: 120 degrees / s ÷ 0.2s = 600 degrees / s 2 It is.

[0047] In addition, the pan deceleration is calculated from the pan speed (120 degrees / s) when the horizontal angle of view is 120 degrees as shown in S2003. If the pan deceleration time is 0.2 seconds, the pan deceleration is calculated as follows: 120 degrees / s ÷ 0.2s = 600 degrees / s2 It is.

[0048] In S2005, the system control unit 1006 determines whether the pan acceleration is equal to or greater than a predetermined acceleration indicating the acceleration performance limit of the pan driver, that is, equal to or greater than a threshold value. If the acceleration is equal to or greater than the predetermined acceleration, the process proceeds to S2006, and if the acceleration is less than the threshold value, the process proceeds to S2008. For example, the acceleration performance limit of the pan drive is 500 degrees / s 2 When the pan acceleration is 600 degrees / s, like S2004, 2 Therefore, the process proceeds to S2006, but the pan acceleration is 400 degrees / s 2 If so, proceed to S2008.

[0049] In S2006, the system control unit 1006 calculates the acceleration for electronic pan control based on the acceleration calculated in S2003. In the imaging device 2000 of this embodiment, the acceleration that cannot be realized by the pan driver is realized by image movement using electronic pan control. Therefore, the acceleration for electronic pan control is the difference obtained by subtracting the acceleration threshold of the pan driver from the required pan acceleration. For example, if the pan acceleration is 600 degrees / s and the acceleration threshold of the pan driver is 500 degrees / s, the acceleration of the electronic pan control is 600-500=100 degrees / s 2 It becomes.

[0050] In S2007, the system control unit 1006 instructs the image processing unit 1002 to perform electronic pan control in the determined acceleration and the specified pan movement direction, and executes electronic pan control shown in the flowchart of FIG. 9, which will be described later.

[0051] In S2008, the system control unit 1006 controls the pan driving unit 1004 based on the calculated pan speed, pan acceleration, and pan deceleration. Although the acceleration drive in the pan direction has been described above, the same applies to the drive and deceleration drive in the tilt direction, for example, when the deceleration is equal to or greater than a predetermined deceleration in S2005.

[0052] Fig. 9 is a flowchart showing electronic pan control. The flowchart of Fig. 9 starts when the image processing unit 1002 receives an instruction for electronic pan control in S2007. When the processing of the flowchart of Fig. 9 is to end, the processing proceeds to the end of S2007 of the flowchart of Fig. 8. That is, when the acceleration controlled by the system control unit 1006 is equal to or greater than a predetermined acceleration, the video can be cut out by electronic pan control.

[0053] In S3001, the image processing unit 1002 acquires the pan driving state of the pan driving unit 1004. The pan driving state is, for example, any one of the states of stopped, accelerating, driving at a constant speed, and decelerating.

[0054] In S3002, the image processing unit 1002 determines whether the pan driving unit 1004 is accelerating. If it is accelerating, the process proceeds to S3003. If it is not accelerating, the process ends.

[0055] In S3003, the image processing unit 1002 acquires the horizontal angle of view of the imaging device 2000. At this time, the acquired horizontal angle of view is the horizontal angle of view acquired by the system control unit 1006 in S2002, and is, for example, 120 degrees.

[0056] In S3004, the image processing unit 1002 obtains a panning operation elapsed time, which is expressed as the product of the inverse of the frame rate and the number of frames that have elapsed since the start of processing. For example, when the frame rate is 60 (FPS), its reciprocal is 1 / 60. If 9 frames have passed since the start of the process in the flowchart of FIG. 9, the panning operation elapsed time is The result is 1 / 60 × 9 = 0.15s.

[0057] In S3005, the image processing unit 1002 calculates the movement speed of the electronic pan control. The movement speed of the electronic pan control is indicated by the product of the acceleration of the electronic pan control calculated in S2006 and the elapsed time of the pan operation. For example, the movement speed of the electronic pan control at the time of processing in S3004 is expressed as follows: 100 degrees / s2 × 0.15s = 15 degrees / s.

[0058] In S3006, the image processing unit 1002 determines the cut-out position of the image. In electronic pan control, only a part of the entire captured image is displayed, and the cut-out position of the image is changed to a position based on the movement speed, so that the image appears to move as seen by the user. In other words, it is necessary to move the image by the required number of pixels. In this case, the pixel value to be moved at the movement speed of electronic pan control can be calculated by multiplying the horizontal resolution per degree by the angle of view moved by electronic pan control. In other words, it is expressed as the product of the quotient of the horizontal resolution, which is the horizontal resolution per degree, divided by the horizontal angle of view, multiplied by the movement speed of electronic pan control and the reciprocal of the frame rate, which is the time per frame. For example, if the horizontal resolution of the output image of the imaging unit 1001 is 1920 pixels, and the movement amount of this frame at the movement speed of electronic pan control calculated in S3004 is converted to a pixel value, 1920 pixels / 120 degrees × 15 degrees / s × (1 / 60)s = 4 pixels It becomes.

[0059] That is, the image processing unit 1002 cuts out an area shifted in the designated pan movement direction from the cut-out position of the video image by the determined designated image value (for example, 4 pixels) with respect to the image cut-out area in the previous frame.

[0060] In this way, according to the imaging device 2000 of this embodiment, electronic pan-tilt control can be used in addition to pan-tilt control. Therefore, the electronic pan-tilt control can make the apparent acceleration or deceleration of the image movement look high by cutting out an image from the captured image, in addition to the acceleration or deceleration of the pan-tilt driver controlled by the system control unit 1006. That is, even if a PT acceleration or PT deceleration that exceeds the performance limit of the pan-tilt driver is required, the movement of the captured image during acceleration and deceleration of the PT operation can be made to be the same regardless of the angle of view.

[0061] Third embodiment In the video distribution system according to the third embodiment, a client device 4000 connected via a network 5000 remotely controls a network camera 3000, and issues instructions including pan / tilt acceleration and deceleration. In addition, the same components as those in the first and second embodiments are given the same reference numerals and the description thereof will be omitted as appropriate.

[0062] FIG. 10 is a diagram illustrating the configuration of a video distribution system according to this embodiment. The video distribution system includes a network camera 3000 and a client device 4000, which are connected via a network 5000 and are capable of communicating with each other.

[0063] The network camera 3000 functions as an imaging unit, a zoom driving unit, and a pan / tilt driving unit of a video distribution system. The network camera 3000 includes an imaging unit 1001, an image processing unit 1002, a zoom driving unit 1003, a pan driving unit 1004, a tilt driving unit 1005, a system control unit 1006, and a communication unit 1007. The network camera 3000 acquires information on the current angle of view from the client device 4000, and can set the information as the speed, acceleration, and deceleration of the pan driving unit 1004 and the tilt driving unit 1005.

[0064] The client device 4000 connects to the network camera 3000 via the network 5000, obtains information about the network camera 3000, and remotely controls it by issuing control instructions remotely. The client device 4000 includes a video display unit 2001 , a video processing unit 2002 , a system control unit 2003 , a pan / tilt drive instruction input unit 2004 , and a communication unit 2005 .

[0065] The video display unit 2001 includes a display for displaying video and its control circuit, and plays back video data processed by the video processing unit 2002. The video display unit 2001 displays a GUI for pan / tilt operation. The GUI accepts settings for the acceleration and deceleration times of the pan / tilt, but may also input instructions for the driving direction and driving speed of the pan / tilt driving unit. The GUI transmits the input pan / tilt driving instructions and the settings for the acceleration and deceleration times to the system control unit 2003.

[0066] The video processing unit 2002 decompresses the compressed and encoded video data of the network camera 3000 received by the communication unit 2005, and converts it into playable video data.

[0067] The system control unit 2003 includes a CPU (Central Processing Unit) and controls the entire client device 4000. The system control unit 2003 receives video data and information on the control state of the camera, such as the angle of view, from the network camera 3000 via the communication unit 2005. The system control unit 2003 transmits a camera control command to the network camera 3000 via the communication unit 2005.

[0068] The pan / tilt drive instruction input unit 2004 includes a joystick that can be tilted up, down, left, right, and the control circuit thereof, and inputs user's instructions for the drive direction and drive speed of the pan / tilt drive unit. For example, the left and right direction of the joystick indicates the pan direction, and the up and down direction indicates the tilt direction, and the drive speed is specified by the magnitude of the joystick tilt. The pan / tilt drive instruction input unit 2004 indicates a faster drive speed as the joystick is tilted more, and indicates a speed specification of 100% based on the angle of view ratio at maximum tilt, and indicates a speed specification of 0% based on the angle of view ratio, i.e., stop, when there is no tilt. The speed specification value for the tilt between these is allocated in predetermined increments. The correspondence between the joystick tilt and the speed specification value is one example, and is set in consideration of the operating feel of the pan / tilt.

[0069] The communication unit 2005 is connected to the system control unit 2003, and transmits and receives control instructions and the like for controlling the network camera 3000 via the network 5000. For example, the communication unit 2005 transmits control commands to the network camera 3000, and receives images captured by the network camera 3000.

[0070] 11 is a flowchart showing the pan control of the network camera 3000 of this embodiment. The flowchart of FIG.

[0071] In S4001, the system control unit 2003 acquires a pan speed instruction from the pan / tilt drive instruction input unit 2004. For example, 50% / s is acquired as the pan speed designated value based on the angle of view ratio.

[0072] In S4002, the system control unit 2003 acquires the current horizontal angle of view from the network camera 3000. For example, the current horizontal angle of view of the network camera 3000 is acquired as 60 degrees.

[0073] In S4003, the system control unit 2003 calculates the pan speed from the obtained horizontal angle of view. The pan speed is expressed as the product of the pan speed setting based on the angle of view ratio and the horizontal angle of view. For example, the pan speed is calculated from the pan speed setting of 50% / s based on the angle of view ratio obtained by S4001 and the horizontal angle of view of 60 degrees obtained by S4001, as follows: 50% / s × 60 degrees = 30 degrees / s.

[0074] In S4004, the system control unit 2003 obtains acceleration and deceleration from the obtained speed and the set acceleration and deceleration times. The pan acceleration and pan deceleration are indicated by the quotient obtained by dividing the pan acceleration time by the pan speed. For example, the pan acceleration is calculated from the pan speed (30 degrees / s) when the horizontal angle of view is 60 degrees as shown in S4003. If the pan acceleration time is 1 second, the pan acceleration is calculated as follows: 30 degrees / s ÷ 1s = 30 degrees / s2 It is.

[0075] Also, the pan deceleration is calculated from the pan speed (30 degrees / s) when the horizontal angle of view is 60 degrees as exemplified in S4003. If the pan deceleration time is 1 second, the pan deceleration is calculated as follows: 30 degrees / s ÷ 1s = 30 degrees / s 2 It is.

[0076] In S4005, the system control unit 2003 controls the pan driving unit 1004 based on the determined pan speed, pan acceleration, and pan deceleration, and similarly controls the tilt driving unit 1005 based on the determined tilt speed, tilt acceleration, and tilt deceleration. FIG. 12 is a diagram showing a control command 2400 indicating the pan / tilt acceleration / deceleration settings of the imaging device. The system control unit 2003 receives a control command from the client device 4000 via the communication unit 2005 based on the values ​​calculated in S4003 and S4004, interprets the control command, and executes the instructed control. The control command includes a command 2100 indicating a pan / tilt drive instruction, a command 2200 indicating a pan / tilt speed designation based on the angle of view ratio, and a control command 2400 indicating a pan / tilt acceleration / deceleration time setting.

[0077] The control command 2400 is a command that indicates a pan / tilt acceleration / deceleration time setting. The control command 2400 has a command identifier 2401, a parameter 2402, a parameter 2403, and a parameter 2404.

[0078] The command identifier 2401 is a command that identifies the type of command. For example, "0400" indicates that the command is for setting the acceleration time and deceleration time of the pan / tilt. Parameter 2402 is a parameter that indicates the direction type, and a value indicating pan or tilt is specified. Parameter 2403 is a parameter that indicates acceleration, and the acceleration when accelerating to a specified speed is expressed in "millidegrees / s 2 " units. The parameter 2404 is a parameter indicating the deceleration rate, and indicates the deceleration rate when decelerating from a specified speed in "millidegrees / s 2 " is specified.

[0079] Moreover, the parameters of the control command 2400 may all be input by the user, similar to the command 2300, or some or all of the parameters may be input automatically. For example, a setting means may be provided that allows the user to set the acceleration time in the parameter 2403.

[0080] Thus, according to the video distribution system of this embodiment, the network camera 3000 can perform pan-tilt control by the client device 4000 via the network 5000. Therefore, even if the imaging means and the pan-tilt control means are not integrated, the acceleration and deceleration can be set so that the acceleration time and deceleration time are constant at different angles of view. In other words, by mounting only the imaging means in the imaging device and controlling multiple imaging devices with a client device equipped with one pan-tilt control means, it is possible to reduce the manufacturing cost of the imaging devices and to collectively control the imaging devices.

[0081] (Other embodiments) The present invention can also be realized by executing the following process. That is, a program for realizing the functions of the above-described embodiment is supplied to a system or device via a network or various recording media, and a computer (CPU, MPU, etc.) of the system or device reads and executes the program code. In this case, the program and the recording media storing the program constitute the present invention.

[0082] In addition, in the present invention, the acceleration time and the deceleration time are the same, but they may be different times. For example, when the acceleration time is Ta and the deceleration time is Td, an inequality such as Ta>Td may be satisfied. [Explanation of symbols]

[0083] 1001: Imaging unit 1002: Image processing unit 1003: Zoom driving unit 1004: Pan driving unit 1005: Tilt driving unit 1006: System control unit

Claims

1. An imaging means for capturing an image; a zoom driving means for controlling an angle of view of the imaging means; a pan / tilt driving means for rotating the imaging means in a pan direction and a tilt direction; a pan / tilt control means for controlling the rotation of the pan and tilt directions of the pan / tilt driving means; a calculation means for calculating a target speed from an angle of view controlled by the zoom driving means and a preset speed designation value, The pan / tilt control means An imaging device characterized by controlling the acceleration or deceleration of the pan-tilt drive means based on at least one of preset acceleration times or deceleration times and the target speed calculated by the calculation means so that the acceleration time or deceleration time of the image movement captured by the imaging means is constant.

2. The pan / tilt control means When the zoom driving means has a first angle of view, the acceleration or deceleration of the pan / tilt driving means is controlled to become a first acceleration or a first deceleration; When the zoom driving means has a second angle of view, the acceleration or deceleration of the pan / tilt driving means is controlled to become a second acceleration or a second deceleration; the first angle of view is greater than the second angle of view; an absolute value of the first acceleration is greater than an absolute value of the second acceleration; The imaging apparatus according to claim 1 , wherein an absolute value of the first deceleration is greater than an absolute value of the second deceleration.

3. The imaging device includes: an electronic pan-tilt control means for generating an image cut out at an arbitrary position from the image captured by the imaging means; The electronic pan-tilt control means includes: In addition to the acceleration or deceleration controlled by the pan / tilt control means, The imaging device according to claim 1 or 2, characterized in that an image is generated in which the apparent acceleration or deceleration time of the image movement is constant by cutting out an image from the image captured by the imaging means, thereby controlling the apparent acceleration or deceleration of the image movement.

4. The electronic pan-tilt control means includes:

4. The imaging device according to claim 3, wherein an image is cut out when the acceleration or deceleration controlled by said pan / tilt control means is equal to or greater than a predetermined acceleration or deceleration.

5. An imaging means for capturing an image; a zoom driving means for controlling an angle of view of the imaging means; a pan / tilt driving means for rotating the imaging means in a pan direction and a tilt direction; a pan / tilt control means for controlling the rotation of the pan and tilt directions of the pan / tilt driving means; a transmitting / receiving means for transmitting and receiving control instructions and a state of the imaging means; a remote control means for remotely controlling the pan / tilt control means via the transmitting / receiving means; a calculation means for calculating a target speed from an angle of view controlled by the zoom driving means and a preset speed designation value, The pan / tilt control means A video distribution system characterized by controlling the acceleration or deceleration of image movement captured by the imaging means based on at least one of pre-set acceleration times or deceleration times and the target speed calculated by the calculation means, so that the acceleration time or deceleration time of the image movement captured by the imaging means is constant.

6. A method for controlling an imaging device including an imaging unit, comprising: An imaging step of capturing an image; a zoom driving step of controlling an angle of view in the imaging step; a pan / tilt driving step of rotating the imaging means in a pan direction and a tilt direction in the imaging step; a pan / tilt control step of controlling rotation in a pan direction and a tilt direction in the pan / tilt driving step; a calculation step of calculating a target speed from the angle of view controlled by the zoom driving step and a preset speed designation value, The pan-tilt control step includes: A control method for an imaging device, characterized in that the acceleration or deceleration of image movement is controlled in the pan / tilt control process based on at least one of preset acceleration times or deceleration times and the target speed calculated in the calculation process so that the acceleration time or deceleration time of the image movement captured by the imaging process is constant.

7. A program for causing a computer to operate an imaging device having an imaging means, On the computer, An imaging step of capturing an image; a zoom driving step for controlling an angle of view in the imaging step; a pan / tilt driving step of rotating the imaging means in a pan direction and a tilt direction in the imaging step; a calculation step of calculating a target speed from a field angle controlled by the zoom driving step and a preset speed designation value; A program for executing a pan / tilt control step that controls the rotation in the pan and tilt directions in the pan / tilt drive step, and controls the acceleration or deceleration of the image movement captured by the imaging step so that the acceleration time or deceleration time of the image movement is constant based on at least one of preset acceleration times or deceleration times and the target speed calculated in the calculation step.

Citation Information

Patent Citations

  • Universal head system

    JP2007282069A

  • Camera device and its control method

    JP2008131387A

  • Camera revolving system

    JP2017034325A

  • Imaging device

    JP2017041705A