Control device, imaging device, imaging system, control method, and program
The control device adjusts pan-tilt acceleration and deceleration based on user input speed, addressing the mismatch in existing network cameras, ensuring smooth and responsive operations.
Patent Information
- Application Number
- JP2021119348
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-07-20
- Publication Date
- 2025-07-29
- Estimated Expiration
- 2041-07-20
AI Technical Summary
Existing network cameras struggle to match user-operated pan-tilt speeds with user expectations, leading to insufficient response performance when changing directions, especially when transitioning between different operation speeds.
A control device that adjusts the acceleration and deceleration of the pan-tilt mechanism based on user operation speed, allowing for multiple acceleration and deceleration settings to align with user intent, improving operability.
Enables quick or slow pan-tilt operations as intended by the user, enhancing user experience and responsiveness.
Smart Images

Figure 0007714399000001 
Figure 0007714399000002 
Figure 0007714399000003
Abstract
Description
Technical Field
[0001] The present invention relates to a control device, an imaging device, an imaging system, a control method, and a program.
Background Art
[0002] Conventionally, in a pan-tilt function, a network camera has been proposed that can switch the magnitude of acceleration and deceleration according to various scenes such as sports competitions and orchestra scenes. However, even in the same scene, there are cases where the user wants to perform the pan-tilt operation slowly and cases where the user wants to perform it quickly, and it may not match the user's operation feeling. Patent Document 1 discloses a configuration for determining the pan-tilt speed based on the position and size of a subject within the screen in order to continue tracking without losing the subject.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] When, for example, a network camera is operating at a speed of 100 degrees / s in the right direction and is requested to operate at a speed of 100 degrees / s in the left direction, it is not possible to achieve sufficient response performance only by changing the pan-tilt speed within a predetermined acceleration range as in the configuration of Patent Document 1.
[0005] An object of the present invention is to provide a control device, an imaging device, an imaging system, a control method, and a program capable of improving user operability.
Means for Solving the Problems
[0006] A control device according to one aspect of the present invention is a control device that controls a drive unit that can drive an imaging unit in a first direction and a second direction different from the first direction, and includes an acquisition unit that acquires an operation speed of a user on an operation device using operation information related to an operation of the user on the operation device, and a setting unit that sets at least one of an acceleration and a deceleration of the drive unit using the operation speed. The setting unit sets the acceleration to a first acceleration when the operation speed is greater than a predetermined value, and sets the acceleration to a second acceleration smaller than the first acceleration when the operation speed is less than the predetermined value. It is characterized by: Effect of the Invention
[0007] According to the present invention, it is possible to provide a control device, an imaging device, an imaging system, a control method, and a program that can improve user operability. [Brief description of the drawings]
[0008] [Figure 1] 1 is a block diagram of a network camera according to an embodiment of the present invention. [Diagram 2] 4 is a flowchart showing a method for determining acceleration according to the first embodiment. [Diagram 3] FIG. 2 is a diagram showing the connection between a network camera and an operation device. [Figure 4] 10 is a diagram showing the relationship between time and lever tilt information transmitted from the operating device. FIG. [Figure 5] FIG. 1 is a diagram illustrating the specifications of pan-tilt operations. [Figure 6] 10 is a flowchart showing a method for determining a deceleration rate according to a second embodiment. [Figure 7] 10 is a flowchart showing a method for determining acceleration and deceleration according to a third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0009] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the drawings, the same reference numerals are used to designate the same components, and redundant explanations will be omitted.
[0010] FIG. 1 is a block diagram of an imaging system according to an embodiment of the present invention. The imaging system includes a network camera 100, a network device 130, an operation device 132, and an external power source 140. The network camera 100 is connected to a client device (information processing device) (not shown) via a network 131 so as to be able to communicate with each other.
[0011] The camera function of the network camera 100 is constituted by a lens 111, an image sensor 112, a signal processing circuit 113, an imaging control circuit 114, a memory transfer circuit 115, a system control unit 116, and a motor control unit 160. The lens 111 is a lens group including a zoom lens, a focus lens, an anti-vibration lens, and an aperture blade. The lens 111 is equipped with a CPU for controlling each block of the lens. Specifically, the CPU controls the zoom lens, the focus lens, the anti-vibration lens, and the aperture blade. The image sensor 112 converts the light imaged through the lens 111 into electric charges to generate an imaging signal. The signal processing circuit 113 digitizes the imaging signal generated by the image sensor 112 to generate image data. The imaging control circuit 114 controls the image sensor 112 at the same period as the output period of the image. Further, when the accumulation time of the image sensor 112 is longer than the output period of the image, the imaging control circuit 114 controls the signal processing circuit 113 so that the signal processing circuit 113 holds the image data in the frame memory during the period when the image sensor 112 cannot output an imaging signal. The memory transfer circuit 115 transfers the image data generated by the signal processing circuit 113 to the memory 122.
[0012] The network communication function of the network camera 100 is composed of a system control unit 116, a memory 122, and a network I / F 123. The image data transferred to the memory 122 by the memory transfer circuit 115 is transmitted to the network 131 via an external network device 130 through the network I / F 123. The system control unit 116 distributes the generated image data to the client device via the network I / F 123. The network I / F 123 receives the camera control command transmitted from the client device and transmits it to the system control unit 116. Also, the network I / F 123 transmits a response to the camera control command to the client device.
[0013] The system control unit 116 analyzes the camera control command and performs processing according to the camera control command. For example, the system control unit 116 gives an instruction to set the image quality to the signal processing circuit 113. The signal processing circuit 113 performs image processing based on the transmitted instruction. Also, the system control unit 116 gives an instruction for a pan / tilt operation to the motor control unit 160. The motor control unit 160 controls the pan drive unit 161 and the tilt drive unit 162 based on the transmitted instruction. The pan drive unit 161 and the tilt drive unit 162 are each composed of a motor, gears, a belt, and the like. By driving the pan drive unit 161, the imaging unit composed of the lens 111 and the imaging element 112 can be driven in the pan direction (the first direction). By driving the tilt drive unit 162, the imaging unit can be driven in the tilt direction. The PT mechanical phase detection control unit 170 performs control for detecting the mechanical phase signals from the pan phase detection unit 171 and the tilt phase detection unit 172 in order to detect the mechanical phase of the mechanical components operated by the pan drive unit 161 and the tilt drive unit 162. For example, the pan phase detection unit 171 and the tilt phase detection unit 172 are PI sensors, and perform the detection process by a mechanism in which they are shielded from / not shielded by the mechanical phase plate.
[0014] Further, as shown in FIG. 1(b), the system control unit 116 includes an acquisition unit 116a and a setting unit 116b. The acquisition unit 116a acquires the operation speed of the user's operation device 132 using the operation information regarding the operation on the user's operation device 132. The setting unit 116b sets at least one of the acceleration and deceleration of the drive units (the pan drive unit 161 and the tilt drive unit 162) using the operation speed. Note that in this embodiment, the system control unit 116 includes the acquisition unit 116a and the setting unit 116b, but a device having the functions of the acquisition unit 116a and the setting unit 116b may be configured as a control device separate from the network camera 100.
[0015] The power control unit 150 is, for example, a DC-DC converter, and is configured by a switch circuit or the like that switches the control module to be energized. The power control unit 150 performs power control on the network camera 100 by receiving power supply from the network device 130 or the external power supply 140 through a network cable or a power cable.
[0016] The network device 130 can not only receive image distribution from the network camera 100, but also supply power to the network camera 100 through a network cable. For example, those compliant with the power supply standard from a wired LAN cable such as PoE or PoE+ can be used.
[0017] The operation device 132 is, for example, a joystick, is connected to the network camera 100, and can communicate between devices. When the operation device 132 is a joystick, it transmits information (operation information) regarding the tilt and direction of the lever to the network camera 100. The network camera 100 can determine the speed and direction of the pan / tilt operation using the acquired information and drive the pan drive unit 161 and the tilt drive unit 162. Note that the operation device 132 may be a controller for video editing.
[0018] The external power supply 140 is a commercial power supply or a DC power supply and can supply power to the network camera 100.
[0019] The operations of each embodiment will be described below. In each embodiment, the pan operation will be described, but the tilt operation is the same. [First Embodiment] In this embodiment, a method for determining acceleration when the operation device 132 instructs a pan operation while the pan operation of the network camera 100 is in a stopped state will be described.
[0020] FIG. 2 is a flowchart showing the method for determining acceleration in this embodiment. Before this flow starts, the network camera 100 is in the power-on state, and the pan drive unit 161 is in the stopped state. Also, the operation device 132 and the network camera 100 are connected and in an operable state. In the following description, the operation device 132 will be described as a joystick.
[0021] In step S101, the system control unit 116 determines whether it has acquired a pan operation instruction from the operation device 132. If it is determined that a pan operation instruction has been acquired, the process proceeds to step S102. If it is determined otherwise, the process of this step is repeated.
[0022] In step S102, the system control unit 116 (acquisition unit 116a) acquires the operation speed of the user with respect to the operation device 132. Here, with reference to FIGS. 3 and 4, the method for acquiring the operation speed will be described. FIG. 3 is a diagram showing the connection between the network camera 100 and the operation device 132. FIG. 4 is a diagram showing the relationship between the tilt information of the lever transmitted from the operation device 132 and time.
[0023] As shown in FIG. 3, the operating device 132 is connected to the network camera 100 via a communication cable. In the present embodiment, the communication cable is at least one of an RS232C cable, a LAN cable, and a USB cable. The network camera 100 and the operating device 132 are in a communicable state, and communication is performed at a predetermined cycle. The operating device 132 transmits information regarding the current inclination and direction of the lever to the network camera 100 at a predetermined cycle. The network camera 100 calculates the speed and direction associated with the inclination and direction of the lever. When the user operates the operating device 132, the system control unit 116 transmits a movement request to the motor control unit 160 based on the above calculation values.
[0024] As shown in FIG. 4, when the operating device 132 is operated while the pan drive unit 161 is in a steady state (stop state or constant speed operation state), lever inclination information different from the steady state is transmitted to the network camera 100. At this time, for example, the operation speed ((second inclination information - inclination information in the steady state) / (time for two cycles)) is obtained based on the inclination information and the direction information for a time period of two cycles. In the present embodiment, as shown in FIG. 4, in the case of a gentle operation (Δ in the figure) and a quick operation (〇 in the figure), the operation speed is determined by obtaining information for two cycles.
[0025] In step S103, the system control unit 116 determines whether the value of the operation speed obtained in step S102 is greater than a predetermined value. If it is determined that the value of the operation speed is greater than the predetermined value, that is, if it is determined that the operation is quick, the process proceeds to step S104. If it is determined that the value of the operation speed is less than the predetermined value, that is, if it is determined that the operation is slow, the process proceeds to step S105. Note that when the value of the operation speed is the same as the predetermined value, which step to proceed to can be arbitrarily set.
[0026] Note that in this embodiment, the operation speed is obtained using information on the tilt and direction of the lever included in the operation information, but the present invention is not limited to this. For example, the operation information may include information on the operation speed, and the operation speed may be obtained using the information on the operation speed.
[0027] In step S104, the system control unit 116 (setting unit 116b) sets the pan acceleration to Hi (first acceleration).
[0028] In step S105, the system control unit 116 (setting unit 116b) changes the pan acceleration to Low (second acceleration).
[0029] Here, with reference to FIG. 5, the specifications regarding the acceleration and deceleration of the pan-tilt operation will be described. FIG. 5 is a diagram for explaining the specifications of the pan-tilt operation. In the pan-tilt operation in this embodiment, it is possible to switch between a plurality of accelerations and decelerations. By switching between a plurality of accelerations and decelerations, it is possible to shift to a constant speed state or a stop state in a short time, or to shift to a constant speed state or a stop state slowly. For example, in a scene where a fast action such as sports is being photographed, by setting the acceleration to Hi (for example, 200 degrees / s^2), it is possible to reach the maximum speed in 0.5 seconds. Also, in a scene where a slow action such as an orchestra is being photographed, by setting the acceleration to Low (for example, 100 degrees / s^2), it is possible to reach the maximum speed in 1 second. Thereby, an operation corresponding to the user's intention can be realized.
[0030] In step S106, the motor control unit 160 starts the pan acceleration process according to the acceleration setting.
[0031] In step S107, when the motor control unit 160 continues the pan acceleration process (for example, gradually increasing the drive frequency) until it reaches the specified speed, it ends the pan acceleration process.
[0032] In step S108, the motor control unit 160 outputs a drive signal so that the pan drive unit 161 operates at a constant speed (operates at a specified speed).
[0033] In step S109, the system control unit 116 sets the pan acceleration to a user-set value.
[0034] As described above, according to the configuration of the present embodiment, when a pan operation at a desired speed is required in the pan stopped state, the magnitude of the acceleration is switched according to the operation speed in the pan operation. Thereby, with a quick operation, the pan operation can be performed at the desired speed in a short time, and with a slow operation, the pan operation can be performed at the desired speed in a relatively long time. Therefore, the operability of the user can be improved. [Second Embodiment] In the present embodiment, a method for determining the deceleration when the operation device 132 instructs the stop of the pan operation in the constant speed operation state of the pan operation of the network camera 100 will be described.
[0035] FIG. 6 is a flowchart showing the method for determining the deceleration of the present embodiment. Before this flow starts, the network camera 100 is in the power-on state, and the pan drive unit 161 is in the state of operating at a constant speed. Also, the operation device 132 and the network camera 100 are connected and in an operable state. In the following description, the operation device 132 will be described as a joystick.
[0036] In step S201, the system control unit 116 determines whether a pan operation stop instruction has been acquired from the operation device 132. If it is determined that a pan operation stop instruction has been acquired, the process proceeds to step S202. If it is determined otherwise, the process of this step is repeated.
[0037] The processes of step S202 and step S203 are the same as the processes of step S102 and step S103 in FIG. 2, respectively, and thus the description is omitted.
[0038] In step S204, the system control unit 116 (setting unit 116b) sets the pan deceleration to Hi (the first deceleration).
[0039] In step S205, the system control unit 116 (setting unit 116b) changes the pan deceleration to Low (the second deceleration).
[0040] In step S206, the motor control unit 160 starts the pan deceleration process according to the deceleration setting.
[0041] In step S207, when the pan drive unit 161 stops while the motor control unit 160 continues the pan deceleration process (for example, gradually reducing the drive frequency), the motor control unit 160 ends the pan deceleration process.
[0042] In step S208, after the pan drive unit 161 stops, the motor control unit 160 outputs a drive signal so that it is held at that position.
[0043] In step S209, the system control unit 116 sets the pan deceleration to the user-set value.
[0044] As described above, according to the configuration of the present embodiment, when the pan operation stop is requested in the constant-speed operation state of the pan operation, the magnitude of the deceleration is switched according to the operation speed in the pan operation. Thereby, it can be stopped in a short time with a quick operation, and can be stopped in a relatively long time with a slow operation. Therefore, the operability of the user can be improved. [Third Embodiment] In this embodiment, a method for determining the acceleration and deceleration when the operation device 132 instructs a reverse pan operation in the constant-speed operation state of the pan operation of the network camera 100 will be described.
[0045] FIG. 7 is a flowchart showing a method for determining acceleration and deceleration according to the present embodiment. Before this flowchart starts, the network camera 100 is in the power-on state, and the pan driving unit 161 is in the state of operating at a constant speed. Also, the operation device 132 and the network camera 100 are connected and in an operable state. Note that the operation device 132 will be described as a joystick in the following description.
[0046] In step S301, the system control unit 116 determines whether it has acquired a pan operation instruction in the direction opposite to the current pan operation direction from the operation device 132. If it is determined that a pan operation instruction in the direction opposite to the current pan operation direction has been acquired, the process proceeds to step S302. If it is determined otherwise, the process of this step is repeated.
[0047] The processes of step S302 and step S303 are the same as the processes of step S102 and step S103 in FIG. 2, respectively, and thus the description thereof is omitted.
[0048] In step S304, the system control unit 116 (setting unit 116b) sets the pan acceleration and the pan deceleration to Hi (the first acceleration and the first deceleration).
[0049] In step S305, the system control unit 116 (setting unit 116b) changes the pan acceleration and the pan deceleration to Low (the second acceleration and the second deceleration).
[0050] In step S306, the motor control unit 160 starts a pan deceleration process according to the deceleration setting.
[0051] In step S307, when the pan driving unit 161 stops while the motor control unit 160 continues the pan deceleration process (for example, gradually decreasing the driving frequency), the motor control unit 160 ends the pan deceleration process.
[0052] In step S308, the motor control unit 160 starts a pan acceleration process according to the acceleration setting.
[0053] In step S309, the motor control unit 160 continues the pan acceleration process (for example, by increasing the drive frequency in stages) and ends the pan acceleration process when the designated speed is reached.
[0054] In step S310, the motor control unit 160 outputs a drive signal so that the pan driving unit 161 operates at a constant speed (operates at a designated speed).
[0055] In step S311, the system control unit 116 sets the pan acceleration and pan deceleration to user-set values.
[0056] As described above, according to the configuration of this embodiment, when a panning operation in the opposite direction is requested while the panning operation is in a constant speed state, the magnitude of the acceleration and deceleration is switched depending on the operation speed of the panning operation. As a result, a quick operation allows a panning operation in the opposite direction at the desired speed in a short time, while a slow operation allows a panning operation in the opposite direction at the desired speed in a relatively long time. Furthermore, since the acceleration and deceleration are the same for the acceleration and deceleration operations, the transition from the deceleration operation to the acceleration operation can be made without any sense of discomfort. This improves user operability.
[0057] The processing of the above-described embodiments may be performed by providing a storage medium on which software program code embodying each function is recorded to a system or device. The computer (or CPU or MPU) of the system or device then reads and executes the program code stored in the storage medium, thereby realizing the functions of the above-described embodiments. In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the storage medium storing the program code constitutes the present invention. Examples of storage media for providing such program code include floppy disks, hard disks, optical disks, and magneto-optical disks. Alternatively, CD-ROMs, CD-Rs, magnetic tapes, non-volatile memory cards, ROMs, and the like may also be used.
[0058] Moreover, by executing the program code read by the computer, not only are the functions of the above-described embodiments realized. Based on the instructions of the program code, an OS (operating system) or the like running on the computer performs part or all of the actual processing, and cases where the functions of the above-described embodiments are realized by this processing are also included.
[0059] Furthermore, the program code read from the storage medium may be written into a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. Thereafter, based on the instructions of the program code, a CPU or the like provided in the function expansion board or function expansion unit performs part or all of the actual processing, and cases where the functions of the above-described embodiments are realized by this processing are also included.
[0060] As described above, the preferred embodiments of the present invention have been explained, but the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of the gist thereof.
Explanation of Reference Numerals
[0061] 111 Lens (imaging unit) 112 Image sensor (imaging unit) 116 System control unit (control device) 116a Acquisition unit 116b Setting unit 132 Operating device 161 Pan drive unit (drive unit) 162 Tilt drive unit (drive unit)
Claims
1. A control device for controlling a driving unit capable of driving an imaging unit in a first direction and a second direction different from the first direction, an acquisition unit that acquires an operation speed of the user with respect to the operation device using operation information regarding an operation on the user's operation device, and a setting unit that sets at least one of an acceleration and a deceleration of the driving unit using the operation speed, wherein when the operation speed is greater than a predetermined value, the setting unit sets the acceleration to a first acceleration, and when the operation speed is less than the predetermined value, the setting unit sets the acceleration to a second acceleration smaller than the first acceleration. The control device is characterized by this.
2. The control device according to claim 1, wherein when the operation speed is greater than a predetermined value, the setting unit sets the deceleration to a first deceleration, and when the operation speed is less than the predetermined value, the setting unit sets the deceleration to a second deceleration smaller than the first deceleration.
3. The control device according to claim 1 or 2, wherein when the operation speed is greater than a predetermined value, the setting unit sets the acceleration and the deceleration to a first acceleration and a first deceleration having the same magnitude as the first acceleration, respectively, and when the operation speed is less than the predetermined value, the setting unit sets the acceleration and the deceleration to a second acceleration smaller than the first acceleration and a second deceleration smaller than the first deceleration and having the same magnitude as the second acceleration, respectively.
4. The operation device is a joystick, and the control device according to any one of claims 1 to 3, wherein the operation information includes information regarding the inclination and direction of the lever of the joystick.
5. The control device according to claim 4, wherein the acquisition unit acquires the operation speed using information regarding the current inclination and direction of the lever, information regarding the inclination and direction of the lever at a time of the first time before the present, and the first time.
6. The control device according to any one of claims 1 to 3, wherein the operation information includes information regarding the operation speed.
7. The control device according to claim 6, wherein the acquisition unit has acquiring the operation speed using information regarding the operation speed.
8. The first direction is a pan direction, and the control device according to any one of claims 1 to 7, wherein the second direction is a tilt direction.
9. An imaging unit, A driving unit capable of driving the imaging unit in a first direction and a second direction different from the first direction, An imaging device, comprising the control device according to any one of claims 1 to 8.
10. An imaging device including an imaging unit and a driving unit capable of driving the imaging unit in a first direction and a second direction different from the first direction, An operating device for operating the imaging device, An imaging system, comprising the control device according to any one of claims 1 to 8.
11. The imaging system according to claim 10, wherein the operating device is a joystick or a controller for video editing.
12. The imaging system according to claim 10 or 11, wherein the operating device is connected to the imaging device via at least one of an RS232C cable, a LAN cable, and a USB cable.
13. The imaging system according to any one of claims 10 to 12, wherein the operating device communicates with the imaging device at a predetermined period.
14. A control method for controlling a driving unit capable of driving an imaging unit in a first direction and a second direction different from the first direction, acquiring an operation speed of a user's operating device using operation information regarding an operation on the user's operating device; setting at least one of an acceleration and a deceleration of the driving unit using the operation speed, wherein in the setting step, when the operation speed is greater than a predetermined value, the acceleration is set to a first acceleration, and when the operation speed is less than the predetermined value, the acceleration is set to a second acceleration smaller than the first acceleration.
15. A program, characterized in that the computer executes the control method according to claim 14.
Citation Information
Patent Citations
Shooting angle control method of television camera in monitor device
JP1993250038A
Servo circuit
JP1995295646A
Moving speed controller and zoom ratio variable speed controller for image pickup camera
JP1999275434A
Camera revolving system
JP2017034325A
Tracking device
JP2017098723A