Control device, camera control system, control method and control procedure

The intuitive operation mode and display interface simplify the operation of the gimbal control device in the pan and tilt directions, improve the flexibility and efficiency of the camera device, and enable more intuitive adjustment of the shooting direction.

CN123077115APending Publication Date: 2026-11-10NIKON CORP
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202580026787.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2024-04-12
Filing Date
2025-04-11
Publication Date
2026-11-10

AI Technical Summary

Technical Problem

In existing technologies, the operation of gimbal control devices in the translation and pitch directions is highly complex, making it difficult to achieve intuitive and efficient adjustment of the shooting direction.

Method used

It adopts an intuitive operation mode, using the left joystick to control the pan, tilt and rotate of the gimbal, and combined with the intuitive operation interface on the display screen, it enables intuitive adjustment of the shooting direction.

Benefits of technology

The gimbal control operation has been simplified, the flexibility and efficiency of the camera device in the pan and tilt directions have been improved, and more intuitive camera orientation adjustment has been achieved.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN123077115A_ABST
    Figure CN123077115A_ABST
Patent Text Reader

Abstract

A control device controls a photographic system capable of rotating at a first rotation angle about an axis in a first direction different from the photographic direction, and a second rotation angle about an axis in a second direction different from the photographic direction. The control device includes: a display unit having a display screen showing an image of a first subject position within a photographic object area captured by the photographic system in the photographic direction; an input unit receiving input of the surface direction of the display screen, i.e., the operating direction; and a control unit that controls the rotation of the first and second rotation angles such that the photographic direction becomes a direction from the photographic system toward a second subject position after movement in the operating direction input by the input unit.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] Reference-based merging

[0002] This application claims priority to Japanese Patent Application No. 2024-64855, filed on April 12, 2024 (Reiwa 6), and incorporates therein by reference. Technical Field

[0003] This invention relates to a control device, a photographic control system, a control method, and a control program. Background Technology

[0004] There exists a gimbal control device that controls the pan and tilt rotation of the camera.

[0005] Existing technical documents

[0006] Patent documents

[0007] Patent Document 1: Japanese Patent Application Publication No. 2007-114503 Summary of the Invention

[0008] The control device of the first disclosure controls a photographic system capable of rotating at a first rotation angle about an axis different from the photographic direction and a second rotation angle about an axis different from the photographic direction. The control device includes: a display unit having a display screen showing an image of a first subject position within a photographic object area captured by the photographic system in the photographic direction; an input unit receiving input of the surface direction of the display screen, i.e., the operating direction; and a control unit that controls the rotation of the first and second rotation angles such that the photographic direction becomes a direction from the photographic system toward a second subject position after movement in the operating direction input by the input unit.

[0009] The control device of the second disclosure controls a rotating mechanism capable of rotating at a first rotation angle about an axis in a first direction different from a predetermined direction, and a second rotation angle about an axis in a second direction different from the predetermined direction. The control device includes: an input unit that receives an input of an operating direction; and a control unit that performs rotational control on the first rotation angle and the second rotation angle such that the predetermined direction becomes a direction from the rotating mechanism toward a destination after moving in the operating direction input by the input unit.

[0010] The control device of the third disclosure controls a photographic system, the photographic system comprising a photographic unit having a photographic surface and a drive unit for rotating the photographic unit to change the photographic direction, wherein the control device comprises: an input unit that receives an instruction to change the photographic direction from a first direction to a second direction; and a control unit that generates a signal for controlling the rotation of the drive unit based on the instruction input through the input unit, the control unit generating the signal after changing the second direction to a direction within the photographic surface.

[0011] The fourth disclosed technology discloses a control device for controlling a photographic system capable of rotating at a first rotation angle about an axis in a first direction different from the photographic direction, and a second rotation angle about an axis in a second direction different from the photographic direction. The control device includes: a display unit having a display screen showing an image of a first subject position within a photographic object area captured by the photographic system in the photographic direction; an input unit receiving input of an operating direction; and a control unit that, when the input unit receives the input of the operating direction, controls the rotation of the first and second rotation angles to align them with the direction in which a second subject is photographed relative to the displayed first subject in the operating direction on the display screen.

[0012] The fifth disclosure discloses a control device for controlling a photographic system capable of rotating at a first rotation angle about an axis in a first direction different from the photographic direction, and a second rotation angle about an axis in a second direction different from the photographic direction. The control device comprises: a display unit having a display screen showing an image of a subject within a photographic object area captured by the photographic system in the photographic direction; an input unit receiving input of the surface direction of the display screen, i.e., the operating direction; and a control unit that controls the rotation of the first and second rotation angles to move the subject displayed on the display screen in a direction opposite to the operating direction.

[0013] The control device of the sixth disclosure controls a photographic system capable of rotating at a first rotation angle about an axis in a first direction different from the photographic direction, and a second rotation angle about an axis in a second direction different from the photographic direction. The control device includes: a display unit having a display screen showing an image of a first subject position within a first photographic object area captured by the photographic system in the first photographic direction; an input unit receiving input of the surface direction of the display screen, i.e., the operating direction; and a control unit that controls the rotation of the first and second rotation angles, changing the first photographic object area to a second photographic object area in the operating direction input by the input unit from the photographic system, and displaying an image of a second subject position within the second photographic object area on the display screen.

[0014] The photographic control system disclosed in the 7th disclosure includes a photographic system and a control device for controlling the photographic system. The photographic system is capable of rotating at a first rotation angle about an axis different from the photographic direction and a second rotation angle about an axis different from the photographic direction. The control device includes: a display unit having a display screen that displays an image of a first subject position within a photographic object area captured by the photographic system in the photographic direction; an input unit that receives input of the surface direction of the display screen, i.e., the operating direction; and a control unit that controls the rotation of the first rotation angle and the second rotation angle such that the photographic direction becomes a direction from the photographic system toward a second subject position, the second subject position being the position after moving in the operating direction input by the input unit.

[0015] The photography control system disclosed in the 8th edition has a rotating mechanism and a control device for controlling the rotating mechanism. The rotating mechanism is capable of rotating at a first rotation angle about an axis in a first direction different from a predetermined direction, and a second rotation angle about an axis in a second direction different from the predetermined direction. The control device has an input unit that receives an input of an operating direction, and a control unit that performs rotational control on the first rotation angle and the second rotation angle, such that the predetermined direction becomes a direction from the rotating mechanism toward a destination after moving in the operating direction input by the input unit.

[0016] The photographic control system disclosed in the 9th disclosure includes a photographic system and a control device for controlling the photographic system. The photographic system includes a photographic unit having an image-capturing surface and a drive unit for rotating the photographic unit to change the photographic direction. The control device includes an input unit that receives an instruction to change the photographic direction from a first direction to a second direction; and a control unit that generates a signal for controlling the rotation of the drive unit based on the instruction input through the input unit. The control unit generates the signal after changing the second direction to a direction within the image-capturing surface.

[0017] The 10th disclosed photographic control system includes a photographic system and a control device for controlling the photographic system. The photographic system is capable of rotating at a first rotation angle about an axis different from the photographic direction and a second rotation angle about an axis different from the photographic direction. The control device includes: a display unit having a display screen that displays an image of the position of a first subject within a photographic object area captured by the photographic system in the photographic direction; an input unit that accepts input of an operating direction; and a control unit that, when the input unit accepts the input of the operating direction, controls the rotation of the first rotation angle and the second rotation angle to become the direction in which a second subject is photographed relative to the displayed first subject in the operating direction on the display screen.

[0018] The 11th disclosed photographic control system includes a photographic system and a control device for controlling the photographic system. The photographic system is capable of rotating at a first rotation angle about an axis in a first direction different from the photographic direction, and a second rotation angle about an axis in the first direction different from the photographic direction. The control device includes: a display unit having a display screen that displays an image of a subject within a photographic object area captured by the photographic system in the photographic direction; an input unit that receives input of the surface direction of the display screen, i.e., the operating direction; and a control unit that controls the rotation of the first rotation angle and the second rotation angle so that the subject displayed on the display screen moves in a direction opposite to the operating direction.

[0019] The 12th disclosed photographic control system includes a photographic system and a control device for controlling the photographic system. The photographic system is capable of rotating at a first rotation angle about an axis different from the photographic direction and a second rotation angle about an axis different from the photographic direction. The control device includes: a display unit having a display screen that displays an image of a first subject position within a first photographic object area captured by the photographic system in the first photographic direction; an input unit that receives input of the surface direction of the display screen, i.e., the operating direction; and a control unit that performs rotational control on the first rotation angle and the second rotation angle, changing the first photographic object area to a second photographic object area in the operating direction input by the input unit from the photographic system, and displaying an image of a second subject position within the second photographic object area on the display screen.

[0020] The control method disclosed in the 13th disclosure is a method executed by a control device that controls a photographic system capable of rotating with a first rotation angle about an axis in a first direction different from the photographic direction, and a second rotation angle about an axis in a second direction different from the photographic direction. The control device performs: a display process that displays an image of a first subject position within a photographic object area captured by the photographic system in the photographic direction; an input process that accepts input of the display screen direction of the image, i.e., the operation direction; and a control process that controls the rotation of the first and second rotation angles such that the photographic direction becomes a direction from the photographic system toward a second subject position after movement in the operation direction input by the input process.

[0021] The control method disclosed in the 14th edition is a method executed by a control device, the control device controlling a rotating mechanism capable of rotating at a first rotation angle about an axis in a first direction different from a predetermined direction, and a second rotation angle about an axis in a second direction different from the predetermined direction, wherein the control device performs: input processing to receive input of an operating direction; and control processing to perform rotational control on the first rotation angle and the second rotation angle such that the predetermined direction becomes a direction from the rotating mechanism toward a moving destination after moving in the operating direction input by the input processing.

[0022] The control method disclosed in the 15th disclosure is a method executed by a control device, the control device controlling a photographic system comprising: a photographic unit having a photographic surface, and a drive unit for rotating the photographic unit to change the photographic direction, wherein the control device performs: input processing, receiving an instruction to change the photographic direction from a first direction to a second direction; and control processing, based on the instruction input through the input processing, transforming the second direction into a direction within the photographic surface and generating a signal for controlling the rotation based on the drive unit.

[0023] The control method disclosed in the 16th disclosure is a method executed by a control device, the control device controlling a photographic system capable of rotating with a first rotation angle about an axis different from the photographic direction and a second rotation angle about an axis different from the photographic direction, wherein the control device performs: a display process for displaying an image of the position of a first subject within the photographic object area captured by the photographic system in the photographic direction on a display screen; an input process for accepting an input of an operating direction; and a control process for controlling the rotation of the first rotation angle and the second rotation angle when the input of the operating direction is accepted by the input process, so as to become the direction in which a second subject is photographed relative to the displayed first subject in the operating direction on the display screen.

[0024] The control method disclosed in the 17th edition is a method executed by a control device, the control device controlling a photographic system capable of rotating with a first rotation angle about an axis in a first direction different from the photographic direction, and a second rotation angle about an axis in a second direction different from the photographic direction, wherein the control device performs: display processing, displaying an image of a subject within a photographic object area captured by the photographic system in the photographic direction on a display screen; input processing, accepting input of the surface direction of the display screen, i.e., the operation direction; and control processing, performing rotational control on the first rotation angle and the second rotation angle so that the subject displayed on the display screen moves in a direction opposite to the operation direction.

[0025] The control method disclosed in the 18th edition is a method executed by a control device, the control device controlling a photographic system capable of rotating with a first rotation angle about an axis in a first direction different from the photographic direction, and a second rotation angle about an axis in a second direction different from the photographic direction, wherein the following are executed: display processing, displaying on a display screen an image of a first subject position within a first photographic object area captured by the photographic system in the first photographic direction; input processing, accepting input of the surface direction of the display screen, i.e., the operation direction; and control processing, performing rotation control on the first rotation angle and the second rotation angle, changing the first photographic object area to a second photographic object area in the operation direction input by the input processing from the photographic system, and displaying an image of a second subject position within the second photographic object area on the display screen.

[0026] The control program of the 19th disclosure causes a processor controlling a photographic system to perform processing, the photographic system being able to rotate with a first rotation angle about an axis in a first direction different from the photographic direction, and a second rotation angle about an axis in a second direction different from the photographic direction, the control program causing the processor to perform: display processing, displaying an image of a first subject position within the photographic object area captured by the photographic system in the photographic direction; input processing, accepting input of the surface direction of the image display screen, i.e., the operation direction; and control processing, performing rotational control on the first rotation angle and the second rotation angle such that the photographic direction becomes a direction from the photographic system toward a second subject position after moving in the operation direction input by the input processing.

[0027] The control program of the 20th disclosure causes a processor controlling a rotating mechanism to perform processing, the rotating mechanism being capable of rotating at a first rotation angle about an axis in a first direction different from a predetermined direction, and a second rotation angle about an axis in a second direction different from the predetermined direction, the control program causing the processor to perform: input processing, accepting input of an operating direction; and control processing, performing rotational control on the first rotation angle and the second rotation angle such that the predetermined direction becomes a direction from the rotating mechanism toward a moving destination after moving in the operating direction input by the input processing.

[0028] The control program of the 21st disclosure causes a processor controlling a camera system to perform processing, the camera system comprising: a camera unit having an image-capturing surface, and a drive unit for rotating the camera unit to change the camera direction, the control program causing the processor to perform: input processing, receiving an instruction to change the camera direction from a first direction to a second direction; and control processing, based on the instruction input through the input processing, transforming the second direction into a direction within the image-capturing surface and generating a signal for controlling the rotation based on the drive unit.

[0029] The control program of the 22nd disclosure causes a processor controlling a photographic system to perform processing, the photographic system being able to rotate with a first rotation angle about an axis in a first direction different from the photographic direction, and a second rotation angle about an axis in a second direction different from the photographic direction, the control program causing the processor to perform: display processing, displaying on a display screen an image of the position of a first subject within the photographic object area captured by the photographic system in the photographic direction; input processing, accepting input of the operating direction; and control processing, when the input of the operating direction is accepted by the input processing, rotating and controlling the first rotation angle and the second rotation angle to become the direction in which a second subject is photographed relative to the displayed first subject in the operating direction on the display screen.

[0030] The control program of the 23rd disclosure causes a processor controlling a photographic system to perform processing, the photographic system being able to rotate with a first rotation angle about an axis in a first direction different from the photographic direction, and a second rotation angle about an axis in a second direction different from the photographic direction, the control program causing the processor to perform: display processing, displaying an image of a subject within the photographic object area captured by the photographic system in the photographic direction on a display screen; input processing, accepting input of the surface direction of the display screen, i.e., the operating direction; and control processing, performing rotational control on the first rotation angle and the second rotation angle so that the subject displayed on the display screen moves in a direction opposite to the operating direction.

[0031] The control program of the 24th disclosure causes a processor controlling a photographic system to perform processing, the photographic system being able to rotate by a first rotation angle about an axis in a first direction different from the photographic direction, and a second rotation angle about an axis in a second direction different from the photographic direction. The control program causes the processor to perform: display processing, displaying on a display screen an image of the position of a first subject within a first photographic object area captured by the photographic system in the first photographic direction; input processing, accepting input of the surface direction of the display screen, i.e., the operation direction; and control processing, performing rotation control on the first rotation angle and the second rotation angle, changing the first photographic object area to a second photographic object area in the operation direction input by the input processing from the photographic system, and displaying an image of the position of a second subject within the second photographic object area on the display screen. Attached Figure Description

[0032] Figure 1 This is an explanatory diagram showing an example of a photographic scene.

[0033] Figure 2This is an explanatory diagram showing an example of the system configuration of a camera control system.

[0034] Figure 3 This is an explanatory diagram showing an example of the configuration of a photographic system.

[0035] Figure 4 This is a block diagram illustrating an example of the hardware configuration of a control device.

[0036] Figure 5 This is an explanatory diagram representing Example 1 of the display screen.

[0037] Figure 6 This is a magnified view of the site display data.

[0038] Figure 7 This is an explanatory diagram illustrating the intuitive operation example 1.

[0039] Figure 8 This is an explanatory diagram illustrating the intuitive operation example 2.

[0040] Figure 9 This is an explanatory diagram showing the display screen in Example 1 of the intuitive operation example.

[0041] Figure 10 This is an explanatory diagram showing the display screen in Example 2 of the intuitive operation example.

[0042] Figure 11 This is a top view of the site in Example 1 of the operation and control of the photography system.

[0043] Figure 12 This is a flowchart illustrating the operation and processing flow of the photography system, Example 1 (first half).

[0044] Figure 13 This is an explanatory diagram showing the calculation examples of distances D1(1) to D4(1).

[0045] Figure 14 This is a flowchart illustrating the operation and processing flow of the photography system, Example 1 (the latter half).

[0046] Figure 15 This is a diagram representing a specific example 1 of the configuration location of the camera system.

[0047] Figure 16 This is a top view of the site in Example 2 of the operation and control of the photography system.

[0048] Figure 17 This is a flowchart illustrating the operation and processing flow of the photography system, Example 2 (first half).

[0049] Figure 18 This is a diagram representing a specific example 2 of the configuration location of the photography system. Detailed Implementation

[0050] < Figure 1 On-site photography >

[0051] Figure 1 This is an explanatory diagram showing an example of a photographic scene. Figure 1 In the example, the shooting location is football stadium 100. However, the shooting location is not limited to football stadium 100; it can be any other sports venue. Furthermore, the shooting location is not limited to outdoors; it can also be indoors. Additionally, the shooting location is not limited to a sports stadium; it can also be an event venue, amusement park or other entertainment facilities, or a city center, as long as it is a suitable location for photography.

[0052] Stadium 100 has a field 101 and a stands 102. The field 101 is surrounded by the stands 102. A pitch 103 is located within the field 101. The pitch 103 is formed by the touchline 1102, the goal line 1103, and the corner points C1 to C4. The touchline 1102 and the goal line 1103 are orthogonal.

[0053] Camera systems 110-1 to 110-8 are installed in the audience seating area 102. Without distinguishing between camera systems 110-1 to 110-8, they are referred to as camera system 110. Multiple camera systems 110 (eight in this example) are arranged to surround the venue 101. Camera system 110 consists of a pan-tilt head 111 and a camera device 112. The pan-tilt head 111 has a rotation mechanism capable of rotating about three mutually orthogonal axes. The pan-tilt head 111 holds the camera device 112. The pan-tilt head 111 controls the attitude of the camera device 112 through the rotation mechanism. The pan-tilt head 111 can be communicatively connected to the camera device 112.

[0054] The camera device 112 photographs the subject. Because the camera device 112 is held by the gimbal 111, it can take pictures in an orientation maintained by the rotation mechanism of the gimbal 111. In this example, the camera device 112 is primarily facing the field 101 to photograph the football match. Alternatively, the camera system 110 can also be positioned above the field 101.

[0055] < Figure 2 Photo Control System >

[0056] Figure 2 This is an explanatory diagram showing an example of the system configuration of a camera control system. The camera control system 200 includes a camera system 110 and a control device 201. The camera system 110 and the control device 201 are connected in a communicable manner via a network 202 such as the Internet, LAN (Local Area Network), or WAN (Wide Area Network).

[0057] The control device 201 can be connected only to the gimbal 111, or it can be connected to both the gimbal 111 and the camera device 112. When the control device 201 is only connected to the gimbal 111, the control signal from the control device 201 controlling the camera device 112 is sent from the gimbal 111 to the camera device 112.

[0058] The control device 201 includes a keyboard 211, a mouse 212, a controller 213, and a display 214.

[0059] The controller 213 is connected to the control device 201 via wired or wireless means to communicate. The controller 213 includes a left joystick 231L, a right joystick 231R, a trigger button 232, and a crosshair 233.

[0060] The left joystick 231L and right joystick 231R can be tilted radially from the upright position, and can move circumferentially along a circle centered on the upright position while tilted. The left joystick 231L is an operating part for operating the rotation mechanism of the gimbal 111 in the translation direction p and the pitch direction t. The right joystick 231R is an operating part for operating the rotation mechanism of the gimbal 111 in the roll direction r.

[0061] The trigger button 232 is a shutter (release) button for taking still images using the photographic device 112. The cross key 233 is an operating part for adjusting the focal length of the photographic device 112 towards the telephoto (telephoto) side or the wide-angle (wide-angle) side.

[0062] The control device 201 sends control signals corresponding to inputs from the keyboard 211, mouse 212, and controller 213 to the camera system 110 via the network 202. The camera device 112 sends captured image data to the control device 201 via the network 202. The display 214 displays the image data from the camera device 112.

[0063] < Figure 3 Photography System 110>

[0064] Figure 3 This is an explanatory diagram showing an example of the configuration of the camera system 110. The gimbal 111 includes a control unit 300, a translation and rotation mechanism 310, a pitch and rotation mechanism 320, and a roll and rotation mechanism 330.

[0065] The control unit 300 includes a processor 301, a storage device 302, a drive circuit 303, a communication interface (communication IF) 304, and a bus 305. The processor 301, storage device 302, drive circuit 303, and communication IF 304 are connected via the bus 305.

[0066] The processor 301 controls the control unit 300. The storage device 302 becomes the operating area of ​​the processor 301. Furthermore, the storage device 302 is a non-transitory or temporary recording medium that stores various programs and data. Examples of storage devices 302 include ROM (Read Only Memory), RAM (Random Access Memory), HDD (Hard Disk Drive), and flash memory.

[0067] The drive circuit 303 performs rotation control on the translation rotation mechanism 310, the pitch rotation mechanism 320 and the roll rotation mechanism 330 based on the control signal from the processor 301.

[0068] Communication IF304 receives data from control device 201 via network 202 and sends data to control device 201. Additionally, if communication IF304 is connected to camera device 112, it receives data from camera device 112 and sends data to camera device 112.

[0069] Additionally, the communication IF304 can also receive signals from GPS satellites. In this case, the control unit 300 can locate the position of the photography system 110, or obtain the altitude of the located position from a server (not shown) providing map data on the storage device 302 or network 202. Alternatively, the control unit 300 can also obtain the altitude from an altimeter, which uses a barometric pressure sensor to detect the air pressure at the location where the photography system 110 is set and converts it into altitude.

[0070] Alternatively, the control unit 300 may not be installed on the gimbal 111, but rather inside the control device 201.

[0071] Next, the translation rotation mechanism 310, the pitch rotation mechanism 320, and the roll rotation mechanism 330 will be described. The translation rotation mechanism 310 rotates the camera device 112 along the translation direction p about the z-axis. The pitch rotation mechanism 320 rotates the camera device 112 along the pitch direction t about the y-axis. The roll rotation mechanism 330 rotates the camera device 112 along the roll direction r about the x-axis.

[0072] The x-axis, y-axis, and z-axis are orthogonal to each other. The direction pointed to by the end (arrow end) of the x-axis, y-axis, and z-axis is set as the positive direction, and the direction pointed to by the beginning is set as the negative direction.

[0073] Furthermore, for ease of explanation, it is assumed that the camera system 110 is configured such that the xy plane, defined by the x-axis and y-axis, is parallel to the ground surface (site 101), and the z-axis is perpendicular to the ground surface (site 101). Additionally, the translation angle p and pitch angle t in this configuration are set to p = 0 degrees and t = 0 degrees, respectively. Furthermore, regarding the translation angle p, pitch angle t, and roll angle r, the counterclockwise direction of the x-axis, y-axis, and z-axis is set as the positive rotation direction, and the clockwise direction as the negative rotation direction, respectively.

[0074] The translation rotation mechanism 310 holds the pitch rotation mechanism 320 in a manner that allows rotation along the translation direction p. The pitch rotation mechanism 320 holds the roll rotation mechanism 330 in a manner that allows rotation along the pitch direction t. The roll rotation mechanism 330 holds the camera device 112 in a manner that allows rotation along the roll direction r. When the translation angle p = 0 and the pitch angle t = 0, the y-axis becomes the optical axis of the camera device 112. The coordinate system 340 defines the mutually orthogonal x-axis, y-axis, and z-axis, as well as the translation direction p, pitch direction t, and roll direction r.

[0075] In this embodiment, the rotation based on the translation direction p of the translation-rotation mechanism 310 and the rotation based on the pitch direction t of the pitch-rotation mechanism 320 have two operation methods: normal operation and intuitive operation. The control device 201 can select between normal operation and intuitive operation.

[0076] In normal operation, for the translation and rotation mechanism 310, tilting the left joystick 231L in the left-right direction 351 corresponds to rotating the gimbal 111 in the translation direction p. Similarly, in normal operation, for the pitch and rotation mechanism 320, tilting the left joystick 231L in the up-down direction 352 corresponds to rotating the gimbal 111 in the pitch direction t.

[0077] The rotation in the translation direction p based on the translation rotation mechanism 310 and the rotation in the pitch direction t based on the pitch rotation mechanism 320 under intuitive operation will be described later. It should be noted that, in normal operation and intuitive operation, for example, the movement of the right control stick 231R in the circumferential direction 353 when it is tilted corresponds to the operation of rotating the gimbal 111 in the roll direction r.

[0078] Furthermore, the gimbal 111 can also be configured without the roll rotation mechanism 330. In this case, the roll rotation mechanism 330 only serves as a holding part for holding the camera device 112.

[0079] Furthermore, the photography system 110 is configured by holding the photography device 112 in the gimbal 111, but the photography system 110 can also be configured by integrating the gimbal 111 and the photography device 112 into one unit. Alternatively, the photography system 110 can also be a drone. In the case of a drone, the translation rotation mechanism 310, the pitch rotation mechanism 320, and the roll rotation mechanism 330 are implemented by rotating the drone itself in the translation direction r, pitch direction t, and roll direction r.

[0080] < Figure 4 Example of the configuration of control device 201 >

[0081] Figure 4 This is a block diagram showing an example of the configuration of the control device 201.

[0082] [Hardware Configuration]

[0083] As hardware components, the control device 201 includes a processor 401, a storage device 402, an input device 403, an output device 404, a communication IF 405, and a bus 406. The processor 401, storage device 402, input device 403, output device 404, and communication IF 405 are connected via the bus 406. The processor 401 controls the control device 201. The storage device 402 serves as the operating area for the processor 401. Furthermore, the storage device 402 is a non-transitory or temporary recording medium for storing various programs and data. Examples of storage devices 402 include ROM, RAM, HDD, and flash memory.

[0084] Input device 403 inputs data. Examples of input devices 403 include a keyboard 211, mouse 212, controller 213, touch panel, numeric keypad, scanner, microphone, and sensor. Output device 404 outputs data. Examples of output devices 404 include a display 214, printer, and speaker. Communication IF 305 connects to network 202 and transmits and receives data with the camera system 110.

[0085] [Functional Composition]

[0086] The control device 201 controls the imaging system 110, which is capable of rotating by a first rotation angle (e.g., translation angle p) about an axis different from the imaging direction of the imaging device 112 (e.g., translation direction p), and a second rotation angle (e.g., pitch angle t) about an axis different from the imaging direction (e.g., pitch direction t). Functionally, the control device 201 includes a display unit 411, an input unit 412, and a control unit 413. Specifically, the display unit 411, the input unit 412, and the control unit 413 are implemented, for example, by causing the processor 401 to execute a program stored in the storage device 402.

[0087] The display unit 411 has a display screen (e.g., display screen 500) that displays an image of the position (e.g., current position CP) of the first subject within the photographic object area (e.g., the court 103) captured by the photography system 110 in the photographic direction.

[0088] The input unit 412 accepts input of the orientation of the display screen (e.g., display screen 500) as the operating direction through the operation of the input device 403.

[0089] The control unit 413 performs rotation control on the first rotation angle (e.g., translation angle p) and the second rotation angle (e.g., pitch direction t) so that the shooting direction becomes the direction from the shooting system 110 toward the second subject position (e.g., target position DP) after moving from the first subject position (e.g., current position CP) to the operation direction input by the input unit 412.

[0090] < Figure 5 Example of a display screen >

[0091] Figure 5 This is an explanatory diagram illustrating Example 1 of the display screen. The display screen 500 is displayed on the monitor 214. The display screen 500 has a first display area 501, a second display area 502, and a third display area 503. The first display area 501 is a display screen that displays image data captured by the selected photographic device 112. The second display area 502 is a display screen that displays thumbnails of image data captured by multiple photographic devices 112 respectively.

[0092] The third display area 503 is a display area operable via the input device 403. Specifically, for example, the third display area 503 displays site display data 530. Site display data 530 is display data showing site 101. Site display data 530 includes configuration markers 531, camera icon 532, and subject position icon 533.

[0093] Configuration marker 531 indicates the configurable position of camera system 110. Camera icon 532 indicates that camera systems 110-4 and 110-8 are configured at the positions corresponding to configuration markers 531-4 and 531-8. Subject position icon 533 indicates the position of the subject captured by camera system 110 corresponding to camera icon 532.

[0094] The arrow connecting the camera icon 532 and the subject position icon 533 represents the shooting direction from the camera system 110. The subject position icon 533 can be moved on the field display data 530 via the operation of the input device 403, and the arrow also moves to follow the subject position icon 533.

[0095] As in Figure 3 As described in the description, the normal operation button 541 is a user interface for setting the pan / rotation mechanism 310 and the pitch / rotation mechanism 320 to normal operation. The intuitive operation button 542 is a user interface for setting the pan / rotation mechanism 310 and the pitch / rotation mechanism 320 to intuitive operation. Intuitive operation is the operation of moving the position of the subject in the screen direction of the first display area 501. The intuitive operation button 542 with a shaded line shows that intuitive operation was selected by pressing it.

[0096] The zoom slider 543 is a slider used to change the focal length of the zoom lens of the photographic device 112 between the telephoto end and the wide-angle end.

[0097] Joystick 544 is a user interface that simulates the operation of the left joystick 231L. Roll slider 545 is a user interface that simulates the movement of the right joystick 231R in the circumferential direction 353.

[0098] The shutter button 546 is a user interface for capturing still images using the photographic device 112 by pressing it. The photographic device 112 that is the target of operation can be the photographic device 112 of the photographic system 110 selected by the camera icon 532, or it can be the photographic device 112 of another photographic system 110 that is not selected by the camera icon 532. Which photographic device 112 is set as the target of operation is predetermined.

[0099] < Figure 6 The venue displays data 530>

[0100] Figure 6 This is an enlarged view of the site display data 530. Configuration marks 531-1 to 531-8 indicate the configurable positions of the camera system 110. Without distinguishing between configuration marks 531-1 to 531-8, it is referred to as configuration mark 531. The position of configuration mark 531 is set for ease of user understanding; in practice, as... Figure 1 As shown, the camera system 110 corresponding to configuration mark 531 is configured in the audience seating 102.

[0101] Camera icons 532-4 and 532-8 indicate that camera systems 110-4 and 110-8 are configured in the positions corresponding to configuration markers 531-4 and 531-8. Camera icons 532-4 and 532-8 are displayed by clicking the corresponding configuration markers 531-4 and 531-8.

[0102] Although not illustrated, when the configuration markers 531-1~531-3, 531-5~531-7 are clicked, the camera icon 532 corresponding to the camera system 110-1~110-3, 110-5~110-7 is displayed in the same way as the camera icons 532-4 and 532-8.

[0103] It should be noted that it is assumed that the displayed camera icons 532-4 and 532-8 are pre-set to correspond with the camera systems 110-4 and 110-8. Therefore, when camera icons 532-4 and 532-8 are selected by pressing, the image data captured by the corresponding camera systems 110-4 and 110-8 is displayed in the first display area 501. The camera icon 532-8 with a shaded line indicates that camera system 110-8 has been selected by pressing.

[0104] <Intuitive Operation>

[0105] Next, the intuitive operation will be explained in detail. Intuitive operation includes both cases where the roll rotation mechanism 330 is not used and cases where the roll rotation mechanism 330 is used. The case where the roll rotation mechanism 330 is not used is when its operation is set to be disabled, or when the gimbal 111 does not have the roll rotation mechanism 330. Figure 7 The text explains the case where the roll rotation mechanism 330 is not used. Figure 8 The use of the roll rotation mechanism 330 is explained in the text.

[0106] It should be noted that, in Figure 7 and Figure 8 Taking the operation of the left control stick 231L and the right control stick 231R as an example, the operation via the control stick 544 and the roll slider 545 is the same.

[0107] [ Figure 7 [Intuitive Operation Example 1]

[0108] Figure 7 This is an explanatory diagram illustrating the intuitive operation example 1. Point A represents the current position of the subject (hereinafter referred to as the current position), and points B and C represent the positions of the subjects that will become the target (hereinafter referred to as the target positions). Circle 741 is a circle centered on the z-axis of the imaging device 112 and passing through point A. Circle 742 is a circle centered on the z-axis of the imaging device 112 and passing through point B. Circle 743 is a circle centered on the z-axis of the imaging device 112 and passing through point C. Circles 741 to 743 are concentric circles centered on the z-axis.

[0109] Image data 701 represents subject 710 (player 711 and field 101) at point A, captured by camera device 112. The direction of camera device 112 toward point A is the camera direction Sa. Image data 702 represents subject 720 (player 711, soccer ball 712, and field 101) at point B, captured by camera device 112. The direction of camera device 112 toward point B is the camera direction Sb. Image data 703 represents subject 730 (player 713 and field 101) at point C, captured by camera device 112.

[0110] The direction in which the photographic device 112 faces point C is the photographic direction Sc. The photographic directions Sa, Sb, and Sc are the optical axis directions of the photographic device 112. Furthermore, the direction of movement from point A to points B and C is designated as Ma.

[0111] (Movement from point A to point B)

[0112] Here, it is assumed that while the camera device 112 is shooting at point A in the shooting direction Sa, the athlete 711 runs to the left on the field 101, that is, runs in the movement direction Ma, and reaches point B. At this time, when switching the shooting point from point A to point B, the gimbal 111 rotates the camera device 112 in the translation direction p (positive) by a translation angle pab, and rotates the camera device 112 in the pitch direction t (negative) by a pitch angle tb. As a result, the shooting direction Sb of the camera device 112 is towards point B, so the camera device 112 can capture the subject 720 of the athlete 711 running from point A to point B.

[0113] In this case, during intuitive operation, the user simply tilts the left joystick 231L to the left, causing the pan-tilt head 111 to rotate the camera device 112 in the translation direction p (positive) by a translation angle pab, and in the pitch direction t (negative) by a pitch angle tb. After confirming that the subject 720 is displayed in the first display area 501, the user returns the left joystick 231L to its original upright position. This stops the pan-tilt head 111 from rotating in the translation direction p (positive) and in the pitch direction t (negative).

[0114] Assuming that under normal operation, the user only tilts the left joystick 231L to the left, the gimbal 111 will only rotate the camera device 112 in the translation direction p (positive) by a translation angle pab, and will not rotate in the pitch direction t (negative). That is, when the user combines tilting the left joystick 231L to the left and tilting it upwards, the gimbal 111 will rotate the camera device 112 in the translation direction p (positive) by a translation angle pab, and will also rotate the camera device 112 in the pitch direction t (negative) by a pitch angle tb.

[0115] (Movement from point A to point C)

[0116] Here, when the camera device 112 is shooting at point A in the shooting direction Sa, and the user wants to make the camera device 112 shoot at the subject 730 in the shooting direction Sc, the user simply pushes the left control stick 231L harder than at point B, causing it to tilt to the left. The gimbal 111 then rotates the camera device 112 in the translation direction p (positive) by a translation angle pac, and in the pitch direction t (negative) by a pitch angle tc. After confirming that the subject 730 is displayed in the first display area 501, the user returns the left control stick 231L to its original upright position. Thus, the gimbal 111 stops rotating in the translation direction p (positive) and in the pitch direction t (negative).

[0117] Alternatively, the user can continue to tilt the left control stick 231L to the left with the same amount of pressure as in the case of shooting point B. In this case, after confirming that the camera device 112 is shooting the subject 730 in the shooting direction Sc and that the subject 730 is displayed in the first display area 501, the user returns the left control stick 231L to its original upright position. As a result, the gimbal 111 stops rotating in the translation direction p (positive) and the pitch direction t (negative).

[0118] (Intuitive operations after moving to point B or point C)

[0119] When operating the camera directly from point B of the camera device 112, no rotation in the roll direction r is performed. Therefore, when the left joystick 231L is tilted upwards, the subject position moves from point B to the upper right direction 725U, and the subject 720 is out of the frame and moves out of the frame to the lower left direction 725D. Similarly, when the left joystick 231L is tilted downwards, the subject position moves from point B to the lower left direction 725D, and the subject 720 is out of the frame and moves out of the frame to the upper right direction 725U.

[0120] Similarly, when the left joystick 231L is tilted to the left, the subject position moves from point B to the upper left direction 725L, and the subject 720 moves out of the frame and to the lower right direction 725R. Similarly, when the left joystick 231L is tilted to the right, the subject position moves from point B to the lower right direction 725R, and the subject 720 moves out of the frame and to the upper left direction 725L.

[0121] Similarly, for point C, when operating the camera intuitively from the state of point C captured by the camera device 112, no rotation in the roll direction r is performed. Therefore, when the left joystick 231L is tilted upwards, the subject position moves from point C to the upper right direction 735U, and the subject 730 is out of the frame and moves out of the frame to the lower left direction 735D. Similarly, when the left joystick 231L is tilted downwards, the subject position moves from point C to the lower left direction 735D, and the subject 720 is out of the frame and moves out of the frame to the upper right direction 735U.

[0122] Similarly, when the left joystick 231L is tilted to the left, the subject position moves from point C to the upper left direction 735L, and the subject 730 is out of the frame and moves out of the frame to the lower right direction 735R. Similarly, when the left joystick 231L is tilted to the right, the subject position moves from point C to the lower right direction 735R, and the subject 730 is out of the frame and moves out of the frame to the upper left direction 735L.

[0123] [ Figure 8 [Intuitive Operation Example 2]

[0124] Figure 8 This is an explanatory diagram illustrating the intuitive operation example 2. Figure 8 Is Figure 7 This example illustrates rotation in the roll direction *r* when moving from point A to points B and C. Specifically, for example, control device 201 controls the gimbal 111 to rotate in the roll direction *r* (negative) by a roll angle *rb* equal to the translation angle *pab* from point A to point B. The roll angle *rb* may not be the same as the translation angle *pab*, but rather a difference within an acceptable range. Thus, the operating direction from point B is the same as or approximately the same as the operating direction from point A.

[0125] Therefore, after the roll rotation, when the left joystick 231L is tilted upwards, the subject's position moves upwards at a distance of 825U from point B, and the subject 720 is removed from the composition and moves out of the frame at a downward distance of 825D. Similarly, when the left joystick 231L is tilted downwards, the subject's position moves downwards at a distance of 825D from point B, and the subject 720 is removed from the composition and moves out of the frame at a distance of 825U.

[0126] Similarly, when the left joystick 231L is tilted to the left, the subject's position moves 825L to the left from point B, and the subject 720 moves out of the frame 825R to the right. Likewise, when the left joystick 231L is tilted to the right, the subject's position moves 825R to the right from point B, and the subject 720 moves out of the frame 825L to the left.

[0127] Similarly, for point C, control device 201 controls the gimbal 111 to rotate in the roll direction r (negative) by a roll angle rc equal to the translation angle pab from point A to point C. The roll angle rc may not be the same as the translation angle pab, but rather have a difference from the translation angle pab within an acceptable range. Therefore, the operating direction from point C is the same as or approximately the same as the operating direction from point A.

[0128] Therefore, after the roll rotation, when the left joystick 231L is tilted upwards, the subject position moves upwards at a distance of 825U from point C, and the subject 720 is removed from the composition and moves downwards at a distance of 825D out of the frame. Similarly, when the left joystick 231L is tilted downwards, the subject position moves downwards at a distance of 825D from point C, and the subject 720 is removed from the composition and moves upwards at a distance of 825U out of the frame.

[0129] Similarly, when the left joystick 231L is tilted to the left, the subject's position moves 825L to the left from point C, and the subject 720 moves out of the frame and to the right and out of the frame. Likewise, when the left joystick 231L is tilted to the right, the subject's position moves 825R to the right from point C, and the subject 720 moves out of the frame and to the left and out of the frame.

[0130] [ Figure 9 [Example 1 of the display screen in the intuitive operation example]

[0131] Figure 9 This is an explanatory diagram illustrating the display screen example 1 in the intuitive operation example 1. Specifically, for example... Figure 9 Showing the representation Figure 7 The image shown is a display screen 500 showing the photographic state of point B after moving from point A to point B. Because... Figure 7 There is no rotation along the roll direction r, therefore, as Figure 7 As shown, arrows 725U, 725D, 725L, and 725R indicate the operating direction of the left joystick 231L.

[0132] [ Figure 10 [Example 2 of the display screen in the intuitive operation example]

[0133] Figure 10 This is an explanatory diagram illustrating the display screen in Example 2 of the intuitive operation example. Specifically, for example... Figure 9 Indicates Figure 8 The image shown is a display screen 500 showing the photographic state of point B after moving from point A to point B. Because... Figure 8 It has a rotation in the roll direction r, therefore, as Figure 9 As shown, the arrows 725U, 725D, 725L, and 725R indicating the operating direction of the left joystick 231L are not displayed.

[0134] < Figure 11 Example 1 of operation and control of camera system 110

[0135] Next, an example of the operation and control of the camera system 110 will be described. Here, the case where the height H of the camera system 110 is unknown and the camera system 110 is located outside the stadium 103 and its airspace above it will be described. As long as the camera system 110 is located outside the stadium 103 and its airspace above it, it can be the field 101 or its airspace above it, or it can be the stands 102 or its airspace above it.

[0136] Figure 11 This is a top view of the site 101 in the operation control example 1 of the photography system 110. It is assumed that the x-axis of the coordinate system 340 is parallel to the sideline 104, and the y-axis is parallel to the baseline 105. Furthermore, the lengths of the sideline 104 (i.e., sideline length V) and the baseline 105 (i.e., baseline length W) are stored as known values ​​in the storage device 402 of the control unit 201.

[0137] When viewed from the z-direction, the intersection point of the y-axis of the gimbal 111 in the camera system 110 and the foreground edge 104 is defined as C5. It should be noted that the y-axis and the intersection point C5 do not need to be strictly orthogonal; their accuracy will be guaranteed in step S1209 described later.

[0138] < Figure 12 Example 1 of the operation and processing flow of camera system 110 (first half) >

[0139] Figure 12 This is a flowchart representing Example 1 (first half) of the operation and processing flow of the camera system 110.

[0140] (Step S1201)

[0141] The control device 201 orients the camera system 110 toward each of the corner points C1 to C4 and the intersection points C5 and C6, and measures the translation angles p(C1) to p(C6) relative to the origin O when the camera system 110 orients the corner points C1 to C4 and the intersection point C5, and the pitch angles t(C1) to t(C4) relative to the origin O when the camera system 110 orients the camera system 110 orients the corner points C1 to C4.

[0142] p(C1) = θ1

[0143] p(C2) = θ2

[0144] p(C3) = θ3

[0145] p(C4) = θ4

[0146] p(C5) = θ5

[0147] t(C1) = 1

[0148] t(C2) = 2

[0149] t(C3) = 3

[0150] t(C4) = 4

[0151] (Step S1202)

[0152] When the translation angle θ5 at intersection point C5 is not zero, the y-axis of the gimbal 111 deviates from the optical axis of the imaging device 112. Therefore, the control device 201 corrects the translation angles p(C1) to p(C4) of corner points C1 to C4 using the translation angle p(C5). Specifically, for example, the control device 201 subtracts the translation angle p(C5) from the translation angles p(C1) to p(C4) of corner points C1 to C4. The corrected translation angles p[C1] to p[C4] of corner points C1 to C4 are as follows.

[0153] p[C1]=θ1-θ5

[0154] p[C2]=θ2+θ5

[0155] p[C3]=θ3+θ5

[0156] p[C4]=θ4-θ5

[0157] (Step S1203)

[0158] The control device 201 calculates the distances D1(1) to D4(1) from the camera system 110 to the corner points C1 to C4 when the height H of the camera system 110 is set to a unit height (e.g., 1m).

[0159] [ Figure 13 Example of calculating distances D1(1) to D4(1)]

[0160] Figure 13 This is an explanatory diagram showing the calculation examples of distances D1(1) to D4(1). For example... Figure 13 As shown, the distances D1(1) to D4(1) are calculated as follows.

[0161] D1(1) = cot 1

[0162] D2(1) = cot 2

[0163] D3(1) = cot 3

[0164] D4(1) = cot 4

[0165] (Step S1204)

[0166] return Figure 12 The control device 201 calculates the coordinate values ​​C1(1)~C4(1) of the corner points C1~C4 when the height H of the photography system 110 is a unit height. The x-coordinate values ​​C1(1)x~C4(1)x of the coordinate values ​​C1(1)~C4(1) are calculated as follows.

[0167] C1(1)x=D1(1)×sin(p[C1])

[0168] C2(1)x=D2(1)×sin(p[C2])

[0169] C3(1)x=D3(1)×sin(p[C3])

[0170] C4(1)x=D4(1)×sin(p[C4])

[0171] In addition, the y coordinates of coordinates C1(1)~C4(1) are calculated as follows.

[0172] C1(1)y=D1(1)×cos(p[C1])

[0173] C2(1)y=D2(1)×cos(p[C2])

[0174] C3(1)y=D3(1)×cos(p[C3])

[0175] C4(1)y=D4(1)×cos(p[C4])

[0176] (Step S1205)

[0177] The control device 201 calculates the unit edge length V(1) and the unit bottom length W(1) of the camera system 110 when the height H is a unit height. The unit edge length V(1) is calculated as follows.

[0178] V(1)={|C1(1)x|+|C2(1)x|+|C3(1)x|+|C4(1)x|} / 2

[0179] In addition, the unit bottom line length W(1) is calculated as follows.

[0180] W(1)={|C4(1)y|-|C1(1)y|+|C3(1)y|-|C2(1)y|} / 2

[0181] (Step S1206)

[0182] The control device 201 calculates at least one of a first coefficient α and a second coefficient β. The first coefficient α represents the ratio of the side length V to the unit side length V(1). The second coefficient β represents the ratio of the bottom line length W to the bottom line length W(1). The first coefficient α and the second coefficient β are calculated as follows.

[0183] α=V / V(1)

[0184] β=W / W(1)

[0185] (Step S1207)

[0186] The control device 201 calculates the height H of the camera system 110 based on at least one of a first coefficient α and a second coefficient β. When using only the first coefficient α, the control device 201 calculates the first coefficient α as the height H of the camera system 110. When using only the second coefficient β, the control device 201 calculates the second coefficient β as the height H of the camera system 110.

[0187] When using the first coefficient α and the second coefficient β, the control device 201 calculates a statistical value based on the first coefficient α and the second coefficient β as the height H of the camera system 110. The statistical value based on the first coefficient α and the second coefficient β refers to, for example, the maximum value, minimum value, and average value of the first coefficient α and the second coefficient β.

[0188] (Step S1208)

[0189] The control device 201 calculates the coordinate values ​​of corner points C1 to C4. The x-coordinate values ​​C1x to C4x of corner points C1 to C4 are calculated as follows.

[0190] C1x=C1(1)x×α

[0191] C2x=C2(1)x×α

[0192] C3x=C3(1)x×α

[0193] C4x=C4(1)x×α

[0194] In addition, the y-coordinates C1y to C4y of the corner points C1 to C4 are calculated as follows.

[0195] C1y=C1(1)y×β

[0196] C2y=C2(1)y×β

[0197] C3y=C3(1)y×β

[0198] C4y=C4(1)y×β

[0199] (Step S1209)

[0200] The control device 201 calculates the edge length V12 between corner points C1 and C2, the bottom line length W23 between corner points C2 and C3, the edge length V34 between corner points C3 and C4, and the bottom line length W41 between corner points C4 and C1. The edge lengths V12, W23, V34, and W41 are calculated as follows.

[0201] V12=|C1x|+|C2x|

[0202] W23=|C3y|-|C2y|

[0203] V34 = |C3x| + |C4x|

[0204] W41=|C4y|-|C1y|

[0205] Control device 201 calculates the edge line accuracy AV and the bottom line accuracy AW. The edge line accuracy AV and the bottom line accuracy AW represent the measurement accuracy of the translation angles P (C1) to p (C6) and the pitch angles t (C1) to t (C4) of corner points C1 to C4. The edge line accuracy AV and the bottom line accuracy AW are calculated in the following manner.

[0206] AV = |V12-V34|

[0207] AW = |W23-W41|

[0208] If at least one of the edge accuracy (AV) and bottom accuracy (AW) exceeds a specified threshold (e.g., 5m), the control device 201 considers the camera system 110 to be unacceptable in terms of accuracy and displays a warning on the display 214. In this case, the system either restarts from step S1201, resets the gimbal 111, or allows the user to continue operating with low accuracy.

[0209] If neither the edge accuracy (AV) nor the bottom accuracy (AW) exceeds the specified threshold (e.g., 5m), the camera system 110 is considered to meet the required accuracy, and the process is switched to... Figure 14 Step S1401.

[0210] < Figure 14 Example 1 (second half) of the operation and processing flow of the camera system 110 >

[0211] Figure 14 This is a flowchart illustrating the operation and processing flow of the camera system 110, Example 1 (second half).

[0212] (Step S1401)

[0213] Control device 201 awaits operation input via input device 403 (step S: No). Operation input via input device 403 refers to tilt input of left joystick 231L, tilt input of joystick 544, or movement input of subject position icon 533. If operation input via input device 403 is received (step S1401: Yes), proceed to step S1402.

[0214] (Step S1402)

[0215] The control device 201 calculates the target position DP = (xdp, ydp, -H) through the operation of the input device 403, and then proceeds to step S1403.

[0216] [Operation input via left joystick 231L or joystick 544]

[0217] When an operation input is made via the left joystick 231L (and the same applies to joystick 544), the control device 201 detects the tilting direction and the amount of pressure. The amount of pressure is the strength of the left joystick 231L pushing in the tilting direction. The strength of the pressure is detected, for example, by a pressure sensor within the controller 213 and sent as the amount of pressure to the control device 201.

[0218] Control device 201 determines the tilting direction of the left joystick 231L as the movement direction Mcd from the current position CP to the target position DP. For example, in Figure 7 and Figure 8 In the example, when point A is set as the current position CP and point B is set as the target position DP, the movement direction Ma is the movement direction Mcd.

[0219] The control device 201 calculates the travel distance MDcd from the current position CP to the target position DP based on the amount of pressure applied to the left joystick 231L. Since the travel distance MDcd is directly proportional to the amount of pressure applied, the greater the pressure, the longer the travel distance MDcd. Figure 7 and Figure 8 In the example, the lengths of line segments AB and AC are the distances MDcd that were moved.

[0220] Based on the coordinates (xcp, ycp) of the current position CP, the direction of movement Mcd, and the distance of movement MDcd, the control device 201 calculates the coordinates (xdp, ydp, -H) of the target position DP on the xy plane (site 101).

[0221] [Operation input via subject position icon 533]

[0222] When an operation input is made via the subject position icon 533, the control device 201 determines the direction from the current position CP of the subject position icon 533 to the target position DP as the movement direction Mcd. Then, proceed to step S1403.

[0223] The control device 201 calculates the coordinates (xcp, ycp) of the target position DP reached when the subject position icon 533 is moved from the current position CP along the movement direction Mcd.

[0224] (Step S1403)

[0225] The control device 201 calculates the distance Ddp from the camera system 110 (origin O) to the target position DP. The distance Ddp is calculated as follows.

[0226] Ddp = √{(Fdp)} 2 +H 2}···(1)

[0227] In this example, the unit height (e.g., 1m) is substituted as the height H. It should be noted that if the height H is a known value, the control device 201 does not execute step S1207, but instead substitutes the height H into the above equation (1) to calculate the distance Ddp.

[0228] Since the distance Fdp is the distance from point Q to the target position DP, the distance Fdp is calculated as follows.

[0229] Fdp = √{(xdp)} 2 +(ydp) 2}

[0230] It should be noted that, in order to simplify the calculation, the control device 201 calculates the x-coordinate value xdp (1) and the y-coordinate value ydp (1) per unit height by dividing the x-coordinate value xdp and the y-coordinate value ydp of the target position DP by the first coefficient α and the second coefficient β, respectively. Then, the control device 201 uses the x-coordinate value xdp (1) and the y-coordinate value ydp (1) per unit height to calculate the distance Ddp (1) per unit height.

[0231] Ddp(1)=√{(xdp(1)) 2 +(ydp(1)) 2}

[0232] It is feasible to treat the distance Fdp(1) per unit height as the distance Ddp(1) per unit height.

[0233] (Step S1404)

[0234] Control device 201 calculates the translation angle θdp and pitch angle relative to the target position DP. dp is used as the rotation control variable. Translation angle θdp and pitch angle are also considered. dp is calculated using the following formula.

[0235] θdp=arctan{xdp / (Ddp×ydp)}+θ5

[0236] dp = arctan(H / Ddp)

[0237] The case using Ddp(1) is calculated as follows.

[0238] θdp=arctan{xdp(1) / (Ddp(1)×ydp(1))}+θ5

[0239] dp = arctan(1 / Ddp(1))

[0240] (Step S1405)

[0241] Control device 201 calculates the rotation control quantity (θcd, cd). Rotational control quantity (θcd, cd) is calculated using the following formula.

[0242] θcd=θdp-θcp

[0243] cd = dp- cp

[0244] θcp is the translation angle p of the gimbal 111 relative to the current position CP. cp is the pitch angle t of gimbal 111 relative to the current position CP, obtained from gimbal 111.

[0245] (Step S1406)

[0246] Control device 201 controls the rotation by means of the rotation control quantity (θcd, cd) controls the rotation of the gimbal 111. Specifically, for example, the control device 201 causes the gimbal 111 to rotate by a translation angle θcd and a pitch angle θcd. cd. Therefore, the optical axis of the imaging device 112 is oriented towards the target position DP, such as Figure 7 As shown, subjects 720 and 730 are photographed. Then, proceed to step S1407.

[0247] (Step S1407)

[0248] When the gimbal 111 can rotate in the roll direction r, the control device 201 controls the gimbal 111 to rotate in the roll direction r by a roll angle ψcd equal to the translation angle θcd. Thus, the optical axis of the imaging device 112 is oriented towards the target position DP, as... Figure 8 As shown, the subjects were photographed at 720 and 730.

[0249] Furthermore, since the coordinates (xdp, ydp, -H) of the target location DP have been determined, the control device 201 moves the subject position icon 533 in the field display data 530 from the current location CP to the target location DP. Thus, a correspondence is established between the position of the subject at the target location DP displayed in the first display area 501 and the position of the subject position icon 533, allowing the user to have a clear overview of where the target location DP is located on the field 101.

[0250] It should be noted that, Figure 11 The current position CP shown is any point within the field 101. However, when the coordinates of any point within the field 101 are unknown, the control device 201 calculates the coordinates of any point within the field 101 by setting the current position CP as a known point such as corner point C1~C4 and setting any unknown point within the field 101 as the target position DP.

[0251] < Figure 15 Example 1 of the specific configuration location of the camera system 110

[0252] Figure 15 This is a diagram illustrating a specific example 1 of the configuration position of the camera system 110. The configuration position of the camera system 110 is determined by a combination of positive or negative signs of the translation angles p[C1] to p[C4] of the corner points C1 to C4. However, the condition is that the absolute value of each of the translation angles p[C1] to p[C4] is less than 90 degrees.

[0253] The control device 201 determines the location of the camera system 110 by calculating the translation angles p[C1] to p[C4] of corner points C1 to C4 for each of the multiple camera systems 110 using step S1502. Figure 15 In the example, control device 201 determines that the photography system 110 is configured between C1 and C2.

[0254] In this way, even if the height H of the camera system 110 is unknown, the control device 201 can calculate the height H of the camera system 110, so that the user can operate the gimbal 111 intuitively.

[0255] < Figure 16 Example 2 of operation and control of camera system 110

[0256] Example 2 of the operation and control of the camera system 110 will be described. Here, we will describe the case where the height H of the camera system 110 is unknown and the camera system 110 is located on and above the stadium 103.

[0257] Figure 16 This is a top view of site 101 in Example 2 of the operation control of the camera system 110. Figure 11 Unlike other systems, since the camera system 110 is located on and above the court 103, the point where the y-axis intersects the sideline 104 orthogonally upwards with the y-axis of the gimbal 111 in the camera system 110 when viewed from the z-direction is set as C5. It should be noted that the y-axis and the intersection point C5 do not need to be strictly orthogonal; their accuracy will be guaranteed in step S1710 described later.

[0258] < Figure 17 Example 2 of the operation and processing flow of camera system 110 (first half) >

[0259] Figure 17 This is a flowchart representing Example 2 (first half) of the operation and processing flow of the camera system 110.

[0260] (Step S1701)

[0261] The control device 201 orients the camera system 110 toward each of the corner points C1 to C4 and the intersection point C5, and measures the translation angles p(C1) to p(C5) relative to the origin O when the camera system 110 is oriented toward each of the corner points C1 to C4 and the intersection point C5, and the pitch angles t(C1) to t(C4) relative to the origin O when the camera system 110 is oriented toward each of the corner points C1 to C4.

[0262] p(C1) = θ1

[0263] p(C2) = θ2

[0264] p(C3) = θ3

[0265] p(C4) = θ4

[0266] p(C5) = θ5

[0267] t(C1) = 1

[0268] t(C2) = 2

[0269] t(C3) = 3

[0270] t(C4) = 4

[0271] (Step S1702)

[0272] When the translation angle θ5 at intersection point C5 is not zero, the y-axis of the gimbal 111 deviates from the optical axis of the imaging device 112. Therefore, the control device 201 corrects the translation angles p(C1) to p(C4) of corner points C1 to C4 using the translation angle p(C5). Specifically, for example, the control device 201 subtracts the translation angle p(C5) from the translation angles p(C1) to p(C4) of corner points C1 to C4. The corrected translation angles p[C1] to p[C4] of corner points C1 to C4 are as follows.

[0273] p[C1]=θ1-θ5

[0274] p[C2]=θ2-θ5

[0275] p[C3]=θ3-θ5

[0276] p[C4]=θ4-θ5

[0277] (Step S1703)

[0278] The control device 201 sets the height H of the control device 201 to a unit height (e.g., 1m) and calculates the distances D1(1) to D4(1) from the camera system 110 to the corner points C1~C4.

[0279] D1(1)=cot(t(C1))

[0280] D2(1)=cot(t(C2))

[0281] D3(1)=cot(t(C3))

[0282] D4(1)=cot(t(C4))

[0283] (Step S1704)

[0284] The control device 201 calculates the angle ψ1 between the camera system 110 and the x-axis when the camera system 110 is oriented toward corner point C1, the angle ψ2 between the camera system 110 and the x-axis when the camera system 110 is oriented toward corner point C2, the angle ψ3 between the camera system 110 and the x-axis when the camera system 110 is oriented toward corner point C3, and the angle ψ4 between the camera system 110 and the x-axis when the camera system 110 is oriented toward corner point C4.

[0285] ψ1=-p[C1]-90

[0286] ψ2=p[C2]-90

[0287] ψ3=-p[C3]+90

[0288] ψ4=p[C4]+90

[0289] (Step S1705)

[0290] The control device 201 uses distances D1 (1) and D2 (1) to calculate the unit side length V (1) per unit height using the following formula (2).

[0291] V(1)=D1(1)×cosψ1+D2(1)×cosψ2···(2)

[0292] In addition, the control device 201 uses distances D3 (1) and D4 (1) to calculate the unit side length V (1)B per unit height using the following formula (3).

[0293] V(1)=D3(1)×cosψ1+D4(1)×cosψ2···(3)

[0294] The control device 201 uses distances D1 (1) and D4 (1) to calculate the unit bottom line length W (1) per unit height using the following formula (4).

[0295] W(1)=D1(1)×sinψ1+D4(1)×sinψ4···(4)

[0296] In addition, the control device 201 uses distances D2 (1) and D3 (1) to calculate the unit bottom line length W (1) per unit height using the following formula (5).

[0297] W(1)=D2(1)×sinψ2+D3(1)×sinψ3···(5)

[0298] (Step S1706)

[0299] The control device 201 calculates at least one of a first coefficient α and a second coefficient β. The first coefficient α represents the ratio of the side length V to the unit side length V(1). The second coefficient β represents the ratio of the bottom line length W to the bottom line length W(1). The first coefficient α and the second coefficient β are calculated as follows.

[0300] α=V / V(1)

[0301] β=W / W(1)

[0302] The unit side length V(1) used in the calculation of the first coefficient α can be either of the two unit side lengths V(1) in equations (2) and (3) above, or it can be the average of the two unit side lengths V(1) in equations (2) and (3) above. The unit bottom length W(1) used in the calculation of the second coefficient β can be either of the two unit bottom lengths W(1) in equations (4) and (5) above, or it can be the average of the two unit bottom lengths W(1) in equations (4) and (5) above.

[0303] (Step S1707)

[0304] Similarly to step S1207, control device 201 calculates the height H of camera system 110 based on at least one of the first coefficient α and the second coefficient β.

[0305] (Step S1708)

[0306] The control device 201 calculates the coordinate values ​​C1(1)~C4(1) of the corner points C1~C4 when the height H of the photography system 110 is a unit height. The x-coordinate values ​​C1(1)x~C4(1)x of the coordinate values ​​C1(1)~C4(1) are calculated as follows.

[0307] C1(1)x=-D1(1)×cosψ1

[0308] C2(1)x=D2(1)×cosψ2

[0309] C3(1)x=D3(1)×cosψ3

[0310] C4(1)x=-D4(1)×cosψ4

[0311] In addition, the y coordinates of coordinates C1(1)~C4(1) are calculated as follows.

[0312] C1(1)y=-D1(1)×sinψ1

[0313] C2(1)y=-D2(1)×sinψ2

[0314] C3(1)y=D3(1)×sinψ3

[0315] C4(1)y=D4(1)×sinψ4

[0316] (Step S1709)

[0317] Similarly to step S1208, control device 201 calculates the coordinate values ​​of corner points C1 to C4. The x-coordinate values ​​C1x to C4x of corner points C1 to C4 are calculated as follows.

[0318] C1x=C1(1)x×α

[0319] C2x=C2(1)x×α

[0320] C3x=C3(1)x×α

[0321] C4x=C4(1)x×α

[0322] In addition, the y-coordinates C1y to C4y of the corner points C1 to C4 are calculated as follows.

[0323] C1y=C1(1)y×β

[0324] C2y=C2(1)y×β

[0325] C3y=C3(1)y×β

[0326] C4y=C4(1)y×β

[0327] (Step S1710)

[0328] Similar to step S1209, control device 201 calculates the edge length V12 between corner points C1 and C2, the bottom line length W23 between corner points C2 and C3, the edge length V34 between corner points C3 and C4, and the bottom line length W41 between corner points C4 and C1. The edge length V12, bottom line length W23, edge length V34, and bottom line length W41 are calculated as follows.

[0329] V12=|C1x|+|C2x|

[0330] W23=|C3y|+|C2y|

[0331] V34 = |C3x| + |C4x|

[0332] W41=|C4y|+|C1y|

[0333] The control device 201 calculates the edge line accuracy AV and the bottom line accuracy AW. The edge line accuracy AV and the bottom line accuracy AW are calculated in the following manner.

[0334] AV = |V12-V34|

[0335] AW = |W23-W41|

[0336] If the control device 201 determines that the imaging system 110 does not meet the required accuracy if at least one of the edge line accuracy AV and the bottom line accuracy AW is above a specified threshold (e.g., 5m), a warning is displayed on the display 214. In this case, the process is restarted from step S1801.

[0337] If neither the edge accuracy AV nor the bottom accuracy AW exceeds the specified threshold (e.g., 5m), the imaging system 110 is considered to meet the required accuracy, and the control device 201 executes the command. Figure 14 Steps S1401~S1407.

[0338] It should be noted that if the height H is a known value, the control device 201 will not execute step S1707, but will instead substitute the height H into the above formula (1) to calculate the distance Ddp (step S1403).

[0339] < Figure 18 Example 2 of the specific configuration location of the camera system 110

[0340] Figure 18 This is a diagram illustrating a specific example 2 of the configuration location of the camera system 110. The orientation of the camera system 110 is determined by a combination of positive or negative signs of the translation angles p[C1] to p[C4] of the corner points C1 to C4. However, the condition is that the absolute value of each of the translation angles p[C1] to p[C4] is less than 90 degrees.

[0341] The control device 201 determines the location of the camera system 110 by calculating the translation angles p[C1] to p[C4] of corner points C1 to C4 for each of the multiple camera systems 110 using step S1702. Figure 18 In the example, the control device 201 determines that the camera system 110 is oriented between C3 and C4.

[0342] In this way, even if the height H of the camera system 110 is unknown, the control device 201 can calculate the height H of the camera system 110, so that the user can operate the gimbal 111 intuitively.

[0343] In this way, the user intuitively operates the left joystick 231L, joystick 544, or subject position icon 533 to move the subject position in the direction of the display screen in the first display area 501. This makes the direction of operation of the left joystick 231L, joystick 544, or subject position icon 533 the same as the direction of movement of the subject position in the direction of the display screen in the first display area 501. Therefore, user operability is improved, allowing the user to intuitively change the composition of the photographic device 112, and making subject tracking easier.

[0344] It should be noted that when the photography system 110 is a drone, since it can move after measuring corner points C1 to C4, when hovering after moving, the control device 201 only needs to correct the coordinates of the origin O and the altitude H according to the amount and direction of movement. Therefore, the operation control of the photography system 110 is executed at the origin O and altitude H after movement.

[0345] <Variation Example>

[0346] Next, a variation of the above-mentioned camera control system 200 will be described.

[0347] [Variation Example 1]

[0348] Figure 6 The image shows that camera system 110-8 was selected via camera icon 532-8. Figures 7-18The text describes the operation controls of the selected camera system 110-8, but not the other camera systems 110 (in...). Figure 6 In the example, camera system 110-4 is also controlled following the operation control of camera system 110-8. That is, the other camera system 110 is controlled to face the target position DP in the same way as camera system 110-8. Thus, it is possible to use multiple camera systems 110 to track and photograph the same subject.

[0349] [Modification Example 2]

[0350] When the control device 201 operates the photography system 110 to change the subject's position from the current position CP to the target position DP, it can also perform automatic zoom control on the photography device 112. Specifically, at the target position DP, the control device 201 uses skeletal detection to detect human subjects from the composition of the target position DP and counts the number of people detected. Then, the control device 201 controls the photography device 112 to change the magnification (zoom ratio) towards the wide-angle side.

[0351] The control device 201 again uses skeletal detection technology to detect the number of people in the subject in the composition after moving to the wide-angle side.

[0352] If the number of people counted after the zoom lens moves to the wide-angle side is greater than the number of people before the movement, the control device 201 repeats the movement control of the camera device 112 to change the magnification to the wide-angle side and the counting of the number of people in the subject using skeletal detection technology.

[0353] If the number of people counted before and after the magnification is changed to the wide-angle side decreases, the control device 201 controls the camera device 112 to restore the magnification before the magnification change.

[0354] By performing automatic zoom control in this way, even if the subject the user wants to photograph is lost when changing from the current position CP to the target position DP in a fast operation, for example, the photography device 112 can automatically set the composition to suit the target position DP.

[0355] Additionally, the control device 201 can detect a human subject from the composition of the target position DP using skeletal detection technology, but it can also detect a human subject using facial recognition. Furthermore, the control device 201 can also perform zoom control on the imaging device 112 based on the size of the detected subject. Specifically, for example, the control device 201 performs zoom control so that the rectangle surrounding the detected subject converges within the composition of the imaging device 112.

[0356] In addition, the control device 201 can also control the roll angle r to eliminate the tilt of the bones in the frame when it can determine that the person is standing vertically relative to the ground by using the detected skeleton and / or posture information of the person, so that the person included in the shooting field of view is captured vertically in the photographic image.

[0357] [Modification Example 3]

[0358] In the above embodiment, a football stadium 100 was used as an example for explanation. In the case of the football stadium 100, there is a rectangular field 103. Therefore, when the pan-tilt unit 111 is set along the sideline 104 of the field 103, the control device 201 can easily set the intersection point C5.

[0359] In contrast, when the camera system 111 is installed inside the netting in a baseball field, or at corner points C1 to C4 in a soccer stadium, for example, if the camera system 110 is installed inside the netting in a baseball field, the intersection of the extended lines of home plate and first base or home plate and third base is set as C5, and the corner points of the infield rhombus are measured as C1 to C4 respectively, thereby enabling the calculation of the coordinates of any point in the field.

[0360] [Variation Example 4]

[0361] In the above example, the example of operating the gimbal 111 using the left joystick 231L was explained, but as long as the operation direction can be input, the right joystick 231R or the D-pad 233 can also be used for operation.

[0362] [Variation Example 5]

[0363] The function of the control device 201 to operate and control the camera system 110 can also be installed in the controller 213.

[0364] [Variation Example 6]

[0365] When the camera system 110 is equipped with a rangefinder, it can measure the distances to corner points C1-C4 and the distance Dcp to the current position CP, and send them to the control device 201. This simplifies the calculation and processing in the control device 201.

[0366] It should be noted that this invention is not limited to the above-described contents, and they can be combined in any way. Furthermore, other solutions that can be considered within the scope of the technical concept of this invention are also included within the scope of this invention.

[0367] Explanation of reference numerals in the attached figures

[0368] 110 Photography system, 111 Pan-tilt head, 112 Photography device, 200 Photography control system, 201 Control device, 300 Control unit, 310 Translation and rotation mechanism, 320 Pitch and rotation mechanism, 330 Roll and rotation mechanism, 411 Display unit, 412 Input unit, 413 Control unit.

Claims

1. A control device, characterized in that, The control device controls the imaging system, which is capable of rotating by a first rotation angle about an axis in a first direction different from the imaging direction, and a second rotation angle about an axis in a second direction different from the imaging direction. The control device has: The display unit has a display screen that displays an image of the first subject position within the photographic object area captured by the photographic system in the photographic direction; The input unit accepts input regarding the orientation of the display screen, i.e., the operating direction; and The control unit rotates the first rotation angle and the second rotation angle so that the imaging direction is from the imaging system toward the position of the second subject after moving in the operation direction input by the input unit.

2. The control device according to claim 1, characterized in that, The control unit performs rotation control on the first rotation angle and the second rotation angle so that the imaging direction becomes a direction from the imaging system toward the position of the second subject after the first subject position has been moved in the operating direction with the input intensity of the input unit.

3. The control device according to claim 1 or 2, characterized in that, The display unit displays information indicating the operating direction from the position of the second subject, based on the rotation control amount of the first rotation angle by the control unit.

4. The control device according to claim 1 or 2, characterized in that, The photographic system is capable of rotating about an axis in the direction of the photograph. The control unit controls the camera system to rotate around the axis of the camera direction based on the rotation control amount of the first rotation angle, so that the operating direction from the second subject position is consistent with or approximately the operating direction from the first subject position.

5. The control device according to claim 4, characterized in that, The photographic system is capable of rotating about an axis in the direction of the photograph. The control unit detects the skeletal information of a person in the image of the second subject position, and controls the camera system to rotate around the axis of the camera direction based on the rotation control amount of the first rotation angle and the detected skeletal information of the person, so that the operating direction from the second subject position is consistent with or approximately the operating direction from the first subject position.

6. The control device according to any one of claims 1 to 5, characterized in that, The input section accepts input of the operation direction from the joystick or the cross key.

7. The control device according to any one of claims 1 to 5, characterized in that, The display screen shows a display area of ​​the photographic object area captured by the photography system, and an icon indicating the position of the subject on the display area. The input unit accepts movement inputs to move the icon from the first subject position to the second subject position on the display area.

8. The control device according to any one of claims 1 to 6, characterized in that, The display screen shows a display area of ​​the photographic object area captured by the photography system, and an icon indicating the position of the subject on the display area. When the display unit receives input of the operation direction through the input unit, it changes the display position of the icon from the first subject position on the display area to the second subject position.

9. The control device according to any one of claims 1 to 8, characterized in that, The control unit detects a person subject in the image of the second subject position and controls the camera system based on the detected person information to change the zoom ratio of the camera system.

10. The control device according to any one of claims 1 to 9, characterized in that, The control unit calculates the rotation control amount of the first rotation angle based on the position of the second subject and the distance from the camera system to the position of the second subject, and calculates the rotation control amount of the second rotation angle based on the height of the camera system and the distance from the camera system to the position of the second subject.

11. The control device according to claim 10, characterized in that, The photography system includes an altimeter. The control unit obtains the height of the camera system from the camera system.

12. The control device according to claim 10, characterized in that, The control unit determines the coordinates of the rectangle when the height of the camera system is set to a unit height, based on the first rotation angle and the second rotation angle of each vertex of the rectangle in the area of ​​the photographed object captured by the camera system, calculates the side length of the rectangle at the unit height, and calculates the height of the camera system based on the actual side length of the rectangle and the side length of the rectangle at the unit height.

13. The control device according to claim 12, characterized in that, The control unit determines the measurement accuracy of the first rotation angle and the second rotation angle of each vertex based on the actual side length of the rectangle within the photographed object area and the side length of the rectangle at the unit height.

14. The control device according to any one of claims 1 to 13, characterized in that, The input unit accepts the selection of any one of the multiple camera systems configured in different locations. The control unit performs rotation control on the first rotation angle and the second rotation angle of a specific camera system selected by the input unit from among the multiple camera systems.

15. The control device according to claim 14, characterized in that, The control unit follows the rotation control of the first rotation angle and the second rotation angle of the specific camera system, and performs rotation control on the first rotation angle and the second rotation angle of other camera systems among the plurality of camera systems that were not selected by the input unit.

16. A control device, characterized in that, The control device controls the rotating mechanism, which is capable of rotating at a first rotation angle about an axis in a first direction different from the predetermined direction, and a second rotation angle about an axis in a second direction different from the predetermined direction. The control device has: The input section accepts inputs indicating the direction of operation; and The control unit controls the rotation of the first rotation angle and the second rotation angle so that the predetermined direction becomes the direction from the rotating mechanism toward the destination after moving in the operating direction input by the input unit.

17. A control device, characterized in that, The control device controls the imaging system, which includes an imaging unit with an image-capturing surface and a drive unit that rotates the imaging unit to change the imaging direction. The control device has: The input unit receives an instruction to change the photographic direction from the first direction to the second direction; and The control unit generates signals for controlling the rotation based on the drive unit, based on the instructions input through the input unit. The control unit generates the signal after transforming the second direction into a direction within the camera plane.

18. A control device, characterized in that, The control device controls the imaging system, which is capable of rotating by a first rotation angle about an axis in a first direction different from the imaging direction, and a second rotation angle about an axis in a second direction different from the imaging direction. The control device has: The display unit has a display screen that displays an image of the first subject position within the photographic object area captured by the photographic system in the photographic direction; The input section accepts input indicating the direction of operation; and When the input unit receives the input of the operation direction, the control unit performs rotation control on the first rotation angle and the second rotation angle to make the direction in which the second subject on the display screen is photographed relative to the first subject in the operation direction.

19. A control device, characterized in that, The control device controls the imaging system, which is capable of rotating by a first rotation angle about an axis in a first direction different from the imaging direction, and a second rotation angle about an axis in a second direction different from the imaging direction. The control device has: The display unit has a display screen that displays an image of a subject within the photographic object area captured by the photographic system in the photographic direction; The input unit accepts input regarding the orientation of the display screen, i.e., the operating direction; and The control unit controls the rotation of the first rotation angle and the second rotation angle so that the subject displayed on the display screen moves in a direction opposite to the operation direction.

20. A control device, characterized in that, The control device controls the imaging system, which is capable of rotating by a first rotation angle about an axis in a first direction different from the imaging direction, and a second rotation angle about an axis in a second direction different from the imaging direction. The control device has: The display unit has a display screen that displays an image of the position of a first subject within a first photographic object area captured by the photographic system in a first photographic direction; The input unit accepts input regarding the orientation of the display screen, i.e., the operating direction; and The control unit controls the rotation of the first rotation angle and the second rotation angle, changes the first photographic object area to the second photographic object area in the operation direction input by the input unit from the photographic system, and displays the image of the second subject position in the second photographic object area on the display screen.

21. A photography control system, characterized in that, The photography control system includes a photography system and a control device for controlling the photography system. The photography system is capable of rotating by a first rotation angle about an axis in a first direction different from the photography direction, and a second rotation angle about an axis in the first direction different from the photography direction. The control device has: The display unit has a display screen that displays an image of the first subject position within the photographic object area captured by the photographic system in the photographic direction; The input unit accepts input regarding the orientation of the display screen, i.e., the operating direction; and The control unit rotates the first rotation angle and the second rotation angle so that the imaging direction is from the imaging system toward the position of the second subject after moving in the operation direction input by the input unit.

22. A photography control system, characterized in that, The photography control system includes a rotating mechanism and a control device for controlling the rotating mechanism. The rotating mechanism is capable of rotating at a first rotation angle about an axis in a first direction different from a predetermined direction, and a second rotation angle about an axis in a second direction different from the predetermined direction. The control device has: The input section accepts inputs indicating the direction of operation; and The control unit controls the rotation of the first rotation angle and the second rotation angle so that the predetermined direction becomes the direction from the rotating mechanism toward the destination after moving in the operating direction input by the input unit.

23. A photography control system, characterized in that, The photography control system includes a photography system and a control device for controlling the photography system. The photography system includes a camera unit with an image-capturing surface and a drive unit that rotates the camera unit to change the photography direction. The control device has: The input unit receives an instruction to change the photographic direction from the first direction to the second direction; and The control unit generates signals for controlling the rotation based on the drive unit, based on the instructions input through the input unit. The control unit generates the signal after transforming the second direction into a direction within the camera plane.

24. A photography control system, characterized in that, The photography control system includes a photography system and a control device for controlling the photography system. The photography system is capable of rotating by a first rotation angle about an axis in a first direction different from the photography direction, and a second rotation angle about an axis in the first direction different from the photography direction. The control device has: The display unit has a display screen that displays an image of the first subject position within the photographic object area captured by the photographic system in the photographic direction; The input section accepts input indicating the direction of operation; and When the input unit receives the input of the operation direction, the control unit performs rotation control on the first rotation angle and the second rotation angle to make the direction in which the second subject on the display screen is photographed relative to the first subject in the operation direction.

25. A photography control system, characterized in that, The photography control system includes a photography system and a control device for controlling the photography system. The photography system is capable of rotating by a first rotation angle about an axis in a first direction different from the photography direction, and a second rotation angle about an axis in the first direction different from the photography direction. The control device has: The display unit has a display screen that displays an image of a subject within the photographic object area captured by the photographic system in the photographic direction; The input unit accepts input regarding the orientation of the display screen, i.e., the operating direction; and The control unit controls the rotation of the first rotation angle and the second rotation angle so that the subject displayed on the display screen moves in a direction opposite to the operation direction.

26. A photography control system, characterized in that, The photography control system includes a photography system and a control device for controlling the photography system. The photography system is capable of rotating by a first rotation angle about an axis in a first direction different from the photography direction, and a second rotation angle about an axis in the first direction different from the photography direction. The control device has: The display unit has a display screen that displays an image of the position of a first subject within a first photographic object area captured by the photographic system in a first photographic direction; The input unit accepts input regarding the orientation of the display screen, i.e., the operating direction; and The control unit controls the rotation of the first rotation angle and the second rotation angle, changes the first photographic object area to the second photographic object area in the operation direction input by the input unit from the photographic system, and displays the image of the second subject position in the second photographic object area on the display screen.

27. The photographic control system according to any one of claims 21, 23 to 26, characterized in that, The photography system is configured within the area of ​​the photographed object or above the area of ​​the photographed object.

28. The photographic control system according to any one of claims 21, 23 to 26, characterized in that, The photography system is configured in an area outside the area of ​​the photographed object or above the area outside the area of ​​the photographed object.

29. The photographic control system according to any one of claims 21, 23 to 28, characterized in that, The photography system is a drone.

30. A control method, characterized in that, The control method is executed by a control device that controls a photographic system capable of rotating by a first rotation angle about an axis in a first direction different from the photographic direction, and a second rotation angle about an axis in a second direction different from the photographic direction. The control device performs: Display processing displays an image of the first subject position within the photographic object area captured by the photographic system in the photographic direction; Input processing accepts input of the display orientation of the image, i.e., the operation direction; as well as The control process performs rotational control on the first rotation angle and the second rotation angle so that the imaging direction becomes a direction from the imaging system toward the position of the second subject after moving in the operation direction input by the input processing.

31. A control method, characterized in that, The control method is executed by a control device that controls a rotating mechanism capable of rotating at a first rotation angle about an axis in a first direction different from a predetermined direction, and a second rotation angle about an axis in a second direction different from the predetermined direction. The control device performs: Input processing: Accepting input indicating the direction of the operation; and The control process performs rotational control on the first rotation angle and the second rotation angle so that the predetermined direction becomes the direction from the rotating mechanism toward the destination after moving in the operation direction input by the input process.

32. A control method, characterized in that, The control method is executed by a control device that controls a photographic system. The photographic system includes a photographic unit with an image-capturing surface and a drive unit that rotates the photographic unit to change the photographic direction. The control device performs: Input processing, accepting instructions to change the photography direction from the first direction to the second direction; and The control processing, based on the instruction input through the input processing, generates a signal for controlling the rotation based on the drive unit after transforming the second direction into a direction within the imaging plane.

33. A control method, characterized in that, The control method is executed by a control device that controls a photographic system capable of rotating by a first rotation angle about an axis in a first direction different from the photographic direction, and a second rotation angle about an axis in a second direction different from the photographic direction. The control device performs: Display processing displays an image of the first subject position within the photographic object area captured by the photographic system in the photographic direction on a display screen; Input processing: Accepting input indicating the direction of the operation; as well as The control process, when the input of the operation direction is received through the input process, performs rotation control on the first rotation angle and the second rotation angle so as to make the direction in which the second subject on the display screen is photographed relative to the first subject on the display in the operation direction.

34. A control method, characterized in that, The control method is executed by a control device that controls a photographic system capable of rotating by a first rotation angle about an axis in a first direction different from the photographic direction, and a second rotation angle about an axis in a second direction different from the photographic direction. The control device performs: Display processing displays the image of the subject within the photographic object area captured by the photographic system in the photographic direction on a display screen; Input processing accepts input of the display screen's orientation, i.e., the operating direction; as well as The control process performs rotation control on the first rotation angle and the second rotation angle so that the subject displayed on the display screen moves in a direction opposite to the operation direction.

35. A control method, characterized in that, The control method is executed by a control device that controls a photographic system capable of rotating by a first rotation angle about an axis in a first direction different from the photographic direction, and a second rotation angle about an axis in a second direction different from the photographic direction. Execution in the control method: Display processing displays an image of the first subject position within the first photographic object area captured by the photographic system in the first photographic direction on a display screen; Input processing accepts input of the display screen's orientation, i.e., the operating direction; as well as The control process performs rotation control on the first rotation angle and the second rotation angle, changing the first photographic object area to the second photographic object area in the operation direction input by the input processing from the photographic system, and displaying the image of the second subject position in the second photographic object area on the display screen.

36. A control program, characterized in that, The control program causes the processor controlling the imaging system to perform processing, the imaging system being able to rotate by a first rotation angle about an axis in a first direction different from the imaging direction, and a second rotation angle about an axis in a second direction different from the imaging direction. The control program causes the processor to execute: Display processing displays an image of the first subject position within the photographic object area captured by the photographic system in the photographic direction; Input processing accepts input of the display orientation of the image, i.e., the operation direction; as well as The control process performs rotational control on the first rotation angle and the second rotation angle so that the imaging direction becomes a direction from the imaging system toward the position of the second subject after moving in the operation direction input by the input processing.

37. A control program, characterized in that, The control program causes a processor controlling the rotating mechanism to perform processing, the rotating mechanism being able to rotate with a first rotation angle about an axis in a first direction different from a predetermined direction, and a second rotation angle about an axis in a second direction different from the predetermined direction. The control program causes the processor to execute: Input processing: Accepting input indicating the direction of the operation; and The control process performs rotational control on the first rotation angle and the second rotation angle so that the predetermined direction becomes the direction from the rotating mechanism toward the destination after moving in the operation direction input by the input process.

38. A control program, characterized in that, The control program causes the processor controlling the imaging system to perform processing. The imaging system includes an imaging unit with an image-capturing surface and a drive unit that rotates the imaging unit to change the imaging direction. The control program causes the processor to execute: Input processing, accepting instructions to change the photography direction from the first direction to the second direction; and The control processing, based on the instruction input through the input processing, generates a signal for controlling the rotation based on the drive unit after transforming the second direction into a direction within the imaging plane.

39. A control program, characterized in that, The control program causes the processor controlling the imaging system to perform processing, the imaging system being able to rotate by a first rotation angle about an axis in a first direction different from the imaging direction, and a second rotation angle about an axis in a second direction different from the imaging direction. The control program causes the processor to execute: Display processing displays an image of the first subject position within the photographic object area captured by the photographic system in the photographic direction on a display screen; Input processing: Accepting input indicating the direction of the operation; as well as The control process, when the input of the operation direction is received through the input process, performs rotation control on the first rotation angle and the second rotation angle so as to make the direction in which the second subject on the display screen is photographed relative to the first subject on the display in the operation direction.

40. A control program, characterized in that, The control program causes the processor controlling the imaging system to perform processing, the imaging system being able to rotate by a first rotation angle about an axis in a first direction different from the imaging direction, and a second rotation angle about an axis in a second direction different from the imaging direction. The control program causes the processor to execute: Display processing displays the image of the subject within the photographic object area captured by the photographic system in the photographic direction on a display screen; Input processing accepts input of the display screen's orientation, i.e., the operating direction; as well as The control process performs rotation control on the first rotation angle and the second rotation angle so that the subject displayed on the display screen moves in a direction opposite to the operation direction.

41. A control program, characterized in that, The control program causes the processor controlling the imaging system to perform processing, the imaging system being able to rotate by a first rotation angle about an axis in a first direction different from the imaging direction, and a second rotation angle about an axis in a second direction different from the imaging direction. The control program causes the processor to execute: Display processing displays an image of the first subject position within the first photographic object area captured by the photographic system in the first photographic direction on a display screen; Input processing accepts input of the display screen's orientation, i.e., the operating direction; as well as The control process performs rotation control on the first rotation angle and the second rotation angle, changing the first photographic object area to the second photographic object area in the operation direction input by the input processing from the photographic system, and displaying the image of the second subject position in the second photographic object area on the display screen.

Citation Information

Patent Citations

  • Universal head control device and imaging system

    JP2007114503A

  • Control method of charge / discharge circuit, and control program of charge / discharge circuit

    JP2024064855A