IMAGING ASSIST DEVICE, IMAGING ASSIST SYSTEM, AND CONTROL METHOD THEREOF
The imaging auxiliary device stabilizes panning and tilting by processing user operation signals with reference data, addressing the instability and skill requirements of traditional tripods, allowing unskilled users to achieve smooth camera movements.
Patent Information
- Application Number
- JP2020099472
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2020-06-08
- Publication Date
- 2024-11-01
- Estimated Expiration
- 2040-06-08
AI Technical Summary
Existing tripods for video imaging require skilled operation and manual adjustments, leading to instability in panning and tilting, and cannot adapt to changes in subject behavior or camera work.
An imaging auxiliary device that acquires user operation signals, processes them to generate drive signals, and controls motors for stable panning and tilting, using reference data and various processing methods to correct and smooth the motion.
Enables stable panning and tilting even by unskilled operators, ensuring smooth and adaptive camera movements.
Smart Images

Figure 0007576929000001 
Figure 0007576929000002 
Figure 0007576929000003
Abstract
Description
[Technical field]
[0001] The present invention relates to an imaging assist device, an imaging assist system, and a control method thereof, which assist a user in capturing moving images. [Background technology]
[0002] Conventionally, panning and tilting have been performed using a tripod when shooting video, and it is known that the quality of the final image varies greatly depending on the tripod used. When shooting video using a tripod, using a highly functional and high-performance tripod for video makes the start and end of panning / tilting smoother, and the rotation operation during panning and tilting is stabilized. This allows for smooth panning and tilting images to be captured.
[0003] On the other hand, Patent Document 1 discloses a tripod with a horizontal position adjustment device that automatically adjusts the tripod to a horizontal state using a spirit level. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2017-102138 A Summary of the Invention [Problem to be solved by the invention]
[0005] Conventional tripods for video shooting have problems such as time required for preparation and the need for skilled techniques to maintain stable rotation operation due to manual operation. On the other hand, the tripod disclosed in Patent Document 1 only adjusts the horizontal state of the pan head, and does not adjust the camerawork of the video camera. In addition, a technology that only performs constant speed operation or programmable rotation operation cannot respond to changes in the behavior of the subject or camerawork in various situations.
[0006] An object of one aspect of the present invention is to provide an imaging assist device, an imaging assist system, and a control method thereof that enable even an unskilled operator to perform stable panning and tilting. [Means for solving the problem]
[0007] In order to solve the above problems, an imaging auxiliary device according to one embodiment of the present invention is an imaging auxiliary device that is attached to an imaging device, and includes an acquisition unit that sequentially acquires operation signals indicating user operations regarding the imaging direction of the imaging device, a generation unit that processes the operation signals acquired by the acquisition unit and sequentially generates drive signals, and a drive control unit that controls a drive unit that changes the imaging direction of the imaging device using the drive signals generated by the generation unit.
[0008] According to the imaging auxiliary device having the above configuration, even an operator who is not an expert can perform stable panning and tilting.
[0009] In the imaging auxiliary device according to one aspect of the present invention, the processing by the generation unit may include processing for generating the drive signal by referring to norm data and the operation signal.
[0010] According to the imaging auxiliary device having the above configuration, the driving signal is generated by referring to the reference data, so that stable panning and tilting can be performed.
[0011] In an imaging assistance device according to one aspect of the present invention, the generation unit may calculate a correction amount from a difference between the reference data and the operation signal, and generate the driving signal from the calculated correction amount and the operation signal.
[0012] According to the imaging auxiliary device having the above configuration, the operation signal is corrected so as to approach the reference data, so that stable panning and tilting can be performed.
[0013] In an imaging assistance device according to one aspect of the present invention, the acquisition unit may further acquire norm data identification information indicating norm data selected by a user from among a plurality of norm data candidates, and the processing by the generation unit may include processing of generating the driving signal by referring to the operation signal and the norm data indicated by the norm data identification information.
[0014] According to the imaging auxiliary device having the above configuration, stable panning and tilting can be performed according to the user's preferences by using the reference data selected by the user.
[0015] In the imaging auxiliary device according to one aspect of the present invention, the processing by the generation unit may include processing for removing unnecessary frequency bands in the operation signal.
[0016] According to the imaging auxiliary device having the above configuration, it is possible to remove unnecessary frequency bands, thereby obtaining smooth moving images.
[0017] In the imaging auxiliary device according to one aspect of the present invention, the processing by the generation section may include a process of restricting a signal value of the drive signal to fall within a predetermined range.
[0018] According to the imaging auxiliary device having the above configuration, the signal value of the driving signal falls within a predetermined range, so that smooth moving images can be obtained.
[0019] In the imaging auxiliary device according to one aspect of the present invention, the process by the generation unit may include a process of determining a subsequent drive pattern based on a drive pattern up to that point.
[0020] According to the imaging auxiliary device having the above configuration, the drive pattern is determined based on the preferred operation pattern, so that stable panning and tilting can be performed.
[0021] The imaging assist device according to an aspect of the present invention may further include an operation reception unit that receives the user operation via at least one of a grip controller, a touch panel, a button, and a joystick.
[0022] According to the imaging auxiliary device having the above configuration, various operation methods can be applied.
[0023] An imaging assist system according to one aspect of the present invention includes any one of the imaging assist devices described above and a mobile terminal device, wherein the acquisition section of the imaging assist device acquires the operation signal via the mobile terminal device.
[0024] According to the imaging assistance system having the above configuration, even an operator who is not an expert can perform stable panning and tilting.
[0025] A control method according to one aspect of the present invention is a control method for an imaging auxiliary device attached to an imaging device, and includes an acquisition step of sequentially acquiring operation signals indicating user operations regarding the imaging direction of the imaging device, a generation step of processing the acquired operation signals to sequentially generate drive signals, and a drive control step of controlling a drive unit that changes the imaging direction of the imaging device using the generated drive signals.
[0026] According to the control method for the imaging auxiliary device having the above configuration, even an operator who is not an expert can perform stable panning and tilting.
[0027] A control program according to one embodiment of the present invention is a control program for causing a computer to function as an imaging auxiliary device attached to an imaging device, and causes a computer to function as an acquisition unit that sequentially acquires operation signals indicating user operations regarding the imaging direction of the imaging device, a generation unit that processes the acquired operation signals and sequentially generates drive signals, and a drive control unit that controls a drive unit that changes the imaging direction of the imaging device using the generated drive signals.
[0028] A recording medium according to one aspect of the present invention is a computer-readable non-transitory recording medium having the above-mentioned control program recorded thereon. Effect of the Invention
[0029] According to one aspect of the present invention, it is possible to realize an imaging assistance device, an imaging assistance system, and a control method thereof that enable even an unskilled operator to perform stable panning and tilting. [Brief description of the drawings]
[0030] [Figure 1] 1 is an overall schematic diagram of an imaging auxiliary device according to a first embodiment. [Diagram 2] 1 is a block diagram showing the configuration of an imaging auxiliary device according to a first embodiment. [Diagram 3] 5 is an example of an imaging assist control flowchart of the imaging assist device according to the first embodiment. [Figure 4] 4 is an example of an image capture assist control circuit of the image capture assist device according to the first embodiment. [Diagram 5] 3 is a conceptual diagram of an imaging auxiliary control of the imaging auxiliary device according to the first embodiment. FIG. [Figure 6] 6 is a display example of reference data displayed on a touch panel of the imaging auxiliary device according to the first embodiment. [Figure 7] 13 is another example of an imaging assist control flowchart of the imaging assist device according to the second embodiment. [Figure 8] 13 is another example of an imaging assist control flowchart of the imaging assist device according to the third embodiment. [Figure 9] 13 is another example of an imaging assist control flowchart of the imaging assist device according to the fourth embodiment. [Figure 10] FIG. 13 is a block diagram showing the configuration of an imaging auxiliary system according to a fifth embodiment. [Figure 11] FIG. 13 is a diagram illustrating selection of reference data using a mobile terminal device. [Figure 12] FIG. 13 is a diagram illustrating an operation of an imaging auxiliary device using a portable terminal device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0031] [First embodiment] The first embodiment will be described with reference to the drawings. Fig. 1 is an overall schematic diagram of an imaging auxiliary device 1 according to the first embodiment. Fig. 2 is a block diagram of the imaging auxiliary device according to the first embodiment. The imaging auxiliary device 1 is a device for changing the imaging direction of an imaging device attached to the imaging auxiliary device 1 based on an instruction from a user. The imaging device is a video camera for capturing moving images, a smartphone, or the like.
[0032] (Overall composition) First, the overall configuration of the imaging auxiliary device 1 will be described. As shown in FIG. 1, the imaging auxiliary device 1 includes a pan head 10 on which the imaging device 20 is placed, a pitch direction motor 30, a yaw direction motor 32, a housing 40 that supports the entire imaging auxiliary device 1, and a grip controller 50 that performs operations related to the imaging direction of the imaging device 20. The pitch direction motor 30 drives the pan head 10 in the pitch direction. The yaw direction motor 32 drives the pan head 10 in the yaw direction. In the embodiment shown in FIG. 1, the imaging auxiliary device 1 is attached to a tripod 5 arranged in a substantially horizontal direction. However, the imaging auxiliary device may be attached to a support other than a tripod when used. Also, the imaging auxiliary device may be configured to be integrated with the tripod from the beginning.
[0033] The imaging device 20 is mounted and fixed on the camera platform 10. As described later, the camera platform 10 can adjust the center of gravity of the mounted imaging device 20. The camera platform 10 is rotated in the pitch direction by the pitch direction motor 30 and in the yaw direction by the yaw direction motor 32. The yaw direction is the horizontal direction, i.e., the left-right direction, and the pitch direction is the direction perpendicular to the yaw direction, i.e., the up-down direction. The rotation of the imaging device 20 in the yaw direction is also called panning, and the rotation in the pitch direction is also called tilting. The pitch direction motor 30 and the yaw direction motor 32 rotate the camera platform 10 in the pitch direction and the yaw direction to three-dimensionally change the imaging direction of the imaging device 20. The pitch direction motor 30 and the yaw direction motor 32 are examples of a driving unit according to this embodiment.
[0034] The pitch direction motor 30 and the yaw direction motor 32 are supported by a housing 40. The housing 40 is attached to a tripod 5. When the tripod 5 is arranged horizontally, the housing 40 is also arranged approximately horizontally, and the camera platform 10 is also arranged approximately horizontally in the initial position.
[0035] The grip controller 50 is attached to the side of the housing 40. The grip controller 50 is a rod body having one end attached to the housing 40 and extending from the housing 40. The operator can tilt the other end of the grip controller 50 in any direction at any angle. The grip controller 50 is an example of an operation unit according to the present embodiment. Specifically, the user controls the direction in which the imaging device 20 is pointed by changing the direction in which the grip controller 50 is tilted. In addition, the user controls the speed at which the imaging device 20 moves in that direction by changing the angle at which the grip controller 50 is tilted. For example, if the grip controller 50 is tilted to the right, the pan head 10, i.e., the imaging device 20, rotates to the right, and if the grip controller 50 is tilted to a large extent, the rotation speed becomes faster.
[0036] As shown in FIG. 2, the housing 40 includes a control unit 60, an input / output unit 72, and a storage unit 74 therein, and an SD card slot 76 on the side. The control unit 60 controls the entire imaging auxiliary device 1. As the control unit 60, various processors such as an MPU (Micro Processing Unit), a CPU (Central Processing Unit), an ASIC (Application Specific Integrated Circuit), or a PLD (Programmable Logic Device) can be used. The input / output unit 72 communicates information between the imaging auxiliary device 1 and the outside. The input / output unit 72 can be a transmitting / receiving device such as Bluetooth (registered trademark) or Wi-Fi (registered trademark). The storage unit 74 stores various control programs, normative data described below, and other information in advance or as needed. The storage unit 74 is various volatile or non-volatile ROM (Read Only Memory) or RAM (Random Access Memory), etc. The SD card slot 76 accepts an SD card. The control unit 60 , the input / output unit 72 , the storage unit 74 , and the SD card slot 76 are electrically connected to one another via a bus 80 .
[0037] The control unit 60 includes an operation reception unit 62, an acquisition unit 64, a generation unit 66, and a drive control unit 68. The operation reception unit 62 receives a user operation via the grip controller 50. Specifically, the operation reception unit 62 detects the movement of the grip controller 50 and converts it into an operation signal indicating a user operation regarding the imaging direction of an imaging device (not shown). The operation signal indicating the user operation regarding the imaging direction is, for example, an operation signal indicating the operation direction and the operation amount of the grip controller 50. Furthermore, the operation reception unit 62 transmits the operation signal to the acquisition unit 64. The acquisition unit 64 sequentially acquires operation signals indicating user operations regarding the imaging direction of the imaging device from the operation reception unit 62 and transmits them to the generation unit 66. The generation unit 66 receives the operation signals acquired by the acquisition unit 64, processes them, and sequentially generates drive signals. The drive control unit 68 controls the pitch direction motor 30 and the yaw direction motor 32 using the drive signals generated by the generation unit 66. The operation reception unit 62, the acquisition unit 64, the generation unit 66, and the drive control unit 68 are electrically connected to each other via a bus 80.
[0038] The camera platform 10 includes a digital level 12, a camera platform motor 14, and a camera platform motor control unit 16. The camera platform motor control unit 16 analyzes the output from the digital level 12 to determine the position of the center of gravity of the imaging device. Then, the camera platform motor 14 is driven and controlled to move the mounting unit on which the imaging device is mounted, thereby moving the center of gravity of the imaging device to an appropriate position. For example, the orientation of the imaging device can be stably changed by moving the center of gravity of the imaging device to the center of gravity of the camera platform 10 including the pitch direction motor 30 and the yaw direction motor 32. When the imaging device is moved to the appropriate position, the mounting unit is fixed at that position.
[0039] (Method of controlling imaging auxiliary device) Next, a control method of the imaging auxiliary device 1 will be described. Fig. 3 is an example of an imaging auxiliary control flowchart of the imaging auxiliary device according to the first embodiment. Here, the imaging auxiliary control is triggered to start when, for example, the imaging auxiliary device 1 is powered on. Alternatively, if the imaging auxiliary device 1 has an imaging auxiliary control mode switch for starting imaging auxiliary control, the imaging auxiliary control is triggered to start when the switch is turned on.
[0040] As shown in FIG. 3, in step S10, the acquisition unit 64 of the control unit 60 determines whether or not there is an operation signal. Specifically, the acquisition unit 64 determines whether or not an operation signal has been received from the operation reception unit 62. If it is determined that an operation signal has not been received (step S10: N), the process returns to step S10. If it is determined that an operation signal has been received (step S10: Y), the process proceeds to step S12. In step S12, the acquisition unit 64 sequentially acquires the operation signals and transmits them to the generation unit 66. Next, the process proceeds to step S14, where the generation unit 66 generates a driving signal by referring to the normative data and the operation signal received from the acquisition unit 64. In this way, the driving signal is generated by referring to the normative data, so that stable panning and tilting can be performed. The normative data is stored in the storage unit 74 in advance. Alternatively, the normative data may be stored in the storage unit 74 by inserting an SD card in which normative data that the user wants to use is stored into the SD card slot 76.
[0041] Next, the process proceeds to step S16, where the generating unit 66 transmits the generated driving signal to the driving control unit 68. Next, the process proceeds to step S18, where the driving control unit 68 drives and controls the pitch direction motor 30 and the yaw direction motor 32 based on the driving signal. Next, the process proceeds to step S20, where the generating unit 66 determines whether or not a termination condition for terminating the imaging assist control is satisfied. If it is determined that the termination condition is satisfied (step S20: Y), the imaging assist control is terminated. If it is determined that the termination condition is not satisfied (step S20: N), the process returns to step S10. The termination condition for the imaging assist control is, for example, when the power supply of the imaging assist device 1 is turned off. Alternatively, if the imaging assist device 1 has an imaging assist control mode switch for starting the imaging assist control, the termination condition for the imaging assist control is when the switch is turned off.
[0042] (Generation of driving signals) The driving signal is generated by processing the operation signal so as to approximate it to, for example, normative data. The normative data is generated, for example, by taking test images of various movements (camera work) of the imaging device in advance, analyzing the movements of the images that are evaluated as good images, and creating numerical data of the camera work. Alternatively, the normative data may be created in advance based on the movements of existing images that are evaluated as having excellent camera work.
[0043] FIG. 4 is an example of a target tracking control circuit FC that uses a preferred camera work as reference data. In this circuit, the generating unit 66 calculates a correction amount from the difference between the reference data and the operation signal, and generates a drive signal from the calculated correction amount and the operation signal. Specifically, as shown in FIG. 4, the output E of a subtractor A1 that takes the difference between the operation signal X and the reference data signal S is input to a correction amount calculation circuit F. The output U from the correction amount calculation circuit F and the operation signal X are processed by a subtractor A3. The output Y and the reference data signal S are applied to a subtractor A2, and the output C is input to the correction amount calculation circuit F. The output Y of the subtractor A3 obtained in this way is used as a drive signal.
[0044] As shown in FIG. 5, it can be seen that the output Y obtained by processing the operation signal X with a large swing width by the target tracking control circuit FC approaches the reference data signal S. The reference data signal S is, for example, the angular velocity change amount of the imaging device. The operation signal input by the user generally has a large swing width, and even though the movement of the subject is not rapid, the movement direction and angular velocity often change suddenly due to the instability of the camera work. In contrast, the driving signal processed to approach the reference data signal S has a small swing width, and the temporal change in the movement direction and angular velocity is also small. As a result, the viewer is given the impression of a smooth image. In other words, since the operation signal is corrected to approach the reference data, stable panning and tilting can be performed. Note that when the subject moves suddenly, the camera work also needs to move suddenly to follow it. As a method of distinguishing whether a sudden change in camera work is due to following the sudden movement of the subject or due to instability of the camera work, for example, the control described in the second embodiment can be considered.
[0045] (normative data) The reference data is not limited to the above examples. For example, the reference data may be the direction, angle, angular velocity, angular acceleration, a combination of the direction or angle and angular velocity, a combination of the direction or angle and angular acceleration, etc., when the imaging device starts to move. By using such reference data, it is possible to prevent the imaging device from suddenly starting to move.
[0046] Furthermore, the normative data may be, for example, the direction, angle, angular velocity, angular acceleration, a combination of a direction or angle and angular velocity, a combination of a direction or angle and angular acceleration, etc., when the motion of the imaging device stops. Since the driving signal is generated by referring to such normative data, it is possible to prevent the imaging device from suddenly stopping.
[0047] Furthermore, the normative data may be, for example, a direction, an angle, an angular velocity, an angular acceleration, a combination of a direction or an angle and an angular velocity, a combination of a direction or an angle and an angular acceleration, etc., when the orientation of the imaging device starts to change in the case where the orientation of the imaging device changes during the process. By using such normative data, it is possible to prevent a sudden change in the orientation of the imaging device.
[0048] The reference data may also be data that matches a specific pattern of the subject's movement, such as when the subject moves left or right, when moving away, when moving closer, etc. In this case, the amount of change in zoom may also be combined as the reference data.
[0049] The user may also obtain the normative data by selecting and downloading the normative data that the user desires to use from a predetermined homepage (server) via the Internet communication network. The user can store the downloaded normative data in the storage unit 74 and use it for shooting assistance control. The predetermined homepage is, for example, a homepage that provides various product information of the imaging assistance device 1.
[0050] (Operation unit) In the above embodiment, an example has been described in which the grip controller 50 is used as the operation unit. However, the operation unit is not limited to this, and may be anything that can input user operations. For example, it may be a joystick, a button, a touch panel, or the like. In addition, these do not need to be arranged on the housing 40, and their arrangement is arbitrary. For example, the operation unit may be configured to be separated from the housing 40. In addition, as will be described later, it may be configured to input using a mobile terminal device. In this way, various operation methods can be applied to operate the imaging device 20.
[0051] For example, as shown in FIG. 6, in the case where the touch panel 52 is provided as the operation unit, the control unit 60 can display a plurality of candidates of normative data on the touch panel 52. The user can select normative data to be applied from the candidate data displayed on the touch panel 52. FIG. 6 shows an example in which the selected normative data is indicated by a check mark being displayed in a check box. Specifically, by checking and inputting the normative data to be applied, a signal indicating the selected normative data (normative data identification information) is transmitted to the acquisition unit 64 of the control unit 60. The acquisition unit 64 acquires the normative data identification information indicating the normative data selected by the user and transmits it to the generation unit 66. The generation unit 66 generates a drive signal by referring to the operation signal and the normative data indicated by the normative data identification information. In this way, stable panning and tilting can be performed according to the user's preference by using the normative data selected by the user.
[0052] When a joystick is provided as the operation unit, the user can perform operations similar to those of the grip controller 50. Also, the reference data may be selected with another joystick. When buttons are provided as the operation unit, the operation direction and amount can be input with a plurality of buttons, for example.
[0053] According to the above-described imaging auxiliary control, the movement of the imaging device operated by the user is changed to a movement that is closer to the standard data for preferred camerawork, so that even an operator who is not an experienced user can perform stable panning and tilting of the imaging device.
[0054] Second Embodiment Next, the second embodiment will be described with reference to the drawings. The overall configuration of the imaging support device according to the second embodiment is the same as that of the imaging support device 1 according to the first embodiment, so the description will be omitted. In the imaging support device according to the second embodiment, the generating unit 66 performs a process of removing unnecessary frequency bands (components) in the operation signal. The unnecessary frequency bands (components) are, for example, frequency bands (components) that occur when the movement of the camera changes suddenly even though the subject does not move suddenly. The unnecessary frequency bands are frequency bands when the movement of the subject and the tracking of the camera do not match. As a method of determining whether or not the frequency band is unnecessary, for example, it can be determined by the degree of change in the amount of the operation signal, that is, the second derivative value of the operation signal. Even if the first derivative value of the operation signal is large, if the second derivative value is small, it is considered that the sudden movement of the subject is being tracked. Conversely, if the second derivative value of the operation signal is large, it is considered that the movement of the subject and the tracking do not match. In other words, if the second derivative value of the operation signal is equal to or greater than a predetermined value, it can be determined that the unnecessary frequency band is included. 7 is an example of a flowchart of imaging assist control of the imaging assist device according to the second embodiment. The imaging assist control is started in the same way as in the first embodiment.
[0055] In the flowchart shown in FIG. 7, steps S40 and S42 are the same as steps S10 and S12 in the flowchart of the first embodiment. Next, in step S44, the generation unit 66 acquires an angular acceleration, which is a second derivative of the movement angle, from the operation signal received from the acquisition unit 64, and determines whether the angular acceleration is equal to or greater than a predetermined value. If the angular acceleration is equal to or greater than the predetermined value (step S44: Y), the process proceeds to step S46. In step S46, the generation unit 66 removes or reduces unnecessary frequency bands in a range in which the angular acceleration is equal to or greater than the predetermined value, thereby generating a drive signal, and the control flow proceeds to step S50. On the other hand, if the angular acceleration is less than the predetermined value (step S44: N), the control flow proceeds to step S48. In step S48, the generation unit 66 generates a drive signal from the operation signal, and the control flow proceeds to step S50. The following steps S50 to S54 are the same as steps S16 to S20 in the first embodiment.
[0056] Alternatively, instead of calculating the angular acceleration from the operation signal received from the acquisition unit 64, an acceleration sensor may be used to perform control to remove or reduce unnecessary frequency bands. The acceleration sensor is disposed, for example, on the camera platform 10 of the imaging auxiliary device according to this embodiment (not shown). In this case, the acquisition unit 64 acquires an angular acceleration signal from the acceleration sensor, and the generation unit 66 determines whether the angular acceleration signal acquired by the acquisition unit 64 is equal to or greater than a predetermined value (corresponding to steps S40 to S44 in FIG. 7 where "operation signal" is replaced with "angular acceleration signal"). Thereafter, each step in FIG. 7 may be executed according to the determination result in step S44 in FIG. 7.
[0057] According to the imaging auxiliary control of the second embodiment described above, it is possible to remove unnecessary frequency bands in the operation signal, so that the movement of the imaging device 20 becomes smoother, and a smooth moving image can be obtained.
[0058] Third embodiment Next, the third embodiment will be described with reference to the drawings. The overall configuration of the imaging auxiliary device according to the third embodiment is the same as that of the imaging auxiliary device 1 according to the first embodiment, and therefore the description thereof will be omitted. In the imaging auxiliary device according to the third embodiment, the generating unit 66 performs a process of restricting the signal value of the driving signal so that it falls within a predetermined range. FIG. 8 is an example of an imaging auxiliary control flowchart of the imaging auxiliary device according to the third embodiment. The trigger for starting imaging auxiliary control is the same as in the first embodiment.
[0059] In the flowchart shown in FIG. 8, steps S60 and S62 are the same as steps S10 and S12 in the flowchart of the first embodiment. Next, in step S64, the generating unit 66 processes the operation signal to sequentially generate driving signals. Next, in step S66, the generating unit 66 performs a process of limiting the signal value of the generated driving signal so that it falls within a predetermined range. For example, a part exceeding an upper limit value of the predetermined range is rewritten to the upper limit value of the predetermined range. In addition, a part below a lower limit value of the predetermined range may be rewritten to the lower limit value of the predetermined range. Next, in step S68, the generating unit 66 transmits the limited driving signal to the drive control unit 68. Next steps S70 to S72 are the same as steps S18 to S20 in the flowchart of the first embodiment.
[0060] In the third embodiment, for example, upper limits of angular velocity and angular acceleration are determined in advance for each direction as the normative data and stored in the storage unit 74. In addition, lower limits may be stored in the storage unit 74. As described above, the normative data is determined by taking test shots of various images in advance and analyzing the movements of images evaluated as good images. Alternatively, the normative data may be created based on the movements of existing images evaluated as having good camera work. Note that the method of restricting the signal value of the driving signal to fall within a predetermined range is not limited to the above method. For example, when the operation signal exceeds its maximum value, the operation signal may be processed so as to change gradually within a range not exceeding the maximum value to generate the driving signal.
[0061] According to the imaging auxiliary control of the third embodiment described above, the driving signal is processed so as to fall within a predetermined range, whereby the movement of the imaging device becomes smooth, and a smooth moving image can be obtained.
[0062] [Fourth embodiment] Next, the fourth embodiment will be described with reference to the drawings. The overall configuration of the imaging auxiliary device according to the fourth embodiment is the same as that of the imaging auxiliary device 1 according to the first embodiment, and therefore the description thereof will be omitted. In the imaging auxiliary device according to the fourth embodiment, the generation unit 66 performs a process of determining a subsequent drive pattern based on the drive pattern up to the previous embodiment. FIG. 9 is an example of an imaging auxiliary control flowchart of the imaging auxiliary device according to the fourth embodiment. The trigger for starting imaging auxiliary control is the same as in the first embodiment.
[0063] In the flowchart shown in Fig. 9, steps S80 and S82 are the same as steps S10 and S12 in the flowchart of the first embodiment. Next, in step S84, the generation unit 66 acquires the pattern of the driving signal generated immediately before. Next, in step S86, the generation unit 66 processes the acquired operation signal according to the acquired pattern of the driving signal to generate a driving signal. Steps S88 to S92 are the same as steps S16 to S20 in the flowchart of the first embodiment.
[0064] In this embodiment, the camerawork of a desired image is analyzed, and characteristic combination data of a second drive pattern following a first drive pattern is collected. Then, a first drive pattern similar to the pattern of the drive signal generated immediately before, acquired in step S84, is searched from the combination data. If a similar first drive pattern is found, the operation signal is processed so as to approach the second drive pattern following it.
[0065] According to the imaging auxiliary control of the fourth embodiment, the subsequent driving pattern is determined based on the driving pattern up to the previous time. In this way, the driving pattern is determined based on the preferable operation pattern (camera work) of the imaging device, so that stable panning and tilting of the imaging device can be performed.
[0066] Fifth embodiment Next, the fifth embodiment will be described with reference to the drawings. FIG. 10 is a block diagram of an imaging auxiliary system 100 according to the fifth embodiment. The imaging auxiliary system 100 includes an imaging auxiliary device 1 and a mobile terminal device 90. The imaging auxiliary device 1 is the same as the imaging auxiliary device 1 described in the first to fourth embodiments, so a description thereof will be omitted. As shown in FIG. 10, the mobile terminal device 90 includes a display unit 92, an acquisition unit 94, a control unit 96, and an input / output unit 98. The display unit 92 is a display that displays various information to the user. The display unit 92 also serves as a touch panel that inputs user instructions. The acquisition unit 94 acquires an operation signal input from the user via the display unit 92. The acquisition unit 94 also acquires various information received from the outside via the input / output unit 98. The control unit 96 controls the operation of the entire mobile terminal device 90. The input / output unit 98 is an interface that transmits and receives various information to and from the outside. The display unit 92, the acquisition unit 94, the control unit 96, and the input / output unit 98 are electrically connected to one another via a bus 82. The mobile terminal device 90 is, for example, a smartphone.
[0067] The imaging auxiliary device 1 and the portable terminal device 90 of the imaging auxiliary system 100 can communicate information with each other via the input / output unit 72 of the imaging auxiliary device 1 and the input / output unit 98 of the portable terminal device 90. Specifically, a user can use the portable terminal device 90 to instruct the imaging auxiliary device 1 to send a list of normative data. Upon receiving an instruction from the user via the portable terminal device 90, the imaging auxiliary device 1 transmits the list of normative data stored in the storage unit 74 to the portable terminal device 90. The portable terminal device 90 receives the list of normative data and displays it on the display unit 92 as shown in FIG. 11.
[0068] To configure the imaging assistant system 100, an application for sending a list of reference data to the imaging assistant device 1 is installed in advance on the mobile terminal device 90. The application may be made downloadable, for example, from the product homepage of the imaging assistant device 1.
[0069] The user selects one of the normative data displayed on the display unit 92 and transmits it to the imaging auxiliary device 1. Fig. 11 shows an example in which the selected normative data is indicated by a check mark being displayed in a check box. The imaging auxiliary device 1 performs imaging auxiliary control using the normative data selected by the user.
[0070] 12 is a diagram showing a method for operating the imaging auxiliary device 1 using a portable terminal device 90 in the imaging auxiliary system 100. In this embodiment, instead of the grip controller 50 of the first embodiment, the user operates the imaging auxiliary device 1 using a portable terminal device 90. For this reason, an application for operating the imaging auxiliary device 1 is installed in advance in the portable terminal device 90. The application may be made downloadable from, for example, the above-mentioned website.
[0071] When the downloaded application is started, an operation screen of the imaging auxiliary device 1 is displayed on the display unit 92, as shown in Fig. 12, for example. In the illustrated example, the orientation of the imaging device mounted on the imaging auxiliary device 1 is displayed in the up, down, left, and right directions, and the moving speed in those directions is displayed with a five-level scale. The user operates the imaging auxiliary device 1 by swiping a finger in the direction in which the imaging device is to be moved up to the scale corresponding to the moving speed. The moving direction can be not only up, down, left, and right directions, but also diagonal directions.
[0072] A swipe operation input to the display unit 92 is converted into an operation signal and acquired by the acquisition unit 94 of the mobile terminal device 90. The acquired operation signal is transmitted to the imaging auxiliary device 1 via the input / output unit 98. The acquisition unit 64 of the imaging auxiliary device 1 acquires the operation signal via the mobile terminal device 90 and transmits it to the generation unit 66. The generation unit 66 processes the received operation signal to sequentially generate driving signals.
[0073] The contents displayed on the mobile terminal device 90 need not be limited to the operation screen. For example, if the mobile terminal device 90 and the imaging device are configured to be able to communicate information with each other, the view image of the imaging device may be displayed in real time on the display unit 92 of the mobile terminal device 90. In this case, the user can operate the display unit 92 while checking the imaging screen of the imaging device on the display unit 92, which makes the operation easier.
[0074] According to the imaging auxiliary control of the fifth embodiment, even an unskilled operator can stably pan or tilt the imaging device. Furthermore, the imaging device can be operated or information can be obtained via a mobile terminal device, improving convenience.
[0075] The control unit 60 of the imaging auxiliary device 1 may be realized by a logic circuit (hardware) formed in an integrated circuit (IC chip) or the like, or may be realized by software. In the latter case, the imaging auxiliary device 1 includes a computer that executes instructions of a program, which is software that realizes each function. This computer includes, for example, one or more processors, and a computer-readable recording medium storing the program. In the computer, the processor reads the program from the recording medium and executes it, thereby achieving the object of the present invention. For example, a CPU (Central Processing Unit) can be used as the processor. For the recording medium, a "non-transient tangible medium," such as a ROM (Read Only Memory) or the like, as well as a tape, a disk, a card, a semiconductor memory, a programmable logic circuit, or the like can be used. In addition, the imaging auxiliary device 1 may further include a RAM (Random Access Memory) for expanding the program. In addition, the program may be supplied to the computer via any transmission medium (such as a communication network or a broadcast wave) capable of transmitting the program. Note that one aspect of the present invention may also be realized in the form of a data signal embedded in a carrier wave, in which the program is embodied by electronic transmission.
[0076] [Additional Notes] The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present invention. [Explanation of symbols]
[0077] 1 Imaging support device 5. Tripod 10 Pan head 12 Digital Level 14 Head motor 16 Head motor control unit 20 Imaging device 30 Pitch direction motor (drive unit) 32 Yaw direction motor (drive unit) 40 Case 50 Grip controller (operation part) 52 Touch Panel 60 Control section 62 Operation reception section 64 Acquisition Department 66 Generation part 68 Drive control unit 72 Input / output section 74 Memory section 76 SD card slot 80, 82 Bus 90 Portable terminal device 92 Display section 94 Acquisition Department 96 Control Unit 98 Input / output section 100 Imaging Support System
Claims
1. An imaging auxiliary device attached to an imaging device, comprising: a first acquisition unit that sequentially acquires an operation signal indicating a user operation regarding an imaging direction of the imaging device; A storage unit in which one or more pieces of normative data are stored; A second acquisition unit that acquires one of the one or more normative data selected by a user; a generation unit that processes the operation signal acquired by the first acquisition unit and sequentially generates a drive signal; a drive control unit that controls a drive unit that changes an imaging direction of the imaging device using the drive signal generated by the generation unit; Equipped with The processing by the generation unit includes processing the operation signal so as to approximate the normative data acquired by the second acquisition unit by referring to the normative data acquired by the second acquisition unit and the operation signal. Imaging aid.
2. The generation unit is Calculating a correction amount from a difference between the reference data acquired by the second acquisition unit and the operation signal; The drive signal is generated from the calculated correction amount and the operation signal. The imaging auxiliary device according to claim 1 .
3. A plurality of pieces of normative data are stored in the storage unit, a third acquisition unit that acquires normative data identification information indicating normative data selected by a user from among the plurality of normative data; The second acquisition unit acquires the reference data indicated by the reference data identification information from the storage unit, The process by the generation unit includes a process of generating the drive signal by referring to the operation signal and the reference data acquired by the second acquisition unit.
3. The imaging auxiliary device according to claim 1.
4. The processing by the generating unit includes a process of removing unnecessary frequency bands in the operation signal. The imaging auxiliary device according to claim 1 .
5. The process by the generation unit includes: A process of rewriting a portion of the generated drive signal that exceeds a predetermined upper limit value to the predetermined upper limit value; and A process of rewriting a portion of the generated drive signal that is below a predetermined lower limit value to the predetermined lower limit value. Contains The imaging auxiliary device according to claim 1 .
6. The process by the generation unit includes a process of determining a subsequent drive pattern of the drive signal based on a drive pattern of the drive signal generated by the generation unit up to the immediately preceding drive pattern, referring to the reference data which is combination data of a first drive pattern and a second drive pattern subsequent to the first drive pattern, searching the combination data for a first drive pattern similar to the drive pattern of the drive signal up to the immediately preceding time; determining a subsequent drive pattern of the drive signal so as to approach a second drive pattern subsequent to the retrieved first drive pattern; Contains The imaging auxiliary device according to claim 1 .
7. and an operation receiving unit that receives the user operation via at least one of a grip controller, a touch panel, a button, and a joystick. The imaging auxiliary device according to claim 1 .
8. An imaging auxiliary device according to any one of claims 1 to 7; A mobile terminal device, The first acquisition unit of the imaging auxiliary device acquires the operation signal via the mobile terminal device. Imaging assistance system.
9. A method for controlling an imaging auxiliary device attached to an imaging device, comprising the steps of: a first acquisition step of sequentially acquiring an operation signal indicating a user operation regarding an imaging direction of an imaging device; a second acquisition step of acquiring one piece of normative data selected by a user from a storage unit in which one or more pieces of normative data are stored; a generating step of processing the operation signal acquired in the first acquiring step to sequentially generate a driving signal; a drive control step of controlling a drive unit that changes an imaging direction of the imaging device using the generated drive signal; Including, The processing in the generating step includes processing the operation signal so as to approximate the standard data acquired in the second acquiring step by referring to the standard data acquired in the second acquiring step and the operation signal. Contains Control methods.
Citation Information
Patent Citations
Camera capable of panning photography and program for motion picture editing
JP2006115323A
Vibration proof apparatus
JP2007183356A
Camera crane device
JP2007239842A
Method and system for enabling pointing control of actively stabilized cameras
JP2016515348A
Tripod with horizontal position adjusting device
JP2017102138A
