Intelligent follow-up shooting pan / tilt and control method

By designing an intelligent follow-shooting gimbal, automated handheld operation of mobile terminals in live streaming and video recording is achieved, solving the problem of freeing up users' hands and realizing automated operation of panoramic video, video recording and photo taking.

CN111928080BActive Publication Date: 2024-11-29深圳市众智创新科技有限责任公司
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202010958133.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-09-14
Publication Date
2024-11-29
Estimated Expiration
2040-09-14

AI Technical Summary

Technical Problem

In existing technologies, it is difficult to automate hand-holding or two-hand release when performing operations such as live streaming and video recording on mobile terminals, especially in scenarios such as outdoor photography, live streaming, and video recording, where manual hand-holding or assistance from others is required.

Method used

A smart follow-shooting gimbal was designed, including a base, a horizontal rotating base, a vertical rotating bracket, and a camera. The camera captures images and drives the video device to adjust its angle, enabling the device to automatically follow the subject and maintain the best shooting angle.

Benefits of technology

It automates panoramic video, recording, photography, and live streaming under single-user operation, freeing up hands and keeping the device at the best angle within the field of view at all times.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN111928080B_ABST
    Figure CN111928080B_ABST
Patent Text Reader

Abstract

The present invention relates to an intelligent follow-up shooting gimbal and a control method, which includes a fuselage base, a horizontal rotating base, a horizontal rotating shell, a longitudinal rotating bracket and a camera; the horizontal rotating base and the fuselage base form a coaxial rotation connection; a longitudinal rotating driving motor is fixedly connected to the horizontal rotating base, and its power output end is horizontally fixedly connected to a horizontal axis, and the horizontal axis is fixed to a longitudinal rotating bracket with a spherical surface through a column; a card slot is provided on the central surface of the spherical outer surface of the longitudinal rotating bracket; a battery and a control circuit board are fixedly connected to the horizontal rotating base, and a camera is arranged at the front end of the horizontal rotating base; the horizontal rotating shell is buckled and fixed to the upper end of the horizontal rotating base, and a hole is opened at the top, and the spherical outer surface of the longitudinal rotating bracket is located inside the top hole of the horizontal rotating shell. The present invention realizes real-time object following, face following and motion control, etc., and solves the problem that a user can make panoramic video, record video, take photos, and live broadcast by himself, freeing the user's hands.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of intelligent communication technology, and in particular to an intelligent follow-up shooting pan / tilt platform and a control method thereof. Background Art

[0002] With the rapid development of mobile communication technology, the fifth generation digital communication (5G) era has begun to become popular. Mobile terminals have become a necessity in people's daily lives. People are increasingly dependent on mobile phones and other electronic products, such as live broadcasts, small video screens, photos, videos, etc. In order to ensure the perfection of the video during live broadcasts and videos, this series of operations requires manual hand-held control, or someone to help with the shooting. It is difficult to completely free your hands in many scenarios, especially when taking photos outdoors, live broadcasts outdoors, and video recordings. This is a problem that needs to be solved. Summary of the invention

[0003] The technical problem to be solved by the present invention is to provide an intelligent follow-up shooting pan-tilt and a control method, which can be conveniently placed in different places, capture images through the device's own camera, and drive the video recording or playback device installed thereon to synchronously adjust an angle, so that the device can always follow the person being filmed or keep the video playback device within the viewer's field of view and achieve the optimal angle.

[0004] To solve the above technical problems, the present invention is implemented as follows: the intelligent follow-up shooting gimbal described in the present invention includes a body base, a horizontal rotation base, a horizontal rotation shell, a longitudinal rotation bracket and a camera; the horizontal rotation base and the body base form a coaxial rotation connection, the horizontal rotation drive motor is fixedly connected to the horizontal rotation base, the flat shaft output end of the horizontal rotation drive motor is arranged in the vertical direction, and is plugged and fixed with the center of the body base; the horizontal rotation base is fixedly connected with the longitudinal rotation drive motor, and its power output end is laterally fixedly connected with a horizontal axis, and the horizontal axis is fixed to the longitudinal rotation bracket with a spherical surface through a column; a card slot is provided on the central surface of the spherical outer surface of the longitudinal rotation bracket; the horizontal rotation base is fixedly connected with a battery and a control circuit board, and a camera is arranged at the front end of the horizontal rotation base; the horizontal rotation shell is buckled and fixed to the upper end of the horizontal rotation base, and its top is opened, and the spherical outer surface of the longitudinal rotation bracket is located on the inner side of the top hole of the horizontal rotation shell.

[0005] Preferably, one end of the horizontal axis away from the power output end of the longitudinal rotation drive motor is rotationally connected to a support, and the support is plugged and fixed on the horizontal rotation base.

[0006] Preferably, a fixing bracket is detachably fixedly connected to the middle position of the card slot.

[0007] Preferably, a power switch and a charging port are provided at the rear of the horizontal rotating base; and a bottom support foot is fixedly connected to the bottom of the fuselage base.

[0008] Preferably, an annular clamping platform is provided at the outermost edge of the bottom of the horizontal rotating base, and an annular clamping groove is provided at the top edge of the fuselage base, and the annular clamping platform can be clamped in the annular clamping groove and rotate along the annular clamping groove; an annular boss is provided at the bottom center position of the horizontal rotating base, and the outer ring of the bearing is clamped in the center hole of the annular boss; a base center boss is provided at the center of the fuselage base, and the inner ring of the bearing is clamped and fixed on the outer cylindrical surface of the base center boss; the upper end surface of the base center boss of the fuselage base is coaxially fixedly connected with a vertical shaft, and a flat hole is provided in the center of the vertical shaft, and the flat shaft output end of the horizontal rotation drive motor is plugged and fixed in the flat hole.

[0009] Preferably, a nut that can be connected to the expansion bracket is embedded in the center of the bottom of the fuselage base, and a nut that can be connected to the expansion bracket is embedded in the center of the slot of the longitudinal rotation bracket.

[0010] Preferably, the control circuit board includes an MCU, a power management module, an image processing module, a motor drive module, and a Bluetooth module; the power management module is communicatively connected to the MCU for power supply control, power on / off, and charging; the camera is communicatively connected to the MCU and the image processing module for transmission coordinate feedback of real-time images; the image processing module is communicatively connected to the MCU for processing image data fed back by the camera and performing judgment; the motor drive module is communicatively connected to the MCU, and the MCU sends the feedback data of the image processing module to the motor drive module, thereby controlling the horizontal rotation drive motor and the longitudinal rotation drive motor to rotate; the Bluetooth module is communicatively connected to the MCU, and the Bluetooth module is used for communication with an external electronic device for freeze-frame photography, video recording, page turning, and volume increase and decrease.

[0011] The control method of the present invention is as follows:

[0012] Step 1: Turn on the power switch, the power management module supplies power to the system, the camera of the PTZ enters the working mode after initialization, and the visible image of the camera is EFGH;

[0013] Step 2: The camera feeds the image in the visible screen to the image processing module, which divides the visible screen into grids, determines the center of the captured object image ABCD as O, and establishes the initial point coordinates centered on O;

[0014] Step 3: Capture the object's image center from O to O 1 When the camera feeds the position image of the object to the image processing module for analysis, it calculates the moving distance OO 1, MCU based on the distance OO feedback from the graphics processing module 1 The lateral displacement of the object is calculated by the Pythagorean theorem to be O 1 I and longitudinal displacement is OI;

[0015] Step 4: The MCU records the time the object moves while it is moving, and calculates the speed v of the object based on the distance the object moves and the time it takes to move to that distance;

[0016] Step 5: MCU According to O 1 The value of I and the speed v of the object can be used to calculate the angle and speed of the horizontal rotation base that the horizontal rotation drive motor needs to drive in order to keep synchronous movement with the displacement of the object; the MCU can calculate the angle and speed of the longitudinal rotation bracket that the longitudinal rotation drive motor needs to drive in order to keep synchronous movement with the displacement of the object according to the value of OI and the speed v of the object.

[0017] Step 6: The MCU feeds back the above calculated values ​​to the motor drive module, and the motor drive module sends signals to the horizontal rotation drive motor and the longitudinal rotation drive motor to control the horizontal rotation drive motor and the longitudinal rotation drive motor to move synchronously, thereby realizing the real-time tracking function of the electronic device installed in the card slot of the longitudinal rotation bracket;

[0018] Step 7: When the gimbal starts the automatic photo-taking function, the Bluetooth module must be turned on first, and the gimbal and the electronic device complete the Bluetooth connection; turn on the camera of the electronic device, and when the object to be captured moves into the image capture range ABCD and stays there, the MCU starts timing. When the object remains frozen and does not move for ≥t seconds, the Bluetooth module of the gimbal will send a command to the shutter button of the electronic device to realize the automatic photo-taking function.

[0019] Positive effects of the present invention: The intelligent follow-up shooting gimbal and control method described in the present invention realize real-time object following, face following and motion control, etc., and solve the problem that a user can watch panoramic video, record video, take photos and live broadcast by himself, freeing the user's hands and allowing him to always keep the C position. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0021] Figure 1 It is a schematic diagram of the structure of the present invention;

[0022] Figure 2 It is a schematic diagram of the structure of the present invention;

[0023] Figure 3 It is a schematic diagram of the decomposed structure of the present invention;

[0024] Figure 4 It is a schematic diagram of the decomposed structure of the present invention;

[0025] Figure 5 It is a schematic diagram of the structure of the present invention;

[0026] Figure 6 It is a schematic diagram of the structure of the fuselage base;

[0027] Figure 7 is a schematic diagram of a control system of the present invention;

[0028] Figure 8 It is a schematic diagram of the camera capturing the picture;

[0029] Fig. 9 It is a schematic diagram of the image captured by the camera after the object moves.

[0030] In the figure, 1 is a longitudinal rotation bracket, 2 is a horizontal rotation shell, 3 is a horizontal rotation base, 4 is a fuselage base, 5 is a camera, 6 is a fixed bracket, 7 is a card slot, 8 is a horizontal axis, 9 is a support, 10 is a longitudinal rotation drive motor, 11 is a power switch, 12 is a horizontal rotation drive motor, 13 is a charging port, 14 is a bottom support foot, 15 is an annular card platform, 16 is a vertical axis, 17 is an annular card slot, 18 is a flat shaft output end, 19 is a bearing, 20 is a base center boss, and 21 is a battery. DETAILED DESCRIPTION

[0031] like Figures 1 to 6 As shown, the intelligent follow-up shooting gimbal of the present invention comprises a body base 4, a horizontal rotating base 3, a horizontal rotating shell 2, a longitudinal rotating bracket 1 and a camera 5; the horizontal rotating base 3 and the body base 4 are connected in a coaxial rotational connection, the horizontal rotating drive motor 12 is fixedly connected to the horizontal rotating base 3, the flat shaft output end 18 of the horizontal rotating drive motor 12 is arranged in a vertical direction, and is plugged and fixed with the center of the body base 4; the horizontal rotating base 3 is fixedly connected with a longitudinal rotating drive motor 10, and its power output end is laterally fixedly connected with a transverse axis 8, and the transverse axis 8 is fixed to the longitudinal rotating bracket 1 with a spherical surface through a column; a card slot 7 is provided on the central surface of the spherical outer surface of the longitudinal rotating bracket 1; the horizontal rotating base 3 is fixedly connected with a battery 21 and a control circuit board, and the front end of the horizontal rotating base 3 is provided with a camera 5; the horizontal rotating shell 2 is buckled and fixed to the upper end of the horizontal rotating base 3, and its top is opened, and the spherical outer surface of the longitudinal rotating bracket 1 is located on the inner side of the top hole of the horizontal rotating shell 2.

[0032] Specifically, one end of the transverse axis 8 away from the power output end of the longitudinal rotation drive motor 10 is rotationally connected to the support 9 , and the support 9 is plugged and fixed on the horizontal rotation base 3 .

[0033] Specifically, a fixing bracket 6 is detachably fixedly connected to the middle position of the card slot 7 .

[0034] Specifically, a power switch 11 and a charging port 13 are disposed at the rear of the horizontal rotating base 3; a bottom support leg 14 is fixedly connected to the bottom of the body base 4 to prevent the body base from rotating.

[0035] Specifically, an annular clamping platform 15 is provided at the outermost edge of the bottom of the horizontal rotating base 3, and an annular clamping groove 17 is provided at the top edge of the fuselage base 4. The annular clamping platform 15 can be clamped in the annular clamping groove 17 and rotate along the annular clamping groove 17; an annular boss is provided at the bottom center position of the horizontal rotating base 3, and the outer ring of the bearing 19 is clamped in the center hole of the annular boss; a base center boss 20 is provided at the center of the fuselage base 4, and the inner ring of the bearing 19 is clamped and fixed on the outer cylindrical surface of the base center boss 20; the upper end surface of the base center boss 20 of the fuselage base 4 is coaxially fixedly connected with the vertical shaft 16, and the center of the vertical shaft 16 is provided with a flat hole, and the flat shaft output end 18 of the horizontal rotation drive motor 12 is plugged and fixed in the flat hole.

[0036] Specifically, a nut that can be connected to the expansion bracket is embedded in the center of the bottom of the fuselage base 4, and a nut that can be connected to the expansion bracket is embedded in the center of the slot 7 of the longitudinal rotation bracket 1.

[0037] Specifically, Figure 7 As shown, the control circuit board includes an MCU, a power management module, an image processing module, a motor drive module, and a Bluetooth module; the power management module is connected to the MCU in communication for power supply control, power on / off, and charging; the camera 5 is connected to the MCU and the image processing module in communication for transmission coordinate feedback of real-time images; the image processing module is connected to the MCU in communication for processing image data fed back by the camera 5 and making judgments; the motor drive module is connected to the MCU in communication, and the MCU sends the feedback data of the image processing module to the motor drive module, thereby controlling the horizontal rotation drive motor 12 and the longitudinal rotation drive motor 10 to rotate; the Bluetooth module is connected to the MCU in communication, and the Bluetooth module is used for communication with external electronic devices, and is used for freeze-frame photography, video recording, page turning, and volume increase and decrease.

[0038] like Figure 8 , Fig. 9 As shown, the working process of the present invention is:

[0039] The power switch 11 is turned on, the power management module supplies power to the system, and the camera 5 of the pan / tilt head enters the working mode after initialization, and the visible image of the camera 5 is EFGH.

[0040] The camera 5 feeds back the image in the visible picture to the image processing module, and the image processing module divides the visible picture into grids, determines that the center of the captured object image ABCD is O, and establishes the initial point coordinates with O as the center.

[0041] The center of the captured object image moves from O to O 1 When (the object moves to A 1 B 1 C 1 D 1 Position), the camera feeds the position image of the object to the image processing module for analysis and then calculates the moving distance OO 1 , MCU based on the distance OO feedback from the graphics processing module 1 The lateral displacement of the object is calculated by the Pythagorean theorem to be O 1 I and the longitudinal displacement are OI; MCU records the time of the object's movement when the object moves, and calculates the speed v of the object's movement by the distance the object moves and the time it takes to move to that distance; MCU calculates the speed v of the object's movement according to O 1 The value of I and the speed v of the object's movement can be used to calculate the angle and rotation speed that the horizontal rotation drive motor needs to drive the horizontal rotation base to rotate in order to keep synchronous movement with the object's displacement; the MCU can calculate the angle and rotation speed that the longitudinal rotation drive motor needs to drive the longitudinal rotation bracket to rotate in order to keep synchronous movement with the object's displacement based on the value of OI and the speed v of the object's movement; the MCU feeds back the above-mentioned calculated values ​​to the motor drive module, and the motor drive module sends signals to the horizontal rotation drive motor and the longitudinal rotation drive motor to control the synchronous movement of the horizontal rotation drive motor and the longitudinal rotation drive motor, thereby realizing the real-time tracking function of the electronic device installed in the card slot of the longitudinal rotation bracket.

[0042] When the gimbal starts the automatic photo-taking function, the Bluetooth module must be turned on first, and the gimbal and the electronic device complete the Bluetooth connection; turn on the camera of the electronic device, when the object to be captured moves into the range ABCD of the image capture and stays there, the MCU starts timing, and when the object remains frozen and does not move for ≥5 seconds (the set value can be modified as needed), the Bluetooth module of the gimbal will send a command to the shutter button of the electronic device to realize the automatic photo-taking function.

[0043] The above description is only to illustrate some functional structural principles of a smart follow-up shooting gimbal related to the present invention. Since it is easy for technicians in the same technical field to make several modifications on this basis, this specification is not intended to limit the smart follow-up shooting gimbal described in the present invention to the specific structure and applicable scope shown or described. Therefore, all corresponding modifications and equivalents that may be used belong to the protection scope of the patent of the present invention.

[0044] The embodiments described with reference to the accompanying drawings are exemplary and are intended to be used to explain the present application, and should not be construed as limiting the present application. In the description of the present application, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "upper", "lower", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", "clockwise", "counterclockwise", etc., indicating the orientation or positional relationship, are based on the orientation or positional relationship shown in the accompanying drawings, and are only for the convenience of describing the present application and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be construed as limiting the present application. In addition, the terms "first" and "second" are only used for descriptive purposes, and should not be construed as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the present application, "several" and "multiple" mean two or more than two, unless otherwise clearly specified and specifically defined. In the present application, unless otherwise clearly specified and defined, the terms "installed", "connected", "connected", "fixed" and the like should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be an indirect connection through an intermediate medium, or it can be a communication between the two components. For ordinary technicians in this field, the specific meanings of the above terms in the present application can be understood according to specific circumstances. In the present application, unless otherwise clearly specified and defined, the first feature "above" or "below" the second feature can include the first and second features being in direct contact, or the first and second features being in contact through another feature between them. Moreover, the first feature "above", "above" and "above" the second feature include the first feature being directly above and obliquely above the second feature, or simply means that the first feature is higher in level than the second feature. The first feature being “below”, “below” and “under” the second feature includes the first feature being directly above and diagonally above the second feature, or simply means that the first feature is at a smaller horizontal height than the second feature.

Claims

1. A control method for an intelligent follow-up shooting PTZ. Features: The method is implemented based on an intelligent follow-up shooting gimbal, and the intelligent follow-up shooting gimbal comprises a body base, a horizontal rotation base, a horizontal rotation shell, a longitudinal rotation bracket and a camera; the horizontal rotation base and the body base form a coaxial rotation connection, the horizontal rotation drive motor is fixedly connected to the horizontal rotation base, the flat shaft output end of the horizontal rotation drive motor is arranged in a vertical direction, and is plugged and fixed with the center of the body base; the horizontal rotation base is fixedly connected with the longitudinal rotation drive motor, and its power output end is laterally fixedly connected with a transverse axis, and the transverse axis is fixed to the longitudinal rotation bracket with a spherical surface through a column; a card slot is provided on the central surface of the spherical outer surface of the longitudinal rotation bracket; the horizontal rotation base is fixedly connected with a battery and a control circuit board, and a camera is arranged at the front end of the horizontal rotation base; the horizontal rotation shell is buckled and fixed to the upper end of the horizontal rotation base, and a hole is opened at the top, and the spherical outer surface of the longitudinal rotation bracket is located on the inner side of the top hole of the horizontal rotation shell; The control circuit board includes an MCU, a power management module, an image processing module, a motor drive module, and a Bluetooth module; the power management module is connected to the MCU in communication for power supply control, power on / off, and charging; the camera is connected to the MCU and the image processing module in communication for transmission coordinate feedback of real-time images; the image processing module is connected to the MCU in communication for processing image data fed back by the camera and making judgments; the motor drive module is connected to the MCU in communication, and the MCU sends the feedback data of the image processing module to the motor drive module, thereby controlling the horizontal rotation drive motor and the longitudinal rotation drive motor to rotate; the Bluetooth module is connected to the MCU in communication, and the Bluetooth module is used to communicate with an external electronic device for freeze-frame photography, video recording, page turning, and volume increase and decrease; The control method of the intelligent follow-up shooting gimbal includes the following steps: Step 1: Turn on the power switch, the power management module supplies power to the system, the camera of the PTZ enters the working mode after initialization, and the visible image of the camera is EFGH; Step 2: The camera feeds the image in the visible screen to the image processing module, which divides the visible screen into grids, determines the center of the captured object image ABCD as O, and establishes the initial point coordinates centered on O; Step 3: Capture the object's image center from O to O 1 When the camera feeds the position image of the object to the image processing module for analysis, it calculates the moving distance OO 1 , MCU based on the distance OO fed back by the graphics processing module 1 The lateral displacement of the object is calculated by the Pythagorean theorem to be O 1 I and longitudinal displacement is OI; Step 4: The MCU records the time the object moves, and calculates the speed v of the object based on the distance the object moves and the time it takes to move that distance. Step 5: MCU According to O 1 The value of I and the speed v of the object can be used to calculate the angle and speed of the horizontal rotation base that the horizontal rotation drive motor needs to drive in order to keep synchronous movement with the displacement of the object; the MCU can calculate the angle and speed of the longitudinal rotation bracket that the longitudinal rotation drive motor needs to drive in order to keep synchronous movement with the displacement of the object according to the value of OI and the speed v of the object. Step 6: The MCU feeds back the above calculated values ​​to the motor drive module, and the motor drive module sends signals to the horizontal rotation drive motor and the longitudinal rotation drive motor to control the horizontal rotation drive motor and the longitudinal rotation drive motor to move synchronously, thereby realizing the real-time tracking function of the electronic device installed in the card slot of the longitudinal rotation bracket; Step 7: When the gimbal starts the automatic photo-taking function, the Bluetooth module must be turned on first, and the gimbal and the electronic device complete the Bluetooth connection; turn on the camera of the electronic device, and when the object to be captured moves into the image capture range ABCD and stays there, the MCU starts timing. When the object remains frozen and does not move for ≥t seconds, the Bluetooth module of the gimbal will send a command to the shutter button of the electronic device to realize the automatic photo-taking function.

2. The control method of the smart follow-up shooting PTZ according to claim 1, Features: One end of the horizontal axis away from the power output end of the longitudinal rotation driving motor is rotatably connected with the support, and the support is plugged and fixed on the horizontal rotation base.

3. The control method of the smart follow-up shooting PTZ according to claim 1, Features: A fixing bracket is detachably fixedly connected at the middle position of the card slot.

4. The control method of the smart follow-up shooting PTZ according to claim 1, Features: A power switch and a charging port are arranged at the rear of the horizontal rotating base; and a bottom support foot is fixedly connected to the bottom of the fuselage base.

5. The control method of the smart follow-up shooting PTZ according to claim 1, Features: The outermost edge of the bottom of the horizontal rotating base is provided with an annular clamping platform, and the top edge of the fuselage base is provided with an annular clamping groove, and the annular clamping platform can be clamped in the annular clamping groove and rotate along the annular clamping groove; an annular boss is provided at the bottom center position of the horizontal rotating base, and the outer ring of the bearing is clamped in the center hole of the annular boss; a base center boss is provided at the center of the fuselage base, and the inner ring of the bearing is clamped and fixed on the outer cylindrical surface of the base center boss; the upper end surface of the base center boss of the fuselage base is coaxially fixedly connected with a vertical shaft, and a flat hole is provided in the center of the vertical shaft, and the flat shaft output end of the horizontal rotating drive motor is plugged and fixed in the flat hole.

6. The control method of the smart follow-up shooting PTZ according to claim 1, Features: A nut that can be connected to the expansion bracket is embedded in the center of the bottom of the fuselage base, and a nut that can be connected to the expansion bracket is embedded in the center of the card slot of the longitudinal rotation bracket.

Citation Information

Patent Citations

  • Intelligent pan-tilt based on multi-camera image analysis processing

    CN108869974A

  • Camera is trailed in two mesh education

    CN204859328U

  • Intelligent following shooting holder

    CN212273533U