Electronic device for connecting photographic equipment and mobile device and pan / tilt system including the same
By designing an electronic device connecting photography equipment and mobile devices, the problem that users cannot observe the recording effect in real time is solved, and the control and data display of photography equipment by mobile devices is realized. It is suitable for multiple models of equipment, simplifying operation and reducing The cost.
Patent Information
- Application Number
- CN201811132002.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2018-09-27
- Publication Date
- 2024-11-01
- Estimated Expiration
- 2038-09-27
AI Technical Summary
When using a handheld gimbal system, users cannot observe the audio and video or photo effects recorded by the photography equipment in real time, and the existing external display devices are costly, and some photography equipment does not support the mobile phone remote control function, which limits the user's operation convenience.
Design an electronic device to collect and transmit audio and video and photo data by connecting photography equipment and mobile devices, and encode and package processing through processing modules, and support control protocols for various photography equipment models to realize the mobile device's photography equipment. Control and data display. The device includes a multimedia interface, a photography device control interface and a processing module, which is connected by a USB interface or a wireless radio frequency transceiver to simplify the user's interaction with the photography device.
Users can view the recording effects of photography equipment in real time through mobile devices and control it. It is suitable for photography equipment of various models, reducing operational complexity and cost and improving user experience.
Smart Images

Figure CN109104585B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of photographic equipment control and handheld pan / tilt platform, and in particular to an electronic device for connecting photographic equipment and a mobile device and a pan / tilt platform system including the electronic device. Background Art
[0002] With the continuous development of handheld pan-tilt technology, it has become increasingly common to use a pan-tilt system to assist photographic equipment (including cameras, camcorders, etc.) in recording audio and video and taking photos. The user fixes the photographic equipment on the pan-tilt system and controls the movement of the photographic equipment in all directions by controlling the pan-tilt handle. However, when using the pan-tilt system, the user may not be able to observe the screen of the photographic equipment due to the movement of the photographic equipment, resulting in the user being unable to know the effect of the currently recorded audio, video or photo. To solve this problem, the usual practice is to connect the existing photographic equipment to an external display device, which can be fixed on the pan-tilt handle to display the audio, video or photo currently recorded by the photographic equipment, so that the user can watch it in real time. However, the price of such an external display device is often quite expensive, which greatly increases the cost.
[0003] Since some current photographic equipment already has a mobile phone remote control function, one way to reduce costs is to use a mobile phone to replace the external display device. The mobile phone is connected to the photographic equipment via Bluetooth or WIFI to obtain the audio, video or photos currently captured by the photographic equipment. In addition, users can also control the photographic equipment through their mobile phones. However, there are still many photographic equipment on the market that do not support the mobile phone remote control function, so this method is not suitable for many users. Summary of the invention
[0004] In order to solve the problems existing in the prior art, according to one embodiment of the present invention, an electronic device for connecting a photographic device and a mobile device is provided, comprising a first connection interface, a second connection interface and a processing module; wherein the second connection interface is connected to the photographic device, and is used to collect audio and video recorded and / or photos taken by the photographic device; the processing module is used to perform encoding and packaging processing on the audio and video and / or photos, and transmit them to the mobile device via the first connection interface.
[0005] In the above-mentioned electronic device, the second connection interface includes a multimedia interface and a photographic device control interface, the multimedia interface of the second connection interface is connected to the multimedia interface of the photographic device, and is used to collect audio and video recorded and / or photos taken by the photographic device, and the photographic device control interface is connected to the data transmission interface of the photographic device; the first connection interface is also used to receive photographic device control commands from the mobile device; the processing module is also used to convert the photographic device control commands into control commands dedicated to the photographic device, and transmit the converted photographic device control commands to the photographic device via the photographic device control interface.
[0006] The above-mentioned electronic device also includes a storage module, which stores control protocols corresponding to multiple photographic device models; the processing module is also used to transmit photographic device model query information to the photographic device via the photographic device control interface, and receive the model information of the photographic device via the photographic device control interface; the processing module is also used to query the storage module according to the model information of the photographic device, obtain the control protocol corresponding to the photographic device model of the photographic device, and convert the photographic device control command according to the obtained control protocol.
[0007] In the above-mentioned electronic device, the second connection interface also includes an audio and video conversion module, which is used to receive audio, video or photos from the photographic device, convert the audio, video or photos into a format supported by the multimedia interface of the second connection interface, and send the converted audio, video or photos to the multimedia interface of the second connection interface.
[0008] In the above electronic device, the first connection interface includes one or more of a USB interface, a USB hub or a wireless radio frequency transceiver.
[0009] According to one embodiment of the present invention, a gimbal system is also provided, including a gimbal handle (which includes a connection module), a gimbal power device and the above-mentioned electronic device; wherein the connection module in the gimbal handle is connected to the first connection interface in the electronic device.
[0010] In the above-mentioned gimbal system, the connection module in the gimbal handle is also connected to the mobile device, used to receive data from the electronic device and transmit it to the mobile device, and / or used to receive photographic equipment control commands from the mobile device and transmit the photographic equipment control commands to the electronic device.
[0011] In the above-mentioned gimbal system, the gimbal handle also includes a human-computer interaction module, which is connected to the connection module and is used to receive the photographic equipment control command input by the user. The connection module receives the photographic equipment control command input by the user through the human-computer interaction module, and transmits the photographic equipment control command to the electronic device.
[0012] In the above pan-tilt system, the first connection interface is connected to the connection module via a wireless or wired connection, and / or is connected to the mobile device via a wireless or wired connection.
[0013] In the above pan / tilt system, the connection module is connected to the mobile device via a wireless or wired connection.
[0014] The present invention has the following beneficial effects:
[0015] 1. When it is inconvenient or impossible for the user to view the screen of the photographic device, the user can use a commonly used mobile device (such as a mobile phone, tablet computer, etc.) to obtain the effects of the currently recorded audio or video or the taken photos, and can control the photographic device through the mobile device, which facilitates the user's shooting operation.
[0016] 2. It has a wide range of applications and can display or play in real time the audio, video or photos captured by various types of photographic equipment through mobile devices, and can also control the operation of various types of photographic equipment through mobile devices.
[0017] 3. Users can obtain audio, video or photos of the photographic device and control the operation of the photographic device by connecting the mobile device to the pan-tilt system via wire or wirelessly, which further simplifies the user's operation, facilitates the user's interaction with the photographic device, and greatly improves the user experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] The exemplary embodiments will be described in detail below with reference to the accompanying drawings, which are intended to depict exemplary embodiments and should not be interpreted as limiting the intended scope of the claims. Unless explicitly noted, the accompanying drawings are not to be considered to be drawn to scale.
[0019] Figure 1 is a stereoscopic diagram of a pan / tilt system according to an embodiment of the present invention;
[0020] Figure 2 is a block diagram of the internal structure of a pan / tilt system according to an embodiment of the present invention;
[0021] Figure 3 is through Figure 2 The schematic diagram of the process of the pan-tilt system playing the audio and video recorded by the camera device on the mobile device is shown. DETAILED DESCRIPTION
[0022] In order to make the purpose, technical solutions and advantages of the present invention more clearly understood, the present invention is further described in detail below through specific embodiments in conjunction with the accompanying drawings. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.
[0023] According to one embodiment of the present invention, a pan / tilt system is provided. Figure 1 As shown, the pan / tilt system includes a pan / tilt power device 11, a pan / tilt handle 12, and an electronic device 13 for connecting a photographic device 14 and a mobile device 15 (such as a mobile phone, a tablet computer, a handheld notebook computer, or other electronic devices with a display screen and computing and communication functions, etc.), as shown below. Figure 2 Describe these parts separately.
[0024] The pan-tilt power device 11 includes: a multi-axis motor (such as a three-axis motor); connecting components, including connecting parts for fixing the photographic equipment 14; and sensors, etc., wherein the sensors are used to sense information such as the position and speed of the photographic equipment 14.
[0025] The pan / tilt handle 12 includes a main control module 123, a connection module 121, and a human-computer interaction module 122, etc., wherein the human-computer interaction module 122 may be a switch, a button, etc. In the pan / tilt handle 12, the human-computer interaction module 122 is used to receive commands input by the user (for example, by pressing a switch or a button) and transmit them to the main control module 123. The main control module 123 controls the rotation of the motor in the pan / tilt power device 11 according to the commands input by the user or according to the photographic equipment information (such as position, speed, etc.) sensed by the sensor, thereby controlling the movement of the photographic equipment 14 in all directions. The connection module 121 is connected to the mobile device 15 and the first connection interface 134 in the electronic device 13, and is used to further transmit the data transmitted by the electronic device 13 to the mobile device 15 and transmit the photographic equipment control command input by the user through the mobile device 15 to the electronic device 13. The connection module 121 may also be connected to the human-computer interaction module 122, and is used to receive the photographic equipment control command input by the user through the human-computer interaction module 122 and transmit the photographic equipment control command to the electronic device 13.
[0026] The electronic device 13 connecting the photographic equipment and the mobile device includes a processing module 131, a storage module 132, a first connection interface 134 and a second connection interface 133. Among them, the second connection interface 133 includes a multimedia interface 1331 and a photographic equipment control interface 1332. The former is used to connect with the multimedia interface of the photographic equipment 14 and collect audio, video or photos captured and transmitted by the photographic equipment in real time, and the latter is connected with the data transmission interface of the photographic equipment 14, and is used to receive photographic equipment parameters and control the operation of the photographic equipment. The first connection interface 134 is connected to the connection module 121 in the gimbal handle 12. When the connection module 121 is connected to the mobile device 15 at the same time, the first connection interface 134 is connected to the mobile device 15 via the connection module 121. The storage module 132 stores control protocols corresponding to various types of photographic equipment. The processing module 131 is used to encode and encapsulate the audio, video or photos collected by the multimedia interface 1331 to obtain data that can be parsed and decoded by the mobile device, and send the processed data to the connection module 121 in the gimbal handle 12 via the first connection interface 134, and then send it to the mobile device via the connection module 121. It should be noted that the first connection interface can be connected to the connection module 121 in a wireless or wired manner, and the connection module 121 can be connected to the mobile device 15 in a wireless or wired manner. The processing module 131 is also used to convert the photographic device control command received via the first connection interface 134 (input by the user through the mobile device 15 or the human-computer interaction module 122), that is, convert the photographic device control command input by the user into a control command dedicated to the current photographic device, and send the converted photographic device control command to the photographic device via the photographic device control interface 1332. According to an embodiment of the present invention, the processing module 131 searches the storage module 132 according to the photographic device model information, obtains the control protocol corresponding to the photographic device model, and then converts the photographic device control command input by the user into a photographic device control command recognizable by the current photographic device according to the obtained control protocol, and transmits the converted photographic device control command to the photographic device 14 via the photographic device control interface 1332. In order to obtain the photographic device model information of the current photographic device, the processing module 131 can send photographic device model query information to the photographic device 14 via the photographic device control interface 1332, and receive the photographic device model information returned by the photographic device 14.
[0027] Since all existing types of photographic equipment basically support HDMI output, the multimedia interface 1331 can use an HDMI interface. It should be understood that in the prior art, in addition to HDMI, VGA and DVI interfaces are also common output interfaces of photographic equipment. Therefore, according to other embodiments of the present invention, the multimedia interface 1331 can also be a VGA interface or a DVI interface. In addition, if photos are received, the multimedia interface 1331 can also be a USB interface, etc. According to one embodiment of the present invention, the first connection interface 134 includes a USB interface, and the connection module 121 in the pan / tilt handle 12 is a USB hub (i.e., USB HUB), so that the mobile device 15 can be connected to the connection module 121 in the pan / tilt handle 12 via a USB connection, and the electronic device 13 can be connected to the connection module 121 (via the first connection interface 134) via a USB connection, and then connected to the mobile device via a USB connection. According to one embodiment of the present invention, the photographic equipment control interface 1332 can be a serial port or a USB interface, which is used to connect to the data transmission interface of the photographic equipment 14.
[0028] In actual use, the user needs to fix the photographic device on the pan-tilt power device 11 of the pan-tilt system, connect the multimedia interface of the photographic device 14 to the multimedia interface 1331 of the electronic device 13, connect the data transmission interface of the photographic device 14 to the photographic device control interface 1332 of the electronic device 13, and connect the mobile device 15 to the connection module 121 in the pan-tilt handle 12. Based on such a connection structure, the process of recording audio, video or photos by the photographic device 14 and playing them on the mobile device 15 through the pan-tilt system is as follows (see Figure 3 ):
[0029] Step 21 . The photographing device 14 transmits the recorded audio and video or the taken photos to the multimedia interface 1331 of the electronic device 13 in real time via its multimedia interface.
[0030] Step 22 . The multimedia interface 1331 of the electronic device 13 collects the audio, video or photos sent by the photographic device 14 .
[0031] Step 23. The processing module 131 of the electronic device 13 encodes the collected audio, video or photos, for example, using H.264+AAC technology to encode audio and video; encapsulates the encoded data, for example, encapsulates it in TS stream format, wherein audio and video synchronization information (PTS) is added; and transmits the encapsulated data to the connection module 121 in the pan / tilt handle 12 via the first connection interface 134. Among them, the encoding process can not only unify the audio, video or photos into a format that can be decoded by the mobile device (so that the mobile device 15 can decode the data by installing the corresponding APP), but also reduce the size of the original audio, video or photos by re-encoding or compression, so that the transmission of audio, video or photos is more efficient; and encapsulation can ensure the synchronization of audio, video or photos and the stability of data transmission. Although the encoding process is performed by taking H.264+AAC as an example above, those skilled in the art should understand that other encoding formats can also be used to perform encoding processing. In addition, in addition to the TS stream format, other encapsulation formats (such as RTMP, RTP, RTSP, etc.) are also applicable.
[0032] Step 24 . The connection module 121 in the gimbal handle 12 transmits the data transmitted from the electronic device 13 to the mobile device 15 .
[0033] Step 25. The mobile device 15 parses the received data (for example, obtains data in H.264+AAC format), then performs decoding processing, and plays or displays the decoded audio, video or photo files on the screen.
[0034] Thus, the user can know the recording effect of the current photographic device according to the audio and video played or the photos displayed on the mobile device 15, without checking the screen of the photographic device 14. In the process of viewing the audio and video recorded or the photos taken by the photographic device 14 through the mobile device 15, the user can input the photographic device control command according to the effect learned from the mobile device 15, and then control the photographic device 14 through the pan-tilt system. According to one embodiment of the present invention, the above control process is as follows:
[0035] Step 31. The user inputs a photographic device control command through the mobile device 15 or the human-computer interaction module 122 on the gimbal handle 12. If the user inputs a photographic device control command (i.e., a general photographic device control command) through the mobile device 15, the mobile device 15 sends the photographic device control command to the connection module 121 in the gimbal handle 12, and the connection module 121 further sends the photographic device control command to the first connection interface 134 in the electronic device 13. If the user inputs a photographic device control command through the human-computer interaction module 122 on the gimbal handle 12, the connection module 121 directly receives the photographic device control command and transmits the photographic device control command to the first connection interface 134 in the electronic device 13.
[0036] Step 32. The processing module 131 in the electronic device 13 sends the photographic device model query information to the photographic device 14 via the photographic device control interface 1332, and receives the photographic device model information returned by the photographic device 14. Those skilled in the art should understand that the photographic device model can be queried after the photographic device 14 is connected to the pan / tilt system, and the photographic device model information can be stored in the storage module 132. Subsequently, when receiving a photographic device control command, the processing module 131 can directly obtain the photographic device model information from the storage module 132 without sending the photographic device model query information to the photographic device 14 again.
[0037] Step 33. The processing module 131 searches for the control protocol corresponding to the model of the photographic device in the storage module 132 according to the model information of the photographic device, converts the received control command of the photographic device into a control command dedicated to the current photographic device according to the found control protocol, and transmits the converted control command to the photographic device via the photographic device control interface 1332, thereby realizing the control of the photographic device.
[0038] As described above, the first connection interface 134 of the electronic device 13 includes a USB interface, which is connected to the connection module 121 (i.e., USB hub) in the gimbal handle 12, and further connected to the mobile device 15 (connected to the USB hub). In another embodiment, the first connection interface 134 of the electronic device 13 can be a wireless RF transceiver (e.g., a 2.4G wireless RF transceiver chip), so the electronic device 13 can be connected to the mobile device by wireless connection. According to one embodiment of the present invention, the UDP protocol can be used to transmit (processed TS format) data through WIFI. In addition, the connection module 121 in the gimbal handle 12 can also be a wireless RF transceiver, so that it can be connected to the electronic device 13 and the mobile device 15 in a wireless manner. In another embodiment, the first connection interface 134 of the electronic device 13 includes both a USB interface and a wireless RF transceiver. The electronic device 13 is connected to the mobile device through a wireless connection on the one hand, and is also connected to the connection module 121 in the gimbal handle 12 through a USB connection on the other hand. In another embodiment, the first connection interface 134 of the electronic device 13 may be a USB hub, which is used to connect to the mobile device 15 and the human-computer interaction module 122 via a USB connection. In another embodiment, the first connection interface 134 of the electronic device 13 may include a USB hub and a wireless RF transceiver, wherein the wireless RF transceiver is connected to the USB hub. The electronic device 13 is connected to the mobile device 15 via a wireless connection, and is connected to the connection module 121 in the gimbal handle 12 via a USB hub. The USB hub provides multiple USB interfaces, which, in addition to being able to connect the electronic device 13 and the gimbal handle, also provides the user with the possibility of further expanding the electronic device 13.
[0039] In another embodiment, in order to save costs, the Hi3516A chip of HiSilicon is used with some external modules to realize the electronic device 13. The Hi3516A chip provides a USB interface (including providing a photographic device control interface 1332), and provides a BT1120 interface or an I2S interface to receive audio and video. As mentioned above, since almost all current photographic devices support HDMI technology, an HDMI conversion module can be connected to the BT1120 interface or the I2S interface. The HDMI conversion module is used to receive the audio and video sent by the photographic device 14, convert the audio and video into a format supported by the multimedia interface of the Hi3516A chip (such as the BT1120 interface or the I2S interface), such as the digital signal data format of BT1120 or the audio data format of I2S, and is used to transmit the converted data to the multimedia interface 1331 of the Hi3516A chip. The Hi3516A chip then encodes and encapsulates the data transmitted from the HDMI conversion module, and the USB interface on the Hi3516A chip sends the processed data to the connection module 121 in the pan / tilt handle 12, and then sends it to the mobile device 15. When the user wants to control the photographic device, the user inputs the photographic device control command into the connection module 121 in the pan / tilt handle 12 through the mobile device 15 or the human-computer interaction module 122, and then the connection module 121 transmits it to the USB interface of the Hi3516A chip, and the Hi3516A chip converts and sends the converted control command to the photographic device via the photographic device control interface 1332 on the Hi3516A chip. Those skilled in the art should understand that in addition to the Hi3516A chip, other similar SoC chips are also applicable.
[0040] Since the USB interfaces on the existing SoC chip are usually limited, in order to facilitate further expansion of the electronic device 13, in a further embodiment, one of the USB interfaces can be connected to a USB hub, and the USB hub is connected to the connection module 121 in the gimbal handle 12. In a further embodiment, a wireless radio frequency transceiver can also be connected to the USB hub to achieve wireless connection with the mobile device 15 (or with the connection module 121).
[0041] In the above embodiment, the multimedia interface 1331 of the electronic device 13 is used to receive audio, video or photos from the photographic device 14, while in another embodiment, the multimedia interface 1331 (such as an HDMI interface) can be used only to receive audio and video files, while the photographic device control interface 1332 receives photo files.
[0042] It should be noted that some exemplary methods are depicted as flow charts. Although the flow charts describe the operations as being performed sequentially, it is understood that many operations may be performed in parallel, simultaneously, or synchronously. In addition, the order of the operations may be rearranged. The process may terminate when the operations are completed, but may also have additional steps not included in the figures or in the embodiments.
[0043] The above method can be implemented by hardware, software, firmware, middleware, pseudocode, hardware description language or any combination thereof. When implemented in software, firmware, middleware or pseudocode, the program code or code segment used to perform the task can be stored in a computer-readable medium, such as a storage medium, and the processor can perform the task.
[0044] It should be understood that exemplary embodiments of software implementations are typically encoded on some form of program storage medium or implemented on some type of transmission medium. The program storage medium can be any non-transient storage medium, such as a disk (e.g., a floppy disk or hard disk) or an optical disk (e.g., a compact disk read-only memory or "CD ROM"), and can be read-only or randomly accessed. Similarly, the transmission medium can be a twisted pair, a coaxial cable, an optical fiber, or some other suitable transmission medium known in the art.
[0045] Although the present invention has been described through preferred embodiments, the present invention is not limited to the embodiments described herein but includes various changes and modifications that may be made without departing from the scope of the present invention.
Claims
1. An electronic device (13) for connecting a photographic device (14) and a mobile device (15), comprising a first connection interface (134), a second connection interface (133) and a processing module (131); in, The second connection interface (133) is connected to the photographic device (14) and is used to collect audio and video recorded and / or photos taken by the photographic device (14); the processing module (131) is used to encode and package the audio and video and / or photos, and transmit them to the mobile device (15) via the first connection interface (134), wherein the first connection interface (134) of the electronic device (13) also includes an interface for connecting a gimbal handle, The second connection interface (133) includes a multimedia interface (1331) and a photographic device control interface (1332), wherein the multimedia interface (1331) is connected to the multimedia interface of the photographic device (14) and is used to collect audio and video recorded and / or photos taken by the photographic device (14), and the photographic device control interface (1332) is connected to the data transmission interface of the photographic device (14); The first connection interface (134) is also used to receive a photographic device control command from the mobile device (15); the processing module (131) is also used to convert the photographic device control command into a control command dedicated to the photographic device (14), and transmit the converted photographic device control command to the photographic device (14) via the photographic device control interface (1332).
2. The electronic device (13) according to claim 1, wherein: The electronic device (13) further comprises a storage module (132), wherein the storage module (132) stores control protocols corresponding to a plurality of photographic equipment models; The processing module (131) is also used to transmit photographic device model query information to the photographic device (14) via the photographic device control interface (1332), and receive model information of the photographic device (14) via the photographic device control interface (1332); The processing module (131) is also used to query the storage module (132) according to the model information of the photographic device (14), obtain the control protocol corresponding to the photographic device model of the photographic device (14), and convert the photographic device control command according to the obtained control protocol.
3. The electronic device (13) according to claim 1, wherein: The second connection interface (133) also includes an audio and video conversion module, which is used to receive audio, video or photos from the photographic device (14), convert the audio, video or photos into a format supported by the multimedia interface (1331), and send the converted audio, video or photos to the multimedia interface (1331).
4. The electronic device (13) according to any one of claims 1 to 3, wherein: The first connection interface (134) includes one or more of a USB interface, a USB hub, or a wireless radio frequency transceiver.
5. A pan / tilt system, comprising: A pan / tilt handle (12), comprising a connection module (121); Pan / tilt power device (11); as well as An electronic device (13) for connecting a photographing device (14) and a mobile device (15) as claimed in any one of claims 1 to 4; Wherein, the connection module (121) in the pan / tilt handle (12) is connected to the first connection interface (134) in the electronic device (13), The first connection interface (134) is connected to the connection module (121) by wireless or wired connection, and / or is connected to the mobile device (15) by wireless or wired connection, and the connection module (121) is connected to the mobile device (15) by wireless or wired connection.
6. The pan / tilt system according to claim 5, wherein: The connection module (121) in the gimbal handle (12) is also connected to the mobile device (15) and is used to receive data from the electronic device (13) and transmit it to the mobile device (15), and / or is used to receive a photographic device control command from the mobile device (15) and transmit the photographic device control command to the electronic device (13).
7. The pan / tilt system according to claim 5 or 6, wherein: The gimbal handle (12) also includes a human-computer interaction module (122), which is connected to the connection module (121) and is used to receive a photographic device control command input by a user. The connection module (121) receives the photographic device control command input by the user through the human-computer interaction module (122), and transmits the photographic device control command to the electronic device (13).
