Camera tracking device

Abstract

The camera tracking device (1) includes a sensor head (2) that can be externally and detachably coupled to a camera (3). The sensor head (2) includes means configured to detect a first rotational movement of the sensor head (2) around a first axis of rotation (X) and a second rotational movement of the sensor head around a second axis of rotation (Y) perpendicular to the first axis of rotation (X), and to generate respective electronic signals indicating such rotational movements; a data processing unit configured to receive and process the electronic signals; a wireless data transmission unit configured to establish a connection with a network or an external electronic device; means (4) for displaying a graphical user interface; fixing means (5) suitable for coupling the sensor head (2) with the camera (3) when in use; and a wired connection interface (6) designed for connecting the device (1) to an external data processing system when in use.

Description

Detailed Description of the Invention

[0001] 〔Technical Field〕 The present invention relates to a tracking device for a camera.

[0002] 〔Prior Art〕 The use of virtual production technology, including virtual sets, augmented reality (AR) technology and mixed reality (MR) technology, or extended reality (XR) technology, is to visually capture real-world scenes and overlay one or more virtual levels (layers) including sets, elements, or characters on those scenes, and is known in the entertainment field or the field of visual material production. Due to recent technological advancements, it has become possible to produce augmented reality materials or virtual scenes characterized by high realism in which virtual levels are fused with real-shot images very smoothly, naturally and effectively.

[0003] Currently, augmented reality visual materials can be produced through applications operable on hardware devices such as smartphones equipped with cameras and motion sensors. In particular, one or more cameras for capturing real-world scenes, a software application capable of generating one or more virtual images and overlaying it on the captured scene, and one or more sensors capable of detecting changes occurring to the framing (due to zooming or movement of the camera) and adapting the position of the virtual image accordingly are required.

[0004] In the context of professional or amateur visual material production, there is a need to adapt the use of professional cameras or amateur cameras to create virtual production visual materials.

[0005] For this purpose, a tracking device has been proposed that can be externally and detachably coupled to these cameras. Such a device can detect changes in framing, encode the detected information using electronic signals, and transmit those electronic signals to a data processing system.

[0006] One type of tracking device known in the art includes a sensor head comprising one or more optical sensors adapted to detect the positions of a plurality of markers placed in a real environment defining a framing area. The tracking device includes processing means configured to create a three-dimensional map of the surrounding environment based on the positions of the markers and to detect the position and orientation of the sensor head relative to the map in real time. Examples of such devices are disclosed in patent applications GB2602356A and EP4020392A.

[0007] However, it has been confirmed that even publicly known devices using conventional technology are not without room for improvement.

[0008] In particular, known devices are expensive and structurally complex, and preparing the shooting environment, especially regarding marker placement, often requires a long time and considerable effort. Furthermore, such preparation is difficult to carry out, especially when the shooting environment is outdoors.

[0009] [Disclosure] The objective of this invention is to solve or mitigate the aforementioned problems by devising a structurally compact and simple tracking device for cameras.

[0010] Another objective of the present invention is to provide a camera tracking device that does not require effort to prepare the work environment.

[0011] A further objective of the present invention is to provide a device that is easy to maintain.

[0012] A further objective of the present invention is to provide a lightweight device.

[0013] A further objective of the present invention is to provide a device that is easy for operators to use.

[0014] A further objective of the present invention is to create a camera tracking device that is structurally and functionally simple, highly reliable in operation, widely applicable, and relatively cost-effective.

[0015] The above-mentioned objectives are achieved, according to the present invention, by the camera tracking device described in the appended claims.

[0016] The camera tracking device includes a sensor head that can be externally and detachably coupled to a video camera.

[0017] The sensor head includes means configured to detect a first rotational movement of the sensor head around a first rotation axis and a second rotational movement of the sensor head around a second rotation axis perpendicular to the first rotation axis, and to generate electronic signals indicating such rotational movements.

[0018] Preferably, the means configured to detect a first rotational movement of the sensor head around a first rotation axis and a second rotational movement of the sensor head around a second rotation axis perpendicular to the first rotation axis, and to generate respective electronic signals indicating such rotational movements, includes or comprises a first inertial sensor.

[0019] Preferably, the first rotation axis is a horizontal rotation axis, and therefore the first rotational movement is an oscillating movement on a vertical plane.

[0020] Preferably, the second axis of rotation is a vertical axis of rotation, and therefore the second rotational movement is an oscillating movement on a horizontal plane.

[0021] The sensor head further includes a data processing unit configured to receive the signal from the first inertial sensor and process the signal.

[0022] Preferably, the data processing unit includes, or consists of, an electronic card.

[0023] The sensor head further includes a wireless data transmission assembly configured to establish a connection with a network or an external electronic device.

[0024] Preferably, the wireless data transmission unit includes, or consists of, a wi-fi card.

[0025] The sensor head further includes a wired connection interface adapted to connect the device to an external data processing system during use. [[ID=ID=18]]

[0026] Preferably, the external data processing system includes a computer configured to generate a virtual scenario.

[0027] Preferably, the wired connection interface includes a plurality of connection ports adapted to transmit signals processed by the internal data processing unit to the external data processing system.

[0028] Preferably, the wired connection interface includes one or more RS485 serial ports.

[0029] Preferably, the wired connection interface includes an input port for an electronic signal indicating the zoom and / or focus operation of a camera lens.

[0030] The sensor head further includes means for displaying a graphical user interface.

[0031] Preferably, the means for displaying the graphical user interface includes, or consists of, an electronic display.

[0032] Preferably, the electronic display is configured to display the operating parameters regarding the tracking device.

[0033] The sensor head further includes fixing means adapted to couple the sensor head to the camera in use.

[0034] Preferably, the fixing means includes a plurality of sheets adapted to receive and hold respective fixing straps or ties for fixing the device to the camera in use.

[0035] Preferably, the device includes means configured to detect translational movement of the sensor head and generate respective electronic signals indicative of such movement.

[0036] Preferably, the means configured to detect translational movement of the sensor head and generate respective electronic signals indicative of such movement includes, or consists of, a second inertial sensor.

[0037] Preferably, the second inertial sensor is housed within a wired accessory connected to the sensor head.

[0038] Preferably, the sensor head is formed by a box-shaped body including a lower base and an upper base.

[0039] Preferably, the lower base and the upper base are connected to each other by a plurality of side walls.

[0040] Preferably, the body includes four side walls.

[0041] Preferably, the electronic display is positioned on one of the multiple side walls.

[0042] Preferably, the side wall containing the electronic display is inclined so that it is easy for the operator to view it.

[0043] Preferably, the lower base of the main body includes the fixing means.

[0044] According to the present invention, the data processing unit is configured to transmit the electronic signals to the external data processing system in real time, either by the wireless data transmission unit or by the wired connection interface, so that the external data processing system uses the electronic signals to generate a virtual scenario in real time that is consistent with the operations performed by the camera.

[0045] Furthermore, one aspect of the present invention is a method for tracking a camera using a camera tracking device according to the present invention, a. The process of connecting a camera tracking device to a video camera; b. The process of operating and configuring the device; c. While the camera is operating, the device detects a first rotational movement of the camera around a first rotation axis and a second rotational movement of the camera around a second rotation axis perpendicular to the first rotation axis, and generates electronic signals indicating such rotational movements; d. A process in which a processing unit inside the device processes the electronic signal and generates a tracking signal for the camera; e. The process of transmitting the camera tracking signal to an external data processing system in real time via the wireless data transmission unit of the device or via the wired connection interface of the device; f. The process of generating a virtual scenario in real time that is consistent with the actions performed by the camera, using the tracking signal of the camera, by the external data processing system. This method includes [something].

[0046] Preferably, the wireless transmission of the tracking signal is performed using the OSC protocol or the FreeD protocol.

[0047] Furthermore, one aspect of the present invention is a computer program that includes instructions to cause a device according to the present invention to perform steps c to e of the described method.

[0048] Furthermore, one aspect of the present invention is a computer-readable data carrier on which a computer program according to the present invention is recorded.

[0049] Furthermore, one aspect of the present invention is a system for generating virtual scenarios, comprising at least one video camera, a tracking device coupled to at least one camera, and an external data processing system configured to receive and use tracking signals from at least one of the cameras generated by the tracking device to generate virtual scenarios in real time that are consistent with operations performed by at least one of the video cameras.

[0050] [Description of the drawing] Further details of the present invention will become clearer from a detailed description of a preferred embodiment of the tracking device for a video camera according to the present invention, illustrated in the accompanying drawings. In the accompanying drawings: Figure 1 shows a perspective view of the device according to the present invention, coupled with a camera in a first mounting configuration.

[0051] Figure 2 shows a perspective view of the device according to the present invention, coupled with a camera in a second mounting configuration.

[0052] Figure 3 shows a perspective view of the device according to the present invention, coupled with a camera in a third mounting configuration.

[0053] Figures 4 and 5 show the respective side views of the device according to the present invention.

[0054] Figure 6 shows a bottom view of the device according to the present invention.

[0055] Figure 7 shows a perspective view of the device according to the present invention, coupled with a camera mounted on a swivel arm.

[0056] [Description of Embodiments of the Invention] Referring particularly to Figures 1 to 7, the camera tracking device is collectively indicated by reference numeral 1.

[0057] Device 1 includes a sensor head 2 that can be externally and detachably coupled to a video camera 3.

[0058] The sensor head 2 is formed by a box-shaped body 20. The box-shaped body 20 includes a lower base 21 and an upper base 22. The lower base 21 and the upper base 22 are connected to each other through a plurality of side walls 23.

[0059] Preferably, the main body 20 includes four side walls 23.

[0060] The sensor head 2 includes means 4 (preferably an electronic display) for displaying a graphical user interface. The electronic display 4 is located on one of the side walls 24 of the plurality of side walls 23.

[0061] Preferably, the side wall 24 equipped with the electronic display 4 is inclined so that it is easy for the operator to view it.

[0062] The lower base 21 of the main body 20 includes fixing means 5 suitable for detachably connecting the main body 2 to the structure of the video camera 3 during use (operation).

[0063] Preferably, the fixing means 5 includes a preferably T-shaped channel 51 suitable for receiving a corresponding bracket positioned on the structure of the camera 3. Preferably, the fixing means 5 further includes a plurality of sheets 52 suitable for receiving and holding each fixing strap or tie for securing the device 1 to the camera 3 when in use.

[0064] The sensor head 2 includes at least a first inertial sensor M1 inside the box-shaped body 20. The first inertial sensor M1 is configured to detect a first rotational movement of the sensor head 2 around a first rotation axis X and a second rotational movement of the sensor head 2 around a second rotation axis Y that is perpendicular to the first rotation axis X.

[0065] Preferably, the first rotation axis X is a horizontal rotation axis, and therefore the first rotational movement is an oscillating movement on a vertical plane (i.e., a tilt-type movement).

[0066] Preferably, the second rotation axis Y is a vertical rotation axis, and therefore the second rotational movement is an oscillating movement on the horizontal plane (i.e., a pan-shaped movement).

[0067] The first inertial sensor M1 is configured to generate electronic signals that indicate the detected rotational movement.

[0068] The sensor head 2 further includes a data processing unit U1 (preferably an electronic card) inside the box-shaped body 20. The data processing unit U1 is configured to receive the signal from the first inertial sensor M1 and process the signal.

[0069] The sensor head 2 further includes a wireless data transmission unit U2 (preferably a Wi-Fi card) inside the box-shaped body 20. The wireless data transmission unit U2 is configured to establish a connection with a network or an external electronic device.

[0070] The sensor head further includes a wired connection interface adapted for connecting the device to an external data processing system E when in use.

[0071] The external data processing system E preferably includes a computer configured to generate virtual scenarios.

[0072] The connection interface 6 preferably includes a plurality of connection ports (e.g., RS485 serial ports) suitable for transmitting signals processed by the internal data processing unit U1 to an external data processing system E.

[0073] Preferably, the connection interface 6 is located on one of the side walls 23, specifically on side wall 25. Preferably, side wall 25 is on the opposite side of side wall 24 from where the electronic display 4 is located.

[0074] The wired connection interface 6 preferably includes an input port for electronic signals indicating the zoom and focus operation of the camera lens. These electronic signals can be obtained, for example, by a rotary encoder mounted on the camera optical system.

[0075] It should be noted that device 1 may be coupled to a camera 3 mounted on a tripod (see Figures 1 to 3) or on a slewing arm (known as a crane; see Figure 7 in particular). Device 1 may include a second inertial sensor M2 configured to detect the movement of the slewing arm in three-dimensional space (in particular, translational movement along the X, Y, and Z directions) and generate corresponding electronic signals indicating such movement. Preferably, the second inertial sensor M2 is housed in a wired accessory connected to the sensor head.

[0076] It is convenient that the inertial sensor M1, inertial sensor M2, electronic display 4, wireless card U2, and wired connection interface 6 are connected to the internal data processing unit U1 of device 1.

[0077] The operation of camera tracking device 1 can be easily understood from the following explanation.

[0078] First, the operator uses fixing means 5 to attach device 1 to the structure of video camera 3. Device 1 may be positioned so that the display 4 faces the rear of camera 3 (see Figure 1), or so that the display 4 faces laterally to camera 3 (see Figures 1 and 2).

[0079] Subsequently, the operator connects the power cable to device 1 and makes the connections related to the wired interface 6. For example, the operator can connect the input cable from the rotary encoder connected to the optical system of camera 3, and can also connect the output cable to the external data processing system E via the serial port.

[0080] Subsequently, the operator starts up device 1, connects a computer or other external electronic device to device 1's Wi-Fi card, and accesses the web interface for configuring device 1 through the browser of the computer or external electronic device. Through the device 1 configuration web interface, it is possible to adjust settings such as tripod height and offset parameters. The set configuration parameters and other service information can be displayed on the device 1's display 4.

[0081] Note that display 4 is adapted to display the operating parameters of device 1; in particular, device 1 is configured to detect the movement of camera 3, but is not configured to manage or control the movement of camera 3 through actuators.

[0082] Once device 1 is configured, the operator can begin capturing images with camera 3. During capturing, device 1 detects the movement of camera 3, which is coupled to device 1. Specifically, device 1's first inertial sensor M1 detects the rotational movement of camera 3 around the X and Y axes and generates corresponding electronic signals indicating such rotational movement. Device 1's internal processing unit U1 receives these electronic signals along with signals received from an external rotary encoder (if present) and processes and outputs the tracking signal from camera 3 in real time. This tracking signal is transmitted to an external data processing system E via a Wi-Fi card U2 (preferably using the UDP transmission protocol) using the OSC protocol or the FreeD protocol, or via a wired interface 6, for example via a serial port, using the FreeD protocol.

[0083] The tracking signal for camera 3 includes real-time transmitted data relating to the pan, tilt, and zoom movements of camera 3. Preferably, the tracking signal for camera 3 also includes real-time transmitted data relating to the focus and roll of camera 3.

[0084] If camera 3 is mounted on the swivel arm and device 1 is equipped with a second inertial sensor M2 (via a wired accessory including a second inertial sensor), the tracking signal from camera 3 also includes data about the movement of the swivel arm in three-dimensional space (X, Y, and Z directions).

[0085] The external data processing system receives tracking signals from camera 3 and uses these signals to generate virtual scenarios in real time that are consistent with the actions performed by camera 3.

[0086] The camera tracking device according to the present invention achieves the objective of tracking a camera without requiring the lengthy and time-consuming preparation of the shooting environment. In particular, this is realized by an inertial sensor capable of detecting camera movement.

[0087] In practical embodiments of the present invention, the materials used, as well as the shape and dimensions, may be modified as necessary without departing from the scope of the appended claims.

[0088] Where any technical feature referred to in any claim is denoted by a reference symbol, such reference symbols are provided solely for the purpose of enhancing the understanding of that claim and are therefore not to be considered in any way to limit the scope of each element exemplified by such reference symbols. [Brief explanation of the drawing]

[0089] [Figure 1] A perspective view of the device according to the present invention, coupled with a camera in the first mounting configuration, is shown. [Figure 2] A perspective view of the device according to the present invention, coupled with a camera in the second mounting configuration, is shown. [Figure 3] A perspective view of the device according to the present invention, coupled with a camera in the third mounting configuration, is shown. [Figure 4] A side view of the device according to the present invention is shown. [Figure 5] A side view of the device according to the present invention is shown. [Figure 6] A bottom view of the device according to the present invention is shown. [Figure 7] This shows a perspective view of the device according to the present invention, which is coupled with a camera mounted on a swivel arm.

Claims

1. Camera tracking device (1), It includes a video camera (3) and a sensor head (2) that can be externally attached and detachably coupled, The sensor head (2) is A means (M1) configured to detect a first rotational movement of the sensor head (2) around a first rotation axis (X) and a second rotational movement of the sensor head (2) around a second rotation axis (Y) perpendicular to the first rotation axis (X), and to generate electronic signals indicating the respective rotational movements, A data processing unit (U1) configured to receive and process the aforementioned electronic signals, A wireless data transmission unit (U2) that can be configured to establish a connection with an external network or electronic device, Means for displaying a graphical user interface (4), A fixing means (5) is provided to connect the sensor head (2) with the camera (3) when in use. A wired connection interface (6) adapted for connecting the device (1) to an external data processing system (E) when in use, Includes, The means (M1) configured to detect a first rotational movement of the sensor head (2) around a first rotation axis (X) and a second rotational movement of the sensor head (2) around a second rotation axis (Y), the wireless data transmission unit (U2), the means (4) for displaying a graphical user interface, and the wired connection interface (6) are connected to the data processing unit (U1). Camera tracking device (1), wherein the data processing unit (U1) is configured to transmit the electronic signals to the external data processing system (E) in real time via the data transmission unit (U2) wirelessly or via the wired connection interface (6) so that the external data processing system (E) uses the electronic signals to generate a virtual scenario in real time that is consistent with the actions performed by the camera (3).

2. The device according to claim 1, further comprising means (M2) configured to detect the translational movement of the sensor head (2) and generate corresponding electronic signals indicating the movement.

3. The device according to claim 1 or 2, wherein the means (M1) configured to detect a first rotational movement of the sensor head (2) around a first rotation axis (X) and a second rotational movement of the sensor head (2) around a second rotation axis (Y), and to generate respective electronic signals indicating the rotational movements, includes a first inertial sensor.

4. The device according to claim 2 or 3, wherein the means (M2) configured to detect the translational movement of the sensor head (2) and generate corresponding electronic signals indicating the movement includes a second inertial sensor.

5. The sensor head is formed by a box-shaped body (20) including a lower base (21) and an upper base (22), The lower base (21) and the upper base (22) are connected by a plurality of side walls (23). The device according to any one of claims 1 to 4, wherein one of the multiple side walls (23) is provided with the display means (3) of a graphical user interface.

6. The device according to claim 5, wherein the side wall (24) on which the display means (3) of the graphical user interface is provided is inclined.

7. The device according to any one of claims 1 to 6, wherein the fixing means (5) includes a plurality of sheets (52) adapted to receive and hold each fixing strap or tie for fixing the device (1) to the camera (3) when in use.

8. A method for tracking a camera (3) using a camera tracking device (1) according to any one of claims 1 to 7, a. The process of connecting the camera tracking device (1) with the video camera (3); b. The process of operating and setting the device (1); c. While the camera (3) is operating, the device (1) detects a first rotational movement of the camera (3) around a first rotation axis (X) and a second rotational movement of the camera (3) around a second rotation axis (Y) perpendicular to the first rotation axis (X), and generates electronic signals indicating the respective rotational movements; d. A step of generating a tracking signal for the camera (3) by processing the electronic signal via a data processing unit (U1) inside the device (1); e. The step of transmitting the tracking signal of the camera (3) to an external data processing system (E) in real time via the wireless data transmission unit (U2) of the device (1) or via the wired connection interface (6) of the device (1); f. The process of generating a virtual scenario in real time that is consistent with the actions performed by the camera (3) using the tracking signal of the camera (3) with the external data processing system (E). Methods that include...

9. A computer program that includes instructions to cause the device according to any one of claims 1 to 7 to perform steps c to e of the method according to claim 8.

10. A computer-readable data carrier on which the computer program described in claim 9 is recorded.

11. A system for generating virtual scenarios, At least one video camera (3) and A tracking device (1) according to any one of claims 1 to 7, coupled to at least one of the video cameras (3), An external data processing system (E) is configured to receive and use tracking signals from at least one of the video cameras (3) generated by the tracking device (1) to generate a virtual scenario in real time that is consistent with the actions performed by at least one of the cameras (3), A system that includes this.

Images