Tracking shooting method, device and medium

By determining the object position in the wide-angle camera screen and calculating the pixel vector, converting it into an angle vector to drive the telephoto camera to rotate, the problem of high computational load when tracking objects in the prior art is solved, and efficient object tracking and real-time tracking functions of telephoto cameras are realized.

CN115550538BActive Publication Date: 2025-05-13BEIJING XIAOMI MOBILE SOFTWARE CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202110735661.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-06-30
Publication Date
2025-05-13
Estimated Expiration
2041-06-30

AI Technical Summary

Technical Problem

The prior art has a large calculation load when tracking objects in a wide-angle screen, and it is impossible to effectively track objects to be close-up.

Method used

By determining the current position of the object in the wide-angle camera shooting screen, calculate the pixel vector from the center point of the picture to the object's position, and convert it into an angle vector, driving the telephoto camera to track the object.

Benefits of technology

The rotation angle calculation of the telephoto camera is simplified, the computing load is reduced, and the effective tracking of the objects to be close-up is realized, making it easy to realize the real-time tracking function of the telephoto camera.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115550538B_ABST
    Figure CN115550538B_ABST
Patent Text Reader

Abstract

The present disclosure relates to a tracking shooting method, device and medium, which belongs to the field of electronic technology and can effectively track an object to be photographed in close-up and reduce the computing load. A tracking shooting method includes: determining the current position of the object to be photographed in close-up in a wide-angle camera shooting picture; calculating the pixel vector from the center point of the picture of the wide-angle camera shooting picture to the current position of the object to be photographed in close-up; based on the ratio of the viewing angle value of the wide-angle camera to the number of side pixels of the picture of the wide-angle camera shooting picture, converting the pixel vector into an angle vector; based on the angle vector, driving the telephoto camera to rotate to track the object to be photographed in close-up.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of electronic technology, and in particular to a tracking shooting method, device and medium. Background Art

[0002] In the related art, the following method is usually used to track objects in a wide-angle image: first, the object to be photographed in close-up is identified in the wide-angle image, and then the image after digital zoom is edited using the position of the identification frame as the center to achieve the function of simultaneously shooting the scene and close-up. However, this method has a large computational load and cannot effectively track the object to be photographed in close-up. Summary of the invention

[0003] In order to overcome the problems existing in the related art, the present disclosure provides a tracking shooting method, device and medium.

[0004] According to a first aspect of an embodiment of the present disclosure, a tracking shooting method is provided, including: determining a current position of an object to be photographed in close-up in a wide-angle camera shooting picture; calculating a pixel vector from a center point of the wide-angle camera shooting picture to the current position of the object to be photographed in close-up; converting the pixel vector into an angle vector based on a ratio of a viewing angle value of the wide-angle camera to a number of side pixels of the wide-angle camera shooting picture; and driving a telephoto camera to rotate based on the angle vector to track the object to be photographed in close-up.

[0005] Optionally, determining the current position of the object to be captured in close-up in the wide-angle camera shooting picture includes: determining the midpoint of a line connecting touch points located on both sides of the object to be captured in close-up in the wide-angle camera shooting picture; and confirming the midpoint of the line as the current position of the object to be captured in close-up.

[0006] Optionally, the converting of the pixel vector into an angle vector based on the ratio of the viewing angle value of the wide-angle camera to the number of side pixels of the picture taken by the wide-angle camera includes: converting the pixel vector into an angle vector based on the ratio of the vertical viewing angle value of the wide-angle camera to the number of pixels of the vertical side of the picture taken by the wide-angle camera.

[0007] Optionally, driving the telephoto camera to rotate based on the angle vector to track the object to be captured in close-up includes: splitting the angle vector into a horizontal angle value and a vertical angle value; driving the Yaw axis of the telephoto camera to rotate based on the horizontal angle value, and driving the Pitch axis of the telephoto camera to rotate based on the vertical angle value.

[0008] Optionally, the method includes: calculating the change between the current position of the object to be photographed in close-up and its previous position; comparing the change with a preset threshold; if the change is greater than the preset threshold, executing the step of calculating the pixel vector from the center point of the picture taken by the wide-angle camera to the current position of the object to be photographed in close-up.

[0009] Optionally, the method includes: if the change amount is less than the preset threshold, controlling the telephoto camera to perform an anti-shake operation.

[0010] Optionally, the preset threshold is one Nth of the number of pixels on the short side of the picture taken by the telephoto camera, where 3≤N≤9.

[0011] Optionally, the arrangement of the wide-angle camera and the telephoto camera meets the following requirements: the long side of the screen shot by the wide-angle camera is in the same direction as the long side of the screen shot by the telephoto camera, and in the same direction as the long side of the screen; the head of the screen shot by the wide-angle camera is in the same direction as the head of the screen shot by the telephoto camera; and the center position of the long side of the screen shot by the wide-angle camera is aligned with the center position of the long side of the screen shot by the telephoto camera.

[0012] According to a second aspect of an embodiment of the present disclosure, a tracking shooting device is provided, including: a determination module, used to determine the current position of an object to be photographed in close-up in a picture taken by a wide-angle camera; a calculation module, used to calculate a pixel vector from the center point of the picture taken by the wide-angle camera to the current position of the object to be photographed in close-up; a conversion module, used to convert the pixel vector into an angle vector based on the ratio of the viewing angle value of the wide-angle camera to the number of side pixels of the picture taken by the wide-angle camera; and a tracking module, used to drive the telephoto camera to rotate based on the angle vector to track the object to be photographed in close-up.

[0013] Optionally, determining the current position of the object to be captured in close-up in the wide-angle camera shooting picture includes: determining the midpoint of a line connecting touch points located on both sides of the object to be captured in close-up in the wide-angle camera shooting picture; and confirming the midpoint of the line as the current position of the object to be captured in close-up.

[0014] Optionally, the converting of the pixel vector into an angle vector based on the ratio of the viewing angle value of the wide-angle camera to the number of side pixels of the picture taken by the wide-angle camera includes: converting the pixel vector into an angle vector based on the ratio of the vertical viewing angle value of the wide-angle camera to the number of pixels of the vertical side of the picture taken by the wide-angle camera.

[0015] Optionally, driving the telephoto camera to rotate based on the angle vector to track the object to be captured in close-up includes: splitting the angle vector into a horizontal angle value and a vertical angle value; driving the Yaw axis of the telephoto camera to rotate based on the horizontal angle value, and driving the Pitch axis of the telephoto camera to rotate based on the vertical angle value.

[0016] Optionally, the calculation module is also used to: calculate the change between the current position of the object to be photographed in close-up and its previous position, and compare the change with a preset threshold value; if the change is greater than the preset threshold value, perform the operation of calculating the pixel vector from the center point of the picture taken by the wide-angle camera to the current position of the object to be photographed in close-up.

[0017] Optionally, the tracking module is further used to: if the change amount is less than the preset threshold, control the telephoto camera to perform an anti-shake operation.

[0018] Optionally, the preset threshold is one Nth of the number of pixels on the short side of the picture taken by the telephoto camera, where 3≤N≤9.

[0019] Optionally, the arrangement of the wide-angle camera and the telephoto camera meets the following requirements: the long side of the screen shot by the wide-angle camera is in the same direction as the long side of the screen shot by the telephoto camera, and in the same direction as the long side of the screen; the head of the screen shot by the wide-angle camera is in the same direction as the head of the screen shot by the telephoto camera; and the center position of the long side of the screen shot by the wide-angle camera is aligned with the center position of the long side of the screen shot by the telephoto camera.

[0020] According to a third aspect of an embodiment of the present disclosure, there is provided a tracking shooting device, comprising: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to: determine the current position of an object to be photographed in close-up in a wide-angle camera shooting picture; calculate a pixel vector from the center point of the picture of the wide-angle camera shooting picture to the current position of the object to be photographed in close-up; based on the ratio of the viewing angle value of the wide-angle camera to the number of side pixels of the picture of the wide-angle camera shooting picture, convert the pixel vector into an angle vector; based on the angle vector, drive the telephoto camera to rotate to track the object to be photographed in close-up.

[0021] According to a fourth aspect of an embodiment of the present disclosure, a computer-readable storage medium is provided, on which computer program instructions are stored. When the program instructions are executed by a processor, the steps of the tracking shooting method provided in the first aspect of the present disclosure are implemented.

[0022] By adopting the above technical solution, the current position of the object to be photographed in close-up in the picture taken by the wide-angle camera is first determined, and then the pixel vector from the center point of the picture taken by the wide-angle camera to the current position of the object to be photographed in close-up is calculated, and then based on the ratio of the viewing angle value of the wide-angle camera to the number of side pixels of the picture taken by the wide-angle camera, the pixel vector is converted into an angle vector, and then based on the angle vector, the telephoto camera is driven to rotate to track the object to be photographed in close-up. Therefore, the rotation angle of the telephoto camera can be simply calculated in the picture taken by the wide-angle camera, the calculation load is reduced, so that the object to be photographed in close-up can be effectively tracked, and the real-time tracking function of the telephoto camera can be easily realized.

[0023] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0025] Figure 1 The figure is a flow chart of a tracking shooting method according to an exemplary embodiment.

[0026] Figure 2 is a schematic diagram of a user touching two sides of an object to be close-up with two fingers at the same time.

[0027] Figure 3 is a schematic diagram of the object recognition box that will be close-up.

[0028] Figure 4 It is a schematic diagram of the pixel vector from the center point of the picture taken by the wide-angle camera to the current position of the object to be close-up.

[0029] Figure 5 is a schematic top view of an exemplary telephoto camera.

[0030] Figure 6 is a schematic front view of an exemplary telephoto camera.

[0031] Figure 7 According to the embodiment of the present disclosure Figure 5 Schematic diagram of the rotation of the telephoto camera shown.

[0032] Figure 8 is another flow chart of a tracking shooting method according to an embodiment of the present disclosure.

[0033] Fig. 9 This is a schematic diagram of the tracking shooting screen.

[0034] Fig.10 This is a schematic diagram of the anti-shake operation screen.

[0035] Fig.11 This is a schematic diagram showing that the long side of the picture taken by the wide-angle camera is in the same direction as the long side of the picture taken by the telephoto camera and is in the same direction as the long side of the screen.

[0036] Fig.12 It is a schematic diagram showing that the head of the picture taken by the wide-angle camera and the head of the picture taken by the telephoto camera are in the same direction.

[0037] Fig.13 It is a schematic diagram showing that the center position of the long side of the picture taken by the wide-angle camera is aligned with the center position of the long side of the picture taken by the telephoto camera.

[0038] Fig.14 The figure is a block diagram of a tracking and shooting device according to an exemplary embodiment.

[0039] Fig.15 It is a block diagram of a device for tracking shooting according to an exemplary embodiment. DETAILED DESCRIPTION

[0040] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0041] Figure 1 is a flow chart of a tracking shooting method according to an exemplary embodiment. Figure 1 As shown, the tracking shooting method is used in a mobile terminal and includes the following steps.

[0042] In step S11 , the current position of the object to be captured in close-up in the wide-angle camera shooting picture is determined.

[0043] In photography, a wide-angle camera can capture scenes, and a telephoto camera can capture close-ups. If you want to capture both scenes and close-ups at the same time, you need to enable the telephoto camera to rotate at a large angle (for example, greater than 3 degrees). Also, since the telephoto camera needs to rotate at a large angle, the center of the wide-angle camera's shooting picture should be as consistent as possible with the center of the telephoto camera's shooting picture, to ensure that the telephoto lens can efficiently track the close-up object within the scene range of the wide-angle camera.

[0044] The objects being photographed in close-up refer to the people, scenery, animals, etc. that need to be photographed in close-up.

[0045] In some embodiments, the midpoint of the line connecting the touch points on both sides of the object to be photographed in the wide-angle camera image can be first determined; then, the midpoint of the line is confirmed as the current position of the object to be photographed. For example, when taking photos using a mobile terminal, if a user wants to take a close-up of an object in the photographic image, the user can use two fingers to touch both sides of the object to be photographed at the same time, and determine the center position of the line connecting the two touch points as the current position of the object to be photographed.

[0046] In addition, the object to be close-up can also be identified through the identification frame. For example, during the shooting process, if the user touches both sides of the object to be close-up with two fingers at the same time (such as Figure 2 As shown in FIG. 1 ), the midpoint of the line connecting the touch points of the two fingers can be set as the center point of the recognition frame, and the touch points of the two fingers can be used as the focus points of the recognition frame, thereby constructing a recognition frame about the object to be close-up (as shown in FIG. Figure 3 shown).

[0047] In step S12, a pixel vector from the center point of the image captured by the wide-angle camera to the current position of the object to be captured in close-up is calculated. Figure 4 It is a schematic diagram of the pixel vector from the center point of the picture taken by the wide-angle camera to the current position of the object to be close-up.

[0048] In step S13, the pixel vector is converted into an angle vector based on the ratio of the viewing angle value of the wide-angle camera to the number of side pixels of the picture taken by the wide-angle camera.

[0049] In some embodiments, the pixel vector may be converted into an angle vector based on a ratio of an angle value of a vertical viewing angle of the wide-angle camera to the number of pixels of a vertical side of a picture captured by the wide-angle camera.

[0050] In step S14 , the telephoto camera is driven to rotate based on the angle vector to track the object to be captured in close-up.

[0051] In some embodiments, the angle vector may be first split into a horizontal angle value and a vertical angle value; then the Yaw axis of the telephoto camera is driven to rotate based on the horizontal angle value, and the Pitch axis of the telephoto camera is driven to rotate based on the vertical angle value. Generally speaking, the rotation of the Yaw axis corresponds to the horizontal rotation of the shooting screen, and the rotation of the Pitch axis corresponds to the vertical rotation of the shooting screen. By driving the telephoto camera to rotate, the object to be close-up can be tracked.

[0052] Figure 5 is a schematic top view of an exemplary telephoto camera. Figure 6 is a schematic front view of an exemplary telephoto camera. Figure 5 and 6 As shown, the telephoto camera includes two sets of prisms that can rotate on a single axis and a telephoto camera module. Figure 7 According to the embodiment of the present disclosure Figure 5 Schematic diagram of the rotation of the telephoto camera shown.

[0053] By adopting the above technical solution, the current position of the object to be photographed in close-up in the picture taken by the wide-angle camera is first determined, and then the pixel vector from the center point of the picture taken by the wide-angle camera to the current position of the object to be photographed in close-up is calculated, and then based on the ratio of the viewing angle value of the wide-angle camera to the number of side pixels of the picture taken by the wide-angle camera, the pixel vector is converted into an angle vector, and then based on the angle vector, the telephoto camera is driven to rotate to track the object to be photographed in close-up. Therefore, the rotation angle of the telephoto camera can be simply calculated in the picture taken by the wide-angle camera, the calculation load is reduced, so that the object to be photographed in close-up can be effectively tracked, and the real-time tracking function of the telephoto camera can be easily realized.

[0054] Figure 8 is another flow chart of a tracking shooting method according to an embodiment of the present disclosure. Figure 8 and Figure 1 The difference is that it also includes steps S15 and S16.

[0055] In step S15, the change amount between the current position of the object to be close-up and its previous position is calculated;

[0056] In step S16, the change amount is compared with a preset threshold value. The preset threshold value may be one Nth of the number of pixels on the short side of the image captured by the telephoto camera, where 3≤N≤9. For example, the preset threshold value may be 1 / 6 of the number of pixels on the short side of the image captured by the telephoto camera.

[0057] If the change amount is greater than the preset threshold, step S12 is executed to track and shoot the object to be photographed in close-up. Fig. 9 As shown, Fig. 9 The diagram is illustrated by taking N as 6 as an example. If the change amount is less than the preset threshold, step S17 is executed.

[0058] In step S17, if the change amount is less than the preset threshold, the telephoto camera is controlled to perform an anti-shake operation, such as Fig.10 shown.

[0059] By adopting the above technical solution, it is possible to perform anti-shake operations when the moving distance of the object to be photographed is short, and to track and shoot the object to be photographed when the moving distance of the object to be photographed is large. This avoids image shaking and maintains the stability of close-up shots with a telephoto camera.

[0060] In some embodiments, in order to better perform the above tracking shooting method, the arrangement of the wide-angle camera and the telephoto camera can meet the following requirements: (1) The long side of the picture taken by the wide-angle camera is in the same direction as the long side of the picture taken by the telephoto camera, and is in the same direction as the long side of the screen, such as Fig.11 (2) The head of the image taken by the wide-angle camera is in the same direction as the head of the image taken by the telephoto camera, as shown in FIG. Fig.12 As shown; and (3) the center position of the long side of the picture taken by the wide-angle camera is aligned with the center position of the long side of the picture taken by the telephoto camera, as shown Fig.13 By setting this up, it is possible to ensure that the long-side movement tracking of the object to be captured in the scene is more efficient and has a wider tracking range.

[0061] Fig.14 is a block diagram of a tracking shooting device according to an exemplary embodiment. Fig.14 The tracking shooting device includes: a determination module 141, used to determine the current position of the object to be close-up in the wide-angle camera shooting picture; a calculation module 142, used to calculate the pixel vector from the center point of the wide-angle camera shooting picture to the current position of the object to be close-up; a conversion module 143, used to convert the pixel vector into an angle vector based on the ratio of the viewing angle value of the wide-angle camera and the number of side pixels of the wide-angle camera shooting picture; a tracking module 144, used to drive the telephoto camera to rotate based on the angle vector to track the object to be close-up.

[0062] By adopting the above technical solution, the current position of the object to be photographed in close-up in the picture taken by the wide-angle camera is first determined, and then the pixel vector from the center point of the picture taken by the wide-angle camera to the current position of the object to be photographed in close-up is calculated, and then based on the ratio of the viewing angle value of the wide-angle camera to the number of side pixels of the picture taken by the wide-angle camera, the pixel vector is converted into an angle vector, and then based on the angle vector, the telephoto camera is driven to rotate to track the object to be photographed in close-up. Therefore, the rotation angle of the telephoto camera can be simply calculated in the picture taken by the wide-angle camera, the calculation load is reduced, so that the object to be photographed in close-up can be effectively tracked, and the real-time tracking function of the telephoto camera can be easily realized.

[0063] Optionally, determining the current position of the object to be captured in close-up in the wide-angle camera shooting picture includes: determining the midpoint of a line connecting touch points located on both sides of the object to be captured in close-up in the wide-angle camera shooting picture; and confirming the midpoint of the line as the current position of the object to be captured in close-up.

[0064] Optionally, the converting of the pixel vector into an angle vector based on the ratio of the viewing angle value of the wide-angle camera to the number of side pixels of the picture taken by the wide-angle camera includes: converting the pixel vector into an angle vector based on the ratio of the vertical viewing angle value of the wide-angle camera to the number of pixels of the vertical side of the picture taken by the wide-angle camera.

[0065] Optionally, driving the telephoto camera to rotate based on the angle vector to track the object to be captured in close-up includes: splitting the angle vector into a horizontal angle value and a vertical angle value; driving the Yaw axis of the telephoto camera to rotate based on the horizontal angle value, and driving the Pitch axis of the telephoto camera to rotate based on the vertical angle value.

[0066] Optionally, the calculation module 142 is also used to: calculate the change between the current position of the object to be photographed in close-up and its previous position, and compare the change with a preset threshold value; if the change is greater than the preset threshold value, perform the operation of calculating the pixel vector from the center point of the picture taken by the wide-angle camera to the current position of the object to be photographed in close-up.

[0067] Optionally, the tracking module 144 is further configured to: if the change amount is less than the preset threshold, control the telephoto camera to perform an anti-shake operation.

[0068] Optionally, the preset threshold is one Nth of the number of pixels on the short side of the picture taken by the telephoto camera, where 3≤N≤9.

[0069] Optionally, the arrangement of the wide-angle camera and the telephoto camera meets the following requirements: the long side of the screen shot by the wide-angle camera is in the same direction as the long side of the screen shot by the telephoto camera, and in the same direction as the long side of the screen; the head of the screen shot by the wide-angle camera is in the same direction as the head of the screen shot by the telephoto camera; and the center position of the long side of the screen shot by the wide-angle camera is aligned with the center position of the long side of the screen shot by the telephoto camera.

[0070] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0071] The present disclosure also provides a computer-readable storage medium having computer program instructions stored thereon, and when the program instructions are executed by a processor, the steps of the tracking shooting method provided by the present disclosure are implemented.

[0072] Fig.158 is a block diagram of an apparatus 800 for tracking shooting according to an exemplary embodiment. For example, the apparatus 800 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0073] Reference Figure 8 , the device 800 may include one or more of the following components: a processing component 802 , a memory 804 , a power component 806 , a multimedia component 808 , an audio component 810 , an input / output (I / O) interface 812 , a sensor component 814 , and a communication component 816 .

[0074] The processing component 802 generally controls the overall operation of the device 800, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the tracking shooting method described above. In addition, the processing component 802 may include one or more modules to facilitate the interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.

[0075] The memory 804 is configured to store various types of data to support operations on the device 800. Examples of such data include instructions for any application or method operating on the device 800, contact data, phone book data, messages, pictures, videos, etc. The memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0076] The power component 806 provides power to the various components of the device 800. The power component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 800.

[0077] The multimedia component 808 includes a screen that provides an output interface between the device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and / or a rear camera. When the device 800 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0078] The audio component 810 is configured to output and / or input audio signals. For example, the audio component 810 includes a microphone (MIC), and when the device 800 is in an operating mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 804 or sent via the communication component 816. In some embodiments, the audio component 810 also includes a speaker for outputting audio signals.

[0079] I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: home button, volume button, start button, and lock button.

[0080] The sensor assembly 814 includes one or more sensors for providing various aspects of status assessment for the device 800. For example, the sensor assembly 814 can detect the open / closed state of the device 800, the relative positioning of components, such as the display and keypad of the device 800, the sensor assembly 814 can also detect the position change of the device 800 or a component of the device 800, the presence or absence of user contact with the device 800, the orientation or acceleration / deceleration of the device 800 and the temperature change of the device 800. The sensor assembly 814 can include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 814 can also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 can also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor or a temperature sensor.

[0081] The communication component 816 is configured to facilitate wired or wireless communication between the device 800 and other devices. The device 800 can access a wireless network based on a communication standard, such as WiFi, 4G or 5G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0082] In an exemplary embodiment, the device 800 can be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to perform the above-mentioned tracking and shooting methods.

[0083] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 804 including instructions, and the instructions can be executed by the processor 820 of the device 800 to complete the above tracking shooting method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0084] In another exemplary embodiment, a computer program product is further provided. The computer program product includes a computer program executable by a programmable device. The computer program has a code portion for executing the above tracking shooting method when executed by the programmable device.

[0085] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the present disclosure. This application is intended to cover any variations, uses or adaptations of the present disclosure, which follow the general principles of the present disclosure and include common knowledge or customary technical means in the art that are not disclosed in the present disclosure. The specification and examples are to be considered as exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0086] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A tracking shooting method, characterized in that: include: Determine the current position of the object to be captured in close-up in the wide-angle camera image; Calculating a pixel vector from the center point of the picture taken by the wide-angle camera to the current position of the object to be photographed in close-up; Converting the pixel vector into an angle vector based on a ratio of a viewing angle value of a wide-angle camera to a number of side pixels of a picture taken by the wide-angle camera; Driving the telephoto camera to rotate based on the angle vector to track the object to be featured; The step of determining the current position of the object to be captured in close-up in the picture taken by the wide-angle camera includes: Determine the midpoint of a line connecting touch points on both sides of the object to be captured in close-up in the wide-angle camera shooting picture; Confirming the midpoint of the connecting line as the current position of the object to be close-up; The step of converting the pixel vector into an angle vector based on the ratio of the viewing angle value of the wide-angle camera to the number of side pixels of the picture taken by the wide-angle camera comprises: The pixel vector is converted into an angle vector based on a ratio of an angle value of a vertical viewing angle of the wide-angle camera to the number of pixels of a vertical side of a picture taken by the wide-angle camera.

2. The tracking shooting method according to claim 1, characterized in that: The step of driving the telephoto camera to rotate based on the angle vector to track the object to be featured includes: Splitting the angle vector into a horizontal angle value and a vertical angle value; The Yaw axis of the telephoto camera is driven to rotate based on the horizontal angle value, and the Pitch axis of the telephoto camera is driven to rotate based on the vertical angle value.

3. The method according to claim 1, characterized in that The method comprises: Calculating a change between a current position of the object to be close-up and a previous position thereof; comparing the change amount with a preset threshold; If the change amount is greater than the preset threshold, the step of calculating the pixel vector from the center point of the picture taken by the wide-angle camera to the current position of the object to be photographed in close-up is performed.

4. The method according to claim 3, characterized in that The method comprises: If the change amount is less than the preset threshold, the telephoto camera is controlled to perform an anti-shake operation.

5. The method according to claim 3, characterized in that: The preset threshold is one Nth of the number of pixels on the short side of the image captured by the telephoto camera, where 3≤N≤9.

6. The method according to any one of claims 1 to 5, characterized in that: The arrangement of the wide-angle camera and the telephoto camera meets the following requirements: the long side of the picture taken by the wide-angle camera is in the same direction as the long side of the picture taken by the telephoto camera, and is in the same direction as the long side of the screen; the head of the picture taken by the wide-angle camera is in the same direction as the head of the picture taken by the telephoto camera; and the center position of the long side of the picture taken by the wide-angle camera is aligned with the center position of the long side of the picture taken by the telephoto camera.

7. A tracking shooting device, characterized in that: include: A determination module, used to determine the current position of the object to be captured in close-up in the picture taken by the wide-angle camera; A calculation module, used for calculating a pixel vector from the center point of the picture taken by the wide-angle camera to the current position of the object to be photographed in close-up; A conversion module, configured to convert the pixel vector into an angle vector based on a ratio of a viewing angle value of a wide-angle camera to a number of side pixels of a picture taken by the wide-angle camera; A tracking module, configured to drive the telephoto camera to rotate based on the angle vector to track the object to be featured; The step of determining the current position of the object to be captured in close-up in the picture taken by the wide-angle camera includes: Determine the midpoint of a line connecting touch points on both sides of the object to be captured in close-up in the wide-angle camera shooting picture; Confirming the midpoint of the connecting line as the current position of the object to be close-up; The step of converting the pixel vector into an angle vector based on the ratio of the viewing angle value of the wide-angle camera to the number of side pixels of the picture taken by the wide-angle camera comprises: The pixel vector is converted into an angle vector based on a ratio of an angle value of a vertical viewing angle of the wide-angle camera to the number of pixels of a vertical side of a picture taken by the wide-angle camera.

8. A tracking shooting device, characterized in that: include: processor; a memory for storing processor-executable instructions; Wherein, the processor is configured to: Determine the current position of the object to be captured in close-up in the wide-angle camera image; Calculating a pixel vector from the center point of the picture taken by the wide-angle camera to the current position of the object to be photographed in close-up; Converting the pixel vector into an angle vector based on a ratio of a viewing angle value of a wide-angle camera to a number of side pixels of a picture taken by the wide-angle camera; Driving the telephoto camera to rotate based on the angle vector to track the object to be featured; The step of determining the current position of the object to be captured in close-up in the picture taken by the wide-angle camera includes: Determine the midpoint of a line connecting touch points on both sides of the object to be captured in close-up in the wide-angle camera shooting picture; Confirming the midpoint of the connecting line as the current position of the object to be close-up; The step of converting the pixel vector into an angle vector based on the ratio of the viewing angle value of the wide-angle camera to the number of side pixels of the picture taken by the wide-angle camera comprises: The pixel vector is converted into an angle vector based on a ratio of an angle value of a vertical viewing angle of the wide-angle camera to the number of pixels of a vertical side of a picture taken by the wide-angle camera.

9. A computer-readable storage medium having computer program instructions stored thereon, characterized in that: When the program instructions are executed by a processor, the steps of the method described in any one of claims 1 to 6 are implemented.

Citation Information

Patent Citations

  • Coordinate extracting algorithm of lacertilian-imitating suborder chamaeleonidae biological vision

    CN102682445A

  • Method and system for detecting and tracking target

    CN105072414A