Video acquisition method, device and electronic equipment
By detecting the target object within the camera's range and obtaining its line of sight, a control signal is generated to adjust the camera's direction, solving the problem of the camera being unable to follow and capture in real time, and achieving efficient video acquisition.
Patent Information
- Application Number
- CN202411812716.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-10
- Publication Date
- 2025-12-05
- Estimated Expiration
- 2044-12-10
AI Technical Summary
Current technology cannot achieve real-time tracking shooting, resulting in poor video shooting quality.
By detecting whether the target object is within the camera's field of view, its line of sight is obtained, and control signals are generated to adjust the camera's direction and angle so that it can capture video along the line of sight.
It enables real-time camera tracking, improving the quality and continuity of video recording, reducing manual intervention, and enhancing the automation and quality of video acquisition.
Smart Images

Figure CN119729194B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of audio and video, and more specifically, to a video acquisition method, apparatus, and electronic device. Background Technology
[0002] In the current field of visual media, the camera is the core of the entire visual acquisition process, and its real-time setup and adjustment capabilities directly affect the output quality of media content. However, current camera adjustment methods primarily rely on manual adjustments by operators, which is not only time-consuming and labor-intensive, but also inefficient. Furthermore, adjustments to camera parameters often exhibit lag, preventing the camera settings from keeping pace with real-time changes in the target object. This results in visual content failing to accurately convey the target object's intent, thus impacting video quality. Additionally, when adjusting the camera direction using vision-following video acquisition methods, the adjustment is mainly based on the gaze signals received by sensors. However, these methods do not comprehensively consider all factors, preventing the camera from achieving real-time tracking and resulting in poor video capture quality.
[0003] There is currently no effective solution to the problem that cameras in related technologies cannot achieve real-time tracking and shooting, resulting in poor video shooting quality. Summary of the Invention
[0004] The main purpose of this application is to provide a video acquisition method, device, and electronic device to solve the problem that cameras in related technologies cannot achieve real-time follow-up shooting and the video shooting effect is poor.
[0005] To achieve the above objectives, according to one aspect of this application, a video acquisition method is provided. The method includes: during video acquisition using a camera, detecting whether a target object is within the camera's field of view; if the target object is within the field of view, acquiring the target object's line of sight direction; generating a control signal based on the line of sight direction, wherein the control signal at least indicates: the direction the camera needs to adjust, and the adjustment range, the direction including azimuth and / or pitch angle; and controlling the camera to adjust its direction according to the control signal, so that the camera acquires video along the line of sight direction.
[0006] Optionally, the method further includes: when the target object is not within the shooting range, acquiring the gaze signal of the target object through a sensor device; and adjusting the direction of the camera based on the gaze signal so that the target object is within the shooting range.
[0007] Optionally, generating a control signal based on the line of sight includes: detecting whether the camera is within a preset visual range of the target object; and generating a control signal based on the line of sight when the camera is within the preset visual range.
[0008] Optionally, generating a control signal based on the gaze direction includes: detecting whether the gaze direction of the target object has changed; if a change in the gaze direction is detected, obtaining the magnitude of the gaze change of the target object; and if the magnitude of the gaze change is greater than a preset magnitude, generating the control signal based on the changed gaze direction.
[0009] Optionally, when the direction includes an azimuth angle, generating a control signal based on the line-of-sight direction includes: determining the target azimuth angle of the line-of-sight direction of the target object in the horizontal direction, and the target pitch angle of the line-of-sight direction of the target object in the vertical direction; determining the azimuth angle difference between the target azimuth angle and the azimuth angle of the camera, and the pitch angle difference between the target pitch angle and the pitch angle of the camera; determining azimuth angle adjustment information of the camera based on the azimuth angle difference, wherein the azimuth angle adjustment information includes the azimuth angle adjustment direction and the azimuth angle adjustment magnitude; determining pitch angle adjustment information of the camera based on the pitch angle difference, wherein the pitch angle adjustment information includes the pitch angle adjustment direction and the pitch angle adjustment magnitude; and generating the control signal based on the azimuth angle adjustment information and / or the pitch angle adjustment information.
[0010] Optionally, generating the control signal based on the azimuth adjustment information and / or the pitch adjustment information includes: generating the control signal based on the azimuth adjustment information when the azimuth difference is greater than a preset first difference threshold and the pitch difference is less than or equal to a preset second difference threshold; or generating the control signal based on the pitch adjustment information when the azimuth difference is less than or equal to the preset first difference threshold and the pitch difference is greater than the preset second difference threshold; or generating the control signal based on the azimuth adjustment information and the pitch adjustment information when the azimuth difference is greater than the preset first difference threshold and the pitch difference is greater than the preset second difference threshold.
[0011] Optionally, generating a control signal based on the line of sight includes: acquiring distance information between the target object and the camera; generating the control signal based on the distance information and the line of sight, wherein the control signal further indicates the focal length that the camera needs to adjust, and the adjustment range of the focal length.
[0012] To achieve the above objectives, according to another aspect of this application, a video acquisition device is provided. The device includes: a detection module for detecting whether a target object is within the camera's field of view during video acquisition; an acquisition module for acquiring the target object's gaze direction when the target object is within the field of view; a generation module for generating a control signal based on the gaze direction, wherein the control signal at least indicates: the direction the camera needs to adjust, and the adjustment range, the direction including azimuth and / or pitch angle; and an acquisition module for controlling the camera to adjust its direction according to the control signal, so that the camera performs video acquisition along the gaze direction.
[0013] Optionally, the device further includes: a first acquisition submodule, configured to acquire the gaze signal of the target object through a sensor device when the target object is not within the shooting range; and a first adjustment submodule, configured to adjust the direction of the camera based on the gaze signal so that the target object is within the shooting range.
[0014] Optionally, the generation module includes: a first detection submodule, used to detect whether the camera is within a preset visual range of the target object; and a first generation submodule, used to generate a control signal based on the line of sight when the camera is within the preset visual range.
[0015] Optionally, the generation module includes: a second detection submodule, used to detect whether the gaze direction of the target object has changed; a first acquisition submodule, used to acquire the gaze change magnitude of the target object when the gaze direction is detected to have changed; and a second generation submodule, used to generate the control signal based on the changed gaze direction when the gaze change magnitude is greater than a preset magnitude.
[0016] Optionally, the generation module includes: a first determining submodule, configured to determine, when the direction includes an azimuth angle, the target azimuth angle of the target object's line of sight in the horizontal direction and the target pitch angle of the target object's line of sight in the vertical direction; a second determining submodule, configured to determine the azimuth angle difference between the target azimuth angle and the azimuth angle of the camera, and the pitch angle difference between the target pitch angle and the pitch angle of the camera; a third determining submodule, configured to determine the azimuth angle adjustment information of the camera based on the azimuth angle difference, wherein the azimuth angle adjustment information includes the azimuth angle adjustment direction and the azimuth angle adjustment magnitude; a fourth determining submodule, configured to determine the pitch angle adjustment information of the camera based on the pitch angle difference, wherein the pitch angle adjustment information includes the pitch angle adjustment direction and the pitch angle adjustment magnitude; and a third generating submodule, configured to generate the control signal based on the azimuth angle adjustment information and / or the pitch angle adjustment information.
[0017] Optionally, the third generation submodule includes: a fourth generation submodule, configured to generate the control signal based on the azimuth adjustment information when the azimuth difference is greater than a preset first difference threshold and the pitch difference is less than or equal to a preset second difference threshold; or a fifth generation submodule, configured to generate the control signal based on the pitch adjustment information when the azimuth difference is less than or equal to the preset first difference threshold and the pitch difference is greater than the preset second difference threshold; or a sixth generation submodule, configured to generate the control signal based on the azimuth adjustment information and the pitch adjustment information when the azimuth difference is greater than the preset first difference threshold and the pitch difference is greater than the preset second difference threshold.
[0018] Optionally, the generation module includes: a second acquisition submodule, used to acquire distance information between the target object and the camera; and a seventh generation submodule, used to generate the control signal based on the distance information and the line of sight, wherein the control signal is further used to indicate the focal length that the camera needs to adjust, and the adjustment range of the focal length.
[0019] In this embodiment, during video capture using a camera, it is detected whether a target object is within the camera's shooting range; if the target object is within the shooting range, the gaze direction of the target object is obtained; based on the gaze direction, a control signal is generated, wherein the control signal at least indicates: the direction the camera needs to adjust, and the adjustment range of the direction, the direction including azimuth and / or pitch angle; the camera is controlled to adjust its direction according to the control signal, so that the camera captures video along the gaze direction, achieving the purpose of automatically adjusting the camera direction through visual tracking during video capture, thereby realizing the technical effect of improving video capture quality while achieving real-time tracking capture, and thus solving the technical problem of poor video capture quality caused by the inability of the camera to achieve real-time tracking capture. Attached Figure Description
[0020] The accompanying drawings, which form part of this application, are used to provide a further understanding of this application. The illustrative embodiments and descriptions of this application are used to explain this application and do not constitute an undue limitation of this application. In the drawings:
[0021] Figure 1 A hardware structure block diagram of a computer terminal for implementing a video acquisition method is shown.
[0022] Figure 2 This is a flowchart of a video acquisition method according to an embodiment of this application;
[0023] Figure 3 This is a schematic diagram of a video capture device according to an embodiment of this application;
[0024] Figure 4 This is a schematic diagram of a video capture device according to an embodiment of this application. Detailed Implementation
[0025] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present application, and not all embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative effort should fall within the scope of protection of the present application.
[0026] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.
[0027] First, some nouns or terms that appear in the description of the embodiments of this application shall be interpreted as follows:
[0028] A sensor is a device or apparatus that can detect and sense a specified measurand and convert it into a usable signal (usually an electrical signal) according to a certain rule. It can convert non-electrical quantities (such as temperature, pressure, light intensity, and speed) into electrical quantities (such as voltage, current, and resistance) to facilitate subsequent signal processing and analysis. Sensors are widely used in industrial automation, environmental monitoring, medical equipment, and consumer electronics.
[0029] Azimuth angle is the angle of rotation of a line of sight on a horizontal plane, usually relative to the front, and is the angle of rotation to the left or right. In a two-dimensional coordinate system, azimuth angle can be expressed as the angle between the line segment from the positive x-axis (or true north) to the point where the line of sight intersects the horizontal plane and the positive x-axis (or true north).
[0030] The elevation angle describes the vertical rotation of the line of sight in the vertical plane, that is, the angle between the line of sight and the horizontal plane. When looking upwards, the elevation angle is positive; when looking downwards, the elevation angle is negative. In a three-dimensional coordinate system, the elevation angle can be expressed as the angle between the line segment from the line of sight to the horizontal plane and the line segment from the line of sight to the positive z-axis.
[0031] It should be noted that the information collected in this application (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for display, data used for analysis, etc.) are information and data authorized by the user or fully authorized by all parties. Furthermore, the collection, storage, use, processing, transmission, provision, disclosure, and application of this data all comply with relevant laws, regulations, and standards, necessary confidentiality measures have been taken, and they do not violate public order and good morals. Corresponding access points are provided for users to choose to authorize or refuse. For example, interfaces are set up between this system and relevant users or organizations, providing users with corresponding access points to choose to agree to or refuse automated decision-making results; if the user chooses to refuse, the process proceeds to the expert decision-making stage.
[0032] Example 1
[0033] According to an embodiment of this application, a method for video acquisition is provided. It should be noted that, in the appendix... Figure 1 The steps shown in the flowchart can be executed in a computer system such as a set of computer-executable instructions, and although a logical order is shown in the flowchart, in some cases the steps shown or described may be executed in a different order than that shown here.
[0034] The method embodiment provided in Embodiment 1 of this application can be executed on a mobile terminal, computer terminal, or similar computing device. Figure 1 A hardware block diagram of a computer terminal (or mobile device) for implementing a video acquisition method is shown. Figure 1 As shown, the computer terminal 10 (or mobile device) may include one or more processors 102 (shown as 102a, 102b, ..., 102n in the figure) 102 (processor 102 may include, but is not limited to, a microprocessor MCU or a programmable logic device FPGA, etc.), a memory 104 for storing data, and a transmission device 106 for communication functions. In addition, it may also include: a display, an input / output interface (I / O interface), a universal serial bus (USB) port (which may be included as one of the ports of a BUS bus), a network interface, a power supply, and / or a camera. Those skilled in the art will understand that... Figure 1 The structure shown is for illustrative purposes only and does not limit the structure of the aforementioned electronic device. For example, computer terminal 10 may also include... Figure 1 The more or fewer components shown, or having the same Figure 1 The different configurations shown.
[0035] It should be noted that the aforementioned one or more processors 102 and / or other data processing circuits are generally referred to herein as "data processing circuits". These data processing circuits may be embodied, in whole or in part, in software, hardware, firmware, or any other combination thereof. Furthermore, the data processing circuits may be a single, independent processing module, or may be integrated, in whole or in part, into any other element within the computer terminal 10 (or mobile device). As involved in the embodiments of this application, the data processing circuits serve as a processor control mechanism (e.g., selection of a variable resistor termination path connected to an interface).
[0036] The memory 104 can be used to store software programs and modules of application software, such as the program instructions / data storage device corresponding to the video acquisition method in this embodiment. The processor 102 executes various functional applications and data processing by running the software programs and modules stored in the memory 104, thereby realizing the above-mentioned video acquisition method. The memory 104 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 104 may further include memory remotely located relative to the processor 102, and these remote memories can be connected to the computer terminal 10 via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.
[0037] The transmission device 106 is used to receive or send data via a network. Specific examples of the network described above may include a wireless network provided by the communication provider of the computer terminal 10. In one example, the transmission device 106 includes a Network Interface Controller (NIC), which can connect to other network devices via a base station to communicate with the Internet. In another example, the transmission device 106 may be a Radio Frequency (RF) module, used for wireless communication with the Internet.
[0038] The display can be, for example, a touchscreen liquid crystal display (LCD) that allows the user to interact with the user interface of the computer terminal 10 (or mobile device).
[0039] Under the above operating environment, this application provides an optional video acquisition method. Figure 2 This is a flowchart of a video acquisition method according to an embodiment of this application, such as... Figure 2 As shown, the method includes the following steps:
[0040] Step S202: During the video capture process using the camera, detect whether the target object is within the camera's shooting range;
[0041] Optionally, a camera can continuously monitor target objects in the scene to detect whether they are within the camera's field of view. This is fundamental for all subsequent tracking, gaze detection, and direction control. The detection result directly determines whether subsequent steps are executed. For example, if the target object is within the camera's field of view, the camera will begin acquiring the target object's gaze direction; if the target object is outside the field of view, a specific process will be triggered. Continuous detection allows for timely responses to target object movements, ensuring rapid adaptation to changes in target position, which is crucial for maintaining the continuity and quality of video recording. Accurately detecting whether the target object is within the camera's field of view ensures the accuracy of video acquisition, thereby preventing the loss of critical information due to the target being out of sight. Furthermore, real-time detection capabilities ensure that the camera can track the target object in real time. Even if the target object briefly leaves the camera's field of view, the camera can quickly adjust to recapture the target, maintaining the continuity of video recording. In addition, accurate detection and rapid response to target objects can reduce the unpleasant experience of users "losing" targets when watching videos, improving the overall viewing experience and user satisfaction. Avoiding unnecessary camera orientation adjustments helps optimize the resource utilization of the video acquisition system, such as reducing unnecessary driver movements, lowering energy consumption, and reducing camera wear.
[0042] Step S204: When the target object is within the shooting range, obtain the direction of the target object's gaze;
[0043] Optionally, when the target object is within the camera's field of view, the target object's gaze direction can be acquired. This can be achieved, but is not limited to, acquiring the target object's gaze direction through computer vision techniques and algorithms (such as face recognition and eye tracking) to identify the target object's eyes and determine its gaze direction, which includes, but is not limited to, the direction and focus of the gaze.
[0044] Optionally, the acquired gaze direction information is crucial for generating control signals. Without accurate gaze direction, subsequent camera orientation adjustments will lose their target, resulting in poor video capture quality. Real-time detection and gaze direction acquisition also ensure that the camera system can respond instantly to changes in the target object's gaze, which is especially important for vision-tracking-based video capture, maintaining consistency between the video content and the target object's gaze.
[0045] In an optional embodiment, the method further includes: acquiring the gaze signal of the target object through a sensor device when the target object is not within the shooting range; and adjusting the direction of the camera based on the gaze signal so that the target object is within the shooting range.
[0046] Optionally, adjusting the camera direction when the target object is not within the shooting range ensures normal shooting of the target object. When the target object temporarily leaves the camera's shooting range, this embodiment uses sensor devices to collect the target object's gaze signal, enabling the detection and relocation of the missing target, ensuring the continuity and integrity of video acquisition. Furthermore, when faced with uncertainty in the target's position, this embodiment can self-correct using additional sensor information, avoiding interruptions or loss during video acquisition. This ensures that even when the target object is not in the field of view, the camera direction can be automatically detected and adjusted, reducing the need for manual intervention and making video acquisition more automated.
[0047] Step S206: Based on the line of sight, generate a control signal, wherein the control signal is used to indicate at least: the direction that the camera needs to be adjusted, and the adjustment range of the direction, the direction including azimuth angle and / or pitch angle;
[0048] Optionally, after obtaining the target object's gaze direction, a control signal can be generated based on that gaze direction. The control signal is an instruction for the camera to adjust its direction, including but not limited to the direction and magnitude of adjustment required, ensuring the camera accurately points to the target object's gaze focus. Even when the target object's gaze changes rapidly, the camera's direction can be quickly adjusted to capture the target object's focus, thereby improving the accuracy and quality of video acquisition. By analyzing the target object's gaze direction, the camera's azimuth and / or pitch angle adjustment needs are intelligently determined. The generated control signal includes parameters for direction and adjustment magnitude. This process requires precise settings to ensure rapid and accurate camera adjustment while avoiding image instability caused by over-adjustment. Through fine-grained control, the camera can maintain the optimal shooting angle, avoiding video quality problems caused by incorrect angles, such as blurred targets and scene edge distortion, enhancing the video's visual appeal and usability. Automated control reduces the need for manual adjustments by the operator, maintaining automatic camera tracking even in complex shooting environments, simplifying the operation process and improving video acquisition efficiency.
[0049] Optionally, control signals can be generated to automatically adjust the camera's direction and focal length based on the target object's line of sight and a pre-defined visual range. The camera receives the control signals through a driver and adjusts them accordingly, enabling the camera to follow the target object's line of sight in real time.
[0050] In one alternative embodiment, generating a control signal based on the line-of-sight direction includes: detecting whether the camera is within a preset visual range of the target object; and generating the control signal based on the line-of-sight direction if the camera is within the preset visual range.
[0051] Optionally, before generating the control signal, it can be detected whether the camera is within the preset visual range of the target object, serving as a pre-screening step for target object gaze tracking and camera adjustment. Setting the preset visual range helps limit the camera's adjustment range, avoiding frequent malfunctions when camera adjustments are unnecessary, while ensuring more reasonable and efficient camera adjustments. Limiting the camera's adjustment range optimizes resource utilization and avoids excessive power consumption and unnecessary wear on the driver, improving the overall efficiency and economy of video shooting. When the camera is detected to be within the preset visual range of the target object, generating a precise control signal based on the target object's gaze direction demonstrates accurate capture of the target object's gaze focus and ensures that the camera can intelligently adjust to optimally follow the target's gaze.
[0052] Optionally, the preset visual range can be flexibly adjusted according to specific application scenarios. This embodiment can adapt to both indoor environments and vast outdoor spaces. For example, the preset visual range can be set to the target object's line of sight within a 120-degree radius. This ensures that the camera effectively tracks within a reasonable range, enhancing the adaptability and flexibility of the video acquisition system.
[0053] In one optional embodiment, generating a control signal based on the gaze direction includes: detecting whether the gaze direction of the target object has changed; if a change in gaze direction is detected, obtaining the magnitude of the gaze change of the target object; if the magnitude of the gaze change is greater than a preset magnitude, generating a control signal based on the changed gaze direction.
[0054] Optionally, in this embodiment, by continuously detecting changes in the target object's gaze direction, the camera can quickly respond to dynamic changes in the target object's gaze, improving the camera's intelligent adaptive capability in following the target's gaze. When the gaze change is significant, control signals are generated and the camera direction is adjusted, thereby reducing the frequency of camera adjustments and avoiding unnecessary changes. By generating a control signal based on the new gaze direction when the target object's gaze changes and the change exceeds a preset value, it can be ensured that the control signal is generated based on the most effective gaze information at present, avoiding unnecessary camera adjustments. Setting a preset amplitude also provides a decision benchmark; a new control signal is only generated when the gaze change exceeds this threshold, which helps reduce frequent camera adjustments and avoids image jitter or instability during video acquisition.
[0055] Optionally, the preset visual range can be a 120-degree visual range around the target object. If the target object is within the visual range, a control signal is generated to adjust the camera's direction and focus; otherwise, no camera adjustment is made. By setting the visual range, the camera's adjustment range can be limited, avoiding frequent malfunctions when camera adjustments are not necessary.
[0056] In an optional embodiment, when the direction includes an azimuth angle, a control signal is generated based on the line-of-sight direction, including: determining the target azimuth angle of the target object's line-of-sight direction in the horizontal direction and the target pitch angle of the target object's line-of-sight direction in the vertical direction; determining the azimuth angle difference between the target azimuth angle and the camera's azimuth angle, and the pitch angle difference between the target pitch angle and the camera's pitch angle; determining azimuth angle adjustment information for the camera based on the azimuth angle difference, wherein the azimuth angle adjustment information includes the azimuth angle adjustment direction and the azimuth angle adjustment magnitude; determining pitch angle adjustment information for the camera based on the pitch angle difference, wherein the pitch angle adjustment information includes the pitch angle adjustment direction and the pitch angle adjustment magnitude; and generating a control signal based on the azimuth angle adjustment information and / or the pitch angle adjustment information.
[0057] Optionally, the horizontal angle difference between the target object's line of sight and the horizontal reference direction, i.e., the target azimuth angle, can be calculated based on the line-of-sight estimation results. The vertical angle difference between the target object's line of sight and the vertical reference direction, i.e., the target pitch angle, can also be calculated based on the line-of-sight estimation results. By determining the horizontal (azimuth angle) and vertical (pitch angle) changes in the target object's line of sight, this embodiment can accurately calculate the azimuth and pitch angles that the camera needs to adjust, thus more accurately following the target object's line of sight. Specifically, changes in the horizontal viewing angle can be directly converted into a horizontal angle adjustment signal for the camera pan / tilt unit or rotation mechanism, thereby adjusting the camera's azimuth angle. Changes in the vertical viewing angle can be converted into a vertical angle adjustment signal for the camera pan / tilt unit or rotation mechanism, thereby adjusting the camera's pitch angle. If the target object's line of sight is downward and the pitch angle with the camera exceeds a certain angle, it is considered that the pitch angle needs to be increased by a predetermined angle; if the target object's line of sight is upward and exceeds a certain angle, it is considered that the pitch angle needs to be decreased by a predetermined angle. The vertical angle difference between the target object's line of sight and the vertical reference direction, i.e., the target azimuth angle, is calculated based on the line-of-sight estimation results. By determining the azimuth and pitch differences, quantitative data can be provided for camera adjustments. This allows the system to determine the adjustment direction and magnitude based on the actual differences, thus enabling more precise video acquisition control. Based on the calculated azimuth and pitch adjustment information, specific control signals are generated to directly guide camera orientation adjustments. For example, changes in the horizontal viewing angle can be directly converted into a horizontal angle adjustment signal for the camera's pan / tilt or rotation mechanism, thereby adjusting the camera's azimuth and ensuring that the adjustment action matches changes in the target object's line of sight.
[0058] In one optional embodiment, generating a control signal based on azimuth adjustment information and / or pitch adjustment information includes: generating a control signal based on azimuth adjustment information when the azimuth difference is greater than a preset first difference threshold and the pitch difference is less than or equal to a preset second difference threshold; or generating a control signal based on pitch adjustment information when the azimuth difference is less than or equal to the preset first difference threshold and the pitch difference is greater than the preset second difference threshold; or generating a control signal based on both azimuth adjustment information and pitch adjustment information when the azimuth difference is greater than the preset first difference threshold and the pitch difference is greater than the preset second difference threshold.
[0059] Optionally, by setting a threshold for the difference between the azimuth and pitch angles, this embodiment can achieve precise control over the camera adjustment, avoid over-responding to minor changes, thereby optimizing the use of driver resources, reducing unnecessary energy consumption and wear, and enhancing the stability and responsiveness of the camera during target object visual tracking. Especially in scenarios where the target's line of sight changes rapidly, this embodiment can make adjustments more quickly and accurately.
[0060] Optionally, the process of adjusting the pitch angle can be achieved as follows: by detecting, identifying, and locating the target object, estimating the line of sight based on the position of the feature points, comparing the horizontal direction of the line of sight with the current azimuth angle of the camera, and calculating the azimuth angle; updating the line of sight direction estimation and azimuth angle adjustment in real time and providing feedback during the adjustment process; and correcting the parameters.
[0061] By adjusting the camera's horizontal direction individually when the target's line of sight changes significantly (azimuth), or adjusting the vertical direction when the vertical direction changes significantly (pitch), or adjusting both directions simultaneously when both changes are significant, the camera's orientation can be flexibly adjusted based on changes in the target's line of sight. Furthermore, adjusting the camera's azimuth or pitch angle accordingly when the difference in azimuth or pitch angle is large can avoid unnecessary adjustments and reduce adjustment frequency. Precisely controlling the separate adjustments of the camera's azimuth and pitch angles ensures that the camera accurately follows the target's line of sight, reducing video content deviation or instability caused by improper camera adjustments, thereby improving video acquisition quality and viewing experience.
[0062] Optionally, in complex environments with varying degrees of change in the target's line of sight, the priority of adjustments can be determined. For example, in scenarios where both camera azimuth and pitch angles need to be adjusted simultaneously, the magnitude of the azimuth and pitch angle differences can be used to determine whether to adjust the camera's azimuth or pitch angle first. For instance, if the azimuth angle difference is greater than the pitch angle difference, it indicates a larger azimuth deviation, and the camera's azimuth angle can be adjusted first; if the azimuth angle difference is less than the pitch angle difference, it indicates a larger pitch deviation, and the camera's pitch angle can be adjusted first. Through these methods, high-quality and continuous video capture can be maintained regardless of rapid horizontal movement or significant vertical changes.
[0063] In one optional embodiment, a control signal is generated based on the line-of-sight direction, including: acquiring distance information between the target object and the camera; and generating the control signal based on the distance information and the line-of-sight direction, wherein the control signal further indicates the focal length that the camera needs to adjust, and the adjustment range of the focal length.
[0064] Optionally, focal length adjustment is primarily used to change the camera's field of view and focusing distance, enabling clear capture of details of the target object's gaze or maintaining the target object's appropriate size in the frame. By simultaneously processing the target object's gaze direction and distance information, camera adjustment not only includes direction but also adjusts the focal length based on the target's distance, achieving more precise video capture. By calculating the distance between the target object and the camera, the adjustment range of the camera's focal length can be automatically determined, ensuring optimal focusing regardless of the target object's distance. In addition to direction adjustment, focal length adjustment also helps optimize the clarity of video capture, especially when the target object is moving rapidly or the camera's position changes significantly, maintaining image stability and clarity. In summary, automatically adjusting the focal length based on changes in the distance between the target object and the camera, and simultaneously adjusting the camera's direction and focal length, can generate control signals for simultaneous adjustment of both camera direction and focal length. This allows for focal length adjustment while capturing the area the target object is looking at, thereby maintaining optimal image quality.
[0065] Step S208: Adjust the camera's orientation according to the control signal so that the camera can capture video along the line of sight.
[0066] Optionally, the camera can receive generated control signals containing information about the direction and magnitude of camera adjustment. These abstract instructions are translated into concrete operations, adjusting the camera's azimuth and / or pitch angles by driving the camera's steering mechanism, ensuring the camera accurately aligns with the target object's line of sight. The dynamic adjustment function is a real-time response to changes in the target object's line of sight, ensuring the camera continuously adjusts its direction to capture the target object's visual focus. Even with minor or rapid changes in the target object's line of sight, the camera adjusts promptly to stay on track. Precise direction adjustment effectively avoids problems such as image jitter and target loss caused by untimely or inaccurate camera direction adjustment during video capture, ensuring continuous and high-quality video acquisition.
[0067] Optionally, when the camera angle changes, real-time gaze feedback can be provided to the operator via a small display screen or headphones. This feedback can include information such as the camera's angle, position, and current status, allowing the operator to understand and make necessary adjustments. After video recording, post-processing can be performed, such as video editing, image quality enhancement, and adding special effects, to further optimize the viewing experience. In practical applications, the camera system can be tested and debugged multiple times based on this embodiment to ensure its accuracy and stability. This may include, but is not limited to, testing the system's performance in different scenarios and adjusting parameters to achieve optimal results.
[0068] Based on the above embodiments and optional embodiments, this application proposes an implementation method for an optional video acquisition method, the method comprising:
[0069] Step S1, visual detection and tracking of the target object, specifically includes:
[0070] S11. During the video acquisition process, computer vision technology and algorithms (such as face recognition and eye tracking algorithms) are used to detect the gaze of the target object in real time in order to identify the eyes of the target object and determine the gaze direction of the target object, including the direction of the gaze and the focus.
[0071] S12, if the target object is detected to be outside the camera's shooting range, the gaze signal of the target object is collected by the sensor; the direction of the camera is adjusted based on the gaze signal so that the target object is within the camera's shooting range, and the gaze direction of the target object is determined based on the same processing method as in step S11.
[0072] Step S2, camera orientation control, specifically includes:
[0073] Based on the target object's line of sight and a pre-defined visual range, control signals are generated to automatically adjust the camera's direction and focal length. The camera receives control signals through a driver and adjusts them accordingly, enabling the camera to follow the target object's line of sight in real time.
[0074] Specifically, the preset visual range can be a 120-degree field of view of the target object. If the camera is within the visual range and the target object's line of sight, a control signal is generated to adjust the camera's direction and focus; otherwise, no adjustment is made. By setting the visual range, the camera's adjustment range can be limited, avoiding frequent malfunctions when camera adjustments are not necessary.
[0075] Step S3, camera dynamic angle adaptation, specifically includes:
[0076] Based on changes in the target subject's line of sight and shooting requirements, the camera's tilt and angles are automatically adjusted to ensure the optimal shooting angle is always achieved. This includes the following sub-steps:
[0077] S31, Set the corresponding adjustment rules, wherein the adjustment rules are used to indicate the correspondence between the changing direction of the target object's line of sight and the changing angle of the camera's pitch.
[0078] S32, based on the target object's line of sight change information and adjustment rules, determine whether the camera's elevation and depression angles need to be adjusted. For example, if the target object's line of sight is downward and the elevation angle with the camera exceeds a certain angle, it is considered that the elevation angle needs to be increased by a predetermined angle; if the target object's line of sight is upward and exceeds a certain angle, it is considered that the elevation angle needs to be decreased by a predetermined angle.
[0079] S33, based on the judgment result, adjust the camera's elevation and depression angles by controlling the camera's driver. This process can be achieved by sending control signals to the camera, which may include parameters such as the adjusted angle value and speed.
[0080] During video recording, the camera continuously captures video. A combination of dynamic angle adaptation and gaze feedback ensures that the captured content remains consistently high-quality.
[0081] Step S4, gaze feedback, specifically includes:
[0082] When the camera angle changes, the operator receives real-time gaze feedback via a small display screen or headphones. This feedback can include information such as the camera's angle, position, and current status, allowing the operator to understand and make necessary adjustments.
[0083] Step S5, post-processing, specifically includes:
[0084] After the video is filmed, some post-processing work may be required, such as video editing, enhancing image quality, and adding special effects, to further optimize the viewing experience.
[0085] Step S6, testing and debugging, specifically includes:
[0086] In practical applications, the camera system can be tested and debugged multiple times to ensure its accuracy and stability. This can include, but is not limited to, testing the system's performance in different scenarios and adjusting parameters to achieve optimal results.
[0087] This embodiment provides a video capture method based on visual tracking. It utilizes gaze and focus locking, and defines a visual range area to adapt to visual tracking, such as capturing video within a 120-degree visual range of the subject. During video capture, dynamic angle adaptation is performed, providing gaze feedback when the camera changes angles from different elevations or downward views. This improves the effectiveness of video capture based on visual tracking.
[0088] It should be noted that in this embodiment, normal shooting of the target object can be achieved by adjusting the camera direction when the target object is not within the shooting range; by setting a visual range area, the adjustment range of the camera can be limited, avoiding frequent malfunctions of the camera when no camera adjustment is needed; by generating control signals and adjusting the camera direction when the line of sight changes significantly, the frequency of camera adjustments can be reduced, avoiding unnecessary adjustments; by adjusting the azimuth angle of the camera to achieve horizontal and vertical movement of the camera lens when the target object's line of sight changes horizontally or vertically, the lens can be aligned with the target object's current line of sight; by adjusting the azimuth angle or pitch angle accordingly when the difference in azimuth angle or pitch angle is large, unnecessary adjustments can be avoided, reducing the frequency of adjustments; by automatically adjusting the focal length according to the change in distance between the target object and the camera, and simultaneously adjusting the camera direction and focal length, generating control signals for simultaneous adjustment of the camera direction and focal length, the camera focal length can be adjusted while capturing the area being looked at by the target object, thereby maintaining optimal image quality.
[0089] It should be noted that the video acquisition method provided in this application, during the video acquisition process using a camera, detects whether the target object is within the camera's shooting range; if the target object is within the shooting range, it acquires the target object's line of sight direction; based on the line of sight direction, it generates a control signal, wherein the control signal at least indicates: the direction the camera needs to adjust, and the adjustment range of the direction, the direction including azimuth angle and / or pitch angle; and controls the camera to adjust its direction according to the control signal, so that the camera can acquire video along the line of sight direction, thus solving the problem in related technologies where cameras cannot achieve real-time tracking shooting and the video shooting effect is poor. This achieves the goal of automatically adjusting the camera direction through visual tracking during video shooting, realizing the effect of improving video shooting quality while achieving real-time tracking shooting.
[0090] It should be noted that the steps shown in the flowchart in the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, and although a logical order is shown in the flowchart, in some cases the steps shown or described may be executed in a different order than that shown here.
[0091] Example 2
[0092] This application also provides a video capture device. It should be noted that the video capture device of this application can be used to execute the video capture method provided in this application. The video capture device provided in this application is described below.
[0093] According to an embodiment of this application, an apparatus for implementing the above-described video acquisition method is also provided, such as... Figure 3 As shown, the device includes: a detection module 300, used to detect whether a target object is within the camera's shooting range during video acquisition; an acquisition module 302, connected to the detection module 300, used to acquire the target object's line of sight when the target object is within the shooting range; a generation module 304, connected to the acquisition module 302, used to generate a control signal based on the line of sight, wherein the control signal at least indicates: the direction the camera needs to adjust, and the adjustment range of the direction, the direction including azimuth angle and / or pitch angle; and an acquisition module 306, connected to the generation module 304, used to control the camera to adjust its direction according to the control signal, so that the camera can acquire video along the line of sight.
[0094] The video capture device provided in this application embodiment includes a detection module 300 for detecting whether a target object is within the camera's shooting range during video capture; an acquisition module 302, connected to the detection module 300, for acquiring the target object's gaze direction when the target object is within the shooting range; a generation module 304, connected to the acquisition module 302, for generating a control signal based on the gaze direction, wherein the control signal at least indicates the direction the camera needs to adjust and the adjustment range, including azimuth and / or pitch angles; and a capture module 306, connected to the generation module 304, for controlling the camera to adjust its direction according to the control signal, so that the camera captures video along the gaze direction. This solves the problem in related technologies where cameras cannot achieve real-time tracking and the video capture effect is poor. It achieves the goal of automatically adjusting the camera direction through visual tracking during video capture, realizing real-time tracking while improving the video capture effect.
[0095] Optionally, the video acquisition device provided in this application embodiment further includes: a first acquisition submodule, used to acquire the gaze signal of the target object through a sensor device when the target object is not within the shooting range; and a first adjustment submodule, used to adjust the direction of the camera based on the gaze signal so that the target object is within the shooting range.
[0096] Optionally, in the video acquisition device provided in the embodiments of this application, the generation module includes: a first detection submodule, used to detect whether the camera is within a preset visual range of the target object; and a first generation submodule, used to generate a control signal based on the line of sight when the camera is within the preset visual range.
[0097] Optionally, in the video acquisition device provided in this application embodiment, the generation module further includes: a second detection submodule, used to detect whether the gaze direction of the target object has changed; a first acquisition submodule, used to acquire the gaze change amplitude of the target object when the gaze direction has changed; and a second generation submodule, used to generate a control signal based on the changed gaze direction when the gaze change amplitude is greater than a preset amplitude.
[0098] Optionally, in the video acquisition device provided in this application embodiment, the generation module includes: a first determining submodule, used to determine, when the direction includes azimuth, the target azimuth angle of the target object's line of sight in the horizontal direction and the target pitch angle of the target object's line of sight in the vertical direction; a second determining submodule, used to determine the azimuth angle difference between the target azimuth angle and the camera's azimuth angle, and the pitch angle difference between the target pitch angle and the camera's pitch angle; a third determining submodule, used to determine the camera's azimuth angle adjustment information based on the azimuth angle difference, wherein the azimuth angle adjustment information includes the azimuth angle adjustment direction and the azimuth angle adjustment magnitude; a fourth determining submodule, used to determine the camera's pitch angle adjustment information based on the pitch angle difference, wherein the pitch angle adjustment information includes the pitch angle adjustment direction and the pitch angle adjustment magnitude; and a third generating submodule, used to generate a control signal based on the azimuth angle adjustment information and / or the pitch angle adjustment information.
[0099] Optionally, in the video acquisition device provided in this application embodiment, the third generation submodule includes: a fourth generation submodule, used to generate a control signal based on azimuth adjustment information when the azimuth difference is greater than a preset first difference threshold and the pitch difference is less than or equal to a preset second difference threshold; or a fifth generation submodule, used to generate a control signal based on pitch adjustment information when the azimuth difference is less than or equal to a preset first difference threshold and the pitch difference is greater than a preset second difference threshold; or a sixth generation submodule, used to generate a control signal based on azimuth adjustment information and pitch adjustment information when the azimuth difference is greater than a preset first difference threshold and the pitch difference is greater than a preset second difference threshold.
[0100] Optionally, in the video acquisition device provided in this application embodiment, the generation module includes: a second acquisition submodule, used to acquire distance information between the target object and the camera; and a seventh generation submodule, used to generate a control signal based on the distance information and the line of sight, wherein the control signal is further used to indicate the focal length that the camera needs to adjust, and the adjustment range of the focal length.
[0101] It should be noted that the detection module 300, acquisition module 302, generation module 304, and collection module 306 mentioned above correspond to steps S202 to S208 in Embodiment 1. The modules and corresponding steps implement the same instances and application scenarios, but are not limited to the content disclosed in Embodiment 1. It should be noted that the above modules or units can be hardware or software components stored in memory (e.g., memory 104) and processed by one or more processors (e.g., processors 102a, 102b, ..., 102n). The above modules can also be part of a device and run in the computer terminal 10 provided in Embodiment 1.
[0102] Example 3
[0103] Embodiments of this application may provide an electronic device. Figure 4 This is a structural block diagram of an electronic device according to an embodiment of this application. Figure 4 As shown, the electronic device may include: one or more ( Figure 4 (Only one is shown) processor 1002, memory 1004, memory controller, and peripheral interface, wherein the peripheral interface is connected to the radio frequency module, audio module and display.
[0104] The memory can be used to store software programs and modules, such as the program instructions / modules corresponding to the methods and apparatus in the embodiments of this application. The processor executes various functional applications and data processing by running the software programs and modules stored in the memory, thereby implementing the above-described methods. The memory may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory may further include memory remotely located relative to the processor, and these remote memories can be connected to the terminal via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.
[0105] The processor can access information and applications stored in memory via a transmission device to perform the following steps: during video capture by the camera, detecting whether the target object is within the camera's shooting range; if the target object is within the shooting range, acquiring the target object's line of sight direction; generating a control signal based on the line of sight direction, wherein the control signal at least indicates: the direction the camera needs to adjust, and the adjustment range, the direction including azimuth and / or pitch angle; and controlling the camera to adjust its direction according to the control signal so that the camera captures video along the line of sight direction.
[0106] The processor can also call the information and application stored in the memory through the transmission device to perform the following steps: when the target object is not in the shooting range, acquire the gaze signal of the target object through the sensor device; adjust the direction of the camera based on the gaze signal so that the target object is in the shooting range.
[0107] The processor can also call the information and application stored in the memory through the transmission device to perform the following steps: detect whether the camera is within the preset visual range of the target object; if the camera is within the preset visual range, generate a control signal based on the direction of the line of sight.
[0108] The processor can also call the information and application program stored in the memory through the transmission device to perform the following steps: detect whether the gaze direction of the target object has changed; if the gaze direction has changed, obtain the magnitude of the gaze change of the target object; if the magnitude of the gaze change is greater than a preset magnitude, generate a control signal based on the changed gaze direction.
[0109] The processor can also invoke information and application programs stored in the memory via a transmission device to perform the following steps: determining the target azimuth angle of the target object's line of sight in the horizontal direction and the target pitch angle of the target object's line of sight in the vertical direction; determining the azimuth angle difference between the target azimuth angle and the camera azimuth angle, and the pitch angle difference between the target pitch angle and the camera pitch angle; determining the camera azimuth angle adjustment information based on the azimuth angle difference, wherein the azimuth angle adjustment information includes the azimuth angle adjustment direction and the azimuth angle adjustment magnitude; determining the camera pitch angle adjustment information based on the pitch angle difference, wherein the pitch angle adjustment information includes the pitch angle adjustment direction and the pitch angle adjustment magnitude; and generating a control signal based on the azimuth angle adjustment information and / or the pitch angle adjustment information.
[0110] The processor can also call the information and application program stored in the memory through the transmission device to perform the following steps: when the azimuth difference is greater than a preset first difference threshold and the pitch difference is less than or equal to a preset second difference threshold, generate a control signal based on the azimuth adjustment information; or when the azimuth difference is less than or equal to the preset first difference threshold and the pitch difference is greater than the preset second difference threshold, generate a control signal based on the pitch adjustment information; or when the azimuth difference is greater than the preset first difference threshold and the pitch difference is greater than the preset second difference threshold, generate a control signal based on the azimuth adjustment information and the pitch adjustment information.
[0111] The processor can also call the information and application stored in the memory through the transmission device to perform the following steps: obtain the distance information between the target object and the camera; generate a control signal based on the distance information and the line of sight, wherein the control signal is also used to indicate the focal length that the camera needs to adjust, and the adjustment range of the focal length.
[0112] This application provides a video capture scheme. During video capture using a camera, it detects whether the target object is within the camera's shooting range. If the target object is within the shooting range, it acquires the target object's line of sight. Based on the line of sight, a control signal is generated, wherein the control signal at least indicates: the direction the camera needs to adjust, and the adjustment range, including azimuth and / or pitch angles. The camera is controlled to adjust its direction according to the control signal, enabling it to capture video along the line of sight. This solves the problem in related technologies where cameras cannot achieve real-time tracking, resulting in poor video capture quality. It addresses the technical problem of poor video capture quality caused by the inability of cameras to achieve real-time tracking. Furthermore, it achieves the goal of automatically adjusting the camera's direction through visual tracking during video capture, realizing improved video capture quality while achieving real-time tracking.
[0113] Those skilled in the art will understand that Figure 4 The structure shown is for illustrative purposes only. Electronic devices can also be smartphones (such as Android phones, iOS phones, etc.), tablets, PDAs, mobile internet devices (MIDs), PADs, and other terminal devices. Figure 4 This does not limit the structure of the aforementioned electronic device. For example, electronic devices may also include components that are more... Figure 4 The more or fewer components shown (such as network interfaces, display devices, etc.), or having the same Figure 4 The different configurations shown.
[0114] Those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be implemented by a program instructing the hardware related to the terminal device. The program can be stored in a computer-readable storage medium, which may include: flash drive, read-only memory (ROM), random access memory (RAM), disk or optical disk, etc.
[0115] Example 4
[0116] Embodiments of this application also provide a storage medium. Optionally, in this embodiment, the storage medium can be used to store the program code executed by the video capture method provided in Embodiment 1.
[0117] Optionally, in this embodiment, the storage medium may be located in any computer terminal in a group of computer terminals in a computer network, or in any mobile terminal in a group of mobile terminals.
[0118] This application also provides a computer program product that, when executed on a data processing device, is adapted to perform video capture method steps.
[0119] The sequence numbers of the embodiments in this application are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.
[0120] In the above embodiments of this application, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments.
[0121] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. The device embodiments described above are merely illustrative; for example, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the displayed or discussed mutual coupling, direct coupling, or communication connection may be through some interfaces; the indirect coupling or communication connection between units or modules may be electrical or other forms.
[0122] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.
[0123] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.
[0124] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as a USB flash drive, read-only memory (ROM), random access memory (RAM), portable hard drive, magnetic disk, or optical disk.
[0125] The above description is only a preferred embodiment of this application. It should be noted that for those skilled in the art, several improvements and modifications can be made without departing from the principle of this application, and these improvements and modifications should also be considered within the scope of protection of this application.
Claims
1. A video capturing method, comprising: The method comprises: In the process of video acquisition by a camera, detecting whether a target object is in a shooting range of the camera; In the case that the target object is in the shooting range, acquiring a line-of-sight direction of the target object; Based on the line-of-sight direction, generating a control signal, wherein the control signal at least indicates that the camera needs to adjust a direction and an adjustment range of the direction, and the direction comprises an azimuth angle and / or a pitch angle; Controlling the camera to adjust the direction according to the control signal, so that the camera acquires video along the line-of-sight direction; The method further comprises: in the case that the target object is not in the shooting range, acquiring a line-of-sight signal of the target object by a sensor device; and adjusting the direction of the camera based on the line-of-sight signal, so that the target object is in the shooting range.
2. The method of claim 1, wherein, The method further comprises: Detecting whether the camera is in a preset visual range of the target object; In the case that the camera is in the preset visual range, generating the control signal based on the line-of-sight direction.
3. The method of claim 1, wherein, The method further comprises: Detecting whether the line-of-sight direction of the target object changes; In the case that the line-of-sight direction is detected to change, acquiring a line-of-sight change range of the target object; In the case that the line-of-sight change range is greater than a preset range, generating the control signal based on the changed line-of-sight direction.
4. The method of claim 1, wherein, In the case that the direction comprises an azimuth angle, the method further comprises: Determining a target azimuth angle of the line-of-sight direction of the target object in a horizontal direction, and a target pitch angle of the line-of-sight direction of the target object in a vertical direction; Determining an azimuth angle difference value between the target azimuth angle and an azimuth angle of the camera, and a pitch angle difference value between the target pitch angle and a pitch angle of the camera; Based on the azimuth angle difference value, determining azimuth angle adjustment information of the camera, wherein the azimuth angle adjustment information comprises an azimuth angle adjustment direction and an azimuth angle adjustment range; Based on the pitch angle difference value, determining pitch angle adjustment information of the camera, wherein the pitch angle adjustment information comprises a pitch angle adjustment direction and a pitch angle adjustment range; Based on the azimuth angle adjustment information and / or the pitch angle adjustment information, generating the control signal.
5. The method of claim 4, wherein, The method further comprises: In the case that the azimuth angle difference value is greater than a preset first difference threshold value, and the pitch angle difference value is less than or equal to a preset second difference threshold value, generating the control signal based on the azimuth angle adjustment information; or In the case that the azimuth angle difference value is less than or equal to the preset first difference threshold value, and the pitch angle difference value is greater than the preset second difference threshold value, generating the control signal based on the pitch angle adjustment information; or In a case where the azimuth angle difference is greater than the preset first difference threshold and the elevation angle difference is greater than the preset second difference threshold, the control signal is generated based on the azimuth angle adjustment information and the elevation angle adjustment information.
6. The method according to any one of claims 1 to 5, characterized in that, The control signal is generated based on the line-of-sight direction, and the method comprises: obtaining distance information between the target object and the camera; generating the control signal based on the distance information and the line-of-sight direction, wherein the control signal further indicates a focal length that needs to be adjusted by the camera and an adjustment range of the focal length.
7. A video capture device, comprising: The method comprises: detecting, by a detection module, whether a target object is within a shooting range of a camera during video acquisition by the camera; obtaining, by an obtaining module, a line-of-sight direction of the target object in a case where the target object is within the shooting range; generating, by a generation module, a control signal based on the line-of-sight direction, wherein the control signal at least indicates a direction that needs to be adjusted by the camera and an adjustment range of the direction, and the direction comprises an azimuth angle and / or an elevation angle; controlling, by an acquisition module, the camera to adjust the direction according to the control signal, so that the camera performs video acquisition along the line-of-sight direction; the device is further configured to, in a case where the target object is not within the shooting range, acquire a line-of-sight signal of the target object by a sensor device, and adjust the direction of the camera based on the line-of-sight signal, so that the target object is within the shooting range.
8. A computer-readable storage medium, characterized in that, The computer-readable storage medium comprises a stored executable program, wherein the computer-readable storage medium controls a device in which the computer-readable storage medium is located to execute the video acquisition method of any one of claims 1 to 6 when the executable program is executed.
9. An electronic device, comprising: The method comprises: a memory storing an executable program; a processor configured to execute the program, wherein the program is executed to perform the method of any one of claims 1 to 6.
Citation Information
Patent Citations
Photographing device and photographing method which can detect sight line of eyes
CN108200340A
Camera control method and device, equipment and storage medium
CN112118380A