Video acquisition method and device and electronic equipment

Abstract

The invention discloses a video acquisition method, a video acquisition device and electronic equipment. The method comprises the steps of detecting whether a target object is in a shooting range of a camera or not in a video acquisition process through the camera; under the condition that the target object is in the shooting range, acquiring the sight line direction of the target object; based on the sight line direction, a control signal is generated, the control signal is at least used for indicating the direction, needing to be adjusted, of the camera and the adjustment amplitude of the direction, and the direction comprises the azimuth angle and / or the pitch angle; and controlling the camera to perform direction adjustment according to the control signal, so that the camera performs video acquisition along the sight line direction. Through the method and the device, the problems that a camera cannot realize real-time follow-up shooting and the video shooting effect is poor in the prior art are solved.

Description

Technical Field

[0001] The present application relates to the field of audio and video, and more specifically, to a video acquisition method, device and electronic equipment. Background Art

[0002] In the current visual media field, the camera is the core of the entire visual acquisition process, and the real-time setting and adjustment capabilities of the camera directly affect the output quality of the media content. However, the camera adjustment method of the related art mainly relies on manual adjustment by the operator, which is not only time-consuming and labor-intensive, but also has low operating efficiency. In addition, the adjustment of camera parameters often has a lag, which makes the camera settings unable to keep up with the real-time changes of the target object, resulting in the visual content being unable to accurately express the intention of the target object, thereby affecting the quality of the video. In addition, when adjusting the camera direction based on the video acquisition method based on visual following, the camera direction is mainly adjusted based on the line of sight signal of the object received by the sensor. However, the above method does not take into account all factors, the camera cannot achieve real-time follow-up shooting, and the video shooting effect is poor.

[0003] With regard to the problem in related technologies that the camera cannot achieve real-time follow-up shooting and the video shooting effect is poor, no effective solution has been proposed yet. Summary of the invention

[0004] The main purpose of the present application is to provide a video acquisition method, device and electronic device to solve the problem in the related art that the camera cannot achieve real-time follow-up shooting and the video shooting effect is poor.

[0005] In order to achieve the above-mentioned purpose, according to one aspect of the present application, a video acquisition method is provided. The method comprises: in the process of video acquisition by a camera, detecting whether the target object is within the shooting range of the camera; when the target object is within the shooting range, obtaining the sight direction of the target object; based on the sight direction, generating a control signal, wherein the control signal is at least used to indicate: the direction that the camera needs to adjust, and the adjustment amplitude of the direction, the direction includes the azimuth angle and / or the pitch angle; according to the control signal, controlling the camera to adjust the direction so that the camera performs video acquisition along the sight direction.

[0006] Optionally, the method further includes: when the target object is not within the shooting range, collecting a sight signal of the target object by means of a sensor device; and adjusting the direction of the camera based on the sight signal so that the target object is within the shooting range.

[0007] Optionally, generating a control signal based on the line of sight direction includes: detecting whether the camera is within a preset visual range of the target object; and generating a control signal based on the line of sight direction when the camera is within the preset visual range.

[0008] Optionally, generating a control signal based on the line of sight direction includes: detecting whether the line of sight direction of the target object changes; when a change in the line of sight direction is detected, obtaining a change amplitude of the line of sight of the target object; when the line of sight change amplitude is greater than a preset amplitude, generating the control signal based on the changed line of sight direction.

[0009] Optionally, in the case where the direction includes an azimuth, generating a control signal based on the line of sight direction includes: determining a target azimuth of the line of sight direction of the target object in the horizontal direction, and a target pitch angle of the line of sight direction of the target object in the vertical direction; determining an azimuth difference between the target azimuth and the azimuth of the camera, and a pitch angle difference between the target pitch angle and the pitch angle of the camera; determining azimuth adjustment information of the camera based on the azimuth difference, wherein the azimuth adjustment information includes an azimuth adjustment direction and an azimuth adjustment amplitude; determining pitch adjustment information of the camera based on the pitch angle difference, wherein the pitch adjustment information includes a pitch adjustment direction and a pitch adjustment amplitude; generating the control signal based on the azimuth adjustment information and / or the pitch angle adjustment information.

[0010] Optionally, generating the control signal based on the azimuth adjustment information and / or the pitch angle adjustment information includes: generating the control signal based on the azimuth adjustment information when the azimuth difference is greater than a preset first difference threshold and the pitch angle difference is less than or equal to a preset second difference threshold; or generating the control signal based on the pitch angle adjustment information when the azimuth difference is less than or equal to a preset first difference threshold and the pitch angle difference is greater than a preset second difference threshold; or generating the control signal based on the azimuth adjustment information and the pitch angle adjustment information when the azimuth difference is greater than the preset first difference threshold and the pitch angle difference is greater than the preset second difference threshold.

[0011] Optionally, generating a control signal based on the line of sight direction includes: obtaining distance information between the target object and the camera; generating the control signal based on the distance information and the line of sight direction, wherein the control signal is also used to indicate a focal length of the camera that needs to be adjusted, and an adjustment range of the focal length.

[0012] In order to achieve the above-mentioned purpose, according to another aspect of the present application, a video acquisition device is provided. The device comprises: a detection module, which is used to detect whether a target object is within the shooting range of a camera during video acquisition by a camera; an acquisition module, which is used to acquire the sight direction of the target object when the target object is within the shooting range; a generation module, which is used to generate a control signal based on the sight direction, wherein the control signal is used to indicate at least: the direction in which the camera needs to be adjusted, and the adjustment amplitude of the direction, the direction including the azimuth angle and / or the pitch angle; and an acquisition module, which is used to control the camera to adjust the direction according to the control signal, so that the camera performs video acquisition along the sight direction.

[0013] Optionally, the device also includes: a first acquisition submodule, used to collect the line of sight signal of the target object through a sensor device when the target object is not within the shooting range; and a first adjustment submodule, used to adjust the direction of the camera based on the line of sight signal so that the target object is within the shooting range.

[0014] Optionally, the generation module includes: a first detection submodule, used to detect whether the camera is within a preset visual range of the target object; and a first generation submodule, used to generate a control signal based on the line of sight direction when the camera is within the preset visual range.

[0015] Optionally, the generation module includes: a second detection submodule, used to detect whether the line of sight direction of the target object has changed; a first acquisition submodule, used to acquire the line of sight change amplitude of the target object when a change in the line of sight direction is detected; and a second generation submodule, used to generate the control signal based on the changed line of sight direction when the line of sight change amplitude is greater than a preset amplitude.

[0016] Optionally, the generating module comprises: a first determining submodule, for determining, when the direction comprises an azimuth, a target azimuth of the sight line direction of the target object in the horizontal direction, and a target pitch angle of the sight line direction of the target object in the vertical direction; a second determining submodule, for determining an azimuth difference between the target azimuth and the azimuth of the camera, and a pitch angle difference between the target pitch angle and the pitch angle of the camera; a third determining submodule, for determining, based on the azimuth difference, azimuth adjustment information of the camera, wherein the azimuth adjustment information comprises an azimuth adjustment direction and an azimuth adjustment amplitude; a fourth determining submodule, for determining, based on the pitch angle difference, pitch adjustment information of the camera, wherein the pitch angle adjustment information comprises a pitch angle adjustment direction and a pitch angle adjustment amplitude; a third generating submodule, for generating the control signal based on the azimuth adjustment information and / or the pitch angle adjustment information.

[0017] Optionally, the third generating submodule includes: a fourth generating submodule, used to generate the control signal based on the azimuth adjustment information when the azimuth difference is greater than a preset first difference threshold and the pitch angle difference is less than or equal to a preset second difference threshold; or a fifth generating submodule, used to generate the control signal based on the pitch adjustment information when the azimuth difference is less than or equal to the preset first difference threshold and the pitch angle difference is greater than a preset second difference threshold; or a sixth generating submodule, used to generate the control signal based on the azimuth adjustment information and the pitch adjustment information when the azimuth difference is greater than the preset first difference threshold and the pitch angle difference is greater than the preset second difference threshold.

[0018] Optionally, the generation module includes: a second acquisition submodule, used to acquire the distance information between the target object and the camera; and a seventh generation submodule, used to generate the control signal based on the distance information and the line of sight direction, wherein the control signal is also used to indicate the focal length of the camera that needs to be adjusted, and the adjustment range of the focal length.

[0019] In an embodiment of the present application, during the process of video acquisition by a camera, it is detected whether the target object is within the shooting range of the camera; when the target object is within the shooting range, the line of sight direction of the target object is obtained; based on the line of sight direction, a control signal is generated, wherein the control signal is at least used to indicate: the direction in which the camera needs to be adjusted, and the adjustment amplitude of the direction, the direction including the azimuth and / or the pitch angle; the camera is controlled to adjust the direction according to the control signal so that the camera acquires video along the line of sight direction, thereby achieving the purpose of automatically adjusting the direction of the camera through visual following during the video shooting process, thereby achieving the technical effect of improving the video shooting effect while realizing real-time follow-up shooting, and further solving the technical problem of poor video shooting effect caused by the inability of the camera to realize real-time follow-up shooting. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The drawings constituting a part of the present application are used to provide a further understanding of the present application. The illustrative embodiments and descriptions of the present application are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0021] Figure 1 A hardware structure block diagram of a computer terminal for implementing a video acquisition method is shown;

[0022] Figure 2 is a flow chart of a video acquisition method according to an embodiment of the present application;

[0023] Figure 3 is a schematic diagram of a video acquisition device provided according to an embodiment of the present application;

[0024] Figure 4 It is a schematic diagram of a video acquisition device according to an embodiment of the present application. DETAILED DESCRIPTION

[0025] In order to enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of this application.

[0026] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0027] First, some nouns or terms that appear in the description of the embodiments of the present application are subject to the following explanations:

[0028] A sensor is a device or apparatus that can detect and sense a specified quantity and convert it into a usable signal (usually an electrical signal) according to a certain rule. It can convert non-electrical quantities (such as temperature, pressure, light intensity, speed, etc.) into electrical quantities (such as voltage, current, resistance, etc.) for subsequent signal processing and analysis. Sensors are widely used in industrial automation, environmental monitoring, medical equipment, consumer electronics and other fields.

[0029] Azimuth Angle refers to the angle of rotation of the line of sight on the horizontal plane, usually the angle of rotation to the left or right based on the front. In a two-dimensional coordinate system, the azimuth angle can be expressed as the angle between the positive x-axis (or due north) and the line segment from the positive x-axis (or due north) to the intersection of the line of sight and the horizontal plane.

[0030] The elevation angle is the angle between the line of sight and the horizontal plane. When looking up, the elevation angle is positive; when looking down, the elevation angle is negative. In a three-dimensional coordinate system, the elevation angle can be expressed as the angle between the line segment from the line of sight to the horizontal plane and the line segment from the line of sight to the positive z-axis.

[0031] It should be noted that the collected information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for display, data for analysis, etc.) involved in this application are information and data authorized by the user or fully authorized by all parties, and the collection, storage, use, processing, transmission, provision, disclosure and application of relevant data are in compliance with relevant laws, regulations and standards, necessary confidentiality measures are taken, and public order and good customs are not violated, and corresponding operation entrances are provided for users to choose to authorize or refuse. For example, an interface is set up between this system and relevant users or institutions to provide users with corresponding operation entrances for users to choose to agree or refuse the results of automated decision-making; if the user chooses to refuse, the expert decision-making process will be entered.

[0032] Example 1

[0033] According to an embodiment of the present application, a method embodiment of video acquisition is provided. It should be noted that in the attached Figure 1 The steps shown in the flowcharts may be executed in a computer system such as a set of computer-executable instructions, and although a logical order is shown in the flowcharts, in some cases the steps shown or described may be performed in an order different from that shown here.

[0034] The method embodiment provided in the first embodiment of the present application can be executed in a mobile terminal, a computer terminal or a similar computing device. Figure 1 FIG. 1 shows a hardware structure block diagram of a computer terminal (or mobile device) for implementing a video acquisition method. Figure 1 As shown, the computer terminal 10 (or mobile device) may include one or more (102a, 102b, ..., 102n are used to illustrate) processors 102 (the processor 102 may include but is not limited to a processing device such as a microprocessor MCU or a programmable logic device FPGA), a memory 104 for storing data, and a transmission device 106 for communication functions. In addition, it may also include: a display, an input / output interface (I / O interface), a universal serial bus (USB) port (which may be included as one of the ports of the BUS bus), a network interface, a power supply and / or a camera. It can be understood by those skilled in the art that Figure 1 The structure shown is only for illustration and does not limit the structure of the above electronic device. Figure 1 More or fewer components as shown, or with Figure 1 Different configurations are shown.

[0035] It should be noted that the one or more processors 102 and / or other data processing circuits described above may generally be referred to herein as "data processing circuits". The data processing circuits may be embodied in whole or in part as software, hardware, firmware, or any other combination thereof. In addition, the data processing circuit may be a single independent processing module, or may be incorporated in whole or in part into any of the other components in the computer terminal 10 (or mobile device). As described in the embodiments of the present application, the data processing circuit acts as a processor control (e.g., selection of a variable resistor terminal path connected to an interface).

[0036] The memory 104 can be used to store software programs and modules of application software, such as the program instructions / data storage device corresponding to the video acquisition method in the embodiment of the present application. The processor 102 executes various functional applications and data processing by running the software programs and modules stored in the memory 104, that is, the above-mentioned video acquisition method is realized. The memory 104 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include a memory remotely arranged relative to the processor 102, and these remote memories may be connected to the computer terminal 10 via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0037] The transmission device 106 is used to receive or send data via a network. The specific example of the above network may include a wireless network provided by a communication provider of the computer terminal 10. In one example, the transmission device 106 includes a network adapter (Network Interface Controller, NIC), which can be connected to other network devices through a base station so as to communicate with the Internet. In one example, the transmission device 106 can be a radio frequency (RF) module, which is used to communicate with the Internet wirelessly.

[0038] The display may be, for example, a touch screen liquid crystal display (LCD) that enables a user to interact with a user interface of the computer terminal 10 (or mobile device).

[0039] In the above operating environment, the present application provides an optional video acquisition method. Figure 2 is a flow chart of a video acquisition method according to an embodiment of the present application, such as Figure 2 As shown, the method comprises the following steps:

[0040] Step S202, during the process of video acquisition by the camera, detecting whether the target object is within the shooting range of the camera;

[0041] Optionally, the target object in the scene can be continuously monitored by the camera to detect whether the target object is within the camera's shooting range, which is the basis for all subsequent tracking, sight detection and direction control. The detection result directly determines whether the subsequent steps are executed or not. For example, if the target object is within the camera's shooting range, the sight direction of the target object will be obtained; if the target object is not within the shooting range, a specific process will be triggered. Through continuous detection, the movement of the target object can be responded to in a timely manner to ensure that the target position can be quickly adapted to changes, which is crucial to maintaining the continuity and quality of video shooting. By accurately detecting whether the target object is within the camera's shooting range, the accuracy of video acquisition is ensured, thereby avoiding the loss of key information due to the target being out of sight. In addition, the real-time detection capability can ensure that the camera can track the target object in real time. Even if the target object temporarily leaves the camera's field of view, the camera can quickly adjust to recapture the target and maintain the continuity of video shooting. In addition, through accurate detection and rapid response to the target object, the unpleasant experience of "losing" the target that users may encounter when watching the video can be reduced, improving the overall viewing and user satisfaction of the video. By avoiding unnecessary camera orientation adjustments, it helps optimize the resource utilization of the video acquisition system, such as reducing unnecessary actuator movements, lowering energy consumption, and reducing camera wear.

[0042] Step S204, when the target object is within the shooting range, obtaining the sight direction of the target object;

[0043] Optionally, when the target object is within the shooting range of the camera, the sight direction of the target object can be obtained. The sight direction of the target object can be obtained by, but is not limited to, computer vision technology and algorithms (such as face recognition, eye tracking) to identify the eyes of the target object and determine the sight direction of the target object, wherein the sight direction includes but is not limited to the direction and focus of the gaze.

[0044] Optionally, the acquired gaze direction information is an important basis for generating control signals. Without accurate gaze direction, subsequent camera direction adjustment will lose the target, resulting in poor video acquisition. Real-time detection and gaze direction acquisition can also ensure that the camera system can respond to changes in the gaze of the target object in real time, which is particularly important for video acquisition based on visual tracking, and can maintain the consistency of the video content with the gaze of the target object.

[0045] In an optional embodiment, the method further includes: when the target object is not within the shooting range, collecting a sight line signal of the target object through a sensor device; and adjusting the direction of the camera based on the sight line signal so that the target object is within the shooting range.

[0046] Optionally, the direction of the camera can be adjusted when the target object is not within the shooting range to ensure normal shooting of the target object. When the target object temporarily leaves the shooting range of the camera, the present embodiment collects the sight signal of the target object through the sensor device to detect and relocate the missing target, thereby ensuring the continuity and integrity of the video acquisition. In addition, when faced with uncertainty in the target position, the present embodiment can perform self-correction through additional sensor information to avoid interruption or loss during the video acquisition process. This ensures that even when the target object is not in the field of view, the direction of the camera can be automatically detected and adjusted, reducing the need for manual intervention and making video acquisition more automated.

[0047] Step S206, generating a control signal based on the line of sight direction, wherein the control signal is used to indicate at least: the direction in which the camera needs to be adjusted, and the adjustment amplitude of the direction, the direction including the azimuth angle and / or the pitch angle;

[0048] Optionally, after obtaining the sight direction of the target object, a control signal can be generated based on the sight direction. The control signal is an instruction for the camera to adjust the direction, including but not limited to the direction in which the camera needs to be adjusted and the adjustment amplitude, so as to ensure that the camera can accurately point to the sight focus of the target object. Even when the sight of the target object changes rapidly, the direction of the camera can be quickly adjusted to capture the focus of the target object, thereby improving the accuracy and effect of video acquisition. By analyzing the sight direction of the target object, the adjustment requirements of the azimuth and / or pitch angle of the camera are intelligently judged, and the generated control signal contains the parameters of the direction and adjustment amplitude. This process requires precise setting to ensure that the adjustment of the camera is fast and accurate, while avoiding the instability of the picture caused by excessive adjustment. Through fine control, the camera can maintain shooting at the best angle, avoid video quality problems caused by incorrect angles, such as target blur, scene marginalization, etc., and enhance the viewing and practicality of the video. Automated control can reduce the need for manual adjustment by the operator, and can maintain automatic tracking of the camera even in complex shooting environments, simplify the operation process, and improve the efficiency of video acquisition.

[0049] Optionally, a control signal can be generated to automatically adjust the direction and focal length of the camera according to the line of sight of the target object and a preset visual range area, wherein the control signal is received by a driver and the camera is adjusted based on the control signal so that the camera can follow the line of sight of the target object in real time.

[0050] In an optional embodiment, generating a control signal based on the line of sight direction includes: detecting whether the camera is within a preset visual range of the target object; and generating a control signal based on the line of sight direction when the camera is within the preset visual range.

[0051] Optionally, before generating a control signal, it is possible to detect whether the camera is within the preset visual range of the target object, as a pre-screening for tracking the target object's line of sight and adjusting the camera. The setting of the preset visual range helps to limit the adjustment range of the camera, avoiding frequent misoperation of the camera when no camera adjustment is required, while ensuring that the adjustment action of the camera is more reasonable and efficient. By limiting the adjustment range of the camera, resource utilization can be optimized, excessive power consumption and unnecessary wear of the driver can be avoided, and the overall efficiency and economy of the camera for video shooting can be improved. When it is detected that the camera is within the preset visual range of the target object, an accurate control signal is generated according to the line of sight direction of the target object, which can reflect the accurate capture of the line of sight focus of the target object, and can also ensure that the camera can be intelligently adjusted to follow the target line of sight in the optimal state.

[0052] Optionally, the preset visual range can be flexibly adjusted according to specific application scenarios, and this embodiment can adapt to both indoor environments and outdoor wide spaces. For example, the preset visual range can be set to within a 120-degree visual range of the target object. This ensures that the camera can effectively track within a reasonable range, and enhances the adaptability and flexibility of the video acquisition system.

[0053] In an optional embodiment, a control signal is generated based on the line of sight direction, including: detecting whether the line of sight direction of the target object changes; when a change in the line of sight direction is detected, obtaining the change amplitude of the line of sight of the target object; when the line of sight change amplitude is greater than a preset amplitude, generating a control signal based on the changed line of sight direction.

[0054] Optionally, in this embodiment, by continuously detecting changes in the line of sight direction of the target object, the camera can respond quickly to dynamic changes in the line of sight of the target object, thereby improving the intelligent adaptability of the camera to follow the target line of sight. When the line of sight changes by a large amplitude, the control signal is generated and the camera direction is adjusted, thereby reducing the frequency of camera adjustment and avoiding unnecessary adjustments. By generating a control signal based on the new line of sight direction when the line of sight of the target object changes and the amplitude of the change exceeds a preset value, it can be ensured that the generation of the control signal is based on the most effective line of sight information at the moment, avoiding unnecessary camera adjustments. Setting a preset amplitude can also provide a decision-making benchmark. Only when the amplitude of the line of sight change exceeds this threshold will a new control signal be generated, which helps to reduce frequent adjustments of the camera and avoid image jitter or instability during video acquisition.

[0055] Optionally, the pre-set visual range area can be within the 120-degree visual range of the target object; if it is within the visual range area, a control signal is generated to adjust the direction and focal length of the camera; if it is not, the camera is not adjusted. By setting the visual range area, the adjustment range of the camera can be limited to avoid frequent malfunctions of the camera when no camera adjustment is required.

[0056] In an optional embodiment, when the direction includes an azimuth, a control signal is generated based on the line of sight direction, including: determining a target azimuth of the line of sight of the target object in the horizontal direction, and a target pitch angle of the line of sight of the target object in the vertical direction; determining an azimuth difference between the target azimuth and the azimuth of the camera, and a pitch difference between the target pitch angle and the pitch angle of the camera; determining azimuth adjustment information of the camera based on the azimuth difference, wherein the azimuth adjustment information includes an azimuth adjustment direction and an azimuth adjustment amplitude; determining pitch adjustment information of the camera based on the pitch difference, wherein the pitch adjustment information includes a pitch adjustment direction and a pitch adjustment amplitude; and generating a control signal based on the azimuth adjustment information and / or the pitch adjustment information.

[0057] Optionally, the horizontal angle difference between the sight line direction of the target object and the horizontal reference direction, i.e., the target azimuth, can be calculated based on the result of the sight line estimation. The vertical angle difference between the sight line direction of the target object and the vertical reference direction, i.e., the target pitch angle, can be calculated based on the result of the sight line estimation. By determining the horizontal (azimuth) and vertical (pitch angle) changes of the sight line direction of the target object, the present embodiment can accurately calculate the azimuth and pitch angle that the camera needs to adjust to more accurately follow the sight line of the target object. Specifically, the change in the viewing angle in the horizontal direction can be directly converted into a horizontal angle adjustment signal of the camera pan or rotating mechanism, thereby adjusting the azimuth of the camera. The change in the viewing angle in the vertical direction can be converted into a vertical angle adjustment signal of the camera pan or rotating mechanism to adjust the pitch angle of the camera. If the sight line of the target object is downward and the elevation angle with the camera exceeds a certain angle, it is considered that the elevation angle needs to be increased by a predetermined angle; if the sight line of the target object is upward by more than a certain angle, it is considered that the elevation angle needs to be reduced by a predetermined angle. The vertical angle difference between the sight line direction of the target object and the vertical reference direction, i.e., the target azimuth, is calculated based on the result of the sight line estimation. By determining the azimuth difference and the pitch difference, a quantitative basis can be provided for the adjustment of the camera, so that the system can determine the adjustment direction and amplitude according to the actual difference, thereby achieving more precise video acquisition control. Based on the calculated azimuth adjustment information and pitch adjustment information, a specific control signal is generated, which can directly guide the camera to adjust the direction. For example, the change in the horizontal viewing angle can be directly converted into a horizontal angle adjustment signal of the camera pan or rotation mechanism, thereby adjusting the azimuth of the camera, thereby ensuring that the adjustment action matches the change in the line of sight of the target object.

[0058] In an optional embodiment, a control signal is generated based on the azimuth adjustment information and / or the pitch angle adjustment information, including: when the azimuth angle difference is greater than a preset first difference threshold and the pitch angle difference is less than or equal to a preset second difference threshold, a control signal is generated based on the azimuth adjustment information; or when the azimuth angle difference is less than or equal to the preset first difference threshold and the pitch angle difference is greater than the preset second difference threshold, a control signal is generated based on the pitch angle adjustment information; or when the azimuth angle difference is greater than the preset first difference threshold and the pitch angle difference is greater than the preset second difference threshold, a control signal is generated based on the azimuth adjustment information and the pitch angle adjustment information.

[0059] Optionally, this embodiment can achieve precise control of camera adjustment by setting difference thresholds of azimuth and pitch angles, avoid excessive response to small changes, thereby optimizing the use of driver resources, reducing unnecessary energy consumption and wear, and enhancing the stability and responsiveness of the camera during visual tracking of target objects. Especially in scenarios where the target's line of sight changes rapidly, this embodiment can make adjustments more quickly and accurately.

[0060] Optionally, the process of adjusting the pitch angle can be achieved in the following ways: by detecting, identifying and locating the target object, estimating the line of sight based on the position of the feature points, comparing the horizontal direction of the line of sight with the current azimuth of the camera, and calculating the azimuth; updating the line of sight direction estimation and azimuth adjustment in real time during the adjustment process and providing feedback; and correcting the parameters.

[0061] By adjusting the horizontal direction of the camera alone when the horizontal direction of the target's line of sight changes significantly (azimuth), or adjusting the vertical direction when the vertical direction changes significantly (pitch angle), or adjusting both the horizontal and vertical directions when both changes are significant, the camera direction can be flexibly adjusted based on the target's line of sight changes. In addition, when the azimuth difference or the pitch angle difference is large, the corresponding adjustment of the camera's azimuth or pitch angle can also avoid unnecessary adjustments and reduce the frequency of adjustments. By accurately controlling the adjustment of the camera's azimuth and pitch angles separately, it can also ensure that the camera can accurately follow the line of sight of the target object, reduce the offset or instability of the video content caused by improper camera adjustment, and thus improve the quality of video acquisition and viewing experience.

[0062] Optionally, in a complex environment where the target line of sight changes by different magnitudes, the priority of adjustment can also be determined. For example, in a scenario where both the azimuth and pitch angles of the camera need to be adjusted at the same time, the size of the azimuth difference and the pitch difference can be used to determine whether to adjust the azimuth of the camera first or the pitch angle of the camera first. For example, when the azimuth difference is greater than the pitch difference, it indicates that the azimuth deviation is greater, and the azimuth of the camera can be adjusted first; when the azimuth difference is less than the pitch difference, it indicates that the pitch deviation is greater, and the pitch angle of the camera can be adjusted first. In the above manner, high quality and continuity of video acquisition can be maintained regardless of rapid horizontal movement or large vertical changes.

[0063] In an optional embodiment, a control signal is generated based on the line of sight direction, including: obtaining distance information between the target object and the camera; generating a control signal based on the distance information and the line of sight direction, wherein the control signal is also used to indicate the focal length of the camera that needs to be adjusted, and the adjustment range of the focal length.

[0064] Optionally, the adjustment of the focal length is mainly used to change the field of view and the focusing distance of the camera, so that the details of the target object's gaze can be clearly captured or the target object can be kept at an appropriate size in the picture. By simultaneously processing the sight direction information and distance information of the target object, the adjustment of the camera not only includes the direction, but also can adjust the focal length according to the distance of the target, so as to achieve more accurate video acquisition. By calculating the distance between the target object and the camera, the adjustment range of the camera focal length can be automatically determined to ensure that the best focusing effect can be maintained regardless of the distance of the target object. On the basis of the direction adjustment, the adjustment of the focal length can also help optimize the clarity of the video acquisition, especially when the target object moves quickly or the position of the camera changes greatly, the picture can be kept stable and clear. In summary, according to the change in the distance between the target object and the camera, the focal length is automatically adjusted, and the camera direction and focal length are adjusted simultaneously. A control signal for the simultaneous adjustment of the camera direction and focal length can be generated, and the camera focal length can be adjusted while capturing the area where the target object is looking at, thereby maintaining the best image quality.

[0065] Step S208: Control the camera to adjust its direction according to the control signal so that the camera can capture video along the line of sight.

[0066] Optionally, the camera can receive generated control signals, which contain information about the direction in which the camera needs to be adjusted and the amplitude of the adjustment. These abstract instructions are converted into specific operations, and the azimuth and / or pitch angle of the camera are adjusted by driving the steering mechanism of the camera to ensure that the camera can accurately align with the line of sight of the target object. The dynamic adjustment function is a real-time response based on the change of the line of sight direction of the target object, which can ensure that the camera can continuously adjust its direction to capture the visual focus of the target object. Even if the line of sight direction of the target object changes slightly or rapidly, the camera can adjust in time to keep up with the target object. Through precise direction adjustment, problems such as image jitter and target loss caused by untimely or inaccurate camera direction adjustment during video acquisition can be effectively avoided, ensuring the continuity and high quality of video acquisition.

[0067] Optionally, when the angle of the camera changes, the operator is given real-time gaze feedback through a small display screen or headphones, etc. The feedback may include information such as the angle, position and current state of the camera, so that the operator can understand and make necessary adjustments. After the video is shot, some post-processing work can be performed, such as video editing, enhancing image quality, adding special effects, etc., to further optimize the video viewing experience. In practical applications, the camera system can also be tested and debugged multiple times based on this embodiment to ensure its accuracy and stability. It can include, but is not limited to, testing the performance of the system in different scenarios, adjusting parameters to obtain the best effect, etc.

[0068] Based on the above embodiments and optional embodiments, the present application proposes an optional implementation of a video acquisition method, which includes:

[0069] Step S1, visual detection and tracking of the target object, specifically includes:

[0070] S11, during the video acquisition process, use computer vision technology and algorithms (such as face recognition, eye tracking algorithm) to detect the line of sight of the target object in real time to identify the eyes of the target object and determine the line of sight of the target object, wherein the line of sight direction includes the direction and focus of the gaze.

[0071] S12, if it is detected that the target object is not within the shooting range of the camera, the line of sight signal of the target object is collected through the sensor; the direction of the camera is adjusted based on the line of sight signal so that the target object is within the shooting range of the camera, and the line of sight direction of the target object is determined based on the same processing method as step S11.

[0072] Step S2, camera direction control, specifically includes:

[0073] According to the line of sight of the target object and the preset visual range area, a control signal is generated to automatically adjust the direction and focal length of the camera, wherein the control signal is received by the driver, and the camera is adjusted based on the control signal, so that the camera can follow the line of sight of the target object in real time.

[0074] Specifically, the pre-set visual range area can be within the 120-degree visual range of the target object; if the camera in the direction of the target object's sight is within the visual range area, a control signal is generated to adjust the direction and focal length of the camera; if not, the camera is not adjusted. By setting the visual range area, the adjustment range of the camera can be limited to avoid frequent misoperation of the camera when no camera adjustment is required.

[0075] Step S3, camera dynamic angle adaptation, specifically includes:

[0076] According to the changes in the line of sight of the target object and the shooting requirements, the camera's elevation and depression angles are automatically adjusted to ensure that the best shooting angle is always obtained. The specific steps include the following:

[0077] S31, setting a corresponding adjustment rule, wherein the adjustment rule is used to indicate the corresponding relationship between the change direction of the sight line of the target object and the change of the pitch angle of the camera.

[0078] S32, based on the target object's line of sight direction change information and adjustment rules, determine whether the camera's elevation and depression angles need to be adjusted. For example, if the target object's line of sight is downward and the elevation angle with the camera exceeds a certain angle, it is considered necessary to increase the elevation angle by a predetermined angle; if the target object's line of sight is upward by more than a certain angle, it is considered necessary to reduce the elevation angle by a predetermined angle.

[0079] S33, according to the judgment result, by controlling the driver of the camera, adjusting the elevation angle and depression angle of the camera, this process can be achieved by sending a control signal to the camera, and the control signal can include parameters such as the adjusted angle value and speed.

[0080] During the video shooting process, the camera continues to shoot video, and through the combination of dynamic angle adaptation and gaze feedback, it ensures that the captured content always maintains high quality.

[0081] Step S4, gaze feedback, specifically includes:

[0082] When the angle of the camera changes, the operator is given real-time gaze feedback through devices such as a small display or headphones. The feedback can include information such as the angle, position and current status of the camera so that the operator can understand and make necessary adjustments.

[0083] Step S5, post-processing, specifically includes:

[0084] After the video is shot, some post-processing may be required, such as video editing, enhancing image quality, adding special effects, etc., to further optimize the video viewing experience.

[0085] Step S6, testing and debugging, specifically includes:

[0086] In actual applications, the camera system can also be tested and debugged multiple times to ensure its accuracy and stability. This can include, but is not limited to, testing the performance of the system in different scenarios, adjusting parameters to achieve the best results, etc.

[0087] This embodiment provides a video acquisition method based on visual tracking, which adapts visual tracking by gazing and locking focus, and setting a visual range area, for example, video shooting is performed within the 120-degree visual range of the person being watched; dynamic angle adaptation is performed during video shooting, and for different elevation angles of the downward lens, when the operator changes the lens, gaze feedback is given. This improves the effect of video shooting based on visual tracking.

[0088] It should be noted that, in this embodiment, by adjusting the direction of the camera when the target object is not within the shooting range, normal shooting of the target object can be achieved; by setting the visual range area, the adjustment range of the camera can be limited, and frequent malfunctions of the camera when no camera adjustment is required can be avoided; by generating a control signal and adjusting the direction of the camera when the line of sight changes greatly, the frequency of camera adjustment can be reduced and unnecessary adjustments can be avoided; by adjusting the azimuth of the camera when the line of sight of the target object changes in the horizontal direction or the vertical direction, the horizontal and vertical movements of the camera lens can be achieved, and the lens can be aligned with the current line of sight direction of the target object; by making corresponding adjustments to the azimuth or pitch angle of the camera when the azimuth difference or the pitch angle difference is large, unnecessary adjustments can be avoided and the frequency of adjustments can be reduced; by automatically adjusting the focal length according to the change in the distance between the target object and the camera, adjusting the camera direction and focal length simultaneously, and generating a control signal for adjusting the camera direction and focal length simultaneously, the focal length of the camera can be adjusted while capturing the area that the target object is looking at, thereby maintaining the best image quality.

[0089] It should be noted that the video acquisition method provided in the embodiment of the present application detects whether the target object is within the shooting range of the camera during the process of video acquisition by the camera; when the target object is within the shooting range, the sight direction of the target object is obtained; based on the sight direction, a control signal is generated, wherein the control signal is at least used to indicate: the direction in which the camera needs to be adjusted, and the adjustment amplitude of the direction, the direction includes the azimuth and / or the pitch angle; the camera is controlled to adjust the direction according to the control signal, so that the camera performs video acquisition along the sight direction, which solves the problem that the camera cannot achieve real-time follow-up shooting and the video shooting effect is poor in the related technology. Thus, the purpose of automatically adjusting the direction of the camera through visual following during the video shooting process is achieved, and the effect of improving the video shooting effect while achieving real-time follow-up shooting is achieved.

[0090] It should be noted that the steps shown in the flowcharts of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and that, although a logical order is shown in the flowcharts, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0091] Example 2

[0092] The embodiment of the present application also provides a video acquisition device. It should be noted that the video acquisition device of the embodiment of the present application can be used to execute the video acquisition method provided by the embodiment of the present application. The video acquisition device provided by the embodiment of the present application is introduced below.

[0093] According to an embodiment of the present application, a device for implementing the above-mentioned video acquisition method is also provided, such as Figure 3 As shown, the device includes: a detection module 300, which is used to detect whether the target object is within the shooting range of the camera during video acquisition through the camera; an acquisition module 302, which is connected to the detection module 300, and is used to acquire the sight line direction of the target object when the target object is within the shooting range; a generation module 304, which is connected to the acquisition module 302, and is used to generate a control signal based on the sight line direction, wherein the control signal is used to indicate at least: the direction in which the camera needs to be adjusted, and the adjustment amplitude of the direction, the direction including the azimuth and / or the pitch angle; an acquisition module 306, which is connected to the generation module 304, and is used to control the camera to adjust the direction according to the control signal, so that the camera acquires video along the sight line direction.

[0094] The video acquisition device provided in the embodiment of the present application is provided with a detection module 300, which is used to detect whether the target object is within the shooting range of the camera during the process of video acquisition through the camera; the acquisition module 302 is connected to the detection module 300, and is used to obtain the sight direction of the target object when the target object is within the shooting range; the generation module 304 is connected to the acquisition module 302, and is used to generate a control signal based on the sight direction, wherein the control signal is at least used to indicate: the direction that the camera needs to adjust, and the adjustment amplitude of the direction, and the direction includes the azimuth and / or the pitch angle; the acquisition module 306 is connected to the generation module 304, and is used to control the camera to adjust the direction according to the control signal, so that the camera performs video acquisition along the sight direction, which solves the problem that the camera cannot achieve real-time follow-up shooting and the video shooting effect is poor in the related art. Then, the purpose of automatically adjusting the direction of the camera through visual following during the video shooting process is achieved, and the effect of improving the video shooting effect while achieving real-time follow-up shooting is achieved.

[0095] Optionally, the video acquisition device provided in the embodiment of the present application also includes: a first acquisition sub-module, used to collect the line of sight signal of the target object through a sensor device when the target object is not within the shooting range; and a first adjustment sub-module, used to adjust the direction of the camera based on the line of sight signal so that the target object is within the shooting range.

[0096] Optionally, in the video acquisition device provided in the embodiment of the present application, the generation module includes: a first detection submodule, used to detect whether the camera is within a preset visual range of the target object; and a first generation submodule, used to generate a control signal based on the line of sight direction when the camera is within the preset visual range.

[0097] Optionally, in the video acquisition device provided in the embodiment of the present application, the generation module also includes: a second detection submodule, used to detect whether the line of sight direction of the target object has changed; a first acquisition submodule, used to acquire the line of sight change amplitude of the target object when a change in the line of sight direction is detected; and a second generation submodule, used to generate a control signal based on the changed line of sight direction when the line of sight change amplitude is greater than a preset amplitude.

[0098] Optionally, in the video acquisition device provided in the embodiment of the present application, the generation module includes: a first determination submodule, used to determine the target azimuth angle of the target object's line of sight in the horizontal direction and the target pitch angle of the target object's line of sight in the vertical direction when the direction includes the azimuth angle; a second determination submodule, used to determine the azimuth difference between the target azimuth angle and the azimuth angle of the camera, and the pitch angle difference between the target pitch angle and the pitch angle of the camera; a third determination submodule, used to determine the azimuth adjustment information of the camera based on the azimuth difference, wherein the azimuth adjustment information includes the azimuth adjustment direction and the azimuth adjustment amplitude; a fourth determination submodule, used to determine the pitch adjustment information of the camera based on the pitch angle difference, wherein the pitch adjustment information includes the pitch adjustment direction and the pitch adjustment amplitude; a third generation submodule, used to generate a control signal based on the azimuth adjustment information and / or the pitch adjustment information.

[0099] Optionally, in the video acquisition device provided in the embodiment of the present application, the third generating submodule includes: a fourth generating submodule, which is used to generate a control signal based on the azimuth adjustment information when the azimuth difference is greater than a preset first difference threshold and the pitch angle difference is less than or equal to a preset second difference threshold; or a fifth generating submodule, which is used to generate a control signal based on the pitch adjustment information when the azimuth difference is less than or equal to the preset first difference threshold and the pitch angle difference is greater than the preset second difference threshold; or a sixth generating submodule, which is used to generate a control signal based on the azimuth adjustment information and the pitch angle adjustment information when the azimuth difference is greater than the preset first difference threshold and the pitch angle difference is greater than the preset second difference threshold.

[0100] Optionally, in the video acquisition device provided in the embodiment of the present application, the generation module includes: a second acquisition sub-module, used to obtain the distance information between the target object and the camera; a seventh generation sub-module, used to generate a control signal based on the distance information and the line of sight direction, wherein the control signal is also used to indicate the focal length of the camera that needs to be adjusted, and the adjustment range of the focal length.

[0101] It should be noted that the detection module 300, acquisition module 302, generation module 304, and acquisition module 306 correspond to steps S202 to S208 in Example 1, and the examples and application scenarios implemented by the modules and corresponding steps are the same, but are not limited to the contents disclosed in the above-mentioned Example 1. It should be noted that the above-mentioned modules or units may be hardware components or software components stored in a memory (e.g., memory 104) and processed by one or more processors (e.g., processors 102a, 102b, ..., 102n), and the above-mentioned modules may also be part of the device and may be run in the computer terminal 10 provided in Example 1.

[0102] Example 3

[0103] An embodiment of the present application may provide an electronic device, Figure 4 is a structural block diagram of an electronic device according to an embodiment of the present application. Figure 4 As shown, the electronic device may include: one or more ( Figure 4 (only one is shown) processor 1002, memory 1004, storage controller, and peripheral interface, wherein the peripheral interface is connected to the radio frequency module, audio module and display.

[0104] Among them, the memory can be used to store software programs and modules, such as program instructions / modules corresponding to the methods and devices in the embodiments of the present application, and the processor executes various functional applications and data processing by running the software programs and modules stored in the memory, that is, realizing the above-mentioned method. The memory may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory may further include a memory remotely arranged relative to the processor, and these remote memories may be connected to the terminal via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0105] The processor can call the information and application stored in the memory through the transmission device to perform the following steps: in the process of video acquisition through the camera, detect whether the target object is within the shooting range of the camera; when the target object is within the shooting range, obtain the line of sight direction of the target object; based on the line of sight direction, generate a control signal, wherein the control signal is used to indicate at least: the direction in which the camera needs to be adjusted, and the adjustment amplitude of the direction, the direction includes azimuth and / or pitch angle; control the camera to adjust the direction according to the control signal, so that the camera acquires video along the line of sight direction.

[0106] The processor can also call the information and application programs stored in the memory through the transmission device to perform the following steps: when the target object is not within the shooting range, collect the sight signal of the target object through the sensor device; adjust the direction of the camera based on the sight signal so that the target object is within the shooting range.

[0107] The processor can also call the information and application programs stored in the memory through the transmission device to perform the following steps: detecting whether the camera is within the preset visual range of the target object; when the camera is within the preset visual range, generating a control signal based on the line of sight direction.

[0108] The processor can also call the information and application programs stored in the memory through the transmission device to perform the following steps: detect whether the line of sight direction of the target object has changed; when a change in the line of sight direction is detected, obtain the change amplitude of the line of sight of the target object; when the line of sight change amplitude is greater than a preset amplitude, generate a control signal based on the changed line of sight direction.

[0109] The processor can also call the information and application stored in the memory through the transmission device to perform the following steps: determine the target azimuth of the target object's line of sight in the horizontal direction, and the target pitch angle of the target object's line of sight in the vertical direction; determine the azimuth difference between the target azimuth and the azimuth of the camera, and the pitch difference between the target pitch angle and the pitch angle of the camera; based on the azimuth difference, determine the azimuth adjustment information of the camera, wherein the azimuth adjustment information includes the azimuth adjustment direction and the azimuth adjustment amplitude; based on the pitch difference, determine the pitch adjustment information of the camera, wherein the pitch adjustment information includes the pitch adjustment direction and the pitch adjustment amplitude; based on the azimuth adjustment information and / or the pitch adjustment information, generate a control signal.

[0110] The processor can also call the information and application stored in the memory through the transmission device to perform the following steps: when the azimuth angle difference is greater than a preset first difference threshold and the pitch angle difference is less than or equal to a preset second difference threshold, generate a control signal based on the azimuth angle adjustment information; or when the azimuth angle difference is less than or equal to the preset first difference threshold and the pitch angle difference is greater than the preset second difference threshold, generate a control signal based on the pitch angle adjustment information; or when the azimuth angle difference is greater than the preset first difference threshold and the pitch angle difference is greater than the preset second difference threshold, generate a control signal based on the azimuth angle adjustment information and the pitch angle adjustment information.

[0111] The processor can also call the information and application programs stored in the memory through the transmission device to perform the following steps: obtaining the distance information between the target object and the camera; generating a control signal based on the distance information and the line of sight direction, wherein the control signal is also used to indicate the focal length of the camera that needs to be adjusted, as well as the adjustment range of the focal length.

[0112] By adopting the embodiment of the present application, a solution for video acquisition is provided. In the process of video acquisition by a camera, it is detected whether the target object is within the shooting range of the camera; when the target object is within the shooting range, the sight direction of the target object is obtained; based on the sight direction, a control signal is generated, wherein the control signal is at least used to indicate: the direction in which the camera needs to be adjusted, and the adjustment amplitude of the direction, the direction includes the azimuth and / or the pitch angle; the camera is controlled to adjust the direction according to the control signal, so that the camera performs video acquisition along the sight direction, which solves the problem that the camera cannot achieve real-time follow-up shooting and the video shooting effect is poor in the related technology. The technical problem of poor video shooting effect caused by the inability of the camera to achieve real-time follow-up shooting is solved. Thereby, the purpose of automatically adjusting the direction of the camera through visual following during video shooting is achieved, and the effect of improving the video shooting effect while achieving real-time follow-up shooting is achieved.

[0113] It can be understood by those skilled in the art that Figure 4 The structure shown is for illustration only, and the electronic device may also be a smart phone (such as an Android phone, an iOS phone, etc.), a tablet computer, a PDA, a mobile Internet device (Mobile Internet Devices, MID), a PAD, or other terminal devices. Figure 4 The structure of the electronic device is not limited. Figure 4 More or fewer components (such as network interfaces, display devices, etc.) shown in, or having Figure 4 Different configurations are shown.

[0114] A person of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing the hardware related to the terminal device through a program, and the program can be stored in a computer-readable storage medium, and the storage medium may include: a flash drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0115] Example 4

[0116] The embodiment of the present application further provides a storage medium. Optionally, in this embodiment, the storage medium can be used to store the program code executed by the video acquisition method provided in the first embodiment.

[0117] Optionally, in this embodiment, the above storage medium may be located in any computer terminal in a computer terminal group in a computer network, or in any mobile terminal in a mobile terminal group.

[0118] The present application also provides a computer program product, which, when executed on a data processing device, is suitable for executing the program steps of the video acquisition method.

[0119] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0120] In the above embodiments of the present application, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, please refer to the relevant description of other embodiments.

[0121] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. Among them, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of units or modules, which can be electrical or other forms.

[0122] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0123] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0124] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, disk or optical disk and other media that can store program codes.

[0125] The above is only a preferred implementation of the present application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present application. These improvements and modifications should also be regarded as the scope of protection of the present application.

Claims

1. A video acquisition method, characterized in that: include: In the process of video acquisition by a camera, detecting whether a target object is within the shooting range of the camera; When the target object is within the shooting range, acquiring the sight direction of the target object; Based on the line of sight direction, a control signal is generated, wherein the control signal is used to indicate at least: the direction in which the camera needs to be adjusted, and the adjustment amplitude of the direction, wherein the direction includes an azimuth angle and / or a pitch angle; The camera is controlled to adjust its direction according to the control signal so that the camera can collect video along the sight line direction.

2. The method according to claim 1, characterized in that The method further comprises: When the target object is not within the shooting range, collecting a sight signal of the target object by using a sensor device; The direction of the camera is adjusted based on the sight signal so that the target object is within the shooting range.

3. The method according to claim 1, characterized in that The generating a control signal based on the line of sight direction comprises: Detecting whether the camera is within a preset visual range of the target object; When the camera is within the preset visual range, the control signal is generated based on the line of sight direction.

4. The method according to claim 1, characterized in that: The generating a control signal based on the line of sight direction comprises: Detecting whether the sight line direction of the target object changes; When a change in the sight line direction is detected, obtaining a change amplitude of the sight line of the target object; When the change amplitude of the line of sight is greater than a preset amplitude, the control signal is generated based on the changed line of sight direction.

5. The method according to claim 1, characterized in that In the case where the direction includes an azimuth, the generating a control signal based on the line of sight direction includes: Determining a target azimuth angle of the sight line direction of the target object in the horizontal direction, and a target pitch angle of the sight line direction of the target object in the vertical direction; Determine an azimuth difference between the target azimuth and the azimuth of the camera, and a pitch difference between the target pitch angle and the pitch angle of the camera; Based on the azimuth angle difference, determining the azimuth angle adjustment information of the camera, wherein the azimuth angle adjustment information includes the azimuth angle adjustment direction and the azimuth angle adjustment amplitude; Based on the pitch angle difference, determining pitch angle adjustment information of the camera, wherein the pitch angle adjustment information includes a pitch angle adjustment direction and a pitch angle adjustment amplitude; The control signal is generated based on the azimuth angle adjustment information and / or the elevation angle adjustment information.

6. The method according to claim 5, characterized in that The generating the control signal based on the azimuth angle adjustment information and / or the elevation angle adjustment information comprises: generating the control signal based on the azimuth adjustment information when the azimuth angle difference is greater than a preset first difference threshold and the pitch angle difference is less than or equal to a preset second difference threshold; or generating the control signal based on the pitch angle adjustment information when the azimuth angle difference is less than or equal to the preset first difference threshold and the pitch angle difference is greater than the preset second difference threshold; or When the azimuth angle difference is greater than the preset first difference threshold, and the elevation angle difference is greater than the preset second difference threshold, the control signal is generated based on the azimuth angle adjustment information and the elevation angle adjustment information.

7. The method according to any one of claims 1 to 6, characterized in that: The generating a control signal based on the line of sight direction comprises: Acquire distance information between the target object and the camera; The control signal is generated based on the distance information and the sight line direction, wherein the control signal is also used to indicate the focal length of the camera that needs to be adjusted and the adjustment range of the focal length.

8. A video acquisition device, characterized in that: include: A detection module is used to detect whether a target object is within the shooting range of the camera during video acquisition by the camera; An acquisition module, used for acquiring the sight direction of the target object when the target object is within the shooting range; A generating module, used for generating a control signal based on the sight line direction, wherein the control signal is used for indicating at least: the direction in which the camera needs to be adjusted, and the adjustment amplitude of the direction, the direction including the azimuth angle and / or the pitch angle; The acquisition module is used to control the direction of the camera to adjust according to the control signal so that the camera can acquire video along the direction of the sight line.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a stored executable program, wherein when the executable program is run, the device where the computer-readable storage medium is located is controlled to execute the video acquisition method according to any one of claims 1 to 7.

10. An electronic device, characterized in that: include: A memory storing an executable program; A processor, configured to run the program, wherein the program executes the method according to any one of claims 1 to 7 when running.

Images