Shooting control method and device, electronic equipment and storage medium

Abstract

The invention discloses a shooting control method and device, electronic equipment and a storage medium, and belongs to the technical field of communication. Determining shooting control information of each shooting device according to the user shooting intention information and the device information of the at least two shooting devices; a shooting instruction is sent to each shooting device, the shooting instruction carries the shooting control information, and the shooting instruction is used for instructing each shooting device to shoot according to the shooting control information.

Description

Technical Field

[0001] This application belongs to the field of communication technology, specifically relating to a shooting control method, device, electronic device, and storage medium. Background Technology

[0002] In multi-camera shooting scenarios, the same shooting device is usually equipped with multiple lenses. The seamless switching between multiple cameras is achieved through the coordination of communication within the device, or multiple shooting devices record simultaneously and then perform post-production to achieve the effect of seamless switching between multiple cameras.

[0003] However, the multiple lenses of a single device are limited by physical distance and cannot meet the shooting needs of large-scale scenes, while simultaneous recording of multiple devices relies too much on manual preset parameters and post-production operations, resulting in low production efficiency. Summary of the Invention

[0004] The purpose of this application is to provide a shooting control method, device, electronic device, and storage medium that can meet the shooting needs of a wide range of scenes, eliminate the need for manual parameter preset and post-processing, reduce shooting operations, and improve shooting efficiency.

[0005] In a first aspect, embodiments of this application provide a shooting control method, including: Obtain information about the user's shooting intent; Based on the user's shooting intention information and the device information of at least two shooting devices, determine the shooting control information for each shooting device; A shooting instruction is sent to each shooting device. The shooting instruction carries shooting control information and is used to instruct each shooting device to shoot according to the shooting control information.

[0006] Secondly, embodiments of this application provide a shooting control method, applied to a shooting device, comprising: Receive shooting instructions sent by the main control device; the shooting instructions carry shooting control information. Capture images according to the shooting control information.

[0007] Thirdly, embodiments of this application provide a shooting control device, including: The acquisition module is used to acquire information about the user's shooting intent. The determination module is used to determine the shooting control information of each shooting device based on the user's shooting intention information and the device information of at least two shooting devices; The sending module is used to send shooting instructions to each shooting device. The shooting instructions carry shooting control information and are used to instruct each shooting device to shoot according to the shooting control information.

[0008] Fourthly, embodiments of this application provide a shooting control device, applied to a shooting equipment, comprising: The receiving module is used to receive shooting instructions sent by the main control device, wherein the shooting instructions carry shooting control information; The shooting module is used to capture images according to the shooting control information.

[0009] Fifthly, embodiments of this application provide an electronic device, including a processor, a memory, and a program or instructions stored in the memory and executable on the processor. When the program or instructions are executed by the processor, they implement the steps of the shooting control method as shown in the first aspect, or the steps of the shooting control method as shown in the second aspect.

[0010] In a sixth aspect, embodiments of this application provide a readable storage medium storing a program or instructions that, when executed by a processor, implement the steps of the shooting control method as shown in the first aspect, or implement the steps of the shooting control method as shown in the second aspect.

[0011] In a seventh aspect, embodiments of this application provide a chip, which includes a processor and a display interface coupled to the processor. The processor is used to run programs or instructions to implement the steps of the shooting control method as shown in the first aspect, or to implement the steps of the shooting control method as shown in the second aspect.

[0012] Eighthly, embodiments of this application provide a computer program product stored in a storage medium, which is executed by at least one processor to implement the steps of the shooting control method as described in the first aspect.

[0013] In this embodiment, user shooting intention information can be obtained, and shooting control information for each shooting device can be determined based on the user shooting intention information and the device information of at least two shooting devices. A shooting command is sent to each shooting device, carrying the shooting control information, instructing each shooting device to shoot according to the shooting control information. This allows for direct parsing of the user's shooting intention, automatic generation of multi-device zoom, movement, and other shooting control information, eliminating shooting delays caused by manual intervention, reducing shooting operations, enabling one-click execution of complex camera movements, lowering shooting difficulty, and improving shooting efficiency. Attached Figure Description

[0014] Figure 1 Flowcharts of shooting control methods provided for some embodiments of this application; Figure 2 A schematic diagram of zoom ratio switching in a shooting control method provided for some embodiments of this application; Figure 3A schematic diagram of the shooting trajectory of the shooting device for some embodiments of the shooting control method provided in this application; Figure 4 Flowcharts of shooting control methods provided for some embodiments of this application; Figure 5 This is a schematic diagram of the structure of a shooting control device provided in an embodiment of this application; Figure 6 This is a schematic diagram of the structure of a shooting control device provided in an embodiment of this application; Figure 7 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application; Figure 8 This is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0015] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.

[0016] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such terms can be used interchangeably where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and the number of objects is not limited; for example, a first object can be one or more. Furthermore, in the specification and claims, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.

[0017] To address the problems in related technologies, embodiments of this application provide a shooting control method, apparatus, base station, storage medium, and program product.

[0018] The following is in conjunction with the appendix Figures 1 to 8 The shooting control method, device, base station, storage medium and program product provided in this application will be described in detail through specific embodiments and application scenarios.

[0019] First, let's explain the technical terms that appear in the embodiments of this application.

[0020] User shooting intent information refers to information such as the user's shooting needs, shooting purpose, and shooting effect involved in the shooting behavior.

[0021] The communication range of a base station refers to the area covered by the base station via radio waves. The base station provides wireless access, data transmission, and data processing functions for the shooting device. In this embodiment, the wireless access function allows shooting devices within the base station's communication range to access the base station. The data transmission function receives device information from the shooting device and sends shooting commands to the shooting device. The data processing function determines the shooting control information for each shooting device based on the user's shooting intention information and the device information of at least two shooting devices within the base station's communication range.

[0022] Shooting equipment includes, but is not limited to, digital cameras, mobile phones, camcorders, drones, tablets, PDAs, action cameras, mirrorless cameras, smart glasses, smartwatches, and other electronic devices with shooting and base station communication functions.

[0023] Scene alignment techniques (SAT) are methods that achieve pixel-level registration by estimating geometric changes between images through feature point matching or deep learning. Image object algorithms can be used for deformation information extraction, i.e., by aligning feature points of at least two frames, calculating displacement, rotation, or perspective transformation parameters to eliminate camera shake or achieve panoramic stitching. Furthermore, they can be used for dynamic scene analysis, i.e., tracking the motion trajectory of objects in video processing to assist in image fusion.

[0024] The histogram chi-square test can be used for color difference detection, analyzing the consistency of color distribution between images to obtain color difference information between at least two images, such as identifying changes in lighting or traces of post-processing tampering.

[0025] A low-latency communication network (LCN) is a network system that achieves extremely low end-to-end data transmission latency through technological optimization. Its goal is to shorten the data transmission time from the sender to the receiver, measured in milliseconds (ms) or microseconds (μs). Based on this, combined with... Figure 1 A shooting control method provided in the embodiments of this application will be described in detail.

[0026] Figure 1 A flowchart of a shooting control method provided for some embodiments of this application.

[0027] like Figure 1 As shown, the shooting control method provided in this application embodiment can be applied to a base station, shooting device or control device. Based on this, the shooting control method may include steps 110 to 130, as detailed below.

[0028] Step 110: Obtain user shooting intention information; Step 120: Determine shooting control information for each shooting device based on user shooting intention information and device information of at least two shooting devices; Step 130: Send shooting instructions to each shooting device, the shooting instructions carrying shooting control information, the shooting instructions being used to instruct each shooting device to shoot according to the shooting control information.

[0029] For example, taking a football shooting scenario and shooting control method applied to a base station, the multi-camera collaborative shooting control method is explained. In a football match, multiple shooting devices are needed to capture key actions such as goals and fouls from different angles. At this time, the base station can coordinate multiple shooting devices to achieve collaborative shooting. Specifically, user shooting intent information is obtained, such as focusing on tracking the left forward's shooting action, where the left forward is player ID 9, and the goal area is the X / Y coordinate range. Next, based on the user's shooting intent and the device information of at least two shooting devices within the base station's communication range, three available shooting devices are detected: camera CAM1 on the high position of the east stand, camera CAM2 on the west baseline, and drone DRONE1 hovering in the air. Based on this, camera CAM1's shooting control information 1 is to adjust the focal length to 300mm, the downward angle to 15°, and enable athlete face tracking. Camera CAM2: Switch to 120fps slow motion mode and lock onto the goal line area. Drone DRONE1: Descend to an altitude of 30 meters and initiate dynamic surround shooting. Then, the base station sends shooting commands to each device.

[0030] In this way, the base station can directly analyze the user's shooting intentions and automatically generate shooting control information such as zoom and movement for multiple devices, eliminating shooting delays caused by manual intervention, reducing shooting operations, realizing one-click execution of complex camera movements, reducing shooting difficulty, and improving shooting efficiency.

[0031] Furthermore, by directly connecting the shooting equipment to the base station, the intermediate server link is eliminated, which can shorten data transmission latency and improve the synchronization accuracy of multiple cameras, meeting the real-time tracking needs of high-speed sports scenes such as racing and ball games. In addition, by issuing shooting commands to the shooting equipment through the base station, the physical space limitations of traditional multi-camera systems can be overcome, supporting collaborative shooting by shooting equipment scattered in large venues such as stadiums and concerts, covering a wider range of shooting scenarios, and adapting to the shooting needs of complex spatial layouts and large-scale scenes.

[0032] It should be noted that the shooting control method provided in this application can be applied independently to a base station, shooting device, or control device, or it can be applied collaboratively to a base station, shooting device, and control device. These will be described in detail below.

[0033] In some embodiments, the shooting control method provided in this application can be applied to a shooting control system, which includes a base station and shooting devices. The base station can acquire device information of at least two shooting devices within its communication range and send this device information to a shooting device with determined shooting control information. The shooting device with determined shooting control information can acquire user shooting intent information; determine shooting control information for each shooting device based on the user shooting intent information and the device information of the at least two shooting devices; and send the shooting control information to the base station. The base station can also receive the shooting control information sent by the shooting device with determined shooting control information, generate a shooting instruction based on the shooting control information, and send the shooting instruction to each shooting device. The shooting instruction carries the shooting control information and instructs each shooting device to shoot according to the shooting control information. Alternatively, the shooting control information for each of the at least two shooting devices can be sent to each shooting device, or only the shooting control information corresponding to that specific shooting device can be sent.

[0034] In other embodiments, the shooting control method provided in this application can be applied to a shooting control system, which includes a base station and a control device, wherein the control device is an electronic device or server with computing and communication functions. Based on this, the control device can acquire user shooting intent information and device information of at least two shooting devices within the communication range of the base station; determine shooting control information for each shooting device based on the user shooting intent information and the device information of the at least two shooting devices; and send the shooting control information to the base station. The base station can be used to receive the shooting control information sent by the shooting devices with determined shooting control information, generate shooting instructions based on the shooting control information, and send shooting instructions to each shooting device. The shooting instructions carry the shooting control information and are used to instruct each shooting device to shoot according to the shooting control information. Specifically, the shooting control information of each of the at least two shooting devices can be sent to each shooting device, or only the shooting control information corresponding to that shooting device can be sent. The above steps are described in detail below.

[0035] First, regarding step 110, in this embodiment of the application, the user's shooting intention information can be obtained in the following two ways, as detailed below.

[0036] In one method, the base station can obtain the user's shooting intention information by receiving shooting requests sent by the shooting control device. That is, the shooting request carries the user's shooting intention information, such as focusing on tracking the left forward's shooting action, where the left forward is player ID 9 and the goal area is the X / Y coordinate range. Alternatively, starting from a panoramic view of shooting device A, the camera can adjust the lens focal length to gradually zoom in on the main subject, creating a visual zoom-in effect, and then turn left, ultimately focusing on a close-up of target T in the area captured by shooting device C.

[0037] Method 2 is based on the ability to pre-set user shooting intent information at the base station.

[0038] Next, step 120 is involved. In this embodiment of the application, step 120 may specifically include steps 1201 and 1202, as shown below.

[0039] Step 1201: Generate a shooting trajectory based on the user's shooting intention information.

[0040] For example, if the user's shooting intention is to start with a panoramic view from shooting device A, zoom in and turn left, and finally focus on a close-up of target T in the area captured by shooting device C, then the shooting trajectory can be P0→P1→P2→P3.

[0041] Step 1202: Based on the shooting trajectory and the device information of at least two shooting devices, determine the shooting control information of each shooting device.

[0042] In this embodiment, the shooting control information may include at least one of the following: shooting parameters and movement parameters of the shooting device driven by the gimbal device. Shooting parameters include, but are not limited to: zoom ratio, horizontal angle, pitch angle, and aperture. This embodiment uses zoom ratio as an example.

[0043] For example, using the above example, P0 is the starting point of the panoramic shot, i.e., the center of the shooting area of ​​shooting device A, with coordinates [0,0,0]. P1 is the zoom-in transition point, i.e., 3 units away from P0, with a zoom ratio from 35mm to 85mm. P2 is the left-turn node, i.e., offset 2 units to the left from P1, with a horizontal angle (Pan) of +45°. P3 is the target close-up point, i.e., the center of the shooting area of ​​shooting device C, with a focal length of 135mm. Based on this, the shooting control information assigned to shooting device A is to shoot from P0 to P1 within 0 seconds to 1.5 seconds, with a zoom ratio of Z(t) = 35 + 33.3t (mm) and Pan(t) = 0°. The shooting control information assigned to shooting device B is to shoot from P1 to P2 within 1.5 seconds to 3 seconds, with a zoom ratio of Z(t) = 85 - 16.7t and Pan(t) = 0° to +45°. The shooting control information assigned to the shooting device C is to shoot from P2 to P3 in 3 to 4.5 seconds, with a zoom ratio of Z(t) = 85 + 33.3t and Pan(t) = +45° → -30°.

[0044] Therefore, based on the shooting trajectory and the equipment information of the shooting device, the zoom ratio is automatically calculated, enabling intelligent focus tracking for multiple shooting devices. This avoids the image proportion distortion caused by manual adjustment, reduces shooting operations, and ensures shooting quality.

[0045] In this embodiment of the application, prior to step 120, it is necessary to obtain the device information of the shooting device. Based on this, prior to step 120, the shooting control method may further include: Receive access requests sent by imaging devices within the base station's communication range via a low-latency communication network; and receive device information sent by the imaging device when the imaging device is connected to the base station.

[0046] For example, a base station can receive access requests from each of at least two imaging devices, such as C1, C2, ..., Cn, within its communication range. When the base station allows an imaging device to access the base station, it can trigger the imaging device to send its device information to the base station, so that the base station can receive and store the device information sent by the imaging device.

[0047] In some embodiments of this application, the device information of the shooting device includes at least one of the following: camera parameters of the camera in the shooting device, shooting orientation information of the shooting device, and location information within the communication range of the base station.

[0048] In other embodiments of this application, based on the above embodiments, device information of a gimbal device communicatively connected to the shooting device is introduced. This allows for changes in the shooting angle of the shooting device, enabling real-time collaborative control. During continuous zoom in, not only can the target be brought closer, but the spatial orientation of the image can also be smoothly changed (i.e., achieving "spatial turning"), breaking through the limitations of a single shooting device's fixed perspective and enabling more complex and dynamic large-scale scene narratives. Therefore, in the embodiments of this application, the device information can be specifically divided into shooting device information of the shooting device and gimbal device information of the gimbal device communicatively connected to the shooting device. The shooting device information of the shooting device may include at least one of the following: camera parameters of the camera in the shooting device, shooting orientation information of the shooting device, and location information within the communication range of the base station. The gimbal device information includes the range of movement of the shooting device driven by the gimbal device.

[0049] It should be noted that the location information of the aforementioned imaging equipment within the base station's communication range can be obtained through at least one of the following methods: determination via the imaging equipment's built-in positioning system, which can be combined with Real-time Kinematic (RTK) enhancement technology, base station-assisted positioning, Visual Simultaneous Localization and Mapping (SLAM), or obtained from preset precise coordinates. The positioning system may include the Global Positioning System (GPS) or the BeiDou Navigation Satellite System (BDS).

[0050] The shooting orientation information mentioned above can be obtained in at least one of the following ways: determined by the built-in electronic compass of the device, determined by the inertial measurement unit (IMU), or obtained by feedback from the gimbal device.

[0051] The camera parameters mentioned above can be obtained through at least one of the following methods: sensor size, focal length, optical zoom range, maximum field of view, minimum field of view, pitch angle, and digital zoom capability. It should be noted that if the shooting device has multiple cameras, the aforementioned focal length may include the focal lengths of each camera.

[0052] In some embodiments of this application, the shooting angle of the shooting device is fixed, and only the zoom ratio of the shooting device is changed. Thus, the shooting control information of the shooting device can be determined through the following steps. Specifically, the cooperative zoom trajectory includes at least two zoom key points, a zoom timestamp for each zoom key point, and the zoom ratio corresponding to the zoom timestamp. The shooting control information includes the zoom ratio, and the shooting trajectory includes the cooperative zoom trajectory. Based on this, step 1202 above can specifically include: Based on the collaborative zoom trajectory, the zoom magnification of each zoom key point is determined according to the equipment information of at least two shooting devices and the overlapping area of ​​the field of view of each pair of collaborative shooting devices; wherein, the overlapping area of ​​the field of view is determined by the equipment information of at least two shooting devices.

[0053] For example, the collaborative zoom trajectory includes three zoom key points: P0→P1→P2. The zoom timestamp for each key point is 0s for P0, 1.5s for P1, and 3s for P2. The zoom magnification of P0 is Z(t) = 35 + 33.3t, the zoom magnification of P1 is Z(t) = 85 - 16.7t, and the zoom magnification of P2 is Z(t) = 85 + 33.3t. Based on this, if shooting device A captures P1, then the zoom magnification assigned to shooting device A at 0s is Z(t) = 35 + 33.3t. If shooting device B captures P2, then the zoom magnification assigned to shooting device B at 1.5s is Z(t) = 85 - 16.7t. If shooting device C captures P3, then the zoom magnification of shooting device C at 3s is determined to be Z(t) = 85 + 33.3t.

[0054] In the embodiments of this application, such as Figure 2 As shown in the embodiments of this application, the effect of adjusting the zoom magnification to control the framing range is as follows: Figure 2 As shown, when the focal length magnification is small, the shooting frame range is larger; conversely, when the focal length magnification is large, the shooting frame range is small. That is, when the zoom magnification of the shooting device is reduced, the shooting frame range of the shooting device can be reduced from frame 201 FOV zoom in to frame 202 FOV.

[0055] It should be noted that, in the embodiments of this application, the collaborative zoom trajectory can be generated through the following process.

[0056] In this embodiment of the application, the overlapping area of ​​the field of view can be determined in the following way.

[0057] First, from at least two shooting devices, any two adjacent or collaborative shooting devices are identified, and the device information of any two adjacent shooting devices or collaborative shooting devices is obtained. This device information may include shooting orientation information, maximum field of view, minimum field of view, sensor size, and focal length. Second, based on the device information of each shooting device, the spatial relationship between the shooting devices is calculated using Euclidean distance to determine the viewing frustum corresponding to each shooting device. The field of view of each shooting device is calculated using the sensor size and focal length. The field of view is then transformed into a viewing frustum model in three-dimensional space, its boundary determined by the shooting orientation information axis and the field of view. Finally, a geometric algorithm is used to calculate the spatial intersection region of the two viewing frustums, and this spatial intersection region is defined as the field of view overlap region.

[0058] This solves the pain point of switching between multiple cameras in large scenes with multiple shooting devices. By continuing to stack multiple devices, the zoom distance can be greatly increased.

[0059] In other embodiments of this application, the device information includes the shooting device information of each shooting device and the gimbal device information of the gimbal device that is communicatively connected to each shooting device; the shooting control information includes the movement parameters of the shooting device driven by the gimbal device; the shooting trajectory includes the camera movement shooting path, the camera movement shooting path includes at least two camera movement critical points, each of the at least two camera movement critical points constitutes a spatial path segment, each camera movement critical point corresponds to a camera movement timestamp, and the spatial path corresponds to the shooting angle.

[0060] In this embodiment, the shooting device further includes a gimbal device to assist the electronic device in improving the stability of the captured image and changing the shooting angle of the electronic device. That is, the electronic device is communicatively connected to the gimbal device, and the gimbal device can move the electronic device. In this embodiment, there can be multiple gimbal devices and electronic devices, and the relationship between the gimbal device and the electronic device can be one-to-one.

[0061] Based on this, step 1202 above may specifically include: According to the camera movement shooting path, based on the equipment information of at least two shooting devices and the first field of view adjacent area of ​​each of the two shooting devices that are shooting in coordination, for the shooting devices that shoot each of the two adjacent camera movement critical points and the spatial path segment formed by each of the two adjacent camera movement critical points, determine the timestamp of the pan-tilt device driving the shooting device to move and the movement parameters corresponding to the timestamp.

[0062] For example, the camera movement path includes P0→P1→P2→P3, where the camera movement thresholds are P0, P1, P2, and P3. The spatial path segment formed by P0 and P1 is P0→P1, the spatial path segment formed by P1 and P2 is P1→P2, and the spatial path segment formed by P2 and P3 is P2→P3. Based on this, the movement parameter assigned to camera A is 0 seconds to 1.5 seconds, shooting from P0 to P1, with Pan(t) = 0°. The movement parameter assigned to camera B is 1.5 seconds to 3 seconds, shooting from P1 to P2, with Pan(t) = 0° → +45°. The movement parameter assigned to camera C is 3 seconds to 4.5 seconds, shooting from P2 to P3, with Pan(t) = +45° → -30°.

[0063] In this embodiment of the application, the adjacent area of ​​the first field of view is determined by the gimbal device information of the gimbal device that is communicatively connected to each of the two co-shooting shooting devices.

[0064] Here, based on the position information, shooting orientation information, and shooting control information of each of the two collaborative shooting devices, including the movement parameters (i.e., the movement range) of the pan-tilt device driving the shooting device, the overlapping area of ​​the field of view between each of the two collaborative shooting devices, such as AB or BC, can be calculated. In this embodiment, this is to ensure that the FOV of shooting device B can cover the adjacent part of the FOV of shooting device A, so that continuous images can be captured by shooting devices A and B. That is, it can be understood that the images captured by shooting device A and the images captured by shooting device B can be combined into a panoramic image. Alternatively, it can be understood as combining the video captured by shooting device A and the video captured by shooting device B, and combining the last frame of the video captured by shooting device A with the first frame of the video captured by shooting device B to obtain a continuous video.

[0065] In some embodiments of this application, at least two shooting devices include a first type of shooting device that is communicatively connected to a gimbal device and a second type of shooting device that is not communicatively connected to a gimbal device. The device information of the first type of shooting device includes the first shooting device information of the first type of shooting device and the gimbal device information of the gimbal device that is communicatively connected to the first type of shooting device. The device information of the second type of shooting device includes the second shooting device information of the second type of shooting device. The first shooting control information of the first type of shooting device includes the zoom ratio and the movement parameters of the shooting device driven by the gimbal device. The shooting control information of the second type of shooting device includes the zoom ratio. The shooting trajectory includes a collaborative camera movement trajectory, which includes at least three shooting points. The at least three shooting points include at least one zoom key point and at least two camera movement critical points. Each zoom key point corresponds to a zoom timestamp, and each camera movement critical point corresponds to a camera movement timestamp. The shooting path segment formed by each two adjacent camera movement critical points corresponds to a shooting angle. Based on this, step 1202 can specifically include: According to the coordinated camera movement trajectory, based on the equipment information of at least two shooting devices and the adjacent area of ​​the second field of view of the first type of shooting device and the second type of shooting device in coordinated shooting, a zoom magnification is assigned to the shooting device that shoots the zoom key point, and a movement timestamp, movement parameters corresponding to the timestamp, and zoom magnification of the shooting path segment are assigned to the second type of shooting device that shoots the two adjacent camera movement critical points and the shooting path segment formed by the two adjacent camera movement critical points. The adjacent area of ​​the second field of view is determined by the first shooting device information of the first type of shooting device that is cooperating with the first type of shooting device, the gimbal device information of the gimbal device that is communicating with the first type of shooting device, and the second shooting device information of the second type of shooting device that is cooperating with the first type of shooting device.

[0066] For example, the coordinated camera movement trajectory is P0→P1→P2→P3, where P0 and P3 are key zoom points and P1 and P2 are two critical camera movement points. P0 is the starting point of the panoramic shot, i.e., the center of the shooting area of ​​shooting device A, with coordinates [0,0,0]. P1 is the ZoomIn transition point, i.e., 3 units away from P0, with a zoom magnification from 35mm to 85mm. P2 is the left turn node, i.e., shifting 2 units to the left from P1, with a horizontal angle (Pan) +45°. P3 is the target close-up point, i.e., the center of the shooting area of ​​shooting device C, with a focal length of 135mm. Based on this, the shooting control information assigned to shooting device A is: from 0 seconds to 1.5 seconds, shooting from P0 to P1, with a zoom magnification of Z(t) = 35 + 33.3t (mm) and Pan(t) = 0°. Shooting control information is assigned to shooting device B: from 1.5s to 3 seconds, shooting from P1 to P2, with a zoom ratio of Z(t) = 85 - 16.7t and Pan(t) = 0° → +45°. Shooting control information is assigned to shooting device C: from 3 seconds to 4.5 seconds, shooting from P2 to P3, with a zoom ratio of Z(t) = 85 + 33.3t.

[0067] Therefore, based on simple zoom in, it integrates smooth changes in spatial orientation, enabling a single camera movement to cover the complex process of wide-angle initiation, zooming in on the target, changing the observation direction, and continuing to focus on a new target. This provides users with virtual camera movement freedom far exceeding the physical limitations of a single device, allowing for the planning of arbitrary spatial paths and perspective change trajectories to achieve complex motion shot effects similar to those in movies. Furthermore, through joint trajectory planning—that is, zoom rotation and ultra-low latency synchronous control—even when zooming and switching occur during the rotation of the gimbal device, the high degree of coherence and visual seamlessness of the final output video stream is guaranteed, avoiding image jumps and disorientation caused by rotation or switching. It is suitable for scenarios that require focusing on details and changing the observation angle within a large space, such as sports events, large-scale events, landscape documentaries, and security monitoring tracking, significantly improving shooting efficiency and the dynamic expressiveness of the final image.

[0068] Then, regarding step 130, in one embodiment of this application, the shooting command can be sent via targeted transmission, that is, step 130 may specifically include: Shooting instructions are sent to each shooting device via a low-latency communication network.

[0069] For example, if there are three shooting devices, the base station can send shooting control information to each device specifically. Specifically, it can send shooting control information 1 to camera CAM1, which sets the focal length to 300mm, the tilt angle to 15°, and enables athlete face tracking. It can send shooting control information 2 to camera CAM2, which switches to 120fps slow-motion mode and locks onto the goal line area. Finally, it can send shooting control information 3 to drone DRONE1, which descends to an altitude of 30 meters and initiates dynamic surround shooting.

[0070] In other embodiments of this application, the shooting command can be sent via broadcast, that is, step 130 may specifically include: The shooting instructions are broadcast to shooting devices within the communication range of the base station via a low-latency communication network.

[0071] The shooting instruction may include a set of shooting control information constructed from the shooting control information of each shooting device.

[0072] For example, if there are three shooting devices, the base station can broadcast shooting instructions to the shooting devices within the base station's communication range. The shooting instructions include a set of shooting control information for the three shooting devices, namely, shooting control information 1 for camera CAM1, which adjusts the focal length to 300mm and the downward angle to 15°; shooting control information 2 for camera CAM2, which switches to 120fps slow motion mode and locks the goal line area; and shooting control information 3 for drone DRONE1, which descends to an altitude of 30 meters and starts dynamic surround shooting.

[0073] Based on this, the shooting device can find the shooting control information corresponding to its own device identifier from the shooting control information set.

[0074] Thus, the effect is achieved by synchronizing multi-device parameters in real time through 5G ultra-low latency, and dynamically allocating the focal length by combining spatial location and zoom capability to ensure smooth image transitions and avoid the abrupt changes in traditional multi-camera switching. For example, in a football match, the camera can seamlessly zoom from an overview of the stands to a close-up of the athlete's face. 5G low-latency network slicing technology ensures communication stability and can maintain low latency even in high-density device environments, ensuring the reliability of control commands in complex scenarios and reducing packet loss rate.

[0075] Furthermore, after step 130, video data captured by multiple shooting devices can be integrated. Based on this, the shooting control method may also include steps 2101 to 2104, as shown below.

[0076] Step 2101: Receive video data sent by at least two shooting devices, the video data being captured by the shooting devices according to the shooting control information.

[0077] For example, two shooting devices, namely drone A and camera B, are used to collaboratively film a moving scene. Drone A shoots first, followed by camera B. The base station needs to ensure the temporal and spatial continuity of the two video segments. Based on this, the base station can receive video data (10 seconds, 30fps) from drone A and video data (10 seconds, 30fps) from camera B.

[0078] Step 2102: Based on the first image in the video data of the first shooting device and the second image in the video data of the second shooting device, determine the difference information between the first image and the second image. The difference information includes at least one of the following: deformation information of the first image and the second image, color difference information of the first image and the second image, wherein the first shooting device and the second shooting device are two shooting devices that cooperate in shooting among the at least two shooting devices.

[0079] Specifically, step 2102 includes steps 21021 and 21022.

[0080] Step 21021: In the case where at least two shooting devices include two collaborative shooting devices, and the two collaborative shooting devices include a first shooting device and a second shooting device shooting after the first shooting device, extract a first image from the video data of the first shooting device, and extract a second image from the video data of the second shooting device. The first image is the last p frames in the video data of the first shooting device, where p is an integer greater than or equal to 1; the second image is the first q frames in the video data of the second shooting device.

[0081] For example, the explanation will be based on the last frame of the video data from the first shooting device (first image) and the last frame of the video data from the second shooting device (second image). Specifically, the last frame (frame 300) of the video from drone A and the first frame (frame 1) of the video from camera B are extracted. The last frame can be shown as the moment the athlete takes off, and the first frame can be shown as the moment before the athlete lands.

[0082] The following explanation uses the last three frames of video data from the first shooting device (first image) and the first two frames of video data from the second shooting device (second image) as examples. Specifically, it involves extracting the last three frames from the video from drone A and the first two frames from the video from camera B. The last three frames can be displayed as images of the athlete's take-off, and the first two frames can be displayed as images of the athlete before landing.

[0083] Step 21022: Based on the feature points of the first image, determine the difference information between the second image and the second image. The difference information includes at least one of the following: deformation information of the first image and the second image, and color difference information of the first image and the second image.

[0084] For example, the explanation will be based on the last frame of video data from the first shooting device (first image) and the last frame of video data from the second shooting device (second image). If the proportion of the athlete's legs is slightly stretched due to the perspective shift of camera B, and the overall tone of camera B is cooler due to changes in lighting, feature points in the two frames, such as the athlete's outline and background buildings, can be extracted using the SIFT algorithm to obtain the difference information between the two images.

[0085] The following explanation uses the last three frames of video data captured by the first camera (using the first image as the first shooting device) and the first two frames of video data captured by the second camera (using the second image as the second shooting device) as examples. If camera B slightly stretches the proportion of the athlete's legs due to a shift in perspective, or if camera B's overall color tone appears cool due to changes in lighting, feature points such as the athlete's outline and background buildings can be extracted from the last three frames using the SIFT algorithm. Similarly, feature points from the first two frames can also be extracted using the SIFT algorithm. Next, feature points from the last frame are corrected using the feature points from the two last three frames, resulting in a first corrected image of the last frame. Then, the next frame from the first two frames is used to correct the previous frame, resulting in a second corrected image of the first frame. Finally, feature points from both frames, such as the athlete's outline and background buildings, can be extracted using the SIFT algorithm to obtain the difference information between the two images.

[0086] Step 2103: Correct the target image based on the difference information to obtain a corrected image, wherein the target image includes at least one of the following: an image in the video data of the first shooting device and an image in the video data of the second shooting device.

[0087] The images in the video data of the first shooting device may include a first image and a second image, and the corrected image includes at least one of the following: a first corrected image after correcting the first image and a second corrected image after correcting the second image.

[0088] For example, color correction is performed on the last frame image to adjust the color temperature to match that of the first frame image, resulting in a first corrected image. Geometric correction is then performed on the first frame image to eliminate the deformation of the athlete's legs, resulting in a second corrected image.

[0089] Step 2104: Determine the continuous video data captured by the first and second shooting devices based on the corrected image and the target image.

[0090] Specifically, step 2105 may include: If the target image includes the last frame, the first image is replaced with the first corrected image; if the target image includes the second image, the second image is replaced with the second corrected image. Then, based on the overlapping area of ​​the contents of the first and second corrected images, a gradient fusion process is performed on the first and second corrected images to obtain continuous video data captured by the first and second shooting devices.

[0091] For example, linear gradient blending can be applied to the overlapping area of ​​two corrected images, such as the athlete's body, to generate a continuous video with a seamless transition.

[0092] Furthermore, step 21022 above may specifically include steps 210221 and 210222, as shown below.

[0093] Step 21022: Align the feature points of the first frame image and the feature points of the second image using an image alignment algorithm to obtain the deformation information of the first and second images.

[0094] The deformation information in the embodiments of this application may include a perspective transformation matrix.

[0095] Step 21022: Determine the color difference information between the first image and the second image through histogram chi-square test.

[0096] This leads to a method for multi-camera synchronous shooting control based on a 5G-based kilometer-scale low-latency communication network. Leveraging the core advantage of 5G's ultra-low latency (end-to-end latency reduced to 1ms), and through communication protocol optimization, the network server portion is eliminated. Direct connection between two devices via base station reduces multi-camera synchronization errors to within one frame. Combined with dynamic zoom planning, the zoom level of each camera is automatically controlled, effectively helping users meet wide-range shooting needs. For example, in large-scale matches like football, cameras distributed throughout the field, even high in the stands, and following athletes' mobile devices require precise synchronization to achieve smooth, multi-angle transitions that follow movement. Dynamic zoom planning automatically enables cameras in different positions to collaboratively achieve a smooth zoom-in effect from a "wide-view" to a "close-up of the athlete," eliminating the need for the director to manually adjust the zoom of each camera individually.

[0097] It should be noted that the shooting control method provided in this application embodiment can be applied to at least one of the following scenarios: In sports events, cameras dispersed in the stands, on the sidelines, and on athletes can work together to complete panoramic to detailed camera movements, allowing the director to achieve multi-device joint shooting without manual switching. In film and television production, drone swarms can be combined with ground equipment to shoot dynamic zoom one-shot videos. Based on this, the shooting method provided in this application embodiment can upgrade multi-camera control from manual operation to automated collaboration through 5G low-latency communication networks and intelligent algorithms, significantly improving shooting efficiency and image quality, and is particularly suitable for shooting needs in large-scale, high-dynamic scenes.

[0098] Figure 4 A flowchart of a shooting control method provided for some embodiments of this application.

[0099] like Figure 4 As shown, the shooting control method provided in this application embodiment can be applied to shooting devices. Based on this, the shooting control method may include steps 410 and 420, as detailed below.

[0100] Step 110: Receive the shooting instruction sent by the main control device. The shooting instruction carries shooting control information. Step 120: Capture the image according to the shooting control information.

[0101] In this application embodiment, the main control device may include at least one of the following: a base station and a control device.

[0102] To facilitate data integration of video data captured by multiple shooting devices and improve shooting efficiency, this embodiment of the application utilizes a 5G low-latency communication network for data transmission. Specifically, images can be sent to the main control device via the low-latency communication network. Shooting commands from the main control device can also be received via the low-latency communication network.

[0103] The shooting control method provided in this application can be executed by a shooting control device. This application uses the shooting control device performing shooting as an example to illustrate the device of the shooting control method provided in this application.

[0104] This application also provides a shooting control device. (Specifically combined with...) Figure 5 Please provide a detailed explanation.

[0105] Figure 5 This is a schematic diagram of a shooting control device provided in an embodiment of this application.

[0106] like Figure 5 As shown, the shooting control device 50 may specifically include: The acquisition module 501 is used to acquire user shooting intent information; The determination module 502 is used to determine the shooting control information of each shooting device based on the user's shooting intention information and the device information of at least two shooting devices; The sending module 503 is used to send shooting instructions to each shooting device. The shooting instructions carry shooting control information and are used to instruct each shooting device to shoot according to the shooting control information.

[0107] The shooting control device 50 in the embodiments of this application will be described in detail below.

[0108] In some embodiments of this application, the determining module 502 is specifically used to generate a shooting trajectory based on the user's shooting intention information; Based on the shooting trajectory and the equipment information of at least two shooting devices, determine the shooting control information for each shooting device.

[0109] In some embodiments of this application, the determining module 502 is specifically used to determine the zoom ratio of each zoom key point according to the collaborative zoom trajectory, based on the device information of at least two shooting devices and the overlapping area of ​​the field of view of each of the two collaborative shooting devices in the at least two shooting devices, when the shooting control information includes zoom ratio, the shooting trajectory includes a collaborative zoom trajectory, the collaborative zoom trajectory includes at least two zoom key points and a zoom timestamp of each zoom key point and a zoom ratio corresponding to the zoom timestamp; The overlapping area of ​​the field of view is determined by the equipment information of at least two shooting devices.

[0110] In some embodiments of this application, the determining module 502 is specifically used to, when the device information includes the shooting device information of each shooting device and the gimbal device information of the gimbal device that is communicatively connected to each shooting device, the shooting control information includes the movement parameters of the shooting device driven by the gimbal device; the shooting trajectory includes a camera movement shooting path, the camera movement shooting path includes at least two camera movement critical points, each of the at least two camera movement critical points forms a spatial path segment, each camera movement critical point corresponds to a camera movement timestamp, and the spatial path corresponds to a shooting angle, according to the camera movement shooting path, based on the device information of at least two shooting devices and the first field of view adjacent area of ​​each of the at least two shooting devices that are cooperating in shooting, allocate the movement timestamp of the gimbal device driven by the shooting device and the movement parameters corresponding to the timestamp for the shooting device that shoots each of the two adjacent camera movement critical points and the spatial path segment formed by each of the two adjacent camera movement critical points; The first field of view adjacent area is determined by the gimbal device information of the gimbal device that is communicatively connected to each of the two co-shooting shooting devices.

[0111] In some embodiments of this application, at least two shooting devices include a first type of shooting device that is communicatively connected to a gimbal device and a second type of shooting device that is not communicatively connected to a gimbal device. The device information of the first type of shooting device includes the first shooting device information of the first type of shooting device and the gimbal device information of the gimbal device that is communicatively connected to the first type of shooting device. The device information of the second type of shooting device includes the second shooting device information of the second type of shooting device. The first shooting control information of the first type of shooting equipment includes the zoom ratio and the movement parameters of the shooting equipment driven by the gimbal device; the shooting control information of the second type of shooting equipment includes the zoom ratio. The shooting trajectory includes a coordinated camera movement trajectory, which includes at least three shooting points. The at least three shooting points include at least one zoom key point and at least two camera movement critical points. Each zoom key point corresponds to a zoom timestamp, and each camera movement critical point corresponds to a camera movement timestamp. The shooting path segment formed by each pair of adjacent camera movement critical points in the at least two camera movement critical points corresponds to a shooting angle.

[0112] In some embodiments of this application, the determining module 502 is specifically used to, according to the coordinated camera movement trajectory, based on the device information of at least two shooting devices and the adjacent area of ​​the second field of view of the first type of shooting device and the second type of shooting device in coordinated shooting, assign a zoom magnification to the shooting device shooting the zoom key point, and assign a movement timestamp, a movement parameter corresponding to the timestamp, and a zoom magnification of the shooting path segment to the second type of shooting device shooting two adjacent camera movement critical points and the shooting path segment formed by the two adjacent camera movement critical points; The adjacent area of ​​the second field of view is determined by the first shooting device information of the first type of shooting device that is cooperating with the first type of shooting device, the gimbal device information of the gimbal device that is communicating with the first type of shooting device, and the second shooting device information of the second type of shooting device that is cooperating with the first type of shooting device.

[0113] In some embodiments of this application, the sending module 503 may be used to send a shooting instruction to each shooting device through a low-latency communication network; wherein the shooting instruction further includes a global synchronization clock signal, which is used to align the shooting time of at least two shooting devices.

[0114] In some embodiments of this application, the shooting control device 50 may further include a receiving module for receiving video data sent by at least two shooting devices, wherein the video data is captured by the shooting devices in accordance with the shooting control information; The determining module 502 is specifically used to determine the difference information between the first image and the second image based on the first image in the video data of the first shooting device and the second image in the video data of the second shooting device. The difference information includes at least one of the following: deformation information of the first image and the second image, color difference information of the first image and the second image, wherein the first shooting device and the second shooting device are two shooting devices that cooperate in shooting among at least two shooting devices. The shooting control device 50 may further include a correction module for correcting the target image based on the difference information to obtain a corrected image, wherein the target image includes at least one of the following: an image in the video data of the first shooting device and an image in the video data of the second shooting device; The determining module 502 is specifically used to determine the continuous video data captured by the first shooting device and the second shooting device based on the corrected image and the target image.

[0115] This application also provides a shooting control device. (Specifically combined with...) Figure 5 Please provide a detailed explanation.

[0116] Figure 6 This is a schematic diagram of a shooting control device provided in an embodiment of this application.

[0117] like Figure 6 As shown, the shooting control device 60 is applied to the shooting equipment, and the device may specifically include: The receiving module 601 receives the shooting command sent by the main control device, and the shooting command carries shooting control information; The shooting module 602 captures images according to the shooting control information.

[0118] The shooting control device 60 in the embodiments of this application will be described in detail below.

[0119] In some embodiments of this application, the shooting control device 60 may further include a sending module, which is used to send an image to the main control device via a low-latency communication network when the shooting command is sent by the main control device via a low-latency communication network.

[0120] The shooting control device in this application embodiment can be an electronic device or a component of an electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices besides a terminal. For example, the electronic device can be a mobile phone, tablet computer, laptop computer, handheld computer, in-vehicle electronic device, mobile internet device (MID), augmented reality (AR) / virtual reality (VR) device, robot, wearable device, ultra-mobile personal computer (UMPC), netbook, or personal digital assistant (PDA), etc. It can also be a server, network attached storage (NAS), personal computer (PC), television (TV), ATM, or self-service machine, etc. This application embodiment does not specifically limit the scope.

[0121] The shooting control device in this application embodiment can be a device with an operating system. This operating system can be Android, iOS, or other possible operating systems; this application embodiment does not specifically limit it.

[0122] The device coordination apparatus provided in this application embodiment can achieve... Figures 1 to 4 The various processes implemented in the illustrated shooting control method embodiment achieve the same technical effect, and will not be described again here to avoid repetition.

[0123] Based on this, the shooting control device provided in this application embodiment can acquire user shooting intention information and determine shooting control information for each shooting device according to the user shooting intention information and the device information of at least two shooting devices; it sends a shooting instruction to each shooting device, the shooting instruction carrying the shooting control information, and the shooting instruction is used to instruct each shooting device to shoot according to the shooting control information. In this way, the base station can directly parse the user's shooting intention and automatically generate shooting control information such as zoom and movement for multiple devices, eliminating shooting delays caused by manual intervention, reducing shooting operations, realizing one-click execution of complex camera movements, reducing shooting difficulty, and improving shooting efficiency.

[0124] Optional, such as Figure 7As shown, this application embodiment also provides an electronic device or base station 70, including a processor 701 and a memory 702. The memory 702 stores a program or instructions that can run on the processor 701. When the program or instructions are executed by the processor 701, they implement the various steps of the above-described shooting control method embodiment and can achieve the same technical effect. To avoid repetition, they will not be described again here.

[0125] It should be noted that the electronic devices in the embodiments of this application include the aforementioned mobile electronic devices and non-mobile electronic devices.

[0126] It should be noted that the electronic devices in the embodiments of this application include the aforementioned mobile electronic devices and non-mobile electronic devices.

[0127] Figure 8 This is a schematic diagram of the hardware structure of an electronic device provided for some embodiments of this application.

[0128] The electronic device 800 includes, but is not limited to, components such as: radio frequency unit 801, network module 802, audio output unit 803, input unit 804, sensor 805, display unit 806, user input unit 807, interface unit 808, memory 809, and processor 810.

[0129] Those skilled in the art will understand that the electronic device 800 may also include a power supply (such as a battery) for supplying power to various components. The power supply may be logically connected to the processor 810 through a power management system, thereby enabling functions such as managing charging, discharging, and power consumption through the power management system. Figure 8 The electronic device structure shown does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be elaborated here.

[0130] In this embodiment, the processor 810 is used to acquire user shooting intention information. The processor 810 can also be used to determine shooting control information for each of the shooting devices based on the user shooting intention information and device information of at least two shooting devices. The network module 802 or the radio frequency unit 801 is used to send a shooting instruction to each of the shooting devices, the shooting instruction carrying the shooting control information, and the shooting instruction instructing each of the shooting devices to shoot according to the shooting control information.

[0131] Therefore, it can directly analyze the user's shooting intentions, automatically generate shooting control information such as zoom and movement for multiple devices, eliminate shooting delays caused by manual intervention, reduce shooting operations, realize one-click execution of complex camera movements, reduce shooting difficulty, and improve shooting efficiency.

[0132] The electronic device 800 is described in detail below.

[0133] In some embodiments of this application, the processor 810 is specifically used to generate a shooting trajectory based on the user's shooting intention information; Based on the shooting trajectory and the equipment information of at least two shooting devices, determine the shooting control information for each shooting device.

[0134] In some embodiments of this application, the processor 810 is specifically configured to, when the shooting control information includes zoom magnification, the shooting trajectory includes a cooperative zoom trajectory, the cooperative zoom trajectory includes at least two zoom key points and a zoom timestamp for each zoom key point and a zoom magnification corresponding to the zoom timestamp, determine the zoom magnification of each zoom key point according to the cooperative zoom trajectory, based on the device information of at least two shooting devices and the overlapping area of ​​the field of view of each of the two co-shooting shooting devices in the at least two shooting devices; The overlapping area of ​​the field of view is determined by the equipment information of at least two shooting devices.

[0135] In some embodiments of this application, the processor 810 is specifically configured to, when the device information includes shooting device information of each shooting device and gimbal device information of a gimbal device communicatively connected to each shooting device, the shooting control information includes movement parameters of the gimbal device driving the shooting device; the shooting trajectory includes a camera movement shooting path, the camera movement shooting path includes at least two camera movement critical points, each of the at least two camera movement critical points constitutes a spatial path segment, each camera movement critical point corresponds to a camera movement timestamp, and the spatial path corresponds to a shooting angle, according to the camera movement shooting path, based on the device information of at least two shooting devices and the first field of view adjacent area of ​​each of the at least two shooting devices that are cooperating in shooting, allocate timestamps of movement of the gimbal device driving the shooting device and movement parameters corresponding to the timestamps to the shooting devices that shoot each of the two adjacent camera movement critical points and the spatial path segment formed by each of the two adjacent camera movement critical points; The first field of view adjacent area is determined by the gimbal device information of the gimbal device that is communicatively connected to each of the two co-shooting shooting devices.

[0136] In some embodiments of this application, at least two shooting devices include a first type of shooting device that is communicatively connected to a gimbal device and a second type of shooting device that is not communicatively connected to a gimbal device. The device information of the first type of shooting device includes the first shooting device information of the first type of shooting device and the gimbal device information of the gimbal device that is communicatively connected to the first type of shooting device. The device information of the second type of shooting device includes the second shooting device information of the second type of shooting device. The first shooting control information of the first type of shooting equipment includes the zoom ratio and the movement parameters of the shooting equipment driven by the gimbal device; the shooting control information of the second type of shooting equipment includes the zoom ratio. The shooting trajectory includes a coordinated camera movement trajectory, which includes at least three shooting points. The at least three shooting points include at least one zoom key point and at least two camera movement critical points. Each zoom key point corresponds to a zoom timestamp, and each camera movement critical point corresponds to a camera movement timestamp. The shooting path segment formed by each pair of adjacent camera movement critical points in the at least two camera movement critical points corresponds to a shooting angle.

[0137] In some embodiments of this application, the processor 810 is specifically configured to, according to the coordinated camera movement trajectory, and based on the device information of at least two shooting devices and the adjacent area of ​​the second field of view of the first type of shooting device and the second type of shooting device cooperating in shooting, assign a zoom magnification to the shooting device shooting the zoom key point, and assign a movement timestamp, a movement parameter corresponding to the timestamp, and a zoom magnification of the shooting path segment to the second type of shooting device shooting two adjacent camera movement critical points and the shooting path segment formed by the two adjacent camera movement critical points; The adjacent area of ​​the second field of view is determined by the first shooting device information of the first type of shooting device that is cooperating with the first type of shooting device, the gimbal device information of the gimbal device that is communicating with the first type of shooting device, and the second shooting device information of the second type of shooting device that is cooperating with the first type of shooting device.

[0138] In some embodiments of this application, the radio frequency unit 801 or the network module 802 may be used to send shooting instructions to each shooting device through a low-latency communication network; wherein the shooting instructions also include a global synchronization clock signal, which is used to align the shooting time of at least two shooting devices.

[0139] In some embodiments of this application, the radio frequency unit 801 or the network module 802 is used to receive video data sent by at least two shooting devices, wherein the video data is captured by the shooting devices according to shooting control information; The processor 810 is specifically used to determine the difference information between the first image and the second image based on the first image in the video data of the first shooting device and the second image in the video data of the second shooting device. The difference information includes at least one of the following: deformation information of the first image and the second image, and color difference information of the first image and the second image. The first shooting device and the second shooting device are two shooting devices that cooperate in shooting among at least two shooting devices. The processor 810 is specifically used to correct the target image based on the difference information to obtain a corrected image, wherein the target image includes at least one of the following: an image in the video data of the first shooting device and an image in the video data of the second shooting device; The processor 810 is specifically used to determine continuous video data captured by the first and second shooting devices based on the corrected image and the target image.

[0140] Alternatively, in this embodiment, the network module 802 or the radio frequency unit 801 is used to receive a shooting command sent by the main control device, the shooting command carrying shooting control information. The processor 810 is used to capture images according to the shooting control information.

[0141] In some embodiments of this application, the network module 802 or the radio frequency unit 801 may also be used to send images to the main control device via a low-latency communication network when the shooting command is sent by the main control device via a low-latency communication network.

[0142] It should be understood that the input unit 804 may include a graphics processing unit (GPU) 8041 and a microphone 8042. The GPU 8041 processes image information of still images or videos acquired by an image capture device (such as a camera) in video capture mode or image capture mode. The display unit 806 may include a display panel, which may be configured in the form of a liquid crystal display, an organic light-emitting diode, or the like. The user input unit 807 includes at least one of a touch panel 8071 and other input devices 8072. The touch panel 8071 is also called a touch screen. The touch panel 8071 may include two parts: a touch detection device and a touch display. Other input devices 8072 may include, but are not limited to, a physical keyboard, function keys (such as volume display buttons, power buttons, etc.), a trackball, a mouse, and a joystick, which will not be described in detail here.

[0143] The memory 809 can be used to store software programs and various information. The memory 809 may primarily include a first storage area for storing programs or instructions and a second storage area for storing information. The first storage area may store the operating system, application programs or instructions required for at least one function (such as sound playback, image playback, etc.). Furthermore, the memory 809 may include volatile memory or non-volatile memory, or both. The non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct memory bus RAM (DRRAM). The memory 809 in the embodiments of this application includes, but is not limited to, these and any other suitable types of memory.

[0144] Processor 810 may include one or more processing units; optionally, processor 810 integrates an application processor and a modem processor, wherein the application processor mainly handles operations involving the operating system, user interface, and applications, and the modem processor mainly handles wireless display signals, such as a baseband processor. It is understood that the aforementioned modem processor may also not be integrated into processor 810.

[0145] This application also provides a readable storage medium storing a program or instructions. When the program or instructions are executed by a processor, they implement the various processes of the above-described incoming call processing method embodiments and achieve the same technical effect. To avoid repetition, they will not be described again here.

[0146] The processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes computer-readable storage media, such as computer read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.

[0147] In addition, this application embodiment provides another chip, which includes a processor and a display interface. The display interface and the processor are coupled. The processor is used to run programs or instructions to implement the various processes of the above-described incoming call processing method embodiment and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0148] It should be understood that the chip mentioned in the embodiments of this application may also be referred to as a system-on-a-chip, system chip, chip system, or system-on-a-chip, etc.

[0149] This application provides a computer program product, which is stored in a storage medium and executed by at least one processor to implement the various processes of the above-described call handling method embodiments, and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0150] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0151] Furthermore, it should be noted that the scope of the methods and apparatus in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.

[0152] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a computer software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods of the various embodiments of this application.

[0153] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.

Claims

1. A shooting control method, characterized in that, include: Obtain information about the user's shooting intent; Based on the user's shooting intention information and the device information of at least two shooting devices, determine the shooting control information for each of the shooting devices; A shooting instruction is sent to each of the shooting devices, the shooting instruction carrying the shooting control information, the shooting instruction being used to instruct each of the shooting devices to shoot according to the shooting control information.

2. The method according to claim 1, characterized in that, The step of determining the shooting control information for each shooting device based on the user's shooting intention information and the device information of at least two shooting devices includes: Based on the user's shooting intention information, a shooting trajectory is generated; Based on the shooting trajectory and the device information of the at least two shooting devices, the shooting control information of each shooting device is determined.

3. The method according to claim 2, characterized in that, The shooting control information includes zoom ratio, the shooting trajectory includes a cooperative zoom trajectory, the cooperative zoom trajectory includes at least two zoom key points and a zoom timestamp for each zoom key point and a zoom ratio corresponding to the zoom timestamp; The step of determining the shooting control information for each of the at least two shooting devices according to the shooting trajectory includes: Based on the cooperative zoom trajectory, and according to the device information of the at least two shooting devices and the overlapping area of ​​the field of view of each pair of cooperating shooting devices, the zoom magnification of each zoom key point is determined. The overlapping area of ​​the field of view is determined by the device information of the at least two shooting devices.

4. The method according to claim 2, characterized in that, The device information includes the shooting device information of each shooting device and the gimbal device information of the gimbal device that is communicatively connected to each shooting device. The shooting control information includes the movement parameters of the shooting device driven by the gimbal device. The shooting trajectory includes a camera movement shooting path, which includes at least two camera movement critical points. Each pair of adjacent camera movement critical points constitutes a spatial path segment. Each camera movement critical point corresponds to a camera movement timestamp. The spatial path corresponds to a shooting angle. The step of determining the shooting control information for each of the at least two shooting devices according to the shooting trajectory includes: According to the camera movement shooting path, based on the equipment information of the at least two shooting devices and the first field of view adjacent area of ​​each of the at least two shooting devices that are shooting together, for the shooting device that shoots each of the two adjacent camera movement critical points and the spatial path segment formed by each of the two adjacent camera movement critical points, the timestamp of the pan-tilt device driving the shooting device to move and the movement parameters corresponding to the timestamp are determined. The first field of view adjacent region is determined by the gimbal device information of the gimbal device that is communicatively connected to each of the two co-shooting shooting devices.

5. The method according to claim 2, characterized in that, The at least two shooting devices include a first type of shooting device that is communicatively connected to a gimbal device and a second type of shooting device that is not communicatively connected to a gimbal device. The device information of the first type of shooting device includes the first shooting device information of the first type of shooting device and the gimbal device information of the gimbal device that is communicatively connected to the first type of shooting device. The device information of the second type of shooting device includes the second shooting device information of the second type of shooting device. The first shooting control information of the first type of shooting device includes the zoom ratio and the movement parameters of the shooting device driven by the gimbal device; the shooting control information of the second type of shooting device includes the zoom ratio. The shooting trajectory includes a coordinated camera movement trajectory, which includes at least three shooting points. The at least three shooting points include at least one zoom key point and at least two camera movement critical points. Each zoom key point corresponds to a zoom timestamp, and each camera movement critical point corresponds to a camera movement timestamp. The shooting path segment formed by each pair of adjacent camera movement critical points in the at least two camera movement critical points corresponds to a shooting angle.

6. The method according to claim 5, characterized in that, The step of determining the shooting control information for each of the at least two shooting devices according to the shooting trajectory includes: According to the coordinated camera movement trajectory, based on the device information of the at least two shooting devices and the adjacent area of ​​the second field of view of the first type of shooting device and the second type of shooting device in coordinated shooting, a zoom ratio is assigned to the shooting device shooting the zoom key point, and a movement timestamp, a movement parameter corresponding to the timestamp, and a zoom ratio for shooting the shooting path segment formed by the two adjacent camera movement critical points are assigned to the second type of shooting device shooting the two adjacent camera movement critical points. The second field of view adjacent area is determined by the first shooting device information of the first type of shooting device that is cooperating with the first type of shooting device, the gimbal device information of the gimbal device that is communicatively connected to the first type of shooting device, and the second shooting device information of the second type of shooting device that is cooperating with the first type of shooting device.

7. The method according to claim 1, characterized in that, Sending a shooting command to each of the shooting devices includes: A shooting command is sent to each of the shooting devices via a low-latency communication network; wherein the shooting command further includes a global synchronization clock signal, which is used to align the shooting time of the at least two shooting devices.

8. The method according to claim 1, characterized in that, After sending a shooting command to each of the shooting devices, the method further includes: Receive video data sent by the at least two shooting devices, wherein the video data is captured by the shooting devices in accordance with the shooting control information; Based on the first image in the video data of the first shooting device and the second image in the video data of the second shooting device, the difference information between the first image and the second image is determined. The difference information includes at least one of the following: deformation information of the first image and the second image, and color difference information of the first image and the second image. The first shooting device and the second shooting device are two shooting devices that cooperate in shooting among the at least two shooting devices. Based on the difference information, the target image is corrected to obtain a corrected image, wherein the target image includes at least one of the following: an image in the video data of the first shooting device, and an image in the video data of the second shooting device; Based on the corrected image and the target image, the continuous video data captured by the first shooting device and the second shooting device are determined.

9. A shooting control method, characterized in that, include: Receive a shooting instruction sent by the main control device, the shooting instruction carrying shooting control information; Capture images according to the captured images control information.

10. The method according to claim 9, characterized in that, The shooting command is sent by the main control device through a low-latency communication network; the method further includes: The image is sent to the master control device via the low-latency communication network.

11. A shooting control device, characterized in that, include: The acquisition module is used to acquire information about the user's shooting intent. The determining module is used to determine the shooting control information of each of the shooting devices based on the user's shooting intention information and the device information of at least two shooting devices; The sending module is used to send a shooting instruction to each of the shooting devices. The shooting instruction carries the shooting control information and is used to instruct each of the shooting devices to shoot according to the shooting control information.

12. A shooting control device, characterized in that, include: The receiving module is used to receive shooting instructions sent by the main control device, wherein the shooting instructions carry shooting control information; The shooting module is used to capture images according to the shooting control information.

13. An electronic device, characterized in that, It includes a processor and a memory, the memory storing a program or instructions that can run on the processor, the program or instructions being executed by the processor to implement the steps of the shooting control method as described in any one of claims 1 to 8 or the steps of the shooting control method as described in claim 9 or 10.

14. A readable storage medium, characterized in that, The readable storage medium stores a program or instructions that, when executed by a processor, implement the steps of the shooting control method as described in any one of claims 1 to 8 or the steps of the shooting control method as described in claim 9 or 10.

Images