Shooting device control method, live content generation method and device

Abstract

The application discloses a shooting device control method, a live content generation method and device. The shooting device control method comprises the following steps: obtaining a user viewing demand; determining a regulation and control decision for a shooting device according to the user viewing demand; and controlling the shooting device according to the regulation and control decision. Through the shooting device control method disclosed in the embodiment of the application, the user is not limited to the interaction of text and voice or the interaction of waiting for the anchor to ask questions and answer, the shooting device can be controlled according to the real-time viewing intention of the user, the interactive participation of the user is improved, the shooting device can be dynamically adjusted according to the real-time viewing intention of the user, and the viewing demand of the user is maximally met.

Description

Technical Field

[0001] This invention relates to the field of intelligent control technology, and in particular to a method for controlling a shooting device, a method for generating live streaming content, and an apparatus. Background Technology

[0002] In current filming scenarios, especially live streaming, the control of filming equipment remains largely manual or pre-programmed. This lack of dynamic and intelligent scheduling and control based on real-time user intent results in a lack of effective interaction with the user during filming. Furthermore, live streaming incurs excessively high labor costs and cannot be conducted for extended periods, while non-live streaming hours result in significant resource waste for businesses. Summary of the Invention

[0003] To address at least one technical problem existing in the prior art, embodiments of the present invention provide a shooting device control method, a live streaming content generation method, and an apparatus. The technical solution is as follows: Firstly, a method for controlling a shooting device is provided, the method comprising: Obtain user viewing preferences; The decision to adjust the shooting equipment is determined based on the user's viewing needs. The shooting equipment is controlled according to the aforementioned control decision.

[0004] Furthermore, the step of determining the control decision for the shooting equipment based on the user's viewing needs includes: Obtain the current status of the candidate shooting devices; Based on the current state of the candidate shooting devices, the selected shooting device to perform the shooting task is determined, and a device call decision is generated; The device control decision for the selected shooting device is determined based on the user's viewing needs.

[0005] Further, the step of determining the selected shooting device to perform the shooting task based on the current state of the candidate shooting devices and generating a device invocation decision includes: Based on the current state of the candidate shooting devices, the selected shooting device is determined according to a preset scheduling rule. The current state of the candidate shooting device includes any one or more of the following: the current location, current working state, current battery level, and current performance parameters of the candidate shooting device.

[0006] Furthermore, the step of determining the device control decision for the selected shooting device based on the user's viewing needs includes: Based on the user's viewing needs, a target camera movement method is selected from a preset camera movement orientation library to generate a camera movement decision. The camera movement orientation library includes any one or more of the following camera movement methods: panoramic, close-up, overhead camera movement, eye level, fixed lens, left front side, right front side, left rear side, right rear side, front, rear, left side, and right side.

[0007] Furthermore, the generation device control decision for determining the selected shooting device based on the user's viewing needs includes: According to the target camera movement method of the selected camera, the camera movement parameters are determined for the selected camera and a scene control decision is generated. The camera movement parameters are calculated based on the three-dimensional spatial model of the shooting scene and include any one or more of the following: movement trajectory, shooting angle and movement speed.

[0008] Further, determining the movement trajectory of the selected shooting device based on the target camera movement method includes: The subject to be filmed is determined based on the user's viewing needs; The position of the object being photographed is determined based on a three-dimensional spatial model of the shooting scene; The movement trajectory of the selected shooting device is determined and calculated based on the target camera movement method and the position of the subject being photographed.

[0009] Further, determining the shooting angle of the selected shooting device based on the target camera movement method includes: The subject to be filmed is determined based on the user's viewing needs; The shooting distance corresponding to the shooting object is determined according to the target camera movement method, wherein the shooting object is preset with shooting distances corresponding to each of the camera movement methods; The shooting angle of the selected shooting device is determined according to the shooting distance.

[0010] Furthermore, the acquisition of user viewing needs includes: Obtain interactive information from the live stream, including: real-time public chat messages and / or structured instructions triggered by interactive Q&A; The user's viewing needs are categorized and identified based on the interactive information.

[0011] Secondly, a method for generating live streaming content is provided, the method comprising: The shooting device is controlled using the shooting device control method as described in any of the first aspects; A live stream is generated based on the images captured by the imaging device; The broadcast content is determined according to the user's viewing needs, and the broadcast content includes any one or more of the following: product introduction, lead generation and traffic attraction, and sales guidance.

[0012] Further, generating a live stream from images captured by the shooting device includes: Acquire a fixed image captured by the shooting device and use the fixed image as the underlying background image; Acquire the moving image captured by the shooting device and place the moving image on top of the background image; The live stream is created by combining a fixed image with a moving image.

[0013] Thirdly, a shooting device control device is provided, the device comprising: The demand acquisition module is used to acquire user viewing needs; The decision-making module is used to determine the control decision for the shooting equipment based on the user's viewing needs. The device control module is used to control the shooting device according to the control decision.

[0014] Furthermore, the information acquisition module is also used to acquire the current status of the candidate shooting devices; The decision-making module includes: The device invokes the decision generation module to determine the selected shooting device to perform the shooting task based on the current status of the candidate shooting devices; The device control decision generation module is used to determine the device control decision of the selected shooting device based on the user's viewing needs.

[0015] Furthermore, the device invokes the decision generation module, specifically for: Based on the current status of the candidate shooting devices, the selected shooting device is determined according to the preset scheduling rules. The current status of the candidate shooting device includes any one or more of the following: the current location, current working status, current battery level, and current performance parameters.

[0016] Furthermore, the equipment control decision generation module includes: The camera movement decision generation module is used to select a target camera movement method from a preset camera movement orientation library based on the user's viewing needs and generate a camera movement decision. The camera movement orientation library includes any one or more of the following camera movement methods: wide shot, close-up, overhead shot, eye-level shot, fixed shot, left front side, right front side, left rear side, right rear side, directly in front, directly behind, directly to the left, and directly to the right.

[0017] Furthermore, the equipment control decision generation module also includes: The scene control decision generation module is used to determine the camera movement parameters for the selected camera according to the camera movement method of the selected camera and generate scene control decisions. The camera movement parameters are calculated based on the three-dimensional spatial model of the shooting scene and include any one or more of the following: movement trajectory, shooting angle and movement speed.

[0018] Furthermore, the scene control decision generation module is specifically used for: Determine the shooting subjects based on the user's viewing needs; The placement of the products to be photographed is determined based on the three-dimensional spatial model of the shooting scene; The movement trajectory of the selected shooting equipment is determined and calculated based on the target camera movement method and the placement of the subject.

[0019] Furthermore, the scene control decision generation module is specifically used for: Determine the subject to be photographed based on the user's intent; The shooting distance corresponding to the subject is determined based on the target camera movement method, wherein the shooting distance corresponding to different camera movements is preset for the subject. Determine the shooting angle of the selected shooting equipment based on the shooting distance.

[0020] Furthermore, the requirements elicitation module includes: The information acquisition module is used to acquire interactive information from the live stream, including: real-time public screen bullet comments and / or structured instructions triggered by interactive Q&A. The demand analysis module is used to classify and identify user viewing needs based on interactive information.

[0021] Fourthly, a live streaming content generation device is provided, the device comprising: A shooting control module is used to control a shooting device using the shooting device control method described in any one of the first aspects; The image generation module is used to generate live video based on the images captured by the shooting device. The content generation module is used to determine the broadcast content according to the user's viewing needs. The broadcast content includes any one or more of the following: product introduction, lead generation and lead attraction, and sales guidance.

[0022] Fifthly, an electronic device is provided, comprising: One or more processors; and A memory associated with the one or more processors, the memory being used to store program instructions that, when read and executed by the one or more processors, perform the method as described in any of the first aspects.

[0023] In a sixth aspect, a computer-readable medium is provided having a computer program stored thereon, wherein the program, when executed by a processor, implements the method as described in any of the first aspects.

[0024] The beneficial effects of the technical solutions provided in the embodiments of the present invention include at least the following: 1. The shooting device control method disclosed in the embodiments of the present invention enables users to go beyond just text and voice interaction or waiting for the host to ask and answer questions. Users can control the shooting device according to their real-time viewing intentions, thereby increasing user participation. The shooting device can be dynamically adjusted according to the user's real-time viewing intentions to maximize the satisfaction of the user's viewing needs.

[0025] 2. In the live content generation method disclosed in the embodiments of the present invention, the live screen is generated by calling and controlling the images captured by the shooting device according to the user's viewing needs, and the broadcast content is determined according to the user's viewing needs. This can improve the synchronization between the broadcast content and the live screen, and ensure that both the live screen and the broadcast content meet the user's viewing needs, thereby maximizing the effectiveness of interaction with the user and satisfying the user's viewing needs. Attached Figure Description

[0026] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0027] Figure 1 This is a schematic flowchart of the shooting device control method provided in the embodiment of the present invention; Figure 2 This is a schematic flowchart of the live content generation method provided in an embodiment of the present invention; Figure 3 This is a schematic flowchart illustrating the live content generation method under various user demand scenarios provided in the embodiments of the present invention; Figure 4 This is a schematic flowchart of a live content generation method for collaborative control of multiple types of shooting devices provided in an embodiment of the present invention; Figure 5 This is a schematic flowchart illustrating the application of the live content generation method disclosed in the embodiments of the present invention in combination with various live streaming methods. Figure 6 This is a schematic diagram of the control device structure for the shooting equipment provided in an embodiment of the present invention; Figure 7 This is a schematic diagram of the structure of the live content generation device provided in an embodiment of the present invention; Figure 8This is a schematic diagram of the electronic device structure provided in an embodiment of the present invention. Detailed Implementation

[0028] To make the objectives, technical solutions, and advantages of this invention clearer, the technical solutions of the embodiments of this invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this invention, and not all embodiments. Based on the embodiments of this invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this invention.

[0029] Currently, in shooting scenarios such as intelligent live streaming, live streaming in real-world settings, and video shooting, common shooting solutions mainly rely on fixed-position cameras or manually operated equipment for moving and shooting. The shooting process is difficult to keep up with the audience's needs in real time, and manual operation of shooting equipment is labor-intensive, lacking intelligent control solutions for shooting equipment.

[0030] like Figure 1 As shown, the present invention provides a method for controlling a shooting device, a method for generating live streaming content, and an apparatus, the specific technical solutions of which are as follows: S1. Obtain user viewing needs.

[0031] S2. Determine the adjustment decisions for the shooting equipment based on the user's viewing needs.

[0032] S3. Control the shooting equipment according to the control decision.

[0033] In step S1 above, as an optional case, "user" mainly refers to viewers watching the video, and "user viewing needs" mainly refers to the viewers' real-time viewing intentions. These viewing needs can be extracted from real-time bullet comments, real-time messages, and interactive information such as Q&A sessions sent by viewers on the public screen. Alternatively, "user" can refer to the entity controlling the shooting equipment, such as a director, physical anchor, virtual anchor, or live stream operator. "User viewing needs" mainly refers to the entity's real-time control needs of the shooting equipment, which can be extracted from real-time shooting instructions sent by the entity to the shooting equipment. Exemplarily, the shooting equipment control method disclosed in this embodiment of the invention, in a live streaming shooting scenario, can control the shooting equipment according to the viewers' real-time viewing intentions to intelligently realize those intentions, or it can control the shooting equipment according to the anchor's real-time instructions to intelligently realize those intentions.

[0034] In step S2 above, the shooting equipment may include: a camera, a webcam, a robot with shooting capabilities, a drone, or other aerial camera equipment. Additionally, the shooting equipment may include: audio recording equipment, and lighting equipment. For example, the shooting object and shooting angle can be determined according to the user's viewing needs, and a control decision can be made based on the position of the shooting object and the shooting angle to activate the camera equipment and lighting equipment.

[0035] The aforementioned control decisions can include equipment deployment decisions and control decisions. Equipment deployment decisions primarily refer to determining the optimal shooting device for a given task when multiple shooting devices or multiple candidate devices of the same type exist. This can be done either by determining the optimal shooting device based on priority rules or by determining the optimal shooting device based on preset deployment rules. Equipment deployment decisions enable the coordinated deployment of multiple shooting devices. For example, simultaneously deploying drones and shooting robots to perform multi-dimensional shooting of a subject, or simultaneously deploying shooting robots and lighting equipment to achieve intelligent lighting and coordinated shooting control of the subject. For instance, the optimal shooting device can be determined through preset deployment rules or by using a large model based on the current state of the candidate shooting devices.

[0036] Equipment control decisions primarily refer to the operational decisions made regarding the selected shooting equipment. Different types of shooting equipment require different control decisions. For example, for shooting equipment with video recording capabilities, control decisions include camera movement decisions and scene control decisions. Camera movement decisions mainly include camera movement methods and function selection, while scene control decisions mainly refer to the movement control of the shooting equipment, including movement trajectory and angle. For audio recording equipment, control decisions include movement control and audio intensity adjustment. For lighting equipment, control decisions may include movement control, lighting intensity, and color control. Control decisions for different types of shooting equipment can be combined. For example, control decisions may include movement control of the video recording equipment, distance adjustment of the audio recording equipment, movement control of the lighting equipment, and selection of lighting intensity functions.

[0037] As described above, in step S3, controlling the shooting device can be achieved through the integration of the shooting device's SDK, enabling precise programming control of the shooting device. Based on the control decisions, a specific sequence of control commands is generated. For example, for drones or other aircraft, the onboard computer of the drone or other aircraft can be integrated to control its take-off and landing, waypoint flight, gimbal control, and acquisition of video streams captured by the drone or other aircraft.

[0038] The shooting device control method disclosed in this invention allows users to go beyond just text and voice interaction or waiting for a host to ask and answer questions. It enables users to control the shooting device in real time, increasing user engagement. The shooting device can be dynamically adjusted according to the user's real-time viewing intentions to maximize the satisfaction of the user's viewing needs.

[0039] In one embodiment, step S1 includes: Obtain interactive information from the live stream, including: real-time public chat messages and / or structured instructions triggered by interactive Q&A; User viewing needs are categorized and identified based on interactive information.

[0040] As exemplified above, the live stream message stream OpenAPI provided by the live streaming platform can be accessed to obtain real-time public screen comments or voice interactions. Simultaneously, user intent can be obtained by receiving structured instructions triggered by internal interactive Q&A. For example, Natural Language Processing (NLP) and keyword recognition APIs can be used to classify and identify user viewing needs. As an optional approach, user viewing needs can be classified according to camera movement, with the classification categories corresponding to the camera movement methods, such as: panoramic, close-up, overhead shot, eye-level, fixed shot, left front side, right front side, left rear side, right rear side, directly in front, directly behind, directly to the left, directly to the right. For example, if a viewer posts a comment in the live stream public screen: "See the overall image of the car," and the interactive information is extracted from the comment: viewing object: car, camera movement: panoramic, then the user viewing need is classified as: panoramic. As an optional approach, multiple classification conditions can be combined to categorize user viewing needs. For example, when a live stream has multiple products on display, they can be categorized according to product name and camera movement. Similarly, when interactive information includes multiple viewing conditions (such as viewing angle and brightness requirements), they can be categorized according to camera movement and lighting method.

[0041] The embodiments disclosed in the present invention, as described above, can acquire interactive information through multiple channels, and achieve rapid, efficient, and low-cost extraction of user viewing needs through classification, matching rapidly updated interactive information as much as possible, and maximizing the extraction of user viewing needs.

[0042] In one embodiment, step S2 includes: Obtain the current status of the candidate shooting devices; Based on the current status of the candidate shooting devices, the selected shooting device to perform the shooting task is determined, and a device call decision is generated; The device control decision for selecting the shooting equipment is determined based on the user's viewing needs.

[0043] Regarding the control decision mentioned above, candidate shooting devices can be different types of shooting devices, or multiple devices of the same type. The selected shooting device can be a single shooting device, or multiple shooting devices of different types, or multiple devices of the same type. In the embodiments disclosed in this invention, the selected shooting device for performing the shooting task is first determined, and then the control decision for the selected shooting device is determined. This allows for the reasonable and full utilization of the shooting devices, improving the presentation effect and meeting the user's viewing needs.

[0044] Device call decisions can include: single device call decisions, single type of multiple device call decisions, and multi-type device collaborative call decisions.

[0045] For shooting equipment with camera function, equipment control decisions may include: camera movement decisions and scene control decisions, wherein camera movement decisions include camera movement methods, and scene control decisions are determined based on the three-dimensional spatial model of the shooting scene.

[0046] As an optional scenario, scene control decisions correspond to camera movement decisions, with one camera movement decision potentially corresponding to one or more scene control decisions. Scene control decisions are pre-set for each camera movement decision. These decisions are based on the 3D spatial model of the shooting scene and primarily refer to the movement control of the shooting equipment, including movement coordinates, movement angles, and movement speed. By pre-setting scene control decisions corresponding to camera movement decisions, the scene control decisions can be determined immediately after the camera movement decision is made, improving the ability to quickly respond to user viewing needs.

[0047] Alternatively, scene control decisions can be generated in real-time based on a 3D spatial model of the shooting scene after the camera movement decision is determined. For example, the movement trajectory of the shooting device is calculated based on the position of the subject in the 3D spatial model, the camera movement method, and the current position of the shooting device. The shooting angle is determined according to the camera movement method, while the flight speed can be preset manually. By calculating scene control decisions in real time, there is no need to pre-configure a large number of scene control decisions, reducing the amount of pre-setting work.

[0048] For radio equipment, control decisions can include distance control decisions and adjustment decisions. Distance control decisions primarily control the pickup distance. Adjustment decisions can include functional controls such as volume, signal-to-noise ratio, directivity, low-frequency cutoff, delay / synchronization, and monitoring.

[0049] For lighting equipment, equipment control decisions may include orientation decisions and adjustment decisions. Orientation decisions may include front lighting, side lighting, backlighting, top lighting, bottom lighting, etc. Adjustment decisions may include functional controls such as illuminance, color temperature, light quality, and light ratio.

[0050] In one embodiment, step S2, which determines the selected shooting device to perform the shooting task based on the current state of the candidate devices and generates a device invocation decision, includes: Based on the current status of the candidate shooting devices, the selected shooting device is determined according to the preset scheduling rules. The current status of the candidate shooting device includes any one or more of the following: the current location, current working status, current battery level, and current performance parameters.

[0051] As described above, the decision-making process can determine the selected shooting device by setting the priority of device calls. In this embodiment of the invention, the optimal selected shooting device can be determined based on the current state of the candidate shooting devices. Based on the current location of the candidate shooting devices, a preset scheduling rule can be used to determine the candidate shooting device with the shortest travel distance to the shooting object to perform the shooting task; based on the current working state of the candidate shooting devices, a preset scheduling rule can be used to determine the shooting device in an idle state to perform the shooting task; based on the current battery parameters of the candidate shooting devices, a preset scheduling rule can be used to determine the shooting device with sufficient battery power to perform the shooting task; based on the current performance parameters of the candidate shooting devices, a preset scheduling rule can be used to determine the shooting device whose performance meets the shooting requirements to perform the shooting task. For example, for a waiting-working-charging cycle queue containing at least 3 drones: the current state of the waiting drones is obtained, and the selected drone to perform the task is determined based on the current state of the waiting drones. The current battery level of the waiting drones is obtained, and the scheduling rule for the waiting drones may include: when the battery level of the waiting drone is lower than a threshold X%, it is controlled to intelligently return to the charging dock; simultaneously, the next drone with sufficient battery power (battery power > Y%) is scheduled from the waiting drone queue to take off and take over the task, achieving seamless relay.

[0052] In one embodiment, step S2, which determines the generation device control decision for the selected shooting device based on user viewing needs, includes: Based on the user's viewing needs, a target camera movement method is selected from a preset camera movement orientation library to generate a camera movement decision. The camera movement orientation library includes any one or more of the following camera movement methods: panoramic, close-up, and 12 standard camera movement orientations: overhead shot, eye-level, fixed lens, left front side, right front side, left rear side, right rear side, directly in front, directly behind, directly to the left, and directly to the right.

[0053] As described above, by mapping user viewing needs to camera movement methods in the camera movement library, the corresponding target camera movement method can be selected from the library based on the user's viewing needs. Furthermore, if there is no user feedback, a target camera movement method can be randomly or sequentially selected from the camera movement library at preset time intervals or based on the narration content for live-action camera movement.

[0054] In one embodiment, step S2, which determines the device control decision for the selected shooting device based on the user's viewing needs, further includes: The camera movement parameters of the selected camera are determined according to the camera movement method of the selected camera, and scene control decisions are generated. The camera movement parameters are calculated based on the three-dimensional spatial model of the shooting scene and include any one or more of the following: movement trajectory, shooting angle and movement speed.

[0055] The camera movement parameters described above are calculated based on a pre-defined 3D scene space model (length, width, and height). Alternatively, scene control decisions can be pre-set for each camera movement method; once the camera movement method is determined, the scene control decisions can be determined. For example, close-up camera movements correspond to fixed shooting distances and angles, thus allowing the acquisition of the camera's movement trajectory and shooting angle. Alternatively, scene control decisions can be calculated in real-time based on the camera movement method and the 3D space model of the shooting scene.

[0056] In one embodiment, determining the movement trajectory of the selected shooting device based on the target camera movement method includes: Determine the shooting subjects based on the user's viewing needs; The position of the subject is determined based on the three-dimensional spatial model of the shooting scene; The movement trajectory of the selected shooting equipment is determined and calculated based on the target camera movement method and the position of the subject.

[0057] As described above, based on the location of the subject being filmed, the correct subject is selected and locked. For example, if each product is labeled with its name, and the interactive information guides the user's viewing needs to a specific product name, the filming device will select and lock onto that product through visual calculations. The target position of the selected filming device can be determined based on the target camera movement method and the position of the subject, and then the movement trajectory of the selected filming device can be calculated. As an option, movement trajectories can be determined for different target positions using preset movement rules, which can be determined based on the shortest distance principle.

[0058] In one embodiment, determining the shooting angle of the selected shooting device based on the target camera movement includes: Determine the shooting subjects based on the user's viewing needs; The shooting distance corresponding to the subject is determined based on the target camera movement method, wherein the shooting distance corresponding to different camera movements is preset for the subject. Determine the shooting angle of the selected shooting equipment based on the shooting distance.

[0059] The shooting angles described above are determined by the pre-set distances between the different subjects being filmed. The distance between the shooting device and the subject can be set based on the screen ratio of the subject on the display terminal. For example, for close-up shots, the distance is the distance between the center coordinates of a single subject and the drone (the setting principle is that the entire product occupies 80%-90% of the phone screen); for distant shots, the distance is the distance between the entire shooting scene and the drone (the setting principle is that the center of the entire live streaming scene is the coordinate, and 80%-90% of the scene appears on the phone screen). A preset camera movement library is used for real-world camera movement. The minimum visual angle is selected when the drone is 1.3 meters above the ground for flight camera movement, and the flight speed can be preset to 1-1.5 meters per second.

[0060] The shooting equipment control method disclosed in this invention can be applied to the scheduling and control of shooting equipment in live streaming scenarios such as real anchor live streaming scenarios, live streaming scenarios without anchors, and intelligent live streaming by AI digital humans or AI live streaming software. It can also be applied to the scheduling and control of shooting equipment in video shooting scenarios.

[0061] For example, the AI ​​digital human can interact with intelligent live streaming software or AI live streaming software via IPC (Inter-Process Communication) or RPC (Remote Procedure Call) interfaces. Callable functions include, but are not limited to, triggering customer intent and specific live streaming script segments: for example, if the viewer's intent is a panoramic view of product A, the AI ​​digital human or AI live streaming software will deploy a drone to perform a standard camera movement of the panoramic view of product A, providing a brief introduction and attracting customers to leave leads or guide sales, as well as sending a screen switching signal to OBS or mainstream live streaming platforms. If the scrolling of customer intent in the live stream comments is too fast, the AI ​​digital human or AI live streaming software will randomly select a customer intent for live streaming control, while simultaneously guiding the customer to stay in the live stream through scripted dialogue, quickly explaining the product, etc. If there is no customer intent to trigger the live stream, the AI ​​digital human or AI live streaming software will perform pre-set specific live streaming scripts based on the overall live streaming scenario and the products being streamed. It will also explain the products and use a library of 12 standard camera positions for live streaming. For example, the overall live streaming scenario will be filmed approximately every 5 minutes for 1 minute; a single product will be filmed approximately every 3 minutes for 1 minute. During the pre-set live streaming plan, the AI ​​digital human or AI live streaming software will broadcast the live stream based on the pre-set live streaming scripts, and will provide guidance such as sending private messages, leaving contact information, prompting, liking, forwarding, and ordering every 1 minute.

[0062] like Figure 2 As shown, based on the shooting device control method disclosed in the above embodiments of the present invention, the present invention also discloses a live broadcast content generation method, including: S1' controls the shooting device using the shooting device control method disclosed in the embodiments of the present invention; S2' generates a live stream based on images captured by the camera. S3' determines the broadcast content based on user viewing needs, which includes any one or more of the following: product introduction, lead generation and lead generation, and sales guidance.

[0063] In the above-described live content generation method disclosed in this embodiment of the invention, the live screen is generated by calling and controlling the images captured by the shooting device according to the user's viewing needs, and the broadcast content is determined according to the user's viewing needs. This can improve the synchronization between the broadcast content and the live screen, ensuring that both the live screen and the broadcast content meet the user's viewing needs, maximizing the effectiveness of interaction with the user, and satisfying the user's viewing needs.

[0064] In one embodiment, step S2' includes: Acquire a fixed image captured by the shooting device and use the fixed image as the underlying background image; Acquire the moving image captured by the shooting device and place the moving image on top of the background image; The static and moving images are combined to create a live broadcast.

[0065] As described above, the underlying background image can include a fixed image captured by one camera or fixed images captured by multiple camera devices; the moving image can include a moving image captured by one camera or moving images captured by multiple camera devices. The live streaming content generation method disclosed in this embodiment of the invention can simultaneously display fixed images and multi-angle moving images in the live stream, allowing users to achieve a multi-dimensional, immersive viewing experience.

[0066] like Figure 3 As shown below, the schematic flow of the live content generation method disclosed in the embodiments of the present invention is illustrated in various user demand scenarios: After the live streaming system starts, it loads preset scene strategies, which may include: exhibition hall, trade show, personal mode, etc. In the input layer, it acquires text or voice information and visual recognition results from public screen interactions. Specifically, in the core decision layer, it analyzes the interactive information input from the input layer through information fusion and contextual understanding to obtain user needs, including user viewing needs and user interaction needs. Based on preset scheduling strategies, it determines the control decisions for shooting equipment according to user viewing needs, including prioritizing drones, shooting robots, or a combination of both; based on user interaction needs, it determines whether the user needs content interaction or conversion guidance. If the user needs content interaction, it generates explanations or marketing instructions and calls voice services or AI digital human services; if the user needs conversion guidance, it guides the user to leave contact information or displays product cards.

[0067] like Figure 4As shown, in a scenario where multiple types of shooting devices are controlled collaboratively, the schematic flow of the live content generation method disclosed in this embodiment of the invention includes: When the user's viewing needs determine that the control decisions require collaborative camera movement decisions involving both robots and drones, robot control commands and drone control commands are simultaneously distributed. Both control commands include camera movement decisions (such as gimbal tilt and lens dive as shown in the image) and control decisions (such as moving to point A and flying to point B as shown in the image). The robot and drone execute the control decisions to capture images of the target object, forming a live stream. The initial live stream is displayed in a dual-frame format, intelligently switching the main frame based on interaction or strategy.

[0068] Furthermore, the live streaming content generation method disclosed in this invention can be combined with various live streaming methods for content output and presentation. For example, such as... Figure 5 As shown: Users in the live stream interact via text or voice on the public screen. Based on user interactions, the system determines their viewing needs and then makes control decisions for drones and robots, which then generate a real-time video stream. Alternatively, control decisions can be made based on instructions from the live stream operations manager. A corresponding voice content matching the real-time video stream is generated through an intelligent voice interaction platform and broadcast and displayed via AI live streaming software. Alternatively, an narration audio-visual stream can be generated using AI digital humans or AI live streaming software platforms, then superimposed with real-time user interactions to form a processed intelligent live stream, which is finally pushed to the live streaming platform for display.

[0069] Based on the shooting device control method disclosed in the above embodiments of the present invention, such as Figure 6 As shown, this embodiment of the invention also provides a shooting device control device, including: The demand acquisition module 601 is used to acquire user viewing demands. The decision-making module 602 is used to determine the control decisions for the shooting equipment based on the user's viewing needs. The equipment control module 603 is used to control the shooting equipment according to the control decision.

[0070] The aforementioned control decisions can include equipment allocation decisions and equipment control decisions. Equipment allocation decisions mainly refer to determining the optimal shooting device for the task when multiple shooting devices or multiple candidate devices of the same type exist. Equipment allocation decisions enable the coordinated use of multiple shooting devices. Equipment control decisions mainly refer to the operational decisions regarding the selected shooting device, including camera movement decisions and scene control decisions.

[0071] In one embodiment, the demand acquisition module 601 includes: The information acquisition module is used to acquire interactive information from the live stream, including: real-time public screen bullet comments and / or structured instructions triggered by interactive Q&A. The demand analysis module is used to classify and identify user viewing needs based on interactive information.

[0072] In one embodiment, the information acquisition module is further configured to acquire the current state of the candidate imaging device. The decision determination module 602 includes: The device invokes the decision generation module to determine the selected shooting device to perform the shooting task based on the current status of the candidate shooting devices; The device control decision generation module is used to determine the device control decision of the selected shooting device based on the user's viewing needs.

[0073] The aforementioned device call decisions may include: single device call decisions, single-type multi-device call decisions, and multi-type device collaborative call decisions.

[0074] For shooting equipment with camera function, equipment control decisions may include: camera movement decisions and scene control decisions, wherein camera movement decisions include camera movement methods, and scene control decisions are determined based on the three-dimensional spatial model of the shooting scene.

[0075] For radio equipment, control decisions can include distance control decisions and adjustment decisions. Distance control decisions primarily control the pickup distance. Adjustment decisions can include functional controls such as volume, signal-to-noise ratio, directivity, low-frequency cutoff, delay / synchronization, and monitoring.

[0076] For lighting equipment, equipment control decisions may include orientation decisions and adjustment decisions. Orientation decisions may include front lighting, side lighting, backlighting, top lighting, bottom lighting, etc. Adjustment decisions may include functional controls such as illuminance, color temperature, light quality, and light ratio.

[0077] In one embodiment, the device invokes the decision generation module, specifically for: Based on the current status of the candidate shooting devices, the selected shooting device is determined according to the preset scheduling rules. The current status of the candidate shooting device includes any one or more of the following: the current location, current working status, current battery level, and current performance parameters.

[0078] In one embodiment, the device control decision generation module includes: The camera movement decision generation module is used to select a target camera movement method from a preset camera movement orientation library based on the user's viewing needs and generate a camera movement decision. The camera movement orientation library includes any one or more of the following camera movement methods: wide shot, close-up, overhead shot, eye-level shot, fixed shot, left front side, right front side, left rear side, right rear side, directly in front, directly behind, directly to the left, and directly to the right.

[0079] In one embodiment, the device control decision generation module further includes: The scene control decision generation module is used to determine the camera movement parameters for the selected camera according to the camera movement method of the selected camera and generate scene control decisions. The camera movement parameters are calculated based on the three-dimensional spatial model of the shooting scene and include any one or more of the following: movement trajectory, shooting angle and movement speed.

[0080] As an optional approach, scene control decisions can be pre-set for each camera movement method, and the scene control decisions can be determined once the camera movement method is determined. Alternatively, the scene control decisions can be calculated in real time based on the 3D spatial model of the camera movement method and the shooting scene.

[0081] In one embodiment, the scene control decision generation module is specifically used for: Determine the shooting subjects based on the user's viewing needs; The placement of the products to be photographed is determined based on the three-dimensional spatial model of the shooting scene; The movement trajectory of the selected shooting equipment is determined and calculated based on the target camera movement method and the placement of the subject.

[0082] In one embodiment, the scene control decision generation module is specifically used for: Determine the subject to be photographed based on the user's intent; The shooting distance corresponding to the subject is determined based on the target camera movement method, wherein the shooting distance corresponding to different camera movements is preset for the subject. Determine the shooting angle of the selected shooting equipment based on the shooting distance.

[0083] Based on the live streaming content generation method disclosed in the above embodiments of the present invention, such as Figure 7 As shown, this embodiment of the invention also provides a live streaming content generation device, including: The shooting control module 701 is used to control the shooting device using the shooting device control method disclosed in the embodiments of the present invention; The image generation module 702 is used to generate live broadcast images based on images captured by the shooting device. The content generation module 703 is used to determine the broadcast content according to the user's viewing needs. The broadcast content includes any one or more of the following: product introduction, lead generation and lead attraction, and sales guidance.

[0084] The aforementioned shooting control module 701 is specifically used for: Obtain user viewing preferences.

[0085] The decision to adjust the shooting equipment is determined based on the user's viewing needs.

[0086] Control the filming equipment according to the regulatory decision.

[0087] In one embodiment, the image generation module 702 includes: The background image determination module is used to obtain a fixed image captured by the shooting device and use the fixed image as the underlying background image. The moving image determination module is used to acquire the moving image captured by the shooting device and place the moving image on top of the background image. The image compositing module is used to combine static and moving images into a live broadcast image.

[0088] In addition, this invention also provides an electronic device, including: One or more processors; and A memory associated with the one or more processors, the memory being used to store program instructions, which, when read and executed by the one or more processors, perform the shooting device control method disclosed in the above embodiments.

[0089] Among them, such as Figure 8 As shown, computer device 12 is represented as a general-purpose computing device. Components of computer device 12 may include, but are not limited to: one or more processors or processing units 16, system memory 28, and a bus 18 connecting different system components (including system memory 28 and processing units 16). Bus 18 represents one or more of several bus architectures, including a memory bus or memory controller, a peripheral bus, a graphics acceleration port, a processor, or a local bus using any of the various bus architectures. For example, these architectures include, but are not limited to, the Industry Standard Architecture (ISA) bus, the Micro Channel Architecture (MAC) bus, the Enhanced ISA bus, the Video Electronics Standards Association (VESA) local bus, and the Peripheral Component Interconnect (PCI) bus.

[0090] Computer device 12 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by computer device 12, including volatile and non-volatile media, removable and non-removable media.

[0091] System memory 28 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 30 and / or cache memory 32. Computer device 12 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, storage system 34 may be used to read and write non-removable, non-volatile magnetic media (not shown, commonly referred to as a "hard disk drive"). Although not shown, disk drives for reading and writing to removable non-volatile disks (e.g., "floppy disks") and optical disk drives for reading and writing to removable non-volatile optical disks (e.g., CD-ROMs, DVD-ROMs, or other optical media) may be provided. In these cases, each drive may be connected to bus 18 via one or more data media interfaces. Memory 28 may include at least one program product having a set (e.g., at least one) of program modules configured to perform the functions of the embodiments of the present invention.

[0092] A program / utility 40 having a set (at least one) of program modules 42 may be stored, for example, in memory 28. Such program modules 42 include—but are not limited to—an operating system, one or more application programs, other program modules, and program data. Each or some combination of these examples may include an implementation of a network environment. Program modules 42 typically perform the functions and / or methods described in the embodiments of the present invention.

[0093] The computer device 12 can also communicate with one or more external devices 14 (e.g., keyboard, pointing device, display 24, etc.), and with one or more devices that enable a user to interact with the computer device 12, and / or with any device that enables the computer device 12 to communicate with one or more other computing devices (e.g., network card, modem, etc.). This communication can be performed via the input / output (I / O) interface 22. Furthermore, in this embodiment, the display 24 of the computer device 12 is not an independent entity, but is embedded in a mirror, so that when the display surface of the display 24 is not displayed, the display surface of the display 24 and the mirror surface visually blend together. Moreover, the computer device 12 can also communicate with one or more networks (e.g., local area network (LAN), wide area network (WAN), and / or public networks, such as the Internet) via the network adapter 20. As shown, the network adapter 20 communicates with other modules of the computer device 12 via the bus 18. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with computer device 12, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0094] The processing unit 16 executes various functional applications and data processing by running programs stored in the system memory 28.

[0095] The various embodiments in this specification are described in a progressive manner. Similar or identical parts between embodiments can be referred to mutually. Each embodiment focuses on describing the differences from other embodiments. In particular, for system or system embodiments, since they are basically similar to method embodiments, the description is relatively simple, and relevant parts can be referred to the descriptions in the method embodiments. The systems and system embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without creative effort.

[0096] The technical solutions provided in this application have been described in detail above. Specific examples have been used to illustrate the principles and implementation methods of this application. The descriptions of the above embodiments are only for the purpose of helping to understand the methods and core ideas of this application. Furthermore, those skilled in the art will recognize that, based on the ideas of this application, there will be changes in the specific implementation methods and application scope. Therefore, the content of this specification should not be construed as a limitation of this application.

[0097] All of the above-mentioned optional technical solutions can be combined in any way to form optional embodiments of the present invention, and will not be described in detail here.

[0098] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the protection scope of the present invention.

Claims

1. A photographing apparatus control method characterized by comprising: include: Obtain user viewing preferences; The decision to adjust the shooting equipment is determined based on the user's viewing needs. The shooting equipment is controlled according to the aforementioned control decision.

2. The photographing apparatus control method of claim 1, wherein, The step of determining the control decision for the shooting equipment based on the user's viewing needs includes: Obtain the current status of the candidate shooting devices; Based on the current state of the candidate shooting devices, the selected shooting device to perform the shooting task is determined, and a device call decision is generated; The device control decision for the selected shooting device is determined based on the user's viewing needs.

3. The photographing apparatus control method according to claim 2, wherein The step of determining the selected shooting device to perform the shooting task based on the current state of the candidate shooting devices and generating a device invocation decision includes: Based on the current state of the candidate shooting devices, the selected shooting device is determined according to a preset scheduling rule. The current state of the candidate shooting device includes any one or more of the following: the current location, current working state, current battery level, and current performance parameters of the candidate shooting device.

4. The shooting device control method as described in claim 2, characterized in that, The process of determining the selected shooting device based on the user's viewing needs includes: Based on the user's viewing needs, a target camera movement method is selected from a preset camera movement orientation library to generate a camera movement decision. The camera movement orientation library includes any one or more of the following camera movement methods: panoramic, close-up, overhead camera movement, eye level, fixed lens, left front side, right front side, left rear side, right rear side, front, rear, left side, and right side.

5. The shooting device control method as described in claim 4, characterized in that, The process of determining the selected shooting device based on the user's viewing needs includes: According to the target camera movement method of the selected camera, the camera movement parameters are determined for the selected camera and a scene control decision is generated. The camera movement parameters are calculated based on the three-dimensional spatial model of the shooting scene and include any one or more of the following: movement trajectory, shooting angle and movement speed.

6. The shooting device control method as described in claim 5, characterized in that, Determining the movement trajectory of the selected shooting device based on the target camera movement method includes: The subject to be filmed is determined based on the user's viewing needs; The position of the object being photographed is determined based on a three-dimensional spatial model of the shooting scene; The movement trajectory of the selected shooting device is calculated based on the target camera movement method and the position of the subject.

7. The shooting device control method as described in claim 5, characterized in that, Determining the shooting angle of the selected shooting device based on the target camera movement method includes: The subject to be filmed is determined based on the user's viewing needs; The shooting distance corresponding to the shooting object is determined according to the target camera movement method, wherein the shooting object is preset with shooting distances corresponding to each of the camera movement methods; The shooting angle of the selected shooting device is determined according to the shooting distance.

8. The shooting device control method as described in claim 1, characterized in that, The acquisition of user viewing needs includes: Obtain interactive information from the live stream, including: real-time public chat messages and / or structured instructions triggered by interactive Q&A; The user's viewing needs are categorized and identified based on the interactive information.

9. A method for generating live streaming content, characterized in that, include: The shooting device is controlled using the shooting device control method as described in any one of claims 1-8; A live stream is generated based on the images captured by the imaging device; The broadcast content is determined according to the user's viewing needs, and the broadcast content includes any one or more of the following: product introduction, lead generation and traffic attraction, and sales guidance.

10. The live streaming content generation method as described in claim 9, characterized in that, The step of generating a live stream based on images captured by the camera includes: Acquire a fixed image captured by the shooting device and use the fixed image as the underlying background image; Acquire the moving image captured by the shooting device and place the moving image on top of the background image; The live stream is created by combining a fixed image with a moving image.

11. A control device for a shooting equipment, characterized in that, include: The demand acquisition module is used to acquire user viewing needs; The decision-making module is used to determine the control decision for the shooting equipment based on the user's viewing needs. The device control module is used to control the shooting device according to the control decision.

12. A live streaming content generation device, characterized in that, include: A shooting control module is used to control a shooting device using the shooting device control method as described in any one of claims 1-8; The image generation module is used to generate live video based on the images captured by the shooting device. The content generation module is used to determine the broadcast content according to the user's viewing needs. The broadcast content includes any one or more of the following: product introduction, lead generation and lead attraction, and sales guidance.

13. An electronic device, characterized in that, include: One or more processors; as well as A memory associated with the one or more processors, the memory being used to store program instructions that, when read and executed by the one or more processors, perform the method as described in any one of claims 1 to 8.

14. A computer-readable medium having a computer program stored thereon, wherein, When the program is executed by the processor, it implements the method as described in any one of claims 1 to 8.

Images