Photographing method, intelligent terminal and storage medium

Abstract

This application proposes a shooting method, a smart terminal, and a storage medium. The shooting method includes: S11, responding to a preset event and outputting a shooting plan based on target information. This application does not limit the specific form of the shooting plan; it can be a static posture diagram or multiple shots, using multiple shots to achieve dynamic illustration functions, simultaneously providing guidance for static photography and video shooting. Each shot can include posture diagrams and other descriptions such as expressions, thereby providing richer guidance information and improving shooting results. In addition, the target information can include the current shooting scene, thereby enabling the output of a shooting plan based on the current shooting scene, thus achieving real-time shooting guidance and improving the user experience.

Description

Technical Field

[0001] This application relates to the field of photography technology, specifically to a photography method, a smart terminal, and a storage medium. Background Technology

[0002] With the development of technology, the camera function has become a basic feature of smartphones and other smart terminals. People's requirements for the camera function are also getting higher and higher, and they are no longer just focused on taking clearer images.

[0003] In conceiving and implementing this application, the inventors discovered at least the following problems: Currently, after a smart terminal activates its shooting function, the shooting guidance provided by the shooting interface is usually pre-set. That is, for different shooting scenarios or shooting modes, the smart terminal provides corresponding shooting guidance. For example, for a certain shooting scenario, a suitable posture diagram can be displayed on the shooting interface. The user then performs the posture corresponding to the diagram, and the smart terminal takes the picture. The posture diagram used for shooting guidance can be pre-set or generated in real-time based on AI-generated image processing. Pre-setting requires collecting data on a large number of scenarios or modes in advance, resulting in high labor costs and low flexibility, making it difficult to meet diverse user shooting needs. AI-generated image processing struggles to accurately grasp user needs, leading to a mismatch between the given posture diagram and the actual shooting scenario. Furthermore, regardless of the method, only simple posture diagrams are provided, offering limited guidance information and poor guidance effect. They also lack dynamic illustration capabilities, only supporting guidance for taking photos, not for video shooting.

[0004] The preceding description is intended to provide general background information and does not necessarily constitute prior art. Summary of the Invention

[0005] To address the aforementioned technical issues, this application provides a shooting method, a smart terminal, and a storage medium that can provide real-time, dynamic, and informative shooting guidance to improve the user experience for both taking photos and videos.

[0006] This application provides a display method, including the following steps:

[0007] S11. Responding to preset events, output shooting plans based on target information.

[0008] Optionally, the target information includes at least one of the following: video template, video overview, and current shooting scene.

[0009] Optionally, the output shooting scheme includes at least one of the following:

[0010] Generate multiple storyboards;

[0011] Determine the shooting parameters.

[0012] Optionally, generating multiple storyboards includes:

[0013] Acquire the captured content;

[0014] A processing strategy is obtained based on the target information;

[0015] The captured content is processed according to the processing strategy to output multiple storyboards.

[0016] Optionally, the step of obtaining the processing strategy based on the target information includes:

[0017] From the target information, determine the reference object, the target object, and the preset characteristics of the target object relative to the reference object;

[0018] A processing strategy is generated for the target object based on the preset features.

[0019] Optionally, the method further includes:

[0020] Set a corresponding display time period for each storyboard;

[0021] For each segment of the display period, acquire multiple frames of images obtained according to the shooting scheme;

[0022] The target image corresponding to the display period is generated based on the multi-frame images.

[0023] Optionally, the preset event includes at least one of the following:

[0024] Trigger the shooting assistant;

[0025] The changes in the shooting parameters of the current shooting scene exceed the preset threshold;

[0026] Switch from the first shooting scene to the second shooting scene;

[0027] The preset features of the preset objects in the current shooting scene have changed;

[0028] The target information was obtained.

[0029] Optionally, the method further includes:

[0030] In response to partition display, determine the target partition from at least two partitions;

[0031] Display all or all storyboards that meet the preset conditions in the target partition.

[0032] This application also provides a smart terminal, including: a memory and a processor, wherein the memory stores a shooting program, and when the shooting program is executed by the processor, it implements the steps of any of the shooting methods described above.

[0033] This application also provides a storage medium storing a computer program, which, when executed by a processor, implements the steps of any of the above-described shooting methods.

[0034] As described above, the technical solution of this application includes: S11, responding to a preset event and outputting a shooting plan based on target information. Here, this application does not limit the specific form of the shooting plan; for example, it can be an existing posture diagram or multiple shots. Multiple shots can achieve a dynamic illustration function, providing guidance for both still photography and video shooting. Each shot can include posture diagrams and other descriptions such as expressions, thereby providing richer guidance information and improving shooting results. Furthermore, the target information can include the current shooting scene, enabling the output of a shooting plan based on the current shooting scene, thus achieving real-time shooting guidance and improving the user experience. Attached Figure Description

[0035] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application. To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the description of the embodiments will be briefly introduced below. Obviously, those skilled in the art can obtain other drawings based on these drawings without any creative effort.

[0036] Figure 1 A schematic diagram of the hardware structure of a mobile terminal to implement the various embodiments of this application;

[0037] Figure 2 A communication network system architecture diagram provided for an embodiment of this application;

[0038] Figure 3 A schematic flowchart illustrating a shooting method provided in the first embodiment of this application;

[0039] Figure 4 This application provides a schematic diagram of an interface for invoking a shooting assistant.

[0040] Figure 5a This is a schematic diagram of the interface for the first type of target information provided in an embodiment of this application;

[0041] Figure 5b This is a schematic diagram of the interface for the second type of target information provided in an embodiment of this application;

[0042] Figure 5c This is a schematic diagram of the interface for the third type of target information provided in an embodiment of this application;

[0043] Figure 5d This is a schematic diagram of the interface for the fourth type of target information provided in the embodiments of this application;

[0044] Figure 6 This is a schematic diagram of an interface with multiple scenes provided in an embodiment of this application;

[0045] Figure 7 A flowchart illustrating another shooting method provided in the first embodiment of this application;

[0046] Figure 8 A schematic flowchart illustrating a shooting method provided in the second embodiment of this application;

[0047] Figure 9 This is a flowchart illustrating a shooting method provided in the third embodiment of this application.

[0048] The realization of the objectives, functional features, and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. The accompanying drawings have illustrated specific embodiments of this application, which will be described in more detail below. These drawings and textual descriptions are not intended to limit the scope of the concept in any way, but rather to illustrate the concepts of this application to those skilled in the art through reference to specific embodiments. Detailed Implementation

[0049] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.

[0050] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, components, features, and elements with the same names in different embodiments of this application may have the same meaning or different meanings, the specific meaning of which must be determined by its interpretation in that specific embodiment or further in conjunction with the context of that specific embodiment.

[0051] It should be understood that although the terms first, second, third, etc., may be used herein to describe various information, such information should not be limited to these terms. These terms are used only to distinguish information of the same type from one another. For example, without departing from the scope of this document, first information may also be referred to as second information, and similarly, second information may also be referred to as first information. Depending on the context, the word "if," as used herein, may be interpreted as "when," "when," or "in response to determination." Furthermore, as used herein, the singular forms "a," "an," and "the" are intended to also include the plural forms unless the context indicates otherwise. It should be further understood that the terms "comprising," "including," indicate the presence of the stated feature, step, operation, element, component, item, kind, and / or group, but do not exclude the presence, occurrence, or addition of one or more other features, steps, operations, elements, components, items, kinds, and / or groups. The terms "or," "and / or," "including at least one of the following," etc., as used in this application, may be interpreted as inclusive, or mean any one or any combination thereof. For example, "including at least one of the following: A, B, C" means "any one of the following: A; B; C; A and B; A and C; B and C; A and B and C." Similarly, "A, B, or C" or "A, B, and / or C" means "any one of the following: A; B; C; A and B; A and C; B and C; A and B and C." Exceptions to this definition only occur when the combination of elements, functions, steps, or operations is inherently mutually exclusive in some way.

[0052] It should be understood that although the steps in the flowcharts of this application's embodiments are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some of the steps in the figures may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily completed at the same time, but can be executed at different times, and their execution order is not necessarily sequential, but can be performed alternately or in turn with other steps or at least a portion of the sub-steps or stages of other steps.

[0053] Depending on the context, the words “if” or “suppose” as used here can be interpreted as “when” or “in response to determination” or “in response to detection.” Similarly, depending on the context, the phrases “if determination” or “if detection (of the stated condition or event)” can be interpreted as “when determination” or “in response to determination” or “when detection (of the stated condition or event)” or “in response to detection (of the stated condition or event).”

[0054] It should be noted that step designations such as S11 and S12 are used in this document for the purpose of more clearly and concisely describing the corresponding content, and do not constitute a substantial limitation on the order. In specific implementation, those skilled in the art may execute S12 first and then S11, etc., but these should all be within the protection scope of this application.

[0055] It should be understood that the specific embodiments described herein are merely illustrative of this application and are not intended to limit this application.

[0056] In the following description, the use of suffixes such as "module," "part," or "unit" to denote elements is solely for the purpose of illustrative purposes and has no specific meaning in itself. Therefore, "module," "part," or "unit" may be used interchangeably.

[0057] Smart terminals can be implemented in various forms. For example, the smart terminals described in this application may include smart terminals such as mobile phones, tablets, laptops, handheld computers, personal digital assistants (PDAs), portable media players (PMPs), navigation devices, wearable devices, smart bracelets, pedometers, etc., as well as fixed terminals such as digital TVs and desktop computers.

[0058] The following description will use a mobile terminal as an example. Those skilled in the art will understand that, apart from elements specifically designed for mobile purposes, the construction according to the embodiments of this application can also be applied to fixed-type terminals.

[0059] Please see Figure 1 This is a schematic diagram of the hardware structure of a mobile terminal implementing various embodiments of this application. The mobile terminal 100 may include: an RF (Radio Frequency) unit 101, a WiFi module 102, an audio output unit 103, an A / V (Audio / Video) input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, a processor 110, and a power supply 111, etc. Those skilled in the art will understand that... Figure 1 The mobile terminal structure shown does not constitute a limitation on the mobile terminal. The mobile terminal may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0060] The following is combined Figure 1 A detailed introduction to each component of the mobile terminal:

[0061] The radio frequency unit 101 can be used for receiving and transmitting signals during information transmission or calls. Specifically, it receives downlink information from the base station and processes it with the processor 110; additionally, it transmits uplink data to the base station. Typically, the radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low-noise amplifier, and a duplexer. Furthermore, the radio frequency unit 101 can also communicate wirelessly with networks and other devices. The aforementioned wireless communications may use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication), GPRS (General Packet Radio Service), CDMA2000 (Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division Duplexing-Long Term Evolution), TDD-LTE (Time Division Duplexing-Long Term Evolution), 5G, and 6G.

[0062] WiFi is a short-range wireless transmission technology. Mobile terminals, through the WiFi module 102, can help users send and receive emails, browse web pages, and access streaming media, providing users with wireless broadband internet access. Although Figure 1 WiFi module 102 is shown, but it is understood that it is not a necessary component of a mobile terminal and can be omitted as needed without changing the nature of the invention.

[0063] The audio output unit 103 can convert audio data received by the radio frequency unit 101 or the WiFi module 102 or stored in the memory 109 into audio signals and output them as sound when the mobile terminal 100 is in call signal receiving mode, call mode, recording mode, voice recognition mode, broadcast receiving mode, etc. Furthermore, the audio output unit 103 can also provide audio output related to specific functions performed by the mobile terminal 100 (e.g., call signal receiving sound, message receiving sound, etc.). The audio output unit 103 may include a speaker, a buzzer, etc.

[0064] The A / V input unit 104 is used to receive audio or video signals. The A / V input unit 104 may include a graphics processing unit (GPU) 1041 and a microphone 1042. The GPU 1041 processes image data of still images or videos acquired by an image capture device (such as a camera) in video capture mode or image capture mode. The processed image frames can be displayed on the display unit 106. The image frames processed by the GPU 1041 can be stored in the memory 109 (or other storage medium) or transmitted via the radio frequency unit 101 or the WiFi module 102. The microphone 1042 can receive sound (audio data) in operating modes such as telephone call mode, recording mode, and voice recognition mode, and can process such sound into audio data. The processed audio (voice) data can be converted into a format that can be transmitted to a mobile communication base station via the radio frequency unit 101 in telephone call mode. The microphone 1042 can implement various types of noise cancellation (or suppression) algorithms to eliminate (or suppress) noise or interference generated during the reception and transmission of audio signals.

[0065] The mobile terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Optionally, the light sensor includes an ambient light sensor and a proximity sensor. Optionally, the ambient light sensor can adjust the brightness of the display panel 1061 according to the ambient light level, and the proximity sensor can turn off the display panel 1061 and / or backlight when the mobile terminal 100 is moved to the ear. As a type of motion sensor, an accelerometer sensor can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used for applications that recognize the phone's posture (such as landscape / portrait switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc. Other sensors that may be configured in the phone, such as fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, and infrared sensors, will not be described in detail here.

[0066] The display unit 106 is used to display information input by the user or information provided to the user. The display unit 106 may include a display panel 1061, which may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.

[0067] User input unit 107 can be used to receive input numerical or character information, and generate key signal inputs related to user settings and function control of the mobile terminal. Optionally, user input unit 107 may include touch panel 1071 and other input devices 1072. Touch panel 1071, also known as a touch screen, can collect touch operations performed by the user on or near it (such as operations performed by the user using a finger, stylus, or any suitable object or accessory on or near touch panel 1071), and drive corresponding connection devices according to a pre-set program. Touch panel 1071 may include a touch detection device and a touch controller. Optionally, the touch detection device detects the user's touch position and the signal generated by the touch operation, and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device, converts it into touch point coordinates, sends it to processor 110, and can receive and execute commands sent by processor 110. In addition, touch panel 1071 can be implemented using various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 1071, the user input unit 107 may also include other input devices 1072. Optionally, other input devices 1072 may include, but are not limited to, one or more of the following: physical keyboard, function keys (such as volume control buttons, power buttons, etc.), trackball, mouse, joystick, etc., without being specifically limited here.

[0068] Optionally, the touch panel 1071 may cover the display panel 1061. When the touch panel 1071 detects a touch operation on or near it, it transmits the information to the processor 110 to determine the type of touch event. Subsequently, the processor 110 provides corresponding visual output on the display panel 1061 based on the type of touch event. Although in Figure 1 In this embodiment, the touch panel 1071 and the display panel 1061 are two independent components to realize the input and output functions of the mobile terminal. However, in some embodiments, the touch panel 1071 and the display panel 1061 can be integrated to realize the input and output functions of the mobile terminal. The specific implementation is not limited here.

[0069] Interface unit 108 serves as an interface through which at least one external device can connect to mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, an audio input / output (I / O) port, a video I / O port, a headphone port, and so on. Interface unit 108 may be used to receive input (e.g., data, power, etc.) from the external device and transmit the received input to one or more elements within mobile terminal 100, or it may be used to transmit data between mobile terminal 100 and the external device.

[0070] The memory 109 can be used to store software programs and various data. The memory 109 may primarily include a program storage area and a data storage area. Optionally, the program storage area may store the operating system, applications required for at least one function (such as sound playback, image playback, etc.), etc.; the data storage area may store data created based on the use of the mobile phone (such as audio data, phonebook, etc.). Furthermore, the memory 109 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device.

[0071] The processor 110 is the control center of the mobile terminal. It connects various parts of the mobile terminal via various interfaces and lines. By running or executing software programs and / or modules stored in the memory 109, and by calling data stored in the memory 109, it performs various functions and processes data of the mobile terminal, thereby providing overall monitoring of the mobile terminal. The processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor and a modem processor. Optionally, the application processor mainly handles the operating system, user interface, and applications, while the modem processor mainly handles wireless communication. It is understood that the modem processor may not be integrated into the processor 110.

[0072] The mobile terminal 100 may also include a power supply 111 (such as a battery) that supplies power to various components. Preferably, the power supply 111 can be logically connected to the processor 110 through a power management system, thereby enabling functions such as charging, discharging, and power consumption management through the power management system.

[0073] although Figure 1 As not shown, the mobile terminal 100 may also include a Bluetooth module, etc., which will not be described in detail here.

[0074] To facilitate understanding of the embodiments of this application, the communication network system on which the mobile terminal of this application is based is described below.

[0075] Please see Figure 2 , Figure 2 This application provides a communication network system architecture diagram. The communication network system is an LTE system based on the universal mobile communication technology. The LTE system includes a UE (User Equipment) 201, an E-UTRAN (Evolved UMTS Terrestrial Radio Access Network) 202, an EPC (Evolved Packet Core) 203, and the operator's IP services 204, which are connected in sequence.

[0076] Optionally, UE201 can be the aforementioned terminal 100, which will not be described in detail here.

[0077] E-UTRAN202 includes eNodeB2021 and other eNodeB2022, etc. Optionally, eNodeB2021 can connect to other eNodeB2022 via backhaul (e.g., X2 interface), and eNodeB2021 connects to EPC203, providing access from UE201 to EPC203.

[0078] EPC203 may include MME (Mobility Management Entity) 2031, HSS (Home Subscriber Server) 2032, other MMEs 2033, SGW (Serving Gateway) 2034, PGW (Packet Data Network Gateway) 2035, and PCRF (Policy and Charging Rules Function) 2036, etc. Optionally, MME2031 is the control node that handles signaling between UE201 and EPC203, providing bearer and connection management. HSS2032 is used to provide registers to manage functions such as the Home Location Register (not shown in the figure) and stores user-specific information such as service characteristics and data rates. All user data can be sent through SGW2034. PGW2035 can provide UE 201 IP address allocation and other functions. PCRF2036 is the policy and charging control decision point for service data flow and IP bearer resources. It selects and provides available policy and charging control decisions for the policy and charging enforcement function unit (not shown in the figure).

[0079] IP services 204 may include the Internet, intranet, IMS (IP Multimedia Subsystem), or other IP services.

[0080] Although the above description uses the LTE system as an example, those skilled in the art should know that this application is not only applicable to the LTE system, but also to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA, 5G and future new network systems (such as 6G), etc., without limitation.

[0081] Based on the above-described mobile terminal hardware structure and communication network system, various embodiments of this application are proposed.

[0082] First Embodiment

[0083] Figure 3 This application provides a shooting method according to a first embodiment. The subject performing this shooting method can be at least one of a mobile phone or other smart terminal, a wearable device, or a processor or storage medium with processing capabilities. Please refer to... Figure 3 As shown, the shooting method includes the following steps:

[0084] S11. Responding to preset events, output shooting plans based on target information.

[0085] In one example, the preset event can manifest as one or more events, which may be dedicated events for implementing this application, different from existing events that trigger the smart terminal, thereby at least avoiding any conflict between any event and existing events that perform other functions (including user-defined personalized events). For example, step S11 can be executed only when entering the preset mode and / or enabling the preset function option. In practical scenarios, the preset mode can be enabled and disabled in the "Settings" interface of the smart terminal. Here, users can perform different functions by implementing the same event in a relatively convenient and quick way, that is, reuse the event that performs other functions. In one example, after entering the preset mode, the user clicks the "Camera" APP icon (i.e., responds to the preset event) to trigger the execution of step S11. However, when not entering the preset mode, the user clicks the "Camera" APP icon and can only perform traditional shooting instructions and operations according to the traditional shooting method. It will not obtain target information, nor will it output a shooting plan based on the target information.

[0086] For example, in a scenario applicable to smart terminals, this example is equivalent to adding a personalized shooting function to the smart terminal. The implementation of this function includes, but is not limited to: taking a smartphone as an example, pre-programming a script or application and installing it in the smartphone's operating system, thereby adding a "personalized shooting" option to the smartphone's operating system settings interface and / or voice assistant settings interface; then, the function can be turned on or off by sliding a slider. Alternatively, the smart terminal can have a separate app set up on its main interface, through which corresponding control functions can be turned on and off, and detailed settings for one or more events, including preset events, can be executed. After enabling this function option, the smart terminal can allow the user to set the preset events on the display interface, and then check whether the detected events are consistent with the settings in subsequent processes. If they are consistent, step S11 is triggered; if they are inconsistent, step S11 is not triggered.

[0087] In one example, this application can combine a preset event with the current interface to determine whether to trigger execution step S11. For example, if the current interface is a shooting interface, which includes, but is not limited to, the shooting interface of a camera app or the shooting interface of a chat app, once the preset event is detected, execution step S11 can be triggered directly without considering whether the preset event is an existing event for performing other functions; however, if the current interface is not the shooting interface, even if the preset event is detected as a special event of this application, execution step S11 will not be triggered.

[0088] This application does not limit the specific manifestation of any event, including preset events. The following description uses at least one of events 1 to 5 as an example of preset events.

[0089] Event 1: Triggering the shooting assistant.

[0090] The shooting assistant can be an AI assistant that triggers and starts the shooting function (e.g., starts a camera app). Therefore, the shooting method of this application can be implemented based on an AI model. The AI ​​assistant can be displayed as an icon on the interface of a smart terminal, for example, in conjunction with... Figure 4 The camera interface shown can be interpreted as a voice assistant, which can be reused as an existing voice assistant on a smart terminal, exhibiting characteristics such as... Figure 4 The icons shown in the left-middle image include, but are not limited to, the voice interaction programs built into various smart terminals based on their own operating systems, such as Apple's Sir, Android's Xiao Ai voice assistant, HarmonyOS-based Xiao Yi voice assistant, and various domestic car infotainment systems' Zebra voice assistant, as well as the voice interaction programs of various apps installed on smart terminals; or, the voice assistant can be a different voice assistant from the existing one, manifested as, Figure 4 The icons shown in the middle right image allow users to distinguish which assistant is currently being used by using different icon formats.

[0091] Optional, Figure 4 The two voice assistants shown can only be invoked at a time, and they are invoked in different ways. For example, after launching the camera app, you can invoke the other one by speaking a preset voice command. Figure 4 The image in the middle left shows a traditional voice assistant, but by using preset operations such as swiping from the edge of the screen towards the center, one can activate a different one. Figure 4 The image on the right shows the shooting assistant of this application.

[0092] This application allows the shooting assistant to be triggered only after the camera app is opened and the shooting interface is displayed, or the camera app can be opened by triggering the shooting assistant, thereby entering the shooting interface.

[0093] Event 2: The changes in shooting parameters of the current shooting scene exceed the preset threshold.

[0094] The current shooting scene can be the current field of view of the camera.

[0095] Optionally, the shooting parameters include, but are not limited to, at least one of the following: preset parameters of the target object, preset parameters of the reference object, relative position information (e.g., orientation and / or distance) between the target object and the reference object, brightness, color temperature, color saturation, sharpness, shooting filter style, background music (BGM) name, background music style, special effects style, and overall duration.

[0096] The target object can be the object in focus during the current shooting, and the reference object can be the background of the target object in the current shooting scene. The background can be a person, a dynamic animal such as a dog, or a still object such as mountains and rivers. The preset parameters include, but are not limited to, at least one of area, brightness, and facial feature information. Taking this as an example, event 2 can be manifested as at least one of the following: the target object completely moves out of the current shooting scene, at which point the imaging area of ​​the target object is zero, which is obviously less than the preset threshold; the target object partially moves out of the current shooting scene, at which point the imaging area of ​​the target object is less than the preset threshold; the target object and the reference object are not simultaneously displayed in the current shooting scene, at which point the imaging area of ​​at least one of the target object and the reference object is less than the preset threshold; for example, a person (target object) moves toward a static reference object, or a dynamic reference object walks toward a person, causing the relative position change of the target object and the reference object in the current shooting scene to be greater than the preset threshold, and / or the distance change to be greater than the preset threshold.

[0097] Brightness, color temperature, color saturation, and sharpness, as standards for measuring shooting effects, are key factors in ensuring the final image quality. Therefore, any changes to these parameters necessitate a revised shooting plan. Unlike preset parameters for target and reference objects, which can be altered by the object itself, brightness, color temperature, color saturation, and sharpness are typically changed by the user.

[0098] Event 3: Switch from the first shooting scene to the second shooting scene.

[0099] Event 3 could be a change in the shooting scene. For example, in a shooting scene without a fixed target object, if the camera's current framing changes from a first position to a second position, a new shooting plan needs to be output. It should be understood that the first and second shooting scenes can partially overlap.

[0100] Event 4: The preset characteristics of the preset objects in the current shooting scene have changed.

[0101] The preset object can be at least one of a target object and a reference object. The preset features include, but are not limited to, at least one of the following: area, brightness, facial features, and relative position.

[0102] For example, in the current shooting scene, when the lights switch from off to on, the brightness of the environment where the target object is located changes significantly, and the light and dark effects of the target object also change significantly. Taking a person as an example, some facial features of the person will be clearly imaged, while some facial features will be obscured by shadows and cannot be imaged, appearing as a black spot. Therefore, it is necessary to re-output the shooting plan.

[0103] Event 5: The target information was obtained.

[0104] The target information may include at least one of the following: video template, video overview, and current shooting scene.

[0105] The video template may include, but is not limited to, at least one of the following: a video input by the user, a video automatically selected by the smart terminal based on the current shooting scene, or a video automatically generated in real time by the smart terminal based on the current shooting scene. Through this video template, this application can extract relevant features from the video template and use these relevant features as a reference to guide the user in this shooting process. The relevant features include, but are not limited to, at least one of the following: Figure 5a The pose of the target object, such as body movements; the relative distances between the target object and each side of the camera's viewfinder (i.e., the current field of view), i.e., the proportional size of the target object in the image to be captured, which, relative to the camera of the smart terminal, can be represented as the distance between the target object and the camera to control the camera's focal length on the target object; the reference object referenced by the target object when capturing the current scene, for example, the reference object is... Figure 5a The hat shown; the relative positional information between the target object and the reference object, such as... Figure 5b As shown, for an example where the reference objects are roads and seats, the target object can be located to the left of the roads and seats and adjacent to the roads.

[0106] A video summary can be presented as a text description or a combination of text and illustrations. For example, for shooting scenarios requiring adaptive facial expressions, a summary can be provided using only text such as... Figure 5a The poses and illustrations shown are insufficient to convey facial expressions such as joy, anger, sorrow, happiness, and humor. Instead, one could use, for example... Figure 5c The text description shown can optionally be combined with a corresponding facial expression illustration, for example... Figure 5d The illustration shows a funny pouty mouth.

[0107] The current shooting scene is obtained through methods including, but not limited to, at least one of the following:

[0108] Method 1: The user captures an image of the current scene in real time using a camera, which can be regarded as a preview image as commonly described. Then, the image is imported into the smart terminal. Here, step S11 can be considered as being triggered by user intervention, and it is manifested that the smart terminal will only output a shooting plan based on the current shooting scene if the user behavior of importing the image of the current shooting scene is detected.

[0109] Method 2: The camera is triggered to turn on, that is, it automatically captures the image corresponding to the current scene without the need for human intervention. That is, step S11 can be expressed as: once the camera is detected to be triggered to turn on, it can be considered that a preset event has been detected, and then the shooting plan is automatically output according to the current shooting scene.

[0110] It should be noted that the various embodiments of this application include multiple situations and multiple feasible implementation methods for a certain technical feature. Unless otherwise specified, it means that the corresponding technical feature can be implemented by combining any of the above methods. For example, event 1 can be combined with any of events 2 to 5. By combining the solutions, the corresponding technical feature can be implemented more accurately and / or intelligently, thereby improving the accuracy of the implementation of the technical feature and the user experience.

[0111] In step S11, the shooting plan output based on the target information may include at least one of generating multiple storyboards and determining shooting parameters. The shooting plan can be transmitted to the user in the form of text, images, or voice, so that the user can shoot according to the shooting plan and obtain images that meet their needs.

[0112] Shooting parameters include, but are not limited to, at least one of the following: preset parameters for the target object, preset parameters for the reference object, relative position information between the target object and the reference object, brightness, color temperature, color saturation, sharpness, shooting filter style, background music name, background music style, special effects style, and overall duration. For details, please refer to the detailed description of Event 2 above.

[0113] like Figure 6 As shown, the storyboard can be represented by various prompts or diagrams on the camera shooting interface, such as a still shooting guide. Any storyboard can contain only text descriptions, only diagrams, or a combination of text and diagrams. A single storyboard explains how a shooting scene will be constructed, including the proportion of each shooting object, including the target object and reference objects, in the shot to form the composition, what actions the target object, such as people, will perform, from which angle it will enter or exit, how the smart terminal and its camera will move, and the recording time, etc.

[0114] The order of multiple shots is the same as the chronological order of the images or videos to be captured. Optionally, these shots can be numbered to indicate their sequence, thus forming a shooting guide.

[0115] Please see Figure 7 As shown, the method for generating multiple storyboards may include the following steps: acquiring the captured content; acquiring a processing strategy; and processing the captured content according to the processing strategy to output multiple storyboards. Here, step S11 can be represented as steps S111 to S113.

[0116] S111: Responds to a preset event and captures the captured content;

[0117] S112. Obtain processing strategies based on target information;

[0118] S113. Process the captured content according to the processing strategy to output multiple storyboards.

[0119] In this example, the preset event is used to trigger the acquisition of captured content.

[0120] In other examples, the preset event can be used to trigger the execution of an acquisition processing strategy, i.e. Figure 7 The steps of the method shown can be represented as follows:

[0121] S111, Acquire the captured content;

[0122] S112. Responding to a preset event, obtain the processing strategy based on the target information;

[0123] S113. Process the captured content according to the processing strategy to output multiple storyboards.

[0124] The shooting content can be the current shooting scene in the aforementioned example, or it can include preset objects in the current shooting scene, such as the aforementioned target object and reference object.

[0125] The captured content and the target information both contain at least a target object. Of course, the objects contained in both can be the same, for example, they can both contain a reference object.

[0126] In step S112, the processing strategy can be, for example, Figures 5a to 6 The diagrams shown depicting postures, etc., and / or corresponding textual descriptions. In one example, obtaining a processing strategy based on target information includes: determining a reference object, a target object, and preset features of the target object relative to the reference object from the target information; and generating a processing strategy for the target object based on the preset features.

[0127] Preset features include, but are not limited to, at least one of the following: area, brightness, facial features, and relative position.

[0128] For example, when a light is switched from off to on, the brightness of the environment around the target changes significantly, and the light and shadow effects on the target also change significantly. Taking a person as an example, some facial features of the person will be clearly imaged, while others will be obscured by shadows and cannot be imaged, appearing as a black spot. Therefore, the output processing strategy is to keep the flash on, with the flash illumination covering the facial area of ​​the person, and reduce the sharpness of the image.

[0129] Taking the preset features including relative position as an example, step S112 can be specifically manifested as follows: identifying the target object and reference object from the shooting content, determining shooting parameters based on the target information, determining the relative position of the target object relative to the reference object when shooting based on the shooting parameters, generating a processing strategy based on the relative position such as "the person is on the left side of the seat and road, occupying two-thirds of the frame, and the person makes a waving gesture to indicate separation," and then generating a process such as... Figure 5b The diagrams shown can be optionally accompanied by corresponding text descriptions. These diagrams and corresponding text descriptions are then arranged in chronological order to generate and output multiple storyboards.

[0130] Based on the above scheme, this application does not limit the specific form of the shooting scheme. For example, it can be an existing posture diagram or multiple shots. Multiple shots can realize dynamic illustration function and provide guidance for both still photography and video shooting. That is, the final output image of this application can be a still image (including dynamic photos supported by the iOS system) or a video. Furthermore, each shot can include posture diagrams and other descriptions such as expressions to provide richer guidance information and improve shooting effect. In addition, the target information can include the current shooting scene to realize the output of the shooting scheme according to the current shooting scene, thereby realizing real-time shooting guidance and improving the user experience.

[0131] Second Embodiment

[0132] Please see Figure 8 This is a flowchart illustrating a shooting method provided in the second embodiment of this application. The shooting method includes the following steps S21 to S24.

[0133] S21. Responding to a preset event, output a shooting plan containing multiple shots based on the target information;

[0134] S22. Set the corresponding display time period for each storyboard;

[0135] S23. For each segment of the display time period, acquire multiple frames of images obtained according to the shooting plan;

[0136] S24. Generate the target image corresponding to the display period based on multiple frames of images.

[0137] The same features as the first embodiment described above can be found in the foregoing. For example, the features in step S21 correspond to those in step S11 of the first embodiment, and will not be repeated here. The difference is that in step S21 of this embodiment, the output shooting scheme must include multiple shots.

[0138] Taking the final video as an example, this application can divide the overall length of the video into multiple time segments. The lengths of these time segments can be equal or unequal. Each time segment can be a display time segment corresponding to a storyboard. In other words, through steps S22 to S24, this application can divide a complete video into multiple segments, and each segment is configured with shooting instructions---storyboard.

[0139] Since the duration of a single camera shot is extremely short, much shorter than the duration of a segmented display period, this application can obtain multiple frames of images within any display period according to the shooting scheme of the first embodiment described above. Although all smart terminals use the same shooting scheme, the images obtained will differ due to factors such as user hand tremors and changes in the preset characteristics of the current shooting scene. Therefore, for any display period, this application can generate a target image corresponding to the display period based on the multiple frames of images.

[0140] In one example, step S24 can select the frame with the best imaging quality from multiple frames as the target image corresponding to that display time period. All target images corresponding to the display time periods are arranged according to the chronological order of the storyboard to finally obtain the target video of this shooting.

[0141] In other examples, step S24 can synthesize the best-quality frame image based on the differences between multiple frames. For example, firstly, the frame image with the best imaging quality is selected from multiple frames as the base image. Then, the remaining images are compared one by one with the base image to obtain the degree of difference between the remaining images and the base image, including but not limited to at least one of sharpness and conformity with the target information. Taking the target information as a pose as an example, firstly, the base image with the best imaging quality is selected. Then, the pose in the remaining frame image and the pose in the base image are compared with the pose of the target information. If the pose in the frame image is more consistent with the pose of the target information, the base image is deleted, and the frame image is used as the new base image. The remaining images are then compared with it until the last remaining frame image is used as the target image for that display period. All target images for all display periods are arranged according to the time sequence of the storyboard to finally obtain the target video. Optionally, to ensure the sharpness of the target image, this example can first select several frames with a sharpness that meets a preset standard from multiple frames and then perform the comparison on these images.

[0142] Based on the description of the first embodiment above, the single shot of this second embodiment can be applied to a suitable display period, which can reduce the number of shots required for a single shot. While meeting the needs of fast shooting, it is beneficial to ensure the imaging quality of the target video, such as the clarity and whether the posed shooting posture meets expectations.

[0143] Third Embodiment

[0144] Please see Figure 9 This is a flowchart illustrating a shooting method provided in the third embodiment of this application. The shooting method includes the following steps S31 to S33.

[0145] S31. Responding to a preset event, output a shooting plan containing multiple shots based on the target information;

[0146] S32. In response to partition display, determine the target partition from at least two partitions;

[0147] S33. Display all or all storyboards that meet the preset conditions in the target partition.

[0148] The same features as those in the first and second embodiments described above can be found in the foregoing. For example, the features in step S31 correspond to those in step S21 of the first embodiment, and will not be repeated here.

[0149] Partitioned display can be achieved by changing the screen shape of the smart terminal. In this example, the score camera can be made to move adaptively with the screen shape of the smart terminal to make it easier for users to shoot.

[0150] The preset conditions include, but are not limited to, at least one of the following:

[0151] Condition 1: The shooting scene corresponding to the storyboard is displayed in the target area.

[0152] For example, a shooting plan includes shot 1 and shot 2. When the screen of the smart terminal has only one partition, all shots are displayed on that partition. After shooting is completed based on the guidance of shot 1, if the screen switches to two partitions, and one of the partitions is the target partition, the camera's shooting interface can only be displayed on the target partition. When shooting based on the guidance of shot 2, if the shooting scene corresponding to shot 2 is displayed on the camera's shooting interface, shot 2 can be considered to meet the preset conditions.

[0153] Condition 2: Meets the user's selected operation.

[0154] Each shot is similar to a traditional floating frame, and can be selected and dragged to move on the screen of a smart terminal. Therefore, when the shooting plan includes shot 1 and shot 2, if the user selects shot 2, then shot 2 is deemed to meet the preset conditions and can be displayed in the target area.

[0155] Optionally, the target partition is the partition facing the user's viewing angle. The partition is obtained by dividing the screen of the smart terminal; taking a foldable screen as an example, the two split screens facing away from the user after folding can be called two partitions, with one of them facing the user's eyes, which can be called the target partition; taking a rollable screen as an example, the target partition can be the unfolded portion when the rollable screen switches from a rolled state to a partially unfolded state, and the un-unfolded portion can be called other partitions; taking a flat screen as an example, the operating system divides the display area of ​​the flat screen into multiple partitions, which may or may not have visible dividing lines. The system displays visually visible dividing lines, which at this point represent logical dividing lines defined by the operating system's background processes. Then, one of the partitions is selected as the target partition according to preset rules. Optionally, the preset rules can be at least one of the following: selecting the partition with the largest display area as the target partition; selecting a partition selected by the user as the target partition; or selecting a partition located in a fixed position based on the placement of the smart terminal. For example, when the smart terminal is in portrait mode, the partition at the bottom is the target partition; when the smart terminal is switched to landscape mode, the partition closest to the short side of the flat screen is the target partition. The specific form of the preset rules is not limited in this embodiment.

[0156] The preset rule can be expressed as one or more rules, and can be a dedicated rule for implementing this application, different from existing rules that trigger the smart terminal to perform partitioned display, thereby avoiding any conflict between any rule and existing rules for performing other functions (including user-defined personalized rules). For example, step S32 is only executed when entering a preset mode and / or enabling a preset function option, in order to avoid conflict with existing rules for performing other functions. Figure 5a The preset rule is only considered valid and the corresponding steps are triggered when the shooting interface shown is entered. Therefore, users can conveniently and quickly execute different functions using the same rule, i.e., reuse rules for executing other functions. For example, when entering a shooting interface like... Figure 5a When the user enters the shooting interface, the partition facing the user's eyes is detected and can be used as the target partition. As the user flips the smart terminal, another partition faces the user's eyes, and this other partition is used as the target partition. However, if the user does not enter this interface, even if the user flips the smart terminal, the other partition cannot be used as the target partition. In this case, the target partition is still the partition before the flip.

[0157] In other examples, unlike step S33 described above, this application can display the storyboard in other partitions, as shown below. Figure 5a The shooting interface shown is displayed in the target area so that the score is not displayed in the shooting interface and the target area, so that the shooting interface can be used entirely to display the camera's field of view, which is convenient for shooting.

[0158] This application also provides a smart terminal, including a memory and a processor. The memory stores a shooting program, which, when executed by the processor, implements the steps of the shooting method in any of the above embodiments.

[0159] This application also provides a storage medium storing a shooting program, which, when executed by a processor, implements the steps of the shooting method in any of the above embodiments.

[0160] The embodiments of the smart terminal and storage medium provided in this application may include all the technical features of any of the above-described display method embodiments, and thus have corresponding beneficial effects. The extended and explanatory content of the specification is basically the same as that of the embodiments of the above methods, and will not be repeated here.

[0161] This application also provides a computer program product, which includes computer program code. When the computer program code is run on a computer, it causes the computer to perform the methods described in the various possible implementations above.

[0162] This application also provides a chip, including a memory and a processor. The memory is used to store a computer program, and the processor is used to call and run the computer program from the memory, so that a device with the chip installed performs the methods described in the various possible implementations above.

[0163] It is understood that the above scenarios are merely examples and do not constitute a limitation on the application scenarios of the technical solutions provided in the embodiments of this application. The technical solutions of this application can also be applied to other scenarios. For example, as those skilled in the art will know, with the evolution of system architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of this application are also applicable to similar technical problems.

[0164] The sequence numbers of the embodiments in this application are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0165] The steps in the method of this application embodiment can be adjusted, combined, or deleted according to actual needs.

[0166] The units in the device of this application embodiment can be merged, divided, and deleted according to actual needs.

[0167] In this application, the same or similar terms, concepts, technical solutions and / or application scenario descriptions are generally described in detail only when they appear for the first time. When they appear again, they are generally not repeated for the sake of brevity. When understanding the technical solutions and other contents of this application, the same or similar terms, concepts, technical solutions and / or application scenario descriptions that are not described in detail later can be referred to their previous relevant detailed descriptions.

[0168] In this application, the descriptions of the various embodiments have different focuses. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0169] The technical features of the present application can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of the present application.

[0170] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as described above, and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, controlled terminal, or network device, etc.) to execute the methods of each embodiment of this application.

[0171] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented, in whole or in part, as a computer program product. A computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the flow or function according to the embodiments of this application is generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a storage medium or transmitted from one storage medium to another. For example, computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) means. The storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, storage disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., a solid-state disk (SSD)).

[0172] The above are merely preferred embodiments of this application and do not limit the patent scope of this application. Any equivalent structural or procedural transformations made using the content of this application's specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the patent protection scope of this application.

Claims

1. A shooting method, characterized in that, Including the following steps: S11. Responding to preset events, output shooting plans based on target information.

2. The method according to claim 1, characterized in that, The target information includes at least one of the following: video template, video overview, and current shooting scene.

3. The method according to claim 1, characterized in that, The output shooting scheme includes at least one of the following: Generate multiple storyboards; Determine the shooting parameters.

4. The method according to claim 3, characterized in that, The generation of multiple storyboards includes: Acquire the captured content; A processing strategy is obtained based on the target information; The captured content is processed according to the processing strategy to output multiple storyboards.

5. The method according to claim 4, characterized in that, The processing strategy based on the target information includes: From the target information, determine the reference object, the target object, and the preset characteristics of the target object relative to the reference object; A processing strategy is generated for the target object based on the preset features.

6. The method according to any one of claims 3 to 5, characterized in that, Also includes: Set a corresponding display time period for each storyboard; For each segment of the display period, acquire multiple frames of images obtained according to the shooting scheme; The target image corresponding to the display period is generated based on the multi-frame images.

7. The method according to any one of claims 1 to 5, characterized in that, The preset event includes at least one of the following: Trigger the shooting assistant; The changes in the shooting parameters of the current shooting scene exceed the preset threshold; Switch from the first shooting scene to the second shooting scene; The preset features of the preset objects in the current shooting scene have changed; The target information was obtained.

8. The method according to any one of claims 3 to 5, characterized in that, Also includes: In response to partition display, determine the target partition from at least two partitions; Display all or all storyboards that meet the preset conditions in the target partition.

9. A smart terminal, characterized in that, include: A memory and a processor, wherein the memory stores a shooting program, which, when executed by the processor, implements the steps of the shooting method as described in any one of claims 1 to 8.

10. A storage medium, characterized in that, The device contains a computer program that, when executed by a processor, implements the steps of the photographing method as described in any one of claims 1 to 8.

Images