Video recording method and related apparatus
Patent Information
- Application Number
- CN202210576752.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-05-25
- Publication Date
- 2026-09-08
- Estimated Expiration
- 2042-05-25
AI Technical Summary
[0004]但是,人工剪辑的方式操作繁琐,效率低下,使得电子设备用户体验较差
[0069] It should be understood that the second to fifth aspects of this application correspond to the technical solutions of the first aspect of this application, and the beneficial effects achieved by each aspect and the corresponding feasible implementation are similar, and will not be repeated here.
Smart Images

Figure CN117201924B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of terminal technology, and in particular to video recording methods and related devices. Background Technology
[0002] To enhance user experience, electronic devices such as smartphones and tablets are typically equipped with multiple cameras. For example, they may have a front-facing camera and a rear-facing camera. Users can choose the appropriate shooting mode according to their needs, such as front-camera mode, rear-camera mode, or dual-camera mode.
[0003] In some scenarios, videos shot by users using electronic devices may include one or more people. When users want to obtain videos of a single person, the videos need to be manually edited.
[0004] However, manual editing is cumbersome and inefficient, resulting in a poor user experience on electronic devices. Summary of the Invention
[0005] This application provides a video recording method and related apparatus, applied to electronic devices. This method can track selected individuals during video recording to generate an additional video feed, eliminating the need for manual editing by the user, reducing user operations, and enhancing the user experience.
[0006] In a first aspect, embodiments of this application propose a video recording method applied to a terminal device including a first camera. The video recording method may include:
[0007] The terminal device displays a first interface; at a first moment, the terminal device detects that a first object is displayed at a first position in the first window, the first camera focuses on the first object, and a second window displays a portion of the image related to the first object at the first position in the first window; at a second moment, the terminal device detects that a first object is displayed at a second position in the first window, the first camera focuses on the first object, and a second window displays a portion of the image related to the first object at the second position in the first window; when the first exposure parameter of the real-time image captured by the first camera is locked, the exposure parameter corresponding to the terminal device at the first moment and the exposure parameter corresponding to the terminal device at the second moment are both the first exposure parameter.
[0008] In this embodiment of the application, the first interface includes a first window and a second window. The first window displays a real-time captured image from a first camera, which includes a first object. The focus of the first camera is on the first object. The second window displays a portion of the image related to the first object from the first window.
[0009] Understandably, the first interface can be a preview interface with a tracking target set (e.g., Figure 3BThe interface shown in 'a' can also be a recording interface with a tracking target set (e.g., Figure 3C (The interface shown in 'a'). The first window can be understood as the preview area or recording area below; the real-time captured image from the first camera can be understood as the preview image or recording image below; the second window can be understood as a small window; the image displayed in the second window can be understood as the tracking image, corresponding to the tracking target.
[0010] In this embodiment, the focus changes with the position of the target being tracked. Specifically, the focus changes with the position of the target being tracked, as detailed in the following example. Figure 3B or Figure 3C For example, the interface at the first moment could be... Figure 3B The interface shown as 'a' in the diagram can be the interface at the second time step. Figure 3B The interface shown in b; or, the interface at the first moment can be Figure 3C The interface shown as 'a' in the diagram can be the interface at the second time step. Figure 3C The interface shown in b is shown in the image.
[0011] In related technologies, exposure is controlled by locking the exposure to ensure relatively stable brightness in the captured image. However, locking the exposure also locks the focus. To achieve focus tracking, in the embodiment of this application, the focus and exposure can be controlled separately in the main subject mode. When displaying the image based on the tracked target, the terminal device can also control the exposure lock to fix the exposure parameters, which can reduce overexposure or underexposure caused by the focus being in a strong light source or a dark location, thus improving the user experience.
[0012] In summary, the terminal device can additionally obtain and display the image corresponding to the tracked target, thereby obtaining one or more additional focus-tracking videos corresponding to the tracked target while recording video, thus reducing subsequent editing operations on the tracked target and improving editing efficiency.
[0013] Optionally, when the first exposure parameter of the real-time captured image by the first camera is in an unlocked state, the exposure parameter corresponding to the terminal device at the first moment is different from the exposure parameter corresponding to the terminal device at the second moment.
[0014] In protagonist mode, the device can leave the exposure unlocked, and the exposure value changes with the focus.
[0015] In this way, when displaying a picture based on a tracked target, the terminal device can also control the exposure value based on the focus, adapt to changes in light, control the exposure from another dimension, and improve the user experience.
[0016] Optionally, the first window may also include a second object. The method further includes: at a third moment, the terminal device detects a first operation by the user on the second object; in response to the first operation, the focus of the first camera is on the second object, and the second window displays a portion of the image related to the second object in the first window; when the first exposure parameter of the image captured in real time by the first camera is locked, the exposure parameter corresponding to the terminal device at the third moment is the first exposure parameter.
[0017] It is understandable that when exposure is locked, the exposure parameters will not change even if the terminal device switches the object corresponding to the tracking target. For example, see the following: Figure 8D , Figure 9D The corresponding explanation is as follows: Exposure lock and focus separation allow for focused tracking of the target while maintaining fixed exposure parameters. This results in additional focused video of the tracked target, reducing the need for subsequent editing and improving editing efficiency.
[0018] Optionally, the first window also includes a second object, and the first exposure parameters of the real-time captured image by the first camera are in an unlocked state. The method further includes: at a third moment, the terminal device detects a first operation by the user on the second object; in response to the first operation, the focus of the first camera is on the second object, and the second window displays a portion of the image related to the second object from the first window; the exposure parameters of the terminal device at the third moment are different from the exposure parameters of the terminal device at the second moment.
[0019] Understandably, when exposure is locked, switching the tracking target on the terminal device will change the exposure parameters. For example, see the following: Figure 8C , Figure 9C The corresponding explanation.
[0020] Optionally, the first object is displayed in the center of the second screen.
[0021] For example, such as Figure 3B , Figure 3C The interface shown displays the target in the center of the tracking screen displayed in a small window.
[0022] Optionally, the second window floats on top of the first window, and the second window is smaller than the first window. For example, such as... Figure 3B , Figure 3C The interface shown has a small window smaller than the preview or recording area, and it floats on top of the preview or recording area.
[0023] Optionally, before or after the terminal device displays the first interface, the method further includes: the terminal device receiving a second operation on the first window; in response to the second operation, the terminal device locking the exposure parameters of the first camera as the first exposure parameters.
[0024] In this embodiment, the second operation can be understood as a long press operation, or a press operation exceeding a preset time. The second operation may also be other operations, which are not limited here.
[0025] Understandably, the terminal device can lock the exposure before or after setting the tracking target. Setting the tracking target and locking the exposure parameters are independent; exposure locking and focus control are separate. For example, the terminal device can... Figure 8A Enter the interface shown by b in the image. Figure 8B The interface shown in b; it can also be viewed from Figure 8B Enter the interface shown in 'a'. Figure 8B The interface shown in b is shown in the image.
[0026] In this way, the terminal device can achieve separate control of focus and exposure, reducing overexposure or underexposure when the focus is on a strong light source or a dark location. The setting of the tracking target and whether the exposure parameters are locked are independent of each other, allowing users to easily lock the exposure or set the tracking target, thus improving the user experience.
[0027] Optionally, before the terminal device displays the first interface, the method further includes: the terminal device displays a second interface, the second interface including the first window; when the terminal device detects that the screen displayed in the first window includes the first object, a first tracking identifier associated with the first object is displayed in the first window; wherein, the terminal device displays the first interface of the camera application, including: in response to the user's trigger operation on the first tracking identifier, the terminal device displays the first interface.
[0028] Understandably, the terminal device does not display the small window before setting the tracking target, and displays the small window after setting the tracking target. The tracking icon can be the tracking box mentioned below, or it can be in other forms (e.g., a thumbnail of the object, a number, an icon, etc.), which is not limited here. The tracking icon can also be located where the object is displayed, or it can be arranged and displayed at the edge of the preview area or the recording area, which is not limited here.
[0029] The first tracking identifier can be a tracking identifier corresponding to any object, such as a tracking box corresponding to a male person.
[0030] The triggering operation for the first tracking identifier can be a click operation or a touch operation. This application embodiment does not limit the type of triggering operation.
[0031] For example, the terminal device in Figure 6 When the interface shown in b detects the user clicking the tracking box 605 corresponding to the male character, it enters... Figure 6The interface shown in 'c'; or, the terminal device in Figure 7 When the interface shown in 'a' detects that the user clicked on the tracking box 701 corresponding to the male character, it enters... Figure 7 The interface shown in b is shown in the image.
[0032] Optionally, the first interface is a preview interface during video recording. The first interface also includes an end control. The method further includes: the terminal device detects a third operation on the end control; in response to the third operation, the terminal device saves the first video and the second video, wherein the first video is a video composed of the screens displayed in the first window, and the second video is a video composed of the screens displayed in the second window.
[0033] In this embodiment, the third operation can be a user click operation or a user touch operation; this embodiment does not limit the third operation. The first video can be a video generated from the recording screen displayed in the recording area, and the second video can be a video generated from the tracking screen displayed in the small window.
[0034] The end control can be Figure 3C The end control 318 is shown as 'a' in the diagram. When the terminal device detects that the user clicks the end control 318, the terminal device ends the recording and generates a video based on the recording screen displayed in the recording area; a focus-tracking video is generated based on the tracking screen displayed in the small window.
[0035] In this way, the terminal device can save two video streams and generate an additional video stream based on the tracked target. Users can obtain the video of the tracked target without editing the video, thus improving the user experience.
[0036] Optionally, the first screen is a preview screen before starting video recording.
[0037] Optionally, in response to the first operation, the terminal device also displays a first identifier in the first window; the terminal device receives a fourth operation targeting the first identifier; in response to the fourth operation, the terminal device adjusts the first exposure parameter to a second exposure parameter, and the second exposure parameter is locked.
[0038] The first identifier can be a standard bar as described below, for example... Figure 8A Standard bar 807 is shown as b in 9A; standard bar 907 is shown as b in 9A. The fourth operation can be a sliding operation or other forms of operation, which is not limited in this embodiment.
[0039] When the terminal device detects a sliding operation, it can adjust the exposure value and thus the exposure parameters based on the sliding operation.
[0040] For example, the terminal device can Figure 8AThe interface shown as 'b' receives a swipe gesture, and adjusts the exposure value and parameters based on the swipe gesture, then enters... Figure 8A The interface shown by 'd' in the diagram. Terminal devices can... Figure 9A The interface shown as 'b' receives a swipe gesture, and adjusts the exposure value and parameters based on the swipe gesture, then enters... Figure 9A The interface shown in d is shown in the image.
[0041] Optionally, the first window may also include one or more controls, and the fourth operation is a sliding operation; during the sliding operation, the first window does not display one or more controls.
[0042] The preview area can include controls for exiting protagonist mode, settings, flash, small window style, zoom, etc., while the recording area can include flash controls. It is understood that recording controls can also be located in the preview area; pause and end controls can also be located in the recording area. There are no restrictions here.
[0043] For example, the terminal device can Figure 8A The interface shown as 'b' receives a swipe operation and adjusts the exposure value and exposure parameters based on the swipe operation. Figure 8A Enter the interface shown as 'c' in the image. Figure 8A The interface shown by 'd' in the diagram. Terminal devices can... Figure 9A The interface shown as 'b' receives a swipe operation and adjusts the exposure value and exposure parameters based on the swipe operation. Figure 9A Enter the interface shown as 'c' in the image. Figure 9A The interface shown in d is shown in the image.
[0044] In this way, the terminal device can hide one or more controls, which can reduce accidental triggering by users and improve the user experience.
[0045] Optionally, during the sliding operation, the first window also displays the exposure change value, which is related to the sliding distance corresponding to the sliding operation.
[0046] For example, such as Figure 8A The interface shown as 'c' also displays the exposure change value of 810. (For example...) Figure 9A The interface shown in 'c' also displays the exposure change value of 910.
[0047] In this way, the change in exposure value can prompt the user to adjust the exposure value accordingly, thus improving the user experience.
[0048] Optionally, if the terminal device does not receive the fourth operation within a preset time period after the fourth moment, the first identifier becomes semi-transparent, and the fourth moment is the moment when the terminal device detects the last trigger of the first identifier.
[0049] The fourth operation is an operation that arbitrarily adjusts the exposure, or it can be understood as an operation targeting the first identifier; for example, a sliding operation, a long press operation, etc. The embodiments of this application do not limit the fourth operation.
[0050] The preset time period can be 2 seconds or 5 seconds; the specific value of the preset time period is not limited here. The fourth moment can refer to the moment when the first identifier was last triggered.
[0051] For example, the terminal device can Figure 8A The interface shown as 'd' did not receive the swipe operation. (Enter...) Figure 8A In the interface shown by 'e', the standard bar becomes semi-transparent. The terminal device can... Figure 9A The interface shown as 'd' did not receive the swipe operation. (Enter...) Figure 9A In the interface shown by 'e', the standard bar becomes semi-transparent.
[0052] Understandably, if no exposure adjustment is received within the preset time period, the display of the first indicator can be hidden or weakened to reduce interference with the preview or recording screen and improve the user experience.
[0053] Understandably, in response to the first operation, the terminal device also displays an exposure lock prompt in the first window, which is used to remind the user to lock the exposure.
[0054] For exposure lock prompts, please refer to the following text. Figures 8A-9D The exposure lock indicator in the image. For example, Figure 8A Exposure lock warning 806 in the image. Figure 9A The exposure lock indicator 906, etc., will not be elaborated upon here.
[0055] Terminal devices can display an exposure lock prompt to remind users that the exposure parameters are locked, making it easier for users to adjust the exposure value or cancel the exposure lock later, thus improving the user experience.
[0056] Optionally, the method further includes: the terminal device receiving a fifth operation on the first window; in response to the fifth operation, the terminal device canceling the exposure parameter lock, and the first window not displaying an exposure lock prompt.
[0057] The fifth action can be a user click or any other action; there are no restrictions here.
[0058] For example, the terminal device can Figure 8A The interface shown as 'e' receives a user click and enters... Figure 8A The interface shown in 'a'.
[0059] This allows the terminal device to disable exposure lock and adjust exposure parameters based on focus, the overall image, and other factors. Multiple control methods and functions enhance the user experience.
[0060] Optionally, the terminal device receives a sixth operation for the first window; in response to the sixth operation, the terminal device adjusts the exposure parameters of the locked state to the third exposure parameters based on the sixth operation.
[0061] The sixth action can be a long press, a click, or any other action; there are no restrictions here.
[0062] For example, the terminal device can Figure 10 The interface shown as 'a' in the image receives a long press from the user and enters... Figure 10 The interface shown in b is shown in the image.
[0063] In this way, the terminal device can also adjust the exposure lock position, and then fix it after adjusting the exposure parameters based on the new position. Multiple control methods and functions enhance the user experience.
[0064] Secondly, embodiments of this application provide a terminal device, which can also be referred to as a terminal, user equipment (UE), mobile station (MS), mobile terminal (MT), etc. The terminal device can be a mobile phone, smart TV, wearable device, tablet computer, computer with wireless transceiver capabilities, virtual reality (VR) terminal device, augmented reality (AR) terminal device, wireless terminal in industrial control, wireless terminal in self-driving, wireless terminal in remote medical surgery, wireless terminal in smart grid, wireless terminal in transportation safety, wireless terminal in smart city, wireless terminal in smart home, and so on.
[0065] The terminal device includes a processor for calling a computer program in memory to perform the method as described in the first aspect.
[0066] Thirdly, embodiments of this application provide a computer-readable storage medium storing computer instructions that, when executed on a terminal device, cause the terminal device to perform the method as described in the first aspect.
[0067] Fourthly, embodiments of this application provide a computer program product that, when the computer program is run, causes a terminal device to execute the method as described in the first aspect.
[0068] Fifthly, embodiments of this application provide a chip, the chip including a processor, the processor being configured to invoke a computer program in memory to execute the method as described in the first aspect.
[0069] It should be understood that the second to fifth aspects of this application correspond to the technical solutions of the first aspect of this application, and the beneficial effects achieved by each aspect and the corresponding feasible implementation are similar, and will not be repeated here. Attached Figure Description
[0070] Figure 1 This is a schematic diagram of the hardware system structure of the terminal device provided in the embodiments of this application;
[0071] Figure 2 This is a schematic diagram of the terminal device software system structure provided in the embodiments of this application;
[0072] Figure 3A This is a schematic diagram of an application scenario provided by an embodiment of this application;
[0073] Figure 3B This is a schematic diagram of a protagonist mode preview interface provided in an embodiment of this application;
[0074] Figure 3C This is a schematic diagram of a protagonist mode recording interface provided in an embodiment of this application;
[0075] Figure 4 A schematic diagram of the interface of a terminal device entering the main character mode, provided as an embodiment of this application;
[0076] Figure 5 A schematic diagram of the interface of a terminal device entering the main character mode, provided as an embodiment of this application;
[0077] Figure 6 This is a schematic diagram of the interface corresponding to a protagonist mode recording process provided in an embodiment of this application;
[0078] Figure 7 This is a schematic diagram of the interface corresponding to a protagonist mode recording process provided in an embodiment of this application;
[0079] Figure 8A A schematic diagram of an interface for adjusting exposure in a preview scene, provided as an embodiment of this application;
[0080] Figure 8B A schematic diagram of an interface for adjusting exposure in a preview scene, provided as an embodiment of this application;
[0081] Figure 8C A schematic diagram of an interface for adjusting exposure in a preview scene, provided as an embodiment of this application;
[0082] Figure 8D A schematic diagram of an interface for adjusting exposure in a preview scene, provided as an embodiment of this application;
[0083] Figure 9A This is a schematic diagram of an interface for adjusting exposure in a recording scene, provided as an embodiment of this application.
[0084] Figure 9B This is a schematic diagram of an interface for adjusting exposure in a recording scene, provided as an embodiment of this application.
[0085] Figure 9C This is a schematic diagram of an interface for adjusting exposure in a recording scene, provided as an embodiment of this application.
[0086] Figure 9D This is a schematic diagram of an interface for adjusting exposure in a recording scene, provided as an embodiment of this application.
[0087] Figure 10 This is a schematic diagram of an interface for adjusting exposure in a recording scene, provided as an embodiment of this application.
[0088] Figure 11 A flowchart illustrating a video recording method provided in an embodiment of this application;
[0089] Figure 12 This is a schematic diagram of the structure of a video recording device provided in an embodiment of this application. Detailed Implementation
[0090] To facilitate a clear description of the technical solutions in the embodiments of this application, the terms "first" and "second" are used in the embodiments of this application to distinguish identical or similar items with essentially the same function and purpose. For example, "first chip" and "second chip" are used only to distinguish different chips and do not limit their order. Those skilled in the art will understand that the terms "first" and "second" do not limit the quantity or execution order, and the terms "first" and "second" do not necessarily imply that they are different.
[0091] It should be noted that, in the embodiments of this application, the terms "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design scheme described as "exemplary" or "for example" in this application should not be construed as being more preferred or advantageous than other embodiments or design schemes. Specifically, the use of terms such as "exemplary" or "for example" is intended to present the relevant concepts in a specific manner.
[0092] In this application embodiment, "at least one" refers to one or more, and "more than one" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or multiple.
[0093] This application provides a video recording method that can be applied to electronic devices with recording capabilities. Electronic devices include terminal devices, which can also be called terminals, user equipment (UE), mobile stations (MS), mobile terminals (MT), etc. Terminal devices can be mobile phones, smart TVs, wearable devices, tablets, computers with wireless transceiver capabilities, virtual reality (VR) terminal devices, augmented reality (AR) terminal devices, wireless terminals in industrial control, wireless terminals in self-driving, wireless terminals in remote medical surgery, wireless terminals in smart grids, wireless terminals in transportation safety, wireless terminals in smart cities, wireless terminals in smart homes, and so on. The embodiments of this application do not limit the specific technology or device form used in the terminal devices.
[0094] To better understand the embodiments of this application, the structure of the terminal device of this application embodiment is described below:
[0095] Figure 1A schematic diagram of the terminal device 100 is shown. The terminal device may include components such as: a radio frequency (RF) circuit 110, a memory 120, an input unit 130, a display unit 140, a sensor 150, an audio circuit 160, a wireless fidelity (WiFi) module 170, a processor 180, a power supply 190, and a Bluetooth module 1100. Those skilled in the art will understand that... Figure 1 The terminal device structure shown does not constitute a limitation on the terminal device and may include more or fewer components than shown, or combine certain components, or have different component arrangements.
[0096] The following is combined with Figure 1 A detailed introduction to each component of the terminal device:
[0097] RF circuit 110 can be used for receiving and transmitting signals during information transmission or calls. Specifically, it receives downlink information from the base station and processes it with processor 180; additionally, it transmits uplink data to the base station. Typically, RF circuitry includes, but is not limited to, antennas, at least one amplifier, transceiver, coupler, low-noise amplifier (LNA), duplexer, etc. Furthermore, RF circuit 110 can also communicate wirelessly with networks and other devices. The aforementioned wireless communication can use any communication standard or protocol, including but not limited to Global System for Mobile Communication (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), email, and Short Message Service (SMS), etc.
[0098] The memory 120 can be used to store software programs and modules. The processor 180 executes various functional applications and data processing of the terminal device by running the software programs and modules stored in the memory 120. The memory 120 may mainly include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback function, image playback function, etc.), a boot loader, etc.; the data storage area may store data created according to the use of the terminal device (such as audio data, phonebook, etc.). In addition, the memory 120 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device. It is understood that in this embodiment, the memory 120 stores a program for Bluetooth device reconnection.
[0099] The input unit 130 can be used to receive input numerical or character information, and to generate key signal inputs related to user settings and function control of the terminal device. Specifically, the input unit 130 may include a touch panel 131 and other input devices 132. The touch panel 131, also known as a touch screen, can collect touch operations performed by the user on or near it (such as operations performed by the user using a finger, stylus, or any suitable object or accessory on or near the touch panel 131), and drive the corresponding connection devices according to a pre-set program. Optionally, the touch panel 131 may include two parts: a touch detection device and a touch controller. The touch detection device detects the user's touch position and the signal generated by the touch operation, and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device, converts it into touch point coordinates, sends it to the processor 180, and can receive and execute commands sent by the processor 180. In addition, the touch panel 131 can be implemented using various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 131, the input unit 130 may also include other input devices 132. Specifically, other input devices 132 may include, but are not limited to, one or more of the following: physical keyboard, function keys (such as volume control buttons, power buttons, etc.), trackball, mouse, joystick, etc.
[0100] The display unit 140 can be used to display information input by the user or information provided to the user, as well as various menus of the terminal device. The display unit 140 may include a display panel 141, optionally configured as a liquid crystal display (LCD), organic light-emitting diode (OLED), or similar form. Further, a touch panel 131 may cover the display panel 141. When the touch panel 131 detects a touch operation on or near it, it transmits the information to the processor 180 to determine the type of touch event. Subsequently, the processor 180 provides corresponding visual output on the display panel 141 based on the type of touch event. Although in Figure 1 In this embodiment, the touch panel 131 and the display panel 141 are two separate components to realize the input and output functions of the terminal device. However, in some embodiments, the touch panel 131 and the display panel 141 can be integrated to realize the input and output functions of the terminal device.
[0101] The terminal device may also include at least one sensor 150, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor. The ambient light sensor can adjust the brightness of the display panel 141 according to the ambient light level, and the proximity sensor can turn off the display panel 141 or the backlight when the terminal device is moved to the ear. As a type of motion sensor, an accelerometer sensor can detect the magnitude of acceleration in various directions (generally three axes). When stationary, it can detect the magnitude and direction of gravity and can be used for applications that identify the posture of the terminal device (such as landscape / portrait switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc. Other sensors that may be configured in the terminal device, such as gyroscopes, barometers, hygrometers, thermometers, and infrared sensors, will not be described in detail here.
[0102] Audio circuit 160, speaker 161, and microphone 162 provide an audio interface between the user and the terminal device. Audio circuit 160 converts received audio data into electrical signals and transmits them to speaker 161, where speaker 161 converts them into sound signals for output. On the other hand, microphone 162 converts collected sound signals into electrical signals, which are then received by audio circuit 160, converted into audio data, and then processed by processor 180 before being transmitted via RF circuit 110 to, for example, another terminal device, or the audio data can be output to memory 120 for further processing.
[0103] WiFi is a short-range wireless transmission technology. Terminal devices using a WiFi module 170 can help users send and receive emails, browse web pages, and access streaming media, providing users with wireless broadband internet access. Although Figure 1 WiFi module 170 is shown, but it is understood that it is not a necessary component of the terminal device and can be omitted as needed without changing the essence of the invention.
[0104] The processor 180 is the control center of the terminal device. It connects various parts of the terminal device via various interfaces and lines. By running or executing software programs or modules stored in the memory 120, and by calling data stored in the memory 120, it performs various functions and processes data of the terminal device, thereby providing overall monitoring of the terminal device. Optionally, the processor 180 may include one or more processing units; preferably, the processor 180 may integrate an application processor and a modem processor, wherein the application processor mainly handles the operating system, user interface, and applications, and the modem processor mainly handles wireless communication. It is understood that the modem processor may not be integrated into the processor 180.
[0105] It is understood that in this embodiment of the application, the memory 120 stores a recording program, and the processor 180 can be used to call and execute the recording program stored in the memory 120 to implement the recording method of this embodiment of the application.
[0106] The terminal device also includes a power supply 190 (such as a battery) that supplies power to various components. Preferably, the power supply can be logically connected to the processor 180 through a power management system, thereby enabling functions such as charging, discharging, and power consumption management through the power management system.
[0107] Bluetooth technology is a short-range wireless transmission technology. Terminal devices can establish Bluetooth connections with other terminal devices equipped with Bluetooth modules via Bluetooth module 1100, thereby transmitting data based on the Bluetooth communication link. Bluetooth module 1100 can be Bluetooth Low Energy (BLE) or a module, depending on actual needs. It is understood that in the embodiments of this application where the terminal device is a user terminal or a business device, the terminal device includes a Bluetooth module. However, it is understood that the Bluetooth module is not a necessary component of the terminal device and can be omitted as needed without changing the essence of the invention; for example, a server may not include a Bluetooth module.
[0108] Although not shown, the terminal device also includes a camera. Optionally, the camera can be positioned on the front, rear, or built-in (extending out of the device during use), and this application embodiment does not limit this.
[0109] Optionally, the terminal device may include a single camera, dual cameras, or triple cameras, etc., and this application embodiment does not limit this. Cameras include, but are not limited to, wide-angle cameras, telephoto cameras, or depth cameras. For example, the terminal device may include three cameras, wherein one is a main camera, one is a wide-angle camera, and one is a telephoto camera.
[0110] Optionally, when the terminal device includes multiple cameras, these multiple cameras may all be front-facing, all be rear-facing, all be built-in, or at least some may be front-facing, at least some may be rear-facing, or at least some may be built-in, etc. The embodiments of this application do not limit this.
[0111] For example, Figure 2 This is a software structure block diagram of the terminal device 100 according to an embodiment of this application.
[0112] A layered architecture divides software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.
[0113] The application layer can include a series of application packages. For example... Figure 2 As shown, the application package can include applications such as camera, gallery, phone, map, music, settings, email, video, and social media.
[0114] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.
[0115] like Figure 2 As shown, the application framework layer may include a window manager, content provider, resource manager, view system, notification manager, etc.
[0116] The window manager is used to manage windowed applications. It can obtain the screen size, determine if a status bar is present, lock the screen, allow screen touch, drag the screen, and capture the screen, among other things.
[0117] Content providers store and retrieve data, making that data accessible to applications. This data can include videos, images, audio, phone calls made and received, browsing history and bookmarks, phone books, and more.
[0118] A view system includes visual controls, such as controls for displaying text and controls for displaying images. View systems can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text notification icon could include views for displaying text and views for displaying images.
[0119] The file explorer provides applications with various resources, such as localized strings, icons, images, layout files, video files, and more.
[0120] The notification manager allows applications to display notifications in the status bar. These notifications can be used to deliver informational messages and can disappear automatically after a short pause, requiring no user interaction. For example, the notification manager can be used to notify users of download completion or message alerts. The notification manager can also display notifications as icons or scrolling text in the top status bar, such as notifications from background applications, or as dialog boxes on the screen. Examples include displaying text messages in the status bar, emitting sounds, vibrating the device, and flashing indicator lights.
[0121] The Android runtime consists of core libraries and a virtual machine. The Android runtime is responsible for scheduling and managing the Android system.
[0122] The core library consists of two parts: one part is the functionalities that need to be called by the Java language, and the other part is the Android core library.
[0123] The application layer and application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.
[0124] System libraries can include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing libraries (e.g., OpenGL ES), 2D graphics engines (e.g., SGL), etc.
[0125] The Surface Manager is used to manage the display subsystem and provides the blending of 2D and 3D layers for multiple applications.
[0126] The media library supports playback and recording of various common audio and video formats, as well as still image files. It supports multiple audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, and PNG.
[0127] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0128] A 2D graphics engine is a graphics engine for 2D drawing.
[0129] The kernel layer is the layer between hardware and software. The kernel layer contains at least the display driver, camera driver, audio driver, and sensor driver.
[0130] The following example, using the scenario of switching terminal device interfaces, illustrates the workflow of terminal device software and hardware.
[0131] When the touch sensor in the terminal device receives a touch operation, the corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the touch operation into a raw input event (including touch coordinates, touch pressure, and the timestamp of the touch operation). The raw input event is stored in the kernel layer. The application framework layer retrieves the raw input event from the kernel layer and identifies the control corresponding to the input event. Taking a single touch operation as an example, where the corresponding control is the camera application icon, the camera application calls the interface of the application framework layer to launch the camera application, and then calls the kernel layer to launch the display driver and display the camera application's functional interface.
[0132] Once the camera application is launched, it can call the camera access interface in the application framework layer to initiate the camera's shooting function. Based on the camera driver in the kernel layer, it drives one or more cameras to capture one or more frames of images in real time. After the camera captures the image, it can transmit the image to the camera application in real time through the kernel layer, system libraries, and application framework layer, and then the camera application displays the image on the corresponding functional interface.
[0133] The technical solution of this application and how the technical solution of this application solves the above-mentioned technical problems are described in detail below with specific embodiments. The following specific embodiments can be implemented independently or in combination with each other. The same or similar concepts or processes may not be described again in some embodiments.
[0134] To enhance user experience, mobile phones, tablets, and other terminal devices are typically equipped with multiple cameras. These cameras can provide users with various shooting modes, such as front-facing mode, rear-facing mode, dual-camera mode, and subject mode. Users can select the appropriate shooting mode based on the shooting scenario.
[0135] The "Main Character Mode" can be understood as a mode that generates an additional portrait-tracking video when recording video on a terminal device. This means that upon completion of recording, two or more videos are saved: one is the original recorded video, and the other is a video automatically cropped from the original video based on the tracked subject's image. The subject in this portrait-tracking video can be understood as the "main character" that the user is focusing on. The video corresponding to the "main character" is generated by cropping the corresponding video content from the video recorded by the terminal device.
[0136] In this context, the "protagonist" can be a living being such as a person or animal, or a non-living being such as a vehicle. It is understood that any object that can be identified based on an algorithmic model can serve as the "protagonist" in this application's embodiments. In this application's embodiments, the "protagonist" can be defined as the focus tracking object, which can also be called the protagonist object, tracking target, tracking object and focus tracking target, etc. This application's embodiments do not limit the concept of "protagonist."
[0137] To facilitate understanding, the protagonist mode in the shooting modes will be explained below with reference to the attached diagram.
[0138] For example, Figure 3A This is a schematic diagram illustrating an application scenario provided by an embodiment of this application. For example... Figure 3A As shown, the application scenario includes terminal device 301, person 302, and person 303.
[0139] Terminal device 301 can record video containing the tracked target using a camera. The tracked target can be any person recorded by the camera, or any object such as an animal or a vehicle. Figure 3A In the scene shown, the tracking target can be either person 302 or person 303 in the shooting frame.
[0140] In protagonist mode, the terminal device can obtain one or more additional focus-tracking videos corresponding to the target while recording video.
[0141] Specifically, when the terminal device 301 is previewing in protagonist mode, it can receive the user's operation of setting a tracking target. After starting video recording, the terminal device 301 can generate one or more additional focus-tracking videos based on the tracking target. For example, the terminal device 301 can set the person 302 in the shooting frame as the tracking target, or it can set the person 303 in the shooting frame as the tracking target.
[0142] Alternatively, when the terminal device 301 records in protagonist mode and receives an operation from the user to set a tracking target, the terminal device 301 can generate one or more additional focus-tracking videos based on the tracking target. In this way, the focus-tracking video corresponding to the tracking target can be obtained without manually editing the entire video.
[0143] Understandably, during video recording, the terminal device can switch the person corresponding to the tracking target one or more times. Specifically, when the terminal device receives an instruction from the user to switch the tracking target, the terminal device switches the person corresponding to the tracking target.
[0144] In one possible implementation, when the person corresponding to the tracking target changes, the tracking video obtained by the terminal device contains different people.
[0145] For example, when the terminal device detects that the user has switched the tracking target from person 302 to person 303 during recording, the terminal device displays the tracking screen based on person 303. In the focus-tracking video generated based on the tracking target after recording, person 302 is displayed before the tracking target switch; person 303 is displayed after the tracking target switch. It can also be understood that the part before the tracking target switch corresponds to person 302, and the part after the tracking target switch corresponds to person 303.
[0146] Specifically, taking the example where the terminal device detects that the user has switched the tracking target from person 302 to person 303 at the 3-second mark during the recording of a focus-tracking video, person 302 will be displayed in the focus-tracking video before the 3-second mark, and person 303 will be displayed in the focus-tracking video after the 3-second mark. In this way, the terminal device can switch the tracking target, thus switching the person in the focus-tracking video and improving the user experience.
[0147] In another possible implementation, when the person corresponding to the tracking target changes, the terminal device can obtain one tracking video based on the tracking target before the switch and another tracking video based on the tracking target after the switch.
[0148] For example, when the terminal device detects that the user has switched the tracking target from person 302 to person 303 during the recording process, the terminal device generates a focus tracking video 1 based on person 302, and generates a focus tracking video 2 based on person 303 after the tracking target is switched to person 303.
[0149] In some embodiments, during the video recording process, the terminal device can also start and stop the recording of the focus-tracking video multiple times, generating additional multiple focus-tracking videos.
[0150] For example, during the recording of video 1, when the terminal device receives an operation from the user to end tracking of person 303, the terminal device can generate a focus-tracking video 2 based on person 303. When the terminal device receives an operation from the user to track person 302 after ending the tracking of person 303, the terminal device 301 can additionally generate a focus-tracking video 3 based on person 302. At this time, in addition to the normally recorded video 1, the terminal device generates two additional focus-tracking videos (i.e., focus-tracking video 2 and focus-tracking video 3). This application embodiment does not limit the number of focus-tracking videos.
[0151] In this way, the terminal device can start and stop recording the focus-tracking video multiple times, generating multiple focus-tracking videos based on the tracked target, thus improving the user experience.
[0152] It should be noted that the above Figure 3A The scenario shown includes a video recorded by the terminal device's camera containing two people. The video from the terminal device may contain more or fewer people. This application embodiment does not impose a specific limit on the number of people recorded by the terminal device.
[0153] It should be noted that when the terminal device does not receive any user-set tracking target operation during preview and recording in protagonist mode, one video stream will be obtained upon ending recording. If the terminal device receives a user-set tracking target operation during preview in protagonist mode and then receives a user-closed window operation, the terminal device will cancel tracking of the target. If no user-set tracking target operation is received during recording, one video stream will be obtained upon ending recording.
[0154] Understandably, the protagonist mode can be set in applications with shooting functions, such as cameras. Once the terminal device enters protagonist mode, its implementation can include preview mode and recording mode.
[0155] It should be noted that the interface displayed on the terminal device in both preview mode (before recording) and recording mode (during recording) can be referred to as the preview interface; the screen displayed in the preview interface in preview mode (before recording) will not generate a video and be saved; the screen displayed in the preview interface in recording mode (during recording) will generate a video and be saved. For ease of distinction, in the following text, the preview interface in preview mode (before recording) will be referred to as the preview interface; and the preview interface in recording mode (during recording) will be referred to as the recording interface.
[0156] In the preview mode of the main character mode, the terminal device can display the image captured by the camera in the preview area (preview screen) and the image of the user-selected tracking target in a small window (tracking screen). The terminal device may not generate video in preview mode, nor may it save the content displayed in the preview area and the content displayed in the small window.
[0157] For example, the preview interface of the protagonist mode in the terminal device can be as follows: Figure 3B As shown. The preview interface includes a preview area 304 and a recording control 305.
[0158] Preview area 304 displays a preview image. When the terminal device detects a person in the preview image, a tracking frame (e.g., tracking frame 307 and tracking frame 308) is displayed in the preview area. The tracking frame can indicate to the user that the corresponding person can be set or switched as the tracking target, and can also facilitate the user in setting or switching the tracking target. When the terminal device detects multiple people in the preview image, multiple tracking frames can be displayed in the preview area. The number of tracking frames is less than or equal to the number of people detected by the terminal device. The tracking target is any one of the multiple people in the preview image with corresponding tracking frames. The tracking target can be called the focus object, the main character object, etc., and this application does not limit this.
[0159] In some embodiments, the tracking frame corresponding to a person set as a tracking target (e.g., tracking frame 307) has a different display style than the tracking frame corresponding to a person not set as a tracking target (e.g., tracking frame 308). This makes it easier for users to distinguish and identify the person being tracked (tracking target). In addition to the different styles of the tracking frames, embodiments of this application may also set the colors of the tracking frames; for example, tracking frame 307 and tracking frame 308 may have different colors. This allows for a more intuitive distinction between the tracking target and other people.
[0160] The tracking box can be a dotted frame, such as tracking box 307; or it can be a combination of a dotted frame and a "+" sign, such as tracking box 308. The tracking box can also be displayed in any form, as long as it can be triggered by the user to track the target. The tracking box can be marked at any position of the person who can be set as the tracking target; this embodiment of the application does not impose specific limitations on this.
[0161] It is understood that the tracking frame is one type of tracking identifier, and the terminal device can also display other forms of tracking identifiers to facilitate users in setting tracking targets. For example, other forms of tracking identifiers can be thumbnails of objects, numbers, letters, and graphics, etc. Furthermore, tracking identifiers can be placed anywhere on the object, near the object, or at the edge of the preview area. This application does not specifically limit the specific location of the tracking identifiers.
[0162] For example, the terminal device can arrange thumbnails of one or more objects and display them at the edge of the preview area. When the terminal device receives an operation from the user clicking on any tracking icon, it sets the object corresponding to the clicked tracking icon as the tracking target.
[0163] In one possible implementation, the terminal device can identify a person using facial recognition technology and display a tracking box. The terminal device can determine the display position of the tracking box based on technologies such as human body recognition, for example, a position relatively centered on the person's body. In this way, calculating the position of the tracking box based on the human body can reduce the likelihood of the tracking box being located directly above the face, thus reducing occlusion of the face and improving the user experience. This application does not specifically limit the facial recognition technology or the technology used to calculate the tracking box position.
[0164] In some embodiments, Figure 3B It also includes a small window 306. The small window 306 displays a tracking screen. The tracking screen corresponds to the tracking target. When the tracking target changes, the person in the tracking screen displayed in the small window 306 changes accordingly. For example, if the tracking target changes from the person corresponding to tracking box 307 to the person corresponding to tracking box 308, the tracking screen displayed in the small window 306 also changes accordingly.
[0165] The tracking screen can be a part of the preview screen. In a possible implementation, the tracking screen is obtained by the terminal device cropping the preview screen in real time based on the tracking target according to a certain ratio. This application embodiment does not specifically limit the screen displayed in the small window.
[0166] In some embodiments, the size, position, and landscape / portrait display mode of the small window are adjustable, and users can adjust the style of the small window according to their recording habits.
[0167] Optionally, the tracked target can be displayed in the center of the tracking screen.
[0168] Optionally, a small window floats above the recording area. This is not a limitation.
[0169] In some embodiments, the small window 306 also includes a close control 309 and a first toggle control 310.
[0170] Understandably, when the terminal device receives the user's instruction to set a tracking target, a small window will appear in the preview interface to display the tracking screen of the target. When the terminal device does not receive the user's instruction to set a tracking target, the small window will not appear in the preview interface.
[0171] When the user is Figure 3B When the close control 309 is triggered by clicking, touching, or other operations in the preview interface shown, the terminal device receives the operation to close the small window, closes the small window, and cancels the preview of the tracked target.
[0172] When the user is Figure 3BIn the preview interface shown, when the first switching control 310 is triggered by clicking, touching, or other operations, the terminal device receives an operation to switch the display mode (style) of the small window, and the terminal device switches the style of the small window. Specifically, the small window can be switched from horizontal to vertical, or from vertical to horizontal.
[0173] When the user is Figure 3B When the preview interface shown triggers the recording control 305 through clicks, touches, or other operations, the terminal device receives the start recording operation and begins recording video and focusing video.
[0174] Optionally, the preview interface may also include other controls, such as a protagonist mode exit control 311, a settings control 312, a flash control 313, a second switching control 314, a zoom control 315, etc.
[0175] When the protagonist mode exit control 311 is triggered, the terminal device exits protagonist mode and enters recording mode. When the settings control 312 is triggered, the terminal device can adjust various settings parameters. These parameters include, but are not limited to, enabling watermarking, storage path, encoding method, and saving geographic location. When the flash control 313 is triggered, the terminal device can set flash effects, such as controlling the flash to be forcibly turned on, forcibly turned off, turned on during photo taking, and turned on adaptively according to the environment. When the zoom control 315 is triggered, the terminal device can adjust the camera's focal length, thereby adjusting the magnification of the preview image.
[0176] When the user is Figure 3B When the preview interface is triggered by clicking or touching, the second switching control 314 receives an operation to set the style of the small window, and displays the small window style selection options for the user to choose from. The small window style selection options include, but are not limited to, horizontal or vertical orientation. This application embodiment does not limit this. In possible implementations, the second switching control 314 corresponds to the display style of the small window, making it convenient for the user to distinguish between different small window styles.
[0177] It should be noted that, Figure 3B In the preview interface shown, the style of the small window can be switched using either the first switching control 310 or the second switching control 314. In a possible implementation, the first switching control 310 in the small window and the second switching control 314 in the preview area can be linked. For example, when the small window switches from horizontal to vertical orientation, the icon of the first switching control 310 displays the style used in the vertical preview, and the icon of the second switching control 314 also displays the style used in the vertical preview. Alternatively, both the icons of the first switching control 310 and the second switching control 314 can display the style used in the horizontal preview, prompting the user to click again to switch to the desired preview style.
[0178] Understandably, in preview scenarios, once the terminal device sets a tracking target, the tracking view in the small window can display the tracking target in the center. In some scenarios, the tracking target may be moving; when the tracking target moves but does not leave the camera's view, the tracking view in the small window can continue to display the tracking target in the center.
[0179] For example, the preview interface can be set to track both male and female characters. The terminal device responds to the user's click on the tracking box for the male character, sets the male character as the tracking target, and then enters a sequence such as... Figure 3B The interface shown in 'a'. Figure 3B In the interface shown in Figure 'a', the tracking view in the small window displays the male figure in the center, positioned to the right of the female figure. As the male figure moves, the device continuously tracks and focuses on him, centering him in the small window. When the male figure moves to the left of the female figure, the device's interface can... Figure 3B As shown in b. Figure 3B In the "b" interface, the tracking screen in the small window still displays the male character in the center, with the male character to the left of the female character.
[0180] In one possible implementation, after the terminal device tracks the target, the focus moves with the tracked target. For example, Figure 3B In the interface shown in Figure 'a', the focus is on the male character's face, located slightly to the right of the center of the image. As the male character moves, the device continuously tracks him. When the male character moves to the left of the female character, the device's interface can adjust as follows: Figure 3B As shown in b. Figure 3B In the interface shown by b, the focus is on the male character's face, located slightly to the left of the center of the screen.
[0181] In the main character mode recording mode, the terminal device can display the image captured by the camera (recording screen) in the recording area, and display the image of the user-selected tracking target (tracking screen) in a small window, and generate the recorded video and the tracking video after the recording mode is turned on. At the end of the recording, the terminal device saves the video generated based on the recorded screen and the tracking video generated based on the tracking screen.
[0182] In some embodiments, the recording in the small window can end earlier than the recording of the entire recording area. When the small window recording ends, the terminal device saves the focus-tracked video generated based on the tracking image. Alternatively, it can be understood that the terminal device can end the recording of the focus-tracked video earlier than the recording of the entire video.
[0183] In some embodiments, the recording window may start later than the recording area. Alternatively, it can be understood that after the terminal device starts recording video and detects the user's action of setting a tracking target, the terminal device opens the small window and begins recording the video with focus tracking.
[0184] For example, the recording interface for protagonist mode in the terminal device can be as follows: Figure 3C As shown. The recording interface includes a recording area 316, a pause control 317, and an end control 318.
[0185] Recording area 316 displays the recording screen and recording duration. When the terminal device detects a person in the recording screen, the recording area displays tracking frames (e.g., tracking frames 320 and 321). It is understood that the number of tracking frames is less than or equal to the number of people detected by the terminal device.
[0186] In some embodiments, the recording interface also displays a small window 319. The small window 319 displays a tracking screen. The tracking screen corresponds to the tracking target. When the tracking target changes, the person in the tracking screen displayed in the small window 319 changes accordingly. For example, if the tracking target changes from the person corresponding to tracking frame 320 to the person corresponding to tracking frame 321, the tracking screen displayed in the small window 319 also changes accordingly.
[0187] The tracking frame can be a portion of the recorded frame. In possible implementations, the tracking frame is obtained by cropping the recorded frame in real-time based on the tracking target. This application does not specifically limit the frame displayed in the small window.
[0188] Optionally, the tracked target can be displayed in the center of the tracking screen.
[0189] Optionally, a small window floats above the recording area. This is not a limitation.
[0190] Small window 319 also includes small window end control 322 and small window recording duration.
[0191] Understandably, when the terminal device receives the user's instruction to set a tracking target, a small window will appear on the recording interface to display the tracking screen of the target. When the terminal device does not receive the user's instruction to set a tracking target, the small window will not appear on the recording interface.
[0192] When the user is Figure 3C When the recording interface shown triggers the end control 318 through click, touch or other operations, the terminal device receives the user's operation to end the recording, enters the preview interface of the main character mode, and stores the video corresponding to the recorded screen and the focus tracking video corresponding to the tracking screen.
[0193] When the user is Figure 3CWhen the pause control 317 is triggered by clicking, touching, or other operations on the recording interface shown, the terminal device receives the user's operation to pause recording. The terminal device then pauses the recording of the video in the recording area 316 and the recording of the focus-tracking video in the small window 319.
[0194] When the user is Figure 3C When the recording interface is triggered by clicking, touching or other operations to end the small window control 322, the terminal device receives the user's operation to end the small window recording. The terminal device continues to display the recording screen in the recording area 316, closes the small window 319 and stores the tracking video corresponding to the tracking screen in the small window 319.
[0195] In one possible implementation, the recording interface also includes a flash control 323. When the flash control 323 is triggered, the terminal device can set the flash effect.
[0196] Understandably, when the terminal device records in protagonist mode, it can generate one video based on the recorded area and an additional video tracking the target based on the tracking view in the small window. Both videos are saved independently on the terminal device. This eliminates the need for subsequent manual editing of the entire video, providing a simple and convenient operation and improving the user experience.
[0197] Understandably, during recording, once a tracking target is set on the terminal device, the tracking view in the small window can display the tracking target in the center. In some scenarios, the tracking target may be moving; when the tracking target moves but does not leave the frame, the tracking view in the small window can continue to display the tracking target in the center.
[0198] For example, the preview interface can be set to track both male and female characters. The terminal device responds to the user's click on the tracking box for the male character, sets the male character as the tracking target, and then enters a sequence such as... Figure 3C The interface shown in 'a'. Figure 3C In the interface shown in Figure 'a', the tracking view in the small window displays the male figure in the center, positioned to the right of the female figure. As the male figure moves, the device continuously tracks and focuses on him, centering him in the small window. When the male figure moves to the left of the female figure, the device's interface can... Figure 3C As shown in b. Figure 3C In the "b" interface, the tracking screen in the small window still displays the male character in the center, with the male character to the left of the female character.
[0199] In one possible implementation, after the terminal device tracks the target, the focus moves with the tracked target. For example, Figure 3CIn the interface shown in Figure 'a', the focus is on the male character's face, located slightly to the right of the center of the image. As the male character moves, the device continuously tracks him. When the male character moves to the left of the female character, the device's interface can adjust as follows: Figure 3C As shown in b. Figure 3C In the interface shown by b, the focus is on the male character's face, located slightly to the left of the center of the screen.
[0200] It is understood that, in this application embodiment, the shooting mode that can generate one or more additional focus-tracking videos based on the tracking target is defined as the main character mode. This shooting mode can also be called focus-tracking mode, etc., and this application embodiment does not limit it in this way.
[0201] The following is combined with Figures 4-7 This document explains how to enter the main character mode on the terminal device and the interface involved in recording. Figure 4 and Figure 5 This is a schematic diagram illustrating the entry process for two main character modes provided in the embodiments of this application. Figure 6 and Figure 7 This is a schematic diagram of the interface involved in recording, provided for an embodiment of this application.
[0202] For example, Figure 4 This is a schematic diagram of the interface of a terminal device entering the main character mode, provided in an embodiment of this application.
[0203] When the terminal device is Figure 4 In the main interface shown in Figure 'a', when the terminal device receives the user's operation to open the camera application 401, it can enter... Figure 4 The image shown in 'b' represents the photo preview interface. This preview interface can include a preview area and shooting mode selection options. The preview area displays a real-time preview image; the shooting mode selection options include, but are not limited to: portrait, photo, video, professional, or more.
[0204] When the user is Figure 4 When the camera preview interface shown in b is triggered by clicks, touches, or other operations, resulting in a 402 error, the terminal device receives the user's request to view other shooting modes and enters... Figure 4 The shooting mode selection interface is shown as 'c' in the image. This interface includes shooting mode selection options, including but not limited to: Professional, Panorama, High Dynamic Range (HDR), Time-lapse, Watermark, Document Correction, High Pixel, Short Film, Protagonist Mode 403, or other types of shooting mode selection options.
[0205] When the user is Figure 4When the shooting mode selection interface shown in 'c' is triggered by clicking, touching, or other operations to enter the main character mode 403, the terminal device receives the user's operation to select the main character mode preview and enters... Figure 4 The preview interface corresponding to the protagonist mode is shown as 'd' in the diagram. This preview interface includes a preview area and recording controls. The preview area displays the preview screen. When there is a character in the preview screen, the preview area also displays a tracking box. When the user triggers the tracking box through a click or touch operation, the terminal device receives the operation to set the tracking target, sets the character corresponding to the tracking box as the tracking target, and displays the tracking screen corresponding to the tracking target in a small window on the display interface.
[0206] For example, Figure 5 This is a schematic diagram of another terminal device entering the main character mode, provided as an embodiment of this application.
[0207] When the terminal device is Figure 5 In the main interface shown in Figure 'a', when the user's action of opening the camera application 501 is received, the terminal device can enter... Figure 5 The image shown in section b is the photo preview interface. This photo preview interface can include a preview area and shooting mode selection options. The preview area displays a preview image in real time; the shooting mode selection options include, but are not limited to: portrait, photo, video, professional, or other types of shooting mode selection options.
[0208] When the user is Figure 5 When the camera preview interface shown in b is triggered to record video 502 by clicking, touching, or other operations, the terminal device receives the user's operation to select video preview and enters... Figure 5 The video preview interface is shown as 'c' in the image. This preview interface includes: a preview area, recording parameter selection options, and shooting mode selection options. The preview area displays the preview image in real time; the recording parameter selection options include, but are not limited to: Subject Mode 503, flash, filters, settings, or other types of recording parameter selection options. The shooting mode selection options include, but are not limited to: portrait, photo, video, professional, or other types of shooting mode selection options.
[0209] When the user is Figure 5 When the main character mode 503 is triggered by clicking, touching, or other operations in the video preview interface shown in 'c', the terminal device receives the user's operation to select the main character mode preview and enters... Figure 5 The preview interface corresponding to the protagonist mode is shown as 'd' in the diagram. This preview interface includes a preview area and recording controls. The preview area displays the preview screen. When there is a character in the preview screen, the preview area also displays a tracking box. When the user triggers the tracking box through a click or touch operation, the terminal device receives the operation to set the tracking target, sets the character corresponding to the tracking box as the tracking target, and displays the tracking screen corresponding to the tracking target in a small window on the display interface.
[0210] It is understandable that when a terminal device enters protagonist mode, the terminal device can be placed horizontally in landscape mode or vertically in portrait mode. The principle of implementing protagonist mode is similar in both landscape and portrait modes. The following embodiments will use landscape recording of the terminal device as an example to describe multiple application scenarios of protagonist mode.
[0211] Understandably, in the camera's subject mode, the terminal device can select the tracking target after recording begins, or it can select the tracking target before recording begins. The following section will combine... Figure 6 and Figure 7 The two recording processes will be explained separately. For example, Figure 6 This is a schematic diagram of the interface corresponding to a protagonist mode recording process provided in an embodiment of this application.
[0212] When the user is Figure 6 In the preview interface shown in Figure 'a', when the recording control 601 is triggered by clicking, touching, or other operations, the terminal device receives the command to start recording and enters... Figure 6 The recording interface is shown as b in the diagram. This recording interface includes: a recording area 602, a pause control 603, and an end control 604. The recording area displays the recording screen and a tracking box 605. The tracking box 605 allows the user to easily select the tracking target.
[0213] When the user is Figure 6 When the tracking box 605 is triggered by clicking, touching, or other operations in the recording interface shown in b, the terminal device receives the user's operation to set the tracking target, and the terminal device enters... Figure 6 The recording interface shown in Figure 608 includes: a recording area, a pause control 606, an end control 607, and a small window 608. The recording area displays the recording screen. The small window 608 includes an end control 609. The small window 608 displays the tracking screen corresponding to the tracking target. The tracking screen corresponding to the tracking target is a part of the recording screen.
[0214] exist Figure 6 Based on the process shown, when the user is Figure 6 When the pause control 606 is triggered by clicking or touching the recording interface shown in C, the terminal device receives the operation to pause video recording, and the video recording is paused. The tracking video corresponding to the small window is also paused.
[0215] When the user is Figure 6 When the recording interface shown in C is triggered by clicking or touching the end control 607, the terminal device receives the operation to end video recording, the video recording ends, and the focus-tracking video corresponding to the small window also ends recording.
[0216] When the user is Figure 6 When the recording interface shown in C is triggered by clicking or touching the small window end control 609, the terminal device receives the operation to end the focus tracking video recording, the focus tracking video recording corresponding to the small window ends, and video recording continues.
[0217] When the user is Figure 6 When the recording interface shown in C is triggered by dragging, the position of the small window 608 can be moved.
[0218] The moving distance of the small window 608 is related to the distance between the start position and the end position of the drag operation, and the moving direction of the small window 608 is related to the direction of the drag operation.
[0219] For example, Figure 7 This is a schematic diagram of the interface corresponding to a protagonist mode recording process provided in an embodiment of this application.
[0220] When the user is Figure 7 In the preview interface shown in Figure 'a', when the tracking box 701 is triggered by clicking, touching, or other operations, the terminal device receives the user's operation to set the tracking target and enters... Figure 7 The preview interface is shown as b in Figure 702. This preview interface includes a preview area 702, a recording control 703, and a small window 704. The recording area displays the preview image. The small window 704 displays the tracking image. The tracking image corresponds to the tracking target. The small window 704 also includes a close control 705 and a first toggle control 706.
[0221] When the user is Figure 7 In the preview interface shown in b, when the recording control 703 is triggered by clicking, touching, or other operations, the terminal device receives the start recording operation and enters... Figure 7 The recording interface is shown as 'c' in the diagram. This recording interface includes: a recording area, a pause control 707, an end control 708, and a small window 709. The recording area displays the recording screen. The small window 709 includes an end control 710. The small window 709 displays a tracking screen, which corresponds to the tracking target. The tracking screen is part of the recording screen.
[0222] The functions of the pause control 707, end control 708, and small window 709 can be found in [reference]. Figure 6 The relevant explanations in the document will not be repeated here.
[0223] exist Figure 7 Based on the process shown, when the user is Figure 7 When the close control 705 is triggered by clicking, touching, or other operations in the preview interface shown in b, the terminal device receives the operation to close the small window, closes the small window, and cancels the preview of the tracked target.
[0224] When the user is Figure 7 In the preview interface shown in b, when the recording control 706 is triggered by clicking, touching, or other operations, the terminal device receives an operation to switch the display mode of the small window, and the terminal device switches the display mode of the small window. Specifically, the small window can be switched from horizontal to vertical or from vertical to horizontal.
[0225] In some possible implementations, the terminal device can also adjust the size of the small window. This application does not limit the specific implementation method for adjusting the size of the small window.
[0226] The terminal device can initiate focus-tracking video recording in a small window based on the above scenarios, and obtain multiple video streams. It should be noted that the small window can display the image of the tracked target in the preview area / recording area, but the video recorded in the small window and the video recorded in the recording area are multiple independent videos. It is not a picture-in-picture composite video in which the tracking image of the small window is nested within the recording image of a single recording area.
[0227] It should be noted that if the terminal device does not enable windowed recording, it will only receive one video stream recorded in the designated recording area. If the terminal device enables windowed recording, it will receive one video stream recorded in the designated recording area, as well as one or more video streams recorded in the windowed recording area. For example, during video recording in the designated recording area, the terminal device can enable windowed recording multiple times. When the terminal device detects a click on the windowed recording end control, it can end the windowed recording, receiving one video stream. When the windowed recording resumes, the terminal device will receive a new video stream. The number of videos received by the terminal device based on the windowed recording area is related to the number of times the windowed recording is enabled.
[0228] Optionally, users can browse videos recorded in the recording area and multiple videos recorded in a small window based on the camera application's album. The display order of the multiple videos can be the recording order, that is, the terminal device can sort them according to the end time or start time of the recording. The display order of the multiple videos can also be the reverse recording order, that is, the terminal device can arrange the videos in reverse order according to the end time or start time of the recording.
[0229] Optionally, videos recorded in the recording area and videos recorded in the small window can be displayed in the same album interface's video thumbnails. To easily distinguish between videos recorded in the recording area and videos recorded in the small window, the terminal device can set an identifier for the videos recorded in the small window. For example, the terminal device can add an outer border, font, and graphics to the videos recorded in the small window, and the terminal device can also set the size of the thumbnails for the videos recorded in the small window, so that there is a size difference between the thumbnails of the videos recorded in the small window and those recorded in the recording area. It is understood that this application embodiment does not limit the format of the video thumbnails in the album, the arrangement order of the video thumbnails, or the saving order of the videos.
[0230] Understandably, a terminal device changes the sharpness and brightness of the image it captures by adjusting the focus and exposure point. The focus can be understood as the sharpest, unblurred area in the image. The exposure point can be understood as a reference point for determining the overall brightness of the image; it can also be called the metering point. In the same scene, when the position of the exposure point changes, the corresponding exposure parameters of the captured image change, and thus the brightness changes.
[0231] In a possible design, the focus point and exposure point are at the same location. When the device automatically adjusts the focus and exposure point, if the focus is on a strong light source or a dark area, the captured image may be overexposed or underexposed. When the device locks the exposure, the focus point is also locked, and the device cannot perform focus tracking control, which may result in unclear images of the tracked target.
[0232] Based on this, embodiments of this application provide a scheme for separating focus and exposure point control, where the positions of the focus and the exposure point can be different. This way, the exposure point does not change with the focus position, reducing overexposure or underexposure when the focus is in a strong light source or a dark location. Furthermore, when the terminal device locks the exposure, the focus position remains unaffected, enabling focus tracking control.
[0233] The solution provided in this application can be applied to the main subject mode. Specifically, in the main subject mode, the terminal device can control the exposure point independently. The exposure point does not change with the focus position, and the exposure parameters do not change with the focus position. This can reduce overexposure or underexposure when the focus is on a strong light source or a dark location.
[0234] Furthermore, when the terminal device locks the exposure, the focus position is not locked, enabling automatic focus tracking control. When the exposure is locked, the exposure parameters (aperture, shutter speed, ISO, etc.) are fixed, or in other words, the EV (Exposure Values) value is locked. The exposure parameters will not change with changes in light, resulting in more stable brightness in the captured image and reducing sudden changes in brightness.
[0235] It should be noted that in the main character mode, when no tracking target is set on the terminal device, the device can automatically adjust the focus position based on the captured image. If a tracking target is set on the terminal device, the focus corresponds to the tracking target, and the focus position moves accordingly when the tracking target moves. This allows the terminal device to clearly display the tracking target.
[0236] The following is combined with Figures 8A-10 This section explains how to adjust the exposure parameters in the main character mode. Figures 8A-8D This is a schematic diagram illustrating the process of adjusting exposure parameters in a preview scene. (Figure 9 and...) Figure 10 This is a schematic diagram illustrating the process of adjusting exposure parameters during recording.
[0237] For example, Figure 8A This is a schematic diagram of the interface of a terminal device provided in an embodiment of this application. An example is shown where a person is included in the preview screen.
[0238] When the terminal device receives an instruction to preview the main character mode, the terminal device enters... Figure 8A The preview interface is shown as 'a' in the diagram. This preview interface includes: a preview area 801, a recording control 802, a tracking box, and a tracking tooltip 804. The preview area 801 displays a preview image.
[0239] The tracking box is used to indicate that a tracking target can be set. For example, when the terminal device receives an operation to click the tracking box 803, the terminal device sets the person corresponding to the tracking box 803 as the tracking target and displays a small window with a tracking screen.
[0240] It's understandable that the position of the tracking boxes is related to the people in the preview screen, and the number of tracking boxes is related to the number of people in the preview screen. When the preview screen does not include any people, the terminal device does not display the tracking boxes. This will not be elaborated further here.
[0241] Tracking prompt 804 is used to prompt the user to set a tracking target. The content of tracking prompt 804 can be "Clicking the portrait tracking frame will generate an additional focus-tracking video." This application embodiment does not limit the display position, display format, or specific content of tracking prompt 804. It is understood that the terminal device may not display tracking prompt 804.
[0242] When the user is Figure 8A When the preview interface shown in 'a' is pressed by a finger or stylus at any position in the preview area 801 except for the tracking frame, the terminal device receives the pressing operation and adjusts the exposure value of the preview image based on the pressing position. The exposure parameter changes, and the brightness of the preview image displayed in the preview area 801 may change as a result.
[0243] Understandably, when the area corresponding to the pressed position is dark, increasing the exposure value of the terminal device will increase the brightness of the preview image; conversely, when the area corresponding to the pressed position is bright, decreasing the exposure value of the terminal device will decrease the brightness of the preview image.
[0244] In this way, the terminal device can adjust the position of the exposure point and the exposure parameters independently, thereby adjusting the brightness of the preview image accordingly.
[0245] When the duration of the press operation reaches a threshold, the terminal device receives an operation to lock the exposure. The terminal device locks the exposure parameters, fixing the exposure value, and then enters... Figure 8AThe preview interface is shown as b in the diagram. This preview interface includes: a preview area 805, recording controls, an exposure lock indicator 806, and a standard bar 807. The preview area 805 displays a preview image, and the exposure parameters corresponding to this preview image are related to the brightness of the image at the pressed position.
[0246] In this way, the terminal device can lock the exposure and fix the exposure parameters, so that the brightness of the corresponding content in the preview screen (e.g., the tracking target) is relatively stable, reducing the situation of sudden changes in brightness.
[0247] The exposure lock notification 806 is used to notify the user that the exposure has been locked. The content of the exposure lock notification 806 can be "Exposure locked". This application embodiment does not limit the display location, display content, or specific form of the exposure lock notification.
[0248] Understandably, the exposure lock prompt disappears after a preset duration, or after receiving an instruction to unlock the exposure lock, or when adjusting the exposure based on the standard bar.
[0249] Standard bar 807 can be a combination of a "sun" icon and a dashed line. In a possible implementation, the "sun" icon is located in the middle of the dashed line. Standard bar 807 can also be in other forms, such as a combination of a "sun" icon and a solid line, which is not limited in this embodiment.
[0250] It should be noted that the standard bar is used to adjust the exposure value. When the terminal device receives a sliding operation on an interface displaying the standard bar, the terminal device adjusts the EV value based on the sliding operation, thereby changing the exposure parameters corresponding to the preview screen. In addition, the terminal device also adjusts the position of the "sun" icon in the standard bar based on the sliding operation.
[0251] In this embodiment, the position of the "sun" icon and the change in EV value are both related to the displacement along a preset direction during the sliding operation. The preset direction can be the direction of the dashed line in the standard bar.
[0252] For example, when the terminal device is Figure 8A In the preview interface shown in b, the user's upward swipe gesture is received. The "sun" icon in the standard bar moves upward, the terminal device increases the EV value, which changes the exposure parameters of the preview image, potentially increasing brightness. When the terminal device... Figure 8A In the preview interface shown in b, the user's finger slides down, causing the "sun" in the standard bar to move downwards and decrease the EV value, thus altering the exposure parameters of the preview image and potentially reducing brightness. When the terminal device... Figure 8A When the preview interface shown in b receives a user's finger swipe left or right, the position of the "sun" icon in the standard bar does not change, and the terminal device does not adjust the EV value.
[0253] The following is combined with Figure 8A c and Figure 8A The "d" in the text describes the preview interface during and at the end of the swipe operation. Taking an upward swipe as an example...
[0254] For example, when the terminal device is Figure 8A When the preview area in the preview interface shown by b receives an upward swipe, it enters... Figure 8A The preview interface is shown as 'c' in the image. This preview interface includes: preview area 808 and standard bar 809. Compared to... Figure 8A In the preview interface shown in b, the sun icon in standard bar 807 and standard bar 809 has been moved upwards.
[0255] Among the possible implementation methods, Figure 8A The preview interface shown in Figure 'c' also displays an EV change value of 810. The EV change value 810 can be +0.8. It is understood that during a swipe operation, the EV change value displayed by the terminal device is related to the displacement corresponding to the swipe operation. In some embodiments, when the terminal device receives an upward swipe operation, it does not display a tracking frame.
[0256] In possible implementations, during the swiping operation, the terminal device can also be configured to hide some or all controls in the display interface (e.g., recording controls) to prevent accidental triggering (e.g. Figure 8A (as shown in c in the diagram).
[0257] When the swipe operation ends, the terminal device enters... Figure 8A The preview interface shown in d includes: preview area 811, recording controls, standard bar 812, and exposure lock prompt.
[0258] Understandably, the exposure lock indicator should disappear if no user interaction is received within a preset time. The position of the "sun" in standard bar 812 is related to the displacement of the sliding operation.
[0259] Based on the above embodiments, if the terminal device does not receive any operation on the preview area other than the tracking frame within a preset time period after adjusting the exposure value, the standard bar becomes semi-transparent. For example, when the terminal device... Figure 8A When the preview interface shown by 'd' does not receive user input, the terminal device enters... Figure 8A The preview interface is shown as 'e' in the diagram. This preview interface includes a preview area 813 and a standard bar 814. The standard bar 814 is semi-transparent. Among possible implementations, Figure 8A The preview interface shown in d also includes tracking tip 815.
[0260] In this way, the terminal device can hide the standard bar, reduce the standard bar's interference with the interface, optimize the interface, and improve the user experience.
[0261] In this embodiment, user operations include, but are not limited to, canceling exposure lock and adjusting exposure values. Examples include clicking outside the recording area tracking frame and sliding.
[0262] Based on the above embodiments, when the terminal device receives an operation from the user clicking on a preview area other than the tracking frame, the terminal device cancels the exposure lock. For example, when the user triggers any position in the preview area 811 other than the tracking frame through clicking, touching, or other operations, the terminal device receives the operation to cancel the exposure lock and enters... Figure 8A The preview interface shown in Figure a. This preview interface does not display the standard bar. When the user triggers any position in the preview area 805 (excluding the tracking box) through clicks, touches, or other operations, the terminal device receives an operation to cancel the exposure lock and enters... Figure 8A The preview interface shown in Figure a. This preview interface does not display the standard bar or the exposure lock indicator.
[0263] It is understandable that the terminal device can set a tracking target before and after adjusting the exposure; or it can be understood that the adjustment of exposure and the setting of tracking target do not affect each other.
[0264] For example, when a user is Figure 8A When the preview interface shown in Figure 'a' triggers the tracking box 803 through clicking or other operations, and the terminal device receives the operation to set the person corresponding to the tracking box 803 as the tracking target, it enters... Figure 8B The preview interface is shown as 'a' in the diagram. This preview interface includes a preview area 819 and a small window 820. The small window 820 displays the tracking screen of the target.
[0265] If the shooting angle of the terminal device does not change, and the person or other object does not move, Figure 8B The exposure parameters corresponding to the preview interface shown in 'a' are... Figure 8A The exposure parameters corresponding to the preview interface shown in 'a' are the same.
[0266] For example, when a user is Figure 8A When the preview interface shown in b triggers the tracking box 816 through clicking or other operations, and the terminal device receives the operation to set the person corresponding to the tracking box 816 as the tracking target, it enters... Figure 8B The preview interface is shown as b in the image. This preview interface includes a preview area 821, a small window 822, an exposure lock indicator 823, and a standard bar 824. The small window 822 displays the tracking screen of the target. Figure 8B The exposure parameters corresponding to the preview interface shown in b are... Figure 8AThe preview interface shown in b has the same exposure parameters. After the exposure is locked, changes in focus do not affect the exposure parameters, making the image brightness relatively stable and able to remain unchanged.
[0267] For example, when a user is Figure 8A When the preview interface shown in 'd' triggers the tracking box 817 through clicking or other operations, and the terminal device receives the operation to set the person corresponding to the tracking box 817 as the tracking target, it enters... Figure 8B The preview interface is shown as c in the diagram. This preview interface includes a preview area 825, a small window 826, an exposure lock indicator, and a standard bar 827. The small window 826 displays the tracking screen of the target being tracked. Figure 8B The exposure parameters brightness corresponding to the preview interface shown in 'c' are... Figure 8A The preview interface shown in 'd' has the same exposure parameters. After the exposure is locked, changes in focus do not affect the exposure parameters, making the image brightness relatively stable and able to remain unchanged.
[0268] Compared to standard bar 812, the position of the "sun" icon in standard bar 827 is the same as the position of the "sun" icon in the standard bar.
[0269] For example, when a user is Figure 8A When the preview interface shown in 'e' triggers the tracking box 818 through clicking or other operations, and the terminal device receives the operation to set the person corresponding to the tracking box 818 as the tracking target, it enters... Figure 8B The preview interface is shown as 'd' in the diagram. This preview interface includes a preview area 828, a small window 829, and a standard bar 830. The small window 829 displays the tracking image of the target. The standard bar 830 is semi-transparent. Figure 8B The exposure parameters corresponding to the preview interface shown by d in the figure are... Figure 8A The exposure parameters corresponding to the preview interface shown in 'e' are such that after the exposure is locked, changes in focus do not affect the exposure parameters, making the image brightness relatively stable and able to remain unchanged.
[0270] It is understandable that the terminal device can set the tracking target at any time during the process of adjusting the exposure parameters; after setting the tracking target, the exposure parameters can continue to be adjusted.
[0271] For example, the terminal device can Figure 8B The preview interface shown in Figure 'a' receives the aforementioned press operation. If the duration of the press operation reaches a threshold, the terminal device locks the exposure and enters... Figure 8B The preview interface shown in b is shown in the image. When the terminal device is... Figure 8B When the preview interface shown in b receives the above sliding operation, the terminal device adjusts the exposure value. After the sliding operation ends, the terminal device can enter... Figure 8BThe preview interface shown in 'c'. When the terminal device enters... Figure 8B If no operation is received in the preview area other than the tracking box within the first preset time period after the preview interface shown in 'c', the terminal device enters... Figure 8B The preview interface shown in d is shown in the image.
[0272] Understandably, the terminal device can adjust the focus based on the person in the preview image, and the focus position changes as the person moves. It can also adjust the focus based on other objects in the preview image (e.g., cats, dogs, cars, etc.), or automatically adjust the focus based on the overall image. For example, the terminal device can set the focus in the face area to ensure the face is clearly displayed.
[0273] For example, the following is combined with Figure 8C and Figure 8D The exposure parameters corresponding to the preview images before and after exposure lock are explained.
[0274] If the terminal device does not lock the exposure, it uses active metering based on focus, resulting in inconsistent exposure values and consequently, inconsistent exposure parameters. When the terminal device takes the first shot, it can enter... Figure 8C The preview interface shown in 'a' is shown in the image. This preview interface includes male and female figures, with a corresponding exposure value of 1.
[0275] When the terminal device receives a user's click on the tracking box corresponding to the male figure, the terminal device sets the focus on the area corresponding to the male figure and adjusts the exposure value based on this area. The terminal device can then enter... Figure 8C The preview interface shown in 'b' corresponds to an exposure value of 0.5. Compared to... Figure 8C The preview interface shown in 'a' is shown in the image. Figure 8C The male figure is clearer in the preview interface shown by b.
[0276] When the terminal device receives a user's click on the tracking box corresponding to the female figure, the terminal device sets the focus on the area corresponding to the female figure and adjusts the exposure value based on that area. The terminal device can enter... Figure 8C The preview interface shown by 'c' has an exposure value of 0.8. Compared to... Figure 8C The preview interface shown in b is shown in the image. Figure 8C The female figure is clearer in the preview interface shown by 'c'.
[0277] When the terminal device does not lock exposure, the exposure changes as the focus moves, altering the exposure value and parameters. Furthermore, this can lead to unstable screen brightness, resulting in flickering brightness.
[0278] If the terminal device locks the exposure, it can enter [the following state] when taking the first picture. Figure 8D The preview interface shown in 'a' is shown in the image. This preview interface includes male and female figures, with a corresponding exposure value of 1.
[0279] When the terminal device receives a user's click on the tracking box corresponding to the male figure, the terminal device sets the focus on the area corresponding to the male figure. The terminal device can then enter... Figure 8D The preview interface shown by 'b' has an exposure value of 1. Compared to... Figure 8C The preview interface shown in 'a' is shown in the image. Figure 8D In the preview shown by b, the male figure is clearer.
[0280] When the terminal device receives a user's click on the tracking box corresponding to the female character, the terminal device sets the focus on the area corresponding to the female character. The terminal device can then enter... Figure 8D The preview interface shown by 'c' has an exposure value of 1. Compared to... Figure 8D The preview interface shown in b is shown in the image. Figure 8D The female figure is clearer in the preview interface shown by 'c'.
[0281] It can be seen that, Figure 8D The brightness of the preview interface shown in 'a' is... Figure 8D The brightness of the preview interface shown in b is... Figure 8D The preview interface shown in 'c' has the same exposure value and parameters. When the terminal device locks the exposure, the exposure parameters are fixed and will not change with focus movement. Furthermore, with the same exposure parameters, the corresponding interface brightness is likely to be more stable, reducing fluctuations in brightness.
[0282] Understandably, taking an unlocked exposure scenario where the device is set to track a male figure, if the male figure moves to a well-lit area, the device will adjust its exposure to lower the overall brightness, resulting in a darker image. Conversely, if the male figure moves to a poorly lit area, the device will adjust its exposure to increase the overall brightness, resulting in a brighter image.
[0283] Taking a scenario where the terminal device is set to track a male figure while the exposure is locked, if the male figure moves to a well-lit area, the exposure value of the terminal device remains unchanged, but the overall image becomes brighter. If the male figure moves to a poorly lit area, the exposure value of the terminal device remains unchanged, but the overall image becomes darker.
[0284] In one possible implementation, the protagonist mode provided in this application embodiment, when the image captured by the terminal device includes a person, the terminal device may determine the focus based on the person, and the focus changes as the position of the person in the image changes. When the image captured by the terminal device does not include a person, the terminal device may automatically select the target to focus on.
[0285] Understandably, in the preview scenario, when a user triggers any tracking box by clicking or touching in the preview interface that displays tracking boxes, the terminal device receives the operation to set the tracking target, and the terminal device displays a small window without displaying the tracking prompt.
[0286] When the interface displayed on the terminal device includes a small window, the exposure parameter adjustment and Figure 8A The adjustment method for the preview interface shown is similar, so it will not be described again here.
[0287] It should be noted that when a tracking target is set on the terminal device, the terminal device adjusts the focus based on the tracking target. When no tracking target is set on the terminal device, or when the tracking target is lost, the terminal device adjusts the focus based on the preview screen.
[0288] The above Figure 8A The adjustment of exposure parameters in the preview scene is explained below. The terminal device can start recording from either the preview screen with exposure locked or the preview screen with exposure unlocked. The following refers to Figure 9 and... Figure 10 The process of adjusting exposure parameters in the recording scene is explained.
[0289] The following explanation, with reference to Figure 9, illustrates the process of the terminal device starting recording from the preview interface where the exposure is not locked.
[0290] Understandably, the process of adjusting exposure parameters in the recording scene is similar to that in the preview scene.
[0291] For example, when a user is Figure 8A When the preview interface shown in Figure 'a' triggers the recording control 802 through clicks, touches, or other operations, the terminal device receives the video recording operation and enters... Figure 9A The recording interface is shown as 'a' in the diagram. This recording interface includes: a recording area 901, a pause control 902, an end control 903, and a tracking box. The recording area 901 displays the recording screen.
[0292] The tracking box is used to indicate that a tracking target can be set. For example, when the terminal device receives an operation to click the tracking box 904, the terminal device sets the person corresponding to the tracking box 803 as the tracking target and displays a small window with the tracking screen.
[0293] It's understandable that the position of the tracking frame is related to the people in the recording frame, and the number of tracking frames is related to the number of people in the recording frame. When the recording frame does not include any people, the terminal device does not display the tracking frame. This will not be elaborated further here.
[0294] Among the possible implementation methods, Figure 9A The recording interface shown in Figure 'a' also displays a tracking prompt 930. Tracking prompt 930 is used to prompt the user to set the tracking object. This application embodiment does not limit the display location, display format, or specific content of the tracking prompt.
[0295] When the terminal device receives the operation to set the tracking target, the tracking prompt 930 disappears, or the tracking prompt 930 disappears after displaying the second preset duration. The second preset duration can be 3 seconds or 5 seconds, and this application embodiment does not limit the specific value of the second preset duration.
[0296] When the user is Figure 9A When the recording interface shown in 'a' is pressed by a finger or stylus at any position in the recording area 901 except for the tracking frame, the terminal device receives the pressing operation, adjusts the exposure value based on the pressing position, and changes the exposure parameters, which may in turn change the brightness of the recorded image displayed in the recording area 901.
[0297] It is understandable that when the area corresponding to the pressed position is dark, if the terminal device increases the exposure value, the brightness of the recorded image will increase; when the area corresponding to the pressed position is bright, if the terminal device decreases the exposure value, the brightness of the recorded image will decrease.
[0298] In this way, the terminal device can adjust the position of the exposure point and the exposure parameters independently, thereby adjusting the brightness of the recorded image accordingly.
[0299] When the duration of the press operation reaches a threshold, the terminal device receives an operation to lock the exposure. The terminal device locks the exposure parameters, fixing the exposure value, and then enters... Figure 9A The recording interface is shown as b in the diagram. This recording interface includes: a recording area 905, a pause control, an end control, an exposure lock indicator 906, and a standard bar 907. The recording area 905 displays the recording screen, and the exposure parameters corresponding to this screen are related to the brightness of the screen corresponding to the pressed position.
[0300] Exposure lock notification 906 is used to notify the user that the exposure is locked. The content of exposure lock notification 906 can be "Exposure locked". This application embodiment does not limit the display location, display content, or specific form of the exposure lock notification.
[0301] Understandably, the exposure lock prompt disappears after a preset duration, or when adjusting the exposure based on the standard bar.
[0302] In this way, the terminal device can lock the exposure, fixing the exposure parameters and ensuring relatively stable brightness of the corresponding content (e.g., the tracked target) in the recorded footage, reducing fluctuations in brightness. In the saved video after recording, the brightness of the corresponding content (e.g., the tracked target) remains stable during the exposure-locked period.
[0303] Standard bar 907 can be a combination of a "sun" icon and a dashed line. In a possible implementation, the "sun" icon is located in the middle of the dashed line. Standard bar 907 can also be in other forms, such as a combination of a "sun" icon and a solid line, which is not limited in this embodiment.
[0304] It should be noted that the standard bar is used to adjust the exposure value. When the terminal device receives a sliding operation on the interface displaying the standard bar, it adjusts the position of the "sun" in the standard bar based on the sliding operation, and adjusts the EV value to change the exposure parameters corresponding to the recorded image.
[0305] In this embodiment, the position of the "sun" icon and the change in EV value are both related to the displacement of the sliding operation along the dotted line direction.
[0306] For example, when the terminal device is Figure 9A In the recording interface shown in b, upon receiving a user's upward swipe of their finger, the "sun" icon in the standard bar moves upward and increases the EV value, altering the exposure parameters of the recorded image and potentially increasing brightness. When the terminal device... Figure 9A In the recording interface shown in b, upon receiving a user's downward swipe, the "sun" icon in the standard bar moves downward and decreases the EV value, altering the exposure parameters of the recorded image and potentially reducing brightness. When the terminal device... Figure 9A When the recording interface shown in b receives a user's finger swipe left or right, the position of the "sun" icon in the standard bar does not change, and the terminal device does not adjust EV.
[0307] The following is combined with Figure 9A c and Figure 9A The 'd' in the text describes the interface during and after the swipe operation. Taking an upward swipe as an example...
[0308] For example, when the terminal device is Figure 9A When the recording area in the recording interface shown by b receives an upward swipe operation, it enters... Figure 9A The recording interface is shown as 'c' in the diagram. This recording interface includes: recording area 908 and standard bar 909. Compared to... Figure 9A In the interface shown by b, the sun icon in standard bar 907 and standard bar 909 has been moved upwards.
[0309] Among the possible implementation methods, Figure 9A The interface shown in Figure 'c' also displays an EV change value of 910. The EV change value of 910 can be +0.9. It is understood that during a swipe operation, the EV change value displayed by the terminal device is related to the displacement corresponding to the swipe operation. In some embodiments, when the terminal device receives an upward swipe operation, it does not display a tracking box.
[0310] In possible implementations, during the swiping operation, the terminal device can also be configured to hide some or all controls in the display interface (e.g., pause control, end control, etc.) to prevent accidental triggering (e.g. Figure 9A (as shown in c in the diagram).
[0311] When the swipe operation ends, the terminal device enters... Figure 9A The recording interface shown in d includes: recording area 911, pause control, end control, standard bar 912, and exposure lock prompt.
[0312] Based on the above embodiments, when the terminal device does not receive user operation within a preset time period, the exposure lock prompt disappears and the standard bar becomes semi-transparent.
[0313] In this embodiment, user operations include, but are not limited to, resetting the exposure point and adjusting the exposure value. For example, clicking outside the recording area tracking frame, or sliding.
[0314] In one possible implementation, the exposure lock prompt disappears after a preset duration.
[0315] Based on the above embodiments, when the terminal device does not receive a sliding operation within a preset time period, the standard bar becomes semi-transparent. For example, when the terminal device... Figure 9A When the interface shown as 'd' does not receive user input, the terminal device enters... Figure 9A The interface shown in 'e' is shown in the image. This interface includes a recording area 913 and a standard bar 914. The standard bar 914 is semi-transparent.
[0316] It is understandable that during the recording process on the terminal device, the tracking target can be set; or it can be understood that the adjustment of exposure and the setting of the tracking target do not affect each other. Specifically, adjusting the exposure does not affect the focus following the tracking target, and the focus change caused by resetting the tracking target does not affect the exposure parameters of the image after exposure lock.
[0317] For example, when a user is Figure 9A When the recording interface shown in Figure 'a' triggers the tracking box 904 through clicking or other operations, and the terminal device receives the operation of setting the person corresponding to the tracking box 904 as the tracking target, it enters... Figure 9B The recording interface is shown as 'a' in the diagram. This recording interface includes a recording area 918 and a small window 919. The small window 919 displays the tracking screen of the target being tracked.
[0318] If the shooting angle of the terminal device does not change, and the person or other object does not move, Figure 9B The corresponding exposure parameters in the recording interface shown in Figure 'a' are... Figure 9A The exposure parameters corresponding to the recording interface shown in 'a' are the same.
[0319] For example, when a user is Figure 9A When the recording interface shown in b triggers the tracking box 915 through clicking or other operations, and the terminal device receives the operation of setting the person corresponding to the tracking box 915 as the tracking target, it enters... Figure 9B The recording interface is shown as b in the diagram. This recording interface includes a recording area 920, a small window 921, an exposure lock indicator 922, and a standard bar 923. The small window 921 displays the tracking footage of the target. Figure 9B The corresponding exposure parameters in the recording interface shown by b are... Figure 9A The corresponding exposure parameters in the recording interface shown in b are the same. After the exposure is locked, changes in focus do not affect the exposure parameters, making the image brightness relatively stable and able to remain unchanged.
[0320] For example, when a user is Figure 9A When the recording interface shown in 'd' triggers the tracking box 916 through clicking or other operations, and the terminal device receives the operation to set the person corresponding to the tracking box 916 as the tracking target, it enters... Figure 9B The recording interface is shown as c in the diagram. This recording interface includes a recording area 924, a small window 925, and a standard bar 926. The small window 925 displays the tracking screen of the target. Figure 9B The exposure parameters corresponding to the recording interface shown in 'c' are... Figure 9A The recording interface shown in 'd' has the same exposure parameters. After the exposure is locked, changes in focus do not affect the exposure parameters, making the image brightness relatively stable and able to remain unchanged.
[0321] Compared to standard bar 912, the position of the "sun" icon in standard bar 926 is the same as the position of the "sun" icon in the standard bar.
[0322] For example, when a user is Figure 9A When the recording interface shown in 'e' triggers the tracking box 917 through clicking or other operations, the terminal device receives the operation of setting the person corresponding to the tracking box 917 as the tracking target, and then enters... Figure 9BThe recording interface is shown as d in the diagram. This recording interface includes a recording area 927, a small window 928, and a standard bar 929. The small window 928 displays the tracking footage of the target. The standard bar 929 is semi-transparent. Figure 9B The exposure parameters corresponding to the recording interface shown by d in the figure are... Figure 9A The recording interface shown in 'e' has the same exposure parameters. After the exposure is locked, changes in focus do not affect the exposure parameters, making the image brightness relatively stable and able to remain unchanged.
[0323] It is understandable that during recording, the terminal device can set a tracking target at any time while adjusting exposure parameters; after setting the tracking target, the exposure parameters can continue to be adjusted. Details will not be elaborated here. The terminal device will not stop recording video and / or tracking video while adjusting exposure parameters.
[0324] For example, the following is combined with Figure 9C and Figure 9D The brightness of the recorded footage before and after exposure lock is explained.
[0325] If the terminal device does not lock the exposure, it uses active metering based on focus, resulting in inconsistent exposure values and consequently, inconsistent exposure parameters. When the terminal device takes a picture at a second moment, it can enter... Figure 9C The recording interface is shown as 'a' in the diagram. In this recording interface, the male and female figures have an exposure value of 1. The male figure is set as the tracking target, the terminal device sets the focus on the area corresponding to the male figure, and adjusts the exposure value based on this area.
[0326] When the terminal device receives a user's click on the tracking box corresponding to the female figure, the terminal device sets the focus on the area corresponding to the female figure and adjusts the exposure value based on that area. The terminal device can enter... Figure 9C The recording interface shown by 'b' in the image corresponds to an exposure value of 0.5. Compared to... Figure 9C The recording interface shown in b is... Figure 9C The female figure is clearer in the preview interface shown by b.
[0327] It can be seen that, compared to Figure 9C The recording interface shown in 'a' is... Figure 9C The recording interface shown in 'b' is relatively dark. When the terminal device does not lock the exposure, the exposure changes with the focus movement, altering the exposure value and parameters. Furthermore, this can lead to unstable screen brightness, resulting in flickering between bright and dark areas.
[0328] If the terminal device locks the exposure, when the terminal device takes a picture at the second moment, the terminal device can enter... Figure 9DThe recording interface is shown as 'a' in the diagram. In this recording interface, the male and female figures have an exposure value of 1. The male figure is set as the tracking target, and the terminal device sets the focus on the area corresponding to the male figure.
[0329] When the terminal device receives a user's click on the tracking box corresponding to the female character, the terminal device sets the focus on the area corresponding to the female character. The terminal device can then enter... Figure 9D The preview interface shown by 'b' has an exposure value of 1. Compared to... Figure 9D The preview interface shown in 'a' is shown in the image. Figure 9D The female figure is clearer in the preview interface shown by b.
[0330] It can be seen that, Figure 9D The exposure value corresponding to the recording interface shown in 'a' is... Figure 9D The recording interface shown in 'b' has the same exposure value. When the terminal device locks the exposure, the exposure parameters are fixed and will not change with the focus movement. In addition, with the same exposure parameters, the corresponding interface brightness is likely to be more stable, which can reduce the occurrence of sudden changes in brightness.
[0331] It is understandable that when the recording ends, the terminal device will generate and save a video based on the recorded screen, and a focus-tracking video based on the tracking screen.
[0332] Understandably, if the terminal device does not lock exposure during recording, and if the exposure parameters in the recording interface are not fixed and change with the focus, the brightness of the recorded image may be unstable, and the brightness of the image in the generated video will also be unstable. If the terminal device does not lock exposure during recording, and if the exposure parameters in the recording interface are not fixed and change with the focus, the brightness of the tracked image will be unstable, and the portion of the video corresponding to the tracked image during the exposure-locked period in the generated focus-tracking video will have unstable brightness.
[0333] If the terminal device locks the exposure during recording, the exposure parameters remain fixed and do not change with the focus, and the brightness of the recorded image in the recording interface is relatively stable. In the generated video, the portion of the video corresponding to the recorded image during the exposure lock period will also have relatively stable brightness.
[0334] If the terminal device locks the exposure during recording, the exposure parameters remain fixed and do not change with the focus. The brightness of the tracked image in the recording interface is relatively stable. Therefore, the portion of the video corresponding to the tracked image during the exposure lock period in the generated focus tracking video will have relatively stable brightness.
[0335] The following is combined with Figure 10This section explains the process of recording from the exposure-locked preview screen on the terminal device.
[0336] For example, when a user is Figure 8A In the preview interface shown in Figure 'e', when the recording control is triggered by clicking, touching, or other operations, the terminal device receives the video recording operation and enters... Figure 10 The recording interface is shown as 'a' in the diagram. This recording interface includes: a recording area 1001, a pause control 1002, an end control 1003, and a standard bar 1004.
[0337] The recording area 1001 displays the recording screen and recording duration. When the recording screen includes a person, the recording area 1001 also displays a tracking frame 1005. Optionally, when the terminal device has not set a tracking target, the recording area also displays a tracking prompt 1006.
[0338] Standard strip 1004 is semi-transparent, and... Figure 8A The state of standard bar 814 in the preview interface shown by 'e' is consistent with that of 'e'.
[0339] When the user is Figure 10 In the recording interface shown in Figure 'a', when a long press operation triggers any position in the recording area 1001 (excluding the tracking frame), the terminal device receives an operation to re-lock the exposure. Based on the position of the long press operation, the exposure value is adjusted and the exposure is locked. The terminal device then enters... Figure 10 The recording interface is shown as b in the image. This recording interface includes: recording area 1007, pause control, end control, standard bar 1008, and exposure lock indicator 1009. Recording area 1005 displays the recording screen and recording duration. Compared to... Figure 10 The recording interface shown in 'a' is... Figure 10 The brightness of the recording interface shown in b has changed.
[0340] Based on the above embodiments, when the terminal device does not receive a sliding operation within a preset time period, the standard bar becomes semi-transparent. For example, when the terminal device... Figure 10 When the interface shown in b does not receive user input, the terminal device enters... Figure 10 The interface shown in 'c' is as follows. This interface includes a recording area 1010, a pause control, an end control, and a standard bar 1011. The standard bar 1011 is semi-transparent. The position of the standard bar 1011 is the same as that of the standard bar 1008. The brightness of the recording screen displayed in the recording area 1010 is the same as the brightness of the recording screen displayed in the recording area 1007.
[0341] It should be noted that the exposure lock cannot be released on the terminal device during recording.
[0342] Understandably, in a recording scenario, when a user triggers any tracking box through clicking, touching, or other operations on a recording interface that displays tracking boxes, the terminal device receives the operation to set the tracking target, displays a small window, and does not show the tracking prompt.
[0343] It is understandable that when the interface displayed on the terminal device includes a small window, the exposure parameter adjustment is similar to the above. Figures 9A-10 The adjustment methods shown are similar and will not be repeated here.
[0344] It is understood that the aforementioned tracking prompts, exposure lock prompts, and other prompts can be displayed at the top of the preview area or the top of the recording area, or they can be displayed in other locations. This application embodiment does not limit the location and content of the tracking prompts or the exposure lock prompts.
[0345] It should be noted that the focus and exposure separation control scheme and adjustment method provided in this application embodiment can also be applied to other recording modes. When the exposure is locked, the terminal device can automatically adjust the focus position based on the shooting screen, or adjust the focus position based on the tracking target, or determine the focus position through other means, which are not limited here.
[0346] It is understood that the interface of the terminal device described above is merely an example, and the interface of the terminal device may include more or less content. Furthermore, the shape and form of each control in the above embodiments are only examples. This application does not limit the content of the display interface or the shape and form of each control.
[0347] Based on the above embodiments, this application provides a video recording method. For example, Figure 11 This is a flowchart illustrating a video recording method provided in an embodiment of this application.
[0348] like Figure 11 As shown, the recording method may include the following steps:
[0349] S1101, The terminal device displays the first interface.
[0350] In this embodiment of the application, the first interface includes a first window and a second window. The first window displays a real-time captured image from a first camera, which includes a first object. The focus of the first camera is on the first object. The second window displays a portion of the image related to the first object from the first window.
[0351] Understandably, the first interface can be a preview interface with a tracking target set (e.g., Figure 3B The interface shown in 'a' can also be a recording interface with a tracking target set (e.g., Figure 3C(The interface shown in 'a'). The first window can be understood as the preview or recording area mentioned above; the real-time captured image from the first camera can be understood as the preview or recording image mentioned above; the second window can be understood as the small window mentioned above; the image displayed in the second window can be understood as the tracking image, corresponding to the tracking target.
[0352] S1102. At the first moment, the terminal device detects that a first object is displayed at the first position of the first window, the focus of the first camera is on the first object, and the second window displays a portion of the image related to the first object at the first position of the first window.
[0353] S1103. At the second moment, the terminal device detects that a first object is displayed at the second position of the first window, and the focus of the first camera is on the first object. The second window displays a portion of the image related to the first object at the second position of the first window. When the first exposure parameter of the real-time image captured by the first camera is locked, the exposure parameter corresponding to the terminal device at the first moment and the exposure parameter corresponding to the terminal device at the second moment are both the first exposure parameter.
[0354] In this embodiment, the focus changes with the position of the target being tracked. Specifically, the focus changes with the position of the target being tracked, as detailed in the following example. Figure 3B or Figure 3C For example, the interface at the first moment could be... Figure 3B The interface shown as 'a' in the diagram can be the interface at the second time step. Figure 3B The interface shown in b; or, the interface at the first moment can be Figure 3C The interface shown as 'a' in the diagram can be the interface at the second time step. Figure 3C The interface shown in b is shown in the image.
[0355] In protagonist mode, focus and exposure can be controlled separately, which can reduce overexposure or underexposure when focusing on strong light sources or dark areas, thus improving the user experience.
[0356] In summary, the terminal device can additionally obtain and display the image corresponding to the tracked target, thus obtaining one or more additional focus-tracked videos of the target while recording video. This reduces subsequent editing operations on the tracked target and improves editing efficiency. When displaying the image based on the tracked target, the terminal device can also control exposure lock to fix the exposure parameters.
[0357] Optionally, when the first exposure parameter of the real-time captured image by the first camera is in an unlocked state, the exposure parameter corresponding to the terminal device at the first moment is different from the exposure parameter corresponding to the terminal device at the second moment.
[0358] In protagonist mode, the device can leave the exposure unlocked, and the exposure value changes with the focus.
[0359] In this way, when displaying a picture based on a tracked target, the terminal device can also control the exposure value based on the focus, adapt to changes in light, control the exposure from another dimension, and improve the user experience.
[0360] Optionally, the first window may also include a second object. The method further includes: at a third moment, the terminal device detects a first operation by the user on the second object; in response to the first operation, the focus of the first camera is on the second object, and the second window displays a portion of the image related to the second object from the first window; the exposure parameter corresponding to the terminal device at the third moment is the first exposure parameter.
[0361] It is understandable that when exposure is locked, the exposure parameters will not change even if the terminal device switches the object being tracked. For example, refer to the above. Figure 8D , Figure 9D The corresponding explanation.
[0362] Optionally, the first window also includes a second object, and the first exposure parameters of the real-time captured image by the first camera are in an unlocked state. The method further includes: at a third moment, the terminal device detects a first operation by the user on the second object; in response to the first operation, the focus of the first camera is on the second object, and the second window displays a portion of the image related to the second object from the first window; the exposure parameters of the terminal device at the third moment are different from the exposure parameters of the terminal device at the second moment.
[0363] Understandably, when exposure is locked, switching the tracking target on the terminal device will change the exposure parameters. For example, refer to the above. Figure 8C , Figure 9C The corresponding explanation.
[0364] Optionally, the first object is displayed in the center of the second screen.
[0365] For example, such as Figure 3B , Figure 3C The interface shown displays the target in the center of the tracking screen displayed in a small window.
[0366] Optionally, the second window floats on top of the first window, and the second window is smaller than the first window. For example, such as... Figure 3B , Figure 3C The interface shown has a small window smaller than the preview or recording area, and it floats on top of the preview or recording area.
[0367] Optionally, before or after the terminal device displays the first interface, the method further includes: the terminal device receiving a second operation on the first window; in response to the second operation, the terminal device locking the exposure parameters of the first camera as the first exposure parameters.
[0368] In this embodiment, the second operation can be understood as a long press operation, or a press operation exceeding a preset time. The second operation may also be other operations, which are not limited here.
[0369] Understandably, the terminal device can lock the exposure before or after setting the tracking target. Setting the tracking target and locking the exposure parameters are independent of each other. For example, the terminal device can... Figure 8A Enter the interface shown by b in the image. Figure 8B The interface shown in b; it can also be viewed from Figure 8B Enter the interface shown in 'a'. Figure 8B The interface shown in b is shown in the image.
[0370] In this way, the terminal device can control focus and exposure separately, reducing overexposure or underexposure when the focus is on a strong light source or a dark area. The setting of the tracking target and whether the exposure parameters are locked are independent of each other, allowing users to easily lock the exposure or set the tracking target, thus improving the user experience.
[0371] Optionally, before the terminal device displays the first interface, the method further includes: the terminal device displays a second interface, the second interface including the first window; when the terminal device detects that the screen displayed in the first window includes the first object, a first tracking identifier associated with the first object is displayed in the first window; wherein, the terminal device displays the first interface of the camera application, including: in response to the user's trigger operation on the first tracking identifier, the terminal device displays the first interface.
[0372] Understandably, the terminal device does not display the small window before setting the tracking target, and displays the small window after setting the tracking target. The tracking icon can be the tracking box mentioned above, or it can be in other forms (e.g., object thumbnails, numbers, icons, etc.), which is not limited here. The tracking icon can also be located where the object is displayed, or it can be arranged and displayed at the edge of the preview area or recording area, which is not limited here.
[0373] The first tracking identifier can be a tracking identifier corresponding to any object, such as a tracking box corresponding to a male person.
[0374] The triggering operation for the first tracking identifier can be a click operation or a touch operation. This application embodiment does not limit the type of triggering operation.
[0375] For example, the terminal device in Figure 6 When the interface shown in b detects the user clicking the tracking box 605 corresponding to the male character, it enters... Figure 6 The interface shown in 'c'; or, the terminal device in Figure 7 When the interface shown in 'a' detects that the user clicked on the tracking box 701 corresponding to the male character, it enters... Figure 7 The interface shown in b is shown in the image.
[0376] Optionally, the first interface is a preview interface during video recording. The first interface also includes an end control. The method further includes: the terminal device detects a third operation on the end control; in response to the third operation, the terminal device saves the first video and the second video, wherein the first video is a video composed of the screens displayed in the first window, and the second video is a video composed of the screens displayed in the second window.
[0377] In this embodiment, the third operation can be a user click operation or a user touch operation; this embodiment does not limit the third operation. The first video can be a video generated from the recording screen displayed in the recording area, and the second video can be a video generated from the tracking screen displayed in the small window.
[0378] The end control can be Figure 3C The end control 318 is shown as 'a' in the diagram. When the terminal device detects that the user clicks the end control 318, the terminal device ends the recording and generates a video based on the recording screen displayed in the recording area; a focus-tracking video is generated based on the tracking screen displayed in the small window.
[0379] In this way, the terminal device can save two video streams and generate an additional video stream based on the tracked target. Users can obtain the video of the tracked target without editing the video, thus improving the user experience.
[0380] Optionally, the first screen is a preview screen before starting video recording.
[0381] Optionally, in response to the first operation, the terminal device also displays a first identifier in the first window; the terminal device receives a fourth operation targeting the first identifier; in response to the fourth operation, the terminal device adjusts the first exposure parameter to a second exposure parameter, and the second exposure parameter is locked.
[0382] The first identifier can be one of the standard bars mentioned above, for example... Figure 8A Standard bar 807 is shown as b in 9A; standard bar 907 is shown as b in 9A. The fourth operation can be a sliding operation or other forms of operation, which is not limited in this embodiment.
[0383] When the terminal device detects a sliding operation, it can adjust the exposure value and thus the exposure parameters based on the sliding operation.
[0384] For example, the terminal device can Figure 8A The interface shown as 'b' receives a swipe gesture, and adjusts the exposure value and parameters based on the swipe gesture, then enters... Figure 8A The interface shown by 'd' in the diagram. Terminal devices can... Figure 9A The interface shown as 'b' receives a swipe gesture, and adjusts the exposure value and parameters based on the swipe gesture, then enters... Figure 9A The interface shown in d is shown in the image.
[0385] Optionally, the first window may also include one or more controls, and the fourth operation is a sliding operation; during the sliding operation, the first window does not display one or more controls.
[0386] The preview area can include controls for exiting protagonist mode, settings, flash, small window style, zoom, etc., while the recording area can include flash controls. It is understood that recording controls can also be located in the preview area; pause and end controls can also be located in the recording area. There are no restrictions here.
[0387] For example, the terminal device can Figure 8A The interface shown as 'b' receives a swipe operation and adjusts the exposure value and exposure parameters based on the swipe operation. Figure 8A Enter the interface shown as 'c' in the image. Figure 8A The interface shown by 'd' in the diagram. Terminal devices can... Figure 9A The interface shown as 'b' receives a swipe operation and adjusts the exposure value and exposure parameters based on the swipe operation. Figure 9A Enter the interface shown as 'c' in the image. Figure 9A The interface shown in d is shown in the image.
[0388] In this way, the terminal device can hide one or more controls, which can reduce accidental triggering by users and improve the user experience.
[0389] Optionally, during the sliding operation, the first window also displays the exposure change value, which is related to the sliding distance corresponding to the sliding operation.
[0390] For example, such as Figure 8A The interface shown as 'c' also displays the exposure change value of 810. (For example...) Figure 9A The interface shown in 'c' also displays the exposure change value of 910.
[0391] In this way, the change in exposure value can prompt the user to adjust the exposure value accordingly, thus improving the user experience.
[0392] Optionally, if the terminal device does not receive the fourth operation within a preset time period after the fourth moment, the first identifier becomes semi-transparent, and the fourth moment is the moment when the terminal device triggers the first identifier.
[0393] The fourth operation is an operation that arbitrarily adjusts the exposure, or it can be understood as an operation targeting the first identifier; for example, a sliding operation, a long press operation, etc. The embodiments of this application do not limit the fourth operation.
[0394] The preset time period can be 2 seconds or 5 seconds; there is no limit to the specific value of the preset time period.
[0395] For example, the terminal device can Figure 8A The interface shown as 'd' did not receive the swipe operation. (Enter...) Figure 8A In the interface shown by 'e', the standard bar becomes semi-transparent. The terminal device can... Figure 9A The interface shown as 'd' did not receive the swipe operation. (Enter...) Figure 9A In the interface shown by 'e', the standard bar becomes semi-transparent.
[0396] Understandably, if no exposure adjustment is received within the preset time period, the display of the first indicator can be hidden or weakened to reduce interference with the preview or recording screen and improve the user experience.
[0397] Understandably, in response to the first operation, the terminal device also displays an exposure lock prompt in the first window, which is used to remind the user to lock the exposure.
[0398] The exposure lock prompt can be found in the text above. Figures 8A-9D The exposure lock indicator in the image. For example, Figure 8A Exposure lock warning 806 in the image. Figure 9A The exposure lock indicator 906, etc., will not be elaborated upon here.
[0399] Terminal devices can display an exposure lock prompt to remind users that the exposure parameters are locked, making it easier for users to adjust the exposure value or cancel the exposure lock later, thus improving the user experience.
[0400] Optionally, the method further includes: the terminal device receiving a fifth operation on the first window; in response to the fifth operation, the terminal device canceling the exposure parameter lock, and the first window not displaying an exposure lock prompt.
[0401] The fifth action can be a user click or any other action; there are no restrictions here.
[0402] For example, the terminal device can Figure 8A The interface shown as 'e' receives a user click and enters... Figure 8A The interface shown in 'a'.
[0403] This allows the terminal device to disable exposure lock and adjust exposure parameters based on focus, the overall image, and other factors. Multiple control methods and functions enhance the user experience.
[0404] Optionally, the terminal device receives a sixth operation for the first window; in response to the sixth operation, the terminal device adjusts the exposure parameters of the locked state to the third exposure parameters based on the sixth operation.
[0405] The sixth action can be a long press, a click, or any other action; there are no restrictions here.
[0406] For example, the terminal device can Figure 10 The interface shown as 'a' in the image receives a long press from the user and enters... Figure 10 The interface shown in b is shown in the image.
[0407] In this way, the terminal device can also adjust the exposure lock position, and then fix it after adjusting the exposure parameters based on the new position. Multiple control methods and functions enhance the user experience.
[0408] The recording method of the embodiments of this application has been described above. The apparatus for performing the above method provided in the embodiments of this application will now be described. Figure 12 As shown, Figure 12 This is a schematic diagram of the structure of a recording device provided in an embodiment of this application. The recording device may be a terminal device in the embodiment of this application, or a chip or chip system within the terminal device.
[0409] like Figure 12 As shown, the recording device 2100 can be used in communication equipment, circuits, hardware components, or chips. The recording device includes a display unit 2101 and a processing unit 2102. The display unit 2101 is used to support the display steps performed by the recording device 2100; the processing unit 2102 is used to support the information processing steps performed by the recording device 2100.
[0410] In a possible implementation, the recording device 2100 may also include a communication unit 2103. Specifically, the communication unit supports the recording device 2100 in performing data transmission and data reception steps. The communication unit 2103 may be an input or output interface, pins, or circuitry, etc.
[0411] In a possible embodiment, the recording device may further include a storage unit 2104. The processing unit 2102 and the storage unit 2104 are connected via a line. The storage unit 2104 may include one or more memories, which may be devices in one or more devices or circuits used for storing programs or data. The storage unit 2104 may exist independently and be connected to the processing unit 2102 of the recording device via a communication line. Alternatively, the storage unit 2104 may be integrated with the processing unit 2102.
[0412] Storage unit 2104 may store computer-executable instructions for the methods in the terminal device, so that processing unit 2102 executes the methods in the above embodiments. Storage unit 2104 may be a register, cache, or RAM, etc., and storage unit 2104 may be integrated with processing unit 2102. Storage unit 2104 may be read-only memory (ROM) or other types of static storage devices capable of storing static information and instructions, and storage unit 2104 may be independent of processing unit 2102.
[0413] This application provides a terminal device, which can also be referred to as a terminal, user equipment (UE), mobile station (MS), mobile terminal (MT), etc. The terminal device can be a mobile phone, smart TV, wearable device, tablet computer, computer with wireless transceiver capabilities, virtual reality (VR) terminal device, augmented reality (AR) terminal device, wireless terminal in industrial control, wireless terminal in self-driving, wireless terminal in remote medical surgery, wireless terminal in smart grid, wireless terminal in transportation safety, wireless terminal in smart city, wireless terminal in smart home, etc.
[0414] The terminal device includes: a processor and a memory; the memory stores computer-executable instructions; the processor executes the computer-executable instructions stored in the memory, causing the terminal device to perform the above-described method.
[0415] This application provides a terminal device, the structure of which is described below. Figure 1 The terminal device's memory can be used to store at least one program instruction, and the processor is used to execute at least one program instruction to implement the technical solution of the above method embodiments. Its implementation principle and technical effects are similar to those of the related embodiments of the above method, and will not be repeated here.
[0416] This application provides a chip. The chip includes a processor, which is used to call a computer program in memory to execute the technical solutions in the above embodiments. Its implementation principle and technical effects are similar to those in the related embodiments described above, and will not be repeated here.
[0417] This application provides a computer program product that, when run on an electronic device, causes the terminal device to execute the technical solutions described in the above embodiments. Its implementation principle and technical effects are similar to the related embodiments described above, and will not be repeated here.
[0418] This application provides a computer-readable storage medium storing program instructions. When executed by a terminal device, the program instructions cause the terminal device to perform the technical solution described in the above embodiments. Its implementation principle and technical effects are similar to those of the related embodiments described above, and will not be repeated here. The methods described in the above embodiments can be implemented entirely or partially by software, hardware, firmware, or any combination thereof. If implemented in software, the functionality can be stored as one or more instructions or code on or transmitted on a computer-readable medium. The computer-readable medium can include computer storage media and communication media, and can also include any medium that can transfer a computer program from one place to another. The storage medium can be any target medium accessible by a computer.
[0419] Computer-readable media can include RAM, ROM, compact disc read-only memory (CD-ROM) or other optical disc storage, disk storage or other magnetic storage devices, or any other medium targeted to carry or to store required program code in the form of instructions or data structures, and accessible by a computer. Furthermore, any connection is appropriately referred to as computer-readable media. For example, if software is transmitted from a website, server, or other remote source using coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave, then coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included in the definition of media. As used herein, disks and optical discs include optical discs, laser discs, optical discs, Digital Versatile Discs (DVDs), floppy disks, and Blu-ray discs, where disks typically reproduce data magnetically, while optical discs optically reproduce data using lasers. Combinations of the above should also be included within the scope of computer-readable media.
[0420] This application describes embodiments of methods, apparatus (systems), and computer program products according to embodiments of this application with reference to flowchart illustrations and / or block diagrams. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processing unit of a general-purpose computer, special-purpose computer, embedded processor, or other programmable device to produce a machine, such that the instructions, which execute via the processing unit of the computer or other programmable device, generate instructions for implementing the flowchart illustrations. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.
[0421] The above specific embodiments further illustrate the purpose, technical solution, and beneficial effects of the present invention. It should be understood that the above are merely specific embodiments of the present invention and are not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc., made on the basis of the technical solution of the present invention should be included within the scope of protection of the present invention.
Claims
1. A video recording method, characterized in that, Applied to a terminal device including a first camera, the method includes: The terminal device displays a first interface, which includes a first window and a second window. The first window displays a real-time captured image from the first camera, which includes a first object. The focus of the first camera is on the first object. The second window displays a portion of the image related to the first object from the first window. At the first moment, the terminal device detects that the first object is displayed at the first position of the first window, the focus of the first camera is on the first object, and the second window displays a portion of the image related to the first object at the first position in the first window; At the second moment, the terminal device detects that the first object is displayed at the second position of the first window, the focus of the first camera is on the first object, and the second window displays a portion of the image related to the first object at the second position of the first window; The terminal device, in response to a user operation, locks the exposure parameters of the first camera to the first exposure parameter, thereby putting the first camera in an exposure-locked state. When the first camera is in exposure-locked state, at the first moment and the second moment, the focus of the first camera moves with the first object from the first position to the second position, while the exposure parameters used by the first camera to capture the image remain unchanged.
2. The method according to claim 1, characterized in that, When the first exposure parameter of the first camera is unlocked when it captures the image in real time, the exposure parameter of the terminal device at the first moment is different from the exposure parameter of the terminal device at the second moment.
3. The method according to claim 1, characterized in that, The first window's image also includes a second object, and the method further includes: At the third moment, the terminal device detects the user's first operation on the second object; In response to the first operation, the first camera focuses on the second object, and the second window displays a portion of the image in the first window that is related to the second object; When the first exposure parameter of the image captured by the first camera in real time is locked, the exposure parameter of the terminal device at the third moment is the first exposure parameter.
4. The method according to claim 2, characterized in that, The first window also includes a second object in its view, and the first camera's first exposure parameters for capturing the view in real time are in an unlocked state. The method further includes: At the third moment, the terminal device detects the user's first operation on the second object; In response to the first operation, the first camera focuses on the second object, and the second window displays a portion of the image in the first window that is related to the second object; The exposure parameters of the terminal device at the third time point are different from the exposure parameters of the terminal device at the second time point.
5. The method according to any one of claims 1-4, characterized in that, The first object is displayed in the center of the second screen.
6. The method according to any one of claims 1-4, characterized in that, The second window floats on top of the first window, and the second window is smaller than the first window.
7. The method according to any one of claims 1-4, characterized in that, Before or after the terminal device displays the first interface, the method further includes: The terminal device receives a second operation for the first window; In response to the second operation, the terminal device locks the exposure parameters of the first camera to the first exposure parameters.
8. The method according to any one of claims 1-4, characterized in that, Before the terminal device displays the first interface, it also includes: The terminal device displays a second interface, which includes the first window. When the terminal device detects that the screen displayed in the first window includes a first object, it displays a first tracking identifier associated with the first object in the first window; The terminal device displays a first interface for the camera application, including: In response to a user's triggering action on the first tracking identifier, the terminal device displays the first interface.
9. The method according to any one of claims 1-4, characterized in that, The first interface is a preview interface during video recording. The first interface also includes an end control. The method further includes: The terminal device detects a third operation on the end control; In response to the third operation, the terminal device saves a first video and a second video, wherein the first video is a video composed of the images displayed in the first window, and the second video is a video composed of the images displayed in the second window.
10. The method according to any one of claims 1-4, characterized in that, The first screen is the preview screen before video recording begins.
11. The method according to any one of claims 1-4, characterized in that, The terminal device responds to the first operation, and the first window also displays a first identifier; The terminal device receives a fourth operation for the first identifier; In response to the fourth operation, the terminal device adjusts the first exposure parameter to a second exposure parameter, and the second exposure parameter is locked.
12. The method according to claim 11, characterized in that, The first window also includes one or more controls, and the fourth operation is a sliding operation; During the sliding operation, the first window does not display one or more of the controls.
13. The method according to claim 11, characterized in that, During the sliding operation, the first window also displays an exposure change value, which is related to the sliding distance corresponding to the sliding operation.
14. The method according to any one of claims 1-4 and 12-13, characterized in that, If the terminal device does not receive a fourth operation within a preset time period after the fourth moment, the first identifier becomes semi-transparent. The fourth moment is the moment when the terminal device detects the last time the first identifier is triggered.
15. The method according to any one of claims 1-4 and 12-13, characterized in that, In response to the first operation, the terminal device also displays an exposure lock prompt in the first window, which is used to prompt the user to lock the exposure.
16. The method according to any one of claims 1-4 and 12-13, characterized in that, The method further includes: The terminal device receives a fifth operation for the first window; In response to the fifth operation, the terminal device cancels the exposure parameter lock, and the first window does not display the exposure lock prompt.
17. The method according to any one of claims 1-4 and 12-13, characterized in that, The terminal device receives a sixth operation for the first window; In response to the sixth operation, the terminal device adjusts the exposure parameters of the locked state to the third exposure parameters based on the sixth operation.
18. A terminal device, characterized in that, The terminal device includes a processor for invoking a computer program in memory to perform the method as described in any one of claims 1-17.
19. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer instructions that, when executed on a terminal device, cause the terminal device to perform the method as described in any one of claims 1-17.
Citation Information
Patent Citations
Video anti-shake processing method and electronic equipment
CN114205515A