Video recording methods and electronic devices

Abstract

The invention relates to the field of electronic engineering, and relates to a method of video recording, an electronic device and a computer-readable storage medium, such that multiple video channels can be simultaneously recorded using multiple camera lenses, to capture multiple channels with richer video images and image information.The specific solution is: to initiate, by electronic device, the camera; to capture images using the first and second camera lenses among multiple camera lenses; to display a preview interface, which includes the first and second images; the first image is captured by the first camera lens, the second by the second camera lens, and this second image corresponds to the central region of the image captured by the second camera lens; and the first image is located in the first region of the preview interface, and the second image is located in the second region of the preview interface; to begin video recording after detecting the user's video recording command; and to display a recording screen, which includes the first and second regions. The methods of the invention are used for multi-channel video recording.

Description

A method and device for multi-channel recording

[0001] This application claims priority to Chinese Patent Application No. 201910205090.0, filed on March 18, 2019, entitled "A Multi-channel Recording Method and Device", the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of electronic technology, and in particular to a multi-channel recording method and device. Background Technology

[0003] With the development of electronic technology, users can use the cameras of mobile phones, tablets and other electronic devices to take all kinds of photos and videos, thereby recording wonderful moments, touching scenes and other beautiful pictures.

[0004] Summary of the Invention

[0005] This application provides a multi-channel recording method and device that can simultaneously record multiple channels using multiple cameras, thereby obtaining multiple video images and richer image information.

[0006] To achieve the above objectives, the embodiments of this application adopt the following technical solutions:

[0007] On one hand, this application provides a video recording method applied to an electronic device with a display screen and multiple cameras. The method includes: the electronic device activating a camera; then, the electronic device capturing images using a first camera and a second camera among the multiple cameras. The first camera is a rear wide-angle camera or a rear ultra-wide-angle camera. The second camera is a wide-angle camera, an ultra-wide-angle camera, or a rear telephoto camera. The electronic device displays a preview interface. The preview interface includes a first image and a second image; the first image is an image captured by the first camera, and the second image is from the second camera, and the second image corresponds to the central area of ​​the image captured by the second camera. The first image is located in a first area of ​​the preview interface, and the second image is located in a second area of ​​the preview interface. After detecting a user-instructed recording operation, the electronic device begins recording video. The electronic device displays a shooting interface, which includes a first area and a second area.

[0008] In this solution, electronic devices can simultaneously record images using telephoto cameras with different field of view, as well as wide-angle or ultra-wide-angle cameras, to acquire panoramic and close-up images of different ranges and magnifications at the same time or in the same scene, presenting users with richer image information. Furthermore, when the second image within the second area is the central region of the image captured by the second camera, it can present the user with a close-up view of the focal object or key object, thus providing the user with detailed information about the focal object or key object.

[0009] In one possible design, the second image is the central region of the image captured by the second camera, or the second image is a magnified version of the central region of the image captured by the second camera.

[0010] In other words, the second image comes from the second camera; the second image is the image captured by the second camera.

[0011] In another possible design, the size ratio of the first region is equal to the image output ratio of the photosensitive element of the first camera; and the area formed by splicing the first region and the second region fills the display area of ​​the screen.

[0012] This ensures that the first image has the largest field of view. Furthermore, it maximizes the use of the display screen to present images to the user.

[0013] In another possible design, the preview interface includes a first control, and the method further includes: after detecting a user's operation on the first control, if the first image displayed in the first area is an image captured by a wide-angle camera, the electronic device switches the first image to an image captured by an ultra-wide-angle camera.

[0014] In this way, the electronic device can switch between the ultra-wide-angle camera and the wide-angle camera based on the user's operation of the first control.

[0015] In another possible design, the multiple cameras also include a front-facing camera, and the preview interface includes a second control. The method further includes: after the electronic device detects a user's operation on the second control, switching the second image displayed in the second area to the image captured by the front-facing camera. If the electronic device detects another user operation on the second control, it switches the image captured by the front-facing camera displayed in the second area to the second image.

[0016] In this way, the electronic device can switch whether the image in the second area comes from the rear second camera or the front camera based on the user's operation of the second control, that is, switch between rear close-up mode and front and rear camera mode.

[0017] In another possible design, before the electronic device displays the preview interface, the method further includes: the electronic device performing image stabilization processing on the images captured by the first camera and the second camera respectively.

[0018] In this way, electronic devices can obtain a clear image through image stabilization before displaying it.

[0019] In another possible design, the method further includes: after the electronic device detects a user's preset operation, it adjusts the video resolution; the video resolution corresponds to the size ratio of the area formed by stitching the first and second areas together.

[0020] In other words, when the area formed by splicing the first and second areas fills the display area of ​​the screen, the user can adjust the resolution of the screen, which means adjusting the size ratio of the area formed after splicing.

[0021] In another possible design, the shooting interface includes a third control; the method further includes: after detecting a user's operation on the third control, the electronic device adjusts the zoom ratio of the second image within the second area. Wherein, if the adjusted zoom ratio is equal to 1, the second camera is a wide-angle camera, and the second image is the central area of ​​the image captured by the wide-angle camera. If the adjusted zoom ratio is greater than 1 and less than a first preset value, the second camera is a wide-angle camera, and the second image is a magnified image of the central area of ​​the image captured by the wide-angle camera. If the adjusted zoom ratio is equal to the first preset value, the second camera is a telephoto camera, and the second image is the central area of ​​the image captured by the telephoto camera. If the adjusted zoom ratio is greater than the first preset value, the second camera is a telephoto camera, and the second image is a magnified image of the central area of ​​the image captured by the telephoto camera. If the adjusted zoom ratio is less than 1 and greater than the second preset value, the second camera is an ultra-wide-angle camera, and the second image is a magnified image of the central area of ​​the image captured by the ultra-wide-angle camera. If the adjusted zoom ratio equals the second preset value, then the second camera is an ultra-wide-angle camera, and the second image is the central area of ​​the image captured by the ultra-wide-angle camera. The electronic device displays the second image within the second area according to the adjusted zoom ratio.

[0022] In other words, electronic devices can switch between a wide-angle camera, a telephoto camera, or an ultra-wide-angle camera depending on the zoom level.

[0023] In another possible design, the method further includes: the electronic device stopping video recording after detecting a user-instructed end operation; the electronic device generating a video file; and the electronic device displaying a playback interface, which includes a first area and a second area, after detecting a user's playback operation on the video file.

[0024] In this way, electronic devices can also play multiple recorded videos and simultaneously display multiple images in multiple areas of the playback interface.

[0025] In another possible design, each frame in the video file includes a first sub-image and a second sub-image, where the first sub-image is the first image and the second sub-image is the second image or an image captured by the front-facing camera among multiple cameras.

[0026] In other words, the images in a video file are composite (e.g., spliced) images of the first and second images.

[0027] In another possible design, when the above-mentioned preview interface or shooting interface is displayed, the electronic device can generate a first photo after detecting the user's instruction to generate a photo. The first photo includes the image in the first area and the image in the second area.

[0028] In another possible design, when displaying the aforementioned preview interface or shooting interface, the electronic device can display a second image in a second area based on the user's indicated close-up object after detecting the user's operation of indicating a close-up object.

[0029] On the other hand, this application provides a method for taking a picture, applied to an electronic device with a display screen and multiple cameras. The method includes: the electronic device activating the camera; then, the electronic device using a first camera and a second camera among the multiple cameras to capture images. The first camera is a rear wide-angle camera or a rear ultra-wide-angle camera. The second camera is a wide-angle camera, an ultra-wide-angle camera, or a rear telephoto camera. The electronic device displays a preview interface. The preview interface includes a first image and a second image; the first image is an image captured by the first camera, and the second image is from the second camera, and the second image corresponds to the central area of ​​the image captured by the second camera. The first image is located in a first area of ​​the preview interface, and the second image is located in a second area of ​​the preview interface. After detecting a user's instruction to take a picture, the electronic device saves the image on the current interface to generate a photograph, which includes the aforementioned first image and the aforementioned second image.

[0030] On the other hand, embodiments of this application provide a recording device included in an electronic device, which has the function of implementing the behavior of the electronic device in any of the above aspects and possible implementations. This function can be implemented by hardware or by hardware executing corresponding software. The hardware or software includes at least one module or unit corresponding to the above function. For example, a startup module or unit, a acquisition module or unit, a display module or unit, a processing module or unit, etc.

[0031] In another aspect, embodiments of this application provide an electronic device, including one or more cameras for capturing images; one or more displays for displaying an interface; one or more processors; one or more memories; and one or more computer programs; wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions; when the instructions are executed by the processor, the electronic device performs the recording method in any possible implementation of the foregoing aspects.

[0032] On the other hand, embodiments of this application provide a computer storage medium including computer instructions that, when executed on an electronic device, cause the electronic device to perform the recording method in any possible implementation of the above aspects.

[0033] In another aspect, embodiments of this application provide a computer program product that, when run on a computer, causes the computer to execute the recording method in any possible implementation of the above aspects. Attached Figure Description

[0034] Figure 1 is a schematic diagram of the structure of an electronic device provided in an embodiment of this application;

[0035] Figure 2 is a set of interface diagrams provided in an embodiment of this application;

[0036] Figure 3 is another set of interface diagrams provided in the embodiments of this application;

[0037] Figure 4A is a schematic diagram of an interface provided in an embodiment of this application;

[0038] Figure 4B is a schematic diagram of another interface provided in an embodiment of this application;

[0039] Figure 4C is a schematic diagram of an operation provided in an embodiment of this application;

[0040] Figure 5A is a set of display style diagrams provided in the embodiments of this application;

[0041] Figure 5B is a schematic diagram of another set of display styles provided in an embodiment of this application;

[0042] Figure 5C is a schematic diagram of another set of display styles provided in the embodiments of this application;

[0043] Figure 6A is a schematic diagram of another interface provided in an embodiment of this application;

[0044] Figure 6B is a schematic diagram of another interface provided in an embodiment of this application;

[0045] Figure 6C is a schematic diagram of another interface provided in an embodiment of this application;

[0046] Figure 6D is a schematic diagram of another interface provided in an embodiment of this application;

[0047] Figure 6E is a schematic diagram of another interface provided in an embodiment of this application;

[0048] Figure 7 is another set of interface diagrams provided in the embodiments of this application;

[0049] Figure 8 is another set of interface diagrams provided in the embodiments of this application;

[0050] Figure 9A is a schematic diagram of another interface provided in an embodiment of this application;

[0051] Figure 9B is a schematic diagram of another interface provided in an embodiment of this application;

[0052] Figure 10 is another set of interface diagrams provided in the embodiments of this application;

[0053] Figure 11 is another set of interface diagrams provided in the embodiments of this application;

[0054] Figure 12A is a schematic diagram of another interface provided in an embodiment of this application;

[0055] Figure 12B is a schematic diagram of another interface provided in an embodiment of this application;

[0056] Figure 13 is another set of interface diagrams provided in the embodiments of this application;

[0057] Figure 14 is a schematic diagram of another interface provided in an embodiment of this application;

[0058] Figure 15 is another set of interface diagrams provided in the embodiments of this application;

[0059] Figure 16A is another set of interface diagrams provided in the embodiments of this application;

[0060] Figure 16B is another set of interface diagrams provided in the embodiments of this application;

[0061] Figure 17 is another set of interface diagrams provided in the embodiments of this application;

[0062] Figure 18A is another set of interface diagrams provided in the embodiments of this application;

[0063] Figure 18B is another set of interface diagrams provided in the embodiments of this application;

[0064] Figure 18C is a schematic diagram of a photograph generated during multi-channel recording according to an embodiment of this application;

[0065] Figure 18D is a schematic diagram of a set of photos generated during multi-channel recording provided in an embodiment of this application;

[0066] Figure 19 is a schematic diagram of another interface provided in an embodiment of this application;

[0067] Figure 20 is another set of interface diagrams provided in the embodiments of this application;

[0068] Figure 21 is a schematic diagram of another interface provided in an embodiment of this application;

[0069] Figure 22 is a schematic diagram of another interface provided in an embodiment of this application;

[0070] Figure 23 is a flowchart of a multi-channel recording method provided in an embodiment of this application. Detailed Implementation

[0071] The technical solutions of the embodiments of this application will be described below with reference to the accompanying drawings. In the description of the embodiments of this application, unless otherwise stated, " / " means "or," for example, A / B can mean A or B; "and / or" in this text is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Furthermore, in the description of the embodiments of this application, "multiple" refers to two or more than two.

[0072] This application provides a multi-channel recording method that can be applied to electronic devices including multiple cameras. The electronic device can simultaneously use multiple cameras to record video, obtaining multiple video images and richer image information.

[0073] In this context, "video recording" can also be referred to as "recorded video". In the following embodiments of this application, "video recording" and "recorded video" have the same meaning.

[0074] For example, the electronic device may specifically be a mobile phone, tablet computer, wearable device, in-vehicle device, augmented reality (AR) / virtual reality (VR) device, laptop computer, ultra-mobile personal computer (UMPC), netbook, personal digital assistant (PDA), or dedicated camera (e.g., SLR camera, point-and-shoot camera), etc. The embodiments of this application do not impose any restrictions on the specific type of electronic device.

[0075] For example, Figure 1 shows a schematic diagram of the structure of an electronic device 100. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0076] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0077] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0078] In some embodiments, the controller or GPU, or other processor 110, can be used in a multi-channel recording scenario to combine multiple frames of images simultaneously captured by N (N is an integer greater than 1) cameras 193 into a single frame by splicing or local overlay, so that the electronic device 100 can simultaneously display the images captured by the N cameras 193 according to a preset display style or a display style indicated by the user.

[0079] The display style may include the arrangement and size of images captured by different cameras 193.

[0080] In other embodiments, the controller or GPU or other processor 110 can be used to perform image stabilization processing on the images captured by each camera 193 in a multi-channel recording scenario, and then synthesize the image stabilization processing images corresponding to N cameras 193.

[0081] The controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to the instruction opcode and timing signals to complete the control of fetching and executing instructions.

[0082] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0083] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0084] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple I2C buses. The processor 110 can couple to the touch sensor 180K, charger, flash, camera 193, etc., through different I2C bus interfaces. For example, the processor 110 can couple to the touch sensor 180K through the I2C interface, enabling the processor 110 and the touch sensor 180K to communicate through the I2C bus interface, thereby realizing the touch function of the electronic device 100.

[0085] The I2S interface can be used for audio communication. In some embodiments, the processor 110 may include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the I2S interface to enable the function of answering phone calls through a Bluetooth headset.

[0086] The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via the PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface, enabling the function of answering phone calls through a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0087] The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 via the UART interface to implement Bluetooth functionality. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the UART interface to enable music playback through Bluetooth headphones.

[0088] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI) and a display serial interface (DSI). In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to enable the electronic device 100 to capture images. The processor 110 and the display screen 194 communicate via the DSI interface to enable the electronic device 100 to display images.

[0089] The GPIO interface can be configured via software. It can be configured as a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to a camera 193, a display screen 194, a wireless communication module 160, an audio module 170, a sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0090] USB port 130 is a USB standard compliant interface, specifically a Mini USB port, Micro USB port, USB Type-C port, etc. USB port 130 can be used to connect a charger to charge electronic device 100, and can also be used for data transfer between electronic device 100 and peripheral devices. It can also be used to connect headphones for audio playback. This interface can also be used to connect other electronic devices, such as AR devices.

[0091] It is understood that the interface connection relationships between the modules illustrated in the embodiments of this application are merely illustrative and do not constitute a structural limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.

[0092] The charging management module 140 receives charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 receives charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 receives wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also supply power to the electronic device via the power management module 141.

[0093] The power management module 141 connects the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, providing power to the processor 110, internal memory 121, external memory, display screen 194, camera 193, and wireless communication module 160, etc. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage current, impedance).

[0094] In some other embodiments, the power management module 141 may also be located within the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may also be located in the same device.

[0095] The wireless communication function of electronic device 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.

[0096] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with tuning switches.

[0097] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1.

[0098] In some embodiments, at least some functional modules of the mobile communication module 150 may be disposed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be disposed in the same device.

[0099] The modem processor may include a modulator and a demodulator. The modulator modulates the low-frequency baseband signal to be transmitted into a mid-to-high frequency signal. The demodulator demodulates the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After processing by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs sound signals through audio devices (not limited to speaker 170A, receiver 170B, etc.) or displays images or videos through the display screen 194.

[0100] In some embodiments, the modem processor may be a separate device. In other embodiments, the modem processor may be independent of the processor 110 and may be housed in the same device as the mobile communication module 150 or other functional modules.

[0101] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.

[0102] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling electronic device 100 to communicate with networks and other devices via wireless communication technology. Wireless communication technology may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time-Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. GNSS can include the Global Positioning System (GPS), the Global Navigation Satellite System (GLONASS), the BeiDou Navigation Satellite System (BDS), the Quasi-Zenith Satellite System (QZSS), and / or satellite-based augmentation systems (SBAS).

[0103] Electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0104] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a miniature LED, a microLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, electronic device 100 may include one or more display screens 194.

[0105] In some embodiments, in a multi-channel recording scenario, the display screen 194 can display the images simultaneously captured by N cameras 193 through splicing or picture-in-picture methods according to a preset display style or a display style indicated by the user, so that the multiple images captured by N cameras 193 can be presented to the user at the same time.

[0106] Electronic device 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.

[0107] The ISP (Image Signal Processor) is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, transforming it into an image visible to the naked eye. The ISP can also perform algorithmic optimization of image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.

[0108] Camera 193 is used to capture still images or videos. An object passes through the lens, generating an optical image that is projected onto a photosensitive element. This photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to an ISP (Image Signal Processor) for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP (Digital Signal Processor) for further processing. The DSP converts the digital image signal into standard RGB, YUV, or other image formats.

[0109] The electronic device 100 may include more than or equal to N (N is an integer greater than 1) cameras 193, which may include rear cameras and / or front cameras. The N cameras 193 can be used to record multiple video streams.

[0110] Digital signal processors (DSPs) are used to process digital signals. Besides digital image signals, they can also process other digital signals. For example, when electronic device 100 selects a frequency, the DSP can perform Fourier transforms on the frequency energy.

[0111] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. Thus, electronic device 100 can play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0112] An NPU (Neural Processing Unit) is a computational processor for neural networks (NNs). By borrowing the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can rapidly process input information and continuously learn on its own. NPUs enable intelligent cognitive applications in electronic devices, such as image recognition, facial recognition, speech recognition, and text understanding.

[0113] The external storage interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, music, video, and other files can be saved on the external memory card.

[0114] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of electronic device 100 by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of electronic device 100 (such as audio data, phonebook, etc.). Furthermore, internal memory 121 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.

[0115] Electronic device 100 can implement audio functions, such as music playback and recording, through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.

[0116] The audio module 170 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 170 may be located in the processor 110, or some functional modules of the audio module 170 may be located in the processor 110.

[0117] The speaker 170A, also known as a "loudspeaker," is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or make hands-free calls through the speaker 170A.

[0118] The receiver 170B, also known as the "earpiece," is used to convert audio electrical signals into sound signals. When the electronic device 100 answers a telephone call or voice message, the receiver 170B can be brought close to the ear to listen to the voice.

[0119] Microphone 170C, also known as a "microphone" or "voice transducer," is used to convert sound signals into electrical signals. When making a phone call or sending a voice message, the user can speak by bringing their mouth close to microphone 170C, inputting the sound signal into microphone 170C. Electronic device 100 may have at least one microphone 170C. In some embodiments, electronic device 100 may have two microphones 170C, which, in addition to collecting sound signals, can also perform noise reduction. In other embodiments, electronic device 100 may also have three, four, or more microphones 170C, which can collect sound signals, reduce noise, identify the sound source, and perform directional recording, etc.

[0120] The 170D headphone jack is used to connect wired headphones. The 170D headphone jack can be a USB 130 interface or a 3.5mm Open Mobile Terminal Platform (OMTP) standard interface, a CTIA (Cellular Telecommunications Industry Association of the USA) standard interface.

[0121] Pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 180A can be disposed on display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor may include at least two parallel plates with conductive material. When force is applied to pressure sensor 180A, the capacitance between the electrodes changes. Electronic device 100 determines the pressure intensity based on the change in capacitance. When a touch operation is applied to display screen 194, electronic device 100 detects the touch operation intensity based on pressure sensor 180A. Electronic device 100 can also calculate the touch position based on the detection signal from pressure sensor 180A. In some embodiments, touch operations applied to the same touch position but with different touch operation intensities can correspond to different operation commands. For example: when a touch operation with an intensity less than a first pressure threshold is applied to the SMS application icon, a command to view an SMS is executed. When a touch operation with an intensity greater than or equal to the first pressure threshold is applied to the SMS application icon, a command to create a new SMS is executed.

[0122] The gyroscope sensor 180B can be used to determine the motion attitude of the electronic device 100. In some embodiments, the gyroscope sensor 180B can determine the angular velocity of the electronic device 100 about three axes (i.e., the x, y, and z axes). The gyroscope sensor 180B can be used for image stabilization. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the shake of the electronic device 100, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to counteract the shake of the electronic device 100 by moving in the opposite direction, thus achieving image stabilization. The gyroscope sensor 180B can also be used in navigation and motion-sensing game scenarios.

[0123] The barometric pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 100 calculates altitude using the air pressure value measured by the barometric pressure sensor 180C to assist in positioning and navigation.

[0124] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip cover. In some embodiments, when the electronic device 100 is a flip phone, the electronic device 100 can detect the opening and closing of the flip cover using the magnetic sensor 180D. Then, based on the detected opening and closing state of the cover or the flip cover, features such as automatic flip unlocking can be set.

[0125] The 180E accelerometer can detect the magnitude of acceleration of electronic device 100 in various directions (typically three axes). When electronic device 100 is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify the posture of electronic devices and applied to applications such as screen orientation switching and pedometers.

[0126] A distance sensor 180F is used to measure distance. Electronic device 100 can measure distance via infrared or laser. In some embodiments, during a shooting scene, electronic device 100 can utilize the distance sensor 180F to measure distance for rapid focusing.

[0127] The proximity sensor 180G may include, for example, a light-emitting diode (LED) and a light detector, such as a photodiode. The LED may be an infrared LED. The electronic device 100 emits infrared light outward through the LED. The electronic device 100 uses the photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 can determine that there is no object near the electronic device 100. The electronic device 100 may use the proximity sensor 180G to detect when a user holds the electronic device 100 close to their ear for a call, so as to automatically turn off the screen to save power. The proximity sensor 180G can also be used in holster mode and pocket mode for automatic unlocking and locking of the screen.

[0128] The ambient light sensor 180L is used to sense the brightness of ambient light. The electronic device 100 can adaptively adjust the brightness of the display screen 194 based on the sensed ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also work with the proximity sensor 180G to detect whether the electronic device 100 is in a pocket to prevent accidental touches.

[0129] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can utilize the characteristics of the collected fingerprints to achieve fingerprint unlocking, accessing application locks, taking photos with fingerprints, answering calls with fingerprints, etc.

[0130] Temperature sensor 180J is used to detect temperature. In some embodiments, electronic device 100 uses the temperature detected by temperature sensor 180J to execute a temperature handling strategy. For example, when the temperature reported by temperature sensor 180J exceeds a threshold, electronic device 100 performs thermal protection by reducing the performance of a processor located near temperature sensor 180J to reduce power consumption. In other embodiments, when the temperature is below another threshold, electronic device 100 heats battery 142 to prevent abnormal shutdown of electronic device 100 due to low temperature. In still other embodiments, when the temperature is below yet another threshold, electronic device 100 boosts the output voltage of battery 142 to prevent abnormal shutdown due to low temperature.

[0131] Touch sensor 180K, also known as a "touch panel," can be located on display screen 194. The touch sensor 180K and display screen 194 together form a touchscreen, also known as a "touch screen." Touch sensor 180K detects touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 194. In other embodiments, touch sensor 180K may also be located on the surface of electronic device 100, in a different position than display screen 194.

[0132] The bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can acquire vibration signals from the vibrating bone segments of the human vocal cords. The bone conduction sensor 180M can also contact the human pulse to receive blood pressure signals. In some embodiments, the bone conduction sensor 180M can also be incorporated into headphones to form bone conduction headphones. The audio module 170 can parse the voice signals from the vibrating bone segments of the vocal cords acquired by the bone conduction sensor 180M to realize voice functionality. The application processor can parse heart rate information from the blood pressure signals acquired by the bone conduction sensor 180M to realize heart rate detection functionality.

[0133] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch-sensitive buttons. Electronic device 100 can receive button input and generate key signal inputs related to user settings and function control of electronic device 100.

[0134] Motor 191 can generate vibration alerts. Motor 191 can be used for incoming call vibration alerts or for touch vibration feedback. For example, different vibration feedback effects can correspond to touch operations performed on different applications (such as taking photos, playing audio, etc.). Motor 191 can also correspond to different vibration feedback effects for touch operations performed on different areas of the display screen 194. Different application scenarios (such as time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also be customized.

[0135] Indicator 192 can be an indicator light, used to indicate charging status, power changes, or to indicate messages, missed calls, notifications, etc.

[0136] The SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to make contact with and detach from the electronic device 100. The electronic device 100 can support one or more SIM card interfaces. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 195 simultaneously. The multiple cards can be of the same or different types. The SIM card interface 195 is also compatible with different types of SIM cards. The SIM card interface 195 is also compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to realize functions such as calls and data communication. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

[0137] In the embodiments of this application, the N cameras 193 in the mobile phone can simultaneously record multiple video streams; this shooting mode can be called a multi-channel recording mode. In multi-channel recording mode, during recording or playback of a recorded video, the display screen 194 can simultaneously display multiple frames of images captured by the N cameras 193 on the same interface, according to a preset display style or a display style indicated by the user. The multiple frames of images captured by the N cameras 193 can be stitched together on the same interface or displayed in a picture-in-picture manner.

[0138] In some embodiments, in multi-channel recording mode, the processor 110 (e.g., a controller or GPU) can synthesize multiple frames of images simultaneously captured by N cameras 193 during recording, thereby merging the multiple video streams captured by the N cameras 193 into a single video stream. Then, the video encoder in the processor 110 can encode the synthesized single video stream data to generate a video file. Thus, each frame in the video file can contain multiple images from the N cameras 193. When playing a frame of the video file, the display screen 194 can display the multiple images simultaneously captured by the N cameras 193 according to a preset or user-indicated display style, showcasing multiple images of different ranges, resolutions, or details at the same time or in the same scene to the user.

[0139] In other embodiments, in multi-channel recording mode, the processor 110 can associate each frame of image captured simultaneously by different cameras 193, so that when playing the recorded video, the display screen 194 can display the associated image frames on the same interface according to a preset or user-indicated display style. For example, the processor 110 can associate the multiple frames of images captured simultaneously by N cameras 193 by assigning the same label to them. In this case, the videos recorded by different cameras 193 can be stored as different video files.

[0140] In some embodiments, in multi-channel recording mode, N cameras 193 can capture images at the same frame rate, meaning that the N cameras 193 capture the same number of image frames within the same time period. Videos recorded simultaneously by different cameras 193 can be stored as different video files, which are interconnected. These video files store image frames in the order they were captured, and each video file contains the same number of image frames. When playing a recorded video, the display screen 194 can display the images according to a preset or user-indicated display style, following the order of the image frames in the associated video files, thereby displaying multiple frames corresponding to the same sequence from different video files on the same interface.

[0141] In other embodiments, in multi-channel recording mode, N cameras 193 can capture images at the same frame rate, meaning that the N cameras 193 capture the same number of image frames within the same time period. The processor 110 can timestamp each frame captured by different cameras 193, so that when playing back the recorded video, the display screen 194 can simultaneously display multiple frames captured by the N cameras 193 on the same interface based on the timestamps and a preset or user-indicated display style. Videos recorded by different cameras 193 can be stored as different video files.

[0142] For ease of use, mobile phones are typically used in handheld mode, which usually results in shaky footage. In some embodiments, in multi-channel recording mode, the processor 110 can perform image stabilization processing on image frames captured by different cameras 193 separately. Then, the display screen 194 displays the image based on the image stabilization processing.

[0143] The following will use a mobile phone with the aforementioned touchscreen as an example to illustrate the multi-channel recording method provided in this application.

[0144] As described above, a touchscreen can include a display panel and a touch panel. The display panel can display the interface, meaning the touchscreen is also a display screen; the touch panel can detect the user's touch operations and report them to the phone's processor for corresponding processing.

[0145] In some embodiments, when a user wants to take a picture with their mobile phone, they can instruct the phone to activate the camera through touch operation, button operation, air gesture operation, or voice operation. The phone then activates the camera function according to the user's instruction. For example, as shown in Figure 2(a), the phone activates the camera function after detecting the user's tap on the camera icon 201.

[0146] In some embodiments, after activating the camera, the mobile phone can automatically enter shooting modes such as photo mode, video mode (i.e., single-channel video recording mode using a single camera in the prior art), or multi-channel video recording mode, and display a shooting preview interface. For example, after detecting a user's click on the camera icon 201 as shown in Figure 2(a), the mobile phone can automatically enter photo mode and display a preview window 202 as shown in Figure 2(b). The preview window 202 can display a photo preview interface.

[0147] In other embodiments, if the phone does not enter multi-channel recording mode after activating the camera, it can enter multi-channel recording mode according to the user's instructions.

[0148] For example, on the photo preview interface shown in Figure 2(b), if the mobile phone detects the user's click on control 203, it can enter multi-channel recording mode and display the preview window 204 shown in Figure 2(c). The preview window 204 can display the multi-channel recording preview interface.

[0149] In multi-channel recording mode, the preview window 204 can include multiple areas, each used to display images captured by a different camera simultaneously recording multiple channels. For example, when the multi-channel recording mode is dual-channel recording mode, the two cameras on the phone are used for multi-channel recording simultaneously, as shown in Figure 2(c). The preview window 204 can include areas 205 and 206. Area 205 can display the image captured by one camera, and area 206 can display the image captured by the other camera.

[0150] For another example, on the camera preview interface shown in Figure 3(a), if the phone detects the user clicking control 301, it can display the settings interface shown in Figure 3(c). Alternatively, on the camera preview interface shown in Figure 3(b), if the phone detects the user clicking control 302, it can display the settings interface shown in Figure 3(c). Then, if the phone detects the user clicking control 303, it enters multi-channel recording mode.

[0151] For another example, in photo mode, the phone's photo preview interface may include camera icons. After detecting that the user has selected multiple camera icons, the phone determines that the user wants to record video using multiple cameras, thus entering multi-channel recording mode. For instance, referring to Figure 4A, the phone's photo preview interface includes a rear ultra-wide-angle camera icon 401, a rear wide-angle camera icon 402, a rear telephoto camera icon 403, and a front-facing camera icon 404. When the phone detects that the user has clicked on icons 402 and 403, it enters multi-channel recording mode and uses the rear wide-angle camera and the rear telephoto camera to capture images.

[0152] For another example, in photo mode, the camera preview interface displayed on the phone may include a numerical identifier that indicates the number of cameras used simultaneously during shooting (or the number of image streams captured simultaneously). When the phone detects that the value corresponding to the numerical identifier selected by the user is greater than 1, it determines that the user wants to use multiple cameras to record video simultaneously, thus entering multi-channel recording mode.

[0153] For another example, in photo mode or video mode (i.e., single-channel video mode), the phone enters multi-channel video mode after detecting that the user has drawn a preset trajectory 1 (e.g., an "M" trajectory) on the touchscreen.

[0154] As another example, in recording mode (i.e., single-channel recording mode), the mobile phone can prompt the user on the recording preview interface whether to enter multi-channel recording mode. For example, referring to Figure 4B, the mobile phone can display information 405 to prompt the user; after detecting the user's click on control 406, the mobile phone enters multi-channel recording mode.

[0155] In other embodiments, when a user wants to use the mobile phone to record multiple videos, the mobile phone can activate the camera function and directly enter the multi-channel recording mode according to the user's touch operation, button operation, air gesture operation or voice operation.

[0156] For example, when the phone is displaying the desktop or the interface of another application, if it receives a user's voice instruction to enter multi-recording mode, it will activate the camera and enter multi-recording mode. As another example, when the screen is on and the desktop is displayed, or when the screen is off as shown in Figure 4C, if the phone detects that the user has drawn a preset trajectory 2 (e.g., a "CM" trajectory) on the touchscreen, it will activate the camera and enter multi-channel recording mode.

[0157] The above-described method of entering multi-channel recording mode is merely an illustrative example. The mobile phone can also enter multi-channel recording mode in other ways, and this application embodiment does not specifically limit the method.

[0158] After entering multi-channel recording mode, the phone can use N cameras to capture and display multiple images in preview mode.

[0159] In some embodiments, in the preview state of multi-channel recording mode, the mobile phone can capture multiple images using a default set of N (N is an integer greater than 1) cameras. The images captured by different cameras may differ in size, range, content, or clarity. By simultaneously capturing multiple images from multiple cameras, richer visual information about events occurring at the same time or in the same scene can be obtained. The image capture frame rates of the N cameras can be equal, allowing the mobile phone to capture N frames of images simultaneously from the N cameras. For example, N is 2, and the N cameras can be a rear wide-angle camera and a rear telephoto camera.

[0160] The aforementioned N cameras can correspond to the same focal length or different focal lengths. This focal length can include, but is not limited to: a first focal length with a focal length less than a preset value 1 (e.g., 20mm), for example, an ultra-wide-angle camera can correspond to this first focal length; a second focal length with a focal length greater than or equal to the preset value 1 and less than or equal to the preset value 2 (e.g., 50mm), for example, a wide-angle camera can correspond to this second focal length; and a third focal length with a focal length greater than the preset value 2, for example, a telephoto camera can correspond to this third focal length.

[0161] The aforementioned N cameras may include rear cameras and / or front cameras. For example, a phone can simultaneously use two rear cameras for dual-channel rear video recording; another example is that a phone can use one front camera and one rear camera for dual-channel front and rear video recording; yet another example is that a phone can use three rear cameras for triple-channel rear video recording; yet another example is that a phone can use two rear cameras and one front camera for triple-channel video recording; yet another example is that a phone can use two rear cameras and two front cameras for quad-channel video recording; yet another example is that a phone can use two front cameras for dual-channel video recording, and so on.

[0162] Multiple rear cameras typically correspond to multiple focal lengths. When a phone uses multiple rear cameras simultaneously for multi-channel recording, it can simultaneously capture image information from different focal lengths and different field of view ranges. For example, a phone may include three rear cameras and one front camera. The three rear cameras are an ultra-wide-angle camera, a wide-angle camera, and a telephoto camera, while the front camera corresponds to the aforementioned second focal length. The rear ultra-wide-angle or wide-angle camera can capture panoramic information within a larger field of view, while the rear telephoto camera can capture image information with a smaller field of view but clearer and richer details.

[0163] For example, the N cameras can be a rear telephoto camera + a rear wide-angle camera; or a rear ultra-wide-angle camera + a rear telephoto camera; or a rear wide-angle camera + a rear telephoto camera; or a rear ultra-wide-angle camera + a rear wide-angle camera + a rear telephoto camera.

[0164] When a mobile phone simultaneously uses both the rear and front cameras for multi-channel recording, it can capture images of the subject in front of the phone and the person filming behind the phone, allowing users to easily save and review the footage. For example, the N cameras can be a front camera + a rear ultra-wide-angle camera; or a front camera + a rear wide-angle camera; or a front camera + a rear telephoto camera.

[0165] In other embodiments, in the preview state of multi-channel recording mode, the mobile phone can also display multiple images captured simultaneously by N cameras according to a default display style. This display style includes the layout and size of the images captured by different cameras on the interface, that is, the layout and size of the areas where the images captured by different cameras are located on the interface.

[0166] For example, when N is 2, the display styles can include left-right double-panel style, top-bottom double-panel style, or picture-in-picture style. In the double-panel style, the different areas being panned can be equal or unequal, and there are almost no gaps between them, thus maximizing the use of the touchscreen to display image information. The picture-in-picture style refers to the partial overlay display of images captured by different cameras, or an image captured by one camera can be displayed floating on top of an image captured by another camera, with the size of the floating image being smaller than the size of the image below. For example, when N is 2, the display styles can be as shown in Figures 5A(a)-(e). Here, (a)-(c) are double-panel styles, and (d) and (e) are picture-in-picture styles.

[0167] For example, when N is 3, the display style can include a left-center-right three-part style, a top-center-bottom three-part style, or a picture-in-picture style. For instance, when N is 3, the display style can be as shown in (a)-(f) of Figure 5B. Here, (a)-(d) represent the splicing format, and (e) and (f) represent the picture-in-picture format.

[0168] For example, when N is 4, the display style can include horizontal side-by-side style, vertical side-by-side style, four-grid style, top / bottom left / bottom center / bottom right style, or picture-in-picture style, etc. For instance, when N is 4, the display style can be as shown in (a)-(e) of Figure 5C. Where (a)-(c) are splicing formats, and (d) and (e) are picture-in-picture formats.

[0169] The aforementioned default N cameras and default display style can be preset by the phone, set by the user beforehand (e.g., set by the user in the system settings interface before starting the camera to take a picture), or the N cameras or display style that the user last used in multi-channel recording mode. For example, the default N cameras can be a rear wide-angle camera and a rear telephoto camera, the default display style can be as shown in Figure 5A(a), and the multi-channel recording preview interface can be as shown in Figure 2(c).

[0170] In other embodiments, the mobile phone can also perform image stabilization processing on the images captured by each of the N cameras separately, obtaining a clear image before displaying it. For example, image stabilization processing can include motion estimation and motion compensation. Motion estimation refers to finding the optimal motion vector. Motion compensation refers to compensating the current frame based on the motion vector to remove jitter. Exemplary image stabilization methods can include grayscale projection, block matching, bit plane matching, edge matching, feature point matching, etc.

[0171] For example, when using block matching for image stabilization, a frame can be divided into multiple non-overlapping sub-blocks (e.g., 32*32), assuming that all pixels within the sub-block have the same motion vector. Then, within a set search range, the current block is compared with the corresponding block in the previous frame; based on a certain matching criterion, the best match is found, and the alternative position or corresponding motion vector of the current block is obtained, thereby compensating the current frame.

[0172] In one technical solution, adjacent frames experiencing shaking often become blurry due to content misalignment. The phone can register these two frames and crop the edges to obtain a clear image. However, compared to wide-angle or ultra-wide-angle cameras, telephoto cameras exhibit more severe image misalignment when shaking occurs, thus requiring more significant cropping during image stabilization.

[0173] In other embodiments, in the preview state of the multi-channel recording mode, the mobile phone can also capture and display multiple images according to the default recording mode. This recording mode includes a correspondence between cameras and display styles; the mobile phone can use N cameras corresponding to the default recording mode to capture images and display the images using the display style corresponding to the default recording mode.

[0174] For example, recording modes may include close-up mode, front and rear camera modes, etc., with close-up mode being the default recording mode. For instance, the cameras corresponding to close-up mode are a rear wide-angle camera and a rear telephoto camera, and the corresponding display style is shown in Figure 5A(a). As another example, the cameras corresponding to close-up mode are a rear ultra-wide-angle camera and a rear telephoto camera, and the corresponding display style is shown in Figure 5A(d). As yet another example, the cameras corresponding to front and rear camera mode are a rear wide-angle camera and a front camera, and the corresponding display style is shown in Figure 5A(e).

[0175] In close-up mode, the phone can simultaneously record a panoramic view behind the phone and a close-up view of the subject, and display the panoramic image and the close-up image in two separate areas. This allows the phone to display a wide-ranging panoramic image while also showcasing the beauty of the details of the subject.

[0176] In some embodiments, the mobile phone can obtain the output ratio of the photosensitive element in the camera capturing the panoramic image, ensuring that the size ratio of the area where the displayed panoramic image is located is consistent with the output ratio of the photosensitive element. This guarantees that the panoramic image has the maximum field of view. The output ratio of the photosensitive element refers to the ratio of the image formed by the photosensitive element in the width and height directions. The mobile phone can also obtain the size ratio and dimensions of the touchscreen display area. Based on the size ratio of the display area and the panoramic image, the size ratio of the close-up image is determined so that the stitched panoramic image and close-up image on the multi-channel video preview interface fill the entire display area of ​​the touchscreen. That is, there is almost no gap between the panoramic image area and the close-up image area, and the entire area formed by stitching the panoramic image area and the close-up image area is the same size and ratio as the touchscreen display area, thereby maximizing the use of the touchscreen to present images to the user.

[0177] For example, referring to Figure 6A, area 610 contains a panoramic image, and area 620 contains a close-up image. When the aspect ratio of the image sensor in the camera capturing the panoramic image is 4:3, and the aspect ratio of the touchscreen display area is 18:9, the aspect ratio of the panoramic image (i.e., the aspect ratio of area 610) can also be 4:3, and the aspect ratio of the close-up image (i.e., the aspect ratio of area 620) can be 2:3. The image formed by stitching the panoramic image and the close-up image has an aspect ratio of 18:9, and the stitched image fills the entire display area of ​​the touchscreen, with the display style shown in Figure 5A(a). In some embodiments, the multi-channel recording preview interface may also include a control 640, as shown in Figure 6A, marked "Close-up" within a solid line box, used to prompt the user that the current mode is close-up.

[0178] As another example, when using the picture-in-picture display style shown in Figure 5A(d), the preview effect in close-up mode can be seen in Figure 6B. In some embodiments, after entering multi-channel recording mode, as shown in Figure 6B, the multi-channel recording preview interface may only display the control 603 indicating that the current mode is multi-channel recording, and no longer display the "take a picture" control, "large aperture" control, etc. As shown in Figure 6B, the multi-channel recording preview interface may also include a control 604. After the phone detects the user's click on the control 604, it hides the control 603. In this way, the displayed image can be avoided from being obscured by the control as much as possible, improving the user's visual experience.

[0179] In front and rear camera mode, the phone can simultaneously record the scene behind the phone and the scene in front of the phone. For example, it can simultaneously record the scene of the subject being photographed in the back and the scene of the person taking the picture in the front, and display the rear image and the front image in two separate areas.

[0180] In some embodiments, the size ratio of the area where the rear image is located is consistent with the output ratio of the photosensitive element, which ensures that the rear image has the largest field of view; and the stitched panoramic image and close-up image can fill the entire display area of ​​the touch screen, which can maximize the use of the touch screen to present images to the user.

[0181] For example, in front-and-back mode, when using the display style shown in Figure 5A(a), the preview effect in front-and-back mode can be seen in Figure 6C. As shown in Figure 6C, the control 605 marked "Front-and-Back" within the solid line box indicates that the current mode is front-and-back, with the rear image in area 606 and the front image in area 607. When using the picture-in-picture display style shown in Figure 5A(e), the preview effect in front-and-back mode can be seen in Figure 6D.

[0182] In other embodiments, in the preview state of multi-channel recording mode, the mobile phone can capture multiple images based on N cameras indicated by the user. For example, similar to the camera icons shown in Figure 4A, after entering multi-channel recording mode, the multi-channel recording preview interface may include camera icons. After detecting the user's selection of multiple cameras, the mobile phone simultaneously captures images through the multiple cameras selected by the user.

[0183] As another example, as shown in Figure 7(a), the preview interface of the multi-channel recording mode displays a settings control 701. After the phone detects the user's click on the control 701, it can display the settings interface shown in Figure 7(b). The user can use the settings interface to set or modify the N cameras used by the phone during multi-channel recording.

[0184] As another example, after the mobile phone enters the multi-channel recording mode, the settings interface shown in Figure 7(b) can be automatically popped up, allowing the user to set or modify the camera they want to use.

[0185] As another example, after entering multi-channel recording mode, as shown in Figure 8(a), the multi-channel recording preview interface may include a camera settings control 801. After the mobile phone detects the user's click on the control 801, it can display a camera settings interface 802 as shown in Figure 8(b). The user can set or modify the camera they want to use during multi-channel recording on the camera settings interface 802.

[0186] In other embodiments, in the preview state of multi-channel recording mode, the mobile phone can display multiple images simultaneously captured by N cameras on the multi-channel recording preview interface according to the display style set by the user. For example, the user can select a display style through the settings interface 702 shown in Figure 7(b), or create a new display style by themselves.

[0187] As another example, after entering multi-channel recording mode, as shown in Figure 8(a), the multi-channel recording preview interface may include a display style setting control 803. After the mobile phone detects the user's click on the control 803, it can display the display style setting interface 804 as shown in Figure 8(c). The user can set the desired display style for multi-channel recording on the display style setting interface 804.

[0188] For example, when the user sets the camera to an ultra-wide-angle camera, a wide-angle camera, and a telephoto camera, and the display style is the stitching format shown in Figure 5B(d), the multi-channel recording preview interface can be as shown in Figure 9A. When the user sets the camera to an ultra-wide-angle camera, a telephoto camera, and a front-facing camera, and the display style is the picture-in-picture format shown in Figure 5B(f), the multi-channel recording preview interface can be as shown in Figure 9B.

[0189] In other embodiments, in the preview state of the multi-channel recording mode, the user can also drag the positions of different areas on the shooting interface to modify the arrangement of different areas; or drag the boundary lines between different areas to modify the size of different areas, thereby achieving the desired layout effect. Then, the mobile phone can simultaneously display multiple images captured by multiple cameras according to the modified layout and area size. For example, the schematic diagram of the modified display style can be seen in Figures 10(a) and (b), or Figures 10(a) and (c).

[0190] In other embodiments, the user can also modify the recording mode in the preview state of the multi-channel recording mode. For example, if the phone is currently in close-up mode as shown in Figure 6A, the phone can switch to front / rear mode as shown in Figure 6C after detecting the user's click on the switching control 602. If the current recording mode is the front / rear mode as shown by control 605 in Figure 6C, the phone can switch to close-up mode as shown in Figure 6A after detecting the user's click on the switching control 602.

[0191] In other embodiments, in the preview state of close-up mode, the mobile phone can switch the camera used to capture panoramic images according to the user's instructions. For example, after detecting the user's click on the switching control 601 shown in Figure 6A, if the camera currently capturing panoramic images is the rear wide-angle camera, it switches to using the rear ultra-wide-angle camera to capture panoramic images. The corresponding preview interface after switching cameras can be seen in Figure 6E. If the camera currently capturing panoramic images is the rear ultra-wide-angle camera, the mobile phone can switch to using the rear wide-angle camera to capture panoramic images after detecting the user's click on the switching control 601. In other embodiments, the multi-channel recording preview interface may also include, as shown in Figure 6A, a control 630 marked "Wide-angle" within a solid box indicating that the wide-angle camera is currently capturing panoramic images; and a control marked "Ultra-wide-angle" within a dashed box indicating that the panoramic image can be switched to be captured using the ultra-wide-angle camera.

[0192] For another example, in front and rear camera mode, the phone can switch between the rear wide-angle camera and the rear ultra-wide-angle camera for capturing rear images according to the user's instruction. For example, referring to Figure 6C, after the phone detects the user clicking the switching control 601, if the camera currently capturing rear images is the wide-angle camera, it switches to using the ultra-wide-angle camera to capture rear images; if the camera currently capturing rear images is the ultra-wide-angle camera, it switches to using the wide-angle camera to capture rear images.

[0193] In some embodiments, in close-up mode, the panoramic image can be an image captured by an ultra-wide-angle camera or a wide-angle camera; the close-up image can be a magnified portion of an image captured by the ultra-wide-angle / wide-angle camera, or it can be the entire image captured by the telephoto camera, or a local area of ​​an image captured by the telephoto camera, or a magnified portion of an image captured by the telephoto camera. The close-up image can magnify and display detailed information of the close-up object.

[0194] In other words, the panoramic image is the image captured by the first camera, which can be an ultra-wide-angle camera or a wide-angle camera. The close-up image can come from the second camera, which can be an ultra-wide-angle camera, a wide-angle camera, or a telephoto camera. The second camera can be the same as or different from the first camera.

[0195] It should be noted that for images captured by the first camera, the phone can also perform image stabilization and other processing by cropping a small amount of edge areas to obtain higher quality panoramic images.

[0196] In the close-up mode preview state, users can also adjust the zoom level corresponding to the close-up image. As the zoom level increases, the magnification of the close-up image also increases; as the zoom level decreases, the magnification of the close-up image also decreases.

[0197] For example, referring to Figure 11(a), when the mobile phone detects that the user clicks on the control 1101, it can display the zoom ruler 1102 as shown in Figure 11(b). When the mobile phone detects that the user drags the zoom ruler 1102 up / down, it increases / decreases the zoom magnification of the close-up image.

[0198] As another example, referring to Figure 12A, when the mobile phone detects that the user clicks on control 1201, it can zoom in on the close-up image by a preset step size; when the mobile phone detects that the user clicks on control 1202, it can zoom out on the close-up image by a preset step size.

[0199] As another example, referring to Figure 12B, when the phone detects a pinch gesture, it can reduce the zoom level of the close-up image; when the phone detects an expansion gesture, it can increase the zoom level of the close-up image.

[0200] As the zoom level of the close-up image changes, the second camera can switch between different rear cameras. For example, if the close-up image is a captured image or a magnified version of an image from an ultra-wide-angle camera, then as the zoom level increases, the close-up image can switch to a captured image or a magnified version of an image from a wide-angle camera or a telephoto camera. Conversely, if the close-up image is a captured image or a magnified version of an image from a telephoto camera, then as the zoom level decreases, the close-up image can switch to a captured image or a magnified version of an image from a wide-angle camera or an ultra-wide-angle camera.

[0201] In some embodiments, the close-up image is the central region of the image captured by the second camera (i.e., the central region of the field of view of the second camera), or the close-up image is an enlarged version of the central region of the image captured by the second camera. It is understood that the ultra-wide-angle camera, wide-angle camera, and telephoto camera on a mobile phone are very close together, so the central regions of the field of view of these rear cameras are generally consistent. That is, the subject in the central region of the images captured by the first camera and the second camera is generally consistent, and the close-up image can correspond to the central region of the panoramic image.

[0202] Typically, users place the focus or key object of interest in the center of the field of view, and the image of the focus or key object is usually presented in the center area of ​​the image captured by the second camera. When the close-up image is in the center area of ​​the image captured by the second camera, a close-up view of the focus or key object can be presented to the user, thus providing the user with detailed information about the focus or key object.

[0203] When a phone's rear camera setup includes an ultra-wide-angle camera, a wide-angle camera, and a telephoto camera, the wide-angle camera with a centered field of view can be used as the main camera. The zoom ratio corresponding to the image captured by the main camera can be 1. The panoramic image can be an image captured by either the wide-angle camera or the ultra-wide-angle camera.

[0204] For example, as shown in Figure 13(a), the first camera is an ultra-wide-angle camera and the second camera is a wide-angle camera. The panoramic image in the first region 1301 is an image captured by the ultra-wide-angle camera; the close-up image in the second region 1302 is a cropped portion of the central area of ​​the image captured by the wide-angle camera, and the zoom ratio corresponding to the close-up image is currently 1.

[0205] In the case shown in Figure 13(a), if the mobile phone detects that the user has indicated to increase the zoom ratio in the manner shown in Figure 11, Figure 12A or Figure 12B, and the increased zoom ratio is greater than 1 and less than a first preset value (e.g., 5), then the mobile phone will crop the middle area from the image captured by the wide-angle camera and enlarge it according to the increased zoom ratio (e.g., 2) and the size of the second area 1302, and then display it in the second area 1302 as shown in Figure 13(b).

[0206] In the case shown in Figure 13(b), if the mobile phone detects that the user has indicated to increase the zoom ratio in the manner shown in Figure 11, Figure 12A or Figure 12B, and the increased zoom ratio is greater than or equal to the first preset value, the mobile phone will switch the second camera from a wide-angle camera to a telephoto camera, and according to the increased zoom ratio (e.g., 6) and the size of the second region 1302, crop the middle area from the image captured by the wide-angle camera and enlarge it, and then display it in the second region 1302 as shown in Figure 13(c).

[0207] In the scenario shown in Figure 13(a), if the mobile phone detects that the user has instructed a reduction in zoom level as shown in Figures 11, 12A, or 12B, and the reduced zoom level is less than 1 but greater than or equal to a second preset value (e.g., 0.6), the mobile phone switches the second camera from a wide-angle camera to an ultra-wide-angle camera. Based on the reduced zoom level (e.g., 0.8) and the size of the second region 1302, the phone crops and magnifies the middle area of ​​the image captured by the wide-angle camera and displays it within the second region 1302 as shown in Figure 13(d). In this case, both the panoramic image and the close-up image originate from the ultra-wide-angle camera.

[0208] In other words, when the zoom ratio of the close-up image is within the range of [second preset value, 1), the second camera can be an ultra-wide-angle camera; when the zoom ratio of the close-up image is within the range of [1, first preset value), the second camera can be a wide-angle camera; when the zoom ratio of the close-up image is greater than or equal to the first preset value, the second camera can be a telephoto camera.

[0209] When the user moves the phone, the close-up image changes as the subject within the central area of ​​the second camera's field of view changes. In one technical solution, referring to Figure 14, the phone can display a control 1401 on the panoramic image to mark the central area of ​​the rear camera's field of view. When the user wants to switch the close-up object, they can move the phone so that all or most of the close-up object is within the area selected by the control 1401 on the panoramic image, thereby placing the close-up object in the central area of ​​the camera's field of view. This allows the close-up image to be magnified to display the detailed information of the close-up object.

[0210] In other embodiments, the phone can display a default close-up object. For example, the default close-up object could be an object in the center area of ​​a panoramic image. Another example is a person near the center area. After the user specifies a close-up object, the phone can display a close-up image corresponding to the switched close-up object.

[0211] In other embodiments, in the preview state of multi-channel recording mode, the mobile phone may not display close-up images initially; the close-up images may then be displayed after the user indicates the close-up object.

[0212] In other embodiments, in the preview state of multi-channel recording mode, regardless of whether the phone displays a close-up image, the user can specify a close-up object, and the phone displays the corresponding close-up image based on the user-specified close-up object. For example, referring to Figure 15(a), the phone can prompt the user via information 1501 to click on a location within the dashed box 1502 to select a close-up object. When the phone detects the user's click operation at a location on the panoramic image, the subject being photographed at that location becomes the close-up object. Referring to Figure 15(b), the close-up image is an enlarged view of that location.

[0213] In one technical solution, the close-up image can be a magnified portion of a panoramic image, and the close-up image can zoom in / out on the subject. To avoid problems with zooming out of the close-up image due to the subject being located at the edge of the panoramic image, the user can select the subject within the dashed box 1502, which is far from the edge of the panoramic image.

[0214] In another technical solution, the close-up image can be a magnified portion of the image captured by the second camera. The image within the dashed frame 1502 is the image corresponding to the field of view of the second camera. The user can select the close-up object within the dashed frame 1502, that is, select the close-up object within the field of view of the second camera.

[0215] For example, a mobile phone can prompt the user to tap a target subject (such as a person, animal, plant, or object) within a dotted box to select a close-up object. When the phone detects that the user taps the location of a person in the panoramic image, that person becomes the close-up object.

[0216] For example, referring to Figure 16A(a), when the mobile phone detects that the user has selected a region on the panoramic image, the object within that region is the close-up object; as shown in Figure 16A(b), the close-up image is the magnified image of the close-up object.

[0217] For example, when the phone detects that the user has selected a region on the panoramic image, it identifies the main shooting target within that region. This main shooting target is the close-up object, and the close-up image is an enlarged version of the close-up object.

[0218] In addition, similar to indicating a close-up object on a panoramic image, the user can also indicate a close-up object on a close-up image, which will not be elaborated here. For example, referring to Figure 16B(a), when the mobile phone detects that the user drags the control 1601 to a certain position on the close-up image and releases it, the subject being photographed at that position is the close-up object; as shown in Figure 16B(b), the close-up image is an image of the close-up object magnified.

[0219] In other embodiments, in the preview state of multi-channel recording mode, when N cameras simultaneously capture images, the mobile phone can also stop displaying images in at least one area according to the user's instruction, or only display images in M ​​areas (M is a positive integer less than N), so as to dynamically display one or more images that the user wants to focus on. The images in the M areas can adaptively fill the entire display interface; or, the M areas can maintain their original layout, with the area where the image display is stopped being a blank area, or displaying a preset background image, or displaying a desktop background, etc.

[0220] For example, referring to Figure 17(a), an "×" control is provided on the area where each image is located. When the phone detects that the user clicks on the "×" control 1701, the phone can display only the image in area 1702 and stop displaying the image in area 1703. Furthermore, as shown in Figure 17(b), the image in area 1701 adaptively fills the entire touchscreen (i.e., fills the entire display area of ​​the touchscreen); or, as shown in Figure 17(c), the size of area 1702 remains unchanged. Specifically, in one case, the phone stops displaying the image in that area, but the camera corresponding to that area continues to capture images; in another case, the phone stops displaying the image in that area, and the camera corresponding to that area stops capturing images.

[0221] As another example, referring to Figure 17(d), if the mobile phone detects that the user drags the image in area 1703 to the boundary and continues to drag, then as shown in Figure 17(b) or (c), the mobile phone stops displaying the image in area 1703.

[0222] In another embodiment, the mobile phone can also hide some controls on the preview interface of the multi-channel recording mode to minimize the obstruction of the preview image by the controls and improve the user's visual experience. For example, when the user clicks control 207 as shown in Figure 2(c), the mobile phone can stop displaying the row of controls such as "Large Aperture," "Video Recording," "Photo Taking," "Multi-channel Recording," and "More"; after detecting the user's touchscreen operation, the hidden controls can be restored. As another example, if the controls on the interface are not clicked by the user within a preset time, the mobile phone can hide the controls on the interface to minimize the obstruction of the preview image by the controls; after detecting the user's touchscreen operation, the hidden controls can be restored.

[0223] In other embodiments, in the preview state of multi-channel recording mode, the user can also adjust parameters such as video resolution, filter effects, and whether to use flash. For example, video resolution refers to the resolution of the entire image displayed on the touchscreen, which corresponds to the aspect ratio of the N regions stitched together. When the image stitched together from the N regions fills the display area of ​​the touchscreen, this resolution corresponds to the aspect ratio of the touchscreen's display area. For instance, when the resolution is 5210×3840, 3968×2976, or 3264×2448, the aspect ratio of the touchscreen display area is 4:3; when the resolution is 3968×1984 or 3264×1632, the aspect ratio is 18:9; when the resolution is 2560×1080 or 1680×720, the aspect ratio is 21:9; and when the resolution is 2976×2976, the aspect ratio is 1:1. For another example, users can set the resolution of images captured by different cameras, and the resolution corresponds to the size ratio of the display area of ​​the image captured by the camera on the interface.

[0224] For example, as shown in Figure 7(a), the multi-channel recording preview interface may include a control 702, through which the user can set different filter effects. For example, the filter effects may include black and white effect, whiteboard effect, tone separation effect, negative effect, etc.

[0225] In the preview state of multi-channel recording mode, after detecting the user's instruction to take a picture, the phone begins recording multiple video streams, displays the shooting interface, and saves the captured video images. This shooting interface can include N images simultaneously captured by N cameras.

[0226] For example, in close-up mode, when the mobile phone detects that the user clicks the shooting control 603 shown in Figure 6A, the shooting interface shown in Figure 18A(a) or (b) can be displayed. The shooting interface includes a panoramic image and a close-up image, as well as a control 1801 for controlling the end of recording and a control 1802 for controlling the pause of recording.

[0227] Specifically, during multi-channel recording, the phone can continue to use the N cameras used in preview mode to capture images and display the images captured simultaneously by the N cameras on the shooting interface using the display style used in preview mode.

[0228] In some embodiments, similar to how users set the camera, display style, or recording mode for multi-channel recording in multi-channel recording preview mode, users can also modify at least one of the camera, display style, or recording mode used for multi-channel recording during multi-channel recording. In one case, the phone can dynamically switch to using at least one of the modified camera, display style, or recording mode to continue recording multi-channel video during the current recording process. That is, the phone continues recording while the user is modifying the camera, display style, or recording mode. In another case, the phone can pause recording while the user is modifying at least one of the camera, display style, or recording mode used for multi-channel recording, and then resume recording after the modification is completed. This recording process includes multi-channel video recorded according to the original camera, display style, or recording mode, and multi-channel video recorded according to the modified camera, display style, or recording mode.

[0229] For example, similar to the multi-channel video preview interface, as shown in Figure 18A, the shooting interface can also display a settings control 1803. After the phone detects the user clicking the settings control 1803, it can display the settings interface shown in Figure 7, allowing the user to easily modify the camera or display style. Again, similar to the multi-channel video preview interface, the shooting interface can display camera settings controls or display style settings controls, which can be used by the user to modify the camera or display style.

[0230] In other embodiments, similar to the multi-channel recording preview interface, the shooting interface may also display switching controls 1804 and 1805. After detecting a user's click on switching control 1804, the phone switches the camera used for capturing panoramic images to either an ultra-wide-angle camera or a wide-angle camera. After detecting a user's click on switching control 1805, the phone switches between close-up mode and front / rear camera mode.

[0231] In other embodiments, similar to the multi-channel recording preview state, during multi-channel recording in close-up mode, the mobile phone can dynamically change the close-up object according to the user's instructions and continue the current video recording based on the changed close-up object. For example, when the focus is on the center area, the close-up object can be changed by moving the mobile phone. In this way, the generated same multi-channel video can include the image of the close-up object before modification and the image of the close-up object after modification.

[0232] In other embodiments, similar to the multi-channel recording preview state, during multi-channel recording in close-up mode, the phone can also change the zoom level of the close-up image according to the user's instructions and continue recording the current video based on the changed zoom level. In this way, the same multi-channel video generated by the phone can include close-up images with different zoom levels.

[0233] Specifically, similar to the preview state of multi-channel recording, the second camera used to provide the close-up image varies depending on the zoom level of the close-up image. For example, similar to the situation shown in Figure 13, when the zoom level of the close-up image is within the range of [second preset value, 1), the second camera can be an ultra-wide-angle camera; when the zoom level of the close-up image is within the range of [1, first preset value), the second camera can be a wide-angle camera; and when the zoom level of the close-up image is greater than or equal to the first preset value, the second camera can be a telephoto camera.

[0234] Similar to the preview state of multi-channel recording, the close-up image can be the central area of ​​the image captured by the second camera, or an image of the central area magnified.

[0235] For example, in the multi-channel recording process shown in Figure 18B(a), the panoramic image comes from the wide-angle camera, the zoom ratio of the close-up image is 2, and the close-up image is a magnified image of the central area of ​​the image captured by the wide-angle camera. If the mobile phone detects the user's click on control 1806, it increases the zoom ratio of the close-up image, that is, magnifies the close-up image. As shown in Figures 18B(b) and (c), the zoom ratio changes from 2 to 5 on the zoom scale 1807. The mobile phone switches to the telephoto camera to capture the close-up image, and the close-up image is the central area of ​​the image captured by the telephoto camera. The magnified close-up image can be seen in Figure 18B(c).

[0236] In other embodiments, similar to the multi-channel recording preview state, during multi-channel recording, the mobile phone can also stop displaying images in at least one area according to the user's instructions, or only display images in M ​​areas (M is an integer less than N), so as to dynamically display the one or several images that the user wants to focus on.

[0237] In another embodiment, similar to the multi-channel video preview state, during multi-channel video recording, the mobile phone can also hide some controls on the shooting interface (such as setting control 1801, large aperture control, etc.) to avoid the preview image being obscured by the controls as much as possible and improve the user's visual experience; after detecting the user's operation of clicking the touch screen or other operations that indicate the display of controls, the hidden controls are then displayed.

[0238] In other embodiments, during multi-channel recording, the mobile phone can also generate photos from the images currently captured by N cameras according to the user's instructions, so that the user can save and retrieve the highlights in a timely manner.

[0239] For example, in the case shown in Figure 18B(a), if the mobile phone detects a double-tap operation by the user on the touchscreen, it saves the currently captured image as a photo. In one case, the photo saved by the mobile phone is the single photo shown in Figure 18C; in another case, the photo saved by the mobile phone is the two photos shown in Figure 18D(a) and (b).

[0240] As another example, in the case shown in Figure 18B(a), if the mobile phone detects a double-tap operation by the user on the panoramic image, it saves the current panoramic image as a photo; if the mobile phone detects a double-tap operation by the user on the close-up image, it saves the current close-up image as a photo.

[0241] After detecting a user's instruction to end the recording, the phone terminates the current video recording and generates multiple video files. For example, the phone stops recording after detecting a user clicking the end control 1801 shown in Figure 18A(a). As shown in Figure 19, thumbnails of the generated video files can be displayed in the area indicated by control 1901. Furthermore, the phone re-enters the preview state for multi-channel recording.

[0242] After a mobile phone starts recording multiple images, it can save the images captured during the recording process, as well as the multiple video files generated after the recording ends.

[0243] In some embodiments, a mobile phone can combine multiple frames of images captured by N cameras at the same time into a single video image and save the combined video image, thereby saving multiple videos recorded by N cameras into a single video file.

[0244] In other embodiments, the mobile phone can associate multiple frames of images captured by N cameras at the same time, and save each image captured by each camera as a separate video file.

[0245] In other embodiments, the N cameras have the same image capture frame rate, and the mobile phone can save the image captured by each of the N cameras as a separate video file. Each video file has the same number of image frames, and the N video files corresponding to the N cameras are associated with each other.

[0246] Specifically, for images captured by the camera, the mobile phone can also perform ISP processing, video post-processing, video encoding, and other processing before generating video files.

[0247] In some embodiments, the thumbnails of generated multi-channel video files can be displayed in the display style adopted when recording began. In other embodiments, the mobile phone can mark the saved multi-channel video files to facilitate user identification that the video file records multi-channel video. For example, referring to Figure 20(a), the thumbnail 2001 of the multi-channel video file displays a label 2002. In other embodiments, the mobile phone can store the generated multi-channel video files separately in a specific folder to facilitate user management and retrieval of the multi-channel video files. Furthermore, as shown in Figures 20(b) and (c), when the mobile phone detects that a user is viewing the attributes of a multi-channel video file, it can display parameter information of the multi-channel video, such as the camera used when recording the multi-channel video, the display style, or other video files associated with the current video file. If the user changes the camera during recording, the parameter information can also include the correspondence between the recording time and the camera before and after the change. If the user changes the display style during recording, the parameter information can also include the correspondence between the recording time and the display style before and after the change.

[0248] After capturing multiple video files, the phone can play back the captured videos.

[0249] The phone can play multiple videos based on the specific details of the generated video files. For example, corresponding to the aforementioned saving of multiple video files, if a video file is a composite image file generated from multiple images (i.e., each frame in the video file includes N sub-images, each from one of the N cameras), the phone can directly play the composite image frame. If a video file includes multiple frames simultaneously captured by different related cameras, the phone will display these related frames on the same screen according to its display style when playing multiple videos. If multiple video files are related, the phone will play multiple videos based on these related video files.

[0250] In some embodiments, when playing multiple videos, the mobile phone can use the same display style as during recording to play the video images. For example, after the mobile phone detects that the user clicks on the playback control 2003 shown in Figure 20(b), it can play multiple videos and display the playback interface shown in Figure 21.

[0251] In other embodiments, when playing multiple videos, the mobile phone can also play video images according to a display style set by the user that differs from the recording process. For example, the user can set the display style through the interface shown in Figure 7. If the number of regions n1 (positive integer) included in the user-set display style is less than the number of regions n2 (positive integer) included in the display style during recording, the mobile phone will only display n1 images during playback. If the number of regions n1 included in the user-set display style is greater than the number of regions n2 included in the display style during recording, the mobile phone will only display n2 images during playback; the remaining n1-n2 regions will be blank, display the desktop background, or repeatedly display (n1-n2) images from the n2 regions.

[0252] In other embodiments, when playing multiple videos, the mobile phone can also stop displaying images in one or more areas, or only display images in one or more areas, according to the user's instructions.

[0253] In other embodiments, when playing multiple videos, the mobile phone can also save the currently displayed image as a photo according to the user's instructions, so that the user can extract and share the wonderful moments.

[0254] Furthermore, in some other embodiments, during multi-channel recording, the mobile phone can use N cameras to capture images, displaying only one image by default, but generating video files corresponding to the N cameras' multi-channel recordings. The mobile phone can then play these multi-channel videos according to a preset display style or a user-defined display style. For example, in front and rear camera mode, the mobile phone defaults to displaying only the rear camera image on the entire touchscreen so that the user can more clearly see the recording behind the phone, but the generated video includes both the rear and front camera images.

[0255] In some other embodiments, when recording a single video stream in recording mode (i.e., single-channel recording mode), if the phone detects that the user has clicked the "multi-channel recording" control, the phone enters multi-channel recording mode and continues the recording process. Similarly, when recording multiple videos in multi-channel recording mode (e.g., as shown in Figure 18A), if the phone detects that the user has clicked the "record" control, the phone enters multi-channel recording mode and continues the recording process. That is, after recording is complete, the video obtained by the phone may include a portion of the single-channel video and another portion of the multi-channel video.

[0256] In some embodiments, during the preview or recording process of multi-channel recording, the N images captured by the N cameras simultaneously displayed on the mobile phone interface can be images captured by the N cameras at the same time. In other embodiments, the N images captured by the N cameras simultaneously displayed on the mobile phone interface can also be images captured by the N cameras within the same period T. For example, the N cameras are a wide-angle camera and a telephoto camera, which capture images according to a preset period T. Within the same period T, the wide-angle camera first captures image 1, and then the telephoto camera captures image 2. The images displayed on the mobile phone interface include image 1 and image 2. When saving the captured images, the images captured by the N cameras within the same period are correlated and can be synthesized into a single video frame for storage.

[0257] The above embodiments illustrate multi-channel video recording using N cameras on a mobile phone. In other embodiments, the mobile phone can also take multiple photos using N cameras, thereby recording images of different ranges or different resolutions at the same time or in the same scene, or recording images of the photographer and the subject at the same time or in the same scene. Similar to multi-channel video recording, the mobile phone can simultaneously display and save the multiple images captured by the N cameras on the interface according to the display style, which will not be elaborated here. For example, the photo preview interface of the multi-channel photo mode can be seen in Figure 22.

[0258] In conjunction with the above embodiments and corresponding drawings, another embodiment of this application provides a multi-channel recording method, which can be implemented on an electronic device having the structure shown in FIG1. ​​The electronic device may include a display screen and multiple cameras. Referring to FIG23, the method may include:

[0259] 2301. Electronic device starts camera.

[0260] For example, an electronic device can activate the camera after detecting that a user clicks on control 201 shown in Figure 2(a).

[0261] 2302. Electronic devices use a first camera and a second camera among multiple cameras to capture images. The first camera is a rear wide-angle camera or a rear ultra-wide-angle camera, and the second camera is a wide-angle camera, an ultra-wide-angle camera, or a rear telephoto camera.

[0262] 2303. An electronic device displays a preview interface, which includes a first image and a second image; the first image is an image captured by a first camera, the second image is from a second camera, and the second image corresponds to the central area of ​​the image captured by the second camera; wherein, the first image is located in the first area of ​​the preview interface, and the second image is located in the second area of ​​the preview interface.

[0263] Specifically, the second image can be the central area of ​​the image captured by the second camera, or the second image can be a magnified image of the central area of ​​the image captured by the second camera.

[0264] For example, the preview interface can be the interface shown in Figure 2(c), Figure 6A, Figure 6B, etc. The first object can be a little girl jumping. The first area can be area 205 shown in Figure 2(c), and the second area can be area 206 shown in Figure 2(c). The first image can be a panoramic image displayed in the first area; the second image can be a close-up image displayed in the second area, and the close-up image is an image of the little girl jumping.

[0265] 2304. After detecting a user's instruction to record, the electronic device begins recording video.

[0266] For example, after detecting that a user clicks the shooting control 603 shown in Figure 6A, the electronic device can determine that the user has instructed to record video, and thus start recording video.

[0267] 2305. An electronic device displays a shooting interface, which includes the first area and the second area.

[0268] For example, the shooting interface can be the interface shown in Figure 18A or Figure 18B. The panoramic image on the shooting interface is in the first area, and the close-up image is in the second area.

[0269] In the scheme described in steps 2301-2305, the electronic device can simultaneously record images using telephoto cameras with different field of view, as well as wide-angle or ultra-wide-angle cameras, to obtain panoramic and close-up images of different ranges and magnifications at the same time or in the same scene, presenting users with richer image information.

[0270] Since users typically place the focus or key object of interest in the center of the field of view, the image of the focus or key object is usually presented in the center area of ​​the image captured by the second camera. In this embodiment, when the close-up image is in the center area of ​​the image captured by the second camera, a close-up view of the focus or key object can be presented to the user, thereby providing the user with detailed information about the focus or key object.

[0271] In some embodiments, the size ratio of the first region is equal to the output image ratio of the photosensitive element of the first camera, thereby ensuring that the panoramic image has the maximum field of view. Furthermore, the area formed by stitching the first and second regions fills the display area of ​​the screen. This maximizes the utilization of the display screen to present images to the user.

[0272] In other embodiments, the preview interface includes a first control, and the method may further include:

[0273] 2306. After detecting a user's operation on the first control, if the first image displayed in the first area is an image captured by a wide-angle camera, the electronic device switches the first image to an image captured by an ultra-wide-angle camera.

[0274] 2307. After detecting a user's operation on the first control, if the first image displayed in the first area is an image captured by an ultra-wide-angle camera, the electronic device switches the first image to an image captured by a wide-angle camera.

[0275] For example, the first control can be control 601 as shown in Figure 6A. The first image captured by the wide-angle camera can be the panoramic image shown in Figure 6A, and the first image captured by the ultra-wide-angle camera can be the panoramic image shown in Figure 6E.

[0276] In other embodiments, the preview interface includes a second control, and the method may further include:

[0277] 2308. The electronic device includes multiple cameras, including a front-facing camera. After detecting the user's operation on the second control, the electronic device switches the second image displayed in the second area to the image captured by the front-facing camera.

[0278] For example, the second control can be control 602 as shown in FIG. 6A. The second image displayed in the second area can be the close-up image shown in FIG. 6A. The image captured by the front-facing camera displayed in the second area can be the front-facing image shown in FIG. 6C.

[0279] 2309. If the electronic device detects the user's operation on the second control again, the image captured by the front-facing camera displayed in the second area will be switched to the second image.

[0280] In other embodiments, prior to step 2303, the method may further include:

[0281] 2310. The electronic device performs image stabilization processing on the images captured by the first camera and the second camera respectively.

[0282] In this way, electronic devices can obtain a clear image through image stabilization before displaying it.

[0283] In other embodiments, the method may further include:

[0284] 2311. After detecting a user's preset operation, the electronic device adjusts the video resolution, which corresponds to the size ratio of the area formed by splicing the first and second areas.

[0285] For details regarding video resolution, please refer to the relevant descriptions in the above embodiments; they will not be repeated here.

[0286] In other embodiments, the shooting interface includes a third control, and the method may further include:

[0287] 2312. After detecting the user's operation on the third control, the electronic device adjusts the zoom level of the second image in the second area.

[0288] Specifically, if the adjusted zoom ratio is equal to 1, the second camera is a wide-angle camera, and the second image is the central area of ​​the image captured by the wide-angle camera. If the adjusted zoom ratio is greater than 1 and less than a first preset value, the second camera is a wide-angle camera, and the second image is a magnified version of the central area of ​​the image captured by the wide-angle camera. If the adjusted zoom ratio is equal to the first preset value, the second camera is a telephoto camera, and the second image is the central area of ​​the image captured by the telephoto camera. If the adjusted zoom ratio is greater than the first preset value, the second camera is a telephoto camera, and the second image is a magnified version of the central area of ​​the image captured by the telephoto camera. If the adjusted zoom ratio is less than 1 and greater than the second preset value, the second camera is an ultra-wide-angle camera, and the second image is a magnified version of the central area of ​​the image captured by the ultra-wide-angle camera. If the adjusted zoom ratio is equal to the second preset value, the second camera is an ultra-wide-angle camera, and the second image is the central area of ​​the image captured by the ultra-wide-angle camera.

[0289] In other words, electronic devices can switch between a wide-angle camera, a telephoto camera, or an ultra-wide-angle camera depending on the zoom level.

[0290] For example, the third control may be control 1806 shown in (a) of Figure 18B, and / or control 1807 shown in (b) of Figure 18B, etc.

[0291] 2313. The electronic device displays a second image in the second area according to the adjusted zoom level.

[0292] For example, during video recording, the effect of adjusting the zoom level can be seen in the close-up image shown in Figure 18B; similarly, in preview mode, the effect of adjusting the zoom level can be seen in the close-up image shown in Figure 13.

[0293] In other embodiments, the method may further include:

[0294] 2314. Electronic devices stop recording video after detecting a user instruction to end the operation.

[0295] For example, the electronic device stops the recording process of the current video after detecting that the user clicks the end control 1801 shown in Figure 18A(a).

[0296] 2315. Electronic devices generate video files.

[0297] In some embodiments, each frame of the video file includes a first sub-image and a second sub-image, wherein the first sub-image is a first image and the second sub-image is a second image or an image captured by a front-facing camera among multiple cameras.

[0298] In some other embodiments, prior to step 2303, the electronic device may stitch together the first sub-image and the second sub-image before displaying them.

[0299] After stitching together the sub-images, the electronic device can perform encoding and other processing via an encoder before generating a video file.

[0300] 2316. After detecting a user's playback operation on a video file, the electronic device displays a playback interface, which includes a first area and a second area.

[0301] For example, the playback interface can be as shown in Figure 22, where the first area displays images of a little boy, a little girl, a car, and a dog, and the second area displays an enlarged image of the little girl.

[0302] It should be noted that the above description mainly uses the example of displaying the rear panoramic image on the left side of the interface, and the rear close-up image and the front image on the right side of the interface. This application does not specifically limit the display positions of the rear panoramic image, rear close-up image, and front image. For example, the rear panoramic image can also be displayed on the right side of the interface, and the rear close-up image and the front image can also be displayed on the left side of the interface.

[0303] Another embodiment of this application provides an electronic device, including: one or more cameras for capturing images; one or more displays for displaying an interface; one or more processors; one or more memories; and one or more computer programs; wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions; when the instructions are executed by the processor, the electronic device performs the multi-channel recording method described above.

[0304] For example, when the electronic device is a mobile phone as shown in FIG1, the processor in the electronic device can be processor 110 in FIG1, the memory can be internal memory 121 in FIG1, the display screen can be display screen 194 in FIG1, and the N cameras can be camera 193 in FIG1. ​​One or more computer programs are stored in internal memory 121, and the one or more computer programs include instructions; when the instructions are executed by processor 110, the mobile phone performs the multi-channel recording method in the above embodiment.

[0305] This application also provides a computer storage medium storing computer instructions. When the computer instructions are executed on an electronic device, the electronic device performs the aforementioned steps to implement the multi-channel recording method described above.

[0306] This application also provides a computer program product that, when run on a computer, causes the computer to perform the aforementioned steps to implement the multi-channel recording method described above.

[0307] In addition, embodiments of this application also provide an apparatus, which may specifically be a chip, component or module. The apparatus may include a connected processor and a memory. The memory is used to store computer execution instructions. When the apparatus is running, the processor can execute the computer execution instructions stored in the memory to cause the chip to execute the multi-channel recording method in the above method embodiments.

[0308] In this application, the electronic devices, computer storage media, computer program products or chips provided in the embodiments are all used to execute the relevant methods provided above. Therefore, the beneficial effects they can achieve can be referred to the beneficial effects in the corresponding methods provided above, and will not be repeated here.

[0309] Through the above description of the embodiments, those skilled in the art can clearly understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0310] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another device, or some features may be ignored or not executed. Furthermore, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.

[0311] The units described as separate components may or may not be physically separate. A component shown as a unit can be one or more physical units; that is, it can be located in one place or distributed in multiple different locations. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0312] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0313] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solutions of the embodiments of this application, essentially or in other words, the parts that contribute to the prior art, or all or part of the technical solutions, can be embodied in the form of a software product. This software product is stored in a storage medium and includes several instructions to cause a device (which may be a microcontroller, chip, etc.) or processor to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0314] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A video recording method, applied to an electronic device having a display screen and multiple cameras, characterized in that, The method includes: The electronic device activates the camera; The electronic device uses a first camera and a second camera among the plurality of cameras to capture images. The first camera is a rear wide-angle camera or a rear ultra-wide-angle camera; the second camera is the wide-angle camera, the ultra-wide-angle camera, or a rear telephoto camera. The electronic device displays a preview interface, which includes a first image and a second image. The first image is an image captured by the first camera, and the second image is from the second camera, with the second image corresponding to the central area of ​​the image captured by the second camera. The first image is located in a first area of ​​the preview interface, and the second image is located in a second area of ​​the preview interface. The electronic device begins recording video after detecting a user's instruction to record. The electronic device displays a shooting interface, which includes the first area and the second area.

2. The method according to claim 1, characterized in that, The second image is the central region of the image captured by the second camera, or the second image is a magnified image of the central region of the image captured by the second camera.

3. The method according to claim 1 or 2, characterized in that, The size ratio of the first region is equal to the image output ratio of the photosensitive element of the first camera; and the area formed by splicing the first region and the second region fills the display area of ​​the display screen.

4. The method according to any one of claims 1-3, characterized in that, The preview interface includes a first control, and the method further includes: After detecting a user's operation on the first control, if the first image displayed in the first area is an image captured by the wide-angle camera, the electronic device will switch the first image to an image captured by the ultra-wide-angle camera. If the first image displayed in the first area is an image captured by the ultra-wide-angle camera, then the electronic device will switch the first image to an image captured by the wide-angle camera.

5. The method according to any one of claims 1-4, characterized in that, The plurality of cameras also includes a front-facing camera, the preview interface includes a second control, and the method further includes: After detecting the user's operation on the second control, the electronic device switches the second image displayed in the second area to the image captured by the front-facing camera; If the electronic device detects the user's operation on the second control again, it will switch the image captured by the front-facing camera displayed in the second area to the second image.

6. The method according to any one of claims 1-5, characterized in that, Before the electronic device displays the preview interface, the method further includes: The electronic device performs image stabilization processing on the images captured by the first camera and the second camera, respectively.

7. The method according to any one of claims 1-6, characterized in that, The method further includes: After detecting a user's preset operation, the electronic device adjusts the video resolution; the video resolution corresponds to the size ratio of the area formed by stitching together the first area and the second area.

8. The method according to any one of claims 1-7, characterized in that, The shooting interface includes a third control; the method further includes: After detecting the user's operation on the third control, the electronic device adjusts the zoom ratio of the second image in the second area of ​​the shooting interface; If the adjusted zoom ratio is equal to 1, then the second camera is the wide-angle camera, and the second image is the central region of the image captured by the wide-angle camera; If the adjusted zoom ratio is greater than 1 and less than the first preset value, then the second camera is the wide-angle camera, and the second image is the magnified image of the central area of ​​the image captured by the wide-angle camera; If the adjusted zoom ratio is equal to the first preset value, then the second camera is the telephoto camera, and the second image is the central region of the image captured by the telephoto camera. If the adjusted zoom ratio is greater than the first preset value, then the second camera is the telephoto camera, and the second image is the magnified image of the central area of ​​the image captured by the telephoto camera; If the adjusted zoom ratio is less than 1 and greater than the second preset value, then the second camera is the ultra-wide-angle camera, and the second image is the magnified image of the central area of ​​the image captured by the ultra-wide-angle camera; If the adjusted zoom ratio is equal to the second preset value, then the second camera is the ultra-wide-angle camera, and the second image is the central region of the image captured by the ultra-wide-angle camera; The electronic device displays the second image in the second area according to the adjusted zoom level.

9. The method according to any one of claims 1-8, characterized in that, The method further includes: The electronic device stops recording video after detecting a user instruction to end the recording. The electronic device generates video files; After detecting a user's playback operation on the video file, the electronic device displays a playback interface, which includes the first area and the second area.

10. The method according to claim 9, characterized in that, Each frame of the video file includes a first sub-image and a second sub-image, wherein the first sub-image is the first image and the second sub-image is the second image or an image captured by the front-facing camera among the plurality of cameras.

11. An electronic device, characterized in that, include: Multiple cameras are used to capture images; One or more displays for displaying the interface; One or more processors; One or more memory units; and one or more computer programs; wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions; when the instructions are executed by the processor, the electronic device performs the following steps: Start the camera; Images are captured using a first camera and a second camera among the plurality of cameras. The first camera is a rear wide-angle camera or a rear ultra-wide-angle camera; the second camera is the wide-angle camera, the ultra-wide-angle camera, or a rear telephoto camera. The preview interface includes a first image and a second image; the first image is an image captured by the first camera, and the second image is from the second camera, and the second image corresponds to the central area of ​​the image captured by the second camera; wherein, the first image is located in the first area of ​​the preview interface, and the second image is located in the second area of ​​the preview interface; After detecting the user's instruction to record, video recording begins; The shooting interface is displayed, which includes the first area and the second area.

12. The electronic device according to claim 11, characterized in that, The second image is the central region of the image captured by the second camera, or the second image is a magnified image of the central region of the image captured by the second camera.

13. The electronic device according to claim 11 or 12, characterized in that, The size ratio of the first region is equal to the image output ratio of the photosensitive element of the first camera; and the area formed by splicing the first region and the second region fills the display area of ​​the display screen.

14. The electronic device according to any one of claims 11-13, characterized in that, The preview interface includes a first control; when the instruction is executed by the processor, the electronic device also performs the following steps: After detecting the user's operation on the first control, if the first image displayed in the first area is an image captured by the wide-angle camera, then the first image is switched to an image captured by the ultra-wide-angle camera; If the first image displayed in the first area is an image captured by the ultra-wide-angle camera, then the first image is switched to an image captured by the wide-angle camera.

15. The electronic device according to any one of claims 11-14, characterized in that, The plurality of cameras also includes a front-facing camera, and the preview interface includes a second control; when the instruction is executed by the processor, the electronic device also performs the following steps: After detecting the user's operation on the second control, the second image displayed in the second area is switched to the image captured by the front camera; If user interaction with the second control is detected again, the image captured by the front-facing camera displayed in the second area will be switched to the second image.

16. The electronic device according to any one of claims 11-15, characterized in that, When the instruction is executed by the processor, the electronic device also performs the following steps: Before displaying the preview interface, the images captured by the first camera and the second camera are subjected to image stabilization processing respectively.

17. The electronic device according to any one of claims 11-16, characterized in that, When the instruction is executed by the processor, the electronic device also performs the following steps: After detecting a user's preset operation, the video resolution is adjusted; the video resolution corresponds to the size ratio of the area formed by stitching the first area and the second area together.

18. The electronic device according to any one of claims 11-17, characterized in that, The shooting interface includes a third control, which, when executed by the processor, also causes the electronic device to perform the following steps: After detecting the user's operation on the third control, the zoom ratio of the second image in the second area of ​​the shooting interface is adjusted; If the adjusted zoom ratio is equal to 1, then the second camera is the wide-angle camera, and the second image is the central region of the image captured by the wide-angle camera; If the adjusted zoom ratio is greater than 1 and less than the first preset value, then the second camera is the wide-angle camera, and the second image is the magnified image of the central area of ​​the image captured by the wide-angle camera; If the adjusted zoom ratio is equal to the first preset value, then the second camera is the telephoto camera, and the second image is the central region of the image captured by the telephoto camera. If the adjusted zoom ratio is greater than the first preset value, then the second camera is the telephoto camera, and the second image is the magnified image of the central area of ​​the image captured by the telephoto camera; If the adjusted zoom ratio is less than 1 and greater than the second preset value, then the second camera is the ultra-wide-angle camera, and the second image is the magnified image of the central area of ​​the image captured by the ultra-wide-angle camera; If the adjusted zoom ratio is equal to the second preset value, then the second camera is the ultra-wide-angle camera, and the second image is the central region of the image captured by the ultra-wide-angle camera; The second image is displayed in the second area according to the adjusted zoom level.

19. The electronic device according to any one of claims 11-18, characterized in that, When the instruction is executed by the processor, the electronic device also performs the following steps: Video recording stops after the user indicates that the action has ended; Generate video file; After detecting a user's playback operation on the video file, a playback interface is displayed, which includes the first area and the second area.

20. The electronic device according to claim 19, characterized in that, Each frame of the video file includes a first sub-image and a second sub-image, wherein the first sub-image is the first image and the second sub-image is the second image or an image captured by the front-facing camera among the plurality of cameras.

21. A computer storage medium, characterized in that, It includes computer instructions, which, when executed on an electronic device, cause the electronic device to perform the recording method as described in any one of claims 1-10.

22. A computer program product, characterized in that, When the computer program product is run on a computer, the computer performs the recording method as described in any one of claims 1-10.

Images