Device for multi-channel video recording

The multi-channel video recording method and apparatus on electronic devices with multiple camera lenses addresses the limitation of existing methods by simultaneously capturing and displaying panoramic and close-up images, providing a more comprehensive view of a scene with enhanced image information.

DE202020006070U1Active Publication Date: 2024-11-07HONOR DEVICE CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
DE202020006070
Authority / Receiving Office
DE · DE
Patent Type
Utility models
Current Assignee / Owner
Priority Date
2019-03-18
Filing Date
2020-02-24
Publication Date
2024-11-07
Estimated Expiration
2030-02-28

AI Technical Summary

Technical Problem

Existing video recording methods on electronic devices with multiple camera lenses do not effectively utilize the capabilities of multiple lenses to provide a comprehensive view of a scene, often limiting the amount of image information captured and presented to the user.

Method used

A multi-channel video recording method and apparatus that utilizes multiple camera lenses, including rear-facing wide-angle, ultra-wide-angle, and large focal length lenses, to simultaneously capture and display panoramic and close-up images, allowing for a larger amount of image information by switching between different camera lenses based on user input and displaying them in a spliced or overlaid manner on a single screen.

Benefits of technology

Enables the capture and display of a panoramic image with detailed close-up information, providing a more comprehensive view of a scene by utilizing the unique fields of view of multiple lenses, enhancing user experience with clearer and more detailed image presentation.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

An electronic device comprising: a plurality of cameras designed to take a picture; one or more display screens designed to display an interface; one or more processors; one or more memories; and one or more computer programs, wherein the one or more computer programs are stored in the memory and the one or more computer programs contain an instruction; wherein, when the instruction is executed by the processor, the electronic device is capable of performing the following steps: Starting a camera application; Capturing images using a first camera and a second camera from a plurality of cameras, wherein the first camera is a rear-facing wide-angle camera or a rear-facing ultra-wide-angle camera, and the second camera is the wide-angle camera, the ultra-wide-angle camera, or a rear-facing long-focus camera; Displaying a preview interface of the camera application, wherein the preview interface comprises a first image and a second image; the first image is an image captured by the first camera, the second image is from the second camera, and the second image corresponds to a central area of ​​an image captured by the second camera; and the first image is arranged in a first area of ​​the preview interface and the second image is arranged in a second area of ​​the preview interface; Starting a video recording after detecting a video recording instruction activation; and Displaying a recording screen, wherein the recording screen includes the first area and the second area.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This application claims priority over Chinese patent application No. 201910205090.0, filed with the Chinese Patent Office on March 18, 2019, entitled “MULTI-CHANNEL VIDEO RECORDING METHOD AND DEVICE”, which is incorporated herein by reference in full. TECHNICAL AREA

[0002] Embodiments of this application relate to the field of electronic technologies and in particular to a multi-channel video recording method and device. BACKGROUND

[0003] As part of the development of electronic technologies, a user can take various photos and videos by using a camera lens of an electronic device, such as a mobile phone or tablet computer, to capture beautiful images, such as wonderful moments and moving scenes. SUMMARY

[0004] Embodiments of this application provide a multi-channel video recording method and device such that a plurality of video channels can be recorded simultaneously using a plurality of camera lenses in order to obtain a plurality of video image channels and a larger amount of image information.

[0005] To achieve the aforementioned objective, the following technical solutions are used in the embodiments of this application:

[0006] According to one aspect, an embodiment of this application provides a video recording method applied to an electronic device with a display screen and a plurality of camera lenses, the method comprising: starting a camera by the electronic device; then capturing images by the electronic device using a first camera lens and a second camera lens from the plurality of camera lenses, wherein the first camera lens is a rear-facing wide-angle camera lens or a rear-facing ultra-wide-angle camera lens, and the second camera lens is the wide-angle camera lens, the ultra-wide-angle camera lens, or a rear-facing camera lens with a long focal length; displaying a preview interface by the electronic device, wherein the preview interface contains a first image and a second image;the first image is an image captured by the first camera lens, the second image is from the second camera lens and corresponds to a central area of ​​an image captured by the second camera lens; wherein the first image is arranged in a first area in the preview interface and the second image is arranged in a second area in the preview interface; starting a video recording by the electronic device after detecting a video recording instruction from a user; and displaying a recording screen by the electronic device, wherein the recording screen comprises the first area and the second area.

[0007] With this solution, the electronic device can simultaneously capture images using the long focal length lens and the wide-angle or ultra-wide-angle lens, which have different fields of view, to obtain a panoramic image and a close-up image corresponding to different areas and zoom levels at the same moment or in the same scene, thus presenting the user with a greater amount of image information. If the second image in the second area is the central area captured by the second camera lens, the user can also be presented with a close-up image of an object to be focused on or a key object, providing detailed information about the object to be focused on or the key object.

[0008] In one possible embodiment, the second image is the central area of ​​the image captured by the second camera lens, or the second image is an enlarged image of the central area of ​​the image captured by the second camera lens.

[0009] In other words, the second image comes from the second camera lens by being taken by the second camera lens.

[0010] In another possible embodiment, the aspect ratio of the first area is equal to the image output ratio of a light-sensitive element of the first camera lens, wherein an area formed after splicing the first and second images completely occupies a display area of ​​the display screen.

[0011] This ensures that the first image has the maximum field of view. Furthermore, the display screen can be used to its fullest extent to present the images to the user.

[0012] In another possible embodiment, the preview interface includes a first control element, the method further comprising: after the electronic device has detected an actuation performed by the user on the first control element, if the first image displayed in the first area is an image captured by the wide-angle camera lens, switching, by the electronic device, of the first image to an image captured by the ultra-wide-angle camera lens; and if the first image displayed in the first area is an image captured by the ultra-wide-angle camera lens, switching, by the electronic device, of the first image to an image captured by the wide-angle camera lens.

[0013] In this way, the electronic device can switch the first camera lens between the ultra-wide-angle camera lens and the wide-angle camera lens based on an operation performed by the user on the first control element.

[0014] In another possible embodiment, the plurality of camera lenses further comprise a forward-facing camera lens, the preview interface comprises a second control element, and the method further comprises: after detecting an actuation performed by the user on the second control element, switching, by the electronic device, the second image displayed in the second area to an image captured by the forward-facing camera lens; and when another actuation performed by the user on the second control element is detected, switching, by the electronic device, the image captured by the forward-facing camera lens and displayed in the second area to the second image.

[0015] In this way, based on an actuation performed by the user on the second control element, the electronic device can switch the image in the second area to the rear-facing second camera lens or the front-facing camera lens, i.e., between a rear close-up mode and a front-back mode.

[0016] In another possible embodiment, the method further comprises, prior to displaying a preview interface by the electronic device, performing image stabilization processing on each image captured by the first camera lens and the second camera lens.

[0017] In this way, the electronic device can obtain a clear image through image stabilization processing and then display the clear image.

[0018] In another possible embodiment, the method further comprises: setting, by the electronic device, a video resolution after detecting a preset user action, wherein the video resolution corresponds to an aspect ratio of the area formed after splicing the first and second areas.

[0019] In other words, if the area formed after splicing the first and second areas completely occupies the display area of ​​the screen, then setting a resolution of the screen by the user is equivalent to setting the aspect ratio of the area formed after splicing.

[0020] In another possible embodiment, the recording screen includes a third control element, the method further comprising: setting, by the electronic device, a zoom factor of the second image in the second area after detecting an actuation by the user on the third control element, wherein, if a set zoom factor is equal to 1, the second camera lens is the wide-angle camera lens and the second image is a central area of ​​the image captured by the wide-angle camera lens; or if a set zoom factor is greater than 1 and less than a first preset value, the second camera lens is the wide-angle camera lens and the second image is a magnified image of a central area of ​​the image captured by the wide-angle camera lens;or if a set zoom factor is equal to the first preset value, the second camera lens is the long focal length camera lens, and the second image is a central area of ​​an image captured by the long focal length camera lens; or if a set zoom factor is greater than the first preset value, the second camera lens is the long focal length camera lens, and the second image is a magnified image of a central area of ​​an image captured by the long focal length camera lens; or if a set zoom factor is less than 1 and greater than a second preset value, the second camera lens is the ultra-wide-angle camera lens, and the second image is a magnified image of a central area of ​​the image captured by the ultra-wide-angle camera lens;or, if a set zoom factor is equal to the second preset value, the second camera lens is the ultra-wide-angle camera lens and the second image is a central area of ​​the image captured by the ultra-wide-angle camera lens; and, by means of the electronic device, displaying the second image in the second area based on the set zoom factor.

[0021] In other words, the electronic device can switch the second camera lens to the wide-angle camera lens, the long focal length camera lens, or the ultra-wide-angle camera lens based on different zoom factors.

[0022] In another possible embodiment, the method further comprises: terminating the video recording by the electronic device after detecting a termination instruction from the user; generating a video file by the electronic device; and displaying a playback interface by the electronic device after detecting a playback operation performed by the user on the video file, wherein the playback interface comprises the first area and the second area.

[0023] In this way, the electronic device can continue to play back a plurality of channels of recorded video and simultaneously play back a plurality of images in a plurality of areas in the playback interface.

[0024] In another possible embodiment, each frame in the video file contains a first partial frame and a second partial frame, wherein the first partial frame is the first frame and the second partial frame is the second frame or the frame captured by the forward-facing camera lens of the plurality of camera lenses.

[0025] In other words, the image in the video file is an image that is obtained after the first image and the second image have been combined (for example, spliced).

[0026] In another possible embodiment, the electronic device can generate a first photo when displaying the preview interface or the capture screen, after detecting a photo generation instruction actuation from the user, wherein the first photo contains the image in the first area and the image in the second area.

[0027] In another possible embodiment, when displaying the preview interface or the recording screen, after detecting an actuation performed by the user to specify a close-up object, the electronic device can display the second image in the second area based on the close-up object specified by the user.

[0028] According to another aspect, an embodiment of this application provides a photography method applied to an electronic device having a screen and a plurality of camera lenses, the method comprising: starting a camera by the electronic device; then capturing images by the electronic device using a first camera lens and a second camera lens from the plurality of camera lenses, wherein the first camera lens is a rear-facing wide-angle camera lens or a rear-facing ultra-wide-angle camera lens, and the second camera lens is the wide-angle camera lens, the ultra-wide-angle camera lens, or a rear-facing camera lens with a long focal length; displaying a preview interface by the electronic device, wherein the preview interface contains a first image and a second image;the first image is an image captured by the first camera lens, the second image is from the second camera lens and corresponds to a central area of ​​an image captured by the second camera lens; and the first image is arranged in a first area in the preview interface and the second image is arranged in a second area in the preview interface; and after capturing a user's photography instruction actuation, the electronic device stores an image in a current interface to produce a photograph, the photograph containing the first image and the second image.

[0029] According to a further aspect, one embodiment of this application provides a video recording device. The device is contained in an electronic device, and the device has a function for implementing the behavior of the electronic device in any method according to the foregoing aspects and possible implementations. The function can be implemented by hardware, or it can be implemented by hardware by executing appropriate software. The hardware or the software comprises at least one module or unit corresponding to the function, for example, a start module or start unit, a capture module or capture unit, a display module or display unit, or a processing module or processing unit.

[0030] According to a further aspect, an embodiment of this application provides an electronic device comprising one or more camera lenses configured to capture an image; one or more display screens configured to display an interface; one or more processors; one or more memories; and one or more computer programs, wherein the one or more computer programs are stored in the memory and the one or more computer programs contain an instruction; wherein, when the instruction is executed by the processor, the electronic device is enabled to perform the video recording method in any possible implementation of the previous aspect.

[0031] According to another aspect, an embodiment of this application provides a computer storage medium containing a computer instruction, wherein, when the computer instruction is executed on an electronic device, the electronic device is enabled to perform the video recording method in any possible implementation of the previous aspect.

[0032] According to another aspect, an embodiment of this application provides for a computer program product wherein, when the computer program product is executed on a computer, the computer is enabled to perform the video recording method in any possible implementation of the previous aspect. BRIEF DESCRIPTION OF THE DRAWINGS Fig. Figure 1 is a schematic structure diagram of an electronic device according to an embodiment of this application; Fig. 2(a), Fig. 2(b) and Fig. 2(c) are schematic diagrams of a group of interfaces according to an embodiment of this application; Fig. 3(a), Fig. 3(b) and Fig. 3(c) are schematic diagrams of another group of interfaces according to an embodiment of this application; Fig. 4A is a schematic diagram of an interface according to an embodiment of the present application; Fig. 4B is a schematic diagram of another interface according to an embodiment of this application; Fig. 4C is a schematic operating diagram according to an embodiment of this application; Fig. Figure 5A is a schematic diagram of a group of representations according to an embodiment of this application; Fig. 5B is a schematic diagram of another group of representations according to an embodiment of this application; Fig. 5C is a schematic diagram of another group of representations according to an embodiment of this application; Fig. 6A is a schematic diagram of another interface according to an embodiment of this application; Fig. Figure 6B is a schematic diagram of another interface according to an embodiment of this application; Fig. Figure 6C is a schematic diagram of another interface according to an embodiment of this application; Fig. 6D is a schematic diagram of another interface according to an embodiment of this application; Fig. Figure 6E is a schematic diagram of another interface according to an embodiment of this application; Fig. 7(a) and Fig. 7(b) are schematic diagrams of another group of interfaces according to an embodiment of this application; Fig. 8(a), Fig. 8(b) and Fig. 8(c) are schematic diagrams of another group of interfaces according to an embodiment of this application; Fig. 9A is a schematic diagram of another interface according to an embodiment of this application; Fig. Figure 9B is a schematic diagram of another interface according to an embodiment of this application; Fig. 10(a), Fig. 10(b) and Fig. 10(c) are schematic diagrams of another group of interfaces according to an embodiment of this application; Fig. 11(a) and Fig. 11(b) are schematic diagrams of another group of interfaces according to an embodiment of this application; Fig. 12A is a schematic diagram of another interface according to an embodiment of this application; Fig. 12B is a schematic diagram of another interface according to an embodiment of this application; Fig. 13(a), Fig. 13(b), Fig. 13(c) and Fig. 13(d) are schematic diagrams of another group of interfaces according to an embodiment of this application; Fig. Figure 14 is a schematic diagram of another interface according to an embodiment of this application; Fig. 15(a) and Fig. 15(b) are schematic diagrams of another group of interfaces according to an embodiment of this application; Fig. 16A(a) and Fig. 16A(b) are schematic diagrams of another group of interfaces according to an embodiment of this application; Fig. 16B(a) and Fig. 16b(b) are schematic diagrams of another group of interfaces according to an embodiment of this application; Fig. 17(a), Fig. 17(b), Fig. 17(c) and Fig. 17(d) are schematic diagrams of another group of interfaces according to an embodiment of this application; Fig. 18A(a) and Fig. 18A(b) are schematic diagrams of another group of interfaces according to an embodiment of this application; Fig. 18B(a), Fig. 18B(b) and Fig. 18B(c) are schematic diagrams of another group of interfaces according to an embodiment of this application; Fig. 18C is a schematic diagram of a photograph produced in a multi-channel video recording method according to an embodiment of this application; Fig. 18D is a schematic diagram of a group of photographs produced in a multi-channel video recording process according to an embodiment of this application; Fig. Figure 19 is a schematic diagram of another interface according to an embodiment of this application; Fig. 20(a), Fig. 20(b) and Fig. 20(c) are schematic diagrams of another group of interfaces according to an embodiment of this application; Fig. 21 is a schematic diagram of another interface according to an embodiment of this application; Fig. Figure 22 is a schematic diagram of another interface according to an embodiment of this application; and Fig. 23A and Fig. Figure 23B is a flowchart of a multi-channel video recording method according to an embodiment of this application. DESCRIPTION OF THE EMBODIMENTS

[0033] The technical solutions in the embodiments of this application are described below with reference to the accompanying drawings. In the description of the embodiments of this application, " / " means "or" unless otherwise specified. For example, A / B can stand for A or B. In this description, "and / or" describes only an associative relationship for describing associated objects and means that three relationships can exist. A and / or B can, for example, represent the following three cases: only A exists, both A and B exist, and only B exists. Furthermore, "a plurality of" in the descriptions of the embodiments of this application means two or more than two.

[0034] The embodiments of this application provide a multi-channel video recording method that can be applied to an electronic device with a plurality of camera lenses. The electronic device can simultaneously use a plurality of camera lenses to perform a video recording in order to obtain a plurality of video image channels and a greater amount of image information.

[0035] The term “video recording” can also be referred to as “recording a video / of videos”. In the following embodiments of this application, “video recording” and “recording a video / of videos” have the same meaning.

[0036] The electronic device may be, for example, a mobile phone, a tablet computer, a portable device, an in-vehicle device, an augmented reality (AR) / virtual reality (VR) device, a notebook or ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), a special camera (e.g., a single-lens reflex camera or a card camera), or the like. The embodiments of the electronic device of this application are not limited to a specific type.

[0037] Fig. Figure 1, for example, is a schematic structure diagram of an electronic device 100. The electronic device 100 can include a processor 110, an external memory interface 120, internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a loudspeaker 170A, a telephone handset 170B, a microphone 170C, a headset interface 170D, a sensor module 180, a button 190, a motor 191, a display 192, a camera lens 193, a screen 194, and a subscriber identification module (SIM) interface 195. exhibit such characteristics.The sensor module 180 can include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetometer 180D, an accelerometer 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J and a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M and the like.

[0038] It is understood that the schematic structure in this embodiment of this application does not constitute a specific limitation of the electronic device 100. In some other embodiments of this application, the electronic device 100 may contain more or fewer components than those shown in the figure, or may have some components combined, or have some components separated, or may have a different component arrangement. The components shown in the figure may be implemented by hardware, software, or a combination of software and hardware.

[0039] The Processor 110 can contain one or more processing units. For example, the Processor 110 can include an Application Processor (AP), a Modem Processor, a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a Controller, Memory, a Video Codec, a Digital Signal Processor (DSP), a Baseband Processor, a Neural Network Processing Unit (NPU), and / or similar components. The various processing units can be independent devices or integrated into one or more processors.

[0040] In some embodiments, the processor 110, such as the controller or the GPU, can be configured to: in a multi-channel video recording scenario, combine a plurality of individual images simultaneously captured by N camera lenses 193 (N being an integer greater than 1) into a single image, in a type of splicing, partial superimposition or similar, so that the electronic device 100 can simultaneously display images captured by the N camera lenses 193, based on a preset display mode or a display mode specified by a user.

[0041] The presentation method can include arrangement types and sizes of images, each taken by different camera lenses.

[0042] In some other embodiments, the processor 110, such as the controller or the GPU, can be configured to: perform image stabilization processing on an image captured by each camera lens 193 in a multi-channel video recording scenario, and then assemble images obtained after image stabilization processing that correspond to the N camera lenses 193.

[0043] The controller can be a nerve center and command center of the electronic device 100. Based on an instruction operating code and a time signal, the controller can generate an operating control signal to complete the control of instruction retrieval and instruction execution.

[0044] Processor 110 may also include memory to store instructions and data. In some embodiments, the memory in Processor 110 is a cache. This memory can store instructions or data that have just been used or are used cyclically by Processor 110. When Processor 110 needs to reuse the instruction or data, it can retrieve it directly from memory. This avoids repeated access and reduces Processor 110's waiting time, thereby improving system efficiency.

[0045] In some embodiments, the Processor 110 may include one or more interfaces. The interface may be an I2C (Inter-integrated Circuit) interface, an I2S (Inter-integrated Circuit Sound) interface, a PCM (Pulse Code Modulation) interface, a UART (Universal Asynchronous Receiver / Transmitter) interface, a Mobile Industrial Processor Interface (MIPI), a General-Purpose Input / Output (GPIO) interface, a Subscriber Identity Module (SIM) interface, a Universal Serial Bus (USB) interface, and / or similar.

[0046] The I2C interface is a bidirectional synchronous serial bus and comprises a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 can include multiple groups of I2C buses. The processor 110 can be connected to the touch sensor 180K, a charger, a flash unit, the camera lens 193, and the like via various I2C bus interfaces. For example, the processor 110 can be connected to the touch sensor 180K using an I2C interface, allowing the processor 110 to communicate with the touch sensor 180K using the I2C bus interface to implement a touch function of the electronic device 100.

[0047] The I2S interface can be configured for audio communication. In some embodiments, the processor 110 can include multiple groups of I2S buses. The processor 110 can be coupled to the audio module 170 using an I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit an audio signal to the wireless communication module 160 using an I2S interface to implement a call answering function using a Bluetooth headset.

[0048] The PCM interface can also be configured for audio communication to sample, quantize, and encode an analog signal. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled using a PCM bus interface. Alternatively, in some embodiments, the audio module 170 can transmit an audio signal to the wireless communication module 160 via the PCM interface to implement a function for accepting a call via a Bluetooth headset. Both the I2S interface and the PCM interface can be configured for audio communication.

[0049] The UART interface is a universal serial data bus designed for asynchronous communication. The bus can be bidirectional, converting data between serial and parallel communication. In some embodiments, the UART interface is typically configured to connect the processor 110 to the wireless communication module 160. For example, the processor 110 communicates with a Bluetooth module in the wireless communication module 160 using the UART interface to implement Bluetooth functionality. In some embodiments, the audio module 170 can transmit an audio signal to the wireless communication module 160 using the UART interface to implement a music playback function using Bluetooth headphones.

[0050] The MIPI interface can be configured to connect the processor 110 to a peripheral device such as the display screen 194 and the camera lens 193. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), and the like. In some embodiments, the processor 110 communicates with the camera lens 193 using the CSI interface to implement a recording function of the electronic device 100. The processor 110 communicates with the screen 194 using the DSI interface to implement a display function of the electronic device 100.

[0051] The GPIO interface can be configured using software. The GPIO interface can be configured for a control signal or a data signal. In some embodiments, the GPIO interface can be configured to connect the processor 110 to the camera lens 193, the display screen 194, the wireless communication module 160, the audio module 170, the sensor module 180, and the like. The GPIO interface can also be configured as an I2C interface, I2S interface, UART interface, MIPI interface, or similar interface.

[0052] The USB interface 130 is an interface that conforms to a USB standard specification and can, in particular, be a mini-USB interface, a micro-USB interface, a USB Type-C interface, or the like. The USB interface 130 can be configured to connect to a charger to charge the electronic device 100, and it can also be configured to transfer data between the electronic device 100 and a peripheral device. It can also be configured to connect to a headset to play audio using the headset. Furthermore, the interface can be configured to connect to another electronic device, such as an AR device.

[0053] It can be assumed that the schematic interface connection relationships between modules in this embodiment of this application are merely an example for descriptive purposes and do not represent a limitation of the structure of the electronic device 100. In some other embodiments of this application, the electronic device 100 may alternatively use a different type of interface connection than in the foregoing embodiment or use a combination of several interface connection types.

[0054] The charging management module 140 is configured to receive a charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive a charging input from the wired charger using the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive a wireless charging input via a wireless charging coil of the electronic device 100. When charging the battery 142, the charging management module 140 can supply power to the electronic device using the power management module 141.

[0055] The power management module 141 is configured to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives an input signal from the battery 142 and / or the charging management module 140 and supplies power to the processor 110, the internal memory 121, external memory, the display screen 194, the camera lens 193, the wireless communication module 160, and the like. The power management module 141 can also be configured to monitor parameters such as battery capacity, the number of battery cycles, and the battery's condition (leakage or impedance).

[0056] In some other embodiments, the power management module 141 can alternatively be arranged in the processor 110. In some other embodiments, the power management module 141 and the charge management module 140 can alternatively be arranged in one and the same device.

[0057] A wireless communication function of the electronic device 100 can be implemented using the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, the baseband processor and the like.

[0058] Antenna 1 and antenna 2 are configured to transmit and receive signals in the form of electromagnetic waves. Each antenna in the electronic device 100 can be configured to cover one or more communication bands. Different antennas can be further multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0059] The mobile communication module 150 can provide a solution for wireless communication, including 2G / 3G / 4G / 5G and the like, which can be applied to the electronic device 100. The mobile communication module 150 can include at least one filter, switch, power amplifier, low-noise amplifier (LNA), and the like. Using the antenna 1, the mobile communication module 150 can receive an electromagnetic wave, perform processing such as filtering or amplification of the received electromagnetic wave, and transmit the electromagnetic wave to the modem processor for demodulation. The mobile communication module 150 can further amplify a signal modulated by the modem processor and convert the signal into an electromagnetic wave that is radiated via the antenna 1.

[0060] In some embodiments, at least some functional modules in the mobile communication module 150 can be arranged in the processor 110. In some embodiments, at least some functional modules in the mobile communication module 150 can be arranged in the same device as at least some modules in the processor 110.

[0061] The modem processor can contain a modulator and a demodulator. The modulator is configured to modulate a low-frequency baseband signal to be transmitted into an intermediate-frequency or high-frequency signal. The demodulator is configured to demodulate a received signal in the form of an electromagnetic wave into a low-frequency baseband signal. The demodulator then transmits the low-frequency baseband signal obtained by demodulation to the baseband processor for processing. The low-frequency baseband signal is processed by the baseband processor and then passed to the application processor. The application processor outputs an audio signal via an audio device (which is not limited to the speaker 170A, the telephone handset 170B, or similar) or displays a picture or video on the screen 194.

[0062] In some embodiments, the modem processor can be an independent device. In some other embodiments, the modem processor can be independent of the processor 110 and arranged in the same device as the mobile communication module 150 or another functional module.

[0063] The wireless communication module 160 can provide a solution for wireless communication, including wireless local area networks (WLANs) (for example, wireless Fidelity networks (Wi-Fi)), Bluetooth (BT), global navigation satellite systems (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), and similar technologies applicable to the electronic device 100. The wireless communication module 160 can consist of one or more devices that integrate at least one communication processing module.The wireless communication module 160 receives an electromagnetic wave using the antenna 2, performs frequency modulation and filtering of the electromagnetic wave signal, and transmits a processed signal to the processor 110. The wireless communication module 160 can also receive a signal to be transmitted from the processor 110, perform frequency modulation and amplification of the signal to be transmitted, and convert the signal to be transmitted into an electromagnetic wave for transmission using the antenna 2.

[0064] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, while the antenna 2 is coupled to the wireless communication module 160, enabling the electronic device 100 to communicate with a network and another device using wireless communication technology. The wireless communication technology may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), Bluetooth, GNSS, WLAN, NFC, FM, IR technology, and / or similar technologies.The GNSS can include a Global Positioning System (GPS), a Global Navigation Satellite System (GLONASS), a Beidou Navigation Satellite System (BDS), a Quasi-Zenith Satellite System (QZSS), and / or a Satellite Based Augmentation System (SBAS).

[0065] The electronic device 100 implements a display function using the GPU, the display screen 194, the application processor, and the like. The GPU is a microprocessor for image processing and is connected to the display screen 194 and the application processor. The GPU is configured to perform mathematical and geometric calculations and to render graphics. The processor 110 can contain one or more GPUs that execute a program instruction to generate or modify display information.

[0066] The display screen 194 is configured to display an image, a video, or the like. The display screen 194 comprises a display field. The display field can use a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a mini-LED, a micro-LED, a micro-OLED, a quantum dot light-emitting diode (QLED), or the like. In some embodiments, the electronic device 100 can comprise one or more display screens 194.

[0067] In some embodiments, the display screen 194 can, in a multi-channel video recording scenario, display images captured simultaneously by N camera lenses 193 in a splicing, picture-in-picture or similar manner and based on a preset display mode or a display mode specified by the user, so that the majority of channels of images captured by the N camera lenses 193 can be presented to the user simultaneously.

[0068] The electronic device 100 can implement a recording function using the ISP, the camera lens 193, the video codec, the GPU, the display screen 194, the application processor and the like.

[0069] The ISP is configured to process the data returned by the camera lens 193. For example, during photography, when a shutter release is activated, light is transmitted through a lens to a light-sensitive element of the camera lens, converting an optical signal into an electrical signal. This electrical signal from the light-sensitive element of the camera lens is then transmitted to the ISP for processing, in order to convert the electrical signal into an image visible to the naked eye. The ISP can further optimize an algorithm for noise, luminance, and hue in an image. The ISP can also optimize parameters such as the exposure and color temperature of a photographed scene. In some embodiments, the ISP can be located within the camera lens 193.

[0070] The camera lens 193 is designed to capture a static image or video. An optical image of an object is generated by the lens and projected onto the light-sensitive element. This light-sensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The light-sensitive element converts the optical signal into an electrical signal and then transmits this electrical signal to the ISP, which converts the electrical signal into a digital image signal. The ISP then passes the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard format such as RGB or YUV.

[0071] The electronic device 100 can contain N (N is an integer greater than 1) or more camera lenses 193. The N camera lenses 193 can comprise a rear-facing camera lens and / or a front-facing camera lens. The N camera lenses 193 can be configured to record a plurality of video channels.

[0072] The digital signal processor is configured to process a digital signal. In addition to the digital image signal, the digital signal processor can process another digital signal. For example, if the electronic device 100 selects a frequency, the digital signal processor is configured to perform a frequency-based Fourier transform or similar operation on the frequency signal.

[0073] The video codec is designed to compress or decompress digital video. The electronic device 100 can support one or more video codecs. In this way, the electronic device 100 can play or record videos in a variety of encoding formats, such as Moving Picture Experts Group (MPEG)1, MPEG2, MPEG3, and MPEG4.

[0074] The NPU is a neural network processor (NN) that quickly processes input data by referencing a biological neural network structure, such as a transmission mode between human brain neurons, and is also capable of continuous self-learning. Applications such as the intelligent recognition of the Electronic Device 100, including image recognition, facial recognition, speech recognition, and text understanding, can be implemented using the NPU.

[0075] The external memory interface 120 can be configured to connect to an external memory card, such as a micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 using the external memory interface 120 to implement a data storage function. For example, files such as music and videos are stored on the external memory card.

[0076] The internal memory 121 can be configured to store computer-executable program code. The executable program code contains an instruction. The processor 110 executes the instruction stored in the internal memory 121 to perform various functional applications and data processing of the electronic device 100. The internal memory 121 can comprise a program memory area and a data memory area. The program memory area can store an operating system, an application required for at least one function (e.g., a sound playback function or a picture playback function), and the like. The data memory area can store data (e.g., audio data and an address book) created during the use of the electronic device 100, and the like.In addition, the internal storage 121 can include high-speed random access storage and non-volatile storage, for example, at least one disk storage device, one flash storage device, or one universal flash storage (UFS).

[0077] The electronic device 100 can implement an audio function, e.g., playing music and recorded sound, by using the audio module 170, the loudspeaker 170A, the telephone handset 170B, the microphone 170C, the headset interface 170D, the application processor, and the like.

[0078] The audio module 170 is configured to convert digital audio information into an analog audio signal for output and to convert analog audio input into a digital audio signal. The audio module 170 can further be configured to encode and decodecode audio signals. In some embodiments, the audio module 170 can be located within the processor 110, or some functional modules of the audio module 170 can be located within the processor 110.

[0079] The 170A loudspeaker is designed to convert an electrical audio signal into a sound signal. Using the 170A loudspeaker, music can be listened to or hands-free calls can be received via the electronic device 100.

[0080] The 170B telephone handset, also referred to as a "receiver," is designed to convert an electrical audio signal into a sound signal. When the 100 electronic device answers a call or receives a voice message, the 170B telephone handset can be brought near a human ear to hear a voice.

[0081] The microphone 170C, also referred to as a "mic" or "sound transducer," is designed to convert an audio signal into an electrical signal. When the user makes a call or sends a voice message, they can speak into the microphone 170C, thus inputting an audio signal into the microphone 170C. At least one microphone 170C can be arranged in the electronic device 100. In some other embodiments, two microphones 170C can be arranged in the electronic device 100 to capture an audio signal and implement a noise reduction function. Alternatively, in some other embodiments, three, four, or more microphones 170C can be arranged in the electronic device 100 to capture an audio signal, reduce noise, identify a sound source, implement a directional audio recording function, and the like.

[0082] The Headset Interface 170D is designed for connecting a wired headset. The Headset Interface 170D can be a USB 130 interface, a 3.5 mm standard interface of the Open Mobile Terminal Platform (OMTP), or a standard interface of the US Mobile Communications Industry Association (CTIA).

[0083] The pressure sensor 180A is designed to detect a pressure signal and convert it into an electrical signal. In some embodiments, the pressure sensor 180A can be located on the display screen 194. There are many types of pressure sensors 180A, for example, a resistive pressure sensor, an inductive pressure sensor, and a capacitive pressure sensor. The capacitive pressure sensor can contain at least two parallel plates with a conductive material. When a force is applied to the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the pressure intensity based on this change in capacitance. When a touch is applied to the display screen 194, the electronic device 100 detects the intensity of the touch based on the pressure sensor 180A.The electronic device 100 can also calculate a touch point based on a signal detected by the pressure sensor 180A. In some embodiments, touch operations applied to the same touch point but with different touch intensities can correspond to different operating instructions. For example, if a touch operation with a touch intensity below a first pressure threshold is applied to an SMS notification symbol, an instruction to display an SMS message is executed. If a touch operation with a touch intensity greater than or equal to the first pressure threshold is applied to the SMS notification symbol, an instruction to create a new SMS message is executed.

[0084] The gyroscope sensor 180B can be configured to determine the direction of movement of the electronic device 100. In some embodiments, the angular velocities of the electronic device 100 about three axes (namely the x, y, and z axes) can be determined using the gyroscope sensor 180B. The gyroscope sensor 180B can be configured for image stabilization during recording. For example, when the shutter release is pressed, the gyroscope sensor 180B detects an angle at which the electronic device 100 shakes and, based on this angle, calculates a distance that a lens module must compensate for, so that a lens counteracts the shake of the electronic device 100 by moving in the opposite direction to implement image stabilization. The gyroscope sensor 180B can also be used in navigation scenarios and motion-sensing games.

[0085] The barometric pressure sensor 180C is designed to measure barometric pressure. In some embodiments, the electronic device 100 uses the atmospheric pressure measured by the barometric pressure sensor 180C to calculate an altitude to aid in positioning and navigation.

[0086] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can use the magnetic sensor 180D to detect whether a flip case is open or closed. In some embodiments, if the electronic device 100 is a flip phone, it can use the magnetic sensor 180D to detect whether a flip cover is open or closed and, based on a detected open or closed state of the leather case or flip cover, activate a function, such as automatic unlocking in response to the open state.

[0087] The accelerometer 180E can detect the magnitude of accelerations in various directions (generally in the direction of three axes) of the electronic device 100, can detect the magnitude and direction of gravity when the electronic device 100 is not moving, and can furthermore be configured to detect an orientation of the electronic device used for switching between landscape and portrait format, a pedometer, or other applications.

[0088] The distance sensor 180F is designed to measure distance. The electronic device 100 can measure the distance using infrared or laser technology. In some embodiments, the electronic device 100 can use the distance sensor 180F to measure the distance to a photographed scene in order to implement rapid focusing.

[0089] The proximity light sensor 180G can, for example, contain a light-emitting diode (LED) and an optical detector, such as a photodiode. The LED can be an infrared LED. The electronic device 100 emits infrared light using the LED. The electronic device 100 detects the infrared light reflected by a nearby object using the photodiode. If the detected reflected light is sufficient, it can be determined that an object is near the electronic device 100. If the detected reflected light is insufficient, the electronic device 100 can determine that no object is near the electronic device 100.The electronic device 100 can use the proximity light sensor 180G to detect whether the user is holding the device close to their ear to make / answer a call, in order to automatically turn off the screen to save power. The proximity light sensor 180G can also be configured to automatically unlock or lock the screen in a leather case or pocket mode.

[0090] The ambient light sensor 180L is designed to detect the brightness of the ambient light. Based on the detected ambient brightness, the electronic device 100 can adaptively adjust the luminance of the display screen 194. The ambient light sensor 180L can also be configured to automatically adjust the white balance during photography. Furthermore, the ambient light sensor 180L can cooperate with the proximity light sensor 180G to detect whether the electronic device 100 is in a pocket, thus preventing accidental contact.

[0091] The fingerprint sensor 180H is designed to detect a fingerprint. Using a feature of the detected fingerprint, the electronic device 100 can implement fingerprint unlocking, application access restriction, fingerprint photography, fingerprint call answering, and similar functions.

[0092] The temperature sensor 180J is configured to detect a temperature. In some embodiments, the electronic device 100 executes a temperature processing policy using the temperature detected by the temperature sensor 180J. For example, if a temperature reported by the temperature sensor 180J exceeds a threshold, the electronic device 100 reduces the power of a processor located near the temperature sensor 180J to reduce power consumption for thermal protection. In some other embodiments, if a temperature falls below another threshold, the electronic device 100 heats the battery 142 to prevent the low temperature from causing an abnormal shutdown of the electronic device 100.In some other embodiments, when a temperature falls below a further threshold, the electronic device 100 increases an output voltage of the battery 142 to prevent the low temperature from causing an abnormal shutdown.

[0093] The touch sensor 180K is also referred to as a "touch panel". The touch sensor 180K can be arranged on the display screen 194. The touch sensor 180K and the display screen 194 form a touchscreen, also referred to as a "touchscreen". The touch sensor 180K is configured to detect a touch on or near the sensor surface. The touch sensor can transmit the detected touch to the application processor to determine the type of touch event. A visual output related to the touch can be displayed on the display screen 194. In some other embodiments, the touch sensor 180K can alternatively be arranged on a surface of the electronic device 100 at a location other than that of the display screen 194.

[0094] The 180M bone conduction sensor can receive a vibration signal. In some embodiments, the 180M bone conduction sensor can receive a vibration signal from a vibrating bone in the vocal cord region. The 180M bone conduction sensor can also be in contact with a human pulse to receive a beat-to-beat blood pressure signal. Alternatively, in some embodiments, the 180M bone conduction sensor can be arranged in a headset to form a bone conduction headset. The 170 audio module can evaluate a speech signal based on the vibration signal from the vibrating bone in the vocal cord region received by the 180M bone conduction sensor to implement a speech function. The application processor can evaluate heart rate information based on the beat-to-beat blood pressure signal received by the 180M bone conduction sensor to implement a heart rate detection function.

[0095] Key 190 includes a power button, a volume button, and the like. Key 190 can be a mechanical button or a touch button. The electronic device 100 can receive a key input and generate a key signal input relating to the user setting and function control of the electronic device 100.

[0096] Motor 191 can generate a vibration prompt. Motor 191 can be configured to emit a vibration notification for incoming calls and vibration feedback upon touch. For example, touch operations applied to different applications (e.g., taking photos and playing audio) can correspond to different vibration feedback effects. Motor 191 can also generate different vibration feedback effects corresponding to touches in different areas of the screen 194. Different application scenarios (e.g., a time reminder, receiving information, an alarm clock, and a game) can also correspond to different vibration feedback effects. Customization of vibration feedback upon touch can also be supported.

[0097] The indicator 192 can be a light indicator and can be configured to show a charging status and a change in battery level, and can also be configured to show a message, a missed call, a notification and the like.

[0098] The SIM card interface 195 is designed for the connection of a SIM card. The SIM card can be connected to and removed from the electronic device 100 by inserting it into or removing it from the SIM card interface 195. The electronic device 100 can support one or more SIM card interfaces. The SIM card interface 195 can support a nano-SIM card, a micro-SIM card, a SIM card, and the like. Multiple cards can be inserted into the same SIM card interface 195 simultaneously. The types of multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with an external memory card.The electronic device 100 interacts with a network by using a SIM card to perform functions such as calls and data communication. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be removed from it.

[0099] In this embodiment of this application, N camera lenses 193 in the mobile phone can simultaneously record a plurality of video channels. Such a recording mode can be referred to as a multi-channel video recording mode. In the multi-channel video recording mode, the display screen 194 can, during a video recording process or during a playback process of recorded videos, simultaneously display a plurality of individual frames, each captured by the N camera lenses 193, in the same interface and based on a preset display mode or a user-specified display mode. The plurality of individual frames, each captured by the N camera lenses 193, can be displayed by splicing in the same interface or in a picture-in-picture manner.

[0100] In some embodiments, the processor 110 (e.g., the controller or the GPU) can, in multi-channel video recording mode, assemble a plurality of individual frames simultaneously captured by the N camera lenses 193 in a video recording process to combine a plurality of channels of video streams captured by the N camera lenses 193 into a single channel of video streams. Then, a video encoder in the processor 110 can encode this single channel of the assembled video stream data to produce a video file. In this way, each individual frame in the video file can contain a plurality of images from the N camera lenses 193.When a single frame in the video file is played, the display screen 194 can display a plurality of image channels captured simultaneously by the N camera lenses 193, based on a preset display mode or a user-specified display mode, in order to show the user a plurality of images corresponding to different areas, different definitions, or different detail information at the same time or scene.

[0101] In some other embodiments, the processor 110, in multi-channel video recording mode, can associate all frames simultaneously captured by different camera lenses 193 with one another, so that when playing back recorded videos, the display screen 194 can show associated frames in a uniform interface based on a preset or user-defined display mode. For example, the processor 110 can add a common marker to the majority of frames simultaneously captured by the N camera lenses 193 in order to associate the majority of frames. In this case, videos captured by different camera lenses 193 can be stored separately as different video files.

[0102] In some embodiments, the N camera lenses 193 can separately capture images at the same frame rate in multi-channel video recording mode. In other words, the N camera lenses 193 capture the same number of frames in the same amount of time. Videos captured simultaneously by different camera lenses 193 can be stored separately as different video files, with the different video files being linked to each other. The video files store the frames in the order in which they were captured, with each video file containing the same number of frames.When the recorded videos are played back, the display screen 194 can perform a display based on a preset display mode or a user-specified display mode and in sequences of still images contained in associated video files, in order to display a plurality of still images corresponding to the same sequence and located in different video files in a uniform interface.

[0103] In some other embodiments, the N camera lenses 193 can separately capture images at the same frame rate in multi-channel video recording mode. In other words, the N camera lenses 193 capture the same number of frames within the same time. The processor 110 can add a timestamp to each frame captured by the different camera lenses 193, so that when playing back recorded videos, the display screen 194 can simultaneously display multiple frames captured by the N camera lenses 193 in the same interface, based on the timestamp and a preset or user-specified display mode. Videos captured by different camera lenses 193 can be stored separately as different video files.

[0104] For ease of use, the mobile phone typically records in a handheld mode. However, images captured in handheld mode are usually blurry. In some embodiments, the processor 110 can perform image stabilization processing for each individual frame captured by different camera lenses 193 in multi-channel video recording mode. The screen 194 then displays an image obtained after image stabilization processing.

[0105] The multi-channel video recording method provided in the embodiments of this application is described below by way of an example in which an electronic device is a mobile phone with the aforementioned touchscreen.

[0106] As described above, the touchscreen can include a display area and a touch area. The display area can show an interface. In other words, the touchscreen is also a display screen. The touch area can detect a user's touch input and forward it to the mobile phone's processor for appropriate processing.

[0107] In some embodiments, if the user wishes to use the mobile phone to take a picture, they can instruct the mobile phone to start a camera by touching it, pressing a button, making a gesture in the air, or using voice commands. The mobile phone activates a camera function according to the user's instruction. For example, as in Fig. As shown in 2(a), the mobile phone activates the camera function after it detects a tap on a camera control 201 by the user.

[0108] In some embodiments, after the camera is launched, the mobile phone can automatically enter a recording mode, such as a photo mode, a video recording mode (a single-channel video recording mode in which a single camera lens is used to record video), or a multi-channel video recording mode, and display a recording preview interface. For example, after detecting the user's tap on the camera, the mobile phone can automatically enter a recording mode, such as a photo mode, a video recording mode (a single-channel video recording mode in which a single camera lens is used to record video), or a multi-channel video recording mode, and display a recording preview interface. Fig. 2(a) automatically switch to photo mode using the camera icon 201 shown, and a Fig. 2(b) Display the preview window 202 shown. A photography preview interface can be displayed in the preview window 202.

[0109] In some other embodiments, the mobile phone can enter multi-channel video recording mode after the camera has been started, if it has not already entered multi-channel video recording mode, according to user instructions.

[0110] For example, the mobile phone can be in the Fig. 2(b) enter the multi-channel video recording mode and a photo preview interface shown in Fig. 2(c) The preview window 204 shown is displayed when the mobile phone detects a tap on a control 203 by the user. A multi-channel video recording preview interface can be displayed in the preview window 204.

[0111] In multi-channel video recording mode, the preview window 204 can contain multiple areas, with different areas each used to display images captured by different camera lenses simultaneously recording multiple video channels. For example, if the multi-channel video recording mode is a dual-channel video recording mode, two camera lenses on the mobile phone are used simultaneously for multi-channel video recording. As in Fig. As shown in 2(c), the preview window 204 can have an area 205 and an area 206, an image taken by one of the camera lenses can be displayed in area 205, and an image taken by the other camera lens can be displayed in area 206.

[0112] Another example: If the mobile phone is in a Fig. 3(a) The photograph preview interface shown detects a tap action on a control 301 by the user, which can be displayed in Fig. The settings interface shown in 3(c) can be displayed. Alternatively, it can be displayed in a Fig. 3(b) photograph preview interface shown, when the mobile phone detects a tap on a control 302 by the user, a Fig. The settings interface shown in Figure 3(c) will be displayed. When the mobile phone then detects a user tap on a control 303, the mobile phone switches to multi-channel video recording mode.

[0113] Another example: In photo mode, the photo preview interface displayed on the mobile phone may contain a camera lens identifier. After detecting that the user has selected multiple camera lens identifiers, the mobile phone determines that the user intends to use multiple camera lenses for video recording and therefore enters multi-channel video recording mode. For example, referring to Fig. 4A, a mobile phone's photography preview interface includes an identifier 401 for a rear-facing ultra-wide-angle camera lens, an identifier 402 for a rear-facing wide-angle camera lens, an identifier 403 for a rear-facing long-focal-length camera lens, and an identifier 404 for a front-facing camera lens. Upon detection of a tap on identifiers 402 and 403 by the user, the mobile phone enters multi-channel video recording mode and takes pictures using the rear-facing wide-angle camera lens and the rear-facing long-focal-length camera lens.

[0114] Another example: In recording mode, the photography preview interface displayed on the mobile phone can contain a numerical identifier. This identifier is used to indicate the number of camera lenses being used simultaneously during recording (or the number of image channels being captured concurrently). If a numerical value corresponding to a user-selected identifier is detected as being greater than 1, the mobile phone determines that the user intends to use multiple camera lenses for simultaneous video recording and therefore switches to multi-channel video recording mode.

[0115] Another example: In photo mode or video recording mode (the single-channel video recording mode), after the user detects the drawing of a preset track 1 (for example, an "M" track) on the touchscreen, the mobile phone switches to multi-channel video recording mode.

[0116] As another example, the mobile phone, in video recording mode (single-channel video recording mode), can ask the user in a video recording preview interface if they want to switch to multi-channel video recording mode. For example, the mobile phone, as in Fig. 4B shows information 405 to prompt the user. After the user detects a tap on a control 406, the mobile phone enters multi-channel video recording mode.

[0117] In some other embodiments, if the user wishes to use the mobile phone to perform multi-channel video recording, the camera function can be activated and the phone can directly enter multi-channel video recording mode according to a user instruction, such as a touch operation, a key press, a gesture in the air, or a voice command.

[0118] For example, if the mobile phone is displaying a desktop or the interface of another application, and the mobile phone receives a voice command from the user to enter multi-channel video recording mode, the mobile phone will start the camera and enter multi-channel video recording mode. Another example: If the screen is on and displaying a desktop, or if the screen is off, as in Fig. As shown in Figure 4C, when the mobile phone detects the user activating a preset track 2 (e.g., a "CM" track) on the touchscreen, the mobile phone starts the camera and enters multi-channel video recording mode.

[0119] The methods described above for entering multi-channel video recording mode are merely examples. The mobile phone can alternatively switch to multi-channel video recording mode in another way. The manner of embodiment of this application is not specifically restrictive.

[0120] After entering multi-channel video recording mode, the mobile phone can capture and display multiple image channels in a preview state using N camera lenses.

[0121] In some embodiments, the mobile phone, in preview mode of multi-channel video recording, can capture multiple image channels based on N (N being an integer greater than 1) standard camera lenses. The sizes, areas, content, definitions, and the like of images captured by different camera lenses can vary. Because multiple camera lenses capture multiple image channels simultaneously, more extensive image information occurring at the same moment or in the same scene can be obtained. The frame rates of the N camera lenses can be the same. The mobile phone can capture N individual frames at the same moment using the N camera lenses. For example, N is equal to 2, and the N camera lenses can be the rear-facing wide-angle camera lens and the rear-facing long-focal-length camera lens.

[0122] The N camera lenses can correspond to the same focal length range or to different focal length ranges. The focal length ranges can include, among others, a first focal length range with a focal length less than a preset value 1 (e.g., 20 mm), for example, the ultra-wide-angle camera lens can correspond to the first focal length range; a second focal length range with a focal length greater than or equal to preset value 1 and less than or equal to preset value 2 (e.g., 50 mm), where, for example, the wide-angle camera lens can correspond to the second focal length range; and a third focal length range with a focal length greater than preset value 2, where, for example, the long focal length camera lens can correspond to the third focal length range.

[0123] The N camera lenses can include a rear-facing camera lens and / or a front-facing camera lens. For example, the mobile phone can use two rear-facing camera lenses simultaneously to perform two-channel rear-facing video recording. In another example, the mobile phone can use one front-facing camera lens and one rear-facing camera lens to perform front-back two-channel video recording. In yet another example, the mobile phone can use three rear-facing camera lenses to perform three-channel rear-facing video recording. In a further example, the mobile phone can use two rear-facing camera lenses and one front-facing camera lens to perform three-channel video recording.In another example, the mobile phone can use two rear-facing camera lenses and two front-facing camera lenses to perform four-channel video recording. In yet another example, the mobile phone can use two front-facing camera lenses to perform two-channel video recording.

[0124] Multiple rear-facing camera lenses typically correspond to multiple focal length ranges. If a mobile phone uses multiple rear-facing camera lenses simultaneously to perform multi-channel video recording, image information across different focal length ranges and different fields of view can be captured at the same time. For example, the mobile phone might have three rear-facing camera lenses and one front-facing camera lens. The three rear-facing camera lenses could be an ultra-wide-angle lens, a wide-angle lens, and a long-focal-length lens. The front-facing camera lens could correspond to the second focal length range. The rear-facing ultra-wide-angle or wide-angle lens could capture panoramic data across a larger field of view.A rear-facing camera lens with a long focal length can capture image information in a smaller field of view, but with clearer and more extensive details.

[0125] The N camera lenses could be, for example, the rear-facing ultra-wide-angle camera lens + the rear-facing wide-angle camera lens, the rear-facing ultra-wide-angle camera lens + the rear-facing long focal length camera lens, the rear-facing wide-angle camera lens + the rear-facing long focal length camera lens, or the rear-facing ultra-wide-angle camera lens + the rear-facing wide-angle camera lens + the rear-facing long focal length camera lens.

[0126] When a mobile phone uses both a rear-facing and a front-facing camera lens simultaneously to perform multi-channel video recording, images of a photographed object in front of the phone and a photographer behind the phone can be captured at the same time, making it easy for the user to save and view the footage. For example, the camera lenses could be the front-facing lens and the rear-facing ultra-wide-angle lens, the front-facing lens plus the rear-facing wide-angle lens, or the front-facing lens and the rear-facing long-focal-length lens.

[0127] In some other embodiments, the mobile phone, in preview mode of multi-channel video recording, can furthermore display a plurality of channels of images captured simultaneously by the N camera lenses, based on a standard display method. This display method includes a layout, sizes, and the like of images captured by different camera lenses when displayed in an interface; that is, a layout and sizes of areas in which the images captured by the different camera lenses are arranged within the interface.

[0128] If N is, for example, 2, the display mode can include left-right splicing, top-bottom splicing, picture-in-picture display, or similar. In spliced ​​display modes, different areas to be spliced ​​can be the same or different, with almost no gap between the different areas to be spliced, so that the touchscreen can be used to its maximum extent for displaying image information. Picture-in-picture display means that images taken by different camera lenses are partially superimposed, or that an image taken by one camera lens can be displayed floating on top of an image taken by another camera lens, with the size of the superimposed image being smaller than the size of the underlying image. For example, if N is equal to 2, this corresponds to the display modes in (a) to (e) in Fig. 5A. (a) to (c) are spliced ​​representations, while (d) and (e) are picture-in-picture representations.

[0129] Another example: If N equals 3, the representation can include a left-center-right spliced ​​representation, a top-center-bottom spliced ​​representation, a picture-in-picture representation, or similar. For example, if N equals 3, this corresponds to the representations in (a) to (f) in Fig. 5B. (a) to (d) are spliced ​​representations, while (e) and (f) are picture-in-picture representations.

[0130] Another example: If N equals 4, the representation can include a horizontally parallel representation, a vertically parallel representation, a four-grid representation, a top / left / bottom / middle / right / bottom representation, a picture-in-picture representation, or similar. For example, if N equals 4, this corresponds to the representations in (a) to (e) in Fig. 5C. (a) to (c) are spliced ​​representations, while (d) and (e) are picture-in-picture representations.

[0131] The N standard camera lenses and the standard display mode may be preconfigured in the mobile phone or preset by the user (e.g., set by the user in a system settings interface before the camera is started to take pictures), or they may be N camera lenses or a display mode previously used by the user in multi-channel video recording mode. For example, the N standard camera lenses may be the rear-facing wide-angle camera lens and the rear-facing long focal length camera lens; the standard display mode may be (a) in Fig. It should be 5A, and a multi-channel video recording preview interface can be used in Fig. 2(c) shown.

[0132] In some other embodiments, the mobile phone can further perform image stabilization processing on an image captured by each of the N camera lenses to obtain a clear image and then display that clear image. The image stabilization processing can, for example, include motion estimation and motion compensation. Motion estimation is used to find an optimal motion vector. Motion compensation is used to compensate for a current image based on the motion vector to counteract any jitter. An image stabilization processing method can, for example, include a grayscale projection method, a block matching method, a bit-plane matching method, an edge matching method, a feature point matching method, and the like.

[0133] For example, if image stabilization processing is performed using the block matching method, a single image can be divided into a plurality of non-overlapping sub-blocks (e.g., 32x32), assuming that the motion vectors of all pixels in the sub-block are the same. Then, within a specified search area, a current block is compared to a corresponding block from a previous image. Based on a matching criterion, a best match is found to obtain an alternative position of the current block or a corresponding motion vector to compensate for the current image.

[0134] With a technical solution, two adjacent blurry images are usually out of focus due to the shift in their content. The mobile phone can register the two adjacent images and then crop a portion of the image to obtain a clear picture. The shift in an image captured by a long focal length camera lens is greater than with a wide-angle or ultra-wide-angle lens. Therefore, a larger portion must be cropped during image stabilization.

[0135] In some other embodiments, the mobile phone, in preview mode of multi-channel video recording, can capture and display multiple image channels based on a standard recording mode. The recording mode includes a correspondence between a display mode and camera lenses. The mobile phone can capture images corresponding to the standard recording mode using N camera lenses and display the images using a display mode corresponding to the standard recording mode.

[0136] For example, the shooting mode may include a close-up mode, a front-back mode, and the like, with the default shooting mode being the close-up mode. For example, the camera lenses corresponding to the close-up mode are the rear-facing wide-angle camera lens and the rear-facing long focal length camera lens, with a corresponding representation being that shown in (a) in Fig. 5A. Another example of camera lenses corresponding to the close-up mode are the rear-facing ultra-wide-angle camera lens and the rear-facing long focal length camera lens, where a corresponding representation is shown in (d) in Fig. 5A as shown. Another example: The camera lenses corresponding to the front-back modes are the rear-facing wide-angle camera lens and the front-facing camera lens, the corresponding representation being that shown in (e) in Fig. 5A is the way shown.

[0137] In close-up mode, the mobile phone can simultaneously capture a panoramic image behind the mobile phone and a close-up image of a nearby object, and display one image of a rear panoramic image and one image of a rear close-up image in two areas, so that when the panoramic image corresponding to a large area is displayed, the user can also be shown the beauty of details of the nearby object.

[0138] In some embodiments, the mobile phone can receive an image output ratio from a light-sensitive element in a camera lens capturing the panoramic image and align the aspect ratio of an area containing the displayed panoramic image with the image output ratio of the light-sensitive element, thus ensuring that the panoramic image has a maximum field of view. The image output ratio of the light-sensitive element is the ratio of the width to the height of an image produced by the light-sensitive element.The mobile phone can furthermore obtain an aspect ratio and size of a display area of ​​the touchscreen and determine an aspect ratio of the close-up image based on the aspect ratio of the display area and the aspect ratio of the panoramic image, so that the panoramic image and the close-up image, which are spliced ​​in the multi-channel video recording preview interface, completely occupy the display area of ​​the entire touchscreen.In other words, there is almost no distance between an area containing the panoramic image and an area containing the close-up image, with the entire area formed after splicing the area containing the panoramic image and the area containing the close-up image having a size and aspect ratio that corresponds to the display area of ​​the touchscreen, so that the touchscreen can be used to the maximum extent to present the images to the user.

[0139] In Fig. For example, in 6A, a panoramic image is located in area 610 and a close-up image in area 620. If the image output ratio of a light-sensitive element in a camera lens capturing the panoramic image is 4:3, and the aspect ratio of the touchscreen's display area is 18:9, then the aspect ratio of the panoramic image (i.e., the aspect ratio of area 610) can also be 4:3, the aspect ratio of the close-up image (i.e., the aspect ratio of area 620) can be 2:3, the size of the image formed after splicing the panoramic and close-up images is 18:9, the spliced ​​image completely occupies the display area of ​​the entire touchscreen, and one mode of representation is that shown in (a). Fig. 5A shown. In some embodiments, the multi-channel video recording preview interface may also include a control 640 labelled in a box labelled “Close-up” (see Fig. 6A), to inform the user that the current mode is the close-up mode.

[0140] Another example of a preview effect in close-up mode, when the in (d) in Fig. The picture-in-picture display method shown in 5A is used in Fig. Figure 6B is shown. In some embodiments, the multi-channel video recording preview interface may be displayed after entering multi-channel video recording mode, as shown in Figure 6B. Fig. Figure 6B shows only one control 603 indicating that the current mode is multi-channel video recording mode, and no "Photograph" control, no "Wide Angle" control, or anything similar. As shown in Fig. As shown in Figure 6B, the multi-channel video recording preview interface can also include a control 604. After the user detects a tap on the control 604, the mobile phone hides the control 603. This helps to avoid obscuring a displayed image with the control, thus improving the user's visual experience.

[0141] In front-back mode, the mobile phone can simultaneously capture an image behind the mobile phone and an image in front of the mobile phone, e.g., simultaneously a picture of a photographed object behind and a picture of a photographer in front of the mobile phone, and display a rear image and a front image in two areas each.

[0142] In some embodiments, the aspect ratio of the area containing the rear image is consistent with the image output ratio of a light-sensitive element, thus ensuring that the rear image has a maximum field of view. Furthermore, after splicing, a panoramic image and a close-up image can completely occupy the display area of ​​the entire touchscreen, allowing the touchscreen to be used to its fullest extent for presenting the images to the user.

[0143] Fig. Figure 6C illustrates a preview effect in front-back mode, for example, when in front-back mode the image in (a) is displayed. Fig. The representation method shown in 5A is used. As in Fig. As shown in Figure 6C, a control 605 labelled “Front-Back” in a solid box indicates that the current mode is Front-Back mode, a back image in area 606 and a front image in area 607. Fig. 6D displays a preview effect in "Front-Back" mode when the in (e) in Fig. The picture-in-picture display method shown in 5A is used.

[0144] In some other embodiments, the mobile phone, in preview mode of multi-channel video recording, can capture multiple image channels based on N user-specified camera lenses. Similar to the in Fig. The camera lens identifiers shown in Figure 4A can, for example, be found in the multi-channel video recording preview interface after entering multi-channel video recording mode. After the user selects multiple camera lenses, the mobile phone simultaneously captures images using the user-selected lenses.

[0145] In another example, as in Fig. As shown in Figure 7(a), a setting control 701 is displayed in the preview interface in multi-channel video recording mode. After the user detects a tap on control 701, the mobile phone can record a Fig. Display the settings interface shown in 7(b). The user can set or change N camera lenses used by the mobile phone during multi-channel video recording in the settings interface.

[0146] As another example, after entering multi-channel video recording mode, the mobile phone can automatically select the in Fig. 7(b) display the settings interface shown, so that the user can set a camera lens or switch to a camera lens that the user wishes to use.

[0147] Another example: After the multi-channel video recording mode has been activated, as in Fig. As shown in Figure 8(a), the multi-channel video recording preview interface can include a control 801 for camera lens adjustment. After the user detects a tap on the control 801, the mobile phone can record a Fig. Figure 8(b) shows the camera lens setting interface 802. The user can use the camera lens setting interface 802 to set or change a camera lens that the user wishes to use during multi-channel video recording.

[0148] In some other embodiments, the mobile phone, in preview mode of multi-channel video recording, can display multiple channels of images captured simultaneously by N camera lenses in the multi-channel video recording preview interface, based on a user-defined display mode. For example, the user can select a display mode or create a new one by specifying the... Fig. 7(b) uses the settings interface 702 shown.

[0149] Another example: After the multi-channel video recording mode has been activated, as in Fig. As shown in Figure 8(a), the multi-channel video recording preview interface can include a control 803 for setting the display mode. After a tap is detected on the control 803 by the user, the mobile phone can display an interface for setting the display mode 804, as shown in Figure 8(a). Fig. Figure 8(c) illustrates this. The user can set a display mode to use during multi-channel video recording in the Display Mode Setting Interface 804.

[0150] For example, if the camera lenses specified by the user are the ultra-wide-angle camera lens, the wide-angle camera lens, and the long focal length camera lens, and a display mode specified by the user is that shown in (d) in Fig. The spliced ​​representation shown in 5B corresponds to the multi-channel video recording preview interface according to Fig. 9A. If the camera lenses specified by the user are the ultra-wide-angle camera lens, the long focal length lens, and the front-facing camera lens, and the display mode specified by the user is that described in (f) in Fig. The picture-in-picture display shown in 5B is the multi-channel video recording preview interface according to Fig. 9B will be shown.

[0151] In some other embodiments, while in preview mode of multi-channel video recording, the user can drag the positions of different areas on a recording screen to change their arrangement, or draw a boundary line between different areas to change their sizes, thus achieving a user-desired layout effect. The mobile phone can then simultaneously display multiple channels of images captured by multiple camera lenses, based on the corresponding changes to the layout and sizes of the areas. A schematic diagram of such a change effect is shown, for example, in Fig. 10(a) and Fig. 10(b) shown, or in Fig. 10(a) and Fig. 10(c).

[0152] In some other implementations, the user can further change the recording mode in the preview state of the multi-channel video recording mode. For example, the mobile phone is currently in the Fig. 6A shows the close-up mode. After the user detects a tap on a control 602, the mobile phone can be switched to the mode shown in Fig. Switch between the front-back modes shown in 6C. If a current recording mode is selected by the control 605 in Fig. The front-back mode shown in Figure 6C can be used by the mobile phone after the user registers a tap on the switching control 602. Fig. Switch to the close-up mode shown in 6A.

[0153] In some other embodiments, the mobile phone, in a preview state of close-up mode, can switch between the camera lenses used to capture a panoramic image according to a user instruction. For example, after receiving a tap on the screen, the mobile phone switches between the two camera lenses used to capture a panoramic image. Fig. The toggle control 601 shown in Figure 6A, which the user has recognized, switches to using the rear-facing ultra-wide-angle camera lens to capture a panorama image, if the camera lens currently capturing a panorama image is the rear-facing wide-angle camera lens. A corresponding preview interface after switching the camera lens is shown in Figure 6A. Fig. 6E. If a camera lens currently capturing a panoramic image is the rear-facing ultra-wide-angle camera lens, the mobile phone can switch to using the rear-facing wide-angle camera lens to capture a panoramic image after the user detects a tap on the toggle control 601. In some other embodiments, the multi-channel video recording preview interface may further include a control 630, which is located in a Fig. The box shown in Figure 6A is labelled “Wide Angle” to indicate that the wide-angle camera lens is currently being used to capture a panoramic image; and it may contain a control that is located in a Fig. The box shown in Figure 6A is labelled with a dashed line and marked “Ultra-wide angle” to indicate that the ultra-wide angle camera lens can be used to take a panoramic image.

[0154] Another example: In front-back mode, the mobile phone can, according to a user instruction, switch a camera lens used to capture a rear-facing image to the rear-facing wide-angle camera lens or the rear-facing ultra-wide-angle camera lens. For example, regarding Fig. 6C, after the mobile phone detects a tap on the toggle control 601 by the user, if the camera lens currently capturing a rear image is the wide-angle camera lens, the mobile phone switches to using the ultra-wide-angle camera lens to capture a rear image. If the camera lens currently capturing a rear image is the ultra-wide-angle camera lens, the mobile phone switches to using the wide-angle camera lens to capture a rear image.

[0155] In some embodiments, in close-up mode, a panoramic image can be an image captured with the ultra-wide-angle camera lens or the wide-angle camera lens, wherein a close-up image can be a magnified image of a portion of an image captured with the ultra-wide-angle / wide-angle camera lens, or a complete image captured with the long focal length camera lens, a portion of an image captured with the long focal length camera lens, or a magnified image of a portion of an image captured with the long focal length camera lens. The close-up image can display detailed information of a nearby object in magnified form.

[0156] In other words, the panoramic image is an image captured by a first camera lens; that is, the panoramic image originates from the first camera lens, which can be either the ultra-wide-angle or the wide-angle lens. The close-up image can originate from a second camera lens, which can be either the ultra-wide-angle, the wide-angle, or the long focal length lens. The second camera lens can be identical to or different from the first.

[0157] It should be noted that for an image taken by the first camera lens, the mobile phone may perform processing such as image stabilization by cropping a narrow edge area to obtain a higher quality panoramic image.

[0158] In preview mode, the user can still set a zoom level corresponding to a close-up image. Increasing the zoom level also increases the magnification of the close-up image accordingly. Conversely, decreasing the zoom level also decreases the magnification of the close-up image accordingly.

[0159] For example, if the mobile phone detects that the user is tapping on a control 1101, it can... Fig. 11(b) Show zoom ruler 1102, see Fig. 11(a). When the mobile phone detects an up / down swipe operation performed by the user on the zoom ruler 1102, the mobile phone increases / decreases the zoom factor of a close-up image.

[0160] Another one focusing on Fig. Example 12A: When it is detected that the user taps a control 1201, the mobile phone can increase the zoom factor of a close-up image according to a preset step. When it is detected that the user taps a control 1202, the mobile phone can decrease the zoom factor of the close-up image according to the preset step.

[0161] Another one to focus on Fig. The example relating to Article 12B is that the mobile phone can decrease the zoom factor of a close-up image if it detects a pinch gesture from the user. If the mobile phone detects a spread gesture, it can increase the zoom factor of the close-up image.

[0162] By changing the zoom factor of the close-up image, the second camera lens can also be switched between different rear camera lenses. For example, if the close-up image is a picture taken with the ultra-wide-angle lens or a zoomed-in image of a portion of the scene, increasing the zoom factor will switch the close-up image to a picture taken with the wide-angle lens, the long focal length lens, or a zoomed-in image of a portion of the scene. Conversely, if the close-up image is a picture taken with the wide-angle lens, the ultra-wide-angle lens, or a zoomed-in image of a portion of the scene, decreasing the zoom factor will switch the close-up image to a picture taken with the wide-angle lens, the ultra-wide-angle lens, or a zoomed-in image of a portion of the scene.

[0163] In some embodiments, the close-up image is a central area of ​​an image captured by the second camera lens (i.e., a central area of ​​the second camera lens's field of view), or the close-up image is a magnified image of the central area of ​​the image captured by the second camera lens. It can be assumed that rear-facing camera lenses, such as the ultra-wide-angle lens, the wide-angle lens, and the long focal length lens arranged in the mobile phone, are very close to each other, which is why the central areas of the fields of view of these rear-facing camera lenses are generally consistent.More precisely, the photographed objects in the central areas of the images taken by the first camera lens and the second camera lens are generally consistent, with the close-up image potentially corresponding to a central area of ​​the panoramic image.

[0164] Typically, the user selects a focus object or key object of interest in a central area of ​​the field of view, with an image of the focus object or key object usually appearing in a central area of ​​an image captured by the second camera lens. If the close-up image represents the central area of ​​the image captured by the second camera lens, a close-up image of the focus object or key object can be presented to the user to provide detailed information about the focus object or key object.

[0165] If the mobile phone's rear-facing camera system includes an ultra-wide-angle lens, a wide-angle lens, and a long-focal-length lens, the wide-angle lens can be used as the primary camera lens with a medium field of view. The zoom factor, corresponding to an image taken with the primary camera lens, can be 1. The panorama image can be a single image taken with either the wide-angle or the ultra-wide-angle lens.

[0166] For example, in Fig. As shown in Figure 13(a), the first camera lens is the ultra-wide-angle camera lens and the second camera lens is the wide-angle camera lens. A panoramic image in a first area 1301 is an image taken with the ultra-wide-angle camera lens. A close-up image in a second area 1302 is a section in a central area of ​​an image taken by the wide-angle camera lens, where the current zoom factor corresponding to the close-up image is 1.

[0167] In a Fig. 13(a) case shown, where the mobile phone detects that the user has accessed the Fig. 11(a) and Fig. 11(b), Fig. 12A or Fig. As shown in Figure 12B, the mobile phone is instructed to increase the zoom factor, where an increased zoom factor is greater than 1 and less than a first preset value (e.g., 5). Based on the increased zoom factor (e.g., 2) and a size of the second area 1302, the mobile phone crops a portion in a central area of ​​an image captured by the wide-angle camera lens, enlarges the portion, and then displays the portion in the second area 1302, as shown in Figure 12B. Fig. 13(b) shown.

[0168] In a Fig. 13(b) case shown, where the mobile phone detects that the user has accessed the Fig. 11(a) and Fig. 11(b), Fig. 12A or Fig. As shown in Figure 12B, the mobile phone instructs the user to increase the zoom factor, where an increased zoom factor is greater than or equal to the first preset value. The phone then switches the second camera lens from the wide-angle camera lens to the long focal length camera lens, crops a portion from a central area of ​​an image captured by the wide-angle camera lens based on the increased zoom factor (e.g., 6) and the size of the second area 1302, enlarges the portion, and then displays the portion in the second area 1302, as shown in Figure 12B. Fig. 13(c) shown.

[0169] In the Fig. 13(a) case shown, where the mobile phone detects that the user is in the Fig. 11(a) and Fig. 11(b), Fig. 12A or Fig. As shown in 12B, when the user instructs the mobile phone to reduce the zoom factor, where a reduced zoom factor is less than 1 and greater than or equal to a second preset value (e.g., 0.6), the mobile phone switches the second camera lens from the wide-angle camera lens to the ultra-wide-angle camera lens, crops a portion in a central area of ​​an image captured by the wide-angle camera lens based on the reduced zoom factor (e.g., 0.8) and the size of the second area 1302, zooms in on the portion, and then displays the portion in the second area 1302, as shown in Fig. Figure 13(d) shows that in this case, both the panoramic image and the close-up image were taken with the ultra-wide-angle camera lens.

[0170] In other words, if the zoom factor of the close-up image is within the range of (the second preset value) 1, the second camera lens can be the ultra-wide-angle lens. If the zoom factor of the close-up image is within the range of (the first preset value) 1, the second camera lens can be a wide-angle lens. If the zoom factor of the close-up image is greater than or equal to the first preset value, the second camera lens can be a long focal length lens.

[0171] When the user moves the mobile phone, the close-up image changes with the change in a photographed object in the central area of ​​the second camera lens's field of view. In a way that focuses on Fig. In accordance with the technical solution described in section 14, the mobile phone can display a control element 1401 on a panoramic image, which is used to mark a central area of ​​the field of view of a rear camera lens. When the user wants to switch to a close-up view of an object, they can move the mobile phone so that all or a large part of the close-up object is located within the area framed by the control element 1401 on the panoramic image, so that the object is in the central area of ​​the close-up camera lens's field of view, and the close-up image can display enlarged details of the close-up object.

[0172] In some other embodiments, the mobile phone can display a close-up image of a standard object. For example, the standard close-up object could be an object in a central area of ​​a panoramic image. Another example is a person located near the central area. After the user specifies a close-up object, the mobile phone can display a close-up image corresponding to the specified close-up object.

[0173] In some other embodiments, the mobile phone may not initially display a close-up image in the preview state of the multi-channel video recording mode, but may display a close-up image after the user has specified a close-up object.

[0174] In some other embodiments, in the preview state of the multi-channel video recording mode, regardless of whether the mobile phone is displaying a close-up image, the user can specify a close-up object, and the mobile phone will display a corresponding close-up image based on the close-up object specified by the user. For example, as in Fig. As shown in Figure 15(a), the mobile phone prompts the user, using information 1501, to tap a point in a dashed box 1502 to select a close-up object. After the mobile phone detects a tap by the user at a point on a panoramic image, a photographed object corresponding to that point becomes a close-up object. As shown in Figure 15(a), the mobile phone prompts the user, using information 1501, to tap a point in a dashed box 1502 to select a close-up object. Fig. As shown in Figure 15(b), a close-up image is an enlarged image of this location.

[0175] According to one technical solution, a close-up image can be an enlarged image of a portion of a panoramic image, where the close-up image can be a reduced / enlarged image of a close-up object. To avoid a problem when zooming into a close-up image caused by a close-up object being located at the edge of a panoramic image, the user can select a close-up object far from the edge of the panoramic image in the dashed box 1502.

[0176] According to another technical solution, a close-up image can be an enlarged image of a portion of an image captured by the second camera lens, wherein an image in the dashed field 1502 is an image corresponding to the field of view of the second camera lens, and wherein the user can select a close-up object in the dashed field 1502, that is, a close-up object within the field of view of the second camera lens.

[0177] Another example: The mobile phone can prompt the user to tap a target object (e.g., a person, animal, plant, or substance) within a dotted area to select a close-up object. If the mobile phone detects that the user has tapped a person in a panoramic image, that person becomes the close-up object.

[0178] Another example, which relates to Fig. 16A(a) refers to: If the mobile phone detects a user selecting an area on a panoramic image, an object in that area is a close-up object. As in Fig. As shown in 16A(b), a close-up image is an enlarged image of the close-up object.

[0179] Another example: When a mobile phone detects a user selecting an area within a panoramic image, the phone identifies a primary capture target within that area. The primary capture target is a close-up object, and a close-up image is a magnified image of that close-up object.

[0180] Furthermore, similar to specifying a near-field object in a panorama, the user can specify a near-field object in a close-up image. Details are not described again here. For example, if the mobile phone detects an action where the user drags a control 1601 to a location in a close-up image and releases the control, a photographed object corresponding to that location will be a close-up object (see Fig. 16B(a)). As in Fig. As shown in 16B(b), a close-up image is an enlarged image of the close-up object.

[0181] In some other embodiments, when in preview mode of multi-channel video recording, and when N camera lenses are used simultaneously to capture images, the mobile phone can, at the user's instruction, stop displaying an image in at least one area or display only images in M ​​(where M is a positive integer less than N) areas to dynamically display one or more channels of images on which the user wishes to focus. The images in the M areas can adaptively fill the entire display area. Alternatively, the M areas are maintained in an original layout, with an area where no image is to be displayed being empty or displaying a preset background image, desktop background, or similar.

[0182] In Fig. 17(a), for example, is an “×” control arranged in an area containing each image channel. When the mobile phone detects that the user taps an “x” control 1701, the mobile phone can only display one image in an area 1702 and stop displaying an image in an area 1703. As in Fig. As shown in 17(b), the image in area 1701 adaptively occupies the entire touchscreen (i.e., it completely occupies the display area of ​​the entire touchscreen). Alternatively, as shown in Fig. Figure 17(c) shows the size of area 1702 unchanged. In one case, the mobile phone stops displaying the image in the area, while a camera lens corresponding to the area continues to take an image. In another case, the mobile phone stops displaying the image in the area, and the camera lens corresponding to the area stops taking an image.

[0183] In another example, which relates to Fig. 17(d), the mobile phone stops displaying the image in area 1703 when it detects that the user is dragging the image in area 1703 to a boundary and beyond, as described in Fig. 17(b) or Fig. 17(c) shown.

[0184] In another embodiment, the mobile phone can also hide some controls in the preview interface in multi-channel video recording mode to prevent, as far as possible, a preview image from being obscured by the controls, thereby improving the user's visual experience. For example, if the user taps on a Fig. 2(c) When the user taps control 207, the mobile phone can stop displaying a series of controls such as "Wide Angle," "Video Recording," "Photo," "Multi-Channel Video Recording," and "More." After a user tap is detected on the touchscreen, the hidden controls can be displayed again. Another example: If a user interface control is not tapped for a certain period of time, the mobile phone can hide the control to prevent a preview image from being obscured. After a user touch is detected, the hidden control can be displayed again.

[0185] In some other embodiments, the user can adjust additional parameters in the preview state of the multi-channel video recording mode, such as video resolution, filter effects, and the use of a flash. For example, the video resolution is the resolution of the entire image displayed on the touchscreen, where the resolution corresponds to an aspect ratio of N areas after splicing. If an image obtained after splicing the N areas occupies the entire display area of ​​the touchscreen, the resolution corresponds to an aspect ratio of the display area of ​​the touchscreen. For example, if the resolution is 5210×40, 3968×2976, or 3264×2448, the aspect ratio of the touchscreen display area is 4:3. If the resolution is 3968×1984 or 3264×1632, the aspect ratio of the touchscreen display area is 18:9.If the resolution is 2560×1080 or 1680×720, the aspect ratio of the display area on the touchscreen is 21:9. If the resolution is 2976×2976, the aspect ratio of the touchscreen display area is 1:1. In another example, the user can set a resolution that corresponds to an image captured by the various camera lenses, where the resolution corresponds to the aspect ratio of an area in which the image captured by the camera lenses is displayed in the interface.

[0186] As in Fig. As shown in Figure 7(a), the multi-channel video recording preview interface may, for example, include a Control 702, which allows the user to set various filter effects. These filter effects may include, for example, a black and white effect, a whiteboard effect, a posterization effect, a negative effect, and the like.

[0187] In preview mode of multi-channel video recording, after detecting a recording instruction from the user, the mobile phone begins recording multiple video channels, displays a recording screen, and saves the recorded video images. The recording screen can contain N channels of images captured simultaneously by N camera lenses.

[0188] For example, if it is detected in close-up mode that the user is looking at something in Fig. Tapping the recording control 603 shown in 6A allows the mobile phone to record in Fig. 18A(a) or Fig. Display the recording screen shown in 18A(b). The recording screen contains a panoramic image and a close-up image, a control 1801 for controlling the termination of video recording, and a control 1802 for controlling the pause of video recording.

[0189] In particular, in a multi-channel video recording process, the mobile phone can continue to use the N camera lenses that were used in preview state to capture images, with the recording screen displaying images captured simultaneously by the N camera lenses in the video recording process using a display mode used in preview state.

[0190] In some embodiments, similar to setting a camera lens, display mode, or recording mode for multi-channel video recording in the preview state of multi-channel video recording, the user can change at least one of the elements—camera lens, display mode, or recording mode—during a multi-channel video recording process. In a specific case, the mobile phone can dynamically switch to using at least one of these elements—camera lens, display mode, or recording mode—during the ongoing video recording process in order to continue multi-channel video recording. In other words, if the user changes the camera lens, display mode, or recording mode, the mobile phone continues to record video continuously.In another scenario, the mobile phone may pause video recording during a process in which the user changes the camera lens, display mode, or recording mode used for multi-channel video recording, and resume the ongoing video recording after the change is complete. The current video recording process includes multiple video channels recorded based on the camera lens, display mode, or recording mode before the change, as well as multiple video channels recorded based on a changed camera lens, display mode, or recording mode.

[0191] For example, similar to the multi-channel video recording preview interface, as in Fig. 18A(a) and Fig. As shown in Figure 18A(b), a settings control 1803 is displayed on the recording screen. After the user detects a tap on the settings control 1803, the mobile phone can display the settings shown in Figure 18A(b). Fig. 7(a) and Fig. 7(b) Display the settings interface shown, so that the user can conveniently change a camera lens or display type. Another example: Similar to the multi-channel video recording preview interface, a control for setting the camera lens, a control for setting the display mode, or something similar can be displayed on the recording screen, so that the user can change a camera lens or display mode.

[0192] In some other embodiments, similar to the multi-channel video recording preview interface, a toggle control 1804 and a toggle control 1805 may still be displayed on the recording screen. Upon detection of a tap on the toggle control 1804 by the user, the mobile phone switches a camera lens used for capturing a panorama image to the ultra-wide-angle camera lens or the wide-angle camera lens. Upon detection of a tap on the toggle control 1805 by the user, the mobile phone switches between the close-up mode and the front-back mode.

[0193] In some other embodiments, similar to multi-channel video recording preview, the mobile phone can dynamically change a close-up object in close-up mode during a multi-channel video recording process, according to a user instruction, and continue the ongoing video recording based on the changed close-up object. For example, if a close-up image is a central area, the close-up object can be changed by moving the mobile phone. In this way, one and the same generated multi-channel video can contain an image of the original close-up object and an image of a new close-up object.

[0194] In some other embodiments, similar to the preview state of multi-channel video recording, the mobile phone can also change the zoom factor of a close-up image in close-up mode during a multi-channel video recording process, according to a user instruction, and continue the ongoing video recording based on the changed zoom factor. In this way, one and the same multi-channel video generated by the mobile phone can contain close-ups with different zoom factors.

[0195] In particular, similar to the multi-channel video recording preview, if the zoom factors of the close-ups are different, the second camera lenses used for the close-ups will also be different. For example, if, similar to the in Fig. 13(a), Fig. 13(b), Fig. 13(c) and Fig. In the cases shown in 13(d), if the zoom factor of a close-up image is within the range [second preset value, 1), the second camera lens can be the ultra-wide-angle camera lens. If the zoom factor of a close-up image is within the range [first preset value, 1), the second camera lens can be a wide-angle lens. If the zoom factor of a close-up image is greater than or equal to the first preset value, the second camera lens can be a long-focal-length lens.

[0196] Similar to the preview status of multi-channel video recording, a close-up image can be a central area of ​​an image captured by the second camera lens or an enlarged image of the central area.

[0197] In a Fig. In the multi-channel video recording process shown in Figure 18B(a), for example, a panoramic image is taken from the wide-angle camera lens, a zoom factor of a close-up image is 2, and the close-up image is an enlarged image of a central area of ​​an image taken by the wide-angle camera lens. When the mobile phone detects a tap on a control 1806 by the user, the mobile phone increases the zoom factor of the close-up image, i.e., it enlarges the close-up image. As shown in Fig. 18B(b) and Fig. As shown in Figure 18B(c), the zoom factor changes from 2 to 5 on a zoom scale of 1807. To take a close-up, the mobile phone switches to the long focal length camera lens, where the close-up is a central area of ​​an image taken with the long focal length camera lens. An enlarged close-up is shown in Fig. 18B(c) can be seen.

[0198] In some other embodiments, similar to the preview state of multi-channel video recording, the mobile phone can, in a multi-channel video recording process, stop displaying an image in at least one area according to a user instruction, or display only images in M ​​(M is an integer less than N) areas to dynamically display one or more channels of images on which the user wishes to focus.

[0199] In another embodiment, similar to the multi-channel video recording preview, the mobile phone can hide some controls (e.g., the settings control 1801 and the wide-angle control) on the recording screen during multi-channel video recording to prevent the preview image from being obscured by the controls, thus improving the user's visual experience. After a tap is detected on the touchscreen or similar device to instruct the display of the controls, the hidden controls are redisplayed.

[0200] In some other embodiments, the mobile phone can, in a multi-channel video recording process, generate a photograph in accordance with a user instruction by using images currently being captured by N camera lenses, so that the user can save and extract a successful image in a timely manner.

[0201] For example, in a Fig. In the case shown in 18B(a), when the mobile phone detects a double-tap action performed by the user on the touchscreen, currently captured images are saved in a photo format. In a specific case, the mobile phone saves a Fig. Photo shown in 18C. In another case, the mobile phone stores two photos, shown in (a) and (b) in Fig. are shown in 18D.

[0202] Another example: In the Fig. In the case shown in 18B(a), the current panorama image is saved in a photo format when the mobile phone detects a double-tap action performed by the user on the panorama image. Similarly, when the mobile phone detects a double-tap action by the user on the close-up image, the current close-up image is saved in a photo format.

[0203] After detecting a user's termination instruction, the mobile phone ends the ongoing video recording and creates a multi-channel video file. For example, the mobile phone stops the ongoing video recording after it detects that the user has entered a message. Fig. Taps the exit control 1801 shown in 18A(a). As in Fig. As shown in Figure 19, a thumbnail of the generated video file can be displayed in an area represented by a control element 1901. The mobile phone also returns to the preview state of the multi-channel video recording.

[0204] After recording multiple image channels has started, the mobile phone can save the images captured during video recording and a multi-channel video file created after the end of video recording.

[0205] In some embodiments, the mobile phone can combine a plurality of individual images taken by N camera lenses at the same moment into a video image and then store the combined video image to save a plurality of video channels recorded by the N camera lenses as a video file.

[0206] In some other embodiments, the mobile phone can associate a plurality of individual images taken by N camera lenses at the same time and save a corresponding image taken by each camera lens as a video file.

[0207] In some other embodiments, the frame rates of the image capture by the N camera lenses are the same. The mobile phone can save a corresponding image captured by each of the N camera lenses as a video file. The number of individual frames in all video files is the same, with N video files corresponding to the N camera lenses being related to each other.

[0208] In particular, before a video file is created, the mobile phone may perform further processing on an image captured by a camera lens, such as ISP processing, video post-processing and video encoding.

[0209] In some embodiments, the preview image of the generated multi-channel video file can be displayed in a format used when video recording begins. In some other embodiments, the mobile phone can mark the saved multi-channel video file so that the user is conveniently informed that the video file contains multiple video channels. Fig. 20(a) For example, a marker 2002 is displayed on a thumbnail 2001 of a multi-channel video file. In some other embodiments, the mobile phone can store a generated multi-channel video file separately in a specific folder, allowing the user to conveniently manage and search for the multi-channel video file. As in Fig. 20(b) and Fig. As shown in Figure 20(c), when the mobile phone detects that the user is viewing an attribute of a multi-channel video file, it can display parameter information for multiple video channels, such as camera lenses and display modes used when the multiple video channels are recorded, or another video file related to the current video file. Furthermore, if the user changes a camera lens during a video recording process, the parameter information can include a correspondence between a recording time and the corresponding changes (to and from) camera lenses. Similarly, if the user changes a display mode during video recording, the parameter information can include a correspondence between the recording time and the changed display modes (to and from).

[0210] Once a multi-channel video file has been obtained through recording, the mobile phone can play multiple channels of the recorded videos.

[0211] The mobile phone can play multiple video channels depending on the specific characteristics of the generated video file. For example, if, according to the previous storage of the multi-channel video file, a video file is created using individual frames composed of multiple image channels—that is, each frame in the video file contains N sub-frames, each originating from N camera lenses—the mobile phone can play the composited frames directly. If a video file contains multiple frames of related images captured simultaneously by different camera lenses, when playing multiple video channels, the mobile phone displays the multiple frames of related images based on a single display mode within the same interface.When multiple video files are related, the mobile phone plays multiple video channels based on the majority of related video files.

[0212] In some embodiments, when playing multiple video channels, the mobile phone can display video images using a rendering method similar to that used in a video recording process. For example, after detecting a tap from the user, the mobile phone can display video images on a screen that is... Fig. The player control shown in 20(b) in 2003 can play a plurality of video channels and is configured to display multiple video channels. Fig. Displaying 21 playback interfaces.

[0213] In some other embodiments, when playing multiple video channels, the mobile phone can alternatively play video images based on a display mode defined by the user, which differs from that of a video recording process. For example, the user can set a display mode by selecting the option in Fig. 7(a) and Fig. The interface shown in 7(b) is used. If the number n1 (a positive integer) of areas included in the user-specified display mode is less than the number n2 (a positive integer) of areas included in the display mode used during recording, the mobile phone only plays and displays n1 image channels. If the number n1 of areas included in the user-specified display mode is greater than the number n2 of areas included in the display mode used during recording, the mobile phone only plays and displays n2 image channels. The remaining n1-n2 areas remain blank, display a desktop background, or repeatedly display (n1-n2) image channels in the n2 areas.

[0214] In some other embodiments, the mobile phone may, at the user's instruction, also stop displaying an image in one or more areas when playing multiple video channels, or display only one image in one or more areas.

[0215] In some other embodiments, the mobile phone, according to a user instruction, can save an image displayed in a current playback process in a photo format when playing multiple video channels, so that the user can conveniently extract and share a nice moment.

[0216] Furthermore, in some other embodiments, the mobile phone can capture images using N camera lenses in a multi-channel video recording process and, by default, display only one image channel, but generate a video file with multiple video channels corresponding to the N camera lenses. The mobile phone can then play back the multiple video channels based on a preset or user-defined display mode. For example, in front-back mode, the mobile phone displays only a rear image across the entire touchscreen by default, allowing the user to better see the recording status behind the phone. However, a generated video contains both the rear image and a front image.

[0217] In some other embodiments, when a single video channel is being recorded in video recording mode (the single-channel video recording mode), the mobile phone switches to multi-channel video recording mode and resumes the current video recording process when the mobile phone detects a tap on the "Multi-channel Video Recording" control by the user. Similarly, when multiple video channels are being recorded in multi-channel video recording mode (e.g., in a Fig. 18A(a) and Fig. 18(b) case shown). When the mobile phone detects a tap on the “Video Recording” control by the user, the mobile phone enters multi-channel video recording mode and continues the current recording process. In other words, after video recording is complete, a video recorded by the mobile phone may contain two parts: a single-channel video and a multi-channel video.

[0218] In some embodiments, during a preview process or a video recording process of a multi-channel video recording, N images captured by N camera lenses and simultaneously displayed in the mobile phone's interface can be images captured by the N camera lenses at the same time. Alternatively, in some other embodiments, N images captured by N camera lenses and simultaneously displayed in the mobile phone's interface can be images captured by the N camera lenses over the same period T. For example, the N camera lenses are the wide-angle camera lens and the long-focal-length camera lens, wherein the wide-angle camera lens and the long-focal-length camera lens capture images based on a preset period T.During the same time period T, the wide-angle camera lens first captures an image 1, followed by the long-focal-length camera lens capturing an image 2. The images displayed on the mobile phone's interface comprise image 1 and image 2. When the captured images are saved, the images taken by the N camera lenses during the same time period are related and can be combined into a single video frame for storage.

[0219] The foregoing descriptions were given using an example in which the mobile phone performs multi-channel video recording using N camera lenses. In another embodiment, the mobile phone, using N camera lenses, can also perform multi-channel photography to record images corresponding to different areas or definitions at the same moment or in the same scene, or to record images of a photographer and a photographed object at the same moment or in the same scene. Similar to the multi-channel video recording, the mobile phone can simultaneously display multiple channels of images captured by the N camera lenses in the interface and based on a display mode, and store the plurality of image channels. Details are not described again here.An example of a photography preview interface in a multi-channel photo mode can be found in . Fig. 22.

[0220] With reference to the foregoing embodiments and the corresponding accompanying drawings, a further embodiment of this application provides for a multi-channel video recording method. The method can be implemented in an electronic device with the Fig. The structure shown in Figure 1 can be implemented. The electronic device can include a screen and multiple camera lenses. With reference to Fig. 23A and Fig. 23B, the procedure may consist of the following steps. 2301. The electronic device starts a camera.

[0221] For example, the electronic device can start the camera after it detects that a user has entered the... Fig. 2(a) taps the control 201 shown. 2302. The electronic device captures images using a first camera lens and a second camera lens from a plurality of camera lenses, wherein the first camera lens is a rearward-facing wide-angle camera lens or a rearward-facing ultra-wide-angle camera lens, and the second camera lens is the wide-angle camera lens, the ultra-wide-angle camera lens, or a rearward-facing camera lens with a long focal length. 2303. The electronic device displays a preview interface, the preview interface containing a first image and a second image; the first image is an image captured by the first camera lens, while the second image is from the second camera lens, and the second image corresponds to a central region of an image captured by the second camera lens. The first image is located in a first region of the preview interface, and the second image is located in a second region of the preview interface.

[0222] In particular, the second image can be the central area of ​​the image captured by the second camera lens, or the second image can be an enlarged image of the central area of ​​the image captured by the second camera lens.

[0223] For example, the preview interface can be used in Fig. 2(c), Fig. 6A, Fig. The interface shown is 6B or similar. A first object could be a little girl jumping. The first area could be the one in Fig. 2(c) area 205, while the second area of ​​the in Fig. 2(c) shown area 206. The first image can be a panoramic image displayed in the first area. The second image can be a close-up image displayed in the second area, where the close-up image is an image of the little girl who is jumping. 2304. The electronic device begins video recording after it has recognized a video recording instruction from a user.

[0224] For example, the electronic device can, after detecting that the user has entered the Fig. 6A, when the recording control 603 shown is tapped, determine that the user is instructing the recording of videos, and therefore start the video recording. 2305. The electronic device displays a recording screen, the recording screen having the first area and the second area.

[0225] The recording screen can, for example, display the in Fig. 18A(a) and Fig. 18A(b) or Fig. 18B(a), Fig. 18B(b) and Fig. The interface shown in Figure 18B(c) is shown. A panoramic image on the capture screen is located in the first area, while a close-up image on the capture screen is located in the second area.

[0226] In the solution described in steps 2301 to 2305, the electronic device can capture images simultaneously by using the long focal length camera lens and the wide-angle camera lens or the ultra-wide-angle camera lens, which have different fields of view, to obtain a panoramic image and a close-up image, corresponding to different areas and different zoom levels at the same moment or in the same scene, in order to present a greater amount of image information to the user.

[0227] Since the user typically locates a focus object or a key object in a central area of ​​the field of view, an image of the focus object or key object is usually displayed in a central area of ​​an image captured by the second camera lens. In this embodiment of this application, where the close-up image is the central area of ​​the image captured by the second camera lens, a close-up image of the focus object or key object can be presented to the user to provide the user with detailed information about the focus object or key object.

[0228] In some embodiments, the aspect ratio of the first area is equal to the image output ratio of a light-sensitive element of the first camera lens, thus ensuring that the panoramic image has a maximum field of view. Furthermore, the area formed after splicing the first and second areas completely occupies a display area of ​​the screen. In this way, the display screen can be used to its fullest extent for presenting the images to the user.

[0229] In some other embodiments, the preview interface includes a first control element, and the method may further comprise the following steps: 2306. After detecting an actuation performed by the user on the first control element, if the first image displayed in the first area is an image captured by the wide-angle camera lens, the electronic device switches the first image to an image captured by the ultra-wide-angle camera lens. 2307. After the electronic device detects an actuation performed by the user on the first control element, the electronic device switches the first image to an image taken with the wide-angle lens if the first image displayed in the first area is an image taken with the ultra-wide-angle lens.

[0230] The first control element could be, for example, the one in Fig. The control element 601 shown in 6A. The first image taken with the wide-angle lens can be the one shown in Fig. The panoramic image shown in 6A is the first image taken with the ultra-wide-angle lens, while the image shown in Fig. The panoramic image shown in 6E may be.

[0231] In some other embodiments, the preview interface includes a second control element, and the method may further include the following steps. 2308. The majority of camera lenses included in the electronic device further comprise a forward-facing camera lens. Upon detecting an actuation by the user on the second control element, the electronic device switches the second image displayed in the second area to an image captured by the forward-facing camera lens.

[0232] The second control element can, for example, be the one in Fig. The control element shown in 6A is 602. The second image shown in the second area can be the one in Fig. The close-up image shown in 6A is the image captured by the forward-facing camera lens and displayed in the second area. Fig. 6C shows the front view. 2309. When the electronic device detects another action performed by the user on the second control element, it switches to the second image captured by the forward-facing camera lens and displayed in the second area.

[0233] In some other embodiments, the method may also include the following step prior to step 2303: 2310. The electronic device performs image stabilization processing on each image captured by the first camera lens and the second camera lens.

[0234] In this way, the electronic device can obtain a clear image through image stabilization processing and then display the clear image.

[0235] In some other embodiments, the method may also include the following step: 2311. The electronic device, after detecting a preset user action, sets a video resolution, the video resolution corresponding to an aspect ratio of an area formed after splicing the first and second areas.

[0236] For descriptions of the video resolution, please refer to the corresponding descriptions in the preceding embodiments. Details are not described again here.

[0237] In some other embodiments, the recording screen includes a third control element, and the method may further comprise the following steps: 2312. The electronic device sets a zoom factor of the second image in the second area after it has detected an operation performed by the user on the third control element.

[0238] When the zoom factor is set to 1, the second camera lens is the wide-angle lens, and the second image is a central area of ​​the image captured by the wide-angle lens. When the zoom factor is greater than 1 and less than a first preset value, the second camera lens is the wide-angle lens, and the second image is a magnified image of a central area of ​​the image captured by the wide-angle lens. When the zoom factor is equal to the first preset value, the second camera lens is the long-focal-length lens, and the second image is a central area of ​​an image captured by the long-focal-length lens.If the set zoom factor is greater than the first preset value, the second camera lens is the long focal length lens, and the second image is a magnified image of a central area of ​​an image captured with the long focal length lens. If a set zoom factor is less than 1 and greater than a second preset value, the second camera lens is the ultra-wide-angle lens, and the second image is a zoomed-in image of a central area of ​​the image captured with the ultra-wide-angle lens. If the set zoom factor is equal to the second preset value, the second camera lens is the ultra-wide-angle lens, and the second image is a central area of ​​the image captured with the ultra-wide-angle lens.

[0239] In other words, the electronic device can switch the second camera lens to the wide-angle camera lens, the long focal length camera lens, or the ultra-wide-angle camera lens based on different zoom factors.

[0240] For example, the third control can be the one in Fig. 18B(a) control element 1806 shown, which is in Fig. 18B(b) shown control element 1807 or similar. 2313. The electronic device displays the second image in the second area based on a set zoom factor.

[0241] A schematic diagram of an effect corresponding to a zoom factor setting in a video recording process is shown, for example, in the [reference to diagram]. Fig. 18B(a), Fig. 18B(b) and Fig. The close-up image shown in Figure 18B(c) illustrates this. A schematic diagram of an effect corresponding to a zoom factor setting in a preview state is shown in the close-up in Figure 18B(c). Fig. 13(a), Fig. 13(b), Fig. 13(c) and Fig. 13(d) shown.

[0242] In some other embodiments, the method may also include the following steps. 2314. The electronic device stops video recording after it detects a termination instruction from the user.

[0243] For example, the electronic device stops after detecting a tap from the user at the point in Fig. Termination control 1801 shown in 18A(a) indicates an ongoing video recording process. 2315. The electronic device generates a video file.

[0244] In some embodiments, each frame in the video file contains a first partial frame and a second partial frame, wherein the first partial frame is the first frame and the second partial frame is the second frame, or is the frame that was captured from the plurality of camera lenses by the forward-facing camera lens.

[0245] In some other embodiments, the electronic device can splice the first partial image and the second partial image before step 2303 and then display the first partial image and the second partial image.

[0246] After splicing the partial images, the electronic device can perform further processing, such as encoding using an encoder, and then generate a video file. 2316. The electronic device displays a playback interface after it has detected a playback operation performed by the user on the video file, the playback interface comprising the first area and the second area.

[0247] The playback interface can, for example, be the one in Fig. The interface shown is 22. The first area displays an image in which a small boy, a small girl, a toy vehicle, and a puppy are arranged side by side, while the second area displays an enlarged image of the small girl.

[0248] It should be noted that the foregoing description is mainly based on an example in which a rear panoramic image is displayed on the left side of the interface, and a rear close-up image and a front image are displayed on the right side of the interface. The display locations of the rear panoramic image, the rear close-up image, and the front image are not expressly limited to this embodiment of this application. For example, the rear panoramic image could alternatively be displayed on the right side of the interface, and the rear close-up image and the front image on the left side of the interface.

[0249] Another embodiment of this application provides an electronic device comprising: one or more camera lenses configured to capture an image; one or more display screens configured to display an interface; one or more processors; one or more memory units; and one or more computer programs, wherein the one or more computer programs are stored in the memory and the one or more computer programs contain an instruction; wherein, when the instruction is executed by the processor, the electronic device is enabled to perform the multi-channel video recording method of the preceding embodiment.

[0250] If the electronic device is, for example, the one in Fig. The mobile phone shown in section 1 is the processor of the electronic device, the processor 110 in Fig. 1, the memory can be the internal memory 121 in Fig. 1 be, the display screen can be the display screen 194 in Fig. 1 be, and the N camera lenses can be the camera lenses 193 in Fig. 1. One or more computer programs are stored in the internal memory 121, wherein one or more computer programs contain an instruction. When the instruction is executed by the processor 110, the mobile phone is able to perform the multi-channel video recording method according to the preceding embodiment.

[0251] One embodiment of this application further provides a computer storage medium, wherein the computer storage medium stores a computer instruction, wherein, when the computer instruction is executed on an electronic device, the electronic device is enabled to perform the steps described above in order to implement the multi-channel video recording method in the aforementioned embodiment.

[0252] One embodiment of this application further provides a computer program product wherein, when the computer program product is executed on a computer, the computer is enabled to perform the steps described above in order to implement the multi-channel video recording method in the embodiment described above.

[0253] Furthermore, one embodiment of this application provides a device. The device may, in particular, be a chip, a component, or a module. The device may include a processor and a memory connected to each other. The memory is configured to store a computer-executable instruction. When the device is running, the processor can execute the computer-executable instruction stored in the memory to enable the chip to perform the multi-channel video recording method according to the preceding method descriptions.

[0254] The electronic device, computer storage medium, computer program product, and chip provided in the embodiments of this application are all configured to perform the associated method described above. Therefore, for advantageous effects that can be achieved by the electronic device, computer storage medium, computer program product, and chip, reference is made to the advantageous effects of the corresponding method described above. Details are not described again here.

[0255] Based on the description of the above implementation methods, it is clear to the average person skilled in the art that the division of the above functional modules is taken as an example for the purpose of a concise and accessible description. In actual application, the aforementioned functions can be assigned to different modules and implemented according to requirements; that is, the internal structure of a device can be divided into different functional modules to implement all or some of the functions described above.

[0256] In the various embodiments described in this application, the disclosed device and method can also be implemented in other ways. For example, the described embodiment of the device is merely an example. For instance, the division into modules or units is merely a logical functional division and may be a different division in the actual implementation. For example, a plurality of units or components may be combined or integrated into a different device, or some functions may be ignored or not executed. Furthermore, the mutual couplings or direct couplings or communication links shown or discussed can be implemented by using certain interfaces.The indirect couplings or communication links between the devices or units can be implemented in electronic, mechanical or other forms.

[0257] The units described as separate parts may or may not be physically separate, and the parts represented as units may be one or more physical units located in one place or distributed across different locations. Some or all of the units can be selected based on the actual requirements to achieve the solution objectives of the embodiments.

[0258] Furthermore, in the embodiments of this application, the functional units can be integrated into a processing unit, or each unit can exist physically on its own, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0259] If the integrated unit is implemented in the form of a software functional unit and is sold or used as an independent product, the integrated unit may be stored in a readable storage medium. Based on such an understanding, the technical solutions of this application may be implemented substantially, or the part contributing to the prior art, or all or some of the technical solutions, in the form of a software product. The software product is stored in a storage medium and contains several instructions for instructing a device (which may be a single-chip microcomputer, a chip, or the like) or a processor to perform all or some of the steps of the methods described in the embodiments of this application. The aforementioned storage medium includes: any medium capable of storing program code, such as...a USB flash drive, a removable hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0260] The foregoing descriptions are merely specific embodiments of this application and are not intended to limit the scope of protection of this application. Any modification or substitution within the technical field disclosed in this application falls within the scope of protection of this application. Therefore, the scope of protection of this application is subject to the scope of protection of the claims. QUOTES CONTAINED IN THE DESCRIPTION

[0000] This list of documents submitted by the applicant was generated automatically and is included solely for the convenience of the reader. This list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions. Cited patent literature

[0000] 201910205090.0

[0001]

Claims

[1] An electronic device comprising: a plurality of cameras configured to capture an image; one or more display screens configured to display an interface; one or more processors; one or more memories; and one or more computer programs, wherein the one or more computer programs are stored in the memory and the one or more computer programs comprise an instruction; wherein, when the instruction is executed by the processor, the electronic device is capable of performing the following steps: Starting a camera application; Capturing images using a first camera and a second camera of a plurality of cameras, wherein the first camera is a rear-facing wide-angle camera or a rear-facing ultra-wide-angle camera, and the second camera is the wide-angle camera, the ultra-wide-angle camera, or a rear-facing long-focus camera; Displaying a preview interface of the camera application, the preview interface comprising a first image and a second image; the first image is an image captured by the first camera, the second image is from the second camera, and the second image corresponds to a central region of an image captured by the second camera; and the first image is arranged in a first region of the preview interface and the second image is arranged in a second region of the preview interface; Starting a video recording after detecting a video recording instruction actuation; and Displaying a recording screen, the recording screen comprising the first area and the second area. [2] The electronic device according to claim 1, wherein the second image is a central region of the image captured by the second camera, or the second image is an enlarged image of the central region of the image captured by the second camera. [3] The electronic device according to claim 1 or 2, wherein an aspect ratio of the first region is equal to an image output ratio of a photosensitive element of the first camera, and a region formed after the first region and the second region are spliced ​​completely occupies a display area of ​​the display screen. [4] The electronic device according to any one of claims 1 to 3, wherein the recording screen comprises a third control element and, upon execution of the instruction by the processor, the electronic device is further capable of performing the following steps: Setting a zoom factor of the second image in the second area after detecting an operation performed on the third control element, wherein if a set zoom factor is equal to 1, the second camera is the wide-angle camera, and the second image is a central area of ​​the image captured by the wide-angle camera; or if a set zoom factor is greater than 1 and less than a first preset value, the second camera is the wide-angle camera, and the second image is an enlarged image of a central area of ​​the image captured by the wide-angle camera; or if a set zoom factor is equal to a first preset value, the second camera is the long-focus camera, and the second image is a central area of ​​an image captured by the long-focus camera; or if a set zoom factor is greater than the first preset value, the second camera is the long-focus camera, and the second image is an enlarged image of a central area of ​​an image captured by the long-focus camera; or if a set zoom factor is less than 1 and greater than a second preset value, the second camera is the ultra-wide-angle camera, and the second image is an enlarged image of a central area of ​​the image captured by the ultra-wide-angle camera; or when a set zoom factor is equal to a second preset value, the second camera is the ultra-wide-angle camera, and the second image is a central area of ​​the image captured by the ultra-wide-angle camera; and Display the second image in the second area based on the set zoom factor. [5] An electronic device comprising: a plurality of cameras configured to capture an image; one or more display screens configured to display an interface; one or more processors; one or more memories; and one or more computer programs, wherein the one or more computer programs are stored in the memory and the one or more computer programs comprise an instruction; and when the instruction is executed by the processor, the electronic device is capable of performing the following steps: Displaying, by the electronic device, a first preview interface of a camera application, wherein the first preview interface comprises N display areas displaying images captured by the plurality of cameras of the electronic device, wherein the plurality of cameras comprises at least one rear-facing camera and one front-facing camera, and N is a positive integer greater than 2; in response to a first instruction input on the first preview interface by a user, replacing the first preview interface with a second preview interface of the camera application, wherein the second preview interface comprises a capture control and M display areas that display images of the plurality of cameras based on the selection of the N display areas and that adaptively completely occupy the second preview interface, and the M display areas are configured to display images captured by the rear-facing camera and the front-facing camera, respectively, and M is a positive integer less than N; in response to receiving an instruction performed by the user on the recording control, Starting, by the electronic device, a video recording capturing M video stream channels captured by the plurality of cameras, each of the M channels corresponding to a respective one of the M display areas, and Displaying a recording screen that includes the M display areas and an exit control; Generating at least one video file in response to receiving an instruction performed by the user on the exit control. [6] The electronic device of claim 5, wherein generating at least one video file comprises: Combining the M video stream channels into one video stream channel, encoding the one video stream channel, and generating a video file, the video file comprising the images captured by the rear-facing camera and the front-facing camera of the electronic device. [7] The electronic device of claim 5, wherein generating at least one video file comprises: Creating M different video files, each of the M different video files corresponding to one of the plurality of cameras. [8] The electronic device according to any one of claims 5 to 7, wherein, when the instruction is executed by the processor, the electronic device is enabled to perform the following further steps before displaying the first preview interface of a camera application: displaying, by the electronic device, a photography preview interface, the photography preview interface comprising a first control element; in response to detecting an actuation on the first control, displaying a settings interface, the settings interface comprising a second control; in response to detecting an actuation of the second control, invoking a multi-channel video recording mode. [9] The electronic device according to any one of claims 5 to 8, wherein one display area of ​​the M display areas floats over another display area of ​​the M display areas on the recording screen. [10] The electronic device of claim 9, wherein when the instruction is executed by the processor, the electronic device is enabled to perform the following further steps: Capturing a third instruction input from a user; in response to the third instruction, dragging one of the M display areas onto the recording screen. [11] The electronic device according to any one of claims 5 to 10, wherein the first preview interface comprises a third control element and the first instruction comprises a tap operation on the third control element. [12] The electronic device according to any one of claims 5 to 11, wherein upon execution of the instruction by the processor, the electronic device is enabled to perform the following further steps: Setting a video resolution in response to a preset user actuation on the second preview interface. [13] The electronic device according to any one of claims 5 to 12, wherein the M display areas are 2 display areas. [14] An electronic device comprising: a plurality of cameras configured to capture an image; one or more display screens configured to display an interface; one or more processors; one or more memories; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and the one or more computer programs include an instruction; and, when the instruction is executed by the processor, the electronic device is capable of performing the following steps: Displaying, by the electronic device, a first preview interface of a camera application, wherein the first preview interface comprises N display areas and the N display areas comprise two display areas displaying two images captured by the same camera of the electronic device, wherein one image of the two images is an enlarged image of a portion of another image of the two images, and N is a positive integer greater than or equal to 2; in response to a first instruction input on the first preview interface by a user, replacing the first preview interface with a second preview interface of the camera application, the second preview interface having a capture control and M display areas that display images based on the selection of the N display areas and that adaptively completely occupy the second preview interface, and at least one of the M display areas is configured to display an image captured by a rear-facing camera of the electronic device, where M is a positive integer less than N; in response to the detection of an instruction performed by the user on the recording control, Start a video recording and display a recording screen that includes the M display areas and an end control; in response to detecting an instruction performed by the user on the exit control, generating at least one video file. [15] The electronic device of claim 14, wherein, when the instruction is executed by the processor, the electronic device is enabled to perform the following further steps before displaying the first preview interface of a camera application: displaying, by the electronic device, a photography preview interface, the photography preview interface comprising a first control element; in response to detecting an actuation on the first control, displaying a settings interface, the settings interface comprising a second control; in response to detecting an actuation of the second control, invoking a multi-channel video recording mode. [16] The electronic device of claim 14, wherein starting a video recording comprises: Starting, by the electronic device, a video recording in which M video stream channels captured by at least one rear-facing camera of the electronic device are recorded, each of the M channels corresponding to one of the M display areas. [17] The electronic device of claim 16, wherein generating at least one video file comprises: Combining the M video stream channels into one video stream channel, encoding the one video stream channel, and generating a video file, the video file comprising the images captured by the rear-facing camera of the electronic device. [18] The electronic device of claim 14, wherein generating at least one video file comprises: Creating M different video files, where each of the M different video files corresponds to one of the M display areas. [19] The electronic device according to any one of claims 14 to 18, wherein the same camera is a rear-facing ultra-wide angle camera. [20] The electronic device according to any one of claims 14 to 19, wherein upon execution of the instruction by the processor, the electronic device is enabled to perform the following further steps: Setting a video resolution in response to a preset user actuation on the second preview interface. [21] The electronic device according to any one of claims 14 to 20, wherein M display areas is 1 display area.

Citation Information

Patent Citations

  • A multi-channel recording method, device, and medium

    CN110072070B