A method of photographing a video and an electronic device

Abstract

Embodiments of the present application provide a method for shooting a video and an electronic device, and relate to the technical field of terminals. The method is applied to an electronic device including a display screen, a first camera and a second camera. The first camera and the second camera are located at different sides of the display screen, and the first camera and the display screen are located at the same side of the electronic device. The method includes: displaying a first image from the first camera in a first area of the display screen, and displaying a second image from the second camera in a second area of the display screen, wherein the second area is the entire display area of the display screen, and the first area is smaller than the second area; in response to a detected user operation, gradually changing the opacity of the displayed first image in the first area from a second opacity to a first opacity; displaying a third image in a third area of the display screen, the third image being the second image collected by the second camera in real time, and the third area of the display screen being the entire display area of the display screen.

Description

[0001] This application claims priority to the Chinese Patent Application No. 202110676709.3, filed on June 16, 2021, entitled "A User Video Creation Method Based on Storyline Mode and Electronic Device", and the Chinese Patent Application No. 202111437971.9, filed on November 29, 2021, entitled "A Method for Capturing Video and Electronic Device", both of which are incorporated by reference in their entirety. TECHNICAL FIELD

[0002] The present application relates to the technical field of terminals, and in particular to a method for capturing video and an electronic device. BACKGROUND

[0003] With the development of electronic technology, electronic devices such as mobile phones and tablet computers are generally equipped with multiple cameras, such as front cameras, rear cameras, wide-angle cameras, and the like. In order to bring further shooting creation experience, more and more electronic devices can support multiple cameras to shoot at the same time, and users can select the corresponding shooting mode according to their own needs, for example, front shooting mode, rear shooting mode, front and rear shooting mode, picture-in-picture shooting mode, and the like. Thus, wonderful moments, moving scenes, and the like can be recorded.

[0004] In the process of video shooting, the user may need to switch the shooting mode, for example, switching the front and rear shooting mode to the picture-in-picture shooting mode. However, when switching between different shooting modes, the picture data collected by the different cameras of the electronic device has a certain delay when displayed on the shooting preview interface. When the user switches between different shooting modes, if the picture data collected by the cameras corresponding to various modes is directly displayed, the picture switching in the shooting preview interface will appear stiff when the mode is switched, and even a "stuttering" visual effect will occur, affecting the user experience. SUMMARY

[0005] The present application provides a method for capturing video and an electronic device. The method for capturing video can support the electronic device to perform animation processing when switching the display picture in the shooting preview interface when switching the shooting mode, so that the display picture in the shooting preview interface appears more smooth and lively when switching, improving the user experience.

[0006] In a first aspect, the present application provides a method for capturing video, which is applied to an electronic device including a display screen, a first camera and a second camera. The first camera and the second camera are located at different sides of the display screen. The method includes:

[0007] The first area of the display screen displays a first image collected in real time from a first camera, and the second area of the display screen displays a second image collected in real time from a second camera, wherein the second area is the entire display area of the display screen, and the first area is smaller than the second area.

[0008] In response to the detected user operation, the opacity of the first image displayed in the first area gradually decreases from the second opacity to the first opacity.

[0009] The third area of the display screen displays a third image, and the third image is the second image collected in real time by the second camera, and the third area of the display screen is the entire display area of the display screen.

[0010] On this basis, the photographing method provided in the embodiments of the present application displays the first image and the second image in the first area and the second area of the display screen before detecting the user operation, which is one display screen. After detecting the user operation, the last display screen of the display screen displays the second image in the third area of the display screen, which is another display screen. That is, before and after detecting the user operation, the display screen on the display screen switches from one display screen to another display screen. The present application changes the opacity of the first image displayed in the first area after detecting the user operation, and the part of the display content serves as a transition animation in the switching process of the display screen of the display screen, that is, the transition animation is added when the display screen on the display screen switches from one display screen to another display screen, and the transition animation is a dynamic display screen for transitioning from the above-mentioned one display screen to another display screen. By adding the transition animation when switching the screen, the smoothness of the screen switching is improved. The embodiments of the present application show a specific switching of the display screen, that is, switching from the picture-in-picture display mode to the full-screen display mode.

[0011] In a possible design manner of the first aspect, after responding to the detected user operation, the method further includes:

[0012] In the first time period, the first area displays the first image collected by the first camera when the user operation is detected, the second area displays the second image collected by the second camera when the user operation is detected, the first image is superimposed on the second image, and the opacity of the first image displayed in the first area gradually decreases from the second opacity to the first opacity.

[0013] In the second time period, the third area displays the second image collected by the second camera when the user operation is detected and the third image, and the second image is superimposed on the third image.

[0014] On this basis, the process of switching the picture on the display screen from one display picture to another display picture is divided into two stages, that is, in the first time period, the first image and the second image are displayed in the display mode before picture switching (picture-in-picture display mode), and a transition transition animation is displayed. In the second time period, the second image is displayed in the display mode after switching (full screen display mode), and at this time the second image is overlaid with the third image, so that the transition animation can be smoothly transitioned to the display mode after switching, to improve the smoothness of picture switching.

[0015] In a possible design manner of the first aspect, in the first time period, the Gaussian blur value of the first image gradually increases according to the first curve, and in the first time period and the second time period, the Gaussian blur value of the second image gradually increases according to the first curve.

[0016] On this basis, by setting the Gaussian blur value of the first image to gradually increase in the first time period, and the Gaussian blur value of the second image to gradually increase in the first time period and the second time period, this is a specific animation processing manner in the transition animation, which can make the display picture more natural when loading real-time image data in the display area where the second image is located.

[0017] In a possible design manner of the first aspect, the opacity of the first image displayed in the first area gradually decreases from the second opacity to the first opacity according to the second curve.

[0018] On this basis, by setting the second curve as the reference for the change of the transparency of the first image, by selecting a suitable second curve, the change of the picture transparency in the transition animation can be more natural, and the visual experience of the user can be improved.

[0019] In a possible design manner of the first aspect, before displaying the third image in the third area of the display screen, the method further includes:

[0020] In the second time period, the opacity of the second image gradually decreases from the second opacity to the first opacity according to the second curve.

[0021] On this basis, by setting the opacity of the second image to gradually decrease, the second image gradually becomes transparent, the third image covered by the second image is gradually displayed on the screen, the third image is clearly displayed in the fifth area, the display of the transition animation to the display picture after switching is completed, and the third image is displayed in the display mode after switching.

[0022] In a second aspect, the embodiments of the present application provide a method for shooting a video, which is applied to an electronic device including a display screen, a first camera and a second camera, the first camera and the second camera are located at different sides of the display screen, and the method includes:

[0023] The first area of the display screen displays a first image collected in real time from a first camera, or displays a second image collected in real time from a second camera, wherein the first area is the entire display area of the display screen.

[0024] In response to the detected user operation, the second area of the display screen displays a pre-prepared picture, and the opacity of the pre-prepared picture gradually changes from the first opacity to the second opacity.

[0025] The second area of the display screen displays a first image collected in real time from a first camera, and the third area of the display screen displays a second image collected in real time from a second camera, wherein the third area is the entire display area of the display screen, and the second area is smaller than the third area.

[0026] On this basis, the embodiment of the present application shows another specific display screen switching, i.e., switching from a full-screen display mode to a picture-in-picture display mode, and the display mode of the transition animation can be the picture-in-picture display mode. The embodiment and the technical effects in possible design manners are the mirror image of the change process of the embodiment provided in the first aspect, and the beneficial effects can be referred to the beneficial effects introduced in the first aspect and possible design manners, which will not be described herein.

[0027] In a possible design manner of the second aspect, after responding to the detected user operation, the method further includes:

[0028] In the first time period, the first area displays a third image, the third image is a first image collected by the first camera when the user operation is detected, or the third image is a second image collected by the second camera when the user operation is detected, and the second area of the display screen displays a pre-prepared picture, and the opacity of the pre-prepared picture gradually changes from the first opacity to the second opacity.

[0029] In the second time period, the second area displays the pre-prepared picture and the first image collected in real time by the first camera, wherein the pre-prepared picture is superimposed on the first image, and the third area displays the third image and the second image collected by the second camera, wherein the third image is superimposed on the second image.

[0030] In a possible design manner of the second aspect, in the first time period, the Gaussian blur value of the third image gradually changes according to the first curve.

[0031] In a possible design manner of the second aspect, the opacity of the pre-prepared picture gradually changes from the first opacity to the second opacity according to the second curve.

[0032] In a possible design of the second aspect, before displaying the first image captured in real time by the first camera in the second region of the display screen and displaying the second image captured in real time by the second camera in the third region of the display screen, the method further includes:

[0033] In the second time period, the opacity of the pre-prepared picture gradually decreases from the second opacity to the first opacity according to a second curve;

[0034] In the second time period, the opacity of the third image gradually decreases from the second opacity to the first opacity according to a second curve.

[0035] In a third aspect, an embodiment of the present application provides an electronic device, including a memory for storing computer program instructions and a processor for executing the program instructions, wherein when the computer program instructions are executed by the processor, the electronic device is triggered to perform the method in the first aspect / second aspect and any possible design of the first aspect / second aspect.

[0036] In a fourth aspect, an embodiment of the present application provides a computer readable storage medium, including a stored program, wherein when the program is running, the computer readable storage medium controls a device where the computer readable storage medium is located to perform the method in the first aspect / second aspect and any possible design of the first aspect / second aspect.

[0037] In a fifth aspect, an embodiment of the present application provides a computer program product, including executable instructions, when the executable instructions are executed on a computer, the computer is caused to perform the method in the first aspect / second aspect and any possible design of the first aspect / second aspect.

[0038] It can be understood that the electronic device provided in the third aspect, the computer readable storage medium provided in the fourth aspect, and the computer program product provided in the fifth aspect can achieve the beneficial effects as described in the first aspect / second aspect and any possible design of the first aspect / second aspect, which will not be described here. BRIEF DESCRIPTION OF DRAWINGS

[0039] FIG. 1A A hardware architecture diagram of the electronic device provided in an embodiment of the present application is shown in FIG. 1;

[0040] FIG. 1B A software architecture diagram of the electronic device provided in an embodiment of the present application is shown in FIG. 2;

[0041] FIGS. 2A-2C A set of user interface diagrams provided in an embodiment of the present application is shown in FIG. 3;

[0042] FIG. 3 A shooting scene diagram provided in an embodiment of the present application is shown in FIG. 4;

[0043] FIGS. 4A-4E Another set of interface schematic diagrams provided for the embodiments of the present application;

[0044] FIGS. 5A-5K Another set of interface schematic diagrams provided for the embodiments of the present application;

[0045] FIGS. 6A-6F Another set of interface schematic diagrams provided for the embodiments of the present application;

[0046] FIGS. 7A-7B Another set of interface schematic diagrams provided for the embodiments of the present application;

[0047] FIG. 8A Another set of interface schematic diagrams provided for the embodiments of the present application;

[0048] FIGS. 8B-8F Another set of interface schematic diagrams provided for the embodiments of the present application;

[0049] FIG. 9A 、 FIG. 9B A set of curve schematic diagrams provided for the embodiments of the present application;

[0050] FIG. 10A Another set of interface schematic diagrams provided for the embodiments of the present application;

[0051] FIGS. 10B-10F Another set of interface schematic diagrams provided for the embodiments of the present application. DETAILED DESCRIPTION

[0052] The terms used in the following embodiments of the present application are only for the purpose of describing the specific embodiments and are not intended to be limiting of the present application. As used in the specification and the appended claims of the present application, the singular forms "a," "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and / or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and / or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof. In addition, it will be understood that the term "and / or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated items, for example, the phrase "A and / or B" means one or both of A and B can be present.

[0053] The technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings.

[0054] Reference to“an embodiment” or“the embodiment” in this application means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase“in one embodiment” or“in at least one embodiment” in various places in the specification are not necessarily all referring to the same embodiment, nor are they necessarily all referring to a common embodiment, or an embodiment that is independent of all other embodiments. One of ordinary skill in the art will readily recognize from the disclosure herein the possibility of combining features of different embodiments.

[0055] The terms“first”,“second”,“third”, etc. in the following embodiments of the present application are used only for the purpose of description, and should not be understood as implying or suggesting relative importance or implicitly indicating the number of the technical features indicated. Therefore, the features defined with“first”,“second”, etc. can explicitly or implicitly include one or more of the features, and in the description of the embodiments of the present application, the meaning of“a plurality of” is two or more, unless otherwise specified.

[0056] The term“user interface (UI)” in the following embodiments of the present application is a medium interface for interaction and information exchange between an application or an operating system and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. The user interface is source code written in a specific computer language such as Java, extensible markup language (XML), etc., and the interface source code is parsed, rendered, and finally presented as content recognizable by the user on the electronic device. The commonly used form of user interface is graphic user interface (GUI), which refers to a user interface related to computer operation displayed in a graphical manner. It can be a visual interface element such as text, icon, button, menu, tab, text box, dialog box, status bar, navigation bar, Widget, etc. displayed in the display screen of the electronic device.

[0057] For the sake of clear and concise description of the following embodiments and easy understanding by those skilled in the art, a brief introduction of related concepts or technologies is first given.

[0058] The shooting preview interface refers to the interface displayed by the electronic device during shooting, which can be used to display the image captured by the camera and a plurality of controls. The plurality of controls can include a flash control for turning on / off the flash, a beauty control for turning on / off the beauty function, a shutter control for starting / stopping shooting, etc.

[0059] Single-lens shooting refers to a mode in which the electronic device shoots through only one camera. The single-lens shooting can include a front shooting mode, a rear shooting mode, etc.

[0060] Specifically, the front-facing shooting mode refers to a mode in which the electronic device shoots images using the front-facing camera. When the electronic device is in the front-facing shooting mode, the image captured by the front-facing camera can be displayed in real time on the shooting preview interface.

[0061] Rear-facing camera mode refers to the mode in which an electronic device uses its rear-facing camera to shoot. When in rear-facing camera mode, the image captured by the rear-facing camera can be displayed in real time on the shooting preview interface.

[0062] Multi-lens shooting refers to a mode in which an electronic device can shoot using two or more cameras. This includes front-to-back shooting, front-to-front shooting, rear-to-rear shooting, and picture-in-picture shooting modes.

[0063] Front and rear shooting mode refers to a mode in which an electronic device can shoot simultaneously with the front camera and the rear camera. When the electronic device is in front and rear shooting mode, the electronic device can simultaneously display the images taken by the front camera and the rear camera (for example, the first image and the second image) in the shooting preview interface, and the first image and the second image are spliced ​​together for display. Specifically, when the electronic device is placed vertically, the first image and the second image can be spliced ​​up and down; when the electronic device is placed horizontally, the first image and the second image can be spliced ​​left and right. By default, the display area of ​​the first image is the same as the display area of ​​the second image.

[0064] The front-to-front shooting mode is similar to the front-to-back shooting mode, but the difference is that the front-to-front shooting mode uses two front cameras to shoot at the same time.

[0065] Rear-facing shooting mode refers to a mode in which an electronic device can simultaneously shoot using two rear cameras. When the electronic device is in rear-facing shooting mode, the electronic device can simultaneously display images captured by the two rear cameras (for example, the first image and the second image) in the shooting preview interface, with the first image and the second image displayed in a stitched manner. Specifically, when the electronic device is in a vertical position, the first image and the second image can be stitched vertically; when the electronic device is in a horizontal position, the first image and the second image can be stitched horizontally.

[0066] Picture-in-picture shooting mode refers to a mode in which an electronic device can shoot simultaneously through two cameras. When an electronic device is in picture-in-picture shooting mode, the electronic device can simultaneously display images taken by two cameras (for example, the first image and the second image) in the shooting preview interface. Among them, the second image is displayed in the entire display area of ​​the shooting preview interface, the first image is superimposed on the second image, and the display area of ​​the first image is smaller than the display area of ​​the second image. By default, the first image may be located at the lower left of the second image. The above-mentioned two cameras may include two front cameras, two rear cameras, or one front camera and one rear camera.

[0067] Split-screen display mode (splicing display) refers to that the display screen of the electronic device can display images (for example, a first image and a second image) captured by two cameras, and the first image and the second image are spliced and displayed on the display screen.

[0068] Picture-in-picture display mode refers to that the display screen of the electronic device can display images (for example, a first image and a second image) captured by two cameras, the second image is displayed on the entire display area of the display screen, and the first image is displayed in a small window, the display area of the small window is smaller than the display area of the display screen, that is, the first image is superimposed on the second image, and the display area of the first image is smaller than the display area of the second image.

[0069] Full-screen mode refers to that the display screen of the electronic device can display an image captured by any one camera in full screen, and the display area of the image is the display area of the display screen.

[0070] User operation refers to an operation performed by a user when the user switches a display picture, for example, the user can switch the display picture by touching a switching button on the display screen, or the user can switch the display picture by using a gesture. The direction corresponding to the user operation can refer to a direction pointed by a switching button on the display screen, or refer to a moving direction of a gesture when the user performs the gesture. For example, the gesture is “moving the palm from left to right”, and the direction corresponding to the user operation is from left to right. For another example, the switching button points or indicates “switching from left to right”, and after the button is clicked, the direction corresponding to the user operation also refers to from left to right.

[0071] The first camera can refer to a front camera or a rear camera, and the first camera in the embodiments of the present application generally refers to a front camera.

[0072] The second camera can refer to a front camera or a rear camera, and the first camera in the embodiments of the present application generally refers to a rear camera.

[0073] The first image refers to an image captured by a front camera; and the second image refers to an image captured by a rear camera.

[0074] The third image generally refers to an image captured by a front camera and processed by blurring, transparency, cropping or magnifying, or refers to a pre-prepared picture (including a first pre-prepared picture and a second pre-prepared picture); and the fourth image generally refers to an image captured by a rear camera and processed by blurring, transparency, cropping or magnifying.

[0075] It should be noted that the above-mentioned "single-lens shooting", "multi-lens shooting", "front shooting mode", "rear shooting mode", "front and rear shooting mode", "front front shooting mode", "rear rear shooting mode", and "picture-in-picture shooting mode" are only some names used by the embodiments of the present application, the meanings represented by the names have been described in the embodiments of the present application, and the names do not constitute any limitation on the embodiments.

[0076] At present, an electronic device can provide a user with a plurality of shooting modes, and can switch between the plurality of shooting modes. For example, switching from a front shooting mode to a rear shooting mode, switching from a rear shooting mode to a front shooting mode, switching from a front / rear shooting mode to a front and rear shooting mode, switching from a front and rear shooting mode to a front shooting mode, a rear shooting mode, a rear rear shooting mode, or a picture-in-picture shooting mode.

[0077] The electronic device uses different cameras in different shooting modes, and different cameras capture different pictures. Therefore, when the electronic device switches the shooting mode, the camera used by the electronic device (referred to as a preview camera) also changes, and the display picture in the shooting preview interface also changes. However, it takes a certain amount of time for the electronic device to start a different camera, and it also takes a certain amount of time for the picture captured by the different camera to be displayed in different modes on the shooting preview interface.

[0078] Therefore, when switching between different shooting modes, the picture data captured by the different cameras of the electronic device has a certain delay when displayed on the shooting preview interface. When the user switches between different shooting modes, if the picture data captured by the camera corresponding to each mode is directly displayed, the picture switching in the shooting preview interface during mode switching will appear stiff, and even a "stuttering" visual effect will occur, affecting the user experience.

[0079] To solve the above problems, the embodiments of the present application provide a method for shooting a video, which can support the electronic device to perform animation processing when switching the display picture in the shooting preview interface during shooting mode switching, so that the display picture in the shooting preview interface appears more smooth and lively during switching, and improves the user experience.

[0080] The method for shooting a video provided in the embodiments of the present application can be applied to an electronic device including multiple cameras. The electronic device can identify a preset air gesture (air gesture) of a user through any one of the front cameras. The preset air gesture (air gesture) for switching the shooting mode is not limited in the embodiments of the present application. The air gesture is only a name used in the embodiments of the present application, and can also be referred to as a hovering gesture, a floating gesture, etc. Specifically, the air gesture refers to a gesture input without contacting the electronic device, and the representative meaning thereof has been described in the embodiments of the present application, and the name thereof does not constitute any limitation on the embodiments of the present application.

[0081] In order to more clearly and specifically introduce the method for shooting a video provided in the embodiments of the present application, the electronic device related to the method provided in the embodiments of the present application is introduced first.

[0082] The electronic device can be a mobile phone, a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a cellular phone, a personal digital assistant (PDA), an augmented reality (AR) device, a virtual reality (VR) device, an artificial intelligence (AI) device, a wearable device, a vehicle-mounted device, a smart home device, and / or a smart city device, and the specific type of the electronic device is not specially limited in the embodiments of the present application.

[0083] Referring to FIG. 1A , FIG. 1A A hardware structure schematic diagram of the electronic device provided in the embodiments of the present application is shown.

[0084] As FIG. 1A shown, the electronic device 200 can include a processor 210, an external memory interface 220, an internal memory 221, a universal serial bus (USB) interface 230, a charging management module 240, a power management module 241, a battery 242, an antenna 1, an antenna 2, a mobile communication module 250, a wireless communication module 260, an audio module 270, a loudspeaker 270A, a receiver 270B, a microphone 270C, a headset interface 270D, a sensor module 280, a key 290, a motor 291, an indicator 292, multiple cameras 293, a display screen 294, and a subscriber identification module (SIM) card interface 295, etc.

[0085] The sensor module 280 can include a pressure sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, and the like.

[0086] It can be understood that the structure illustrated in the embodiment does not constitute a specific limitation on the electronic device 200. In other embodiments, the electronic device 200 can include more or fewer components than illustrated, or combine certain components, or split certain components, or different arrangement of components. The illustrated components can be implemented in hardware, software, or a combination of software and hardware.

[0087] The processor 210 can include one or more processing units, for example: the processor 210 can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units can be independent devices, or can be integrated in one or more processors.

[0088] The controller can be the nerve center and command center of the electronic device 200. The controller can generate operation control signals according to instruction operation codes and timing signals, and complete the control of fetching and executing instructions.

[0089] The memory can also be provided in the processor 210, for storing instructions and data. In some embodiments, the memory in the processor 210 is a cache memory. The memory can save instructions or data that the processor 210 has just used or repeatedly uses. If the processor 210 needs to use the instructions or data again, it can directly call from the memory. This avoids repeated access and reduces the waiting time of the processor 210, thus improving the efficiency of the system.

[0090] In some embodiments, the processor 210 can include one or more interfaces. The interfaces can include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc. It can be understood that the interface connection relationship between the modules illustrated in the embodiments is only illustrative and does not constitute a structural limitation on the electronic device 200. In other embodiments, the electronic device 200 can also use different interface connection methods or a combination of multiple interface connection methods.

[0091] In the embodiments of the present application, the processor 210 can receive a plurality of continuous images corresponding to a specific mid-air gesture input by the user, for example, a "palm" gesture, by the camera 293, and then the processor 210 can perform comparative analysis on the plurality of continuous images to determine that the mid-air gesture corresponding to the plurality of continuous images is a "palm" gesture, and determine that the operation corresponding to the mid-air gesture is, for example, starting recording or stopping recording, and then the processor 210 can control the camera application to perform the corresponding operation. The corresponding operation may, for example, include: deactivating the plurality of cameras to simultaneously collect images, and then synthesizing the images collected by the plurality of cameras respectively by the GPU through splicing or picture-in-picture (partial superposition), and calling the display screen 294 to display the synthesized images in the shooting preview interface of the electronic device.

[0092] The external memory interface 220 can be used to connect an external storage card, such as a Micro SD card, to expand the storage capacity of the electronic device 200. The external storage card communicates with the processor 210 through the external memory interface 220 to realize the data storage function. For example, music, video, and other files are saved in the external storage card.

[0093] The internal memory 221 can be used to store computer executable program codes, which include instructions. The processor 210 executes various functional applications and data processing of the electronic device 200 by running the instructions stored in the internal memory 221. For example, in an embodiment of the present application, the processor 210 can execute instructions stored in the internal memory 221, and the internal memory 221 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 200 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 221 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0094] In the embodiment of the present application, the internal memory 221 can store picture files or video files recorded by the electronic device in different shooting modes.

[0095] The charging management module 240 is used to receive charging input from a charger. The charger can be a wireless charger or a wired charger. While charging the battery 242, the charging management module 240 can also power the terminal device through the power management module 241.

[0096] The power management module 241 is used to connect the battery 242, the charging management module 240, and the processor 210. The power management module 241 receives input from the battery 242 and / or the charging management module 240 and provides power to the processor 210, the internal memory 221, the external memory, the display 294, the camera 293, and the wireless communication module 260. In some embodiments, the power management module 241 and the charging management module 240 can also be provided in the same device.

[0097] The wireless communication function of the electronic device 200 can be implemented through antenna 1, antenna 2, mobile communication module 250, wireless communication module 260, a modem processor, and a baseband processor. In some embodiments, the antenna 1 of the electronic device 200 is coupled to the mobile communication module 250, and the antenna 2 is coupled to the wireless communication module 260, so that the electronic device 200 can communicate with the network and other devices through wireless communication technology.

[0098] Antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in electronic device 200 can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization of antennas. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, antennas can be used in combination with a tuning switch.

[0099] Mobile communication module 250 can provide a solution for wireless communication including 2G / 3G / 4G / 5G, etc. applied on electronic device 200. Mobile communication module 250 can include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. Mobile communication module 250 can receive electromagnetic waves by antenna 1, and perform filtering, amplification, etc. on the received electromagnetic waves, and transmit the processed signals to a modem processor for demodulation.

[0100] Mobile communication module 250 can also amplify the signals modulated by the modem processor, and convert the signals into electromagnetic waves radiated by antenna 1. In some embodiments, at least part of the functional modules of mobile communication module 250 can be arranged in processor 210. In some embodiments, at least part of the functional modules of mobile communication module 250 can be arranged in the same device as at least part of the modules of processor 210.

[0101] Wireless communication module 260 can provide a solution for wireless communication including WLAN (such as wireless fidelity (Wi-Fi) network), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) technology, etc. applied on electronic device 200.

[0102] Wireless communication module 260 can be one or more devices integrated with at least one communication processing module. Wireless communication module 260 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering processing on the electromagnetic wave signals, and transmits the processed signals to processor 210. Wireless communication module 260 can also receive signals to be transmitted from processor 210, perform frequency modulation and amplification on the signals, and convert the signals into electromagnetic waves radiated by antenna 2.

[0103] The electronic device 200 implements a display function through a GPU, a display 294, and an application processor, etc. The GPU is a microprocessor for image processing, connected to the display 294 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 210 can include one or more GPUs that execute program instructions to generate or change display information.

[0104] The display 294 is used to display images, videos, etc. The display 294 includes a display panel.

[0105] The electronic device 200 can implement a shooting function through an ISP, a camera 293, a video codec, a GPU, a display 294, and an application processor, etc. The ISP is used to process data fed back by the camera 293. The camera 293 is used to capture still images or videos. In some embodiments, the electronic device 200 can include N cameras 293, N being a positive integer greater than 2.

[0106] The electronic device 200 can implement an audio function through an audio module 270, a speaker 270A, a receiver 270B, a microphone 270C, an earphone interface 270D, and an application processor, etc. For example, music playing, recording, etc.

[0107] The keys 290 include a power key, a volume key, etc. The keys 290 can be mechanical keys. They can also be touch keys. The motor 291 can generate a vibration prompt. The motor 291 can be used for incoming call vibration prompt, and can also be used for touch vibration feedback. The indicator 292 can be an indicator light, which can be used to indicate a charging state, a power change, and can also be used to indicate a message, a missed call, a notification, etc.

[0108] The plurality of cameras 293 are used to capture images. In the embodiments of the present application, the number of cameras 193 can be M, M≥2, M being a positive integer. The number of cameras opened by the electronic device in multi-lens shooting can be N, 2≤N≤M, N being a positive integer.

[0109] In the embodiments of the present application, the types of the camera 293 can be distinguished according to the hardware configuration and the physical position. For example, the plurality of cameras included in the camera 293 can be respectively arranged on the front and back surfaces of the electronic device, the camera arranged on the surface of the display screen 294 of the electronic device can be referred to as a front-facing camera, and the camera arranged on the surface of the back cover of the electronic device can be referred to as a rear-facing camera. For another example, the plurality of cameras included in the camera 293 have different focal lengths and angles of view, the camera with a shorter focal length and a larger angle of view can be referred to as a wide-angle camera, and the camera with a longer focal length and a smaller angle of view can be referred to as a normal camera. The difference between the contents of the images captured by different cameras is that the front-facing camera is used to capture the scene facing the front surface of the electronic device, and the rear-facing camera is used to capture the scene facing the back surface of the electronic device; the wide-angle camera can capture a larger area of the scene within a shorter shooting distance range, and the scene captured at the same shooting distance is smaller in the image than the scene captured by using the normal lens. The length of the focal length and the size of the angle of view are relative concepts, and there is no specific parameter limitation, so the wide-angle camera and the normal camera are also a relative concept, and can be distinguished according to the physical parameters such as the focal length and the angle of view.

[0110] In particular, in the embodiments of the present application, the camera 293 includes at least one camera that can obtain 3D data of an object in a captured image, so that the processor 210 can identify the operation instruction corresponding to the user's air gesture according to the 3D data of the object.

[0111] The camera used to obtain the 3D data of the object can be a separate low-power camera, or can be another normal front-facing camera or rear-facing camera. The normal front-facing camera or rear-facing camera supports a low-power mode. When the low-power camera is working, or the normal front-facing camera or rear-facing camera is working in the low-power mode, the frame rate of the camera is lower than that of the normal camera working in a non-low-power mode, and the output image is in black and white format. Generally, a normal camera can output 30 frames of images, 60 frames of images, 90 frames of images, or 240 frames of images per second, but when the low-power camera or the normal front-facing camera or rear-facing camera is running in the low-power mode, the camera can output, for example, 2.5 frames of images per second. When the camera captures the first image representing the same air gesture, the camera can be switched to output 10 frames of images per second, so as to accurately identify the operation instruction corresponding to the air gesture through a plurality of continuous images. In addition, the pixels of the images captured by the low-power camera are lower than those of the images captured by the normal camera. At the same time, compared with the normal camera, the power consumption of the low-power camera is reduced when working in the low-power mode.

[0112] The aspect ratios of the cameras 293 can be different or the same. The aspect ratio of a camera refers to the ratio of the length to the width of an image captured by the camera. Both the length and the width of the image can be measured in terms of the number of pixels. The aspect ratio of a camera can also be referred to as the image size, the image dimension, the pixel size, or the image resolution. Common aspect ratios of cameras can include 4:3, 16:9, 3:2, and the like. The aspect ratio refers to the approximate ratio of the number of pixels in the length to the number of pixels in the width of an image captured by the camera. In embodiments of this application, when the electronic device is in the multi-lens shooting mode, the images captured by the multiple cameras are displayed in the form of left-right or top-bottom splicing, the sizes of the images captured by different cameras displayed in the preview frame can be the same, and when the images captured by the multiple cameras are displayed in the form of picture-in-picture, the sizes of the images captured by different cameras displayed in the preview frame can be different, specifically, the size of the image captured by the front camera is smaller than the size of the image captured by the rear camera, which can be referred to in detail in the relevant description of the UI embodiments below, and will not be described here in detail.

[0113] In some embodiments, the cameras 293 can be used to capture depth data. For example, the cameras 293 can have a time of flight (TOF) 3D sensing module or a structured light 3D sensing module for obtaining depth information. The camera used to capture depth data can be a front camera or a rear camera.

[0114] The ISP is used to process the data fed back by the cameras 293. For example, when taking a photo, the shutter is opened, the light is transmitted to the camera photosensitive element through the lens, the light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing to convert it into an image visible to the naked eye. The ISP can also optimize the algorithm for the noise, brightness, and skin color of the image. The ISP can also optimize the exposure, color temperature, and other parameters of the shooting scene. In some embodiments, the ISP can be provided in the camera 293.

[0115] The digital signal processor is used to process digital signals, which can include not only digital image signals but also other digital signals. For example, when the electronic device is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy, and the like.

[0116] The video codec is used to compress or decompress digital video. The electronic device can support one or more video codecs. In this way, the electronic device can play or record videos in multiple encoding formats, such as moving picture experts group (MPEG) 1, MPEG 2, MPEG 3, MPEG 4, and the like.

[0117] The NPU is a neural-network (NN) computing processor that rapidly processes input information by drawing on the structure of a biological neural network, such as the transmission mode between human brain neurons, and can also continuously self-learn. Through the NPU, the electronic device can implement intelligent cognition and other applications, such as image recognition, face recognition, speech recognition, and text understanding.

[0118] The electronic device implements display functions through a GPU, the display screen 294, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 294 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 210 can include one or more GPUs that execute program instructions to generate or change display information.

[0119] The display screen 294 is used to display images, videos, and the like. The display screen 294 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flex light-emitting diode (FLED), a Miniled, a MicroLed, a Micro-oLed, a quantum dot light emitting diode (QLED), or the like. In some embodiments, the electronic device can include 1 or N display screens 294, N being a positive integer greater than 1.

[0120] In the embodiments of the present application, the display screen 294 can be used to display images captured by any one of the cameras 293, such as displaying multiple frames of images captured by one camera in a preview frame, or displaying multiple frames of images captured by one camera 293 in a saved video file, or displaying one photo captured by one camera 293 in a saved picture file.

[0121] When the electronic device displays multiple frames of images captured by one camera in a camera preview frame, and a specific air gesture input by a user, such as a "palm", is received, the display screen 294 can be used to display multiple frames of images captured by multiple cameras in the preview frame, and when the electronic device saves a video file or a picture file captured by the multiple cameras, the display screen can display multiple frames of images captured by the multiple cameras 293 in the saved video file, or display one photo synthesized from multiple photos captured by the multiple cameras 293 in the saved picture file.

[0122] In some embodiments, in the multi-lens shooting mode, the display screen 294 can display the multi-path images from the multiple cameras 293 by stitching or picture-in-picture, so that the multi-path images from the multiple cameras 293 can be presented to the user at the same time.

[0123] In some embodiments, in the multi-lens shooting mode, the processor 210 (e.g., a controller or a GPU) can synthesize multiple frames of images from the multiple cameras 293. For example, the video encoder in the processor 210 can encode the synthesized multi-path video stream data to generate a video file, by merging the multi-path video streams from the multiple cameras 293 into one video stream. In this way, each frame of image in the video file can contain multiple images from the multiple cameras 293. When playing a frame of image in the video file, the display screen 294 can display the multi-path images from the multiple cameras 293 to show the user multiple image frames of different ranges, different resolutions, or different details of the same moment or the same scene.

[0124] In some embodiments, in the multi-lens shooting mode, the processor 210 can associate the image frames from different cameras 293 respectively, so that when playing the photographed pictures or videos, the display screen 294 can display the associated image frames in the viewfinder at the same time. In this case, the videos recorded by different cameras 293 at the same time can be stored as different videos, and the pictures recorded by different cameras 293 at the same time can be stored as different pictures.

[0125] In some embodiments, in the multi-path recording mode, the multiple cameras 293 can collect images at the same frame rate respectively, i.e., the number of image frames collected by the multiple cameras 293 at the same time is the same. The videos from different cameras 293 can be stored as different video files, and the different video files are associated with each other. The image frames are stored in the video files in the order of collection, and the different video files include the same number of image frames. When playing the recorded videos, the display screen 294 can display the image frames in the associated video files in the order of collection according to the preset or user-indicated layout, so as to display the multiple frames of images corresponding to the same order in the different video files on the same interface.

[0126] In some embodiments, in the multi-path recording mode, the plurality of cameras 293 can capture images at the same frame rate, i.e., the number of image frames captured by the plurality of cameras 293 in the same time is the same. The processor 210 can respectively timestamp each frame of image from different cameras 293, so that when playing the recorded video, the display screen 294 can simultaneously display multiple frames of images from the plurality of cameras 293 on the same interface according to the timestamps.

[0127] In some embodiments, in the multi-lens shooting scene, the display screen 294 can simultaneously display different images from the plurality of cameras 293 by left-right splicing, top-bottom splicing, or picture-in-picture, etc., so that different images from the plurality of cameras 293 can be simultaneously presented to the user. For details, please refer to the related description of the UI embodiments hereinafter, which will not be described here.

[0128] In some embodiments, in the multi-lens shooting mode, the processor 210, e.g., a controller or a GPU, can synthesize different images from the plurality of cameras 293. For example, the video encoder in the processor 210 can encode the synthesized video stream data to generate a video file by merging the multi-path video stream from the plurality of cameras 293 into one video stream. In this way, each frame of image in the video file can contain multiple images from the plurality of cameras 293. When playing a frame of image in the video file, the display screen 294 can display multiple images from the plurality of cameras 293 to show the user multiple image frames with different contents, different depths of field, or different pixels at the same time or in the same scene. For another example, the video encoder in the processor 210 can encode the synthesized image data to generate a picture file by merging multiple photos from the plurality of cameras 293 into one photo. In this way, one photo in the picture file can contain multiple photos from the plurality of cameras 293. When viewing the photo, the display screen 294 can display multiple photos from the plurality of cameras 293 to show the user multiple image frames with different contents, different depths of field, or different pixels at the same time or in the same scene.

[0129] In some embodiments, in the multi-lens shooting mode, the processor 210 can respectively associate image frames from different cameras 293, so that when playing the shot picture or video, the display screen 294 can simultaneously display the associated image frames in the preview box. In this case, the videos recorded by different cameras 293 at the same time can be respectively stored as different video files, and the photos taken by different cameras 293 at the same time can be respectively stored as different picture files.

[0130] In some embodiments, in the multi-lens recording mode, the plurality of cameras 293 can capture images at the same frame rate respectively, i.e., the number of image frames captured by the plurality of cameras 293 in the same time is the same. The videos from different cameras 293 can be respectively stored as different video files, which are associated with each other. The image frames are stored in the video files in the order of capturing, and the different video files include the same number of image frames. When playing the recorded video, the display screen 294 can display the image frames in the order of capturing according to the preset or user-indicated layout, so as to display the multiple frames of images corresponding to the same order in different video files on the same interface.

[0131] In some embodiments, in the multi-lens recording mode, the plurality of cameras 293 can capture images at the same frame rate respectively, i.e., the number of image frames captured by the plurality of cameras 293 in the same time is the same. The processor 210 can respectively time stamp each frame of image from different cameras 293, so that when playing the recorded video, the display screen 294 can simultaneously display multiple frames of images from the plurality of cameras 293 on the same interface according to the time stamp.

[0132] For convenience of use, the electronic device usually captures images in the user's handheld mode, which usually causes the obtained image to be shaky. In some embodiments, in the multi-lens recording mode, the processor 210 can respectively perform anti-shake processing on the image frames captured by different cameras 293. Then, the display screen 294 displays the images after the anti-shake processing.

[0133] The SIM card interface 295 is used to connect the SIM card. The SIM card can be inserted into or pulled out of the SIM card interface 295 to realize contact and separation with the electronic device. The electronic device can support one or N SIM card interfaces, and N is a positive integer greater than 1. The SIM card interface 295 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. The same SIM card interface 295 can simultaneously insert multiple cards. The types of the multiple cards can be the same or different. The SIM card interface 295 can also be compatible with different types of SIM cards. The SIM card interface 295 can also be compatible with external storage cards. The electronic device interacts with the network through the SIM card to realize functions such as calling and data communication. In some embodiments, the electronic device uses eSIM, i.e., embedded SIM card. The eSIM card can be embedded in the electronic device and cannot be separated from the electronic device.

[0134] The display screen 294 is configured to display images, videos, and the like. In some embodiments, the electronic device can include one or N display screens 294, where N is a positive integer greater than 1. In the embodiments of the present application, the display screen 294 can be configured to display images captured by any one or more of the cameras 293, for example, to display multiple images captured by one camera in a photograph preview interface, or to display multiple images captured by one camera 293 in a saved video file, or to display one photograph captured by one camera 293 in a saved photograph file.

[0135] The SIM card interface 295 is configured to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 295 to achieve contact and separation with the electronic device 200. The electronic device 200 can support one or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 295 can support Nano SIM cards, Micro SIM cards, SIM cards, and the like.

[0136] FIG. 1B FIG. 4 is a software structure block diagram of an electronic device according to an embodiment of the present application.

[0137] The layered architecture divides the software into several layers, each of which has a clear role and division of labor. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, the application layer, the application framework layer, the Android runtime and system library, and the kernel layer.

[0138] The application layer can include a series of application packages.

[0139] As shown in FIG. 5, the application packages can include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, and the like. FIG. 1B

[0140] The application framework layer provides application programming interfaces (APIs) and programming frameworks for the applications of the application layer. The application framework layer includes a number of pre-defined functions.

[0141] As shown in FIG. 6, the application framework layer can include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like. FIG. 1B

[0142] The window manager is configured to manage window programs. The window manager can obtain the size of the display screen, determine whether there is a status bar, lock the screen, and take screenshots, and the like.

[0143] ​​The content provider stores and retrieves data and makes the data accessible to applications. The data can include videos, images, audio, dialed and received phone calls, browsing history and bookmarks, phone book, etc.

[0144] The view system includes visual controls, such as controls that display text, controls that display pictures, etc. The view system can be used to build an application. A display interface can be composed of one or more views. For example, a display interface that includes a short message notification icon can include a view that displays text and a view that displays a picture.

[0145] The telephony manager is used to provide the communication function of the electronic device. For example, the management of the call state (including call connection, call hang-up, etc.).

[0146] The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, etc.

[0147] The notification manager enables an application to display notification information in the status bar, which can be used to convey a message of the notification type, which can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify the completion of the download, message reminders, etc. The notification manager can also be a notification that appears in the top status bar of the system in the form of a chart or a scrolling text, such as a notification of an application running in the background, and can also be a notification that appears on the screen in the form of a dialog window. For example, the text information is prompted in the status bar, a prompt sound is emitted, the electronic device vibrates, the indicator light flashes, etc.

[0148] The Android runtime includes the core library and the virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.

[0149] The core library contains two parts: one part is the function function that the java language needs to call, and the other part is the core library of Android.

[0150] The application layer and the application framework layer run in the virtual machine. The virtual machine executes the java files of the application layer and the application framework layer into binary files. The virtual machine is used to perform the management of the object life cycle, the management of the stack, the management of the thread, the management of the security and the exception, and the garbage collection, etc.

[0151] The system library can include multiple functional modules. For example: surface manager, media library, three-dimensional graphics processing library (for example: OpenGL ES), 2D graphics engine (for example: SGL), etc.

[0152] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.

[0153] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0154] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0155] A 2D graphics engine is a drawing engine for 2D drawings.

[0156] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver.

[0157] The following describes the workflow of the electronic device software and hardware in conjunction with capturing a photo scene.

[0158] When the touch sensor receives a touch operation, a corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the touch operation into a raw input event (including touch coordinates, touch operation timestamp, and other information). The raw input event is stored in the kernel layer. The application framework layer obtains the raw input event from the kernel layer and identifies the control corresponding to the input event. For example, if the touch operation is a single-touch operation, and the control corresponding to the single-touch operation is the control of the camera application icon, the camera application calls the application framework layer interface to start the camera application, which then calls the kernel layer to start the camera driver and capture a still image or video through camera 293. In this embodiment of the present application, the touch sensor receiving a touch operation can be replaced by the camera 293 capturing the user's air gesture operation. Specifically, when the camera 293 captures the air gesture operation, a corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the air gesture operation into a raw input event (including the air gesture image, air gesture operation timestamp, and other information). The raw input event is stored in the kernel layer. The application framework layer obtains the raw input event from the kernel layer and identifies the operation corresponding to the input event. Taking the air gesture operation as an example of switching the shooting mode, the camera application calls the interface of the application framework layer, and then starts other camera drivers by calling the kernel layer, thereby switching to other cameras 293 to capture static images or videos.

[0159] Next, the switching of some shooting modes applied in the method for shooting videos provided in this application will be described with reference to the accompanying drawings.

[0160] like FIG. 2AAs shown, the mobile phone can display a home interface 301. The home interface 301 can include an icon 302 of a camera application. The mobile phone can receive an operation of a user clicking the icon 302, and in response to the operation, the mobile phone can start the camera application and display a shooting preview interface 303 of the camera application. It can be understood that the camera application is an image shooting application on an electronic device such as a smart phone or a tablet computer, which can be a system application or a third-party application, and the application name is not limited in the present application. That is, the user can click the icon 302 of the camera application to open the shooting preview interface 303 of the camera application. Without limitation, the user can also call the camera application in other applications to open the shooting preview interface 303, for example, the user clicks a shooting control in a social application to open the shooting preview interface 303. The social application can support the user to share the photographed pictures or videos to others.

[0161] It should be noted that the shooting preview interface 303 can be a user interface of a default shooting mode of the camera application, for example, a user interface provided when the camera application is in a front shooting mode. It can be understood that the default shooting mode can also be other modes, for example, a rear shooting mode, a front and rear shooting mode, etc. Alternatively, the shooting preview interface 303 can be a user interface of a shooting mode in which the camera application was last exited.

[0162] FIG. 2B Taking the shooting preview interface 303 as an example of a shooting preview interface corresponding to the front shooting mode of the camera application, the following will be described. FIG. 2B As shown, the shooting preview interface 303 can include a preview image 304, a shooting mode option 305, a flash control, a shutter control, etc. The preview image 304 is an image collected by the camera 293 in real time. It should be noted that the electronic device can refresh the image displayed by the shooting preview interface 303 (i.e., the preview image 304) in real time, so as to facilitate the user to preview the image currently collected by the camera 293. The shooting mode option 305 is used to provide multiple shooting modes for the user to select. The multiple shooting modes can include: photographing 305a, video recording 305b, multi-lens video recording 305c, real-time blurring, panorama, etc. The electronic device can receive an operation of the user swiping left / right on the shooting mode option 305, and in response to the operation, the electronic device can start the shooting mode selected by the user. It should be noted that the electronic device can not be limited to FIG. 2B As shown, more or fewer options can be displayed in the shooting mode option 305. FIG. 2B As shown.

[0163] The shooting mode corresponding to photo 305a is a commonly used single-lens shooting mode, which may include a front-facing shooting mode, a rear-facing shooting mode, and the like. That is, when photo 305a is selected, the electronic device can take a photo using either the front camera or the rear camera. For a detailed description of the front-facing shooting mode and the rear-facing shooting mode, please refer to the previous text and will not be repeated here.

[0164] The shooting modes corresponding to multi-lens recording 305c can include multiple shooting modes, such as multiple shooting modes for multi-lens shooting and multiple shooting modes for single-lens shooting. That is, when multi-lens recording 305c is selected, the electronic device can perform single-lens shooting using a single camera or multi-lens shooting using multiple cameras. For an introduction to the various shooting modes for multi-lens shooting, please refer to the detailed description above and will not be repeated here.

[0165] like FIG. 2B As shown, the photo 305a is in the selected state. That is, the electronic device is currently in the shooting mode. If the user wants to turn on the multi-lens recording mode, he can slide the shooting mode option 305 to the left and select the multi-lens recording 305c. When the user slides the shooting mode option 305 to the left and selects the multi-lens recording 305c, the electronic device can turn on the multi-lens recording mode and display the following FIG. 2C The shooting preview interface 303 is shown. FIG. 2C As shown, after entering the multi-camera recording mode, the electronic device can turn on the front camera and the rear camera, and the shooting preview interface 303 simultaneously displays the image 306a captured by the front camera and the image 306b captured by the rear camera, and the images 306a and 306b are spliced ​​together for display. In particular, because the electronic device is placed vertically, the images 306a and 306b are spliced ​​up and down.

[0166] In an optional embodiment, after the electronic device turns on multi-lens recording, the front camera and the rear camera can be enabled by default, and the image captured by the front camera and the image captured by the rear camera can be spliced ​​and displayed on the shooting preview interface (for example, FIG. 2C (The display method shown is shown). It is understood that the default cameras are not limited to the front camera and the rear camera, but can also be the rear camera and the rear camera, the front camera or the rear camera, etc. In addition, the image display method is not limited to the stitching method, and can also be a picture-in-picture method, etc., which is not specifically limited here.

[0167] After the electronic device turns on multi-camera recording, it can perform multi-camera recording. FIG. 3 , FIG. 3 The figure shows a scene in which a user holds an electronic device with a selfie stick and takes a horizontal shot, wherein the electronic device is placed horizontally in the selfie stick. FIG. 3When the shooting scene shown or other scene in which it is inconvenient for the other user to directly touch the display screen, it is inconvenient for the user to control the electronic device, for example, it is inconvenient for the user to start or stop recording and switch the shooting mode. In this case, the user can control the electronic device to start or stop recording and switch the shooting mode of the electronic device through the air gesture.

[0168] Next, the process of controlling the electronic device by the user through the air gesture in the shooting scene shown will be described with reference to the accompanying drawings. FIG. 3 The process of controlling the electronic device by the user through the air gesture in the shooting scene shown.

[0169] Next, the process of controlling the electronic device by the user through the air gesture in the shooting scene shown will be described with reference to the accompanying drawings. FIGS. 4A-4E , a series of interfaces of starting recording by the user through the air gesture will be introduced.

[0170] As shown in FIG. 4A , the electronic device can display a shooting preview interface 401. The shooting preview interface 401 includes a preview image 401a, a preview image 401b, an air lens switching control 402, a recording control 403, and the like. The preview image 401a is an image captured by the rear camera, and the preview image 401b is an image captured by the front camera. In addition, the preview image 401a and the preview image 401b are spliced left and right because the electronic device is placed horizontally in the selfie stick; when the electronic device is placed vertically in the selfie stick, the preview image 401a and the preview image 401b can be spliced up and down. The air lens switching control 402 can be used by the user to quickly turn on / off the air lens switching function. When the air lens switching function is turned on, the user can control the electronic device through a specific air gesture. In FIG. 4A , the air lens switching control 402 indicates that the air lens switching function is in an on state (which can also be referred to as a first state). The recording control 403 can be used by the user to quickly start / stop recording a video. In FIG. 4A , the recording control 403 indicates that the electronic device is in a non-recording state.

[0171] As shown in FIG. 4A , when the user wants to start recording, the user can first face the electronic device and input an air gesture, for example, input an air gesture of “raising hands” (which can be understood as the user keeping facing the display screen and keeping the state of “raising hands”, which can also be referred to as a first air gesture). The front camera of the electronic device can capture the air gesture input by the user (i.e., the preview image 401b) and display it in the shooting preview interface 401. In addition, the electronic device can also analyze and process the captured preview image 401b, and when the air gesture of “raising hands” is recognized, display the shooting preview interface 401 as shown in FIG. 4B . FIG. 4B The shooting preview interface 401 shown is similar to the shooting preview interface 401 shown in FIG. 4A , and the difference is that: FIG. 4BThe shooting preview interface 401 shown in FIG. 4A displays a prompt information 404, which prompts the user that the electronic device has entered a "preparation" state (which can be understood as a state ready for further recognizing the user's air gesture) and the user can input the air gesture as needed. For example, as shown in FIG. 4A, the prompt information 404 can be an icon of the air gesture. FIG. 4B In one possible design, the prompt information 404 can further include text information prompting the user to complete the gesture operation within a first preset time, for example, "complete the gesture operation within 3 seconds".

[0172] Meanwhile, the prompt information 404 can further include a time progress bar, which can be used to indicate the time when the electronic device enters the "preparation" state. Specifically, the electronic device starts timing from the moment (e.g., the first moment) when the electronic device enters the "preparation" state, at which time the time progress bar is blank; the electronic device stops timing after the first preset time at the first moment, at which time the time progress bar is filled. After the electronic device enters the "preparation" state, the user needs to input the air gesture before the time progress bar is filled (which can be understood as within the first preset time) to control the electronic device.

[0173] As shown in FIG. 4A, the user can continuously input the "hand-raising" air gesture (which can also be referred to as a second air gesture) until the time progress bar is filled more than two-thirds (or any other proportion, for example, one-half, two-fifths, etc.) in the shooting scenario based on FIG. 4C As shown in FIG. 4A, the user can continuously input the "hand-raising" air gesture (which can also be referred to as a second air gesture) until the time progress bar is filled more than two-thirds (or any other proportion, for example, one-half, two-fifths, etc.) in the shooting scenario based on FIG. 4B In response to detecting that the user continuously inputs the "hand-raising" air gesture until the time progress bar is filled more than two-thirds, the electronic device can enter a recording preparation state, and display the shooting preview interface 401 as shown in FIG. 4B. For example, if the first preset time is 3 seconds, after the electronic device enters the "preparation" state, the user can keep the "hand-raising" gesture for at least 2 seconds, and the electronic device can enter the recording preparation state. FIG. 4D

[0174] As shown in FIG. 4B, after the electronic device enters the recording preparation state, the shooting preview interface 401 can only display the preview images 401a, 401b and a countdown reminder 405. The preview image 401b shows that the user has put down the hand (i.e., no longer inputs the "hand-raising" air gesture). The countdown reminder 405 is used to remind the user that the electronic device will enter the recording state after a third preset time, for example, 2 seconds. By displaying the countdown reminder 405 on the shooting preview interface 401, the user can be reminded that the electronic device is about to start recording, so as to facilitate the user to prepare for recording. It can be understood that after the electronic device enters the recording preparation state, the user can no longer need to continuously input the air gesture, and can assume any posture to prepare for shooting. FIG. 4D

[0175] ​​After the countdown ends, the electronic device can start recording. See FIG. 4E , FIG. 4E The electronic device displays a shooting preview interface 401 when it starts recording. FIG. 4E The shooting preview interface 401 shown in the figure can include a recording time 406, a recording control 407, a screenshot control 408, and the like. Among them, the recording time 406 is used to indicate the recording duration of the video, for example, “00:01”. When the electronic device detects a touch operation acting on the recording control 407, it can stop or pause recording the video. When the electronic device detects a touch operation acting on the screenshot control 408, it can capture the images (including the preview image 401a and the preview image 401b) currently displayed by the shooting preview interface 401.

[0176] According to the foregoing, when the electronic device detects a “hand-raising” gesture (i.e., the first gesture) input by the user for the first time, it can enter a “preparation” state. In this case, if the electronic device detects a gesture (e.g., a “hand-raising” gesture) input by the user further within a first preset time, the electronic device can perform an operation corresponding to the gesture (e.g., a “hand-raising” gesture can correspond to an operation of starting recording). If the electronic device does not detect a gesture input by the user further within the first preset time, the electronic device returns to the original state (i.e., the state before the electronic device enters the “preparation” state). At this time, if the user wants to control the electronic device again, the user needs to input the “hand-raising” gesture again to make the electronic device enter the “preparation” state again.

[0177] It should be noted that the first gesture and the second gesture described above can be the same (e.g., both “hand-raising”) or different, which is not specifically limited here. In addition, the “hand-raising” gesture described above can be replaced by other gestures, such as a “thumbs-up” gesture, a “victory” gesture, and the like.

[0178] The following will be described in conjunction with the accompanying FIGS. 5A-5F , to introduce a series of interfaces in which the user controls the electronic device to switch from the front shooting mode to other shooting modes during recording by using gestures.

[0179] As shown in FIG. 4A, the electronic device can display a shooting preview interface 401. FIG. 5A The shooting preview interface 401 shown in the figure includes a preview image 401b captured by the front camera. It should be noted that when there are multiple front cameras, the working front camera can be the default front main camera of the electronic device. FIG. 5A As shown in FIG. 4B, the electronic device can display a shooting preview interface 401.

[0180] As shown in FIG. 4B, the electronic device can display a shooting preview interface 401. FIG. 5AAs shown, if the user wants to switch the shooting mode of the electronic device, he can first input an air gesture facing the electronic device, such as inputting an air gesture of "raising your hand". The front camera of the electronic device can collect the air gesture input by the user (i.e., preview image 401b) and display it in the shooting preview interface 401. In addition, the electronic device can also analyze and process the collected preview image 401b, and when the air gesture of "raising your hand" is recognized, it will be displayed as shown in the figure. FIG. 5B The shooting preview interface 401 is shown. FIG. 5B The shooting preview interface 401 shown is FIG. 5A The shooting preview interface 401 shown is similar, with the following differences: FIG. 5B The shooting preview interface 401 shown includes prompt information 404. The relevant introduction of prompt information 404 is referred to above and will not be described in detail here.

[0181] As mentioned above, when the electronic device detects the user's "raise hand" air gesture (i.e., the first air gesture) for the first time, it can enter the "ready" state. After the electronic device enters the "ready" state, the electronic device can determine the operation to be performed based on the further detected gesture operation. That is, based on FIG. 5B On the shooting preview interface 401 shown, the user can input different air gestures to switch the shooting mode of the electronic device, such as controlling the electronic device to switch the shooting mode from front-facing shooting to other shooting modes, such as rear-facing shooting mode, picture-in-picture shooting mode, etc.

[0182] The electronic device can switch from the front camera shooting mode to the rear camera shooting mode or the picture-in-picture shooting mode. FIGS. 5A-5B The shooting scene shown introduces the interfaces involved in the process of switching the electronic device from the front-facing shooting mode to the rear-facing shooting mode or the picture-in-picture shooting mode.

[0183] like FIG. 5C As shown, if the user wants the electronic device to switch from the front shooting mode to the rear shooting mode, the electronic device can display FIG. 5B When the user is in the shooting preview interface 401 shown in FIG, the user inputs the “flip palm” air gesture (also referred to as the third air gesture) facing the display screen. In response to detecting the user’s “flip palm” air gesture, the electronic device may switch the shooting mode from the front shooting mode to the rear shooting mode and display the following image: FIG. 5D The shooting preview interface 401 is shown. FIG. 5D As shown, after the electronic device switches to the rear-facing shooting mode, the image 401 a captured by the rear-facing camera can be displayed on the shooting preview interface 401 .

[0184] It can be understood that the above-mentioned "flip palm" air gesture can also switch the electronic device from rear-facing shooting mode to front-facing shooting mode. The specific process is similar to the process of switching the electronic device from front-facing shooting mode to rear-facing shooting mode, and will not be repeated here.

[0185] The electronic device can also switch from the front shooting mode to the picture-in-picture shooting mode. FIGS. 5A-5B The shooting scene shown introduces the interfaces involved in the process of switching the electronic device from the front shooting mode to the picture-in-picture shooting mode.

[0186] like FIG. 5E As shown, if the user wants the electronic device to switch from the front shooting mode to the picture-in-picture shooting mode, the electronic device can display FIG. 5B In the shooting preview interface 401 shown, the user inputs the air gesture of "extending the palm and then making a fist" (also referred to as the fourth air gesture) facing the display screen. In response to detecting the user inputting the air gesture of "extending the palm and then making a fist", the electronic device can switch the shooting mode from the front shooting mode to the picture-in-picture shooting mode and display the following FIG. 5F The shooting preview interface 401 is shown. FIG. 5F As shown, after the electronic device switches to the picture-in-picture shooting mode, the image 401a captured by the rear camera and the image 401b captured by the front camera can be simultaneously displayed in the shooting preview interface 401. Among them, the image 401b is superimposed on the image 401a, and the display position of the image 401a is the position where the entire shooting preview interface 401 is located.

[0187] Electronic devices can also switch from rear-facing shooting mode to picture-in-picture shooting mode. FIGS. 5A-5B The shooting scene shown introduces the interfaces involved in the process of switching the electronic device from the rear shooting mode to the picture-in-picture shooting mode.

[0188] like FIG. 5G As shown, if the user wants the electronic device to switch from the rear camera shooting mode to the picture-in-picture shooting mode, the electronic device can display FIG. 5H When the shooting preview interface 401 is shown, the air gesture of "extending your palm and then making a fist" (also called the fourth air gesture) is inputted facing the display screen, wherein FIG. 5H and FIG. 5B Similar, except: FIG. 5H The image displayed in the shooting preview interface shown in FIG is a preview image 401a captured by the rear camera. FIG. 5B The image displayed in the shooting preview interface shown in the figure is the preview image 401b captured by the front camera. In response to detecting the user inputting the air gesture of "extending the palm and then making a fist", the electronic device can switch the shooting mode from the front shooting mode to the picture-in-picture shooting mode and display the following image: FIG. 5IThe shooting preview interface 401 is shown. FIG. 5I As shown, after the electronic device switches to the picture-in-picture shooting mode, the image 401a captured by the rear camera and the image 401b captured by the front camera can be simultaneously displayed in the shooting preview interface 401. Among them, the image 401b is superimposed on the image 401a, and the display position of the image 401a is the position where the entire shooting preview interface 401 is located. FIG. 5I The image shown is the same as FIG. 5F The images shown are the same.

[0189] It should be noted that, in the default mode, when the front shooting mode is switched to the picture-in-picture shooting mode and the rear shooting mode is switched to the picture-in-picture shooting mode, the picture-in-picture interface in the shooting preview interface of the picture-in-picture mode displays the preview image 401b captured by the front camera, and the rear view interface in the shooting preview interface of the picture-in-picture mode displays the preview image 401a captured by the rear camera.

[0190] The electronic device can also switch the display positions of the two images in the picture-in-picture mode. The following describes the interfaces involved in the process of changing the positions of the two images in the picture-in-picture mode of the electronic device.

[0191] like FIG. 5J As shown, if the user wants to switch the display position of the image, the user can input the "flip palm" air gesture facing the display screen when the electronic device displays the prompt information 404. In response to detecting the "flip palm" air gesture input by the user, the electronic device can switch the display position of the image and display the following. FIG. 5K The shooting preview interface 401 is shown. FIG. 5K As shown, after the electronic device switches the display position of the image, the positions of image 401a and image 401b are interchanged, that is, image 401a is changed from being displayed in the entire area of ​​the shooting preview interface 401 to being superimposed on image 401b, and image 401b is changed from being superimposed on image 401a to being displayed in the entire area of ​​the shooting preview interface 401.

[0192] The electronic device can also switch from the picture-in-picture shooting mode to other shooting modes, and this process will be described in detail below with reference to the accompanying drawings.

[0193] FIG. 6A The shooting preview interface 401 when the electronic device is in the picture-in-picture shooting mode is shown. FIG. 5F The shooting preview interface 401 shown is similar and will not be described in detail here.

[0194] like FIG. 6AAs shown, if the user wants to switch the shooting mode of the electronic device, he can first input an air gesture facing the electronic device, such as inputting an air gesture of "raising your hand". The front camera of the electronic device can collect the air gesture input by the user (i.e., preview image 401b) and display it in the shooting preview interface 401. In addition, the electronic device can also analyze and process the collected preview image 401b, and when the air gesture of "raising your hand" is recognized, it will be displayed as shown in the figure. FIG. 6B The shooting preview interface 401 is shown. FIG. 6B The shooting preview interface 401 shown is FIG. 6A The shooting preview interface 401 shown is similar, with the following differences: FIG. 6B The shooting preview interface 401 shown includes prompt information 404. The relevant introduction of prompt information 404 is referred to above and will not be described in detail here.

[0195] Based on FIG. 6B On the shooting preview interface 401 shown, the user can input different air gestures to switch the shooting mode of the electronic device, for example, controlling the electronic device to switch the shooting mode from picture-in-picture shooting mode to rear shooting mode, front shooting mode, etc.

[0196] The electronic device can switch from the picture-in-picture shooting mode to the rear shooting mode. FIGS. 6A-6B The shooting scene shown introduces the interfaces involved in the process of switching the electronic device from picture-in-picture shooting mode to rear-view shooting mode.

[0197] like FIG. 6C As shown, if the user wants the electronic device to switch from the picture-in-picture shooting mode to the rear shooting mode, the electronic device can display FIG. 6B In the shooting preview interface 401 shown in FIG, the user inputs an air gesture of "stretching out the palm and then making a fist" facing the display screen. In response to detecting the user's air gesture of "stretching out the palm and then making a fist", the electronic device can switch the shooting mode from the picture-in-picture shooting mode to the rear shooting mode and display the following image: FIG. 6D The shooting preview interface 401 is shown. FIG. 6D As shown, after the electronic device enters the rear-facing shooting mode, the image 401b captured by the front camera may no longer be displayed, and only the image 401a captured by the rear-facing camera may be displayed.

[0198] The electronic device can switch from the picture-in-picture shooting mode to the front shooting mode. FIG. 6E As shown, FIG. 6E and FIG. 6CSimilar, the difference is that the positions of image 401a and image 401b are swapped, that is, image 401a is changed from being displayed in the entire area of ​​the shooting preview interface 401 to being superimposed on image 401b, and image 401b is changed from being superimposed on image 401a to being displayed in the entire area of ​​the shooting preview interface 401.

[0199] like FIG. 6E As shown, if the user wants the electronic device to switch from the picture-in-picture shooting mode to the rear shooting mode, the user can input the air gesture of "extending the palm and then making a fist" facing the display screen when the electronic device displays the prompt information 404. In response to detecting the user's "extending the palm and then making a fist" air gesture, the electronic device can switch the shooting mode from the picture-in-picture shooting mode to the front shooting mode and display the following FIG. 6F The shooting preview interface 401 is shown. FIG. 6F As shown, after the electronic device enters the front shooting mode, the image 401a captured by the rear camera may no longer be displayed, and only the image 401b captured by the front camera may be displayed.

[0200] It should be noted that FIGS. 5A-6F The interfaces shown are all related to switching shooting modes based on the electronic device being recorded. In fact, the electronic device can also recognize the user's air gestures and perform corresponding operations when it is not recording. The principle is similar to the principle of electronic devices recognizing air gestures and performing corresponding operations during recording, so I will not go into details here.

[0201] It can be understood that the above contents are all related introductions based on the shooting scene when the electronic device is placed horizontally. The following will introduce the method of using air gestures to control the electronic device when the electronic device is placed vertically with reference to the accompanying drawings.

[0202] When the electronic device is placed vertically, it can also switch from the front / rear shooting mode to the picture-in-picture shooting mode, or from the picture-in-picture shooting mode to the front / rear shooting mode. The principle is similar to that when the electronic device is placed horizontally.

[0203] The following takes the electronic device in the front and rear shooting mode as an example to explain the relevant interfaces for switching from the front and rear shooting mode to the picture-in-picture shooting mode when the electronic device is placed vertically.

[0204] like FIG. 7A As shown, the electronic device can display a shooting preview interface 401 when the electronic device is placed vertically and in a front shooting mode. The shooting preview interface 401 includes an image 401b shot by the front camera.

[0205] If the user wants to switch the shooting mode of the electronic device, the user first faces the electronic device and inputs a midair gesture, for example, inputs a "raising hand" midair gesture. The front camera of the electronic device can capture the midair gesture input by the user (that is, a preview image 401b), and display the preview image 401b in the shooting preview interface 401. In addition, the electronic device can also analyze and process the captured preview image 401b, and when the "raising hand" midair gesture is recognized, display the shooting preview interface 401 as shown in FIG. 7B . FIG. 7B The shooting preview interface 401 as shown in FIG. 7A is similar to the shooting preview interface 401 as shown in FIG. 7B , and the difference is that: The shooting preview interface 401 as shown in

[0206] includes prompt information 404. For details about the prompt information 404, see the foregoing description, which will not be repeated here. FIG. 7B Based on the shooting preview interface 401 as shown in , the electronic device can switch from the front shooting mode to the picture-in-picture shooting mode when detecting the "stretching out the palm and then making a fist" midair gesture input by the user.

[0207] When the display screen of the shooting preview interface is in the picture-in-picture shooting mode, the electronic device can switch from the picture-in-picture shooting mode to the front / rear shooting mode when detecting the "stretching out the palm and then making a fist" midair gesture input by the user.

[0208] It should be noted that the switching between other shooting modes when the electronic device is in the vertical state has similar principles and contents to the switching between other shooting modes when the electronic device is in the horizontal state, which will not be repeated here.

[0209] The above embodiments describe the switching of some shooting modes applied by the method for shooting a video provided in the present application. Next, the changes of the shooting preview interface in the shooting mode switching will be described in combination with the accompanying drawings.

[0210] The processing flow and principles of the electronic device for the shooting preview interface 401 in the switching process between the picture-in-picture shooting mode and the front / rear shooting mode are the same, and the following will be described in combination with FIGS. 8A-8F , the processing flow of the electronic device for the shooting preview interface 401 in the process of switching from the picture-in-picture shooting mode to the rear shooting mode when the electronic device is in the horizontal state, and a series of interfaces in the processing flow.

[0211] In this embodiment, the user input command is taken as an example of "stretching out the palm and then making a fist", and the processing flow of the shooting preview interface 401 and a series of interfaces in the processing flow are described. After detecting the user input "stretching out the palm and then making a fist" gesture (i.e., the third gesture), the electronic device responds to the detection of the user input "stretching out the palm and then making a fist" gesture, and the shooting preview interface 401 of the electronic device will gradually switch from the picture-in-picture shooting mode to the rear shooting mode. Referring to FIG. 8A , FIG. 8A A flowchart of the electronic device animating the shooting preview interface 401 is shown, and the switching time of the entire process of the shooting preview interface switching from the picture-in-picture shooting mode to the rear shooting mode is the first switching period T1 (for example, the first switching period T1 is 600 ms), which can be divided into two processing time periods. Different processing time periods will be described in detail below with reference to the accompanying drawings.

[0212] As shown in FIG. 8B , the picture in the shooting preview interface 401 is the picture at 0 ms (the first time) in the first switching period T1 of the picture-in-picture shooting mode switching to the rear shooting mode. The picture at this time can be the image of the last frame in the video captured by the picture-in-picture shooting mode. The shooting preview interface 401 includes a picture-in-picture interface 401c and a rear viewfinder interface 401d. At this time, the display area where the picture-in-picture interface 401c is located can be the first area, and the image displayed in the picture-in-picture interface 401c can be the first image. The display area where the rear viewfinder interface 401d is located can be the second area, and the image displayed in the rear viewfinder interface 401d can be the second image. The display interface of the rear viewfinder interface 401d is the interface where the entire shooting preview interface 401 is located, and the picture-in-picture interface 401c is superimposed and displayed on the rear viewfinder interface 401d. In the preset mode, the picture-in-picture interface 401c is located at the lower left corner of the rear viewfinder interface 401d. The picture-in-picture interface 401c is the image captured by the front camera, and the rear viewfinder interface 401d is the image captured by the rear camera.

[0213] Referring to FIG. 8C , FIG. 8C , the shooting preview interface 401 is the picture at 300 ms (the second time) in the first switching period. As shown in FIG. 8C , the shooting preview interface 401 includes the rear viewfinder interface 401d (at this time, the display area where the rear viewfinder interface 401d is located can be the third area), and the picture-in-picture interface 401c disappears. In the rear viewfinder interface 401d in FIG. 8C , the rear viewfinder interface 401d becomes more blurred than the rear viewfinder interface 401d in FIG. 8B .

[0214] Referring to FIG. 8D , FIG. 8DThe illustrated photograph preview interface 401 is a picture at 150 ms in the first switching period, as shown in FIG. 4A. FIG. 8C As shown, the photograph preview interface 401 includes a picture-in-picture interface 401c and a rear viewfinder interface 401d, FIG. 8D The photograph preview interface 401 illustrated in FIG. 4B is similar to the photograph preview interface 401 illustrated in FIG. 4A, except that FIG. 8B The photograph preview interface 401 illustrated in FIG. 4B is similar to the photograph preview interface 401 illustrated in FIG. 4A, except that FIG. 8D The picture-in-picture interface 401c in FIG. 4B is more blurred than the picture-in-picture interface 401c in FIG. 4A, and FIG. 8B The picture-in-picture interface 401c in FIG. 4B is more blurred than the picture-in-picture interface 401c in FIG. 4A, and FIG. 8D The picture-in-picture interface 401c in FIG. 4B is more transparent (with reduced opacity) than the picture-in-picture interface 401c in FIG. 4A, FIG. 8B The picture-in-picture interface 401c in FIG. 4B is more transparent (with reduced opacity) than the picture-in-picture interface 401c in FIG. 4A, FIG. 8D The rear viewfinder interface 401d in FIG. 4B is more blurred than the rear viewfinder interface 401d in FIG. 4A, wherein FIG. 8B The rear viewfinder interface 401d in FIG. 4B is more blurred than the rear viewfinder interface 401d in FIG. 4A, wherein FIG. 8D The degree of blurring of the rear viewfinder interface 401d in FIG. 4B is between the degree of blurring of the rear viewfinder interface 401d in FIG. 4A and the degree of blurring of the rear viewfinder interface 401d in FIG. 4B. FIG. 8B The degree of blurring of the rear viewfinder interface 401d in FIG. 4B is between the degree of blurring of the rear viewfinder interface 401d in FIG. 4A and the degree of blurring of the rear viewfinder interface 401d in FIG. 4B. FIG. 8C The degree of blurring of the rear viewfinder interface 401d in FIG. 4B is between the degree of blurring of the rear viewfinder interface 401d in FIG. 4A and the degree of blurring of the rear viewfinder interface 401d in FIG. 4B.

[0215] The time period from 0 ms (first time) to 300 ms (second time) is referred to as a first time period, and with reference to FIG. 8A In the first time period, the electronic device performs opacity processing on the picture-in-picture interface 401c. The opacity of the picture-in-picture interface 401c at 0 ms (first time) is 100% (second opacity), and the opacity of the picture-in-picture interface 401c at 300 ms (second time) is 0 (first opacity). That is, in the first time period from 0 ms (first time) to 300 ms (second time), the opacity of the picture-in-picture interface 401c changes from 100% to 0 (from the second opacity to the first opacity). In order to make the visual effect of the opacity change of the picture-in-picture interface 401c better, the opacity change of the picture-in-picture interface 401c is a gradual change over time, and the opacity change trend of the picture-in-picture interface 401c can be referred to as the second curve. See FIG. 9B , FIG. 9B The second curve is shown in FIG. 6B, and the second curve can be a 06-sharp curve. Wherein, FIG. 9BIn the coordinate system, the x-axis represents time, and the y-axis represents transparency (the opposite of opacity). The changing trend of the second curve shows that the curvature of the second curve first increases and then decreases over time. The second curve can represent a transition process from slow to fast and then from fast to slow. That is, the transparency of the front viewfinder interface 401c changes slowly at the beginning of the first time period, quickly in the middle of the first time period, and slowly at the end of the first time period within the time period of 0ms-300ms.

[0216] During the first time period, the electronic device also performs Gaussian blur processing on the picture-in-picture interface 401c, wherein the Gaussian blur value of the picture-in-picture interface 401c at 0ms (the first moment) is 0 (the first blur value), and the Gaussian blur value of the picture-in-picture interface 401c at 300ms (the second moment) is 10 (the second blur value). During the first time period, the Gaussian blur value of the picture-in-picture interface 401c changes from 0 to 10 (from the first blur value to the second blur value). The changing trend of the Gaussian blur value of the picture-in-picture interface 401c during the first time period can be referred to the first curve. FIG. 9A , FIG. 9A The changing trend of the first curve is shown, and the first curve may be a 05-Extreme Deceleration Curve (05-Extreme Deceleration Curve). FIG. 9A In the coordinate system, the x-axis represents time, and the y-axis represents the Gaussian blur value. The changing trend of the first curve shows that the curvature of the first curve decreases over time. The first curve can represent two transition processes from rapid to slow. That is, within the time period of 0ms-300ms, the Gaussian blur value of the picture-in-picture interface 401c also increases from rapid to slow over time.

[0217] See FIG. 8E , FIG. 8E The picture of the shooting preview interface 401 in the first switching cycle of 450ms is shown. FIG. 8E As shown, the shooting preview interface 401 includes a rear view interface 401d. The image displayed in the rear view interface 401d is a real-time video image and a last frame image captured by the rear camera. The real-time video image is blocked by the last frame image displayed in the rear view interface 401d, but due to FIG. 8E The last frame image in FIG. 8D The opacity of the last frame image in the video is reduced, so the picture you see at this time is the picture formed by the superposition of the real-time video picture taken by the rear camera and the last frame image.

[0218] refer to FIG. 8F , FIG. 8FAs shown in FIG. 6, the first time period is 600 ms, and the third time point is 600 ms. The screen of the photographing preview interface 401 at the third time point is shown in FIG. 4B. As shown in FIG. 4B, the photographing preview interface 401 includes a rear viewfinder interface 401d (at this time, the display area of the rear viewfinder interface 401d can be the third area, and the image in the rear viewfinder interface 401d is the third image). FIG. 8E As shown in FIG. 4B, the photographing preview interface 401 includes a rear viewfinder interface 401d (at this time, the display area of the rear viewfinder interface 401d can be the third area, and the image in the rear viewfinder interface 401d is the third image).

[0219] The time period from 300 ms (the second time point) to 600 ms (the third time point) is referred to as a second time period. The photographing preview interface 401 at the third time point is different from the photographing preview interface 401 at the second time point, because the electronic device performs transparency processing on the rear viewfinder interface 401d in the second time period. Referring to FIGS. 4B and 4C, the opacity of the last frame of image in the rear viewfinder interface 401d at the second time point is 100% (the second opacity). Referring to FIGS. 4B and 4D, the opacity of the last frame of image in the rear viewfinder interface 401d at the third time point is 0 (the first opacity). That is, in the second time period, the opacity of the rear viewfinder interface 401d changes from 100% to 0 (from the second opacity to the first opacity). The opacity change trend of the rear viewfinder interface 401d can be referred to the second curve. FIG. 8A FIG. 8C FIG. 8A FIG. 8F The opacity of the last frame of image in the rear viewfinder interface 401d at the second time point is 100% (the second opacity). Referring to FIGS. 4B and 4D, the opacity of the last frame of image in the rear viewfinder interface 401d at the third time point is 0 (the first opacity). That is, in the second time period, the opacity of the rear viewfinder interface 401d changes from 100% to 0 (from the second opacity to the first opacity). The opacity change trend of the rear viewfinder interface 401d can be referred to the second curve.

[0220] Referring to FIGS. 4B, 4C, 4D, and 4E, the three figures sequentially show that the last frame of image in the rear viewfinder interface 401d changes from completely opaque to completely transparent in the second time period, and after 300 ms, the video stream captured by the rear camera flows up at the display position of the rear viewfinder interface 401d. As shown in FIG. 4C, the video stream flowing up at the display position of the rear viewfinder interface 401d is blocked by the completely opaque last frame of image. As shown in FIG. 4D, as the opacity of the last frame of image decreases, the video stream and the last frame of image can be seen to overlap in the rear viewfinder interface 401d. As shown in FIG. 4E, as the last frame of image in the rear viewfinder interface 401d gradually changes to completely transparent, the video captured by the rear camera is gradually clearly presented in the rear viewfinder interface 401d in the photographing preview interface 401. FIG. 8C FIG. 8E FIG. 8F FIG. 8C FIG. 8E FIG. 8E FIG. 8F

[0221] ​​​​​​​​​​In addition, the electronic device can also switch from the picture-in-picture shooting mode to the front shooting mode. Specifically, the interface of the picture-in-picture shooting mode can be switched from the interface shown in FIG. 10A to the interface shown in FIG. 10B by inputting the "turning over the palm" gesture, and then the picture-in-picture shooting mode can be switched to the front shooting mode according to the method introduced in the above embodiment. Since the principle of switching the picture-in-picture shooting mode to the front shooting mode is the same as that of switching the picture-in-picture shooting mode to the rear shooting mode, details are not repeated here. FIG. 5J FIG. 5K In addition, the electronic device can also switch from the picture-in-picture shooting mode to the front shooting mode. Specifically, the interface of the picture-in-picture shooting mode can be switched from the interface shown in FIG. 10A to the interface shown in FIG. 10B by inputting the "turning over the palm" gesture, and then the picture-in-picture shooting mode can be switched to the front shooting mode according to the method introduced in the above embodiment. Since the principle of switching the picture-in-picture shooting mode to the front shooting mode is the same as that of switching the picture-in-picture shooting mode to the rear shooting mode, details are not repeated here.

[0222] The electronic device can also switch from the front / rear shooting mode to the picture-in-picture shooting mode. The processing flow and principle of switching from the front shooting mode to the picture-in-picture shooting mode are the same as those of switching from the rear shooting mode to the picture-in-picture shooting mode. Hereinafter, the rear shooting mode is taken as an example to introduce the process of switching from the front / rear shooting mode to the picture-in-picture shooting mode, and the processing flow of the shooting preview interface 401 and a series of interfaces in the processing flow. FIGS. 10A-10F

[0223] In this embodiment, the shooting preview interface in the front / rear shooting mode is the interface shown in FIG. 10A, the command input by the user is "stretching out the palm and then making a fist", and the shooting preview interface of the picture-in-picture shooting mode after switching is the interface shown in FIG. 10B. FIG. 5F FIG. 6A The processing flow of the shooting preview interface 401 and a series of interfaces in the processing flow are described taking the shooting preview interface in the front / rear shooting mode, the command input by the user, and the shooting preview interface of the picture-in-picture shooting mode after switching as examples.

[0224] After detecting the "stretching out the palm and then making a fist" gesture (i.e., the third gesture) input by the user, the electronic device responds to the detection of the "stretching out the palm and then making a fist" gesture input by the user, and the shooting preview interface 401 of the electronic device gradually switches from the rear shooting mode to the picture-in-picture shooting mode, as shown in FIG. 10C. FIG. 10A FIG. 10A Another flowchart of the animation processing of the electronic device on the shooting preview interface 401 is shown, and the switching time of the entire process of switching the shooting preview interface from the rear shooting mode to the picture-in-picture shooting mode is the second switching period T2 (for example, the second switching period T2 is 600 ms), which can be divided into two processing time periods. Different processing time periods are described in detail below with reference to the accompanying drawings.

[0225] FIG. 10B FIG. 10B ​​​​​​The picture in the shooting preview interface 401 shown is a picture at 0 ms (first time) in the second switching period T2 when the rear shooting mode is switched to the picture-in-picture shooting mode. At this time, the picture displayed can be an image of the last frame in the video shot in the rear shooting mode. The shooting preview interface 401 includes a rear viewfinder interface 401d, and the display interface of the rear viewfinder interface 401d is the entire display interface where the shooting preview interface 401 is located.

[0226] Referring to FIG. 10C , FIG. 10C The shooting preview interface 401 shown is a picture at 300 ms (second time) in the second switching period T2. As shown in FIG. 10C The shooting preview interface 401 includes a picture-in-picture interface 401c and a rear viewfinder interface 401d, wherein the picture-in-picture interface 401c is superimposed on the rear viewfinder interface 401d, and the picture displayed in the picture-in-picture interface 401c is a pre-made picture. In the default mode, the picture-in-picture interface 401c can be displayed in the lower left corner of the rear viewfinder interface 401d. In addition, FIG. 10C The rear viewfinder interface 401d in FIG. 10B becomes more blurred than the rear viewfinder interface 401d in

[0227] Referring to FIG. 10D , FIG. 10D The picture of the shooting preview interface 401 at 150 ms in the second switching period T2 is shown. As shown in FIG. 10D The shooting preview interface 401 includes a picture-in-picture interface 401c and a rear viewfinder interface 401d, FIG. 10D The shooting preview interface 401 shown is similar to the shooting preview interface 401 shown in FIG. 10C The difference is that: FIG. 10D The opacity of the picture-in-picture interface 401c in FIG. 10C is higher than the opacity of the picture-in-picture interface 401c in FIG. 10B , FIG. 10E and FIG. 10C The process of the picture-in-picture interface 401c from transparent to opaque is shown in sequence. FIG. 10D The blur degree of the rear viewfinder interface 401d in FIG. 10B is between the blur degree of the rear viewfinder interface 401d in FIG. 10C , FIG. 10B , FIG. 10D and FIG. 10C The process of the rear viewfinder interface 401d becoming more and more blurred is shown in sequence.

[0228] The time period from 0 ms (first time) to 300 ms (second time) in the second switching period T2 is referred to as the first time period. Referring to FIG. 10AIn the first time period, the electronic device performs Gaussian blur processing on the rear viewfinder interface 401d, where the Gaussian blur value of the rear viewfinder interface 401d at 0 ms (first time point) is 0 (first blur value), and the Gaussian blur value of the rear viewfinder interface 401d at 300 ms (second time point) is 100 (third blur value). In the first time period, the Gaussian blur value of the rear viewfinder interface 401d becomes higher and higher, and the change trend of the Gaussian blur value of the rear viewfinder interface 401d in the first time period can be referred to the first curve.

[0229] In addition, in the first time period, the electronic device also performs transparency processing on the picture-in-picture interface 401c, where the opacity of the picture-in-picture interface 401c at 0 ms (first time point) is 0, and the opacity of the picture-in-picture interface 401c at 300 ms (second time point) is 100%. In the first time period, the opacity of the picture-in-picture interface 401c becomes lower and lower, so that the picture-in-picture interface 401c is gradually clearly superimposed on the rear viewfinder interface 401d, and the change trend of the opacity of the picture-in-picture interface 401c in the first time period can be referred to the second curve.

[0230] Referring to FIG. 10F , FIG. 10F It is shown that the picture of the shooting preview interface 401 at 600 ms (third time point) in the second switching period T2, as shown in FIG. 10D , the shooting preview interface 401 includes the picture-in-picture interface 401c and the rear viewfinder interface 401d. Wherein, the picture-in-picture interface 401c is superimposed on the front viewfinder interface 401d and the rear viewfinder interface 401d, and in the preset mode, the picture-in-picture interface 401c is preset at the lower left corner of the shooting preview interface 401. The picture displayed in the picture-in-picture interface 401c is the real-time video picture captured by the front camera, and the picture displayed in the rear viewfinder interface 401d is the real-time video picture captured by the rear camera.

[0231] Referring to FIG. 10E , FIG. 10E It is shown that the picture of the shooting preview interface 401 at 450 ms in the second switching period, as shown in FIG. 10E , the shooting preview interface 401 includes the picture-in-picture interface 401c and the rear viewfinder interface 401d, and the picture-in-picture interface 401c is superimposed on the rear viewfinder interface 401d. Wherein, the picture displayed in the picture-in-picture interface 401c is the real-time video picture captured by the front camera and the prefabricated picture, and the picture displayed in the rear viewfinder interface 401d is the real-time video picture captured by the rear camera and the last frame image.

[0232] The real-time video picture in the picture-in-picture interface 401c is blocked by the prefabricated picture displayed in the picture-in-picture interface 401c, but because FIG. 10E the prefabricated picture in the picture-in-picture interface 401c is compared toFIG. 10C The pre-made picture in the picture-in-picture interface 401c has a reduced opacity, so the picture seen in the picture-in-picture interface 401c at this time is the picture formed by superimposing the real-time video picture captured by the front-facing camera and the pre-made picture.

[0233] The real-time video picture in the rear-sight interface 401d is blocked by the last frame of image displayed in the rear-sight interface 401d, but because FIG. 10E The pre-made picture in the rear-sight interface 401d has a reduced opacity compared to the pre-made picture in the picture-in-picture interface 401c. FIG. 10C The pre-made picture in the rear-sight interface 401d has a reduced opacity, so the picture seen in the rear-sight interface 401d at this time is the picture formed by superimposing the real-time video picture captured by the rear-facing camera and the last frame of image.

[0234] The time period from 300 ms (second time) to 600 ms (third time) is referred to as a second time period, and the shooting preview interface 401 at 600 ms (third time) is different from the shooting preview interface 401 at 300 ms (second time) because the electronic device performs opacity processing on the picture-in-picture interface 401c and the rear-sight interface 401d in the second time period. Referring to FIG. 10A and FIG. 10C , the pre-made picture in the picture-in-picture interface 401c has an opacity of 100% (second opacity) at 300 ms (second time), and the last frame of image in the rear-sight interface 401d has an opacity of 100% (second opacity) at 300 ms (second time). Referring to FIG. 10A and FIG. 10F , the pre-made picture in the picture-in-picture interface 401c has an opacity of 0 (first opacity) at 600 ms (third time), and the last frame of image in the rear-sight interface 401d has an opacity of 0 (first opacity) at 600 ms (third time). That is, in the second time period, the opacity of the picture-in-picture interface 401c changes from 100% to 0 (from the second opacity to the second opacity), and the opacity of the rear-sight interface 401d also changes from 100% to 0 (from the second opacity to the second opacity). The opacity change trend of the picture-in-picture interface 401c and the rear-sight interface 401d can be referred to the second curve.

[0235] Referring to FIG. 10C , FIG. 10E , FIG. 10FThe three pictures sequentially show the process that the pre-made picture in the picture-in-picture interface 401c changes from completely opaque to completely transparent, and the process that the last frame image in the rear view interface 401d changes from completely opaque to completely transparent. Since the video stream captured by the front camera is up-streamed at the display position of the picture-in-picture interface 401c and the video stream captured by the rear camera is up-streamed at the display position of the rear view interface 401d after 300 ms, as shown in FIG. 3C, the video stream up-streamed at the display position of the picture-in-picture interface 401c is blocked by the completely opaque pre-made picture, and the video stream up-streamed at the display position of the rear view interface 401d is blocked by the completely opaque last frame image; as shown in FIG. 3D, as the opacity of the pre-made picture and the last frame image decreases, the video stream can be seen in the picture where the video stream overlaps the pre-made picture, and the picture where the video stream overlaps the last frame image; as shown in FIG. 3E, as the transparency of the pre-made picture in the picture-in-picture interface 401c gradually changes to completely transparent, the video picture captured by the front camera is gradually clearly presented in the picture-in-picture interface 401c in the shooting preview interface 401; as the transparency of the last frame image in the rear view interface 401d gradually changes to completely transparent, the video picture captured by the rear camera is gradually clearly presented in the rear view interface 401d in the shooting preview interface 401. FIG. 10C FIG. 10E FIG. 10E FIG. 10F

[0236] Those skilled in the art can clearly understand the specific working process of the above-described system, apparatus and unit by referring to the corresponding process in the foregoing method embodiments, and thus details are not described here.

[0237] The functional units in each embodiment of the present application can be integrated in one processing unit, or exist separately as individual physical units, or two or more units are integrated in one unit. The integrated unit can be implemented in the form of hardware or software functional units.

[0238] ​​​​If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as flash memory, mobile hard disk, read-only memory, random access memory, magnetic disk or optical disk.

[0239] The above description is merely a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present invention should be included in the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be based on the scope of protection of the claims.

Claims

1. A method of taking a video, characterized by, The method is applied to an electronic device including a display screen, a first camera and a second camera, the first camera and the second camera are located at different sides of the display screen, and the method includes: A first area of the display screen displays a first image collected in real time by the first camera, and a second area of the display screen displays a second image collected in real time by the second camera, wherein the second area is the entire display area of the display screen, and the first area is smaller than the second area; In response to a detected user operation, the opacity of the first image displayed in the first area gradually decreases from a second opacity to a first opacity; the user operation is an operation performed by the user when switching the display screen; The second area of the display screen displays the second image and a third image collected by the second camera, and the second image is superimposed on the third image; the opacity of the second image gradually decreases from the second opacity to the first opacity.

2. The method of claim 1, wherein, After the response to the detected user operation, the method further includes: In a first time period, the first area displays a first image collected by the first camera when the user operation is detected, and the second area displays a second image collected by the second camera when the user operation is detected, and the first image is superimposed on the second image; In a second time period, the first area displays the second image and a third image collected by the second camera when the user operation is detected.

3. The method of claim 2, wherein, In the first time period, a Gaussian blur value of the first image gradually increases according to a first curve, and in the first time period and the second time period, a Gaussian blur value of the second image gradually increases according to the first curve.

4. The method according to claim 2 or 3, characterized in that, The opacity of the first image displayed in the first area gradually decreases from the second opacity to the first opacity according to a second curve.

5. The method according to any one of claims 2 to 4, characterized in that, In the second time period, the opacity of the second image gradually decreases from the second opacity to the first opacity according to a second curve.

6. A method of taking a video, characterized by, The method is applied to an electronic device including a display screen, a first camera and a second camera, the first camera and the second camera are located at different sides of the display screen, and the method includes: A first area of the display screen displays a third image; the third image is a first image collected in real time by the first camera or a second image collected in real time by the second camera, wherein the first area is the entire display area of the display screen; In response to a detected user operation, a second area of the display screen displays a pre-made picture and a first image collected in real time by the first camera, wherein the pre-made picture is superimposed on the first image, and the opacity of the pre-made picture gradually increases from a first opacity to a second opacity; The first area of the display screen displays the third image and a second image collected in real time by the second camera, wherein the third image is superimposed on the second image, and the opacity of the third image gradually decreases from the second opacity to the first opacity.

7. The method of claim 6, wherein, The method further comprises, after the detecting the user operation: In the first time period, the first area displays a third image, the third image being a first image captured by the first camera at the time when the user operation is detected, or the third image being a second image captured by the second camera at the time when the user operation is detected, and the second area of the display screen displays a pre-made picture; In the second time period, the second area displays the pre-made picture and a first image captured by the first camera in real time, and the first area displays the third image and a second image captured by the second camera.

8. The method of claim 7, wherein, In the first time period, a Gaussian blur value of the third image gradually increases according to a first curve.

9. The method according to claim 7 or 8, characterized in that, An opacity of the pre-made picture gradually increases from a first opacity to a second opacity according to a second curve.

10. The method according to any one of claims 7 to 9, characterized in that, In the second time period, the opacity of the pre-made picture gradually decreases from the second opacity to the first opacity according to the second curve. In the second time period, an opacity of the third image gradually decreases from a second opacity to a first opacity according to the second curve.

11. An electronic device, comprising: A computer program product comprising a computer readable storage medium having stored thereon computer program instructions that, when executed at a processor, cause the processor to carry out the method of any one of claims 1-10.

12. A computer-readable storage medium, characterized in that, The computer readable storage medium comprises a stored program, wherein the program, when executed, controls a device in which the computer readable storage medium is located to perform the method of any one of claims 1-10.

13. A computer program product, characterised in that, The computer program product comprises executable instructions that, when executed on a computer, cause the computer to perform the method of any one of claims 1-10.

Images