Shooting Method, Device, Storage Medium and Program Product of Multi-Camera Shooting System

By displaying multiple video images on the main interface of the multi-camera shooting system and supporting user operation switching, the problem that the existing system cannot present the director picture and switch video images is solved, and the flexibility of video shooting is improved.

CN116582754BActive Publication Date: 2025-06-17HUAWEI TECH CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202210501226.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2022-01-30
Filing Date
2022-05-09
Publication Date
2025-06-17
Estimated Expiration
2042-05-09

AI Technical Summary

Technical Problem

The existing multi-camera shooting system cannot present the directing screen or switch video images during the shooting process, resulting in poor flexibility in video shooting.

Method used

A multi-camera shooting system is provided, by displaying multiple video images on the main interface and supporting users to switch video images through user operations, so as to realize the display of the guide screen and the flexible switching of video images.

Benefits of technology

It realizes displaying the guide screen and switching video images in a multi-camera shooting system, improving the flexibility and user experience of video shooting.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116582754B_ABST
    Figure CN116582754B_ABST
Patent Text Reader

Abstract

A shooting method for a multi-camera shooting system, applied to a first electronic device. The first electronic device is the main camera of the multi-camera shooting system, and the multi-camera shooting system further includes at least one auxiliary camera. The method includes: The first electronic device displays a main interface, and the main interface includes a first video image; The first electronic device receives a first user operation in the video shooting mode; According to the first user operation, the first electronic device displays a second video image on the main interface. The first video image is from the main camera or an auxiliary camera, and the second video image is from an auxiliary camera; The first electronic device receives a video switching operation, and the video switching operation is for the second video image; According to the video switching operation, the first electronic device switches the first video image and the second video image.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This application claims the priority of a Chinese patent application with the application number 202210113987.2 and the application title "Shooting Method, Device, Storage Medium and Program Product of a Multi-Camera Shooting System", which was filed with the Chinese Patent Office on January 30, 2022. The entire content thereof is incorporated herein by reference. Technical Field

[0002] Embodiments of this application relate to the technical field of video shooting, and particularly to a shooting method, device, storage medium and program product of a multi-camera shooting system. Background Art

[0003] A multi-camera shooting system refers to a system that uses multiple imaging devices to shoot an object to be photographed; it is a commonly used shooting technique in movies, live broadcast platforms, and stage shootings. Through this technique, the pictures of stories and live broadcasts can be made more vivid and have a better sense of substitution.

[0004] A mobile phone and a small handheld shooting device can be combined into a multi-camera shooting system through short-range communication technologies such as WiFi, bringing a more convenient shooting experience to users. For a multi-camera shooting system composed of a mobile phone or a small handheld shooting device, the shooter often needs to select or splice video images of multiple shooting positions during the shooting creation process. We usually refer to the video preview screens of multiple positions as the director's view, the mobile phone or wireless shooting device that controls the shooting of other positions in the multi-camera shooting system as the main position, and the mobile phone or wireless shooting device that is controlled as the auxiliary position.

[0005] In the existing related technologies, there are two ways of the director's view used in a multi-camera shooting system composed of a mobile phone and a small shooting device. One way is without a director's view. That is, when the main position records a video and selects to switch the lens, only a prompt box showing the names of the alternative lenses can be displayed. After the selection is successful, it directly switches to the corresponding lens image, without a director's view. Another way is the way of locking the shooting lens once the preview image is selected. That is, before shooting a video, the main position will present all the lens images that may be used. The shooter can select any 2 images from them to start shooting, but only the images of these two lenses can be recorded during the shooting process, and re-selection is not allowed, that is, the video image cannot be switched. Since the shooting process of the existing technology cannot present a director's view or cannot switch the shooting image, the flexibility of video shooting is poor. Summary of the Invention

[0006] Embodiments of this application provide a shooting method, device, storage medium and program product of a multi-camera shooting system, which can present a director's view and switch video images during multi-camera shooting, thereby improving the flexibility of video shooting.

[0007] In a first aspect, a shooting method for a multi-camera shooting system is provided, which is applied to a first electronic device. The first electronic device is the main camera of the multi-camera shooting system, and the multi-camera shooting system further includes at least one auxiliary camera. The method includes: The first electronic device displays a main interface, and the main interface includes a first video image; The first electronic device receives a first user operation in the video shooting mode; The first electronic device, according to the first user operation, displays a second video image on the main interface. The first video image comes from the main camera or an auxiliary camera, and the second video image comes from an auxiliary camera; The first electronic device receives a video switching operation, and the video switching operation is directed at the second video image; The first electronic device, according to the video switching operation, switches the first video image and the second video image.

[0008] When receiving the first user operation when the main camera is in the video shooting mode, a second video image that is simultaneously on the main interface with the first video image is displayed, and when receiving the video switching operation, the first video image and the second video image are switched, realizing the display of the director's screen in the multi-camera shooting interface and switching the video images during the shooting process through the director's screen, thereby improving the flexibility of video shooting.

[0009] In a possible implementation manner, the main interface includes an operation control, and the operation control is used to trigger the display of the second video image on the main interface. For example, the first user operation includes a click operation on the operation control. By clicking on the operation control, the control based on the director's screen can be conveniently realized to improve the flexibility of video shooting.

[0010] In a possible implementation manner, the first user operation includes a first swipe gesture operation on a preset position of the main interface. By the swipe gesture operation on the preset position, the control based on the director's screen can be conveniently realized to improve the flexibility of video shooting.

[0011] In a possible implementation manner, the video switching operation includes a single click operation on the second video image in the main interface. By the single click operation on the video image, the control based on the director's screen can be conveniently realized to improve the flexibility of video shooting.

[0012] In a possible implementation manner, one of the first video image and the second video image comes from a second electronic device, and the second electronic device is an auxiliary camera of the multi-camera shooting system; The other of the first video image and the second video image comes from the first electronic device or a third electronic device, and the third electronic device is another auxiliary camera of the multi-camera shooting system.

[0013] In a possible implementation, after the first electronic device switches the first video image and the second video image according to a video switching operation, the method further includes: the first electronic device receives a second user operation; the first electronic device hides the first video image on the main interface according to the second user operation; the first electronic device receives a third user operation; the first electronic device displays the first video image on the main interface according to the third user operation. A function of hiding the live broadcast screen is provided to facilitate the user to better view the live broadcast screen.

[0014] In a possible implementation, the main interface includes an operation control, and the operation control is used to trigger hiding the first video image on the main interface and hiding the first video image on the main interface. For example, the second user operation and the third user operation include click operations acting on the operation control.

[0015] In a possible implementation, the third user operation includes a first swipe gesture operation acting on a preset position, and the second user operation includes a second swipe gesture operation acting on a preset position.

[0016] In a possible implementation, after the first electronic device switches the first video image and the second video image according to a video switching operation, the method further includes: the first electronic device receives a camera position switching operation for the first video image; the first electronic device replaces the first video image with a third video image according to the camera position switching operation, and the first video image and the third video image are video images provided by different camera positions in a multi-camera shooting system. This facilitates the user to switch the live broadcast screen from different camera positions.

[0017] In a possible implementation, the camera position switching operation includes a double-click operation acting on the first video image.

[0018] In a possible implementation, after the first electronic device switches the first video image and the second video image according to a video switching operation, the method further includes: the first electronic device receives a camera switching operation for the first video image; the first electronic device replaces the first video image with a fourth video image according to the camera switching operation, and the first video image and the fourth video image are video images provided by different cameras at the same camera position in a multi-camera shooting system. This facilitates the user to switch the live broadcast screen from different cameras at the same camera position.

[0019] In a possible implementation, the camera switching operation includes a triple-click operation acting on the first video image.

[0020] In a possible implementation, after the first electronic device switches the first video image and the second video image according to a video switching operation, the method further includes: the first electronic device receives a picture-in-picture display operation, and the picture-in-picture display operation is directed at the first video image; the first electronic device displays a fifth video image at least partially surrounded by the second video image on the main interface according to the picture-in-picture display operation, and the fifth video image is the same as the first video image. This is to facilitate the recording effect of picture-in-picture.

[0021] In a possible implementation, the picture-in-picture display operation includes a drag operation acting on the first video image.

[0022] In a possible implementation,

[0023] After the first electronic device switches the first video image and the second video image according to a video switching operation, the first video image comes from a second electronic device, and the second electronic device is a secondary camera position of a multi-camera shooting system; the method further includes: after hiding the first video image on the main interface and the first electronic device does not display the video image from the second electronic device, the first electronic device sends a standby control instruction to the second electronic device, and the standby control instruction is used to instruct the second electronic device to turn off or operate in a low-power mode for any one or any combination of the following components: a camera module, an image signal processor ISP, a video processor VPU, a display screen, and a wireless communication link, and the wireless communication link is used to transmit the video image from the second electronic device to the first electronic device. By sending the standby control instruction, the temporarily unused camera position or the corresponding communication link can be put on standby to reduce power consumption.

[0024] In a possible implementation, the standby control instruction is further used to instruct the second electronic device to change the wireless communication link from the continuous communication state to the periodic sleep communication state; when the duration of the wireless communication link in the periodic sleep communication state reaches a first preset duration, the first electronic device establishes a low-power Bluetooth (BLE) connection between the first electronic device and the second electronic device and disconnects the wireless communication link; after the first electronic device sends the standby control instruction to the second electronic device, the method further includes: the first electronic device executes a first standby recovery process or a second standby recovery process; both the first standby recovery process and the second standby recovery process include: the first electronic device receives a third user operation, and the first electronic device displays a first video image on the main interface according to the third user operation; in the first standby recovery process, the third user operation is a standby recovery operation; the second standby recovery process further includes: before receiving the third user operation, the first electronic device receives a standby recovery operation; before the process of displaying a second video image on the main interface, both the first standby recovery process and the second standby recovery process further include: according to the standby recovery operation, if the standby recovery operation is received when the wireless communication link is in the periodic sleep communication state, the first electronic device sends a standby recovery control instruction to the second electronic device through the wireless communication link, and the standby recovery control instruction is used to instruct the second electronic device to restore the wireless communication link to the continuous communication state; according to the standby recovery operation, if the standby recovery operation is received when the wireless communication link is disconnected, the first electronic device sends a standby recovery control instruction to the second electronic device through the low-power Bluetooth (BLE) connection, and the standby recovery control instruction is used to instruct the second electronic device to restore the wireless communication link to the continuous communication state. By coordinating between the wireless communication link and BLE, the rapid recovery of the wireless communication link can be achieved to improve the response speed of displaying video images; in the second standby recovery process, the wireless communication link is pre-restored based on the standby recovery operation before the third user operation, and then the first video image is displayed according to the third user operation to improve the response speed of displaying video images.

[0025] In a possible implementation, in the second standby recovery process, the standby recovery operation includes a touch operation on a preset position.

[0026] In a possible implementation, the standby control instruction is used to instruct the second electronic device to change the wireless communication link from the continuous communication state to the first periodic sleep communication state; the method further includes: when the duration of the wireless communication link in the first periodic sleep communication state reaches a first preset duration, the first electronic device changes the wireless communication link to the second periodic sleep communication state, and the sleep cycle of the first periodic sleep communication state is less than the sleep cycle of the second periodic sleep communication state; after sending the standby control instruction to the second electronic device, the method further includes: the first electronic device executes a third standby recovery process or a fourth standby recovery process; both the third standby recovery process and the fourth standby recovery process include receiving a third user operation and, according to the third user operation, displaying a first video image on the main interface; in the third standby recovery process, the third user operation is a standby recovery operation; the fourth standby recovery process further includes: before receiving the third user operation, the first electronic device receives a standby recovery operation; before the process of displaying the first video image on the main interface, both the third standby recovery process and the fourth standby recovery process further include: according to the standby recovery operation, the first electronic device sends a standby recovery control instruction to the second electronic device through the wireless communication link, and the standby recovery control instruction is used to instruct the second electronic device to restore the wireless communication link to the continuous communication state. The wireless communication link automatically changes the state according to the sleep duration. On the one hand, it reduces power consumption when there is no communication. On the other hand, it can respond and recover in time when communication is frequent to improve the response speed of displaying the video image; in the fourth standby recovery process, the wireless communication link is pre-restored based on the standby recovery operation before the third user operation, and then the video image is displayed according to the third user operation to improve the response speed of displaying the video image.

[0027] In a possible implementation, in the fourth standby recovery process, the standby recovery operation is a touch operation applied to a preset position.

[0028] In a possible implementation, after the process of sending the standby recovery control instruction to the second electronic device, the method further includes: the first electronic device displays a transition image at a preset position according to the third user operation; the process of the first electronic device displaying the first video image on the main interface includes: according to the third user operation, when the first electronic device receives the first video image from the second electronic device through the wireless communication link restored to the continuous communication state, the first electronic device replaces the transition image with the first video image. When receiving the third user operation, the transition image is first displayed until the wireless communication link is restored, and then the transition image is replaced with the video image to improve the display delay problem caused by the inability to transmit the video image in time.

[0029] In a second aspect, a shooting device of a multi-camera shooting system is provided, which is applied to a first electronic device. The first electronic device is the main camera position of the multi-camera shooting system, and the multi-camera shooting system further includes at least one auxiliary camera position. The device includes: an interface display module for displaying a main interface, the main interface including a first video image; an operation receiving module for receiving a first user operation in a video shooting mode; the interface display module is further configured to, according to the first user operation, display a second video image on the main interface, the first video image being from the main camera position or an auxiliary camera position, and the second video image being from an auxiliary camera position; the operation receiving module is further configured to receive a video switching operation, the video switching operation being directed to the second video image; a video switching module for switching the first video image and the second video image according to the video switching operation.

[0030] In a possible implementation manner, the main interface includes an operation control for triggering the display of the second video image on the main interface. For example, the first user operation includes a click operation on the operation control.

[0031] In a possible implementation manner, the first user operation includes a first swiping gesture operation on a preset position of the main interface.

[0032] In a possible implementation manner, the video switching operation includes a single click operation on the second video image in the main interface.

[0033] In a possible implementation manner, one of the first video image and the second video image is from a second electronic device, and the second electronic device is an auxiliary camera position of the multi-camera shooting system; the other of the first video image and the second video image is from the first electronic device or a third electronic device, and the third electronic device is another auxiliary camera position of the multi-camera shooting system.

[0034] In a possible implementation manner, the operation receiving module is further configured to receive a second user operation; the interface display module is further configured to, according to the second user operation, hide the first video image on the main interface; the operation receiving module is further configured to receive a third user operation; the interface display module is further configured to, according to the third user operation, display the first video image on the main interface.

[0035] In a possible implementation manner, the main interface includes an operation control for triggering the hiding of the first video image on the main interface and the hiding of the first video image on the main interface. For example, the second user operation and the third user operation include click operations on the operation control.

[0036] In a possible implementation manner, the third user operation includes a first swiping gesture operation on a preset position, and the second user operation includes a second swiping gesture operation on a preset position.

[0037] In a possible implementation manner, the operation receiving module is further configured to receive a camera position switching operation for a first video image; the interface display module is further configured to replace the first video image with a third video image according to the camera position switching operation, where the first video image and the third video image are video images provided by different camera positions in a multi-camera shooting system.

[0038] In a possible implementation manner, the camera position switching operation includes a double-click operation on the first video image.

[0039] In a possible implementation manner, the operation receiving module is further configured to receive a camera switching operation for a first video image; the interface display module is further configured to replace the first video image with a fourth video image according to the camera switching operation, where the first video image and the fourth video image are video images provided by different cameras at the same camera position in a multi-camera shooting system.

[0040] In a possible implementation manner, the camera switching operation includes a triple-click operation on the first video image.

[0041] In a possible implementation manner, the operation receiving module is further configured to receive a picture-in-picture display operation for a first video image; the interface display module is further configured to display a fifth video image at least partially surrounded by a second video image on the main interface according to the picture-in-picture display operation, where the fifth video image is the same as the first video image.

[0042] In a possible implementation manner, the picture-in-picture display operation includes a drag operation on the first video image.

[0043] In a possible implementation manner, the device further includes: a standby control module, configured to, after hiding the first video image on the main interface and when the first electronic device does not display a video image from the second electronic device, send a standby control instruction to the second electronic device, where the standby control instruction is used to instruct the second electronic device to turn off or operate in a low-power mode for any one or any combination of the following components: a camera module, an image signal processor (ISP), a video processor (VPU), a display screen, and a wireless communication link, where the wireless communication link is used to transmit the video image from the second electronic device to the first electronic device, the second electronic device is a secondary camera position in a multi-camera shooting system, and the video image is the first video image or the second video image.

[0044] In a possible implementation, the standby control instruction is further used to instruct the second electronic device to change the wireless communication link from the continuous communication state to the periodic sleep communication state; the device further includes a communication control module, which is configured to establish a low-power Bluetooth (BLE) connection between the first electronic device and the second electronic device and disconnect the wireless communication link when the continuous duration of the wireless communication link in the periodic sleep communication state reaches a first preset duration; the operation receiving module is specifically configured to receive a third user operation in the first standby recovery process, or receive a standby recovery operation and a third user operation in the second standby recovery process. In the first standby recovery process, the third user operation is a standby recovery operation; the standby control module is further configured to, according to the standby recovery operation, if the standby recovery operation is received when the wireless communication link is in the periodic sleep communication state, send a standby recovery control instruction to the second electronic device through the wireless communication link, and the standby recovery control instruction is used to instruct the second electronic device to restore the wireless communication link to the continuous communication state; the standby control module is further configured to, according to the standby recovery operation, if the standby recovery operation is received when the wireless communication link is disconnected, send a standby recovery control instruction to the second electronic device through the low-power Bluetooth BLE connection, and the standby recovery control instruction is used to instruct the second electronic device to restore the wireless communication link to the continuous communication state.

[0045] In a possible implementation, in the second standby recovery process, the standby recovery operation includes a touch operation on a preset position.

[0046] In a possible implementation, the standby control instruction is used to instruct the second electronic device to change the wireless communication link from the continuous communication state to the first periodic sleep communication state; the device further includes a communication control module, which is configured to change the wireless communication link to the second periodic sleep communication state when the continuous duration of the wireless communication link in the first periodic sleep communication state reaches a first preset duration, and the sleep cycle of the first periodic sleep communication state is less than the sleep cycle of the second periodic sleep communication state; the operation receiving module is specifically configured to receive a third user operation in the third standby recovery process, or receive a standby recovery operation and a third user operation in the fourth standby recovery process. In the third standby recovery process, the third user operation is a standby recovery operation; the standby control module is further configured to, according to the standby recovery operation, send a standby recovery control instruction to the second electronic device through the wireless communication link, and the standby recovery control instruction is used to instruct the second electronic device to restore the wireless communication link to the continuous communication state.

[0047] In a possible implementation, in the fourth standby recovery process, the standby recovery operation is a touch operation on a preset position.

[0048] In a possible implementation, the apparatus further includes: The interface display module is further configured to display a transition image at a preset position according to a third user operation; specifically, the interface display module is further configured to: according to the third user operation, when the first electronic device receives a video image from the second electronic device through a wireless communication link restored to the continuous communication state, replace the transition image with a first video image.

[0049] In a third aspect, there is provided an electronic device, including a memory for storing computer program instructions and a processor for executing the computer program instructions, wherein when the computer program instructions are executed by the processor, the electronic device is triggered to execute the above-mentioned method.

[0050] In a fourth aspect, there is provided a computer-readable storage medium, the computer-readable storage medium including a stored program, wherein when the program runs, it controls the device where the computer-readable storage medium is located to execute the above-mentioned method.

[0051] In a fifth aspect, there is provided a computer program product, the computer program product including executable instructions, when the executable instructions are executed on a computer, the computer is caused to execute the above-mentioned method.

[0052] The shooting method, device, storage medium and program product of the multi-camera shooting system in the embodiments of the present application display a second video image that is simultaneously on the main interface with the first video image after receiving a first user operation when the host camera is in the video shooting mode, and switch the first video image and the second video image after receiving a video switching operation, realizing the display of a director's screen in the multi-camera shooting interface and switching video images during the shooting process through the director's screen, thereby improving the flexibility of video shooting. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required to be used in the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of this specification. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0054] Figure 1 It is a schematic structural diagram of a multi-camera shooting system provided by an embodiment of the present application;

[0055] Figure 2 It is a schematic diagram of a camera of an electronic device provided by an embodiment of the present application;

[0056] Figure 3 It is a schematic flowchart of a shooting method of a multi-camera shooting system provided by an embodiment of the present application;

[0057] Figure 4aSchematic diagram of the main interface of a first electronic device provided by an embodiment of the present application, including a first video image;

[0058] Figure 4b Schematic diagram of the main interface of a first electronic device provided by an embodiment of the present application, including a first video image and a second video image;

[0059] Figure 4c For Figure 4b Schematic diagram after switching between the first video image and the second video image in;

[0060] Figure 4d For Figure 4c Schematic diagram of the first electronic device in after hiding the first video image;

[0061] Figure 5a Schematic diagram of the process flow of a shooting method of another multi-camera shooting system provided by an embodiment of the present application;

[0062] Figure 5b Schematic diagram of the process flow of a shooting method of yet another multi-camera shooting system provided by an embodiment of the present application;

[0063] Figure 6 Schematic diagram of a scenario where a first electronic device performs a camera position switching operation provided by an embodiment of the present application;

[0064] Figure 7 Schematic diagram of a scenario where a first electronic device performs a camera switching operation provided by an embodiment of the present application;

[0065] Figure 8 Schematic diagram of a scenario where a first electronic device displays a picture-in-picture effect provided by an embodiment of the present application;

[0066] Figure 9 Schematic diagram of a scenario where a first electronic device hides the picture-in-picture effect provided by an embodiment of the present application;

[0067] Figure 10 Schematic diagram of a transmission queue during WiFi communication in an embodiment of the present application;

[0068] Figure 11 Schematic diagram of the process flow of a shooting method of a multi-camera shooting system including a first standby recovery process provided by an embodiment of the present application;

[0069] Figure 12 Schematic diagram of a change in the state of a wireless communication link in an embodiment of the present application;

[0070] Figure 13 Schematic diagram of the process flow of a shooting method of a multi-camera shooting system including a second standby recovery process provided by an embodiment of the present application;

[0071] Figure 14 It is a schematic diagram of another change in the state of a wireless communication link in the embodiments of the present application;

[0072] Figure 15 It is a schematic diagram of yet another change in the state of a wireless communication link in the embodiments of the present application;

[0073] Figure 16 It is a schematic flowchart of a shooting method of a multi-camera shooting system including a third standby recovery process provided by the embodiments of the present application;

[0074] Figure 17 It is a schematic flowchart of a shooting method of a multi-camera shooting system including a fourth standby recovery process provided by the embodiments of the present application;

[0075] Figure 18 It is a schematic diagram of the synchronization period of a wireless communication link in the embodiments of the present application;

[0076] Figure 19 It is a schematic diagram of the structure of another multi-camera shooting system in the embodiments of the present application;

[0077] Figure 20 It is a schematic diagram of a scene where a first electronic device displays a transition image provided by the embodiments of the present application;

[0078] Figure 21 It is a schematic diagram of a scene change when mobile phones form a multi-camera shooting system in the embodiments of the present application;

[0079] Figure 22 It is a schematic diagram of a scene change when a mobile phone and a shooting device form a multi-camera shooting system in the embodiments of the present application;

[0080] Figure 23 It is a block diagram of the structure of an electronic device provided by the embodiments of the present application. Detailed implementation manners

[0081] To better understand the technical solutions of this specification, the embodiments of the present application will be described in detail below with reference to the accompanying drawings.

[0082] It should be clear that the described embodiments are only a part of the embodiments of this specification, rather than all of the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments in this specification without creative efforts belong to the scope protected by this specification.

[0083] The terms used in the embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to limit this specification. The singular forms of "a", "said" and "the" used in the embodiments of the present application and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings.

[0084] It should be understood that the term "and / or" used in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.

[0085] It should be understood that in the various embodiments of the present application, “first”, “second”, etc. are only used to refer to different objects and do not mean any other limitations on the objects referred to.

[0086] See also Figure 1 , Figure 1 This is a structural schematic diagram of a multi-camera shooting system provided in an embodiment of the present application. The shooting method and device provided in the embodiment of the present application can be applicable to the multi-camera shooting system, and the multi-camera shooting system includes at least two wireless shooting devices. For example, the multi-camera shooting system 10 includes three wireless shooting devices: a first electronic device 100, a second electronic device 200 and a third electronic device 300. One wireless shooting device is a camera of the multi-camera shooting system. In order to select and switch the video images shot by each camera in the multi-camera shooting system, a convenient way is to integrate the director screen into the host position of the multi-camera shooting system. Therefore, the first electronic device 100 is used as the host position of the multi-camera shooting system. The first electronic device 100 as the host position needs to shoot video images and manage the video images shot by each camera in the multi-camera shooting system. Therefore, the first electronic device 100 needs to have at least shooting function, display function, communication function and data processing function. The first electronic device 100 can be a mobile phone or other wireless shooting device. The second electronic device 200 and the third electronic device 300 are auxiliary cameras of the multi-camera shooting system. The electronic devices as auxiliary cameras need to shoot video images and transmit them to the host position. Therefore, the second electronic device 200 needs to have at least shooting function and communication function. The second electronic device 200 and the third electronic device 300 can be wireless shooting devices or mobile phones without display function. Before shooting, the main camera and auxiliary camera in the multi-camera shooting system need to be networked first to establish a communication connection. After that, the main camera can send control instructions to the auxiliary camera through the communication connection. The auxiliary camera can realize, for example, picture control of the shot video, control of the shooting camera, control of whether the video image is transmitted to the main camera, control of whether the auxiliary camera is in sleep mode, etc. according to the control instructions.

[0087] Among them, the first electronic device 100, the second electronic device 200, and the third electronic device 300 are connected through a wireless communication network, for example, a wireless communication connection can be established through WiFi. The instruction transmission and data transmission between the first electronic device 100, the second electronic device 200, and the third electronic device 300 can be transmitted through a WiFi wireless communication link. In order to realize the management and control of the video images captured by the slave camera position by the master camera position, the master camera position can set the Camera Hardware Abstraction Layer (CameraHAL), and the slave camera position can set the Virtual Camera Agent (VirtualCameraAgent). When the master camera position detects that the control instruction involves the remote slave camera position, the control instruction is forwarded to the Virtual Camera Agent of the peer slave camera position through the CameraHAL to control the slave camera position. The Virtual Camera Agent of the slave device is used to escape the control instruction sent by the peer master camera position to the corresponding ISP and then control the camera. For example, it can be realized that the master camera position allows the peer slave camera position to transmit the video image to the master camera position, and the video image of the slave camera position is presented on the master camera position.

[0088] It can be understood that the structure of the multi-camera shooting system 10 illustrated in the embodiments of the present application does not limit the structure of the multi-camera shooting system 10. In other embodiments of the present application, the multi-camera shooting system 10 may include more or fewer wireless shooting devices than those shown in the figure. Generally, one master camera position is set in the multi-camera shooting system 10, and in special cases, multiple master camera positions may also be set.

[0089] See Figure 2 , Figure 2 which is a schematic diagram of the camera of an electronic device provided by the embodiments of the present application. In Figure 2 , a mobile phone is taken as an example to Figure 1 exemplarily illustrate the first electronic device 100 in Figure 2 . The front view and rear view of the mobile phone are shown. Two front cameras 111 and 112 are arranged on the front side of the mobile phone, and four rear cameras 121, 122, 123, and 124 are arranged on the rear side of the mobile phone. By configuring multiple cameras, multiple shooting modes can be provided for users, improving the flexibility of users' video shooting.

[0090] It can be understood that Figure 2The illustration is only exemplary and should not be regarded as a limitation on the protection scope of this application. For example, different mobile phones may have different numbers and positions of camera configurations. In addition, the electronic devices involved in the embodiments of this application may include, in addition to mobile phones, tablet computers, personal computers (PCs), personal digital assistants (PDAs), smart watches, netbooks, wearable electronic devices, augmented reality (AR) devices, virtual reality (VR) devices, in-vehicle devices, smart cars, smart speakers, robots, smart glasses, smart TVs, etc. In some possible implementation manners, the electronic device may also be referred to as a terminal device, a user equipment (UE), etc., and the embodiments of this application do not limit this. In addition, Figure 1 the second electronic device and the third electronic device shown may also adopt Figure 2 the electronic device shown.

[0091] In an actual application scenario, after the multi-camera shooting system network is successfully established, the electronic devices at multiple camera positions all enter the working mode. When the electronic device acting as the main camera position enters the video shooting mode, the main interface will be displayed on the main camera position. The main interface is used to display video images. The video images displayed here are the video images provided by the main camera position or the secondary camera positions. When the main camera position is successfully networked for the first time, one video image provided by the main camera position or the secondary camera positions in the multi-camera shooting system can be displayed as the initial video image in the main interface according to the pre-setting of the system.

[0092] Refer to Figure 3 , Figure 3 which is a schematic flowchart of a shooting method for a multi-camera shooting system provided by an embodiment of this application, and is applied to Figure 1 the first electronic device 100 of the multi-camera shooting system shown. The first electronic device 100 is the main camera position of the multi-camera shooting system. As Figure 3 shown, the shooting method may include:

[0093] Step 1000: As Figure 4a shown, the first electronic device displays the main interface 20. The main interface 20 is the interface for the host or the recorder to view. The main interface 20 includes the first video image 201. The first video image 201 is, for example, an image of a person holding a bicycle;

[0094] Step 1001: The first electronic device receives a first user operation in the video shooting mode;

[0095] Step 1002: As Figure 4bAs shown, according to the first user operation, the first electronic device displays the second video image 202 on the main interface 20. The second video image 202 is, for example, a meditation screen. The first video image 201 and the second video image 202 can be overlapped and displayed on the main interface 20. The display area of the first video image 201 can be larger than that of the second video image 202. The second video image 202 can be displayed on the upper layer of the first video image 201. The first video image 201 comes from the main camera position or the secondary camera position, and the second video image 202 comes from the secondary camera position. That is, the first video image 201 and the second video image 202 are video images provided by different camera positions in a multi-camera shooting system;

[0096] At this time, the first video image 201 is a recording screen or a live broadcast screen, that is, the first video image 201 will be recorded and saved or transmitted to the server for live broadcast, which is the video image finally presented to the audience. The second video image 202 is a non-recording screen, or a director's screen, that is, the second video image 202 is only used for the host to preview and will not be presented to the audience for viewing. If the second video image 202 comes from the second electronic device, then when the first electronic device displays the second video image 202 on the main interface 20, the first electronic device will send an instruction to the second electronic device to obtain the second video image, and the second electronic device will transmit the second video image it shoots to the first electronic device according to this instruction.

[0097] Step 1003: The first electronic device receives a video switching operation, and the video switching operation is directed at the second video image 202. For example, the user clicks on the meditation screen in the main interface 20;

[0098] Step 1004: As Figure 4c shown, according to the video switching operation, the first electronic device switches the first video image 201 and the second video image 202, that is, switches the first video image 201 to the original display area of the second video image 202, and switches the second video image 202 to the original display area of the first video image 201. After the switching, the first video image 201 becomes a director's screen only used for the host to preview and will no longer be presented to the audience for viewing. The second video image 202 becomes a recording screen or a live broadcast screen and is presented to the audience for viewing. At this time, the first video image 201 can be displayed on the upper layer of the second video image 202.

[0099] For example, when the user clicks on the meditation screen in the Figure 4b shown main interface 20, the first electronic device will perform video image switching, and the main interface 20 will be switched from as Figure 4b shown to as Figure 4c shown. In addition to the switching of the video images in the interface, in terms of function, this video switching operation switches the meditation screen to a recording screen and switches the hand-held bicycle screen to a director's screen.

[0100] Specifically, when the first electronic device (host device) successfully networks with the secondary device, the first electronic device 100 enters the shooting application. Here, the shooting application includes, but is not limited to, shooting or live broadcast applications, which can be the camera application on a mobile phone or other applications that support a multi-camera system. When the first electronic device 100 enters the shooting application and is in the video shooting mode, the user can see the first video image 201 on the main interface 20. If the user wishes to view the video images provided by each camera through the director's screen, the user can perform a first user operation to cause the second video image 202, which serves as the director's screen, to be displayed on the main interface 20, so that while viewing the video image from one camera on the main interface 20, the user can also view the video image from another camera.

[0101] When the user wishes to switch the second video image 202 to a recording screen, a video switching operation is performed. It should be noted that the main interface 20 can include multiple second video images 202. For example, the user can see multiple second video images 202 provided by multiple cameras through the main interface 20. The user can select a certain second video image to be recorded from the main interface 20 and switch it with the first video image 201 to achieve the recording of this second video image 202, that is, select the second video image 202 to be recorded from the main interface 20 through the video switching operation and switch it with the first video image 201. By switching the video images, the flexibility of video shooting is improved. Additionally, the original first video image 201 on the main interface 20 is switched to the director's screen, so that the host can continue to view the first video image 201 on the main interface 20.

[0102] Exemplarily, the main interface 20 includes operation controls, such as a video recording button, a pause button, a floating ball, a zoom button, etc. The floating ball can be dragged to any position. The floating ball is used to trigger the display of the second video image on the main interface. For example, the first user operation includes a click operation on an operation control (such as the floating ball), or the first user operation includes a first swipe gesture operation on a preset position 30. For example, as Figure 4b shown, the preset position 30 is the display area corresponding to the second video image 202 before video switching; before the video switching operation, the video switching operation includes a single click operation on the second video image 202. This single click operation can be a quick single click operation or a long press operation. For example, the first swipe gesture operation is a right swipe gesture operation. When the user performs a right swipe gesture operation at the preset position 30 on the lower left side of the main interface 20 as Figure 4a shown, the main interface 20 will change to as Figure 4b shown, and the second video image 202 will be displayed. Again, for example, when the first electronic device displays a floating ball, when the user clicks as Figure 4aAfter the floating ball shown, the main interface 20 will become as Figure 4b shown, and display the second video image 202. The first user operation can also be other forms of user operations, such as virtual button operations, physical button operations, etc. This embodiment does not limit the form of the first user operation.

[0103] Exemplarily, the video switching operation can include a long - press operation by the user on the second video image 202. For example, when the user long - presses the second video image 202 as Figure 4b shown, the main interface 20 will become as Figure 4c shown, and the first video image 201 and the second video image 202 are switched. At this time, if the user long - presses the first video image 201, then the first video image 201 and the second video image 202 will be switched again, that is, the main interface 20 will change back to as Figure 4b shown. The video switching operation can also be other forms of user operations, such as virtual button operations, physical button operations, etc. For example, the main interface 20 can include a video switching control, and the video switching operation can include an operation on the video switching control. This embodiment does not limit the form of the video switching operation.

[0104] Further, when the user does not need to use the non - recorded screen, the second video image 202 as Figure 4b shown can be hidden, or the first video image 201 as Figure 4c shown can be hidden, so that the user can better view the video image of the ongoing recording.

[0105] As Figure 4a - 4d and Figure 5a shown, on the basis of the embodiment as Figure 3 shown, after the process in which the first electronic device in step 1004 switches the first video image 201 and the second video image 202 according to the video switching operation, the shooting method can further include:

[0106] Step 1005: The first electronic device receives a second user operation;

[0107] Step 1006: The first electronic device hides the first video image 201 on the main interface according to the second user operation, that is, according to the second user operation, the screen display state of the first electronic device changes from Figure 4c to Figure 4d , and in this example, after hiding the first video image 201, the main interface 20 only displays the second video image 202.

[0108] When the user needs to display the first video image 201 again, steps 1007 and 1008 can also be executed. Step 1007: Receive the third user operation. Step 1008: According to the third user operation, display the first video image 201 on the main interface 20. The way of displaying or hiding the non-recording screen as needed improves the flexibility of video shooting. Among them, if the first video image 201 comes from the second electronic device, when the first electronic device hides the first video image 201 on the main interface, there may be two situations for the second electronic device. One situation is that the second electronic device still transmits the first video image to the first electronic device so that the first electronic device can quickly resume displaying the first video image. The other situation is that the second electronic device receives an instruction from the first electronic device and no longer transmits the first video image to the first electronic device according to this instruction to save power. However, if the first electronic device needs to resume displaying the first video image, the first electronic device needs to send an instruction to resume displaying the first video image to the second electronic device. The second electronic device receives this instruction and resumes transmitting the first video image to the first electronic device according to this instruction. If the second electronic device is a mobile phone, during the process of the first electronic device hiding the first video image, the screen of the second electronic device can always display the first video image or can also hide the first video image at the same time.

[0109] Figure 5b The process shown is another shooting process parallel to Figure 5a the process shown. On the basis of the embodiment shown in Figure 3 after the first electronic device displays the second video image and before the first electronic device receives the video switching operation, that is, after step 1002 and before step 1003, the shooting method further includes: receiving the second user operation; according to the second user operation, hiding the second video image on the main interface, even if the interface shown in Figure 4b becomes the interface shown in Figure 4a receiving the third user operation; according to the third user operation, displaying the second video image on the main interface, even if the interface shown in Figure 4a is restored to the interface shown in Figure 4b After that, steps 1003 and 1004 can be executed to implement video switching, so that the interface shown in Figure 4b becomes the interface shown in Figure 4c shown.

[0110] That is to say, in the process shown in Figure 5a after the user executes the video switching operation, the first video image 201 as the non-recording screen is hidden; in Figure 5bIn the process shown, the user can first hide the second video image 202 that is not the recorded screen, and can watch the first video image 201 in a larger screen through the main interface 20. When a video switch is needed, first restore the display of the second video image 202 by performing a third user operation, and then perform a video switch operation.

[0111] In addition, it should be noted that in 5a and Figure 5b In the process shown, the third user operation can be the same as the above-mentioned first user operation, or different from the above-mentioned second user operation.

[0112] Exemplarily, the operation control (such as a floating ball) is used to trigger hiding the first video image on the main interface and hiding the first video image on the main interface. For example, the second user operation and the third user operation include click operations on the operation control (such as a floating ball). In addition, the third user operation can also include a first swipe gesture operation on a preset position 30; the second user operation can include a second swipe gesture operation on the preset position 30. The first swipe gesture operation and the second swipe gesture operation can be swipe gesture operations in opposite directions. For example, the second swipe gesture operation is a left swipe gesture operation. For example, when the user performs a left swipe gesture operation at the preset position 30 as Figure 4c shown, or clicks the floating ball, the first video image 201 will be hidden, and the main interface 20 will become as Figure 4d shown. After that, if the user performs a right swipe gesture operation at the preset position 30 as Figure 4d shown, or clicks the floating ball, the main interface 20 will become as Figure 4c shown, that is, the display of the first video image 201 is restored. In addition, the second user operation and the third user operation can also be other forms of user operations, such as virtual key operations, physical key operations, etc. The forms of the second user operation and the third user operation are not limited in this embodiment.

[0113] The following further describes the above embodiments based on Figure 4a - 4d this.

[0114] See Figure 4a , a first video image 201 is displayed on the main interface 20 of the first electronic device. The first video image 201 is a video image provided by the first electronic device or the secondary camera position.

[0115] Among them, the first video image 201 can be recorded. When the user performs a video recording operation, for example, when the user clicks the video recording button, the first electronic device receives the video recording operation, saves the data of the first video image 201, or transmits the data of the first video image 201 to the server for live streaming, etc. The data of the video image is obtained by the camera providing the video image and transmitted to the first electronic device, and then saved by the first electronic device after encoding processing.

[0116] It can be understood that in order to display the first video image 201 more clearly, the first video image 201 can be full-screen displayed on the main interface 20, or it can be not full-screen displayed, but medium-screen displayed or small-screen displayed. Specifically, it can be set according to the user's needs. This embodiment does not limit the size of the first video image 201.

[0117] In addition, the first video image 201 is a video image provided by the first electronic device or the auxiliary camera. If the display screen of the first electronic device is small, the main interface 20 can only display one first video image. If the display screen of the first electronic device is large, the main interface 20 can also display multiple first video images. The multiple first video images can come from different cameras or different cameras of the same camera. For example, when the main interface 20 displays two first video images, the two first video images can be vertically tiled or horizontally tiled and displayed on the main interface. In the actual application scenario, it can be set based on the screen size of the first electronic device. This embodiment does not limit the number of first video images displayed on the main interface.

[0118] See Figure 4b . After receiving the first user operation, the second video image 202 is displayed on the main interface 20. The second video image 202 is a video image provided by the first electronic device or the auxiliary camera. The first video image 201 and the second video image 202 are video images provided by different cameras.

[0119] It can be understood that, in order not to affect the user's viewing of the first video image 201, the display size of the second video image 202 will not be set too large. Generally, the display size of the second video image 202 is smaller than that of the first video image 201, and the resolution of the second video image 202 is lower than that of the first video image 201. When the video image of the secondary camera position is the second video image 202, the first electronic device sends a video acquisition instruction to the secondary camera position, and the secondary camera position can transmit the low-resolution video image to the first electronic device to reduce the amount of data transmission. If the first video image 201 is full-screen displayed, the second video image 202 will be superimposed on the first video image 201 for display. If the first video image 201 is not full-screen displayed, the second video image 202 can be superimposed or not superimposed on the first video image 201 for display. In this embodiment, the size, position of the second video image, and the positional relationship with the first video image are not limited.

[0120] In addition, when the display screen of the first electronic device is relatively large, the main interface 20 may include more than one second video image. For example, the main interface 20 may display two second video images, and the two second video images may be tiled vertically or horizontally in a partial area of the main interface 20. In the actual application scenario, it can be set based on the size of the display screen and the size of the main interface. In this embodiment, the number of the second video images 202 is not limited.

[0121] See Figure 4c . In Figure 4b the shown scenario, after the first electronic device receives the user's video switching operation, the video switching operation is directed to the second video image 202. As Figure 4c shown, the display effects of the first video image 201 and the second video image 202 in the main interface 20 are switched. At the same time, in the background, the first video image 201 is switched to a non-recording screen, and the second video image 202 is switched to a recording screen.

[0122] In a possible implementation manner, one of the first video image and the second video image comes from the second electronic device 200, and the second electronic device 200 is a secondary camera position of a multi-camera shooting system; the other of the first video image and the second video image comes from the first electronic device 100 or the third electronic device 300, and the third electronic device 300 is another secondary camera position of the multi-camera shooting system. That is to say, in Figure 4b or Figure 4c the shown scenario, combined with Figure 1In the multi-camera shooting system shown, in a possible shooting process, one of the first video image 201 and the second video image 202 is taken by the first electronic device 100 itself, and the other of the first video image 201 and the second video image 202 is taken by the second electronic device 200; in another possible shooting process, one of the first video image 201 and the second video image 202 is taken by the second electronic device 200, and the other of the first video image 201 and the second video image 202 is taken by the third electronic device 300.

[0123] See Figure 4d , Figure 4d is Figure 4c a schematic diagram of the scene after the first electronic device in hides the first video image. After receiving the second user operation, as Figure 4d shown, the main interface 20 hides the first video image, and at this time the main interface 20 only displays the second video image 202.

[0124] In some embodiments, when the user needs to view other video images, it can be achieved by performing a camera position switching operation.

[0125] Such as Figure 6 shown, on the basis of the embodiment shown in Figure 3 after the first electronic device switches the first video image 201 and the second video image 202 according to the video switching operation, the shooting method may further include:

[0126] Execute step 1009: The first electronic device receives a camera position switching operation, and the camera position switching operation is directed at the first video image 201;

[0127] Execute step 1010: The first electronic device replaces the first video image 201 with a third video image 203 according to the camera position switching operation, and the first video image 201 and the third video image 203 are video images provided by different camera positions in the multi-camera shooting system.

[0128] For example, a multi-camera shooting system includes three electronic devices. Before receiving the camera position switching operation, the second video image 202 on the main interface 20 of the first electronic device 100 is a video image captured by the camera of the first electronic device 100 itself. For example, it is a meditation scene. The second video image 202 on the main interface 20 of the first electronic device 100 is a video image captured by the second electronic device 200. For example, it is a scene of a person holding a bicycle. The video image captured by the third electronic device 300 (for example, a landscape scene) is not yet displayed on the first electronic device 100. After receiving the camera position switching operation, according to the camera position switching operation, the scene of a person holding a bicycle on the main interface 20 of the first electronic device 100 is switched to a landscape scene. That is, it realizes the switching of the non-recording scene on the main interface 20 to the video images provided by different camera positions.

[0129] When the user needs to switch the non-recording scene based on the camera position, the user can perform the camera position switching operation so that the user can view the video images provided by other camera positions through the main interface 20 of the first electronic device 100. When the first electronic device 100 receives the camera position switching operation, the video image of another camera position provided by the main camera position or the auxiliary camera position is displayed at the position of the non-recording scene. For example, there are four camera positions providing video images for the main camera position and the auxiliary camera position. Among them, the video image provided by one camera position is the recording scene on the main interface 20, and the video images provided by the remaining three camera positions can all be presented as the non-recording scenes on the main interface 20. If only the video image provided by one camera position is currently displayed as the non-recording scene and the video images provided by the other two camera positions are not displayed on the main interface 20, then by performing the camera position switching operation once, the non-recording scene on the main interface 20 is switched to the video image provided by another camera position. By repeatedly performing the camera position switching operation, the user can view the video images provided by the three camera positions in turn. Through the camera position switching operation, the user can easily view the video images of all camera positions that have not entered the main interface 20, which is convenient for the user to view the video images of different camera positions.

[0130] Exemplarily, the camera position switching operation includes a double-click operation on the first video image 201. For example, when the user double-clicks on the first video image 201 displayed on the main interface 20, the first video image 201 is switched to the third video image 203 of another camera position. If the user continues to double-click on the third video image 203, the third video image 203 is switched to the video image of another camera position, and so on. Each double-click switches once. The order of camera position switching can be preset by the system. The camera position switching operation can also be other forms of operations, such as virtual key operations, physical key operations, etc. For example, the main interface can include a camera position switching control, and the camera position switching operation can include an operation on the camera position switching control. The form of the camera position switching operation is not limited in this embodiment.

[0131] During the camera position switching process, different situations may exist for the second electronic device and the third electronic device. During the camera position switching process of the first electronic device, the second electronic device can continuously transmit the first video image to the first electronic device, and the third electronic device can also transmit the third video image to the first electronic device, so that the first electronic device can quickly resume displaying the first video image or the third video image. Additionally, when switching the camera position, the first electronic device can also send instructions to the second electronic device and the third electronic device. For example, the second electronic device receives an instruction from the first electronic device and stops transmitting the first video image to the first electronic device according to this instruction to save power consumption. The third electronic device receives an instruction from the first electronic device and resumes transmitting the third video image to the first electronic device according to this instruction. If the second electronic device and the third electronic device are mobile phones, during the camera position switching process of the first electronic device, the screen of the second electronic device can always display the first video image, or the second electronic device can hide the first video image after the first electronic device switches the first video image to the third video image. The screen of the third electronic device can always display the third video image, or the third electronic device can start displaying the third video image after the first electronic device switches the first video image to the third video image.

[0132] In some embodiments, such as Figure 7 shown, for example, when the second electronic device 200 is Figure 2 a mobile phone including a front camera and a rear camera as shown, when the first video image in the main interface 20 of the current first electronic device 100 comes from the rear camera of the second electronic device 200, in order to view the video image provided by the front camera of the second electronic device 200, it can be achieved through a camera switching operation.

[0133] In Figure 3 the embodiment shown, after the first electronic device 100 switches the first video image 201 and the second video image 202 according to the video switching operation, the shooting method may further include:

[0134] Performing step 1011: The first electronic device 100 receives a camera switching operation, and the camera switching operation is directed at the first video image 201;

[0135] Performing step 1012: The first electronic device 100 replaces the first video image 201 with a fourth video image 204 according to the camera switching operation, and the first video image 201 and the fourth video image 204 are video images provided by different cameras of the same camera position in the multi-camera shooting system.

[0136] For example, the multi-camera shooting system includes a first electronic device 100 and a second electronic device 200. Among them, the second electronic device 200 has a front camera and a rear camera. Before receiving the camera switching operation, the second video image 202 in the main interface 20 of the first electronic device 100 is a video image captured by the camera of the first electronic device 100 itself. For example, it is a meditation picture. The first video image 201 in the main interface 20 of the first electronic device 100 is a video image captured by the rear camera of the second electronic device 200. For example, it is a picture of a person holding a bicycle. At this time, the second electronic device 200 also displays the picture of a person holding a bicycle captured by its rear camera. After receiving the camera switching operation, according to the camera switching operation, the first electronic device 100 switches the first video image 201 in the main interface 20 to the fourth video image 204. The fourth video image 204 is a self-portrait picture captured by the front camera of the second electronic device 200. According to the camera switching operation, a corresponding control instruction can also be sent to the second electronic device 200 to make the second electronic device 200 also switch to display the self-portrait picture captured by its front camera. That is, it realizes the switching of the non-recording picture in the main interface 20 of the first electronic device 100 to the video images provided by different cameras of the same camera position.

[0137] When the user needs to switch the non-recording picture in the main interface 20 of the first electronic device 100 to the video image provided by another camera of the same camera position, the camera switching operation can be performed. When the first electronic device 100 receives the camera switching operation, it will switch the current non-recording picture in the main interface 20 to the video image provided by another camera of the same camera position. Through the camera switching operation, the user can easily view the video images provided by each camera of the same camera position, which is convenient for the user to watch the video images of different cameras and improves the flexibility of video shooting.

[0138] Exemplarily, the camera switching operation includes a triple-click operation on the first video image 201. For example, when the user triple-clicks on the first video image 201 in the main interface 20, the first video image 201 will be switched to the video image provided by another camera of the same camera position. If there are more than two cameras, the triple-click operation can continue. Each triple-click will cause a switch. The order of camera switching can be preset by the system. The camera switching operation can also be other forms of operations, such as virtual key operations, physical key operations, etc. For example, the main interface 20 can include a camera position switching control. The camera position switching operation can include an operation on the camera position switching control. The form of the camera switching operation in this embodiment is not limited.

[0139] During the camera switching process, different situations may occur for the second electronic device. During the camera switching process of the first electronic device, the second electronic device can continuously transmit the first video image and the fourth video image to the first electronic device, so that the first electronic device can quickly resume displaying the first video image or the fourth video image. Additionally, when the camera is switched, the first electronic device can also send an instruction to the second electronic device. For example, before the first electronic device receives the camera switching operation, both the first electronic device and the second electronic device display the first video image. When the first electronic device receives the camera switching operation, it sends a corresponding instruction to the second electronic device, and the second electronic device displays the fourth video image according to this instruction, and the first electronic device switches the first video image to the fourth video image. Additionally, before the camera is switched, the second electronic device may not have transmitted the fourth video image to the first electronic device. In this case, when the second electronic device receives the instruction from the first electronic device, it can transmit the fourth video image to the first electronic device to facilitate the camera switching of the first electronic device.

[0140] In some embodiments, in order to meet the diverse requirements of users for shooting videos and increase the presentation methods of videos, a picture-in-picture effect can also be added to the recorded screen.

[0141] Such as Figure 8 shown, based on the embodiment shown in Figure 3 after the process of the first electronic device 100 switching the first video image 201 and the second video image 202 according to the video switching operation, the shooting method may further include:

[0142] Performing step 1013: The first electronic device 100 receives a picture-in-picture display operation, and the picture-in-picture display operation is directed at the first video image 201;

[0143] Performing step 1014: The first electronic device 100, according to the picture-in-picture display operation, displays at least a part of the fifth video image 205 surrounded by the second video image 202 on the main interface 20. The fifth video image 205 is the same as the first video image 201, and the fifth video image 205 and the second video image 202 are the recorded screen or the live broadcast screen, that is, the superimposed screen of the fifth video image 205 and the second video image 202 is used to present to the audience for viewing.

[0144] For example, the picture-in-picture display operation includes a drag operation on the first video image 201. When the user holds the first video image 201 and drags it upward, the fifth video image 205 will be generated.

[0145] It can be understood that the display size of the fifth video image 205 is smaller than that of the second video image 202, and the resolution of the fifth video image 205 is lower than that of the second video image 202. When the fifth video image 205 comes from a certain secondary camera position, the secondary camera position can transmit a low-resolution video image to the first electronic device to reduce the amount of data transmission.

[0146] When the user needs to display a picture-in-picture effect in the recording screen, a picture-in-picture display operation can be executed to enable the main interface 20 of the first electronic device 100 to display the fifth video image 205 as a part of the recording screen. At least a part of the fifth video image 205 is surrounded by the second video image 202. The superposition of the fifth video image 205 and the second video image 202 is the recording screen, that is, the fifth video image 205 and the second video image 202 are recorded as superimposed video images, so as to be saved as a video screen with a picture-in-picture effect, or transmitted to the server for live broadcast to form a live broadcast screen with a picture-in-picture effect. The recording effect of the picture-in-picture video image increases the expression form of the video and improves the flexibility of video shooting.

[0147] Exemplarily, the picture-in-picture display operation can include a drag operation on the first video image 201. For example, when the user holds the first video image 201 displayed on the main interface 20 and drags it upward or in the upper right direction, the same fifth video image 205 as the first video image 201 will be additionally displayed on the main interface 20. The picture-in-picture display operation can also be other forms of operations, such as virtual key operations, physical key operations, etc. For example, if the main interface includes a picture-in-picture control, the picture-in-picture display operation can include an operation on the picture-in-picture control. The form of the picture-in-picture display operation in this embodiment is not limited. In addition, for the fifth video image 205, it can be dragged in any area covered by the main interface 20.

[0148] Exemplarily, by dragging the fifth video image 205 to move in the main interface 20, the user can move the position of the fifth video image 205 in the main interface 20, and the user can select the position to place the fifth video image 205 according to needs, improving the flexibility of video shooting.

[0149] Further, when the user does not need to display the fifth video image 205, the fifth video image 205 can be hidden to end the picture-in-picture display effect.

[0150] As Figure 9 shown, on the basis of the embodiment shown in Figure 8 when the main interface 20 of the first electronic device 100 displays the fifth video image 205, the shooting method can further include:

[0151] Step 1015 is executed: The first electronic device 100 receives a picture-in-picture hiding operation, which may include a dragging operation on the fifth video image 205. For example, when the user holds the fifth video image 205 and drags it upward and slides out of the boundary of the main interface 20, the fifth video image 205 will be hidden, that is, the fifth video image is not displayed on the main interface 20 of the first electronic device 100.

[0152] Step 1016: The first electronic device 100 hides the fifth video image 205 on the main interface 20 according to the picture-in-picture hiding operation.

[0153] It should be noted that when the user no longer needs the picture-in-picture effect, a picture-in-picture hiding operation can be performed to hide the fifth video image 205. When the user needs the picture-in-picture display again, a picture-in-picture display operation can be performed again to display the fifth video image 205. The way of displaying or hiding the picture-in-picture effect as needed improves the flexibility of video shooting.

[0154] Exemplarily, in addition to the dragging operation, the picture-in-picture hiding operation can also be other forms of operations, such as virtual key operations, physical key operations, etc. For example, the main interface includes a picture-in-picture control, and the third interface hiding operation can be an operation on the picture-in-picture control. The form of the third interface hiding operation is not limited in this embodiment.

[0155] It can be understood that Figure 8 and Figure 9 the superposition of the first video image 201 and the fifth video image 205 in

[0156] is a recording interface. When the user performs a video recording operation, such as clicking the video recording button, the first electronic device 100 receives the video recording operation and saves the video image data. The video image data is the video image data corresponding to the video image after the superposition of the first video image 201 and the fifth video image 205. The video image data is collected by the camera providing the video image and transmitted to the first electronic device 100, and the first electronic device 100 saves or transmits it to the server for live broadcast after encoding processing.

[0157] In addition, during the video image shooting process, there are usually some special effect controls, such as beauty effects, etc. These effects can be directly implemented on the video image on the first electronic device, or the special effect control instructions can be transmitted to the auxiliary camera corresponding to the video image. The corresponding auxiliary camera adjusts the video image according to the special effect control instructions and transmits the adjusted video image to the first electronic device 100 for display. Additionally, if the first electronic device 100 displays a fifth video image, that is, the picture-in-picture recording method is used, the same special effect control can be implemented on the second video image and the fifth video image, or different special effect controls can be implemented on the second video image and the fifth video image respectively.

[0158] In some embodiments, when the user operates on the video image displayed on the main interface 20 of the first electronic device 100, and the video image being operated on is provided by the auxiliary camera, the first electronic device 100 needs to send a shooting control instruction to the auxiliary camera so that the auxiliary camera transmits the operated video image to the first electronic device 100 for display. To reduce the delay of image display, the shooting control instructions sent by the first electronic device 100 to the auxiliary camera all need to be transmitted with priority.

[0159] In some embodiments, as Figure 1 and Figure 3 shown, assume that in step 1002 above, the second video image comes from the second electronic device 200, and the second electronic device 200 is an auxiliary camera of the multi-camera shooting system. The above step 1002: The process of the first electronic device 100 displaying the second video image 202 on the main interface 20 according to the first user operation includes:

[0160] Step 10021: The first electronic device 100 generates a data transmission control instruction according to the first user operation, and the data transmission control instruction carries a high-priority tag;

[0161] Step 10022: The first electronic device 100 transmits the data transmission instruction to the second electronic device 200 based on high priority;

[0162] Among them, the data transmission instruction is used to control the second electronic device 200 to transmit the second video image it shoots back to the first electronic device 100;

[0163] Step 10023: The first electronic device 100 receives the second video image sent by the second electronic device 200;

[0164] Step 10024: The first electronic device 100 displays the second video image 202 on the main interface 20.

[0165] In addition, the above method may further include: sending a focusing control instruction or a zoom control instruction, etc. to the second electronic device 200 based on a high priority according to a user operation. When the first electronic device 100 communicates with the second electronic device 200 via WiFi, shooting control instructions such as a data transmission control instruction, a focusing control instruction, and a zoom control instruction are transmitted via WiFi to the secondary camera position for shooting control. Figure 10 FIG. shows a schematic diagram of a transmission queue. Media Access Control Service Data Units (MSDUs) are mapped and classified into multiple transmission queues VO, A_VO, A_VI, VI, BE, and BK through the transmission queue and access category. VO refers to Voice, VI refers to Video, BE refers to Best effort, and BK refers to Background; the transmission queues will be classified into Enhanced Distributed Channel Access (EDCA) queues, and the EDCA queues include VO, VI, BE, and BK in order of decreasing priority. To provide a better user operation experience, in the embodiments of the present application, data packets of these shooting control instructions carry high-priority tags, and these data packets carrying high-priority tags are treated differently and placed in the EDCA queue of WiFi to be transmitted to the second electronic device using a high-priority queue (i.e., Figure 10 the VO queue in). Other control instructions other than the shooting control instructions and the transmission data of the video image are placed in the queue according to the protocol default. By transmitting the shooting control instructions to the second electronic device based on high priority, the problem of communication delay between the first electronic device and the secondary camera position is reduced.

[0166] In some embodiments, to reduce the power consumption of each camera position in a multi-camera shooting system, when the video image of a certain camera position is not displayed on the main interface of the first electronic device, the corresponding camera position can be controlled to enter a low-power working state.

[0167] Figure 11 FIG. is a schematic flowchart of a shooting method for another multi-camera shooting system provided by the embodiments of the present application. Based on the embodiment shown in Figure 1 before receiving a third user operation, for example, after step 1004, the first video image 201 comes from the second electronic device 200, and the second electronic device 200 is a secondary camera position of the multi-camera shooting system; the shooting method may further include:

[0168] Step 1005: Receive a second user operation;

[0169] Step 1006: Hide the first video image 201 on the main interface 20 according to the second user operation. For the specific processes of steps 1005 and 1006, please refer to the relevant description above. Figure 5a and Figure 5b related description content;

[0170] Step 1017: After hiding the first video image 201 on the main interface 20 and when the first electronic device 100 does not display the video image from the second electronic device 200, the first electronic device 100 sends a standby control instruction to the second electronic device 200. The standby control instruction is used to instruct the second electronic device 200 to turn off or operate any one or any combination of the following components in a low-power mode: camera module, image signal processor ISP, video processor VPU, display screen, and wireless communication link. The wireless communication link is used to transmit the video image from the second electronic device 200 to the first electronic device 100. For the second electronic device 200, if it receives the standby control instruction, it will enter standby according to the standby control instruction. For example, it will turn off or switch any of the above components or combinations to operate in a low-power mode.

[0171] Among them, the camera positions in the multi-camera shooting system may be mobile devices or other wireless shooting devices, which can only rely on their own power. For example, the second electronic device 200 can be a mobile phone. It is necessary to consider reducing the shooting power consumption of the mobile phone. The way to reduce power consumption is to turn off at least some components of the second electronic device 200 or control them to operate in a low-power mode when the second electronic device 200 is not in use to maintain the low power consumption of the device. For example, control the second electronic device 200 to enter the standby mode. That is to say, for the multi-camera shooting system, if the video image of a certain camera position is not displayed by the first electronic device 100, that is, not used by the first electronic device 100, then the first electronic device 100 can control the corresponding camera position to reduce power consumption by sending a standby control instruction to it. In addition, for the first electronic device 100 itself, if the video images it displays all come from the auxiliary camera positions, that is, the first electronic device 100 does not display the video images it shoots itself, then it can also control the components that do not affect the display, such as the camera module and image signal processor ISP of the first electronic device 100, to turn off or control them to operate in a low-power mode. For example, the multi-camera shooting system includes the first electronic device 100 and the second electronic device 200. As Figure 4c and Figure 4d shown, the second video image 202 comes from the video image shot by the first electronic device 100 itself, and the first video image 201 comes from the second electronic device 200. After the first electronic device 100 hides the first video image 201 on the main interface 20, the first electronic device 100 may send a corresponding standby control instruction to the second electronic device 200 to control the second electronic device 200 to enter the standby mode to save power.

[0172] In addition, in a possible implementation, after the user hides the first video image 201, it is possible that the user will re-control the display of the first video image 201 in a very short time. To improve the situation where it is necessary to frequently control the second electronic device 200 to standby and resume from the standby mode in this case, the above step 1017: after hiding the first video image 201 on the main interface 20 and the first electronic device 100 does not display the video image from the second electronic device 200, the process of the first electronic device 100 sending a standby control instruction to the second electronic device 200 may include:

[0173] When the first electronic device 100 hides the first video image 201 on the main interface 20 for a preset time or more and the first electronic device 100 does not display the video image from the second electronic device 200 within the preset time, the first electronic device 100 sends a standby control instruction to the second electronic device 200, so as to prevent the second electronic device 200 and the wireless communication link from being frequently awakened from the standby mode.

[0174] The first electronic device 100 may be provided with a detection module for periodically detecting a target camera position whose video image is not used in the display screen of the local device. When the target camera position is detected, the target camera position is notified to enter the standby mode and the corresponding device is turned off.

[0175] When at least some components of the second electronic device 200 are turned off or controlled to work in the low power consumption mode, if the first electronic device 100 uses the video image of the second electronic device 200 again, the secondary camera position needs to be quickly awakened. It should be noted that the quick start of the second electronic device 200 entering the standby mode requires: 1) quickly restoring the wireless communication link; 2) quickly restoring the power components that have been turned off: camera module, ISP, VPU, and / or display screen, etc.

[0176] In some embodiments, such as Figure 12As shown, the wireless communication link has a continuous communication state. In the continuous communication state, the video image transmission efficiency between the first electronic device 100 and the second electronic device 200 is relatively high, so that the first electronic device 100 can receive the video image from the second electronic device 200 through the wireless communication link and display the video image on the main interface 20 of the first electronic device 100. When the first electronic device 100 hides the first video image 201 for more than a preset time and does not display the video image from the second electronic device 200 within the preset time, it indicates that the user may not use the video image from the second electronic device 200 for some time. Therefore, a standby control instruction is sent to the second electronic device 200. On the one hand, the standby control instruction is used to instruct components such as the camera in the second electronic device 200 to turn off. On the other hand, the standby control instruction is also used to instruct the second electronic device 200 to change the wireless communication link from the continuous communication state to the periodic sleep communication state. In the periodic sleep communication state, the wireless communication link includes alternating sleep phases and wake-up phases. Data can be transmitted during the wake-up phase, that is, data transmission can be intermittently realized to save power consumption while ensuring the basic information transmission function of the wireless communication link.

[0177] When the continuous duration of the wireless communication link in the periodic sleep communication state reaches a first preset duration, a Bluetooth Low Energy (BLE) connection is established between the first electronic device 100 and the second electronic device 200, and the wireless communication link is disconnected. For example, the first electronic device 100 and the second electronic device 200 determine to disconnect the wireless communication link (i.e., the WiFi link) when the continuous duration in the periodic sleep communication state reaches the first preset duration through an inactivity timer. That is, when the inactivity timer times out, the wireless communication link is disconnected to reduce power consumption. However, to ensure that the first electronic device 100 and the second electronic device 200 can still maintain communication after the wireless communication link is disconnected, a BLE connection can be established between the two to implement functions such as instruction transmission.

[0178] As Figure 11 and Figure 13 As shown, after the first electronic device 100 sends a standby control instruction to the second electronic device 200, the above method further includes: the first electronic device 100 executes the first standby recovery process S1 or the second standby recovery process S2. Among them, both the first standby recovery process S1 and the second standby recovery process S2 include the process in which the first electronic device 100 receives a third user operation and the first electronic device 100 displays the first video image 201 on the main interface 20 according to the third user operation.

[0179] As Figure 11As shown, in the first standby recovery process S1, the third user operation is a standby recovery operation. That is, the first standby recovery process S1 includes: Step 1018: The first electronic device 100 receives the standby recovery operation; The first electronic device 100, according to the standby recovery operation, executes Step 1021: Display the first video image 201 on the main interface 20.

[0180] As Figure 13 shown, the second standby recovery process S2 includes:

[0181] Step 1007: The first electronic device 100 receives the third user operation;

[0182] The first electronic device 100, according to the third user operation, executes Step 1021: Display the first video image 201 on the main interface 20;

[0183] The second standby recovery process S2 further includes: Before receiving the third user operation, execute Step 1018: The first electronic device 100 receives the standby recovery operation.

[0184] As Figure 11 and Figure 13 shown, before the process of displaying the first video image 201 on the main interface 20, the first standby recovery process S1 and the second standby recovery process S2 further include:

[0185] The first electronic device 100, according to the standby recovery operation, executes Step 1019: Determine whether the wireless communication link is in a periodic sleep communication state or in a disconnected state when the standby recovery operation is received;

[0186] As Figure 14 shown, if the standby recovery operation is received when the wireless communication link is in a periodic sleep communication state, then execute Step 10201: Send a standby recovery control instruction to the second electronic device 200 through the wireless communication link. This standby recovery control instruction is used to instruct the second electronic device 200 to restore the wireless communication link to a continuous communication state. In this case, there is no need to establish a BLE connection, and since the wireless communication link is not disconnected, the wireless communication link can be quickly restored to a continuous communication state;

[0187] As Figure 12As shown, if a standby resume operation is received when the wireless communication link is disconnected, step 10202 is executed: sending a standby resume control instruction to the second electronic device 200 via a low-power Bluetooth (BLE) connection. The standby resume control instruction is used to instruct the second electronic device 200 to restore the wireless communication link to a continuous communication state. At the same time, the BLE connection can be disconnected to save power. Based on the standby resume control instruction, since the wireless communication link has been disconnected before, authentication needs to be performed first, and only after successful authentication can the wireless communication link be restored to a continuous communication state.

[0188] After the wireless communication link is restored to a continuous communication state, the first electronic device 100 can receive video images from the second electronic device 200 via the wireless communication link, and then can execute step 1021 according to the standby resume operation: displaying the first video image 201 on the main interface 20. In the first standby resume process S1, the sending of the standby resume control instruction and the display of the first video image 201 can be triggered by one standby resume operation; while in the second standby resume process S2, the sending of the standby resume instruction is triggered by the standby resume operation, and the display of the first video image 201 is triggered by another third user operation. Therefore, in the second standby resume process S2, the standby resume operation can be set as a pre-operation of the third user operation, that is, the standby resume instruction can be sent in advance before the user executes the third user operation. At this time, the wireless communication link will be restored in advance, and the components of the second electronic device that have been turned off will be restored. Then, when the third user operation is received, the first video image 201 from the second electronic device will be displayed on the main interface 20 to improve the response speed of displaying the first video image 201.

[0189] For example, in the first standby resume process S1, the third user operation is the standby resume operation, that is, the standby resume operation includes a click operation on an operation control (such as a floating ball). In addition, the third user operation can also include a first swipe gesture operation on a preset position 30. As Figure 11 shown, after step 1017, when the first electronic device receives a click operation on the floating ball or a first swipe gesture operation on the preset position 30 by the user, the process from step 1019 to step 1021 is executed to restore the display of the first video image 201.

[0190] For example, in the second standby resume process S2, the standby resume operation includes a touch operation on the preset position 30. Assume that the preset position 30 is the area to be displayed corresponding to the first video image. As Figure 13As shown, after step 1017, when the first electronic device receives a touch operation by the user on the preset position 30, steps 1019 to 10202 are executed to send a standby recovery control instruction to the second electronic device. When the first electronic device receives a first swipe gesture operation by the user on the preset position 30, step 1021 is executed to resume the display of the first video image 201. When the user performs the first swipe gesture operation on the preset position 30, the preset position 30 must be touched first. That is to say, when the user performs the third user operation, the process of sending the standby recovery operation instruction will inevitably be pre-triggered due to the pre-operation of the third user operation, and then the first video image 201 is displayed according to the third user operation.

[0191] It should be noted that in the shooting method of the multi-camera shooting system in the embodiments of the present application, the broadcast period interval of the BLE connection used is adjusted to be shorter than the broadcast period in other processes. For example, in the process of using BLE to implement intelligent home appliance control, the broadcast period interval of the BLE connection is 200 ms, while in the shooting method of the multi-camera shooting system in the embodiments of the present application, the broadcast period interval of the BLE connection can be adjusted to 50 ms, so that the instructions sent to the second electronic device through the BLE connection during the shooting process can be quickly responded to.

[0192] In some other embodiments, as Figure 15 shown, the standby control instruction is used to instruct the second electronic device to change the wireless communication link from the continuous communication state to the first periodic sleep communication state. In the first periodic sleep communication state, the power consumption is lower than that in the continuous communication state; when the duration of the wireless communication link in the first periodic sleep communication state reaches the first preset duration at the first electronic device, the wireless communication link is changed to the second periodic sleep communication state. The sleep cycle of the first periodic sleep communication state is less than the sleep cycle of the second periodic sleep communication state. By changing the wireless communication link to the second periodic sleep communication state, the power consumption can be further reduced.

[0193] Specifically, as Figures 15 to 18 shown, after sending the standby control instruction to the second electronic device, the above method further includes: the first electronic device executes the third standby recovery process S3 or the fourth standby recovery process S4; both the third standby recovery process S3 and the fourth standby recovery process S4 include the above process of receiving the third user operation and displaying the first video image 201 on the main interface 20 according to the third user operation.

[0194] As Figure 16As shown, in the third standby recovery process S3, the third user operation is a standby recovery operation; that is, the third standby recovery process S3 includes: Step 1018: Receive a standby recovery operation; according to the standby recovery operation, execute Step 1021. Step 1021: Display the first video image 201 on the main interface 20.

[0195] As Figure 17 shown, the fourth standby recovery process S4 includes:

[0196] Step 1007: Receive the third user operation;

[0197] According to the third user operation, execute Step 1021. Step 1021: Display the first video image 201 on the main interface 20;

[0198] The fourth standby recovery process S4 further includes: Before receiving the third user operation, execute Step 1018: Receive a standby recovery operation.

[0199] As Figure 16 and Figure 17 shown, before the process of displaying the first video image 201 on the main interface 20, the third standby recovery process S3 and the fourth standby recovery process S4 further include:

[0200] According to the standby recovery operation, execute Step 10201: Send a standby recovery control instruction to the second electronic device through a wireless communication link. The standby recovery control instruction is used to instruct the second electronic device to restore the wireless communication link to a continuous communication state.

[0201] After the wireless communication link is restored to the continuous communication state, the first electronic device 100 can receive video images from the second electronic device 200 through the wireless communication link, and then can execute Step 1021 according to the standby recovery operation. Step 1021: Display the first video image 201 on the main interface 20.

[0202] For example, in the third standby recovery process S3, the third user operation is a standby recovery operation, that is, the standby recovery operation includes a click operation on an operation control (such as a floating ball). In addition, the third user operation can also include a first swipe gesture operation on a preset position 30. As Figure 16 shown, after Step 1017, when the first electronic device receives a click operation on the floating ball or a first swipe gesture operation on the preset position 30 by the user, it executes the process from Step 10201 to Step 1021 to restore the display of the first video image 201.

[0203] For example, in the fourth standby recovery process S4, the standby recovery operation includes a touch operation on the preset position 30. Assume that the preset position 30 is the area to be displayed corresponding to the first video image. AsFigure 17 As shown, after step 1017, when the first electronic device receives a touch operation by the user on the preset position 30, step 10201 is executed to send a standby recovery control instruction to the second electronic device. When the first electronic device receives a first sliding gesture operation by the user on the preset position 30, step 1021 is executed to resume the display of the first video image 201. When the user performs the first sliding gesture operation on the preset position 30, the user will necessarily touch the preset position 30 first. That is to say, when the user performs the third user operation, the process of sending the standby recovery operation instruction will necessarily be pre-triggered due to the pre-operation of the third user operation, and then the first video image 201 will be displayed according to the third user operation.

[0204] In Figure 16 and Figure 17 the embodiments shown, the wireless communication link can apply Figure 18 the data transmission process shown. The wireless communication link includes multiple synchronization cycles. The duration of a synchronization cycle is, for example, 524 ms. Each synchronization cycle includes a discovery window and a data transmission phase. The duration of the discovery window is, for example, 16 ms. In each discovery window, the master device involved in the wireless communication link will send synchronization beacons Sync Beacons. The slave device involved in the wireless communication link only needs to receive the Sync Beacons to achieve synchronization with the master device. Therefore, the power consumption of the slave device is lower than that of the master device. Therefore, in the embodiments of the present application, if the multi-camera shooting system includes a mobile phone and a wireless shooting device, the mobile phone is used as the master device and the wireless shooting device is used as the slave device to reduce the power consumption of the wireless shooting device. As Figure 15 and Figure 18 shown, in the continuous communication state, data is transmitted in the data transmission phase of each synchronization cycle; in the first periodic sleep communication state and the second periodic sleep communication state, the wireless communication link includes alternating sleep phases and wake-up phases. Data can be transmitted in the data transmission phase of the wake-up phase, and data cannot be transmitted in the data transmission phase of the sleep phase. Among them, the duration of the sleep phase of the first periodic sleep communication state is less than the duration of the sleep phase of the second periodic sleep communication state.

[0205] In some embodiments, when the second electronic device enters the standby mode, the auxiliary light on the second electronic device can be controlled to flash to remind the user that this camera position is still in use in the standby mode of the multi-camera shooting system, but components such as the lens of the second electronic device are not used. It can be understood that other methods can also be used to remind the user, not limited to the flashing of the auxiliary light. Therefore, the method for reminding the user that the camera position is working in the standby mode is not limited in this embodiment. As Figure 19As shown, taking a specific scenario as an example, where the first electronic device 100 and the second electronic device 200 are mobile phones, and the third electronic device 300 is a wireless shooting device. When the first electronic device 100 only displays the picture taken by the first electronic device 100 itself, auxiliary lights 900 are respectively provided on the second electronic device 200 and the third electronic device 300. The first electronic device 100 sends a standby control instruction to the second electronic device 200 and the third electronic device 300, causing the screen and camera of the second electronic device 200 to be turned off, and the camera of the third electronic device 300 to be turned off. The auxiliary lights on the second electronic device 200 and the third electronic device 300 flash to prompt the user that the device is still in use under multi-camera standby, but the camera of the device is not being used.

[0206] In some embodiments, as Figure 20 shown, the first electronic device 100 receives a touch operation or a click operation by the user on a preset position 30, and according to this operation, sends a standby recovery instruction to the second electronic device. After sending the standby recovery control instruction to the second electronic device, the above method further includes:

[0207] The first electronic device 100 displays a transition image 209 at the preset position 30 according to a third user operation, such as a first swipe gesture operation on the preset position 30.

[0208] The process of the first electronic device 100 displaying the first video image on the main interface according to the third user operation includes: The first electronic device 100, according to the third user operation, when the first electronic device receives the first video image from the second electronic device through a wireless communication link restored to the continuous communication state, replaces the transition image 209 with the first video image 201, that is, displays the restored first video image 201 on the first electronic device 100, and the restored first video image 201 comes from the second electronic device.

[0209] For example, on the basis of what is shown in Figure 11 or Figure 16 shown, the third user operation is a standby recovery operation. That is, the same user operation can be used to indicate the restoration of the wireless communication link, the restoration of the components of the second electronic device that have been turned off, and the restoration of the first video image 201 displayed on the first electronic device. After sending the standby recovery control instruction to the second electronic device, the method further includes:

[0210] The first electronic device 100 displays a transition image at the preset position according to the standby recovery operation;

[0211] The first electronic device 100, according to the standby resume operation, when the first electronic device receives the first video image from the second electronic device through a wireless communication link restored to the continuous communication state, replaces the transition image 209 with the first video image 201. That is to say, Figure 11 or Figure 16 On the basis shown, the step of displaying the transition image is added, and step 1021 is replaced with the process of "replacing the transition image 209 with the first video image 201".

[0212] For example, the third user operation, that is, the standby resume operation is the first swipe gesture operation acting on the preset position 30. After the first electronic device 100 hides the first video image 201 and sends a standby control instruction to the second electronic device, when the user hopes to resume the display of the first video image 201, the first swipe gesture operation acting on the preset position 30 can be performed on the first electronic device 100. Since the video image to be displayed is the video image of the secondary camera position, the secondary camera position needs to transmit the video image to the first electronic device 100, and there will be a time difference between the first swipe gesture operation and the display of the video image of the secondary camera position on the main interface. During this time difference, the first electronic device 100, according to the first swipe gesture operation, displays the pre-stored transition image 209 at the preset position 30; when the second electronic device and the wireless communication link are restored from the low-power state, and the first electronic device 100 receives the first video image 201, the transition image 209 is replaced with the first video image 201, so as to realize the restoration of the display of the first video image 201 on the first electronic device 100, and solve the problem of image display delay. The transition image can be a dynamic effect of a blurred and rotating picture, or other types of fixed images. The type of the transition image is not limited in this embodiment.

[0213] Similarly, for example, in Figure 13 or Figure 17 On the basis shown, the standby resume operation and the third user operation are different operations. For example, the standby resume operation is a touch operation or a click operation acting on the preset position 30. For example, after the second electronic device enters the standby mode, if the user needs to use the video image from the second electronic device, it can be triggered by a touch operation on the preset position 30 of the first electronic device. After sending a standby resume control instruction to the second electronic device, the method further includes:

[0214] The first electronic device 100, according to the third user operation, displays a transition image at the preset position;

[0215] The first electronic device 100, according to the standby resume operation, when the first electronic device receives the first video image from the second electronic device through a wireless communication link restored to the continuous communication state, replaces the transition image 209 with the first video image 201. That is to say, inFigure 13 or Figure 17 On the basis shown, the step of displaying a transition image is added, and the process of replacing step 1021 with "replacing the transition image 209 with the first video image 201" is carried out.

[0216] Specifically, for example, the standby recovery operation is a touch operation or a click operation on the preset position 30 of the first electronic device 100, and the third user operation is a first swipe gesture operation acting on the preset position 30. After the first electronic device 100 hides the first video image 201 and sends a standby control instruction to the second electronic device, when the user hopes to resume the display of the first video image 201, click on the preset position 30 of the first electronic device 100 and perform the first swipe gesture operation. In this process, the standby recovery operation and the third user operation are sequentially executed. When receiving the standby recovery operation of the user clicking on the preset position 30, a standby recovery control instruction will be sent to the second electronic device to resume the standby state in advance; after receiving the first swipe gesture operation, since the video image to be displayed is that of the secondary camera position, then the secondary camera position needs to transmit the video image to the first electronic device 100, and there will be a time difference between the first swipe gesture operation and the display of the video image of the secondary camera position on the main interface. During this time difference, the first electronic device 100 displays the pre-stored transition image 209 at the preset position 30 according to the first swipe gesture operation; when the second electronic device and the wireless communication link are restored from the low-power state, and the first electronic device 100 receives the first video image, the transition image 209 is replaced with the first video image 201 to achieve the restoration of the display of the first video image 201 on the first electronic device 100, solving the problem of image display delay.

[0217] In addition, different secondary camera positions can have different preset positions on the first electronic device. For example, the second electronic device has a corresponding preset position in the upper left corner of the screen of the first electronic device, and the third electronic device has a corresponding preset position in the upper right corner of the screen of the first electronic device. Assume that the first electronic device currently only displays the second video image 202 and no other video images, and the second video image 202 is a video image taken by the first electronic device itself. At this time, both the second electronic device and the third electronic device can be in the standby mode.

[0218] For example, in the first scenario, when the user clicks on the upper left corner or swipes the screen from the upper left corner to the lower right corner, as the third user operation, the first electronic device will send a standby recovery control instruction to the second electronic device.

[0219] For example, in the second scenario, when the user clicks on the upper right corner, or swipes the screen from the upper right corner to the lower left corner, the first electronic device will send a standby recovery control instruction to the third electronic device. The following describes an embodiment in one scenario in combination with the process of controlling between the first electronic device and the second electronic device based on a wireless communication link: In the initial state, the first electronic device only displays the second video image 202, and the second video image 202 is a video image captured by the first electronic device itself; afterwards, the user controls the first electronic device through a touch event. If the touch event involves the screen control of the remote second electronic device, for example, the user controls the first video image from the second electronic device to be displayed on the first electronic device, it is forwarded to the VirtualCameraAgent of the second electronic device through CameraHAL for control, so that the video image captured by the second electronic device is transmitted to the first electronic device and forms the first video image displayed on the main interface.

[0220] The following describes the embodiments of the present application through two specific examples.

[0221] As Figure 21 shown, two mobile phones supporting multi-camera shooting are respectively used as the first electronic device 100 and the second electronic device 200. The display and hiding of video images can be realized by swiping in and out operations on a preset position 30 on the screen of the first electronic device 100. For example, the main interface of the first electronic device 100 can display the second video image 202 captured by the first electronic device 100 itself. At this time, the second video image 202 is used as the recording screen. The swiping out operation of swiping the screen to the right on the preset position 30 can make the first video image 201 captured by the second electronic device 200 be displayed on the main interface of the first electronic device 100. The video switching operation can switch the first video image 201 and the second video image 202 in the main interface, so that the first video image 201 is switched to the recording screen. At this time, the swiping in operation of swiping the screen to the left on the preset position 30 can hide the second video image 202. In addition, picture-in-picture recording can also be realized. If the first electronic device 100 hides the first video image 201 and does not use the video image of the second electronic device 200, the second electronic device 200 can choose to enable the low-power mode; it can also choose not to enable the low-power mode. For the control transmission of the second electronic device 200, the above-mentioned priority optimization strategy can be used to reduce the latency of control operations on the first electronic device 100.

[0222] As Figure 22 shown, a mobile phone supporting multi-camera shooting is networked with the first electronic device 100 and the fourth electronic device 400, and the fourth electronic device 400 is a shooting device. The specific process and principle can be the same as the above Figure 21The content involved is similar. The difference is that Figure 22 the first video image 201 in Figure 22 comes from the fourth electronic device 400. A low-power indicator light and a startup indicator light can be set on the fourth electronic device 400. When the first electronic device 100 does not use the video image of the fourth electronic device 400, the low-power indicator light of the fourth electronic device 400 flashes, indicating that networking has been established but shooting or previewing is not in use. When the first video image 201 shown by sliding out is an image from the fourth electronic device 400, the startup indicator light of the fourth electronic device 400 flashes, indicating that the device has been enabled for shooting or previewing.

[0223] The embodiment of the present application further provides a shooting device for a multi-camera shooting system, which is applied to the first electronic device. The first electronic device is the main camera position of the multi-camera shooting system. The multi-camera shooting system further includes at least one auxiliary camera position. The device includes: an interface display module, configured to display a main interface, and the main interface includes a first video image; an operation receiving module, configured to receive a first user operation in the video shooting mode; the interface display module is further configured to, according to the first user operation, display a second video image on the main interface. The first video image comes from the main camera position or the auxiliary camera position, and the second video image comes from the auxiliary camera position, that is, the first video image and the second video image are video images provided by different camera positions in the multi-camera shooting system; the operation receiving module is further configured to receive a video switching operation, and the video switching operation is directed to the second video image; a video switching module, configured to switch the first video image and the second video image according to the video switching operation. The shooting device of the multi-camera shooting system can apply the shooting method of the multi-camera shooting system in any of the above embodiments. The specific process and principle are the same as those of the above embodiments and will not be elaborated here.

[0224] It should be understood that the division of the shooting devices in the above multi-camera shooting system is only a division of logical functions. In actual implementation, they can be fully or partially integrated into a physical entity, or physically separated. And these modules can all be implemented in the form of software called by processing elements; they can also all be implemented in the form of hardware; or some modules can be implemented in the form of software called by processing elements, and some modules can be implemented in the form of hardware. For example, any one of the interface display module, the operation receiving module, and the video switching module can be a separately established processing element, or can be integrated into the shooting device, for example, implemented by being integrated into a certain chip of the shooting device. In addition, it can also be stored in the memory of the shooting device in the form of a program, and the functions of the above various modules can be called and executed by a certain processing element of the shooting device. The implementation of other modules is similar. In addition, all or part of these modules can be integrated together or can be independently implemented. The processing element mentioned here can be an integrated circuit with the ability to process signals. In the implementation process, each step of the above method or the above various modules can be completed through the integrated logic circuit in the processor element or the instructions in the form of software.

[0225] For example, the shooting device can be one or more integrated circuits configured to implement the above method, such as: one or more application specific integrated circuits (ASICs), or, one or more digital signal processors (DSPs), or, one or more field programmable gate arrays (FPGAs), etc. Again, when a certain module above is implemented in the form of a processing element scheduling program, the processing element can be a general-purpose processor, such as a central processing unit (CPU) or other processors that can call programs. Again, these modules can be integrated together and implemented in the form of a system-on-a-chip (SOC).

[0226] In some embodiments, the main interface includes operation controls, and the operation controls are used to trigger the display of a second video image on the main interface. For example, the first user operation includes a click operation on the operation control.

[0227] In some embodiments, the first user operation includes a first swipe gesture operation on a preset position of the main interface.

[0228] In some embodiments, the video switching operation includes a click operation on the second video image in the main interface.

[0229] In some embodiments, one of the first video image and the second video image comes from a second electronic device, and the second electronic device is a secondary camera position of a multi-camera shooting system; the other of the first video image and the second video image comes from a first electronic device or a third electronic device, and the third electronic device is another secondary camera position of the multi-camera shooting system.

[0230] In some embodiments, the operation receiving module is further configured to receive a second user operation; the interface display module is further configured to hide the first video image on the main interface according to the second user operation; the operation receiving module is further configured to receive a third user operation; the interface display module is further configured to display the first video image on the main interface according to the third user operation.

[0231] In some embodiments, the main interface includes an operation control, and the operation control is used to trigger hiding the first video image on the main interface and hiding the first video image on the main interface. For example, the second user operation and the third user operation include click operations acting on the operation control.

[0232] In some embodiments, the third user operation includes a first swipe gesture operation acting on a preset position, and the second user operation includes a second swipe gesture operation acting on a preset position.

[0233] In some embodiments, the operation receiving module is further configured to receive a camera position switching operation for the first video image; the interface display module is further configured to replace the first video image with a third video image according to the camera position switching operation, and the first video image and the third video image are video images provided by different camera positions in the multi-camera shooting system.

[0234] In some embodiments, the camera position switching operation includes a double-click operation acting on the first video image.

[0235] In some embodiments, the operation receiving module is further configured to receive a camera switching operation for the first video image; the interface display module is further configured to replace the first video image with a fourth video image according to the camera switching operation, and the first video image and the fourth video image are video images provided by different cameras at the same camera position in the multi-camera shooting system.

[0236] In some embodiments, the camera switching operation includes a triple-click operation acting on the first video image.

[0237] In some embodiments, the operation receiving module is further configured to receive a picture-in-picture display operation for the first video image; the interface display module is further configured to display a fifth video image at least partially surrounded by the second video image on the main interface according to the picture-in-picture display operation, and the fifth video image is the same as the first video image.

[0238] In some embodiments, the picture-in-picture display operation includes a dragging operation on the first video image.

[0239] In some embodiments, the apparatus further includes: a standby control module, configured to, after hiding the first video image on the main interface and when the first electronic device does not display the video image from the second electronic device, send a standby control instruction to the second electronic device, where the standby control instruction is used to instruct the second electronic device to turn off or operate in a low-power mode for any one or any combination of the following components: a camera module, an image signal processor (ISP), a video processor (VPU), a display screen, and a wireless communication link, and the wireless communication link is used to transmit the video image from the second electronic device to the first electronic device, the second electronic device is a secondary camera position of a multi-camera shooting system, and the video image is the first video image or the second video image.

[0240] In some embodiments, the standby control instruction is further used to instruct the second electronic device to change the wireless communication link from a continuous communication state to a periodic sleep communication state; the apparatus further includes a communication control module, configured to establish a low-power Bluetooth (BLE) connection between the first electronic device and the second electronic device and disconnect the wireless communication link when the continuous duration of the wireless communication link in the periodic sleep communication state reaches a first preset duration; the operation receiving module is specifically configured to receive a third user operation in a first standby recovery process, or receive a standby recovery operation and a third user operation in a second standby recovery process, and in the first standby recovery process, the third user operation is a standby recovery operation; the standby control module is further configured to, according to the standby recovery operation, if the standby recovery operation is received when the wireless communication link is in the periodic sleep communication state, send a standby recovery control instruction to the second electronic device through the wireless communication link, where the standby recovery control instruction is used to instruct the second electronic device to restore the wireless communication link to the continuous communication state; the standby control module is further configured to, according to the standby recovery operation, if the standby recovery operation is received when the wireless communication link is disconnected, send a standby recovery control instruction to the second electronic device through the low-power BLE connection, where the standby recovery control instruction is used to instruct the second electronic device to restore the wireless communication link to the continuous communication state.

[0241] In some embodiments, in the second standby recovery process, the standby recovery operation includes a touch operation on a preset position.

[0242] In some embodiments, the standby control instruction is used to instruct the second electronic device to change the wireless communication link from the continuous communication state to the first periodic sleep communication state; the apparatus further includes a communication control module, configured to change the wireless communication link to the second periodic sleep communication state when the duration of the wireless communication link in the first periodic sleep communication state reaches a first preset duration, wherein the sleep period of the first periodic sleep communication state is less than the sleep period of the second periodic sleep communication state; the operation receiving module is specifically configured to receive a third user operation in a third standby recovery process, or receive a standby recovery operation and a third user operation in a fourth standby recovery process, and in the third standby recovery process, the third user operation is a standby recovery operation; the standby control module is further configured to send a standby recovery control instruction to the second electronic device through the wireless communication link according to the standby recovery operation, and the standby recovery control instruction is used to instruct the second electronic device to restore the wireless communication link to the continuous communication state.

[0243] In some embodiments, in the fourth standby recovery process, the standby recovery operation is a touch operation applied to a preset position.

[0244] In some embodiments, the apparatus further includes: the interface display module is further configured to display a transition image at a preset position according to the third user operation; the interface display module is specifically further configured to: according to the third user operation, when the first electronic device receives a video image from the second electronic device through the wireless communication link restored to the continuous communication state, replace the transition image with a first video image.

[0245] Corresponding to the above method embodiments, the present application further provides an electronic device, which includes a memory for storing computer program instructions and a processor for executing the program instructions, wherein when the computer program instructions are executed by the processor, the electronic device is triggered to execute some or all of the steps in the above method embodiments.

[0246] See Figure 23 , Figure 23Schematic diagram of the structure of an electronic device provided by an embodiment of this application. The electronic device 500 may be any electronic device in any of the above embodiments. The electronic device 500 may include a processor 410, an external memory interface 420, an internal memory 421, a universal serial bus (USB) interface 430, a charging management module 440, a power management module 441, a battery 442, an antenna 1, an antenna 2, a mobile communication module 450, a wireless communication module 460, an audio module 470, a speaker 470A, a receiver 470B, a microphone 470C, a headphone jack 470D, a sensor module 480, a button 490, a motor 491, an indicator 492, a camera 493, a display screen 494, and a subscriber identification module (SIM) card interface 495, etc. The sensor module 480 may include a pressure sensor 480A, a gyroscope sensor 480B, a barometric pressure sensor 480C, a magnetic sensor 480D, an acceleration sensor 480E, a distance sensor 480F, a proximity light sensor 480G, a fingerprint sensor 480H, a temperature sensor 480J, a touch sensor 480K, an ambient light sensor 480L, a bone conduction sensor 480M, etc.

[0247] It can be understood that the structure schematically shown in the embodiments of the present invention does not constitute a specific limitation on the electronic device 500.

[0248] In other embodiments of this application, the electronic device 500 may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or have different component arrangements. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0249] The processor 410 may include one or more processing units. For example: the processor 410 may include an application processor (AP), a modulation and demodulation processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units may be independent devices or integrated in one or more processors.

[0250] The controller can generate operation control signals according to the instruction operation code and timing signals to complete the control of instruction fetching and execution.

[0251] A memory can also be set in the processor 410 to store instructions and data. In some embodiments, the memory in the processor 410 is a cache memory. This memory can save the instructions or data that the processor 410 has just used or recycled. If the processor 410 needs to use this instruction or data again, it can be directly called from the said memory. This avoids repeated accesses, reduces the waiting time of the processor 410, and thus improves the efficiency of the system.

[0252] In some embodiments, the processor 410 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0253] The I2C interface is a two-way synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 410 may include multiple groups of I2C buses. The processor 410 can be respectively coupled to the touch sensor 480K, charger, flashlight, camera 493, etc. through different I2C bus interfaces. For example: The processor 410 can be coupled to the touch sensor 480K through the I2C interface, enabling the processor 410 to communicate with the touch sensor 480K through the I2C bus interface to implement the touch function of the electronic device 500.

[0254] The I2S interface can be used for audio communication. In some embodiments, the processor 410 may include multiple groups of I2S buses. The processor 410 can be coupled to the audio module 470 via the I2S bus to enable communication between the processor 410 and the audio module 470. In some embodiments, the audio module 470 can transmit audio signals to the wireless communication module 460 via the I2S interface to implement the function of answering phone calls through a Bluetooth headset.

[0255] The PCM interface can also be used for audio communication to sample, quantize, and encode analog signals. In some embodiments, the audio module 470 and the wireless communication module 460 can be coupled via the PCM bus interface. In some embodiments, the audio module 470 can also transmit audio signals to the wireless communication module 460 via the PCM interface to implement the function of answering phone calls through a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0256] The UART interface is a general-purpose serial data bus for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 410 and the wireless communication module 460. For example, the processor 410 communicates with the Bluetooth module in the wireless communication module 460 via the UART interface to implement the Bluetooth function. In some embodiments, the audio module 470 can transmit audio signals to the wireless communication module 460 via the UART interface to implement the function of playing music through a Bluetooth headset.

[0257] The MIPI interface can be used to connect the processor 410 to peripheral devices such as the display screen 494 and the camera 493. The MIPI interface includes the camera serial interface (CSI), the display serial interface (DSI), etc. In some embodiments, the processor 410 and the camera 493 communicate via the CSI interface to implement the shooting function of the electronic device 500. The processor 410 and the display screen 494 communicate via the DSI interface to implement the display function of the electronic device 500.

[0258] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 410 to the camera 493, the display screen 494, the wireless communication module 460, the audio module 470, the sensor module 480, etc. The GPIO interface can also be configured as an I15c interface, an I14S interface, a UART interface, a MIPI interface, etc.

[0259] The USB interface 430 is an interface that complies with the USB standard specification, which can specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 430 can be used to connect a charger to charge the electronic device 500, and can also be used to transfer data between the electronic device 500 and peripheral devices. It can also be used to connect headphones to play audio. This interface can also be used to connect other electronic devices, such as AR devices, etc.

[0260] It can be understood that the interface connection relationships shown in the embodiments of the present invention are only illustrative and do not constitute a structural limitation on the electronic device 500. In other embodiments of the present application, the electronic device 500 can also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0261] The charging management module 440 is used to receive a charging input from a charger. Among them, the charger can be a wireless charger or a wired charger. In some embodiments of wired charging, the charging management module 440 can receive the charging input from a wired charger through the USB interface 430. In some embodiments of wireless charging, the charging management module 440 can receive the wireless charging input through the wireless charging coil of the electronic device 500. While charging the battery 442, the charging management module 440 can also supply power to the electronic device through the power management module 441.

[0262] The power management module 441 is used to connect the battery 442, the charging management module 440, and the processor 410. The power management module 441 receives the inputs from the battery 442 and / or the charging management module 440 and supplies power to the processor 410, the internal memory 421, the display screen 494, the camera 493, the wireless communication module 460, etc. The power management module 441 can also be used to monitor parameters such as the battery capacity, the number of battery cycles, and the battery health status (leakage, impedance). In some other embodiments, the power management module 441 can also be provided in the processor 410. In other embodiments, the power management module 441 and the charging management module 440 can also be provided in the same device.

[0263] The wireless communication function of the electronic device 500 can be implemented through antenna 1, antenna 2, the mobile communication module 450, the wireless communication module 460, the modulation and demodulation processor, and the baseband processor, etc.

[0264] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 500 can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization rate of the antennas. For example: Antenna 1 can be multiplexed as the diversity antenna of the wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0265] The mobile communication module 450 may provide solutions for wireless communications such as 2G / 3G / 4G / 5G applied to the electronic device 500. The mobile communication module 450 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 450 may receive electromagnetic waves through the antenna 1, filter and amplify the received electromagnetic waves, and then transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 450 may also amplify the signal modulated by the modulation and demodulation processor and convert it into electromagnetic waves through the antenna 1 for radiation. In some embodiments, at least some functional modules of the mobile communication module 450 may be provided in the processor 410. In some embodiments, at least some functional modules of the mobile communication module 450 and at least some modules of the processor 410 may be provided in the same device.

[0266] The modulation and demodulation processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. Subsequently, the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 470A, receiver 470B, etc.), or displays an image or video through the display screen 494. In some embodiments, the modulation and demodulation processor may be an independent device. In other embodiments, the modulation and demodulation processor may be independent of the processor 410 and be provided in the same device as the mobile communication module 450 or other functional modules.

[0267] The wireless communication module 460 may provide solutions for wireless communications applied to the electronic device 500, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite systems (GNSSs), frequency modulation (FM), near field communication (NFC), infrared (IR), etc. The wireless communication module 460 may be one or more devices integrating at least one communication processing module. The wireless communication module 460 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering processing on the electromagnetic wave signals, and sends the processed signals to the processor 410. The wireless communication module 460 may also receive the signals to be sent from the processor 410, perform frequency modulation and amplification on them, and convert them into electromagnetic waves through the antenna 2 for radiation.

[0268] In some embodiments, antenna 1 of the electronic device 500 is coupled to the mobile communication module 450, and antenna 2 is coupled to the wireless communication module 460, enabling the electronic device 500 to communicate with a network and other devices via wireless communication technologies. The wireless communication technologies may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time-Division Synchronous Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. The GNSS may include Global Positioning System (GPS), Global Navigation Satellite System (GLONASS), Beidou Navigation Satellite System (BDS), Quasi-Zenith Satellite System (QZSS), and / or Satellite Based Augmentation Systems (SBAS).

[0269] The electronic device 500 implements a display function through the GPU, the display screen 494, and the application processor, etc. The GPU is a microprocessor for image processing, connected to the display screen 494 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 410 may include one or more GPUs, which execute program instructions to generate or change display information.

[0270] The display screen 494 is used to display images, videos, etc. The display screen 494 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Miniled, a MicroLed, a Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 500 may include one or N display screens 494, where N is a positive integer greater than 1.

[0271] The electronic device 500 can implement the shooting function through an ISP, a camera 493, a video codec, a GPU, a display screen 494, and an application processor, etc.

[0272] The ISP is used to process the data fed back by the camera 493. For example, when taking a photo, the shutter is opened, and light passes through the lens and is transmitted to the camera photosensitive element. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. The ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. The ISP can also optimize parameters such as the exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 493.

[0273] The camera 493 is used to capture static images or videos. An object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV, etc. format. In some embodiments, the electronic device 500 may include one or N cameras 493, where N is a positive integer greater than 1.

[0274] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 500 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy, etc.

[0275] The video codec is used to compress or decompress digital videos. The electronic device 500 can support one or more video codecs. In this way, the electronic device 500 can play or record videos in multiple coding formats, such as: Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0276] The NPU is a neural-network (NN) computing processor. By drawing on the structure of the biological neural network, such as the transmission pattern between human brain neurons, it can quickly process the input information and can also continuously learn by itself. Through the NPU, applications such as intelligent cognition of the electronic device 500 can be realized, such as: image recognition, face recognition, speech recognition, text understanding, etc.

[0277] The external memory interface 420 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 500. The external memory card communicates with the processor 410 through the external memory interface 420 to achieve the data storage function. For example, files such as music and videos are saved in the external memory card.

[0278] The internal memory 421 can be used to store computer-executable program code, and the executable program code includes instructions. The internal memory 421 can include a program storage area and a data storage area. Among them, the program storage area can store the operating system, application programs required for at least one function (such as the sound playback function, image playback function, etc.). The data storage area can store the data created during the use of the electronic device 500 (such as audio data, phone book, etc.). In addition, the internal memory 421 can include high-speed random access memory and can also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc. The processor 410 executes various functional applications and data processing of the electronic device 500 by running the instructions stored in the internal memory 421 and / or the instructions stored in the memory provided in the processor.

[0279] The electronic device 500 can implement audio functions through the audio module 470, speaker 470A, receiver 470B, microphone 470C, headphone jack 470D, and the application processor, etc. For example, music playback, recording, etc.

[0280] The audio module 470 is used to convert digital audio information into an analog audio signal for output, and is also used to convert an analog audio input into a digital audio signal. The audio module 470 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 470 can be disposed in the processor 410, or some functional modules of the audio module 470 can be disposed in the processor 410.

[0281] The speaker 470A, also known as the "loudspeaker", is used to convert an audio electrical signal into a sound signal. The electronic device 500 can listen to music or hands-free calls through the speaker 470A.

[0282] The receiver 470B, also known as the "earpiece", is used to convert an audio electrical signal into a sound signal. When the electronic device 500 answers a call or a voice message, the voice can be listened to by bringing the receiver 470B close to the human ear.

[0283] The microphone 470C, also known as the "microphone" or "transmitter", is used to convert a sound signal into an electrical signal. When making a call or sending a voice message, the user can speak by bringing the mouth close to the microphone 470C to input the sound signal into the microphone 470C. The electronic device 500 can be provided with at least one microphone 470C. In some other embodiments, the electronic device 500 can be provided with two microphones 470C, which can not only collect sound signals but also implement a noise reduction function. In some other embodiments, the electronic device 500 can also be provided with three, four or more microphones 470C to implement functions such as collecting sound signals, noise reduction, identifying the sound source, and implementing a directional recording function.

[0284] The headphone jack 470D is used to connect a wired headphone. The headphone jack 470D can be a USB interface 430, or a 3.5mm open mobile terminal platform (OMTP) standard interface, or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0285] The pressure sensor 480A is used to sense pressure signals and can convert pressure signals into electrical signals. In some embodiments, the pressure sensor 480A may be disposed on the display screen 494. There are many types of pressure sensors 480A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. The capacitive pressure sensor may include at least two parallel plates having conductive materials. When a force acts on the pressure sensor 480A, the capacitance between the electrodes changes. The electronic device 500 determines the intensity of the pressure based on the change in capacitance. When a touch operation acts on the display screen 494, the electronic device 500 detects the intensity of the touch operation according to the pressure sensor 480A. The electronic device 500 can also calculate the position of the touch based on the detection signal of the pressure sensor 480A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities may correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, the instruction to view short messages is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, the instruction to create a new short message is executed.

[0286] The gyroscope sensor 480B can be used to determine the motion posture of the electronic device 500. In some embodiments, the angular velocity of the electronic device 500 around three axes (i.e., the x, y, and z axes) can be determined by the gyroscope sensor 480B. The gyroscope sensor 480B can be used for anti-shake during shooting. Exemplarily, when the shutter is pressed, the gyroscope sensor 480B detects the angle of jitter of the electronic device 500, calculates the distance that the lens module needs to compensate based on the angle, and enables the lens to cancel the jitter of the electronic device 500 through reverse movement to achieve anti-shake. The gyroscope sensor 480B can also be used for navigation and somatosensory game scenarios.

[0287] The barometric pressure sensor 480C is used to measure barometric pressure. In some embodiments, the electronic device 500 calculates the altitude based on the barometric pressure value measured by the barometric pressure sensor 480C to assist in positioning and navigation.

[0288] The magnetic sensor 480D includes a Hall sensor. The electronic device 500 can use the magnetic sensor 480D to detect the opening and closing of the flip leather case. In some embodiments, when the electronic device 500 is a flip phone, the electronic device 500 can detect the opening and closing of the flip according to the magnetic sensor 480D. Furthermore, according to the detected opening and closing state of the leather case or the opening and closing state of the flip, features such as automatic flip unlocking are set.

[0289] The acceleration sensor 480E can detect the magnitude of the acceleration of the electronic device 500 in various directions (generally three axes). When the electronic device 500 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the electronic device and is applied to applications such as horizontal and vertical screen switching and pedometers.

[0290] A distance sensor 480F for measuring distance. The electronic device 500 can measure distance through infrared or laser. In some embodiments, when shooting a scene, the electronic device 500 can use the distance sensor 480F to measure distance to achieve fast focusing.

[0291] The proximity light sensor 480G can include, for example, a light-emitting diode (LED) and a light detector, such as a photodiode. The light-emitting diode can be an infrared light-emitting diode. The electronic device 500 emits infrared light outward through the light-emitting diode. The electronic device 500 uses the photodiode to detect the infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 500. When insufficient reflected light is detected, the electronic device 500 can determine that there is no object near the electronic device 500. The electronic device 500 can use the proximity light sensor 480G to detect that the user holds the electronic device 500 close to the ear for a call, so as to automatically turn off the screen to achieve the purpose of power saving. The proximity light sensor 480G can also be used for automatic unlocking and locking of the leather case mode and pocket mode.

[0292] The ambient light sensor 480L is used to sense the ambient light brightness. The electronic device 500 can adaptively adjust the brightness of the display screen 494 according to the sensed ambient light brightness. The ambient light sensor 480L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 480L can also cooperate with the proximity light sensor 480G to detect whether the electronic device 500 is in the pocket to prevent accidental touch.

[0293] The fingerprint sensor 480H is used to collect fingerprints. The electronic device 500 can use the collected fingerprint characteristics to achieve fingerprint unlocking, access application locks, fingerprint taking pictures, fingerprint answering calls, etc.

[0294] The temperature sensor 480J is used to detect temperature. In some embodiments, the electronic device 500 uses the temperature detected by the temperature sensor 480J to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 480J exceeds the threshold, the electronic device 500 reduces the performance of the processor near the temperature sensor 480J to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the electronic device 500 heats the battery 442 to avoid abnormal shutdown of the electronic device 500 caused by low temperature. In other embodiments, when the temperature is lower than yet another threshold, the electronic device 500 boosts the output voltage of the battery 442 to avoid abnormal shutdown caused by low temperature.

[0295] The touch sensor 480K, also known as the "touch control device". The touch sensor 480K can be disposed on the display screen 494, and the touch sensor 480K and the display screen 494 form a touch screen, also known as the "touch control screen". The touch sensor 480K is used to detect a touch operation acting thereon or nearby. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 494. In some other embodiments, the touch sensor 480K can also be disposed on the surface of the electronic device 500, at a different position from that of the display screen 494.

[0296] The bone conduction sensor 480M can acquire vibration signals. In some embodiments, the bone conduction sensor 480M can acquire vibration signals of the vibrating bone mass of the human vocal part. The bone conduction sensor 480M can also contact the human pulse to receive blood pressure pulsation signals. In some embodiments, the bone conduction sensor 480M can also be disposed in the earphone to form a bone conduction earphone. The audio module 470 can parse out voice signals based on the vibration signals of the vibrating bone mass of the human vocal part acquired by the bone conduction sensor 480M to implement the voice function. The application processor can parse out heart rate information based on the blood pressure pulsation signals acquired by the bone conduction sensor 480M to implement the heart rate detection function. The keys 490 include a power-on key, a volume key, etc. The keys 490 can be mechanical keys. They can also be touch keys. The electronic device 500 can receive key inputs to generate key signal inputs related to the user settings and function control of the electronic device 500.

[0297] The motor 491 can generate vibration prompts. The motor 491 can be used for incoming call vibration prompts and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playing, etc.) can correspond to different vibration feedback effects. For touch operations acting on different regions of the display screen 494, the motor 491 can also correspond to different vibration feedback effects. Different application scenarios (such as time reminder, receiving information, alarm clock, game, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

[0298] The indicator 492 can be an indicator light, which can be used to indicate the charging state, power change, and can also be used to indicate messages, missed calls, notifications, etc.

[0299] The SIM card interface 495 is used to connect to a SIM card. The SIM card can be inserted into or removed from the SIM card interface 495 to achieve contact and separation from the electronic device 500. The electronic device 500 can support one or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 495 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 495 simultaneously. The types of the multiple cards can be the same or different. The SIM card interface 495 can also be compatible with different types of SIM cards. The SIM card interface 495 can also be compatible with external memory cards. The electronic device 500 interacts with the network through the SIM card to implement functions such as calls and data communication. In some embodiments, the electronic device 500 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 500 and cannot be separated from the electronic device 500.

[0300] An embodiment of the present application also provides a computer storage medium. The computer storage medium can store a program. When the program runs, it controls the device where the computer-readable storage medium is located to execute some or all of the steps in the above embodiments. The storage medium can be a magnetic disk, an optical disc, a read-only memory (ROM), a random access memory (RAM), etc.

[0301] An embodiment of the present application also provides a computer program product. The computer program product includes executable instructions. When the executable instructions are executed on a computer, the computer is caused to execute some or all of the steps in the above method embodiments.

[0302] In the embodiments of the present application, "at least one" means one or more, and "multiple" means two or more. "And / or" describes the association relationship of associated objects and indicates that three relationships can exist. For example, A and / or B can represent the cases of A existing alone, A and B existing simultaneously, and B existing alone. Here, A and B can be singular or plural. The character " / " generally represents an "or" relationship between the associated objects before and after. "At least one of the following" and its similar expressions refer to any combination of these items, including any combination of single items or plural items. For example, at least one of a, b, and c can represent: a, b, c, a - b, a c, b - c, or a - b - c, where a, b, and c can be single or multiple.

[0303] Those of ordinary skill in the art can realize that the various units and algorithm steps described in the embodiments disclosed herein can be implemented by electronic hardware, computer software, or a combination of electronic hardware. Whether these functions are executed in a hardware or software manner depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the present invention.

[0304] Those skilled in the art can clearly understand that for the convenience and conciseness of description, the specific working processes of the systems, devices, and units described above can refer to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0305] In several embodiments provided by the present invention, if any function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or a part of this technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The foregoing storage medium includes: USB flash drives, mobile hard disks, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical discs, and other various media that can store program codes.

[0306] The above is only the specific implementation manner of the present invention. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed by the present invention, and all should be covered by the protection scope of the present invention. The protection scope of the present invention shall be subject to the protection scope of the claims.

Claims

1. A shooting method for a multi-camera shooting system, characterized in that, Applied to a first electronic device, the first electronic device being the host device of a multi-camera shooting system, the multi-camera shooting system further including a second electronic device, the second electronic device being a slave device, the host device being used to control the shooting of the slave device of the multi-camera shooting system, the method comprising: The first electronic device displays a first video image in a first display area of the main interface, the first video image being captured by the host device or the slave device, and the first video image being a recording screen; The first electronic device receives a first user operation in the video shooting mode; According to the first user operation, the first electronic device displays a second video image in a second display area of the main interface, the first video image being from the host device or the slave device, the second video image being captured by the slave device, and the second video image being a director's view; The first electronic device receives a video switching operation for the second video image; According to the video switching operation, the first electronic device switches the first video image and the second video image, displays the second video image in the first display area of the main interface, and displays the first video image in the second display area of the main interface. After switching, the first video image is the director's view and the second video image is the recording screen.

2. The method according to claim 1, characterized in that, The main interface includes an operation control for triggering the display of the second video image in the main interface.

3. The method according to claim 1, characterized in that, The first user operation includes a first swipe gesture operation on a preset position of the main interface.

4. The method according to any one of claims 1-3, characterized in that, The video switching operation includes a click operation on the second video image in the main interface.

5. The method according to claim 1, characterized in that, One of the first video image and the second video image is from the second electronic device; The other of the first video image and the second video image is from the first electronic device or a third electronic device, the third electronic device being another slave device of the multi-camera shooting system.

6. The method according to claim 1, characterized in that, After the process in which the first electronic device switches the first video image and the second video image according to the video switching operation, the method further comprises: The first electronic device receives a second user operation; According to the second user operation, the first electronic device hides the first video image in the main interface; The first electronic device receives a third user operation; According to the third user operation, the first electronic device displays the first video image in the main interface.

7. The method according to claim 6, characterized in that, The third user operation includes a first swipe gesture operation on a preset position, and the second user operation includes a second swipe gesture operation on a preset position.

8. The method according to claim 1, characterized in that, After the process in which the first electronic device switches the first video image and the second video image according to the video switching operation, the method further comprises: The first electronic device receives a camera position switching operation for the first video image; The first electronic device replaces the first video image with a third video image according to the camera position switching operation, where the first video image and the third video image are video images provided by different camera positions in the multi-camera shooting system.

9. The method according to claim 1, characterized in that, After the process in which the first electronic device switches the first video image and the second video image according to the video switching operation, the method further includes: The first electronic device receives a camera switching operation for the first video image; The first electronic device replaces the first video image with a fourth video image according to the camera switching operation, where the first video image and the fourth video image are video images provided by different cameras at the same camera position in the multi-camera shooting system.

10. The method according to claim 1, characterized in that, After the process in which the first electronic device switches the first video image and the second video image according to the video switching operation, the method further includes: The first electronic device receives a picture-in-picture display operation for the first video image; The first electronic device displays a fifth video image at least partially surrounded by the second video image on the main interface according to the picture-in-picture display operation, where the fifth video image is the same as the first video image, and the fifth video image is a recording screen.

11. The method according to claim 6, wherein After the process in which the first electronic device switches the first video image and the second video image according to the video switching operation, the first video image is from a second electronic device, and the second electronic device is a secondary camera position of the multi-camera shooting system; The method further includes: after hiding the first video image on the main interface and when the first electronic device does not display a video image from the second electronic device, the first electronic device sends a standby control instruction to the second electronic device, and the standby control instruction is used to instruct the second electronic device to turn off or operate in a low-power mode for any one or any combination of the following components: a camera module, an image signal processor ISP, a video processor VPU, a display screen, and a wireless communication link, and the wireless communication link is used to transmit the video image from the second electronic device to the first electronic device.

12. The method according to claim 11, wherein The standby control instruction is further used to instruct the second electronic device to change the wireless communication link from a continuous communication state to a periodic sleep communication state; When the continuous duration of the wireless communication link in the periodic sleep communication state reaches a first preset duration, the first electronic device establishes a low-power Bluetooth BLE connection between the first electronic device and the second electronic device and disconnects the wireless communication link; After the first electronic device sends the standby control instruction to the second electronic device, the method further includes: the first electronic device executes a first standby recovery process or a second standby recovery process; Both the first standby recovery process and the second standby recovery process include: the process in which the first electronic device receives a third user operation, and the first electronic device displays the first video image on the main interface according to the third user operation; In the first standby recovery process, the third user operation is a standby recovery operation; The second standby recovery process further includes: before receiving the third user operation, the first electronic device receives a standby recovery operation; Before the process of displaying the second video image on the main interface, both the first standby recovery process and the second standby recovery process further include: According to the standby recovery operation, if the standby recovery operation is received when the wireless communication link is in the periodic sleep communication state, the first electronic device sends a standby recovery control instruction to the second electronic device through the wireless communication link, and the standby recovery control instruction is used to instruct the second electronic device to restore the wireless communication link to the continuous communication state; According to the standby recovery operation, if the standby recovery operation is received when the wireless communication link is disconnected, the first electronic device sends a standby recovery control instruction to the second electronic device through the low-power Bluetooth (BLE) connection, and the standby recovery control instruction is used to instruct the second electronic device to restore the wireless communication link to the continuous communication state.

13. The method according to claim 12, wherein In the second standby recovery process, the standby recovery operation includes a touch operation on a preset position.

14. The method according to claim 11, wherein The standby control instruction is used to instruct the second electronic device to change the wireless communication link from the continuous communication state to the first periodic sleep communication state; The method further includes: when the duration of the wireless communication link in the first periodic sleep communication state reaches a first preset duration, the first electronic device changes the wireless communication link to a second periodic sleep communication state, and the sleep cycle of the first periodic sleep communication state is less than the sleep cycle of the second periodic sleep communication state; After sending the standby control instruction to the second electronic device, the method further includes: the first electronic device executes a third standby recovery process or a fourth standby recovery process; Both the third standby recovery process and the fourth standby recovery process include receiving the third user operation, and the process of displaying the first video image on the main interface according to the third user operation; In the third standby recovery process, the third user operation is a standby recovery operation; The fourth standby recovery process further includes: before receiving the third user operation, the first electronic device receives a standby recovery operation; Before the process of displaying the first video image on the main interface, both the third standby recovery process and the fourth standby recovery process further include: According to the standby recovery operation, the first electronic device sends a standby recovery control instruction to the second electronic device through the wireless communication link, and the standby recovery control instruction is used to instruct the second electronic device to restore the wireless communication link to the continuous communication state.

15. The method according to claim 14, wherein In the fourth standby recovery process, the standby recovery operation is a touch operation applied to a preset position.

16. The method according to any one of claims 11 to 15, wherein After the process of sending a standby recovery control instruction to the second electronic device, the method further includes: The first electronic device displays a transition image at a preset position according to the third user operation; The process of the first electronic device displaying the first video image on the main interface according to the third user operation includes: The first electronic device replaces the transition image with the first video image according to the third user operation when the first electronic device receives the first video image from the second electronic device through the wireless communication link restored to the continuous communication state.

17. A photographing device of a multi-camera photographing system, wherein Applied to a first electronic device, the first electronic device is the host position of a multi-camera shooting system, the multi-camera shooting system further includes a second electronic device, the second electronic device is the slave position, the host position is used to control the shooting of the slave position of the multi-camera shooting system, the device includes: An interface display module, configured to display a first video image in a first display area of the main interface, the first video image is captured by the host position or the slave position, and the first video image is a recording screen; An operation receiving module, configured to receive a first user operation in a video shooting mode; The interface display module is further configured to display a second video image in a second display area of the main interface according to the first user operation, the second video image is captured by the slave position, and the second video image is a director's view; The operation receiving module is further configured to receive a video switching operation for the second video image; A video switching module, configured to switch the first video image and the second video image according to the video switching operation, display the second video image in the first display area of the main interface, and display the first video image in the second display area of the main interface. After switching, the first video image is a director's view and the second video image is a recording screen.

18. The device according to claim 17, wherein The operation receiving module is further configured to receive a second user operation; The interface display module is further configured to hide the first video image on the main interface according to the second user operation; The operation receiving module is further configured to receive a third user operation; The interface display module is further configured to display the first video image on the main interface according to the third user operation.

19. The device according to claim 18, wherein The first video image is captured by the second electronic device, and the device further includes: A standby control module, which is configured to send a standby control instruction to the second electronic device after hiding the first video image on the main interface and when the first electronic device does not display a video image from the second electronic device. The standby control instruction is used to instruct the second electronic device to turn off or operate in a low-power mode for any one or any combination of the following components: a camera module, an image signal processor (ISP), a video processor (VPU), a display screen, and a wireless communication link. The wireless communication link is used to transmit the video image from the second electronic device to the first electronic device. The second electronic device is a secondary camera position of the multi-camera shooting system, and the video image is the first video image or the second video image.

20. The device according to claim 19, wherein The standby control instruction is further configured to instruct the second electronic device to change the wireless communication link from a continuous communication state to a periodic sleep communication state; The device further includes a communication control module, which is configured to establish a low-power Bluetooth (BLE) connection between the first electronic device and the second electronic device and disconnect the wireless communication link when the continuous duration of the wireless communication link in the periodic sleep communication state reaches a first preset duration; The operation receiving module is specifically configured to receive a third user operation in a first standby recovery process, or receive a standby recovery operation and a third user operation in a second standby recovery process. In the first standby recovery process, the third user operation is a standby recovery operation; The standby control module is further configured to, according to the standby recovery operation, if the standby recovery operation is received when the wireless communication link is in the periodic sleep communication state, send a standby recovery control instruction to the second electronic device through the wireless communication link. The standby recovery control instruction is used to instruct the second electronic device to restore the wireless communication link to the continuous communication state; The standby control module is further configured to, according to the standby recovery operation, if the standby recovery operation is received when the wireless communication link is disconnected, send a standby recovery control instruction to the second electronic device through the low-power BLE connection. The standby recovery control instruction is used to instruct the second electronic device to restore the wireless communication link to the continuous communication state.

21. The device according to claim 20, wherein The standby control instruction is used to instruct the second electronic device to change the wireless communication link from a continuous communication state to a first periodic sleep communication state; The device further includes a communication control module, which is configured to change the wireless communication link to a second periodic sleep communication state when the continuous duration of the wireless communication link in the first periodic sleep communication state reaches a first preset duration. The sleep cycle of the first periodic sleep communication state is less than the sleep cycle of the second periodic sleep communication state; The operation receiving module is specifically configured to receive a third user operation in a third standby recovery process, or receive a standby recovery operation and a third user operation in a fourth standby recovery process. In the third standby recovery process, the third user operation is a standby recovery operation; The standby control module is further configured to send a standby resume control instruction to the second electronic device via the wireless communication link according to the standby resume operation, where the standby resume control instruction is used to instruct the second electronic device to resume the wireless communication link to the continuous communication state.

22. The device according to any one of claims 19 to 21, wherein Further comprising: The interface display module is further configured to display a transition image at a preset position according to the third user operation; The interface display module is specifically further configured to: according to the third user operation, when the first electronic device receives a video image from the second electronic device via the wireless communication link that has resumed to the continuous communication state, replace the transition image with the first video image.

23. An electronic device, wherein Comprising a memory for storing computer program instructions and a processor for executing the computer program instructions, wherein when the computer program instructions are executed by the processor, the electronic device is triggered to execute the method according to any one of claims 1-16.

24. A computer-readable storage medium, wherein The computer-readable storage medium includes a stored program, wherein when the program runs, it controls the device where the computer-readable storage medium is located to execute the method according to any one of claims 1-16.

25. A computer program product, wherein The computer program product contains executable instructions, and when the executable instructions are executed on a computer, the computer is caused to execute the method according to any one of claims 1-16.

Citation Information

Patent Citations

  • Method and apparatus for implementing multi-camera video synchronous playing

    CN105872570A