Camera control method and electronic device

Abstract

The present application provides a method and an electronic device for controlling a camera. When a second electronic device detects a request from a first electronic device for permission to use a physical camera of the second electronic device, the second electronic device generates and displays a first UI to a user, and the user can control the physical camera on the second electronic device through the first UI. When the user performs an operation on the first UI, the second electronic device detects the request from the first UI, and the second electronic device performs a corresponding operation on the physical camera according to the request of the first UI, thereby satisfying the user's control needs for the physical camera of the second electronic device during the period when the physical camera of the second electronic device is controlled by the first electronic device.

Description

Technical Field

[0001] The present application relates to the field of terminals, and more specifically, to a method and electronic device for controlling a camera in the field of terminals. Background Art

[0002] After a virtual camera corresponding to the physical camera of another electronic device is created on an electronic device, the user can control the physical camera of the other electronic device through the virtual camera. The former can be called a master device and the latter can be called a remote device. For example, the user can control the physical camera of the remote device to turn on or off through the virtual camera on the master device.

[0003] However, while the physical camera of the remote device is controlled by the main control device, the user cannot control the physical camera of the remote device. Therefore, the above technical solution cannot meet the user's control needs for the physical camera of the remote device while the physical camera of the remote device is controlled by the main control device, thereby affecting the user experience. Summary of the invention

[0004] The embodiment of the present application provides a method for controlling a camera, which can meet the user's control needs for the physical camera of a remote device while the physical camera of the remote device is controlled by a main control device.

[0005] In a first aspect, a method for controlling a camera is provided, which is performed by a second electronic device, comprising: when the second electronic device detects a first request from a first electronic device, starting a physical camera and displaying a first UI, wherein the first request requests the second electronic device for permission to use the physical camera; when the second electronic device detects a second request from the first UI, performing a first operation on the physical camera, wherein the first operation is an operation requested by the second request to be performed by the second electronic device.

[0006] In the above scheme, when the second electronic device detects a request from the first electronic device for permission to use the physical camera of the second electronic device, the second electronic device generates and displays a first UI to the user, and the user can control the physical camera on the second electronic device through the first UI. When the user performs a certain operation on the first UI, the second electronic device detects the request from the first UI, and the second electronic device performs corresponding operations on the physical camera according to the request of the first UI, thereby satisfying the user's control needs for the physical camera of the second electronic device during the period when the physical camera of the second electronic device is controlled by the first electronic device.

[0007] In combination with the first aspect, in some implementations of the first aspect, the method further includes: the second electronic device displays, on the first UI, a current picture acquired by the physical camera after the first operation is performed.

[0008] In the above scheme, the second electronic device displays the current picture acquired by the physical camera after executing the first operation on the first UI, so that the user can not only control the physical camera of the second electronic device through the first UI, but also see the current picture acquired by the physical camera on the second electronic device, thereby improving the user experience.

[0009] In combination with the first aspect and the above-mentioned implementation methods, in some implementation methods of the first aspect, the method also includes: the second electronic device sends data information and first parameter information of the first picture to the first electronic device, and the first parameter information is parameter information of the physical camera when shooting the first picture.

[0010] In the above scheme, when the user enables the second electronic device to perform the first operation on the physical camera through the first UI, the second electronic device can send the data information of the current picture obtained by the physical camera after performing the first operation and the parameter information of the physical camera when shooting the current picture to the first electronic device. The first electronic device can display the current picture to the user based on the received data information of the current picture and the parameter information of the physical camera when shooting the current picture, thereby improving the user experience.

[0011] In combination with the first aspect and the above-mentioned implementation manners, in some implementation manners of the first aspect, the method further includes: when the second electronic device detects a third request from the first electronic device, performing a second operation on the physical camera, the second operation being an operation requested by the second electronic device to be performed by the third request; the second electronic device sends data information and second parameter information of a second picture to the first electronic device, the second picture being a current picture acquired by the physical camera after performing the second operation, and the second parameter information being parameter information of the physical camera when shooting the second picture.

[0012] In the above scheme, the second electronic device can not only process requests from the first UI, but also process requests from the first electronic device. In other words, the user can not only control the physical camera of the second electronic device through the first electronic device, but also control the physical camera of the second electronic device through the first UI, thereby realizing multi-terminal control of the physical camera of the second electronic device.

[0013] In combination with the first aspect and the above-mentioned implementation manners, in some implementation manners of the first aspect, the executing the first operation includes: when the control strategy is satisfied, the second electronic device executes the first operation on the physical camera, wherein the control strategy includes: when the receiving time of the second request is earlier than the receiving time of the third request, executing the second request first, or, when the second request conflicts with the third request, refusing to execute the second request, or, when the second request conflicts with the third request, refusing to execute the third request.

[0014] In the above scheme, since the second electronic device can not only process requests from the first UI, but also process requests from the first electronic device, in this case, the operation requested to be executed by the request from the first UI may conflict with the operation requested to be executed by the request from the first electronic device. In order to avoid the occurrence of conflicts, before executing the request, the second electronic device can first determine whether the request is allowed to be executed according to the control policy, and finally only process the requests that are allowed to be executed according to the control policy, thereby avoiding the occurrence of conflicts.

[0015] In combination with the first aspect and the above-mentioned implementation manners, in some implementation manners of the first aspect, the performing of the second operation includes: when the control strategy is satisfied, the second electronic device performs the second operation on the physical camera, wherein the control strategy includes: when the receiving time of the second request is earlier than the receiving time of the third request, the second electronic device executes the second request, or, when the second request conflicts with the third request, the second electronic device refuses to execute the second request, or, when the second request conflicts with the third request, the second electronic device refuses to execute the third request.

[0016] In the above scheme, since the second electronic device can not only process requests from the first UI, but also process requests from the first electronic device, in this case, the operation requested to be executed by the request from the first UI may conflict with the operation requested to be executed by the request from the first electronic device. In order to avoid the occurrence of conflicts, before executing the request, the second electronic device can first determine whether the request is allowed to be executed according to the control policy, and finally only process the requests that are allowed to be executed according to the control policy, thereby avoiding the occurrence of conflicts.

[0017] In combination with the first aspect and the above-mentioned implementations, in some implementations of the first aspect, the method further includes: the second electronic device receives user input data from the first UI; and the second electronic device obtains the control strategy based on the user input data.

[0018] In the above solution, the second electronic device obtains the control strategy based on the user input data from the first UI, so that the user can set the control strategy through the first UI. In other words, the user decides which control strategy to use, thereby improving the user experience.

[0019] In a second aspect, the present application provides a device, which is included in an electronic device, and has the function of implementing the electronic device behavior in the above aspects and possible implementations of the above aspects. The function can be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes one or more modules or units corresponding to the above functions.

[0020] In a third aspect, the present application provides an electronic device, comprising: a touch display screen, wherein the touch display screen comprises a touch-sensitive surface and a display; a camera; one or more processors; a memory; a plurality of applications; and one or more computer programs. The one or more computer programs are stored in the memory, and the one or more computer programs comprise instructions. When the instructions are executed by the electronic device, the electronic device performs a method for controlling a camera in any possible implementation of any of the above aspects.

[0021] In a fourth aspect, the present application provides an electronic device, comprising one or more processors and one or more memories. The one or more memories are coupled to the one or more processors, and the one or more memories are used to store computer program codes, and the computer program codes include computer instructions, and when the one or more processors execute the computer instructions, the electronic device executes the method of controlling a camera in any possible implementation of any of the above aspects.

[0022] In a fifth aspect, the present application provides a computer-readable storage medium, including computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes any possible method of controlling a camera in any of the above aspects.

[0023] In a sixth aspect, the present application provides a computer program product. When the computer program product is run on an electronic device, the electronic device executes any possible method of controlling a camera in any of the above aspects. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 It is a system framework diagram provided by an embodiment of the present application;

[0025] Figure 2 is a schematic block diagram of an electronic device provided in an embodiment of the present application;

[0026] Figure 3 is a schematic diagram of a method for controlling a camera provided in an embodiment of the present application;

[0027] Figure 4 Figure (a) is a schematic diagram of a user interface for controlling a camera provided in an embodiment of the present application;

[0028] Figure 4 Figure (b) is another schematic diagram of a user interface for controlling a camera provided in an embodiment of the present application;

[0029] Figure 5 Figure (a) is a schematic diagram of another example of a user interface for controlling a camera provided in an embodiment of the present application;

[0030] Figure 5 Figure (b) is a schematic diagram of another example of a user interface for controlling a camera provided in an embodiment of the present application. DETAILED DESCRIPTION

[0031] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application.

[0032] To facilitate understanding, a brief introduction is first given to the embodiments of the present application.

[0033] Master device

[0034] The master device may be an electronic device that initiates a request to other electronic devices for permission to use a physical camera of the other electronic devices.

[0035] Remote Device

[0036] The remote device may be an electronic device whose physical camera is controlled by the host device.

[0037] Virtual Camera

[0038] The virtual camera can be a virtual camera corresponding to the physical camera of the remote device created by the main control device based on the parameter information of the physical camera of the remote device. The so-called virtual camera is relative to the physical camera. The main control device can control the physical camera of the remote device through the virtual camera.

[0039] Figure 1 A framework diagram of a system provided in an embodiment of the present application is shown, and a main control device can control a physical camera of a remote device through a virtual camera corresponding to the physical camera of the remote device.

[0040] For example, Figure 2 1 is a schematic diagram of the structure of an electronic device 100 provided in an embodiment of the present application. The electronic device 100 may include a processor 110, an internal memory 120, a universal serial bus (USB) interface 130, a camera 140, a display screen 150, a touch sensor 160, and the like.

[0041] It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0042] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0043] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.

[0044] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0045] The USB interface 130 is an interface that complies with the USB standard specification, and specifically can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transfer data between the electronic device 100 and a peripheral device. It can also be used to connect headphones to play audio through the headphones. The interface can also be used to connect other electronic devices, such as AR devices, etc.

[0046] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present invention is only a schematic illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0047] The electronic device 100 implements the display function through a GPU, a display screen 150, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 150 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or change display information.

[0048] The display screen 150 is used to display images, videos, etc. The display screen 150 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 150, where N is a positive integer greater than 1.

[0049] The electronic device 100 can realize the shooting function through the ISP, the camera 140, the video codec, the GPU, the display screen 150 and the application processor.

[0050] The ISP is used to process the data fed back by the camera 140. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. The ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. The ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP can be set in the camera 140.

[0051] The camera 140 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 140, where N is a positive integer greater than 1.

[0052] The digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the electronic device 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0053] Video codecs are used to compress or decompress digital videos. The electronic device 100 may support one or more video codecs. Thus, the electronic device 100 may play or record videos in a variety of coding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0054] NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. Through NPU, applications such as intelligent cognition of electronic device 100 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.

[0055] The internal memory 120 can be used to store computer executable program codes, which include instructions. The internal memory 120 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data (such as audio data, etc.) created during the use of the electronic device 100, etc. In addition, the internal memory 120 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the electronic device 100 by running instructions stored in the internal memory 120, and / or instructions stored in a memory provided in the processor.

[0056] The touch sensor 160 is also called a "touch control device". The touch sensor 160 can be arranged on the display screen 150. The touch sensor 160 and the display screen 150 form a touch screen, also called a "touch control screen". The touch sensor 160 is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 150. In other embodiments, the touch sensor 160 can also be arranged on the surface of the electronic device 100, which is different from the position of the display screen 150.

[0057] Exemplarily, the electronic device 100 may be a first electronic device or a second electronic device.

[0058] Combine the following Figure 1 The system shown in the figure introduces in detail the method for controlling the camera provided by the present application. Figure 3 A schematic interactive flow chart of a method 300 of controlling a camera is shown.

[0059] Step 301: When the second electronic device detects a first request from the first electronic device, the second electronic device starts a physical camera of the second electronic device and displays a first user interface (UI), wherein the first request requests the second electronic device for permission to use the physical camera.

[0060] Step 302: When the second electronic device detects a second request from the first UI, the second electronic device performs a first operation on the physical camera, where the first operation is an operation requested by the second request to be performed by the second electronic device.

[0061] Exemplarily, a first electronic device discovers other electronic devices around it using near-field broadcasting. For example, the first electronic device discovers a second electronic device using Bluetooth broadcasting. The first electronic device can then establish a connection with the second electronic device and obtain parameter information of a physical camera of the second electronic device. The first electronic device can create a virtual camera corresponding to the physical camera of the second electronic device based on the parameter information of the physical camera of the second electronic device. The first electronic device can then control the physical camera of the second electronic device through the virtual camera. In this case, the first electronic device is the main control device and the second electronic device is the remote device.

[0062] It is worth mentioning that the parameter information of the physical camera in the embodiment of the present application is used to indicate the capabilities of the physical camera. For example, the parameter information of the physical camera may include the resolution, frame rate, and color format supported by the physical camera.

[0063] After the first electronic device creates a virtual camera corresponding to the physical camera of the second electronic device, the user can call the virtual camera through an application (APP) installed on the first electronic device. When the virtual camera is called, the second electronic device detects a first request from the first electronic device. The first request is used to request the second electronic device to start its physical camera. The second electronic device starts the physical camera based on the first request.

[0064] For example, the APP on the first electronic device may display a UI on its display interface, which is used by the user to select the remote device for which the user wants to request permission to use the physical camera, and may also be used by the user to further select permission to request the front camera or rear camera of the physical camera. In order to distinguish it from the UI that appears later, since the UI is used by the user to select the remote device, the UI may be referred to as the UI corresponding to the remote device.

[0065] Assuming that the user selects the front camera of the physical camera of the second electronic device, when the user completes the selection, the APP on the first electronic device will call the virtual camera corresponding to the physical camera of the second electronic device. After the virtual camera is called, the second electronic device will detect the first request from the second electronic device. The first request is used to request the second electronic device to turn on the front camera of its right camera. The second electronic device calls the camera interface to turn on the front camera according to the first request. After that, the physical camera of the second electronic device will capture the current picture in the actual environment. The second electronic device can send the data information of the current picture and the parameter information of the physical camera when shooting the current picture to the first electronic device, so that the first electronic device can display the current picture corresponding to the data information of the current picture to the user according to the parameter information of the physical camera when shooting the current picture.

[0066] It is worth mentioning that when the virtual camera corresponding to the physical camera of the second electronic device is called, the first electronic device can display the UI corresponding to the virtual camera based on the call, and the UI corresponding to the virtual camera can be used by the user to control the physical camera of the second electronic device.

[0067] In addition, the second electronic device can generate a UI (e.g., a first UI) based on the first request from the first electronic device, and display the first UI on the second electronic device. The user can control the physical camera of the second electronic device on the second electronic device through interaction with the first UI. When the user completes an operation on the first UI, the second electronic device detects the second request from the first UI, and the second electronic device performs the first operation on the physical camera according to the second request.

[0068] Exemplarily, the user requests the second electronic device to increase the resolution of the physical camera through the first UI. At this time, the second electronic device performs a first operation of increasing the resolution of the physical camera in response to the user's request.

[0069] Exemplarily, in addition to providing an interactive entrance between the user and the second electronic device, the first UI may also display to the user a picture captured in real time by a physical camera of the second electronic device. In this case, the method 300 may further include:

[0070] Step 303: The second electronic device displays a first picture on the first UI, where the first picture is a current picture acquired by the physical camera after the first operation is performed.

[0071] Exemplarily, the second electronic device may also send data information of the first picture and parameter information of a physical camera of the second electronic device when shooting the first picture to the first electronic device. In this case, the method 300 may also include:

[0072] Step 304: the second electronic device sends data information of the first picture and first parameter information to the first electronic device, where the first parameter information is parameter information of the physical camera when shooting the first picture.

[0073] For example, when the second electronic device performs the first operation, the resolution of the physical camera is increased from 1280×720 to 1920×1080. In this case, the resolution used by the physical camera when shooting the first picture is 1920×1080. After acquiring the first picture, the second electronic device sends the data information of the first picture and the parameter information of the physical camera when shooting the first picture to the first electronic device, so that the first electronic device displays the first picture corresponding to the data information of the first picture to the user according to the parameter information of the physical camera when shooting the first picture. Here, the parameter information of the physical camera when shooting the first picture includes resolution, and the value of the resolution is 1920×1080. In other words, the resolution of the first picture displayed to the user by the first electronic device is the resolution used by the physical camera when shooting the first picture, that is, 1920×1080.

[0074] Exemplarily, the second electronic device may process a request from the first electronic device in addition to processing the request from the first UI. In this case, the method 300 may further include:

[0075] Step 305: When the second electronic device detects the third request from the first electronic device, the second electronic device performs a second operation on the physical camera, where the second operation is an operation requested by the third request to be performed by the second electronic device.

[0076] Step 306, the second electronic device sends data information of a second picture and second parameter information to the first electronic device, where the second picture is the current picture acquired by the physical camera after the second operation is performed, and the second parameter information is parameter information of the physical camera when shooting the second picture.

[0077] When the user performs a certain operation on the virtual camera corresponding to the physical camera of the second electronic device on the UI corresponding to the virtual camera, the second electronic device detects a third request from the first electronic device, and the second electronic device performs a second operation based on the third request. After that, the second electronic device can send the data information of the second picture obtained by the physical camera after performing the second operation and the parameter information of the physical camera when shooting the second picture to the first electronic device, so that the first electronic device can display the second picture corresponding to the data information of the second picture to the user based on the parameter information of the physical camera when shooting the second picture.

[0078] Exemplarily, for a detected request from the UI corresponding to the virtual camera, or a request from the first UI, the second electronic device may first determine whether the control strategy is satisfied, and when the control strategy is satisfied, the second electronic device executes the corresponding request.

[0079] The control strategies may include: sequential priority control strategy, local priority control strategy, and peer priority strategy. The so-called sequential priority control strategy means that the second electronic device executes corresponding requests in sequence according to the order in which the requests are received; the local priority control strategy means that when the operation requested to be executed by the request from the first electronic device conflicts with the operation requested to be executed by the request from the second electronic device, the second electronic device refuses to execute the request from the first electronic device; the peer priority strategy means that when the operation requested to be executed by the request from the first electronic device conflicts with the operation requested to be executed by the request from the second electronic device, the second electronic device refuses to execute the request from the second electronic device.

[0080] Exemplarily, it is assumed that the control strategy is a sequential priority control strategy. In this case, the second electronic device executes all detected requests. In this case, the second electronic device executes both the second request and the third request.

[0081] Exemplarily, assuming that the control policy is a local priority control policy, in this case, when the second electronic device detects both the second request and the third request, assuming that there is a conflict between the first operation requested by the second electronic device to be performed by the second request and the second operation requested by the second electronic device to be performed by the third request, at this time, the second electronic device refuses to perform the second operation corresponding to the third request based on the local priority control policy.

[0082] For example, the second electronic device detects both the second request and the third request, the first operation corresponding to the second request is to set the flash of the physical camera to automatic mode, and the second operation corresponding to the third request is to set the flash of the physical camera to constant mode. In this case, the second electronic device may refuse to execute the third request. In other words, in this case, the second electronic device only executes the second request, that is, sets the flash of the physical camera to automatic mode.

[0083] Exemplarily, assuming that the control policy is a peer-priority control policy, in this case, when the second electronic device detects both the second request and the third request, assuming that there is a conflict between the first operation requested by the second electronic device to be performed by the second request and the second operation requested by the second electronic device to be performed by the third request, at this time, the second electronic device refuses to perform the first operation corresponding to the second request based on the peer-priority control policy.

[0084] For example, the second electronic device detects both the second request and the third request. The first operation corresponding to the second request is to turn on the night scene photography mode, and the second operation corresponding to the third request is to turn on the large aperture photography mode. In this case, the second electronic device may refuse to execute the second request. In other words, in this case, the second electronic device only executes the third request, that is, to turn on the large aperture photography mode.

[0085] Illustratively, the control strategy may be pre-configured on the second electronic device, or the control strategy may be set by the user through the first UI. For example, the user interacts with the second electronic device through the first UI and sets the control strategy on the first UI. At this time, the second electronic device detects the user input data from the first UI, and the second electronic device obtains the control strategy based on the user input data.

[0086] It should be noted that, in the embodiment of the present application, the user operating the first electronic device and the user operating the second electronic device may be the same user, or may be different users, and the embodiment of the present application does not limit this.

[0087] The following takes the live broadcast scenario as an example. Figures 4 to 5 The method 300 is described in detail.

[0088] When the first electronic device discovers the second electronic device using the near field mode, the first electronic device can create a virtual camera corresponding to the physical camera of the second electronic device on it, and then the first electronic device can control the physical camera of the second electronic device through the virtual camera. At this time, the first electronic device is the main control device and the second electronic device is the remote device. For the way the first electronic device discovers the second electronic device and the way the first electronic device creates a virtual camera, please refer to the relevant description in method 300. For the sake of brevity, it will not be repeated here.

[0089] Assume that the anchor currently wants to use a first APP installed on a first electronic device for live broadcasting, wherein the first APP has a live broadcasting function and has the ability to call a virtual camera corresponding to a physical camera of a second electronic device.

[0090] Assume that the host needs to use the function of the physical camera of the first electronic device and the function of the virtual camera corresponding to the physical camera of the second electronic device during the live broadcast. For the physical camera of the first electronic device, when the user turns on the live broadcast function, the first electronic device will turn on the physical camera accordingly. Assuming that the physical camera currently turns on the front camera, the user watching the live broadcast will see the host on their electronic device at this time. For the virtual camera corresponding to the physical camera of the second electronic device, the host can make a selection on the UI corresponding to the remote device displayed by the first APP. Assuming that the host selects the rear camera of the virtual camera corresponding to the second electronic device, when the host completes the selection, the first APP will call the virtual camera corresponding to the physical camera of the second electronic device on the first electronic device.

[0091] After the virtual camera corresponding to the second electronic device is called, the virtual camera proxy module on the second electronic device will detect the first request from the first APP. Since the anchor selected the rear camera of the virtual camera corresponding to the second electronic device, the first request is used to request the second electronic device to start the rear camera of its physical camera. The virtual camera proxy module calls the camera interface to start the rear camera of the physical camera based on the first request.

[0092] The virtual camera proxy module calls the camera interface to start the rear camera of the physical camera according to the first request, and the physical camera will capture the current picture in the actual environment. The virtual camera proxy module can call the camera interface to send the data information of the current picture and the parameter information of the physical camera when shooting the current picture to the first APP on the first electronic device. The first APP can display the current picture corresponding to the data information of the current picture to the user watching the live broadcast according to the parameter information of the physical camera when shooting the current picture. At this time, the first electronic device will display the shooting picture of the physical camera of the first electronic device and the shooting picture of the virtual camera corresponding to the physical camera of the second electronic device. Similarly, for users watching the live broadcast, they can see the shooting picture of the physical camera of the first electronic device on their own electronic devices, and can also see the shooting picture of the virtual camera corresponding to the physical camera of the second electronic device.

[0093] For example, when the anchor is broadcasting live, the user of the first electronic device is the anchor, and the user of the second electronic device is the anchor's assistant. When the anchor starts the live broadcast, he uses the front camera of the physical camera of the first electronic device to take a picture of himself. When the anchor needs to show products to users watching the live broadcast, he can call the rear camera of the virtual camera corresponding to the second electronic device on the first electronic device through the first APP. When the rear camera on the second electronic device is turned on, the assistant can take pictures of the products to be displayed. At this time, users watching the live broadcast can not only see the anchor on their electronic devices, but also see the corresponding products.

[0094] In addition, the assistant can also control the physical camera of the second electronic device on the second electronic device. For example, the virtual camera agent module can generate a UI (for example, a first UI) after detecting a first request from the first electronic device, and display the first UI 401 on the second electronic device. The first UI 401 can be as follows: Figure 4 As shown in (a) of the figure, the assistant can control the physical camera of the second electronic device through the first UI 401. For example, the assistant can set the flash mode of the physical camera of the second electronic device through option 4011, the assistant can set the tone mode of the physical camera through option 4012, the assistant can adjust the resolution of the physical camera through option 4013, and the assistant can set other options of the physical camera through option 4014.

[0095] It should be noted that the options shown in the first UI 401 are only for exemplary purposes. In a specific implementation, the first UI may include more options than those shown in the figure, for example, it may also include a focus option, which is not limited in this embodiment of the present application.

[0096] For example, the assistant adjusts the resolution of the physical camera through option 4013. At this time, the virtual camera agent module detects the request for adjusting the resolution from the first UI (for example, the second request), and the virtual camera agent module calls the camera interface to adjust the resolution of the physical camera based on the second request.

[0097] After executing the first operation corresponding to the second request, the virtual camera proxy module can call the camera interface to display the current picture (for example, the first picture) obtained by the physical camera through the first UI. In this case, the first UI 402 can be as follows: Figure 4 As shown in FIG. 4( b ), the person in the dotted frame 4025 in the first UI 402 is the first picture obtained by the physical camera. Figure 4 The image within the dotted frame 4025 shown in Figure (b) is in non-full screen display mode, and the assistant can set the image within the dotted frame 4026 to full screen display mode through option 4026.

[0098] In addition, the virtual camera proxy module can call the camera interface to send the data information of the first picture obtained by the physical camera after executing the first operation and the parameter information of the physical camera when shooting the first picture to the first APP on the first electronic device. The first APP displays the first picture corresponding to the data information of the first picture to users watching the live broadcast based on the parameter information of the physical camera when shooting the first picture.

[0099] For example, the assistant increases the resolution of the physical camera from 1280×720 to 1920×1080 through option 4023. In this case, the resolution used by the physical camera when shooting the first picture is 1920×1080. After acquiring the first picture, the second electronic device sends the data information of the first picture and the parameter information of the physical camera when shooting the first picture to the first APP on the first electronic device. The first APP displays the first picture corresponding to the data information of the first picture to the user on the first electronic device based on the parameter information of the physical camera when shooting the first picture. Here, the parameter information of the physical camera when shooting the first picture includes resolution, and the value of the resolution is 1920×1080. In other words, the resolution of the first picture displayed to the user by the first electronic device is the resolution used by the physical camera when shooting the first picture, that is, 1920×1080.

[0100] When the anchor performs a certain operation on the virtual camera corresponding to the physical camera of the second electronic device on the UI corresponding to the virtual camera, the virtual camera proxy module detects a third request from the first electronic device, and the virtual camera proxy module calls the camera interface to perform the second operation based on the third request. After that, the virtual camera proxy module can call the camera interface to send the data information of the current picture (for example, the second picture) obtained by the physical camera after performing the second operation and the parameter information of the physical camera when shooting the second picture to the first APP on the first electronic device, so that the first APP can display the second picture corresponding to the data information of the second picture obtained by the physical camera after performing the second operation to users watching the live broadcast based on the parameter information of the physical camera when shooting the second picture.

[0101] For example, the anchor selects the soft option corresponding to the color tone on the UI corresponding to the virtual camera. At this time, the virtual camera proxy module will detect a third request to adjust the color tone of the physical camera to the soft mode. The virtual camera proxy module calls the camera interface to adjust the physical camera to the soft mode based on the third request. After that, the virtual camera proxy module can call the camera interface to send the data information of the second picture obtained by the physical camera after the mode adjustment and the parameter information of the physical camera when shooting the second picture to the first APP on the first electronic device, so that the first APP can display the second picture corresponding to the data information of the second picture on the first electronic device to users watching the live broadcast based on the parameter information of the physical camera when shooting the second picture.

[0102] As can be seen from the previous description, the virtual camera proxy module may detect both the request from the UI corresponding to the virtual camera and the request from the first UI. In the specific implementation, the virtual camera proxy module may first send the request to the control strategy management module, wherein the control strategy management module stores the control strategy. The control strategy management module determines whether the request can be executed on the premise that the control strategy is satisfied. The control strategy management module may notify the virtual camera proxy module of the result, and the virtual camera proxy module determines whether to execute the corresponding request based on the result. For the specific description of the control strategy, please refer to the relevant description in method 300, which will not be repeated here for the sake of brevity.

[0103] Exemplarily, assuming that the control strategy is a sequential priority control strategy, in this case, for all detected requests, the control strategy management module will obtain a result that allows execution, and notify the virtual camera agent module of the result. The virtual camera agent module calls the camera interface to execute the corresponding request. In this case, for the second request and the third request, the virtual camera agent module will call the camera interface to execute them.

[0104] Exemplarily, assuming that the control policy is a local priority control policy, in this case, when the virtual camera agent module detects both the second request and the third request, assuming that there is a conflict between the first operation requested by the second request and the second operation requested by the third request, at this time, the control policy management module refuses to execute the second operation corresponding to the third request based on the local priority control policy, and notifies the virtual camera agent module of the result of the refusal to execute.

[0105] For example, the virtual camera proxy module detects both the second request and the third request. The first operation corresponding to the second request is to set the flash to automatic mode, and the second operation corresponding to the third request is to set the flash to constant mode. In this case, the control strategy management module refuses to execute the third request based on the local priority control strategy. In other words, in this case, the virtual camera proxy module calls the camera to only execute the second request and sets the flash to automatic mode.

[0106] Exemplarily, assuming that the control policy is a peer-priority control policy, in this case, when the virtual camera proxy module detects both the second request and the third request, assuming that there is a conflict between the first operation requested by the second request and the second operation requested by the third request, at this time, the control policy management module refuses to execute the first operation corresponding to the second request based on the peer-priority control policy, and notifies the virtual camera proxy module of the result of the refusal to execute.

[0107] For example, the virtual camera proxy module detects both the second request and the third request. The first operation corresponding to the second request is to turn on the night scene shooting mode, and the second operation corresponding to the third request is to turn on the large aperture shooting mode. In this case, the control strategy management module refuses to execute the second request based on the peer priority control strategy. In other words, in this case, the virtual camera proxy module calls the camera to only execute the third request, that is, to turn on the large aperture shooting mode.

[0108] Exemplarily, the control strategy may be pre-configured in the control strategy management module, or the control strategy may be set by the user through the first UI. For example, the assistant may select an option on the first UI, which represents a certain control strategy. After the assistant makes a selection, the interior of the second electronic device may obtain the control strategy based on the assistant's selection (for example, user input data), and finally the obtained control strategy may be saved in the control strategy management module, so that the control strategy management module may determine whether to allow the request to be executed based on the saved control strategy.

[0109] For example, when the assistant sets the control strategy through the first UI 402, the assistant can select a setting option in the first UI 402. In response to the assistant's operation, the second electronic device displays the following information: Figure 5 The first UI 501 shown in FIG. 5(a) may include a control strategy option 5011. The assistant may select the control strategy option 5011 in the first UI 501. In response to the assistant's operation, the second electronic device displays the following Figure 5 As shown in the first UI 502 in (b) of FIG. 1 , the first UI 502 may include a sequential priority control strategy option 5021, a local priority control strategy option 5022, and a peer priority control strategy option 5023. The first assistant may select one in the first UI 502 as a control strategy. For example, if the assistant selects the sequential priority control strategy option 5021, it means that the assistant has selected the sequential priority control strategy.

[0110] It should be noted that the first UI in the embodiment of the present application can be suspended above any interface and can be dragged at will. For example, the first UI can be suspended on the lock screen interface of the second electronic device or other interfaces after the second electronic device is unlocked.

[0111] It should also be noted that the above description only takes the assistant setting the control strategy as an exemplary description, but this does not constitute a limitation to the embodiments of the present application. In a specific implementation, the host or other users can also complete the setting of the control strategy.

[0112] It should also be noted that the embodiment of the present application does not limit the time when the user sets the control strategy. The user can set the control strategy through the first UI at any time after the first UI is displayed. The control strategy management module saves the control strategy or updates the saved control strategy in real time according to the user's settings.

[0113] It should also be noted that in the embodiments of the present application, the above only uses the virtual camera proxy module and the control strategy management module to perform different functions as an exemplary description, but this does not constitute any limitation to the embodiments of the present application. In specific implementation, the functions performed by the virtual camera proxy module and the control strategy management module can also be implemented by one module, or can be implemented by multiple modules. The embodiments of the present application do not specifically limit this.

[0114] This embodiment can divide the electronic device into functional modules according to the above method example. For example, each functional module can be divided according to each function, or two or more functions can be integrated into one processing module. For example, the above virtual camera agent module and the control strategy management module can be integrated into one processing module. The above integrated modules can be implemented in the form of hardware. It should be noted that the division of modules in this embodiment is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0115] It should be noted that all relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional module and will not be repeated here.

[0116] The electronic device provided in this embodiment is used to execute the above-mentioned method of controlling the camera, so the same effect as the above-mentioned implementation method can be achieved. In the case of an integrated unit, the electronic device may include a processing module, a storage module and a communication module. Among them, the processing module can be used to control and manage the actions of the electronic device, for example, it can be used to support the electronic device to execute the steps performed by the processing unit. The storage module can be used to support the electronic device to store program codes and data, etc. The communication module can be used to support the communication between the electronic device and other devices.

[0117] Among them, the processing module can be a processor or a controller. It can implement or execute various exemplary logic boxes, modules and circuits described in conjunction with the disclosure of this application. The processor can also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of digital signal processing (DSP) and a microprocessor, etc. The storage module can be a memory. The communication module can specifically be a device that interacts with other electronic devices, such as a radio frequency circuit, a Bluetooth chip, a Wi-Fi chip, etc.

[0118] In one embodiment, when the processing module is a processor and the storage module is a memory, the electronic device involved in this embodiment may be a Figure 2 Device of the structure shown.

[0119] This embodiment further provides a computer-readable storage medium, in which computer instructions are stored. When the computer instructions are executed on an electronic device, the electronic device executes the above-mentioned related method steps to implement the method of controlling a camera in the above-mentioned embodiment.

[0120] This embodiment further provides a computer program product. When the computer program product is run on a computer, the computer is enabled to execute the above-mentioned related steps to implement the method for controlling a camera in the above-mentioned embodiment.

[0121] In addition, an embodiment of the present application also provides a device, which may specifically be a chip, a component or a module, and the device may include a connected processor and a memory; wherein the memory is used to store computer-executable instructions, and when the device is running, the processor may execute the computer-executable instructions stored in the memory so that the chip executes the method of controlling the camera in the above-mentioned method embodiments.

[0122] Among them, the electronic device, computer storage medium, computer program product or chip provided in this embodiment is used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method provided above and will not be repeated here.

[0123] Through the description of the above implementation methods, technical personnel in the relevant field can understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0124] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0125] The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0126] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0127] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including several instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to perform all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.

[0128] The above contents are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A method for controlling a camera, characterized in that: The method is performed by a second electronic device, and includes: Detecting a request from the first electronic device to use the physical camera of the second electronic device, starting the physical camera of the second electronic device and displaying a first user interface UI; In response to one or more operations performed by a user on the first UI, adjusting parameter information of the physical camera; Using the physical camera to capture a first picture according to the adjusted parameter information; The first picture is sent to the first electronic device.

2. The method according to claim 1, characterized in that The method further comprises: The first picture is displayed on the first UI, where the first picture is a current picture acquired by the physical camera according to the adjusted parameter information.

3. The method according to claim 1 or 2, characterized in that: The method further comprises: The data information of the first picture and first parameter information are sent to the first electronic device, where the first parameter information is parameter information of the physical camera when shooting the first picture.

4. The method according to claim 1 or 2, characterized in that: The method further comprises: When a third request from the first electronic device is detected, performing a second operation on the physical camera, where the second operation is an operation requested by the third request for the second electronic device to perform; Data information of a second picture is sent to the first electronic device, where the second picture is a current picture acquired by the physical camera after the second operation is performed.

5. The method according to claim 1 or 2, characterized in that: The method further comprises: receiving user input data generated by one or more operations performed by a user on the first UI; A control strategy is obtained according to the user input data.

6. The method according to claim 3, characterized in that The method further comprises: receiving user input data generated by one or more operations performed by a user on the first UI; A control strategy is obtained according to the user input data.

7. The method according to claim 4, characterized in that The method further comprises: receiving user input data generated by one or more operations performed by a user on the first UI; A control strategy is obtained according to the user input data.

8. An electronic device, characterized in that: The electronic device comprises: One or more processors, a memory, and one or more programs, wherein the one or more programs are stored in the memory, and when the one or more programs are executed by the processor, the electronic device executes the method for controlling a camera as described in any one of claims 1 to 7.

9. A computer-readable storage medium, characterized in that: The method comprises computer instructions, and when the computer instructions are executed on an electronic device, the electronic device executes the method for controlling a camera as claimed in any one of claims 1 to 7.

10. A computer program product, characterized in that When the computer program product is executed on an electronic device, the electronic device is enabled to execute the method for controlling a camera according to any one of claims 1 to 7.

Images