A shooting control system

Abstract

The present invention relates to the field of computer vision, and discloses a control method, an electronic device, a computer-readable storage medium, a computer program product, and a chip to solve the technical problem of poor image quality collected by the camera of the electronic device in the prior art. The method comprises: a first electronic device obtains a shooting instruction; according to the shooting instruction, the position information or shooting mode of the content to be shot corresponding to the shooting instruction is determined, and based on the position information or shooting mode of the content to be shot, the camera most suitable for shooting the position of the content to be shot is determined from at least two cameras that can be controlled as the target camera; the at least two cameras include: a camera on the first electronic device and a camera on the second electronic device, and the first electronic device is different from the second electronic device; the first electronic device controls the target camera to execute the shooting instruction to obtain the image data collected by the target camera. The method can be used for artificial intelligence devices.

Description

Technical Field

[0001] The present application relates to the field of Internet of Things, and in particular to a control method, an electronic device, a computer-readable storage medium, and a chip. Background Art

[0002] Currently, the various terminal devices we use, such as mobile phones, tablets, surveillance cameras, TVs, car computers, glasses, etc., can only be controlled individually based on manual selection by the user, or remotely controlled by connecting the mobile phone to the camera or smart home products.

[0003] In the prior art, many electronic devices include cameras, and users can manually select mobile phones, tablets, or surveillance cameras to shoot and collect photos or videos. However, due to the limitations of the angle and distance of the user, there is a technical problem of low photo quality in certain scenarios. Summary of the invention

[0004] The present application provides a control method, an electronic device, a computer-readable storage medium, and a chip for collaborative photography through a camera of a second electronic device to improve the quality of photography.

[0005] In a first aspect, an embodiment of the present invention provides a control method, including:

[0006] The first electronic device obtains a shooting instruction;

[0007] According to the shooting instruction, determine the position information of the content to be shot corresponding to the shooting instruction, and based on the position information of the content to be shot, determine the most suitable camera for shooting the position of the content to be shot from at least two cameras that can be controlled as the target camera; and / or,

[0008] According to the shooting instruction, a shooting mode is determined based on the content to be shot; from at least two cameras that can be controlled, a camera including the shooting mode is determined as a target camera; the at least two cameras include: a camera on the first electronic device and a camera on a second electronic device, the first electronic device is different from the second electronic device;

[0009] The first electronic device controls the target camera to execute the shooting instruction to obtain image data captured by the target camera.

[0010] Optionally, the determining, based on the location information of the content to be photographed, from at least two cameras that can be controlled, a camera that is most suitable for photographing the location of the content to be photographed as a target camera includes:

[0011] Based on the location information of the content to be photographed, a camera whose shooting range covers the location information is determined from at least two cameras that can be controlled by the camera, and if only one camera is determined, the camera is determined to be the target camera;

[0012] or,

[0013] A shooting mode is determined based on the content to be shot; a camera including the shooting mode is determined from at least two cameras that can be controlled, and if only one camera is determined, the camera is determined to be the target camera.

[0014] Optionally, the determining, based on the location information of the content to be photographed, from at least two cameras that can be controlled, a camera that is most suitable for photographing the location of the content to be photographed as a target camera includes:

[0015] Based on the location information of the content to be photographed, from at least two cameras that can be controlled, determine a camera whose shooting range covers the location information; if there are multiple cameras determined, control the multiple cameras to acquire photos, thereby obtaining at least two photos; according to a first preset rule, score the at least two photos, and determine that the camera corresponding to the photo with the highest score is the target camera; or

[0016] A shooting mode is determined based on the content to be shot; a camera that includes the shooting mode is determined from at least two cameras that can be controlled. If there are multiple cameras determined, the multiple cameras are controlled to capture photos, thereby obtaining at least two photos; according to a first preset rule, the at least two photos are scored, and the camera corresponding to the photo with the highest score is determined as the target camera.

[0017] Optionally, the first electronic device controls the target camera to execute the shooting instruction to obtain image data captured by the target camera, including:

[0018] The first electronic device sends a shooting request to the electronic device where the target camera is located, and receives image data sent by the electronic device where the target camera is located; or,

[0019] The first electronic device calls the target camera as a virtual camera of the first electronic device to obtain image data collected by the virtual camera.

[0020] Optionally, the first preset rule includes:

[0021] At least one of a performance parameter of the camera, a distance between the camera and the content to be photographed, and an angle between the camera and the content to be photographed.

[0022] Optionally, before the first electronic device calls the target camera as the virtual camera of the first electronic device, the method further includes: the first electronic device virtualizes the camera of the second electronic device as the virtual camera through its distributed device virtualization module MSDP; the first electronic device calls the target camera as the virtual camera of the first electronic device, and obtaining image data collected by the virtual camera specifically includes:

[0023] The first electronic device calls a CaaS function, and the CaaS function is provided to the first electronic device for calling through a CaaS service;

[0024] The CaaS service queries MSDP whether there is a virtual camera, and when there is a virtual camera, obtains image data collected by the virtual camera through a camera interface.

[0025] In a second aspect, an embodiment of the present invention provides an electronic device, including:

[0026] one or more processors;

[0027] Memory;

[0028] Multiple applications;

[0029] and one or more computer programs, wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions, and when the instructions are executed by the first electronic device, the first electronic device executes the method described in any embodiment of the present invention.

[0030] In a third aspect, an embodiment of the present invention provides an electronic device, including:

[0031] A first obtaining module is used to obtain a shooting instruction;

[0032] A first determination module is used to determine, according to the shooting instruction, the location information of the content to be shot corresponding to the shooting instruction, and based on the location information of the content to be shot, determine the most suitable camera for shooting the location of the content to be shot from at least two cameras that can be controlled by it as the target camera; and / or,

[0033] According to the shooting instruction, a shooting mode is determined based on the content to be shot; from at least two cameras that can be controlled, a camera including the shooting mode is determined as a target camera; the at least two cameras include: a camera on the first electronic device and a camera on the second electronic device, and the first electronic device is different from the second electronic device;

[0034] The control module is used to control the target camera to execute the shooting instruction and obtain the image data collected by the target camera.

[0035] In a fourth aspect, an embodiment of the present invention provides a control method, including:

[0036] The first electronic device obtains a shooting instruction;

[0037] In response to the shooting instruction, the first electronic device controls at least two cameras that it can control to execute the shooting instruction, obtain image data collected by the target camera, and thus obtain at least two photos, the at least two cameras include: a camera on the first electronic device and a camera on a second electronic device, and the first electronic device is different from the second electronic device;

[0038] Calculate the score of each photo according to at least one parameter of the distance between the camera that collects each photo and the photographed object, the angle of the face, and the aesthetic composition parameter;

[0039] The photos meeting the preset scoring value are used as the shooting results of the shooting instruction; and / or, when the shooting instruction is a video acquisition instruction, video acquisition is performed through the camera corresponding to the photos meeting the preset scoring value.

[0040] Optionally, if the photo contains people, the score of the photo can be calculated using the following formula:

[0041] E=αx+βy+γz

[0042] Among them, E represents the rating value of the photo;

[0043] The distance parameter x takes the optimal shooting distance of 50cm in the physical distance as the maximum value, and decreases gradually as it moves farther or closer. α represents the weight value of the distance parameter x, and its value range is [0, 1];

[0044] The angle parameter y has a maximum value when facing the camera, and the deflection gradient decreases toward the three-axis angle. β represents the weight value of the angle parameter y, and its value range is [0, 1];

[0045] The aesthetic composition parameter z takes the maximum score of the aesthetic composition scoring model as its maximum value, and its gradient decreases. γ represents the weight value of the aesthetic composition parameter z, and its value range is [0, 1].

[0046] Optionally, when the photo does not contain the user, the score of the photo can be calculated using the following formula:

[0047] E=αx+γz

[0048] Among them, E represents the rating value of the photo;

[0049] The distance parameter x takes the optimal shooting distance of 50cm in the physical distance as the maximum value, and decreases gradually as it moves farther or closer. α represents the weight value of the distance parameter x, and its value range is [0, 1];

[0050] The aesthetic composition parameter z takes the maximum score of the aesthetic composition scoring model as its maximum value, and its gradient decreases. γ represents the weight value of the aesthetic composition parameter z, and its value range is [0, 1].

[0051] In a fifth aspect, an embodiment of the present invention provides an electronic device, comprising: one or more processors;

[0052] Memory;

[0053] Multiple applications;

[0054] and one or more computer programs, wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions, and when the instructions are executed by the first electronic device, the first electronic device executes the method described in any embodiment of the present invention.

[0055] In a sixth aspect, an embodiment of the present invention provides an electronic device, including:

[0056] An acquisition module is used to obtain a shooting instruction;

[0057] a response module, configured to respond to the shooting instruction, wherein the first electronic device controls at least two cameras that it can control to execute the shooting instruction, obtain image data collected by the target camera, and thereby obtain at least two photos, wherein the at least two cameras include: a camera on the first electronic device and a camera on a second electronic device, and the first electronic device is different from the second electronic device;

[0058] A scoring module, used to calculate the score of each photo according to at least one parameter selected from the distance between the camera that collects each photo and the photographed object, the angle of the face, and the aesthetic composition parameter;

[0059] The determination module is used to use the photos that meet the preset scoring value as the shooting result of the shooting instruction; and / or, when the shooting instruction is a video acquisition instruction, perform video acquisition through the camera corresponding to the photos that meet the preset scoring value.

[0060] In a seventh aspect, an embodiment of the present invention provides a computer-readable storage medium, comprising instructions, characterized in that when the instructions are executed on an electronic device, the electronic device executes the method described in any embodiment of the present invention.

[0061] In an eighth aspect, an embodiment of the present invention provides a computer program product, wherein the computer program product includes software code, and the software code is used to execute the method described in any embodiment of the present invention.

[0062] In a ninth aspect, an embodiment of the present invention provides a chip including instructions, which, when executed on an electronic device, enables the electronic device to execute a method as described in any embodiment of the present invention.

[0063] Because in an embodiment of the present invention, after obtaining a shooting instruction, the first electronic device can, based on the location information of the content to be shot, determine the camera that is most suitable for shooting the location of the content to be shot from at least two cameras that it can control as the target camera, or determine a shooting mode based on the content to be shot, and determine a camera including the shooting mode from at least two cameras that it can control as the target camera, thereby controlling the target camera to execute the shooting instruction, wherein the target camera can be the cameras on at least two electronic devices, so that different cameras can be selected based on the location information of the content to be shot and the shooting mode, and are not limited to the camera of the first electronic device itself, so as to achieve the technical effect of improving the quality of the collected image data. BRIEF DESCRIPTION OF THE DRAWINGS

[0064] Figure 1 is a structural diagram of an electronic device in an embodiment of the present invention;

[0065] Figure 2 A software framework diagram of an electronic device provided by an embodiment of the present invention;

[0066] Figure 3 A framework diagram of a smart home system provided by an embodiment of the present invention;

[0067] Figure 4 A flow chart of a control method provided by an embodiment of the present invention;

[0068] Figure 5 A software framework diagram for virtualizing cameras of other electronic devices as the camera of the electronic device 100 in an embodiment of the present invention;

[0069] Figure 6 This is an interface interaction diagram for processing photos in an embodiment of the present invention;

[0070] Figure 7 A flow chart of a control method provided by an embodiment of the present invention;

[0071] Figure 8 A flow chart of a control method provided by another embodiment of the present invention;

[0072] Fig. 9 A flow chart of a control method provided by another embodiment of the present invention;

[0073] Fig.10 A schematic diagram of photos collected by different cameras in an embodiment of the present invention;

[0074] Fig.11 A flow chart of a control method provided by another embodiment of the present invention. DETAILED DESCRIPTION

[0075] The technical solution in the embodiment of the present application will be described below in conjunction with the drawings in the embodiment of the present application. In the description of the embodiment of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0076] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of the present application, unless otherwise specified, "plurality" means two or more.

[0077] The following describes the application scenarios involved in the embodiments of the present application. The electronic device is equipped with a camera, a microphone, a global positioning system (GPS) chip, various sensors (such as magnetic field sensors, gravity sensors, gyroscope sensors, etc.) and other devices for sensing the external environment, user actions, etc. Based on the perceived external environment and user actions, the electronic device provides the user with a personalized, situational service experience. Among them, the camera can obtain rich and accurate information so that the electronic device can sense the external environment and user actions. The embodiment of the present application provides an electronic device, which can be implemented as any of the following devices containing a camera: a mobile phone, a tablet computer (pad), a portable game console, a personal digital assistant (PDA), a laptop computer, an ultra mobile personal computer (UMPC), a handheld computer, a netbook, a car-mounted media player, a wearable electronic device, a virtual reality (VR) terminal device, an augmented reality (AR) terminal device and other digital display products.

[0078] First, an exemplary electronic device 100 provided in the following embodiments of the present application is introduced.

[0079] Figure 1 A schematic structural diagram of an electronic device 100 is shown.

[0080] The following is a detailed description of the embodiment using the electronic device 100 as an example. It should be understood that: Figure 1 The electronic device 100 shown is only an example, and the electronic device 100 may have more Figure 1 The more or less components shown in the figure can be combined with two or more components, or can have different component configurations. The various components shown in the figure can be implemented in hardware, software, or a combination of hardware and software including one or more signal processing and / or application specific integrated circuits.

[0081] The electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0082] It is understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or arrange the components differently. The illustrated components can be implemented in hardware, software, or a combination of software and hardware. For a detailed structural introduction of the electronic device 100, please refer to the prior patent application: CN201910430270.9.

[0083] Figure 2It is a software structure block diagram of the electronic device 100 of the embodiment of the present application. The layered architecture divides the software into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, namely the application layer, the application framework layer, the Android runtime (Android runtime) and the system library, and the kernel layer. The application layer may include a series of application packages. For a detailed introduction to the software functions, please refer to the prior patent application: CN201910430270.9.

[0084] The embodiment of the present invention provides a control method, which can be used for image shooting and video shooting. The method is applied to an electronic device 100, and the electronic device 100 is used to call the capabilities of other electronic devices associated with it, especially the camera function, so as to realize image acquisition by using the camera function of other electronic devices. Other electronic devices are, for example: electronic devices bound to the same account as the electronic device 100, electronic devices in the same local area network as the electronic device 100, electronic devices belonging to the same user as the electronic device 100, electronic devices belonging to the same family as the electronic device 100 (for example: the user of the electronic device 100 is the mother in the family, then other electronic devices include electronic devices of the mother, father, and children), and electronic devices that can be controlled by other electronic devices 100. The embodiment of the present invention will not be listed in detail and will not be limited. For example: if each electronic device is willing to share functions (for example: camera), it can be registered in the cloud, and the cloud records electronic devices with sharing functions (for example: sharing camera, microphone, display, etc.). When the electronic device 100 needs to shoot, it can send the current location and shooting requirements to the cloud, and the cloud selects a suitable shooting electronic device to provide it to the electronic device 100.

[0085] With the upgrade of smart home and smart life, the future will be an integrated life circle with a terminal such as a mobile phone or cloud as the center, with multiple different terminals (such as tablets, surveillance cameras, TVs, car computers, glasses) working together in a smart way. The electronic device 100 can be an electronic device included in the smart home scene, please refer to Figure 3 The smart home scene includes the following devices: a desktop computer 30 (including a camera, with a camera ID of 30a), a smart TV 31 (including a camera, with a camera ID of 31a), a PAD 32 (including a camera, with a camera ID of 32a), a smart watch 33 (including a camera, with a camera ID of 33a), a mobile phone 34 (including a front camera and a rear camera, with a front camera ID of 34a and a rear camera ID of 34b), and a car 35 (including five cameras, with camera IDs of 35a, 35b, 35c, 35d, and 35e respectively).

[0086] The electronic device 100 is, for example, a mobile phone 34. The smart home scene may also include other devices. The electronic device 100 may also be other devices in the smart home scene, usually electronic devices with relatively strong computing capabilities in the smart home scene. The electronic device 100 may be identified as a master device, and an electronic device whose capabilities (for example, camera, microphone, display, etc.) are registered to the master device (electronic device 100) may be identified as a controlled device. The control method provided in an embodiment of the present invention may also be applied to the cloud. When an electronic device needs to take a photo or a video, for example, after the user generates a shooting instruction, it is sent to the cloud, and the cloud selects the most suitable electronic device for shooting based on the capabilities of each electronic device.

[0087] The following will take the electronic device 100 as an example to introduce a control method. Figure 4 , the method comprises the following steps:

[0088] S400: The electronic device 100 receives a shooting instruction.

[0089] The shooting instruction is, for example, an instruction to take a photo. The shooting instruction may be a voice instruction, an instruction to trigger a photo button of a photo taking application, a preset gesture, and the like. For example, a user of the electronic device 100 may issue a voice instruction to the electronic device 100. The voice instruction may be, for example, "take a photo of me", "take a photo of the car", and the like. The user may issue the voice instruction when the electronic device 100 is in a lock screen state, or may issue the voice instruction after the electronic device 100 is unlocked, and the electronic device 100 may respond to the voice instruction. Alternatively, the user may open the camera application of the electronic device 100 and issue a shooting instruction through the camera application. Alternatively, the user may open an instant messaging application and trigger the shooting instruction by clicking the photo taking button of the instant messaging application, or trigger the shooting instruction by clicking the video communication button of the instant messaging application, and the like. Of course, shooting instructions may also be generated in other ways, which are not listed in detail in the embodiments of the present invention and are not limited thereto. The electronic device 100 is, for example, Figure 3The mobile phone 34 shown. In this embodiment, the user takes a photo through the shooting button of the camera application as an example. In an optional embodiment, the shooting instruction is issued by the user of the electronic device 100, for example: user A picks up the mobile phone 34, and then says "take a photo of the car", then the electronic device 100 directly collects the shooting instruction; for another example: user A picks up the mobile phone 34, opens the vehicle monitoring application, and triggers the remote photography function, then the vehicle monitoring application of the electronic device 100 generates a shooting instruction based on the user operation, etc.; in another optional embodiment, the electronic device 100 receives the shooting instruction sent by other electronic devices, for example: the user sends a voice command to the car navigation system "take a photo of the kitchen for me", and after the car navigation system receives the shooting instruction, it sends it to the electronic device 100, thereby running the shooting instruction based on the powerful computing function of the electronic device 100.

[0090] Alternatively, after detecting the shooting instruction, the vehicle navigation system first determines whether it has the ability to process the shooting instruction. If it has the ability to process the shooting instruction, it processes the shooting instruction itself, otherwise it sends the shooting instruction to the electronic device 100.

[0091] For example, when a vehicle navigation system detects a shooting command, it may determine whether it can respond to the shooting command and obtain the photo or video corresponding to the shooting command. If it can respond, it can be considered that it has the ability to process the shooting command. Otherwise, it is considered that it does not have the ability to process the shooting command.

[0092] S410: The electronic device 100 responds to the shooting instruction and acquires photos through at least two cameras of the electronic device 100 to obtain at least two photos. The at least two cameras of the electronic device 100 include at least one of a physical camera and a virtual camera. The physical camera may be one or more and the virtual camera may also be one or more.

[0093] In an optional implementation, at least two cameras of the electronic device 100 include both physical cameras and virtual cameras, so that the electronic device 100 can respond to shooting instructions simultaneously through its own camera and the cameras of other electronic devices.

[0094] In the specific implementation process, the physical camera of the electronic device 100 is the camera that the electronic device 100 comes with, such as the front camera, rear camera, etc. of the electronic device 100; the virtual camera of the electronic device 100 is the electronic device 100 virtualizing the camera of another electronic device as its own camera. The electronic device 100 can trigger the operation of registering the virtual camera at various times. Two of them are listed below for introduction. Of course, in the specific implementation process, it is not limited to the following two situations. Figure 3Taking the smart home system shown as an example, the mobile phone 34 has two physical cameras (a front camera and a rear camera, the ID of the front camera is: 34a, the ID of the rear camera is: 34b) and 9 virtual cameras (the camera IDs are: 30a, 31a, 32a, 33a, 35a, 35b, 35c, 35d, 35e).

[0095] Before calling the virtual camera function, the electronic device 100 needs to register the data (images or videos) collected by the cameras of other electronic devices as a virtual camera. It can register the cameras of other electronic devices as virtual cameras at various times. Two of them are listed below for introduction. Of course, in the specific implementation process, it is not limited to the following two times.

[0096] The first type is that after the electronic device 100 (as the master device) is powered on (or connected to a router, or the Bluetooth function is turned on), it sends broadcast information through a short-range communication method (for example, Bluetooth, WIFI, etc.), searches for other electronic devices within the communication range, and sends device information to the electronic device 100. The device information includes, for example, device capabilities (camera, microphone, display, etc.), device location, device ID (Identity document), etc. If the electronic device 100 wishes to register the camera of the corresponding electronic device as a virtual camera, it sends a request message to the corresponding electronic device. If the corresponding electronic device agrees to use the camera as the virtual camera of the electronic device 100, the electronic device generates a confirmation message (for example, clicks a preset button, generates a preset voice command, generates a voice gesture, etc.). After receiving the confirmation message, the electronic device 100 performs a virtualization operation of virtualizing the camera of the corresponding electronic device as the local camera. Similarly, the electronic device 100 can also virtualize other capabilities of other electronic devices (for example, microphones, displays, etc.) as local devices.

[0097] After other electronic devices are powered on (or connected to a router), they can also generate broadcast information to search for the master device (electronic device 100). After finding the electronic device 100, the electronic device 100 virtualizes its camera as the camera of the electronic device. Similarly, the electronic device 100 can also virtualize other capabilities of other electronic devices as the capabilities of the electronic device 100.

[0098] Second, after the electronic device 100 is registered on the server through a certain account, it can search for other electronic devices registered with the same account as the electronic device 100, and register the cameras of other electronic devices as the cameras of the electronic device 100, and can also register other capabilities of other electronic devices as capabilities of the electronic device 100; after other electronic devices (controlled devices) are registered on the server through a certain account, they can also search for the master device registered with the same account as the master device, and register their functions to the master device.

[0099] In the specific implementation process, by registering the camera as the virtual camera of the system, the electronic device 100 can call the data collected by the cameras of other electronic devices. For other capabilities of other electronic devices, the electronic device 100 can use a similar method to call.

[0100] Please refer to Figure 5 , the software architecture to implement this solution includes:

[0101] The electronic device 100 can call the CaaS function (for example, CaaS Kit). CaaS (Communications-as-a-Service) refers to encapsulating Internet-based communication capabilities such as messaging, voice, video, conferencing, and communication collaboration into an API (Application Programming Interface) or SDK (Software Development Kit) that is open to the outside world and provided to third parties for calling. The CaaS function includes a lot of content, such as call signaling, media transmission, CaaS services, etc. The CaaS function is provided to the electronic device 100 for calling through the CaaS service. When the triggering conditions are met, the electronic device 100 first informs the MSDP (MSDP MobileSensing development platform) to register the camera of other electronic devices as a virtual camera of the hardware abstraction layer.

[0102] The application framework layer includes: a camera framework, which is used to provide camera functions to the outside world; a camera interface, which is used to obtain data collected by the camera; and MSDP, which is used to register virtual cameras, that is, to virtualize the cameras of other electronic devices into virtual cameras of the hardware abstraction layer.

[0103] The hardware abstraction layer includes cameras (physical cameras and virtual cameras). Through the camera interface, you can access both the physical camera of the electronic device 100 (such as the data of the front camera, the data of the rear camera, etc.) and the virtual camera. The hardware abstraction layer is located at Figure 2 The software system framework shown is between the system library and the kernel layer.

[0104] When the electronic device 100 needs to call the camera function of CaaS, it first registers the CaaS service with the system. The CaaS service queries MSDP whether there is a virtual camera. When there is a virtual camera, the virtual camera video data is obtained through the camera interface. Virtual cameras and physical cameras will have different tags, so the CaaS service can accurately obtain the video data of the virtual camera based on the tag of the virtual camera. Of course, a similar method can be used to provide other capabilities for electronic devices, and the embodiment of the present invention does not limit this.

[0105] When registering the camera of another electronic device as the virtual camera of the electronic device 100, some information of the virtual camera can be recorded, such as: location information, functions (e.g., shooting modes, zoom, resolution, etc.), which electronic device it is located in, etc. In addition, each camera has a camera ID for the electronic device 100 to identify the identity of the camera.

[0106] In the specific implementation process, the electronic device 100 can control all of its cameras to shoot, or can control some of its cameras to shoot. The electronic device can select the target camera from all the cameras it contains in a variety of ways, two of which are listed below for introduction. Of course, in the specific implementation process, it is not limited to the following two situations.

[0107] First, after obtaining the shooting instruction, the electronic device 100 can first determine the location information of the content being photographed corresponding to the shooting instruction, and then determine the camera for shooting based on the location information. For example, the user is worried that the car window is not closed or there is a thief in the car, so he wants to check the situation inside the car, and then generates the following shooting instruction "Check the situation inside the car". After obtaining the shooting instruction, the electronic device 100 first determines that the content being photographed is located in the car through semantic analysis. In this case, the electronic device 100 calls the cameras (physical cameras and virtual cameras) located in the car, that is, cameras 35a, 35b, 35c, 35d, and 35e, and then controls these cameras to capture images.

[0108] For another example: the shooting instruction is "Hi, Xiao E, take a picture of me", and the shooting instruction is received by the electronic device 100, then the electronic device 100 can determine the camera of the electronic device within the preset distance range as the camera currently used for collection. For example: the electronic device 100 can first determine the area where it is located (for example: located in the living room) through the positioning device (or through the collection environment image analysis), and then determine the camera of the electronic device in the area as the camera for collection. For example: the electronic devices currently located in the living room include: PAD32, smart TV 31 (also including the electronic device 100 itself), then the electronic device 100 can determine cameras 32a, 31a, 34a and 34b as cameras for collection.

[0109] After receiving the voice information generated by the user, the electronic device can match the voice information with the preset user voiceprint information to verify the identity of the user who sent the voice information. After the microphone of the electronic device 100 collects the user's voice information, it is transmitted to the CPU or NPU (Neural-network Processing Unit: embedded neural network processor) through the main board for voice recognition and conversion into voice commands that can be recognized by the electronic device 100.

[0110] Alternatively, the electronic device 100 may first obtain the location information of other electronic devices through a positioning device, and then control the camera of an electronic device within a preset distance range from the electronic device as a collection camera. The preset distance is, for example, 10 meters, 20 meters, etc., which is not limited in the embodiments of the present invention.

[0111] Second, the electronic device 100 may determine the content to be photographed in the photographing instruction; determine a photographing mode based on the content to be photographed; and determine a camera including the photographing mode as a collection camera based on the photographing mode.

[0112] For example, if the shooting instruction is a voice instruction, the electronic device 100 can first recognize the voice instruction, and then perform semantic analysis based on the recognized content to determine the content to be shot, such as people, scenery, still life, etc. For example: if the shooting instruction is "take a picture of me", the content to be shot includes people, if the shooting instruction is "take a picture of the bedroom", the content to be shot includes still life, if the shooting instruction is "take a picture of the scenery in front of you", the content to be shot is scenery, etc.

[0113] If the content to be photographed includes "people", the shooting mode of the camera is, for example, portrait mode and large aperture mode; if the content to be photographed is "scenery", the shooting mode of the camera is, for example, landscape mode. If the determined shooting mode is portrait mode, the electronic device 100 can first determine the cameras with portrait mode, and then control these cameras to collect images; if the determined shooting mode is landscape mode, the electronic device 100 can first determine the cameras with landscape mode, and then control these cameras to collect images, and so on. Optionally, when the electronic device 100 controls the camera to take pictures, the shooting instruction can carry the shooting mode, for example: if the content to be photographed corresponding to the shooting instruction includes "people", the shooting mode is portrait mode, and the electronic device receiving the shooting instruction uses the portrait mode to collect photos and sends them to the electronic device 100; if the content to be photographed corresponding to the shooting instruction is landscape, the shooting mode can be landscape mode, and the electronic device receiving the shooting instruction uses the landscape mode to collect photos and sends them to the electronic device 100.

[0114] In addition, if the electronic device that receives the shooting instruction does not have a corresponding shooting mode, the shooting mode closest to the shooting mode is used to take pictures, or the shooting mode most liked by the user of the electronic device 100 is used to take pictures (for example: the default shooting mode, the shooting mode that has been used most times in history, etc.).

[0115] When controlling the camera to shoot, the electronic device 100 may also inform the camera of shooting parameters, such as photo size, exposure, shooting mode, etc.

[0116] S420: The electronic device 100 obtains a score of each of the at least two photos.

[0117] The electronic device 100 can send the at least two photos to the server, and the server will score the at least two photos and return the scores to the electronic device 100; the electronic device 100 can also score the two photos locally. How to obtain the score of each photo will be introduced later.

[0118] Assume that the cameras used for collecting in step S320 are 35a, 35b, 35c, 35d, and 35e, and the scores of the collected photos are as follows:

[0119] As shown in Table 1:

[0120] Camera ID 35a 35b 35c 35d 35e Points 7.1 7.5 8.3 5.7 6.9

[0121] Table 1

[0122] Of course, based on different situations, the scores of the photos collected by each camera are also different, which will not be elaborated here.

[0123] S430: The electronic device 100 determines the photo to be finally provided to the user based on the scores of at least two photos.

[0124] During the specific implementation process, the electronic device 100 can directly provide the photo with the highest score (or the score is ranked at a preset position, or the score is greater than the preset value) to the user, for example, directly provide the photo with a score of 8.3 in Table 1 to the user; the electronic device 100 can also determine the camera of the photo with the highest score (or the score is ranked at a preset position, or the score is greater than the preset value) as the acquisition camera, and re-capture the photos as the photos provided to the user.

[0125] When providing photos to the user, the photos acquired by each camera can be directly provided to the user, or the photos can be processed first, such as: cropping, beautification (such as skin smoothing, beautification, leg slimming, red-eye removal, etc.), splicing, special effects processing (such as: portrait mode, night scene mode, large aperture mode), etc. Among them, the electronic device 100 can send the photos to the server for processing, can be processed locally, or can be sent to other electronic devices for processing. For example, the electronic device 100 hopes to beautify the photos through the beautification software, but the beautification software is not installed on the electronic device 100, and the electronic device 100 inquires that the beautification software is available on the PAD32, then the electronic device 100 can process the photos through the PAD32 and then provide them to the user.

[0126] Alternatively, after providing the photo to the user, when the user wishes to process the photo, the electronic device 100 may prompt the user to use the photo beautification software of other electronic devices to process the photo, for example, Figure 6 As shown, the user of the electronic device 100 clicks the edit button 60 (of course, the edit operation can also be triggered by other methods). After the electronic device 100 responds to the operation, a selection menu 61 is displayed. The selection menu 61 displays multiple editing methods for the user to select an editing method. The editing method can be an editing method available in the electronic device 100, for example: Figure 6 The “local editing” 61a shown may also be an editing method provided by other electronic devices, for example: Figure 6 The “beautifying software 1 is located on the PAD” 61b shown indicates that the photo can be processed by the beautifying software 1 installed on the PAD. Figure 6 The “beautification software 2 is located on the desktop computer” 61c shown indicates that the photo can be processed by the beautification software 2 installed on the desktop computer.

[0127] Among them, when the electronic device 100 detects that the user selects the editing method of other electronic devices to process photos, it can control the corresponding electronic device to open the corresponding application. For example: when the user selects "Meitu software 1 is located in PAD" 61b, the electronic device 100 controls the PAD to control the Meitu software 1 to be in an open state, and synchronously displays the processing interface of the Meitu software 1 on the electronic device 1. By receiving the processing instructions for the photos by the electronic device 100 and sending its processing instructions to PAD32, the photos of the electronic device 100 can be processed by the image processing application of the PAD on the electronic device 100; or, when the electronic device 100 detects that the user selects the editing method of other electronic devices to process photos, the electronic device 100 sends the photos to the corresponding electronic device, controls the corresponding electronic device to open the application, and opens the photos in the application. For example: the electronic device 100 controls the Meitu software 1 of PAD32 to be in an open state, and opens the photos in the Meitu software 1, and then the user completes the processing of the photos on PAD32 and sends them to the electronic device 100.

[0128] In a specific implementation process, after the electronic device 100 respectively acquires photos through at least two cameras of the electronic device 100 based on S410, all photos may be displayed on the display interface of the electronic device 100, and the user may select the most favorite photo.

[0129] In a specific implementation process, after obtaining at least two photos based on S310, the electronic device 100 may stitch the at least two photos together and provide them to the user, so that the user can take photos from multiple angles at the same time.

[0130] In one embodiment, each electronic device in the smart home system can be used as a master device, so that after receiving a shooting instruction, each electronic device can respond to the shooting instruction and execute the above steps. In another embodiment, some electronic devices in the smart home system are master devices, and some electronic devices are controlled devices. After the master device receives the shooting instruction, it directly responds to the shooting instruction and executes the above steps; after the controlled device receives the shooting instruction, it sends the shooting instruction to the master device, so that the master device executes the above steps. Figure 3 Taking the smart home system shown as an example, the mobile phone 34 is the master device and the smart watch is the controlled device. After the mobile phone 34 receives the shooting instruction, it directly responds to the shooting instruction, and after the smart watch receives the shooting instruction, it sends the shooting instruction to the mobile phone 34, which receives the shooting instruction. After the master device acquires the photo, it can store it locally on the master device or send it to the controlled device. Before the master device sends the photo to the controlled device, it can also adjust the display size of the photo to adapt it to the display unit of the controlled device.

[0131] In one embodiment, the electronic device 100 performs the aforementioned steps; in another embodiment, after the electronic device 100 receives the shooting instruction, the electronic device 100 sends the shooting instruction to the server, and the server performs the steps performed by the electronic device 100 in the aforementioned S400-S430.

[0132] Based on the above scheme, it is possible to make photography not limited by current electronic devices, solving the technical problem that the angle and distance selection are not good and the photography effect is poor due to photography only by current electronic devices; it is possible to select the most suitable camera for image acquisition based on the scores of the photos taken by each camera, achieving the technical effect of improving the quality of the collected photos. In addition, in this scheme, the selection is made directly based on the electronic device (or cloud server) without the need for manual selection by the user, thereby improving the efficiency of selection; in addition, in this scheme, when a thin terminal (electronic device with weak processing power) receives a shooting instruction, it can send it to an electronic device with strong processing power for processing, and use the powerful image algorithm capability and shooting mode advantages of the electronic device with strong processing power to assist the thin terminal in improving the shooting effect, thereby achieving the technical effect that the thin terminal can also take high-quality photos.

[0133] In addition, in the above scheme, the electronic device 100 can also use applications installed on other electronic devices to process data on the current electronic device (for example, beautify photos), thereby achieving the function of coordinating the functions of various electronic devices. When the electronic device does not have a certain application installed, the technical effect of the application can also be used.

[0134] Another embodiment of the present invention provides a control method, please refer to Figure 7 , including the following steps:

[0135] S700: The electronic device 100 receives a shooting instruction.

[0136] The shooting instruction is, for example, a video capture instruction. The way in which the shooting instruction is generated is similar to that in S400 and will not be repeated here. The shooting instruction can be used to capture a video, and can also be used to communicate via video with another electronic device. For example: the user of the electronic device 100 generates a voice instruction "Take a moving video for me". In this case, the electronic device 100 shoots a video through the shooting instruction; for another example, the user of the electronic device 100 opens an instant messaging application and turns on the video call function. After the electronic device 100 detects the operation, it starts the camera through the shooting instruction to make a video call with another electronic device.

[0137] S710: The electronic device 100 responds to the shooting instruction and acquires photos through at least two cameras of the electronic device 100 to obtain at least two photos. The at least two cameras of the electronic device 100 include at least one of a physical camera and a virtual camera. The physical camera may be one or more, and the virtual camera may also be one or more. This step is similar to S410 and will not be repeated here.

[0138] S720: The electronic device 100 determines the first camera based on the at least two photos.

[0139] For example, the electronic device 100 can obtain the scores of the at least two photos mentioned above, and then determine the first camera according to the scores of the at least two photos. The specific determination method has been introduced in S420, so it will not be repeated here. The electronic device 100 can also display the photos acquired by each camera on the display unit of the electronic device 100, and prompt the user to select the photo she thinks is the best, and then use the camera corresponding to the photo selected by the user as the first camera. Among them, the first camera can be one camera or multiple cameras. For example, a camera with the best shooting effect (highest score) can be selected as the first camera, or several cameras with different angles and better shooting effects (scores greater than preset values) can be selected as the first camera, so as to capture multiple videos to provide users with videos from different angles, and also give users more choices.

[0140] Optionally, in the above S710, the electronic device 100 may also control each camera to acquire a video, and in S720, the first camera may be determined by the score of the video (taking the average of the scores of each frame of the video) or the video selected by the user.

[0141] S730: The electronic device 100 controls the first camera to capture a video.

[0142] Similarly, after the electronic device 100 controls the first camera to acquire the video, it can directly use it as the shooting result of the shooting instruction, or process it. In addition, the electronic device 100 can also process the video with the help of applications included in other electronic devices, which will not be repeated here.

[0143] When the electronic device 100 controls the first camera to capture video, other cameras may be controlled to be in an on state or an off state, which is not limited in the embodiment of the present invention.

[0144] In one embodiment, after the electronic device 100 determines the first camera, the first camera is always used for video capture during the current shooting process; in another optional embodiment, after the electronic device determines the first camera, if the position of the captured content and at least one of the first camera changes, if the position of the captured content relative to the first camera changes, the camera used for video capture can be re-determined, and a variety of methods can be used to determine it, two of which are listed below for introduction. Of course, in the specific implementation process, it is not limited to the following two situations.

[0145] The first method is to control other cameras to be in the on state at all times, and to obtain photos (or videos) through these cameras at preset time intervals (for example, 10 seconds, 20 seconds, 1 minute, etc.), and to score the photos (or videos) obtained by these electronic devices and the photos (or videos) obtained by the first camera respectively. If the score of the photos obtained by the first camera is still the highest (or still meets the conditions in S420 and S720), the first camera will still be used as the camera for video acquisition; if the score of the photos obtained by other cameras is higher than the score of the photos obtained by the first camera (or it better meets the conditions of S420 and S720 than the first camera), the corresponding electronic device will be set as the new camera for video acquisition.

[0146] Still taking the electronic device 100 controlling the cameras 35a, 35b, 35c, 35d, and 35e to collect images as an example for description, the camera selected by the electronic device 100 in the initial stage is the camera 35a, and assuming that the scores of the collected images are as shown in Table 3:

[0147]

[0148] Table 3

[0149] Since the score of the photo collected by camera 35c is still the highest after 1 minute, camera 35c is still used as the camera for video collection. After 2 minutes, the score of the photo collected by camera 35b is the highest, so camera 35b is used as the camera for video collection, and video data will be collected through camera 35b in the future.

[0150] If the above scheme is used for video acquisition, the video data finally acquired by the electronic device 100 is the video acquired through at least two cameras. If the scheme is used for video calls, at different times, the video received by the other electronic device is the video acquired through different cameras.

[0151] The second method is to control the other cameras except the first camera to stop collecting, and detect the movement of the first camera and the movement of the content being photographed at preset time intervals (for example, 20 seconds, 1 minute, etc.). When the movement of the first camera is greater than the preset movement (for example, 5 meters, 7 meters, etc.), or the movement of the content being photographed is greater than the preset movement, or the relative movement of the content being photographed relative to the first camera is greater than the preset movement, control the other cameras to collect photos, and compare the scores of the photos collected by each camera to determine whether the camera needs to be updated. The determination method has been introduced above, so it will not be repeated here. For example: the user is in the living room at the beginning, and the first camera is the camera 31a of the smart TV 31. When the user walks from the living room to the study, the camera that collects the video is switched from the camera of the smart TV 31 to the camera 30a of the desktop computer 30 in the study.

[0152] In addition, when it is detected that the user moves from the first area (for example, from the living room) to the second area (for example, the bedroom), in addition to switching the camera for shooting, other devices can also be switched, for example, the display unit is switched from the display unit in the first area (for example, the display screen of the smart TV 31) to the display unit in the second area (for example, the desktop computer 30 in the study), so that the content displayed by the display unit before the switching continues to be played through the switched display unit; the microphone is also switched from the microphone in the first area to the microphone in the second area, so that the user's voice continues to be collected through the microphone in the second area. Other components can also be switched, which will not be listed in detail in the embodiment of the present invention, and are not limited.

[0153] The videos acquired through multiple cameras are sent to the electronic device 100, synthesized according to the timestamps, and then sent to the other electronic device or saved locally on the electronic device 100. The electronic device 100 can also optimize the videos acquired by at least two cameras to achieve seamless switching.

[0154] The above video acquisition process can be applied to video calls, video shooting, and other scenarios where video needs to be captured, and the embodiment of the present invention does not limit this. In the specific implementation process, the electronic device 100 can also control multiple cameras to shoot videos (the multiple cameras can be determined based on scores or based on user selection), so that videos of multiple angles of the captured content can be obtained simultaneously.

[0155] Similarly, in the smart home system, all electronic devices can be master devices, or some can be master devices and some can be controlled devices. The aforementioned steps can be executed on the electronic device 100 or on the server.

[0156] In the prior art, if follow-up shooting is required, the user is often required to hold a camera device in the hand to track the movement of the photographed object, which easily causes the handheld camera device to shake, resulting in technical problems such as jitter and blurry photos. Based on the above solution, there is no need to use a handheld camera device to follow the shot. Instead, when the photographed object moves to different positions, the user switches to a different camera device. This solves the technical problem that the user must hold the camera in the hand for follow-up shooting, resulting in low shooting quality.

[0157] Another embodiment of the present invention provides a method for capturing an image. The method can be applied to a server or an electronic device 100. The electronic device 100 is an electronic device included in a smart home scene. For example, the smart home scene is Figure 3 For the smart home scenarios shown, please refer to Figure 8 , the method for capturing the image comprises the following steps:

[0158] S800: The electronic device 100 receives a shooting instruction. As the shooting instruction has been introduced above, it will not be described in detail here.

[0159] S810: The electronic device 100 determines other electronic devices associated with the electronic device 100. In the specific implementation process, the electronic device 100 can determine the electronic devices bound to it in multiple ways, three of which are listed below for introduction. Of course, in the specific implementation process, it is not limited to the following three situations:

[0160] In the first method, the electronic device 100 queries the router to which it is connected for other electronic devices connected to the router, and these electronic devices are electronic devices associated with the electronic device 100.

[0161] The second type is that the electronic device 100 queries the server for electronic devices bound to the same account, and these electronic devices are electronic devices associated with the electronic device 100.

[0162] The third type is that the electronic device 100 sends broadcast information through short-range communication (such as Bluetooth, WIFI direct connection), and other electronic devices generate response information based on the broadcast information. The electronic device 100 regards the electronic device that generates the response information as an electronic device associated with it.

[0163] S820: The electronic device 100 sends a shooting instruction to other electronic devices associated with it; after receiving the shooting instruction, these electronic devices collect photos of the content to be photographed, and then send them to the electronic device 100.

[0164] The electronic device 100 can send a photographing instruction to other electronic devices associated with it remotely, and can also send a photographing instruction to other electronic devices associated with it through a local area network.

[0165] Among them, the electronic device 100 can send a shooting instruction to all electronic devices associated with it, and can also send a shooting instruction to some of the electronic devices associated with it. Some electronic devices can be determined in a variety of ways, and several of them are listed below for introduction. Of course, in the specific implementation process, it is not limited to the following situations.

[0166] First, after obtaining the shooting instruction, the electronic device 100 may first determine the location information of the photographed content corresponding to the shooting instruction, and then determine the electronic device used for shooting based on the location information. For example, if the shooting instruction is "take a photo of the living room for me", then after obtaining the shooting instruction, the electronic device 100 first determines that the photographed object is located in the living room through semantic analysis. In this case, the electronic device 100 first determines the electronic devices located in the living room from the electronic devices 100 bound to it, and then sends the shooting instruction to these electronic devices, thereby acquiring the photo of the living room. For another example, if the shooting instruction is "take a photo of me", the electronic device 100 may first obtain the location information of other electronic devices through the positioning device, and obtain the location information of other electronic devices, and then send the shooting instruction to the electronic devices within a preset distance range from the electronic device 100. The preset distance is, for example, 10 meters, 20 meters, etc., which is not limited in the embodiment of the present invention.

[0167] Second, the electronic device 100 may determine the content to be photographed in the photographing instruction; determine a photographing mode based on the content to be photographed; and determine part of the electronic devices based on the photographing mode.

[0168] For example, if the shooting instruction is a voice instruction, the electronic device 100 can first recognize the voice instruction, and then perform semantic analysis based on the recognized content to determine the content to be shot, such as people, scenery, still life, etc. For example: if the shooting instruction is "take a picture of me", the content to be shot includes people, if the shooting instruction is "take a picture of the bedroom", the content to be shot includes still life, if the shooting instruction is "take a picture of the scenery in front of you", the content to be shot is scenery, etc.

[0169] If the content to be photographed includes "people", the determined shooting mode is, for example, portrait mode and large aperture mode; if the content to be photographed is "landscape", the determined shooting mode is, for example, landscape mode. If the determined shooting mode is portrait mode, the electronic device 100 can query other electronic devices for electronic devices with portrait mode, thereby determining these electronic devices as electronic devices for shooting; if the determined shooting mode is landscape mode, the electronic device 100 can query other electronic devices for electronic devices with landscape mode, thereby determining these electronic devices as electronic devices for shooting, and so on. Alternatively, the electronic device 100 pre-stores the shooting modes of various electronic devices, and directly queries based on the shooting modes of the pre-stored electronic devices, thereby determining the electronic device for shooting.

[0170] Optionally, when the electronic device 100 sends a shooting instruction to the selected electronic device, the shooting instruction may carry a shooting mode, for example: if the content to be shot corresponding to the shooting instruction includes "people", the shooting mode is portrait mode, and the electronic device receiving the shooting instruction uses the portrait mode to acquire photos and sends them to the electronic device 100; if the content to be shot corresponding to the shooting instruction is scenery, the shooting mode may be scenery mode, and the electronic device receiving the shooting instruction uses the scenery mode to acquire photos and sends them to the electronic device 100. When the electronic device receiving the shooting instruction has multiple cameras, it may capture images through some of its cameras or all of its cameras, which is not limited in the embodiment of the present invention.

[0171] In addition, if the electronic device that receives the shooting instruction does not have a corresponding shooting mode, the shooting mode closest to the shooting mode is used to take pictures (for example: the shooting mode is specified as portrait mode in the shooting instruction, but the electronic device that receives the shooting instruction does not have portrait mode, then it can choose a large aperture mode to take pictures), or the shooting mode most liked by the user of the electronic device 100 is used to take pictures (for example: the default shooting mode, the shooting mode that has been used most times in history, etc.).

[0172] S830: After receiving the photos sent by these devices, the electronic device 100 scores these photos and selects the photo with the highest score, and uses the photo as the shooting result of the shooting instruction. If the electronic device 100 itself includes a camera, the electronic device 100 also captures photos through its own camera, and then scores the photo together with the photos captured by other electronic devices to obtain the photo with the highest score. How to determine the score of each photo will be described in detail later.

[0173] After the electronic device 100 determines the photo with the highest score from the photos sent by multiple devices, it can directly output it as the shooting result of the camera application, for example, storing it in the photo album of the electronic device 100, displaying it in the photo preview interface of the photo taking application, etc. The electronic device 100 can also process the finalized photo before outputting it, for example, cropping it to make its size meet the size requirements of the electronic device 100, beautifying it (adjusting hue, saturation, brightness, adding beautifying filters, etc.), adding various special effects, etc.

[0174] Alternatively, if the shooting instruction is sent by other electronic devices (e.g., a car navigation system), after the electronic device 100 obtains the photo, it can send the obtained photo to the car navigation system. Before sending the photo to the car navigation system, the electronic device 100 can also obtain the screen size or screen ratio of the car navigation system, so as to adaptively adjust the photo based on the screen size or screen ratio.

[0175] Alternatively, after acquiring photos, other electronic devices may perform photo beautification processing and add various special effects to the photos before sending them to the electronic device 100, which is not limited in the embodiment of the present invention.

[0176] Alternatively, after determining the photo with the highest score, the electronic device 100 may send it to another electronic device for beautification processing, and the electronic device will beautify the photo and then send it to the electronic device 100. For example: although the mobile phone 38 has powerful computing functions, it does not have a beauty application installed. After determining the photo with the highest score, the electronic device 100 may also confirm whether each other electronic device has a beauty application installed. If an electronic device (for example: PAD32) has a beauty application, the electronic device 100 may send the photo to PAD32 for beauty processing, and then receive the photo after beauty processing by PAD32. Among them, after obtaining the photo with the highest score, the electronic device 100 may inquire whether each bound device has a beauty application installed, or may pre-store inquiries about the functions of each electronic device. After obtaining the photo with the highest score, the electronic device 100 may directly determine the electronic device with the beauty application through the functions of each electronic device.

[0177] In an optional embodiment, after scoring the photos based on S830 and determining the photo with the highest score, the electronic device that took the photo can be controlled to continue taking pictures, and other electronic devices can be controlled to be turned off; alternatively, other electronic devices can be kept on, and this embodiment of the present invention is not limited.

[0178] Another embodiment of the present invention provides a control method, please refer to Fig. 9 ,include:

[0179] S900: The electronic device 100 receives a shooting instruction;

[0180] The shooting instruction is, for example, an instruction for shooting a video. The generation method of the shooting instruction is similar to that in S800 and will not be repeated here.

[0181] S910: The electronic device 100 determines other electronic devices associated with it. This step is similar to S810 and will not be described in detail here.

[0182] S920: The electronic device 100 sends a shooting instruction to other electronic devices associated with it. This step is similar to S920 and will not be repeated here.

[0183] S930: The electronic device 100 receives the photos sent by these devices, then scores these photos, and selects the device that took the photo with the highest score. This step is similar to S930 and will not be described in detail here.

[0184] S940: After determining the electronic device corresponding to the photo with the highest score, the electronic device 100 acquires a video of the current user through the electronic device and sends the video to the peer electronic device of the video communication.

[0185] For example, the user of electronic device 100 opens an instant messaging application to communicate with the opposite user and clicks on a video call button at the same time. After electronic device 100 detects that the user has clicked the video call button, it analyzes that the user of electronic device 100 wishes to take a video of himself and provide it to the opposite electronic device. Electronic device 100 searches for electronic devices within a preset distance range, obtains photos through these electronic devices and its own camera, and then determines the electronic device corresponding to the photo with the highest score as the electronic device used for video communication. The electronic device determined to be used for video communication may be electronic device 100 itself or another electronic device.

[0186] For example: the electronic device 100 determines that the photos collected by the smart TV 31 have the highest score. In this case, the electronic device 100 determines that the smart electronic device 31 is the electronic device used for video communication, so when performing video communication with the other electronic device, the video collected by the smart TV 31 is sent to the other electronic device.

[0187] After the electronic device 100 determines the acquisition device of the photo with the highest score, the acquisition device can be controlled to be turned on, acquire video data, and send the video data to the electronic device 100, and then send it to the peer electronic device through the electronic device 100 to achieve video communication. At the same time, other electronic devices can be controlled to be turned on or off, which is not limited in the embodiment of the present invention.

[0188] In an optional embodiment, after the electronic device determines the acquisition device of the photo with the highest score, the acquisition device is used to acquire the video for video communication during the current video communication process; in another optional embodiment, after the electronic device determines the acquisition device of the photo with the highest score, if the user or the acquisition device moves, other electronic devices can be re-determined as the acquisition device for video communication. Other electronic devices can be determined in a variety of ways, two of which are listed below for introduction. Of course, in the specific implementation process, it is not limited to the following two situations:

[0189] The first method is to control other electronic devices to be always on, and to collect photos through these electronic devices at preset time intervals (for example, 10 seconds, 20 seconds, 1 minute, etc.), and to score the photos collected by these electronic devices and the photos collected by the collection device. If the score of the photos collected by the collection device is still the highest, the device will still be used as the collection device; if the score of the photos collected by other devices is higher than the score of the photos collected by the collection device, the corresponding electronic device will be set as the new collection device.

[0190] The second method is to control other electronic devices except the acquisition device to stop shooting, and detect the movement of the acquisition device and the movement of the photographed object at preset time intervals (for example, 20 seconds, 1 minute, etc.). When the movement of the acquisition device is greater than the preset movement (for example, 5 meters, 7 meters, etc.), or the movement of the photographed object is greater than the preset movement, or the relative movement of the photographed object relative to the acquisition device is greater than the preset movement, control other electronic devices to be in shooting state, collect photos, and compare the scores of the pictures collected by each electronic device. When the score of the photo collected by the acquisition device is still the highest, the device is still used as the acquisition device; when there is a photo collected by other devices with a score higher than the score of the photo collected by the acquisition device, the corresponding electronic device is used as the new acquisition device. For example: when the user walks from the living room to the study, the acquisition device automatically switches from the smart TV 31 in the living room to the desktop computer 30 in the study.

[0191] The video captured by the smart TV 31 and the desktop computer 30 (or other acquisition devices) is sent to the electronic device 100, synthesized according to the timestamp, and then sent to the other electronic device. The video captured by the two video acquisition devices can also be optimized by the electronic device 100 to achieve seamless switching.

[0192] The above-mentioned video acquisition control process can be applied to video calls, video shooting, and other scenarios that require video acquisition, which is not limited in the embodiment of the present invention.

[0193] Here's how to score photos taken with various electronic devices.

[0194] First, when the photo contains people, the score of the photo can be calculated by the following formula:

[0195] E=αx+βy+γz………………………………………………………………(1)

[0196] Among them, E represents the score of the photo;

[0197] The distance parameter (x) takes the optimal shooting distance of 50cm in the physical distance as the maximum value, and decreases gradually as it moves farther or closer. α represents the weight value of the distance parameter (x), and its value range is [0, 1];

[0198] The angle parameter (y) takes the maximum value when facing the camera, and the deflection gradient decreases toward the three-axis angle. β represents the weight value of the angle parameter (y), and its value range is [0, 1].

[0199] The aesthetic composition parameter (z) takes the maximum score of the aesthetic composition scoring model as its maximum value, and its gradient decreases. γ represents the weight value of the aesthetic composition parameter (z), and its value range is [0, 1].

[0200] According to the differences in the objects being photographed, different weight coefficients can also be given to the three factors. For example, in the scene mode of photographing people, a slightly higher weight is given to the angle parameter, such as β=0.5, γ=0.3, α=0.2; in the scene of photographing objects, more emphasis is placed on the clarity of the shooting, and a higher weight is given to the distance parameter, such as α=0.4, β=0.3, γ=0.3. Of course, the weight values ​​can also use other values, which are not limited by the embodiments of the present invention.

[0201] The distance between each electronic device and the photographed object can be calculated by computer vision technology. For example, when the electronic device includes a binocular camera, the distance between the electronic device and the photographed object can be determined by the visual difference between the two cameras when photographing the photographed object; or, when the photographed object is the current user, the current user can be positioned by the current user's handheld electronic device, and other electronic devices can be positioned by the positioning devices of other electronic devices, and the distance between the electronic device and the photographed object can be determined based on the positioning, etc. In addition, the distance of other electronic devices relative to the electronic device 100 can also be obtained based on Bluetooth indoor positioning, wireless WIFI positioning or infrared optical positioning technology.

[0202] The key points of the face can be detected by using the facial key point detection technology (for example, the Harris corner point detection algorithm). After the key points of the face are detected, the angles of the three axes of the face are estimated based on the key points of the face through the posture estimation algorithm. The angle parameter within the user's front face range (for example, the pitch angle, yaw angle, and roll angle are all within -30° to 30°) is the maximum value.

[0203] Aesthetic composition (z) can be calculated by an aesthetic quality assessment algorithm, which usually includes two stages: 1. Feature extraction stage, in which features can be manually designed, for example, the clear contrast, brightness contrast, color simplicity, harmony, and compliance with the rule of thirds of the image can be manually marked to mark the features of the photo; or, the image aesthetic features can be automatically extracted by a deep convolutional neural network; 2. Decision stage, the decision stage refers to training the extracted image aesthetic features into a classifier or regression model to classify and regress the image. The trained model can distinguish images into high aesthetic quality images and low aesthetic quality images, and can also give the image an aesthetic quality score. Commonly used methods include naive Bayes classifiers, support vector machines, and deep classifiers, etc. Among them, an aesthetic scoring system can be set locally on the electronic device 100, and an aesthetic evaluation algorithm can be built into the aesthetic scoring system, or an aesthetic evaluation algorithm can be set on the server, which is not limited by the embodiments of the present invention.

[0204] like Fig.10 As shown in the figure, the scores of each photo after the photos are acquired by different cameras based on the above formula (1) are obtained. Fig.10 It can be seen that the scores of photos containing frontal faces are higher than those of photos not containing frontal faces, and when both contain frontal faces, the scores of photos closer to the camera are higher.

[0205] If the shooting instruction of the electronic device 100 includes the word "person", the electronic device 100 can determine whether the photos captured by each camera include the word "person" through posture recognition. If so, the photos can be scored based on the above formula (1); if not, the photos can be directly discarded without scoring. Alternatively, the electronic device 100 can determine whether the photos captured by each camera include the front face of the word "person" through face recognition. If so, the photos can be scored based on the above formula (1); if not, the photos can be directly discarded without scoring.

[0206] Second, when the photo does not contain the user, the score of the photo can be calculated using the following formula:

[0207] E=αx+γz………………………………………………………………(2)

[0208] Among them, E, α, x, γ, and z have been introduced in the above formula (1), so they will not be repeated here.

[0209] The electronic device 100 may select any of the above methods by default to calculate the score of the photo. In another embodiment, the electronic device 100 may also select different calculation methods based on different photographed objects. For example, if the photographed object includes a person, the photo score is calculated using formula (1); if the photographed object does not include a person, the photo score is calculated using formula (2).

[0210] For other contents, please refer to the description of the relevant contents above and will not be repeated here.

[0211] In the specific implementation process, the photos can also be scored separately based on the above parameters, for example: separate scoring based on distance, separate scoring based on angle, separate scoring based on aesthetic composition, etc.

[0212] Another embodiment of the present invention also provides a control method, please refer to Fig.11 , including the following steps:

[0213] S1100: the electronic device 100 receives a shooting instruction, which is similar to the shooting instruction described above and will not be described in detail herein;

[0214] S1110: The electronic device 100 responds to the shooting instruction and determines a first camera from at least two cameras. The at least two cameras include a physical camera of the electronic device 100 itself and cameras of other electronic devices. The physical camera of the electronic device 100 itself can be one or more, and the cameras of other electronic devices can be one or more.

[0215] In the specific implementation process, the electronic device 100 can determine the first camera in a variety of ways, for example: ① determine the location information of the content to be photographed corresponding to the shooting instruction, and then determine the camera for shooting based on the location information. ② determine the shooting mode based on the content to be photographed; based on the shooting mode, determine the camera containing the shooting mode as the first camera. As the specific determination method has been introduced above, it will not be repeated here.

[0216] S1120: Acquire data corresponding to the shooting instruction through the first camera, where the data may be video data or image data.

[0217] In one embodiment, in the initial stage, the cameras of other electronic devices (including the first camera) can be registered with the virtual camera of the electronic device 100, so that in step S1220, the data corresponding to the shooting instruction can be obtained by calling the virtual camera corresponding to the first camera; in another embodiment, the electronic device 100 can send a shooting instruction to the electronic device corresponding to the first camera, and the electronic device of the first camera responds to the shooting instruction to collect the data and return it to the electronic device 100.

[0218] In the specific implementation process, in addition to using cameras in coordination, multiple electronic devices can also use other functions in coordination, such as microphones, display screens, input devices, application software, etc. For example, after receiving audio data, an electronic device cannot play the audio data because the microphone of the electronic device is damaged or has no microphone. In this case, a microphone within a preset distance range can be selected for playback. For another example, when it is detected that the user selects the editing mode or browsing mode of a file, not only can the editing mode or browsing mode of the local device be prompted, but also the editing mode or browsing mode of other electronic devices associated with it can be provided.

[0219] In the control method described in the embodiment of the present invention, the first electronic device may also utilize other functions of other electronic devices, such as utilizing software (e.g., reading software, video playback software, video processing software, etc.) and hardware (e.g., display, microphone, etc.) of the second electronic device. When utilizing other functions of other electronic devices, the other electronic devices (or corresponding hardware) are determined in a manner similar to that of determining a camera.

[0220] For example, a user of the first electronic device wants to play a video and receives a shooting command; the first electronic device responds to the shooting command, determines that the current location is the living room, detects that the living room contains a smart TV (the second electronic device), and then projects the video content to the smart TV for playback. When determining the second electronic device, the first electronic device can consider the distance, angle, and size of the display of the first and second electronic devices and the user, and comprehensively determine whether to use the display of the first or second electronic device.

[0221] Based on the same inventive concept, another embodiment of the present invention provides a control method, including:

[0222] The first electronic device obtains a shooting instruction;

[0223] According to the shooting instruction, determine the position information of the content to be shot corresponding to the shooting instruction, and based on the position information of the content to be shot, determine the most suitable camera for shooting the position of the content to be shot from at least two cameras that can be controlled as the target camera; and / or,

[0224] According to the shooting instruction, a shooting mode is determined based on the content to be shot; from at least two cameras that can be controlled, a camera including the shooting mode is determined as a target camera; the at least two cameras include: a camera on the first electronic device and a camera on the second electronic device, and the first electronic device is different from the second electronic device;

[0225] The first electronic device controls the target camera to execute the shooting instruction to obtain image data captured by the target camera.

[0226] Optionally, the determining, based on the location information of the content to be photographed, from at least two cameras that can be controlled, a camera that is most suitable for photographing the location of the content to be photographed as a target camera includes:

[0227] Based on the location information of the content to be photographed, a camera whose shooting range covers the location information is determined from at least two cameras that can be controlled by the camera, and if only one camera is determined, the camera is determined to be the target camera;

[0228] or,

[0229] A shooting mode is determined based on the content to be shot; a camera including the shooting mode is determined from at least two cameras that can be controlled, and if only one camera is determined, the camera is determined to be the target camera.

[0230] Optionally, the determining, based on the location information of the content to be photographed, from at least two cameras that can be controlled, a camera that is most suitable for photographing the location of the content to be photographed as a target camera includes:

[0231] Based on the location information of the content to be photographed, from at least two cameras that can be controlled, determine a camera whose shooting range covers the location information; if there are multiple cameras determined, control the multiple cameras to acquire photos, thereby obtaining at least two photos; according to a first preset rule, score the at least two photos, and determine that the camera corresponding to the photo with the highest score is the target camera; or

[0232] A shooting mode is determined based on the content to be shot; a camera that includes the shooting mode is determined from at least two cameras that can be controlled. If there are multiple cameras determined, the multiple cameras are controlled to capture photos, thereby obtaining at least two photos; according to a first preset rule, the at least two photos are scored, and the camera corresponding to the photo with the highest score is determined as the target camera.

[0233] Optionally, the first electronic device controls the target camera to execute the shooting instruction to obtain image data captured by the target camera, including:

[0234] The first electronic device sends a shooting request to the electronic device where the target camera is located, and receives image data sent by the electronic device where the target camera is located; or,

[0235] The first electronic device calls the target camera as a virtual camera of the first electronic device to obtain image data collected by the virtual camera.

[0236] Optionally, the first preset rule includes:

[0237] At least one of a performance parameter of the camera, a distance between the camera and the content to be photographed, and an angle between the camera and the content to be photographed.

[0238] Optionally, the software architecture of the first electronic device includes: an application framework layer, including: a camera framework, used to provide camera functions to the outside world; a camera interface, used to obtain data collected by the camera, the camera includes a physical camera and a virtual camera; MSDP is used to virtualize the camera of other electronic devices into a virtual camera of the hardware abstraction layer; the hardware abstraction layer includes a camera, the camera includes a physical camera and a virtual camera, the physical camera and the virtual camera have different tags, and the first electronic device calls the target camera as the virtual camera of the first electronic device, including:

[0239] Preliminarily virtualizing the target camera as a virtual camera of the first electronic device;

[0240] The first electronic device calls a CaaS function, and the CaaS function is provided to the first electronic device for calling through a CaaS service;

[0241] When the trigger condition is met, the first electronic device notifies the MSDP distributed device virtualization to register the camera of the other electronic device as a virtual camera of the hardware abstraction layer;

[0242] When the first electronic device needs to call the camera function of CaaS, it first registers the CaaS service with the system. The CaaS service queries MSDP whether there is a virtual camera. When a virtual camera exists, the virtual camera video data is obtained through the camera interface.

[0243] Based on the same inventive concept, another embodiment of the present invention provides an electronic device, including:

[0244] one or more processors;

[0245] Memory;

[0246] Multiple applications;

[0247] and one or more computer programs, wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions, and when the instructions are executed by the first electronic device, the first electronic device executes the method as described in any one of claims 1-7.

[0248] Based on the same inventive concept, another embodiment of the present invention provides an electronic device, including:

[0249] A first obtaining module is used to obtain a shooting instruction;

[0250] A first determination module is used to determine, according to the shooting instruction, the location information of the content to be shot corresponding to the shooting instruction, and based on the location information of the content to be shot, determine the most suitable camera for shooting the location of the content to be shot from at least two cameras that can be controlled by it as the target camera; and / or,

[0251] According to the shooting instruction, a shooting mode is determined based on the content to be shot; from at least two cameras that can be controlled, a camera including the shooting mode is determined as a target camera; the at least two cameras include: a camera on the first electronic device and a camera on the second electronic device, and the first electronic device is different from the second electronic device;

[0252] The control module is used to control the target camera to execute the shooting instruction and obtain the image data collected by the target camera.

[0253] Optionally, the first determining module includes:

[0254] A first determining unit is used to determine, based on the location information of the content to be photographed, a camera whose shooting range covers the location information from at least two cameras that can be controlled by the first determining unit, and if there is only one camera determined, determine the camera as a target camera;

[0255] or,

[0256] The second determination unit is used to determine the shooting mode based on the content to be shot; the third determination unit is used to determine the camera that includes the shooting mode from at least two cameras that it can control. If there is only one camera determined, the camera is determined to be the target camera.

[0257] Optionally, the first determining module includes:

[0258] A fourth determination unit includes: based on the location information of the content to be photographed, determining a camera whose shooting range covers the location information from at least two cameras that can be controlled by the camera, and if there are multiple cameras determined, controlling the multiple cameras to acquire photos, thereby obtaining at least two photos; a fifth determination unit includes: scoring the at least two photos according to the first preset rule, and determining that the camera corresponding to the photo with the highest score is the target camera; or

[0259] The sixth determination unit includes: determining a shooting mode based on the content to be photographed; the seventh determination unit includes: determining a camera including the shooting mode from at least two cameras that it can control, and if there are multiple cameras determined, controlling the multiple cameras to capture photos, thereby obtaining at least two photos; the eighth determination unit is used to score the at least two photos according to the first preset rule, and determine that the camera corresponding to the photo with the highest score is the target camera.

[0260] Optionally, the control module is used to:

[0261] The first electronic device sends a shooting request to the electronic device where the target camera is located, and receives image data sent by the electronic device where the target camera is located; or,

[0262] The first electronic device calls the target camera as a virtual camera of the first electronic device to obtain image data collected by the virtual camera.

[0263] Optionally, the first preset rule includes: at least one of: a performance parameter of a camera, a distance between the camera and the content to be photographed, and an angle between the camera and the content to be photographed.

[0264] Optionally, the control module includes:

[0265] The software architecture of the first electronic device includes: an application framework layer, including: a camera framework, which is used to provide camera functions to the outside world; a camera interface, which is used to obtain data collected by the camera, and the camera includes a physical camera and a virtual camera; MSDP is used to virtualize the camera of other electronic devices into a virtual camera of the hardware abstraction layer; the hardware abstraction layer includes a camera, and the camera includes a physical camera and a virtual camera, and the physical camera and the virtual camera have different tags; the control module includes:

[0266] Virtual single use, used to virtualize the target camera as a virtual camera of the first electronic device in advance;

[0267] A calling unit, configured to call a CaaS function, wherein the CaaS function is provided to the first electronic device for calling via a CaaS service;

[0268] A trigger unit, used to notify the MSDP distributed device virtualization to register the camera of other electronic devices as a virtual camera of the hardware abstraction layer when a trigger condition is met;

[0269] The acquisition unit is used to register the CaaS service with the system when the camera function of CaaS needs to be called. The CaaS service queries MSDP whether there is a virtual camera. When a virtual camera exists, the video data of the virtual camera is obtained through the camera interface.

[0270] Based on the same inventive concept, another embodiment of the present invention provides a control method, including:

[0271] The first electronic device obtains a shooting instruction;

[0272] In response to the shooting instruction, the first electronic device controls at least two cameras that it can control to execute the shooting instruction, obtain image data captured by the target camera, and thus obtain at least two photos;

[0273] The first electronic device determines a shooting result of the shooting instruction according to a preset second rule and the at least two photos.

[0274] Optionally, the first electronic device determines the shooting result according to a preset second rule and the at least two photos, including:

[0275] Scoring is performed based on at least one of the performance parameters of the camera, the distance between the camera and the photographed object, and the angle between the camera and the photographed object;

[0276] The photos meeting the preset scoring value are taken as the shooting results of the shooting instruction.

[0277] Optionally, the first electronic device determines the shooting result according to a preset second rule and the at least two photos, including:

[0278] The first electronic device stitches the at least two photos together as a shooting result of the shooting instruction; or,

[0279] The at least two photos are outputted, and in response to a selection operation of the user, the photo selected by the user is used as a shooting result of the shooting instruction.

[0280] Based on the same inventive concept, another embodiment of the present invention provides an electronic device, including:

[0281] one or more processors;

[0282] Memory;

[0283] Multiple applications;

[0284] and one or more computer programs, wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions, and when the instructions are executed by the first electronic device, the first electronic device executes the method introduced in any embodiment of the present invention.

[0285] Based on the same inventive concept, another embodiment of the present invention provides an electronic device, including:

[0286] The second acquisition module is used to obtain a shooting instruction;

[0287] A response module, used to respond to the shooting instruction, control at least two cameras that it can control to execute the shooting instruction, obtain image data collected by the target camera, and thus obtain at least two photos;

[0288] The second determining module is used to determine the shooting result of the shooting instruction according to a preset second rule and the at least two photos.

[0289] Optionally, the second determining module includes:

[0290] A scoring unit, scoring according to at least one parameter of a performance parameter of the camera, a distance between the camera and the photographed object, and an angle between the camera and the photographed object;

[0291] The ninth determining unit is used to use the photos that meet the preset scoring value as the shooting results of the shooting instruction.

[0292] Optionally, the second determining module is used to:

[0293] The first electronic device stitches the at least two photos together as a shooting result of the shooting instruction; or,

[0294] The at least two photos are outputted, and in response to a selection operation of the user, the photo selected by the user is used as a shooting result of the shooting instruction.

[0295] Based on the same inventive concept, another embodiment of the present invention provides a computer-readable storage medium, including instructions, which, when executed on an electronic device, enable the electronic device to execute the method described in any embodiment of the present invention.

[0296] Based on the same inventive concept, another embodiment of the present invention provides a computer program product, wherein the computer program product includes software codes, and the software codes are used to execute the method described in any embodiment of the present invention.

[0297] Based on the same inventive concept, another embodiment of the present invention provides a chip including instructions, and when the chip runs on an electronic device, the electronic device executes the method described in any embodiment of the present invention.

[0298] It is understandable that, in order to realize the above functions, the above-mentioned electronic devices, etc. include hardware structures and / or software modules corresponding to the execution of each function. Those skilled in the art should easily realize that, in combination with the units and algorithm steps of each example described in the embodiments disclosed herein, the embodiments of the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the embodiments of the present invention.

[0299] The embodiment of the present application can divide the functional modules of the above-mentioned electronic device etc. according to the above-mentioned method example. For example, each functional module can be divided corresponding to each function, or two or more functions can be integrated into one processing module. The above-mentioned integrated module can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of modules in the embodiment of the present invention is schematic and is only a logical functional division. There may be other division methods in actual implementation. The following is an example of dividing each functional module corresponding to each function:

[0300] In the method provided in the embodiment of the present application, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in accordance with the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, a network device, an electronic device or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from a website site, a computer, a server or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (digital subscriber line, DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or a data center that includes one or more available media integrated. The available medium may be a magnetic medium (eg, a floppy disk, a hard disk, a magnetic tape), an optical medium (eg, a digital video disc (DVD)), or a semiconductor medium (eg, an SSD), etc.

[0301] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0302] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0303] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0304] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0305] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0306] The above are only specific implementation methods of the present application, but the protection scope of the embodiments of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or replacements within the technical scope disclosed in the embodiments of the present application, which should be included in the protection scope of the embodiments of the present application. Therefore, the protection scope of the embodiments of the present application shall be based on the protection scope of the claims.

Claims

1. A shooting control system, characterized in that: The system includes a first electronic device and a second electronic device, wherein the first electronic device includes a first camera and a second camera, and the second electronic device includes a third camera, wherein: The first electronic device receives a shooting instruction; In response to the shooting instruction, the first electronic device captures images through at least two cameras, where the at least two cameras include the first camera, the second camera, and the third camera; The first electronic device displays, in a first interface of a camera application, an image captured by the first camera, an image captured by the second camera, and an image captured by the third camera; The first electronic device receives a first operation input by a user on the first interface, where the first operation includes the user selecting among images captured by the first camera, images captured by the second camera, and images captured by the third camera; The first electronic device determines, based on the first operation, to use the first camera and the third camera to capture video simultaneously; Before the first electronic device collects images through at least two cameras, the method further includes: The first electronic device finds the second electronic device within the communication range by means of short-range communication; The first electronic device sends a first request to the second electronic device; In response to the first request, the second electronic device sends confirmation information to the first electronic device; In response to the confirmation information, the first electronic device registers the third camera as a local camera.

2. The system according to claim 1, characterized in that The first operation includes selecting an image captured by the first camera in the first interface.

3. The system according to claim 2, characterized in that The first operation also includes selecting an image captured by the third camera in the first interface.

4. The system according to claim 1, characterized in that The second electronic device sending confirmation information to the first electronic device includes: When it is detected that the user clicks the preset button, the second electronic device sends the confirmation information to the first electronic device.

5. The system according to claim 1, wherein: The image captured by the first camera, the image captured by the second camera, and the image captured by the third camera are displayed in the first interface in a spliced ​​form.

6. The system according to claim 1, wherein: The image captured by the first camera, the image captured by the second camera, and the image captured by the third camera are displayed on the first interface at the same time.

7. The system according to claim 1, characterized in that After the first electronic device determines to use the first camera and the third camera to capture video, the first electronic device is further configured to perform the following steps: Using the first camera and the third camera to capture video at the same time; The captured video is saved in the first electronic device.

8. The system according to claim 7, characterized in that Before the first electronic device saves the captured video to the first electronic device, the first electronic device is further configured to perform the following steps: The image captured by the first camera and the image captured by the second camera are synthesized.

9. The system according to claim 8, characterized in that In the video captured by the first camera and the third camera, the image captured by the first camera and the image captured by the second camera are spliced.

10. The system according to claim 7, characterized in that The first electronic device uses the first camera and the third camera to collect video simultaneously, including: In response to the received shooting instruction, the first electronic device simultaneously uses the first camera and the third camera to capture video.

11. The system according to claim 1, characterized in that The first electronic device is a mobile phone, the first camera is a front camera of the first electronic device, and the second camera is a rear camera of the first electronic device; The second electronic device is a mobile phone, and the third camera is a front camera or a rear camera of the second electronic device.

12. The system of claim 1, wherein: The first electronic device searches for the second electronic device within a communication range by means of short-range communication, including: The first electronic device searches for the second electronic device within the communication range through the Wi-Fi function and / or the Bluetooth function.

13. The system of claim 1, wherein: After the first electronic device determines to use the first camera and the third camera to capture video, the first electronic device is further configured to perform the following steps: Turn off the second camera.

14. The system of claim 1, wherein: After the first electronic device collects images through at least two cameras, the method further includes: When the captured image contains a person, the first electronic device calculates the score value of the captured image by the following formula (1): When the captured image does not contain a person, the first electronic device calculates the score value of the captured image by using the following formula (2); Wherein, the formula (1) is: E=αx+βy+γz; the formula (2) is: E=αx+γz; E represents the rating value; The distance parameter x takes the optimal shooting distance of 50cm in the physical distance as the maximum value, and decreases gradually as it moves farther or closer. α represents the weight value of the distance parameter x, and its value range is [0, 1]; The angle parameter y has a maximum value when facing the camera, and the deflection gradient decreases toward the three-axis angle. β represents the weight value of the angle parameter y, and its value range is [0, 1]; The aesthetic composition parameter z takes the maximum score of the aesthetic composition scoring model as its maximum value, and its gradient decreases. γ represents the weight value of the aesthetic composition parameter z, and its value range is [0, 1].

Images