Photographing method and apparatus therefor

Abstract

The application discloses a photographing method and device, and belongs to the technical field of communication. The method comprises the following steps: in a photographing mode, a first electronic device estimates a first relative spatial position between the first electronic device and M second electronic devices, wherein M is a positive integer; the first electronic device acquires M+1 first images, wherein the M+1 first images comprise an image collected by the first electronic device and images collected by the M second electronic devices; and the first electronic device synthesizes the M+1 first images based on the first relative spatial position to obtain a second image, wherein all shooting subjects in the M+1 first images are included in the second image.

Description

TECHNICAL FIELD

[0001] The present application belongs to the technical field of communication, and particularly relates to a photographing method and device thereof. BACKGROUND

[0002] Nowadays, most of the electronic devices such as smart phones, tablet computers, e-book readers have the function of taking photos, which is used to record the beautiful moments in daily life. When a group photo needs to be taken, the field of view of the group photo is usually improved by physical methods (such as taking a photo from a distance by one user or taking a photo by means of a selfie stick), and the best shooting moment is constantly tried.

[0003] However, when a photo is taken from a distance by one user, the photo usually does not include the user himself if no other user helps; when a photo is taken by means of a selfie stick, due to the limitation of the front camera module of the electronic device, the proportion of the face in the close-up and the face in the distance is easily out of balance, and the face at the edge of the field of view is severely distorted. Therefore, the existing photographing method leads to poor image quality of the group photo. SUMMARY

[0004] The purpose of the embodiments of the present application is to provide a photographing method and device, which can solve the problem of poor image quality of the group photo caused by the existing photographing method.

[0005] In a first aspect, the embodiments of the present application provide a photographing method, which comprises: in a group shooting mode, a first electronic device estimates a first relative spatial position between the first electronic device and M second electronic devices, M being a positive integer; the first electronic device acquires M+1 first images, the M+1 first images comprising: an image collected by the first electronic device, images collected by the M second electronic devices; the first electronic device synthesizes the M+1 first images based on the first relative spatial position to obtain a second image; wherein the second image includes all the shooting subjects in the M+1 first images.

[0006] In a second aspect, the embodiments of the present application provide a photographing device, which comprises: an estimation module, an acquisition module and a synthesis module; the estimation module is configured to estimate a first relative spatial position between a first electronic device and M second electronic devices in a group shooting mode, M being a positive integer; the acquisition module is configured to acquire M+1 first images, the M+1 first images comprising: an image collected by the first electronic device, images collected by the M second electronic devices; the synthesis module is configured to synthesize the M+1 first images based on the first relative spatial position estimated by the estimation module to obtain a second image; wherein the second image includes all the shooting subjects in the M+1 first images.

[0007] In a third aspect, an electronic device is provided, which includes a processor and a memory. The memory stores programs or instructions executable on the processor. The programs or instructions, when executed by the processor, implement the steps of the method according to the first aspect.

[0008] In a fourth aspect, a readable storage medium is provided, which stores programs or instructions. The programs or instructions, when executed by a processor, implement the steps of the method according to the first aspect.

[0009] In a fifth aspect, a chip is provided, which includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is configured to execute programs or instructions to implement the method according to the first aspect.

[0010] In a sixth aspect, a computer program product is provided, which is stored in a storage medium. The computer program product is executed by at least one processor to implement the method according to the first aspect.

[0011] In the embodiments of the present application, in the shooting mode, the first electronic device estimates a first relative spatial position between the first electronic device and M second electronic devices, M being a positive integer; the first electronic device acquires M+1 first images, the M+1 first images including an image collected by the first electronic device and images collected by the M second electronic devices; and the first electronic device synthesizes the M+1 first images based on the first relative spatial position to obtain a second image, wherein the second image includes all shooting subjects in the M+1 first images. Through the scheme, when shooting is needed, the M+1 first images collected by the M+1 shooting devices (including the first electronic device and the M second electronic devices) can be synthesized based on the relative spatial position between the M+1 shooting devices to obtain a second image including all shooting subjects in the M+1 first images. It can be seen that each shooting subject in the second image is collected by different shooting devices, so that it can be ensured that each shooting subject in the second image is clear and without distortion, and thus the image quality of the shot image can be improved. BRIEF DESCRIPTION OF DRAWINGS

[0012] Figure 1 is a flowchart of a shooting method provided by the embodiments of the present application;

[0013] Figure 2 is one of example schematic diagrams of a shooting method provided by the embodiments of the present application;

[0014] Figure 3 is another of example schematic diagrams of a shooting method provided by the embodiments of the present application;

[0015] Figure 4is an example schematic diagram of a photographing method provided by an embodiment of the present application;

[0016] Figure 5 is a structural schematic diagram of a photographing device provided by an embodiment of the present application;

[0017] Figure 6 is a hardware structural schematic diagram of an electronic device provided by an embodiment of the present application;

[0018] Figure 7 is a hardware structural schematic diagram of an electronic device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0019] The technical solutions in the embodiments of the present application will be clearly described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only some, but not all of the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by a person of ordinary skill in the art belong to the scope of protection of the present application.

[0020] The terms "first", "second", and the like in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the terms used in this way can be interchanged under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than that illustrated or described herein, and the objects distinguished by "first", "second", etc. are usually a category, and are not limited to the number of objects, for example, the first object can be one or more. In addition, "and / or" in the specification and claims means at least one of the connected objects, and the character " / ", generally indicates that the front and rear associated objects are in an "or" relationship.

[0021] The photographing method and device provided by the embodiments of the present application will be described in detail below with reference to the drawings and specific embodiments and their application scenarios.

[0022] In daily life, people can record beautiful moments in life through electronic devices such as smart phones, especially when they want to take pictures of beautiful moments with friends, they usually need to take pictures through group selfie.

[0023] At present, when users use electronic devices to take pictures in the scene of multi-person group shooting, they usually take the electronic device to a remote place or use a selfie stick or other tools for group shooting. These methods are all physical methods to improve the field of view range of multi-person group shooting, and the best shooting moment and angle are found by constantly changing the shooting angle and posture.

[0024] However, due to the limitation of the electronic device camera module, these methods have the problems of proportion disorder between the close-up face and the distant face, serious face distortion at the edge of the field of view, and difficulty in achieving the satisfactory effect of each user on the face and the overall image quality in the photographic result. Although the user can use a portable smart device on the wrist to assist in shooting during the shooting process. However, due to the small size of the preview screen of these devices, and the operation of these auxiliary devices during the shooting process, the shooter's eyes will be away from the shooting device, missing the best shooting moment. In addition, when the shooter uses a smart device to shoot, the electronic device is far away from the user, and the user can hardly see his / her own posture in the preview interface, so that the photographed image cannot achieve the expected effect, resulting in repeated shooting.

[0025] In the shooting method provided in the embodiments of the present application, when the shooting is needed, the first images collected by the M+1 shooting devices (including the first electronic device and the M second electronic devices) can be synthesized based on the relative spatial positions between the M+1 shooting devices to obtain a second image including all the shooting subjects in the first images. As can be seen, each shooting subject in the second image is collected by different shooting devices, so that each shooting subject in the second image is clear and without distortion, and therefore the image quality of the shot image can be improved.

[0026] The shooting method using the electronic devices A, B and C by the users a, b and c respectively will be described in detail below.

[0027] In the shooting mode, the electronic devices A, B and C are connected wirelessly and estimate the relative spatial positions between the electronic devices. The electronic devices A, B and C synthesize the three first images of the electronic devices A, B and C based on the relative spatial positions to obtain a second image of the shot image, so that a shot image with high image quality can be obtained.

[0028] Further, the electronic devices A, B and C complete the handshake communication through wireless connection, so that the electronic device A can locate the electronic devices B and C by sending and receiving data packets with transmission parameters between each other. In addition, the electronic device A can also send the relative spatial position information between the located electronic devices B and C to the electronic device B, so that the electronic device B can more accurately locate the relative spatial position with the electronic device C.

[0029] Optionally, when the three first images are synthesized to obtain the second image, the electronic device A can construct a field of view geometric model and a three-dimensional image of the shooting subject in the first image based on the relative spatial position and the device information of the electronic devices A, B and C, and render the three-dimensional image in the field of view geometric model to obtain the corresponding mapping image as the second image. Therefore, the shooting subject in the second image has better clarity and geometric relationship.

[0030] Optionally, the electronic device A can also perform color correction processing on the three acquired first images to ensure the uniformity of the color effect of the synthesized second image.

[0031] The embodiment of the present application provides a photographing method, Figure 1 A flow chart of a photographing method provided by the embodiment of the present application is shown, and the method can be applied to an electronic device. As shown in the figure, Figure 1 The photographing method provided by the embodiment of the present application can include the following steps 101 to 103.

[0032] Step 101, in the group photographing mode, the first electronic device estimates a first relative spatial position between the first electronic device and M second electronic devices.

[0033] Wherein, M can be a positive integer.

[0034] In the embodiment of the present application, the first electronic device and the M second electronic devices are all electronic devices participating in group photographing.

[0035] For the convenience of description, in the following embodiments, the "first electronic device and M second electronic devices" are collectively referred to as "M+1 group photographing devices", and the two have the same meaning and can be interchangeable.

[0036] In the embodiment of the present application, the distance between the M+1 group photographing devices is less than or equal to a preset distance.

[0037] For example, the M+1 group photographing devices are in the same photographing scene.

[0038] Optionally, wireless connection can be established between the M+1 group photographing devices. That is, the M+1 group photographing devices can communicate through wireless connection.

[0039] In the embodiment of the present application, the group photographing mode refers to supporting joint photographing between multiple electronic devices to obtain a group photographing image, that is, an image including multiple photographing subjects, such as a group photo.

[0040] Optionally, when the first electronic device enters the group photographing mode, the first electronic device can search for the remaining electronic devices in the range thereof; when one or more electronic devices (such as M second electronic devices) are searched, the first electronic device can establish wireless connection, such as Bluetooth connection, with each electronic device searched. Of course, wireless connection can also be established between the one or more electronic devices, which can be determined according to actual use requirements.

[0041] For example, the electronic device can search for other electronic devices by sending a broadcast message. Alternatively, the first relative spatial position can be a relative position of the M+1 racking devices in a two-dimensional coordinate system, or a relative position of the M+1 racking devices in a three-dimensional coordinate system.

[0042] Alternatively, the first electronic device can estimate the first relative spatial position according to the position information of the M+1 racking devices. Alternatively, the first relative spatial position can be estimated according to the transmission parameters of the data packets sent by the M second electronic devices. For the description of estimating the first relative spatial position according to the transmission parameters of the data packets, details will be described in the following embodiments, and to avoid repetition, details will not be described here.

[0043] Step 102, the first electronic device acquires M+1 first images.

[0044] The M+1 first images can include images captured by the first electronic device and images captured by the M second electronic devices.

[0045] In the embodiments of the present application, the M+1 first images can be images captured by the M+1 racking devices after entering the racking mode.

[0046] Alternatively, each racking device can capture at least one image, and then the user of the racking device can trigger the racking device to take the most satisfactory one of the at least one image as the first image captured by the racking device.

[0047] For example, as shown in FIG. 2, the user of the electronic device A can trigger the electronic device A to take the captured image 20 as the first image, and the user of the electronic device B can trigger the electronic device B to take the captured image 21 as the first image. Figure 2

[0048] Alternatively, the M second electronic devices can broadcast the first images captured thereby, so that the first electronic device and the second electronic devices other than the image broadcaster can all receive the first images. In other words, after the M+1 racking devices capture the first images, they can synchronize the first images to other racking devices.

[0049] Step 103, the first electronic device synthesizes the M+1 first images based on the first relative spatial position to obtain a second image.

[0050] The second image can include all the shooting subjects in the M+1 first images. It should be noted that one first image includes only one shooting subject, and the M+1 first images have a total of M+1 shooting subjects. That is, "all the shooting subjects in the M+1 first images" specifically include the M+1 shooting subjects.

[0051] ​For example, such as Figure 2 As shown, electronic device A acquires image 20, and electronic device B acquires image 21. Electronic device A can synthesize image 20 and image 21 based on the relative spatial position between electronic device A and electronic device B to obtain... Figure 3 Image 22, shown as the second image, can be seen to include the subjects captured in images 20 and 21. In this embodiment, the second image can be a composite image of all subjects captured in the M+1 first images.

[0052] The term "all subjects in the first M+1 images" will be referred to as "M+1 subjects" below. The two terms have the same meaning and can be used interchangeably.

[0053] Optionally, the display parameters of the M+1 subjects in the second image are determined by the first relative spatial position. These display parameters may include: display size and display position.

[0054] Optionally, the subject of the photograph can be the object or subject that has the largest area in the first image.

[0055] Optionally, if image a captured by electronic device A includes the subject captured in image b captured by electronic device B, such as image a including person 1 and person 2 standing next to person 1; where person 1 is the subject of image a and person 2 is the subject of image b; then the relative spatial position between electronic device A and electronic device B can be determined based on the relative positions of person 1 and person 2 in image a. This allows for a more accurate determination of the relative spatial position between the two devices, enabling more accurate synthesis of the M+1 first images, thereby further improving the image quality of the second image.

[0056] In this embodiment of the application, when a combined shot is required, the first images captured by M+1 combined shooting devices (including a first electronic device and M second electronic devices) can be synthesized based on the relative spatial positions between them to obtain a second image that includes all the subjects in the first image. It can be seen that each subject in the second image is captured by a different combined shooting device, which can ensure that each subject in the second image is clear and without distortion, thus improving the image quality of the combined shot image.

[0057] Optionally, step 101 above can be implemented through steps 101a and 101b below.

[0058] Step 101a: The first electronic device receives M first data packets sent by M second electronic devices.

[0059] The first data packet comprises a sending time of the first data packet, a departure angle of the first data packet, and a device identifier of a second electronic device.

[0060] It can be understood that the M second electronic devices correspond to the M first data packets in one-to-one correspondence.

[0061] Optionally, the M+1 devices can transmit the data packets through narrow beams.

[0062] Optionally, the sending time of the first data packet can be a starting sending time of a first data block in the first data packet.

[0063] Optionally, the departure angle of the first data packet can be a transmission direction angle of the second electronic device when the second electronic device sends the first data packet.

[0064] Optionally, the device identifier of the second electronic device can indicate the second electronic device.

[0065] Optionally, before the first electronic device receives the M first data packets, the second data packet can be sent, and the second data packet comprises a departure angle, a sending time of the second data packet, and a device identifier of the first electronic device. Thus, the M second electronic devices can all receive the second data packet. Thus, the second electronic device can estimate an arrival angle and an arrival time of the second data packet, and parse the departure angle and the sending time in the second data packet. In this way, the second electronic device can locate the first electronic device according to the arrival angle and the arrival time of the second data packet and the departure angle and the sending time in the second data packet.

[0066] In step 101b, the first electronic device estimates a first relative spatial position between the first electronic device and the M second electronic devices according to transmission parameters of the M first data packets.

[0067] The transmission parameters of the first data packet can comprise a sending time of the first data packet, a departure angle of the first data packet, an arrival time of the first data packet, and an arrival angle of the first data packet.

[0068] Optionally, after the first electronic device receives the first data packet, the first electronic device can estimate the arrival angle and the arrival time of the first data packet through an antenna of the first electronic device, and parse the departure angle and the sending time of the first data packet carried in the first data packet. In this way, the first electronic device can obtain the transmission parameters of the first data packet.

[0069] For the description of estimating the arrival angle and the arrival time of the first data packet when the first data packet arrives at the first electronic device, refer to the related description in the related art, and the embodiments of the present application are not limited.

[0070] It can be understood that the transmission parameter of the first data packet is used to determine the relative spatial position between the first electronic device and the second electronic device.

[0071] Specifically, the first electronic device can determine the distance between the second electronic device and the first electronic device according to the sending time and the arrival time of the first data packet; and the first electronic device can determine the relative direction between the second electronic device and the first electronic device according to the departure angle and the arrival angle of the first data packet.

[0072] It should be noted that the above estimation method does not limit the embodiments of the present application, and in actual implementation, any estimation method in related technologies can be used to estimate the relative spatial position between the first electronic device and the second electronic device according to the transmission parameter of the first data packet.

[0073] Optionally, the first electronic device can send a second data packet to the second electronic device, and the second data packet contains the departure angle, the sending time of the second data packet and the device identifier of the first electronic device. Thus, the M second electronic devices can receive the second data packet. Then, the second electronic device can estimate the arrival angle and the arrival time of the second data packet through the antenna, and parse the departure angle and the sending time in the second data packet. In this way, the second electronic device can obtain the transmission parameter of the second data packet.

[0074] It can be understood that the arrival angle and the arrival time of the second data packet estimated by different second electronic devices can be different, which can be determined according to the relative position relationship between the second electronic device and the first electronic device.

[0075] Optionally, in one way, after obtaining the transmission parameter of the second data packet, the second electronic device can estimate the relative spatial position between the second electronic device and the first electronic device according to the transmission parameter of the second data packet.

[0076] It can be seen that the M+1 shooting devices can respectively broadcast a data packet, such as the first data packet or the second data packet, so as to facilitate the M+1 shooting devices to estimate the relative spatial position between the M+1 shooting devices. Further, the M+1 shooting devices can share the estimation results, so as to more accurately determine the relative spatial position between the M+1 shooting devices through the M+1 estimation results.

[0077] Alternatively, in another approach, after obtaining the transmission parameters of the second data packet, the second electronic device carries at least a portion of the transmission parameters of the second data packet in the first data packet when sending the first data packet. This allows the first electronic device to determine the relative spatial position 1 and relative spatial position 2 between itself and the second electronic device based on the transmission parameters of the second data packet and the first data packet, respectively; and to correct and verify the relative spatial position 1 based on the relative spatial position 2.

[0078] The process of transmitting data packets between participating electronic devices is described below with reference to the accompanying drawings.

[0079] For example, such as Figure 4 As shown, electronic device A connects to electronic device B via a narrow beam to complete handshake communication; then, electronic device A can send data packet a1 (i.e., the second data packet), in which data packet a1 contains the sending time of data packet a1, the departure angle 41 of data packet a1 and the device identifier of electronic device A.

[0080] After receiving data packet a1, electronic device B can estimate the angle of arrival 42 and arrival time of data packet a1 through the antenna of electronic device B, and parse data packet a1 to obtain the departure angle, transmission time and device identifier of electronic device B.

[0081] Then electronic device B can send data packet b1 to electronic device A. Data packet b1 contains the departure angle of data packet b1, the transmission time, the device identifier of electronic device B, the estimated arrival angle of data packet a1 by electronic device B, and the acknowledgment identifier corresponding to data packet a1.

[0082] After receiving data packet b1 (i.e., the first data packet), electronic device A can estimate the angle of arrival and arrival time of data packet b1, and parse and save data packet b1 to obtain: the departure angle of data packet b1, the sending time of data packet b1; the angle of arrival of data packet a1 to electronic device B; and the device identifier of electronic device B.

[0083] In this system, electronic device A can pre-store the transmission time and departure angle of data packet a1. Thus, electronic device A can estimate the relative spatial position between electronic device A and electronic device B based on the transmission parameters of data packet a1 and data packet b1 respectively, obtaining two relative spatial positions; then, based on these two spatial positions, the final relative spatial position between electronic device A and electronic device B is determined.

[0084] Optionally, during the synchronization process, the first electronic device and the M second electronic devices can correct their first relative spatial position by continuously sending and receiving data packets.

[0085] Optionally, if the M+1 shooting devices are provided with high-precision positioning chips, the electronic device can directly output the relative positions of other electronic devices relative to the electronic device through the high-precision positioning chips.

[0086] For the description of the high-precision positioning chip for positioning the relative positions between the electronic devices, refer to the related description in the related art, and the embodiments of the present application are not limited.

[0087] Thus, since the sending time and the arrival time of the first data packet can indicate the distance between a second electronic device and the first electronic device, and the emitting direction angle and the arrival direction angle of the first data packet can indicate the relative position between a second electronic device and the first electronic device, the first relative spatial position between the first electronic device and the M second electronic devices can be accurately estimated based on the transmission parameters of the M second data packets. Thus, the display parameters of each shooting subject in the shooting image are determined more accurately based on the first relative spatial position, and the sense of reality of the shooting image is improved.

[0088] Optionally, the first data packet can further include first relative position information.

[0089] The first relative position information can be used to indicate the estimated relative spatial position between the fourth electronic device and the fifth electronic device by a second electronic device.

[0090] In the embodiments of the present application, the fourth electronic device and the fifth electronic device can be the devices participating in the shooting.

[0091] Optionally, the fourth electronic device can include any of the following: the first electronic device, a second electronic device. The fifth electronic device can include any of the following: the first electronic device, a second electronic device. And the fourth electronic device and the fifth electronic device are not the same.

[0092] Optionally, when the M+1 shooting devices (not less than three) jointly shoot, a shooting device can attach its estimation result in the first data packet it sends based on the estimation of the relative spatial position between it and at least part of other shooting devices. The estimation result is used for other shooting devices to perform auxiliary estimation.

[0093] For example, the electronic devices A, B, C and D jointly make a shot, after the electronic devices A, B, C and D are stably connected and the relative position estimation between the electronic devices is completed, when the electronic device A sends the data packet a2 to the electronic device B, that is, the electronic device A sends the data packet to the electronic device B for the second time, if the fourth electronic device is the electronic device B (that is, the fourth electronic device is one second electronic device), and the fifth electronic device is the electronic device C (that is, the fifth electronic device is one second electronic device except the one second electronic device in the M second electronic devices). Then, the relative spatial position information of the electronic device C relative to the electronic device B estimated by the electronic device A can be included in the data packet a2. After receiving the data packet a2, the electronic device B can correct the relative spatial position between the electronic device B and the electronic device C estimated by the electronic device B based on the relative spatial position between the electronic device B and the electronic device C estimated by the electronic device A.

[0094] Alternatively, if the fourth electronic device is the electronic device A (that is, the fourth electronic device is the first electronic device), and the fifth electronic device is the electronic device C (that is, the fifth electronic device is one second electronic device except the one second electronic device in the M second electronic devices). Then, the relative spatial position information of the electronic device C relative to the electronic device A estimated by the electronic device A can also be included in the data packet a2. After receiving the data packet a2, the electronic device B can correct the relative spatial position between the electronic device B and the electronic device C estimated by the electronic device B based on the relative spatial position between the electronic device A and the electronic device C estimated by the electronic device A.

[0095] Optionally, the devices indicated by the fourth electronic device and the fifth electronic device can be interchangeable.

[0096] In this way, since the electronic device can more accurately position other electronic devices according to the relative spatial position information estimated by other electronic devices, the estimation accuracy of the relative spatial position between the electronic device and other electronic devices estimated by the electronic device can be improved.

[0097] Optionally, the step 103 can be implemented by the following steps 103a to 103d.

[0098] In step 103a, the first electronic device constructs a field of view geometric model between the M+1 first images based on the first relative spatial position.

[0099] Optionally, the field of view geometric model can be a geometric model generated by the image perspective relationship of the M+1 first images.

[0100] Optionally, the image perspective relationship can be determined by the first relative spatial position between the first electronic device and the M second electronic devices.

[0101] It can be understood that the field of view geometric model is a three-dimensional model.

[0102] The field of view geometric model is used to indicate the relative position of the shooting object corresponding to the shooting subject in the shooting environment.

[0103] In step 103b, the first electronic device constructs a three-dimensional image of all the shooting subjects in the M+1 first images.

[0104] Optionally, the three-dimensional image of the shooting subject can be a three-dimensional stereogram.

[0105] In the embodiment of the present application, after the first electronic device constructs a three-dimensional image of all the shooting subjects in the M+1 first images, M+1 three-dimensional images can be obtained.

[0106] For a specific description of constructing a three-dimensional image of a shooting subject, it will be described in detail in the following embodiments, and to avoid repetition, it will not be described here.

[0107] In step 103c, the first electronic device renders the three-dimensional image in the field of view geometric model with the third image as the background.

[0108] The third image is composed of background images in the M+1 first images.

[0109] In the embodiment of the present application, the electronic device can render the three-dimensional images of all the shooting subjects in the field of view geometric model, that is, render M+1 three-dimensional images in the field of view geometric model.

[0110] Optionally, the third image can be composed after feature alignment of the background images in the M+1 first images.

[0111] Optionally, when the first electronic device renders the three-dimensional image in the field of view geometric model, the rendering parameter can be used for rendering.

[0112] Optionally, the rendering parameter can include at least one of the following: beautifying parameter, body beautifying parameter, lighting parameter, color parameter.

[0113] Optionally, the rendering parameter can be default or manually set by the user.

[0114] Optionally, before rendering the three-dimensional image, the first electronic device can also estimate the lighting characteristics of the shooting scene to obtain the lighting parameter, so that the constructed field of view geometric model is more realistic.

[0115] In step 103d, the first electronic device determines the mapping image corresponding to the field of view geometric model as the second image.

[0116] It can be understood that the mapping image corresponding to the field of view geometric model can be: mapping the field of view geometric model along the first direction to obtain the mapping image of the field of view geometric model. That is, the second image is a two-dimensional image.

[0117] Optionally, the first direction can be the optical axis direction of the first electronic device, such as the optical axis direction of the camera used by the first electronic device to collect the first image.

[0118] It should be noted that the above embodiment is an example of constructing a complete field of view geometric model by the first electronic device. In actual implementation, the first electronic device can construct part of the field of view geometric model, and each second electronic device can also construct part of the field of view geometric model, that is, M+1 shooting devices construct part of the field of view geometric model respectively, to obtain M+1 field of view geometric model parts, that is, a distributed model construction method. The M+1 field of view geometric model parts are synthesized to obtain a complete field of view geometric model.

[0119] Specifically, in the distributed model construction method, the first electronic device only needs to construct the field of view geometric model part corresponding to the first image collected by the first electronic device; and receives M second electronic devices to construct the field of view geometric model part corresponding to the M first images. Then the M+1 field of view geometric model parts are aligned in feature points to obtain a complete field of view geometric model.

[0120] The above embodiment is an example of constructing M+1 three-dimensional images by the first electronic device. In actual implementation, M+1 shooting devices construct three-dimensional images corresponding to their respective first images to obtain M+1 three-dimensional images. Optionally, the shooting devices can synchronize the three-dimensional images constructed by them to other shooting devices.

[0121] Optionally, when M+1 shooting devices construct the field of view geometric model and the three-dimensional image, in one way, each shooting device can first render the three-dimensional image constructed by it in the field of view geometric model part constructed by it, and then synchronize it to other shooting devices. In another way, each shooting device can synchronize the three-dimensional image and the field of view geometric model part constructed by it to a specific shooting device, such as the first electronic device, and the first electronic device realizes the synthesis of the complete field of view geometric model and the rendering of all three-dimensional images.

[0122] In this way, since the first electronic device constructs the three-dimensional images of the shooting subjects in the M+1 first images, and then renders the M+1 three-dimensional images in the field of view geometric model with the third image as the background, and finally determines the mapping image corresponding to it as the second image. Therefore, the image information of the shooting subjects in each first image can be better preserved, so that the clarity, realism and aesthetics of the synthesized second image can be improved.

[0123] Optionally, the step 103a can be implemented by the following step 103a1.

[0124] The step 103a1, the first electronic device constructs a field of view geometric model based on the first relative spatial position and the M+1 sets of device information.

[0125] The M+1 sets of device information correspond to the M+1 third electronic devices one by one, and the M+1 third electronic devices can include: the first electronic device, the M second electronic devices.

[0126] Optionally, each set of device information can include: an offset of a first camera in a third electronic device relative to an antenna array in the third electronic device, a pointing direction of the first camera when the third electronic device collects a first image.

[0127] Optionally, the first camera can be a camera used by a third electronic device to collect a first image.

[0128] Optionally, the image perspective relationship can be determined by the first relative spatial position and the M+1 sets of device information.

[0129] Specifically, when constructing the field of view geometric model, the first electronic device can construct an image perspective relationship between the M+1 first images based on the M+1 pointing directions and the M+1 offsets of the antenna arrays, and the first relative spatial position, thereby constructing the field of view geometric model.

[0130] Optionally, an offset indicates a relative spatial position between a third electronic device and a shooting subject corresponding to the third electronic device.

[0131] For example, the offset of the first camera in the electronic device A relative to the antenna array in the electronic device A is 30° east and north, which can indicate that the shooting subject a is in the direction of 30° east and north of the electronic device A.

[0132] If the electronic device B is in the west of the electronic device A (i.e., the first relative spatial position), the offset of the first camera in the electronic device B relative to the antenna array in the electronic device B is also 30° east and north, which can indicate that the shooting subject b is in the direction of 30° east and north of the electronic device B.

[0133] It can be concluded that the shooting subject b is in the west of the shooting subject a.

[0134] It can be understood that when constructing the field of view geometric model, the first image containing the shooting subject b should be located in the west of the first image containing the shooting subject a.

[0135] Thus, the first electronic device can construct the image perspective relationship among the M+1 first images based on the first relative spatial position and the M+1 sets of device information, thereby constructing an initial field-of-view geometric model, so that a synthesis framework can be fixed for subsequent image synthesis, and the synthesis effect is better and more realistic.

[0136] Optionally, in the embodiments of the present application, the shooting subject in the first image is a person. The step 103b can be implemented by the following steps 103b1 to 103b4.

[0137] In step 103b1, for one of the M+1 first images, the first electronic device inputs the first image into a first face three-dimensional feature point generation model, and outputs the face three-dimensional feature point information of the first shooting subject in the first image through the first face three-dimensional feature point generation model.

[0138] It can be understood that the first face three-dimensional feature point generation model can output the three-dimensional feature point information of the face in the input image.

[0139] Optionally, the face corresponding to the first shooting subject can refer to the face, hair, and ear ornaments of the first shooting subject.

[0140] Optionally, the face three-dimensional feature point information can be three-dimensional modeling and estimation of the face corresponding to the first shooting subject in the first image, and the generated three-dimensional feature points of the face.

[0141] Optionally, if there are two or more face information in the first image, the face with a larger area is taken as the master face, that is, the face of the shooting subject.

[0142] Optionally, for the face information other than the master face, the second face three-dimensional feature point generation model can be used to output the face three-dimensional feature point information corresponding thereto.

[0143] Thus, if the face other than the master face is the shooting subject in the other electronic device, the clarity, realism, and aesthetics of the second image can be improved according to the multi-angle shooting result.

[0144] In step 103b2, the first electronic device estimates the human body three-dimensional key points of the first shooting subject based on the first image.

[0145] Optionally, the human body of the first shooting subject can refer to the torso and clothing of the first shooting subject.

[0146] Optionally, the human body of the first shooting subject can not be subjected to complex and detailed three-dimensional modeling, but only the main position estimation of the human body three-dimensional key points (such as hands, elbows, feet, etc.).

[0147] In step 103b3, the first electronic device performs color and texture rendering on the three-dimensional contour formed by the three-dimensional feature points of the face based on the face image of the first shooting subject, to obtain a three-dimensional face image; and performs color and texture rendering on the three-dimensional contour formed by the three-dimensional feature points of the human body based on the human body image of the first shooting subject, to obtain a three-dimensional human body image.

[0148] Optionally, the color and texture rendering on the three-dimensional contour formed by the three-dimensional feature points of the face by the first electronic device can be filling of the color and texture of the facial skin, filling of the color and texture of the hair, etc.

[0149] Optionally, the color and texture rendering on the three-dimensional contour formed by the three-dimensional feature points of the human body by the first electronic device can be filling of the color and texture of the clothes, filling of the color and texture of the fingers, etc.

[0150] Optionally, the first electronic device can construct the three-dimensional images of the shooting subject in the M+1 first images, to obtain M+1 three-dimensional human body images.

[0151] In step 103b4, the first electronic device performs texture alignment and fusion processing on the three-dimensional face image and the three-dimensional human body image, to obtain a three-dimensional image of the first shooting subject.

[0152] It can be understood that the first electronic device performs texture alignment and fusion processing on the three-dimensional face image of the first shooting subject and the three-dimensional human body image of the first shooting subject, to obtain a three-dimensional image of the first shooting subject.

[0153] Thus, since the first electronic device can construct the three-dimensional images of the shooting subject in the M+1 first images, to obtain M+1 three-dimensional human body images, the image information of the shooting subject in the first image can be better preserved in the subsequent synthesis process.

[0154] Optionally, after obtaining the second image, if the user of the first electronic device is not satisfied with the second image, the user can trigger the first electronic device to reset the rendering parameters according to his own needs, and use the reset rendering parameters to render the three-dimensional image in the field-of-view geometric model with the third image as the background, to obtain a second image that meets the user's expectations.

[0155] Specifically, the first electronic device can pinch the face according to the beautifying parameters, and perform local beautifying on the three-dimensional key points of the human body according to the beautifying parameters. Then, the first electronic device can perform re-illumination rendering and color space conversion rendering on the three-dimensional image, the field-of-view geometric model, the background image, and the global illumination information according to the reset rendering parameters, and fill the background information distortion caused by the face pinching and the body beautifying in the previous step. Finally, the first electronic device can also beautify the face and skin color of the shooting subject.

[0156] Thus, since the three-dimensional feature points of the human face and the three-dimensional key point positions of the local human body can be beautified, and the rendering parameters can be reset, a more personalized style of the retouched image can be obtained, especially when the flash is turned on in the night scene, the subject can be better rendered with better light, so that the retouched image can have better clarity, geometric relationship and light and shadow atmosphere.

[0157] Optionally, before the step 103, the photographing method provided by the embodiment of the present application can further include the following steps 104 and 105.

[0158] In step 104, the first electronic device acquires the photographing parameters when the M second electronic devices collect the first images.

[0159] Optionally, the photographing parameters can include at least one of the following: a color correction matrix, a sensitivity, an aperture size, and shutter information.

[0160] In step 105, the first electronic device performs color space correction processing on the M first images collected by the M second electronic devices based on the M photographing parameters.

[0161] Optionally, the M+1 first images acquired by the first electronic device can be original images.

[0162] Optionally, the first electronic device can convert the M+1 first images into images conforming to the color correction matrix of the first electronic device based on the acquired photographing parameters.

[0163] Specifically, the first electronic device acquires a first image of one second electronic device, and the first electronic device can remap the first image to a standard color space according to the sensor and color conversion information of the one second electronic device, and then convert the first image to the color space of the first electronic device through the color correction matrix of the first electronic device.

[0164] Optionally, if one second electronic device enables high dynamic range when collecting the first image, the first electronic device can remap the first image to a standard color space based on the sensitivity, shutter information, sensor and color conversion information of the one second electronic device, and then convert the first image to the color space of the first electronic device through the color correction matrix of the first electronic device.

[0165] Optionally, for high dynamic range images, a trained deep neural network model can also be used to unify the dynamic range and color space of high dynamic range images.

[0166] Thus, since the first electronic device can perform color space correction processing on the acquired M+1 first images, the consistency of the color effect of the synthesized second image can be ensured, and the image quality of the second image can be improved.

[0167] It can be understood that, for each of the M second electronic devices, each of the steps performed by the first electronic device is performed at the same time as the corresponding step of the first electronic device.

[0168] The execution subject of the photographing method provided in the embodiments of the present application can be a photographing device. In the embodiments of the present application, the photographing method performed by the photographing device is taken as an example to illustrate the photographing device provided in the embodiments of the present application.

[0169] Figure 5 A possible structural schematic diagram of a photographing device involved in the embodiments of the present application is shown. As shown in the figure, Figure 5 the photographing device 50 can include an estimation module 51, an acquisition module 52, and a synthesis module 53.

[0170] The estimation module 51 is configured to estimate a first relative spatial position between the first electronic device and the M second electronic devices in the group photographing mode, where M is a positive integer. The acquisition module 52 is configured to acquire M+1 first images, where the M+1 first images include an image collected by the first electronic device and images collected by the M second electronic devices. The synthesis module 53 is configured to synthesize the M+1 first images based on the first relative spatial position estimated by the estimation module 51 to obtain a second image, where all photographing subjects in the M+1 first images are included in the second image.

[0171] In a possible implementation, the estimation module 51 includes a receiving sub-module and an estimation sub-module.

[0172] The receiving sub-module is configured to receive M first data packets sent by the M second electronic devices, where each first data packet includes a sending time of the first data packet, a departure angle of the first data packet, and a device identifier of one second electronic device.

[0173] The estimation sub-module is configured to estimate the first relative spatial position between the first electronic device and the M second electronic devices according to transmission parameters of the M first data packets.

[0174] The transmission parameters of the first data packet include the sending time of the first data packet, the departure angle of the first data packet, the arrival time of the first data packet, and the arrival angle of the first data packet.

[0175] In a possible implementation, the first data packet further includes first relative position information, and the first relative position information is used to indicate a relative spatial position between the fourth electronic device and the fifth electronic device estimated by the second electronic device.

[0176] The fourth electronic device and the fifth electronic device are devices participating in the multi-shot.

[0177] In a possible implementation, the synthesis module 53 specifically includes a construction submodule, a rendering submodule, and a determination submodule.

[0178] The construction submodule is configured to construct a field-of-view geometric model between the M+1 first images based on the first relative spatial position.

[0179] The construction submodule is further configured to construct a three-dimensional image of all shooting subjects in the M+1 first images.

[0180] The rendering submodule is configured to render the three-dimensional image in the field-of-view geometric model with the third image as a background.

[0181] The determination submodule is configured to determine a mapping image corresponding to the field-of-view geometric model constructed by the construction submodule as the second image.

[0182] The third image is obtained by synthesizing all background images in the M+1 first images.

[0183] In a possible implementation, the shooting subject in the first image is a person.

[0184] The construction submodule is specifically configured to:

[0185] For one of the M+1 first images, the one first image is input into the first face three-dimensional feature point generation model for processing, and the first face three-dimensional feature point generation model outputs face three-dimensional feature point information corresponding to a first shooting subject in the one first image.

[0186] Based on the one first image, a human body three-dimensional key point of the first shooting subject is estimated.

[0187] Based on a face image of the first shooting subject, a three-dimensional contour formed by the face three-dimensional feature points is color and texture rendered to obtain a face three-dimensional image; and based on a human body image of the first shooting subject, a three-dimensional contour formed by the human body three-dimensional feature points is color and texture rendered to obtain a human body three-dimensional image.

[0188] The face three-dimensional image and the human body three-dimensional image are texture aligned and fused to obtain a three-dimensional image of the first shooting subject.

[0189] In a possible implementation, the constructing sub-module is specifically configured to:

[0190] construct a field of view geometric model based on the first relative spatial position and the M+1 sets of device information;

[0191] The M+1 sets of device information correspond to M+1 third electronic devices one by one, and the M+1 third electronic devices include the first electronic device and M second electronic devices.

[0192] Each set of device information includes:

[0193] an offset of the first camera in one third electronic device relative to an antenna array in the one third electronic device;

[0194] a pointing direction of the first camera when the one third electronic device collects the first image;

[0195] The first camera is a camera used by one third electronic device to collect the first image.

[0196] In a possible implementation, the apparatus further includes a processing module.

[0197] The obtaining module 52 is further configured to, before synthesizing the M+1 first images based on the first relative spatial position to obtain a second image, acquire, by the first electronic device, shooting parameters when the M second electronic devices collect the first images.

[0198] The processing module is configured to perform color space correction processing on the first images collected by the M second electronic devices based on the M shooting parameters acquired by the obtaining module.

[0199] Embodiments of the present application provide a photographing apparatus. When it is necessary to synthesize, based on the relative spatial positions among M+1 photographing devices (including the first electronic device and the M second electronic devices), the first images collected by the M+1 photographing devices to obtain a second image including all the shooting subjects in the first images, it can be seen that each shooting subject in the second image is collected by a different photographing device, so that it can be ensured that each shooting subject in the second image is clear and free of distortion, and therefore the image quality of the synthesized image can be improved.

[0200] The photographing apparatus in the embodiments of the present applicationapplicationbe an electronic device, or a component in an electronic device, such as an integrated circuit or a chip. The electronic deviceapplicationbe a terminal, or another device other than a terminal. For example, the electronic deviceapplicationbe a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted electronic device, a Mobile Internet Device (MID), an augmented reality (AR) / virtual reality (VR) device, a robot, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), andapplicationbe a server, a Network Attached Storage (NAS), a personal computer (PC), a television (TV), a teller machine, or a self-service machine, and the like. The embodiments of the present application do not make a specific limitation.

[0201] The photographing apparatus in the embodiments of the present applicationapplicationbe a device having an operating system. The operating systemapplicationbe an Android operating system, an ios operating system, or another possible operating system, and the embodiments of the present application do not make a specific limitation.

[0202] The photographing apparatus provided in the embodiments of the present applicationapplicationbe capable of implementing the method embodiments. Figures 1 to 4 The processes implemented by the method embodimentsapplicationbe described above, and thus will not be described herein again.

[0203] Optionally, as shown in Figure 6 the embodiments of the present application further provide an electronic device 600, whichapplicationinclude a processor 601 and a memory 602. The memory 602applicationstore programs or instructions thatapplicationbe run on the processor 601. The programs or instructionsapplicationbe executed by the processor 601 to implement the processes of the photographing method embodiments described above, and achieve the same technical effects. The processesapplicationnot be described herein again to avoid repetition.

[0204] It should be noted that the electronic device in the embodiments of the present applicationapplicationinclude the mobile electronic device and the non-mobile electronic device described above.

[0205] Figure 7 To implement the hardware structure of an electronic device according to an embodiment of the present application.

[0206] The electronic device 700 includes, but is not limited to, a radio frequency unit 701, a network module 702, an audio output unit 703, an input unit 704, a sensor 705, a display unit 706, a user input unit 707, an interface unit 708, a memory 709, and a processor 710, etc.

[0207] Those skilled in the art can understand that the electronic device 700 can further include a power supply (such as a battery) for supplying power to each component, and the power supply can be logically connected to the processor 710 through a power management system, so as to realize functions such as management of charging, discharging, and power consumption management through the power management system. Figure 7 The electronic device structure shown in the figure does not constitute a limitation on the electronic device, and the electronic device can include more or fewer components than those shown, or combine certain components, or different component arrangements, which are not described here.

[0208] The processor 710 is configured to estimate a first relative spatial position between the first electronic device and M second electronic devices in a racking mode, M being a positive integer; the radio frequency unit 701 is configured to acquire M+1 first images, the M+1 first images including an image collected by the first electronic device and images collected by the M second electronic devices; and the processor 710 is configured to synthesize the M+1 first images based on the first relative spatial position estimated by the processor 710 to obtain a second image, wherein all shooting subjects in the M+1 first images are included in the second image.

[0209] Optionally, the processor 710 is specifically configured to:

[0210] receive M first data packets sent by the M second electronic devices, the first data packet including a sending time of the first data packet, a departure angle of the first data packet, and a device identifier of one second electronic device;

[0211] estimate a first relative spatial position between the first electronic device and the M second electronic devices according to transmission parameters of the M first data packets;

[0212] The transmission parameters of the first data packet include the sending time of the first data packet, the departure angle of the first data packet, the arrival time of the first data packet, and the arrival angle of the first data packet.

[0213] Optionally, the first data packet further includes first relative position information, the first relative position information being used to indicate a relative spatial position between a fourth electronic device and a fifth electronic device estimated by a second electronic device;

[0214] The fourth electronic device and the fifth electronic device are devices participating in racking.

[0215] Optionally, the processor 710 is specifically configured to:

[0216] construct a field of view geometric model between the M+1 first images based on the first relative spatial positions;

[0217] construct a three-dimensional image of all the shooting subjects in the M+1 first images;

[0218] render the three-dimensional image in the field of view geometric model with the third image as a background;

[0219] determine a mapping image corresponding to the field of view geometric model constructed by the constructing submodule as the second image;

[0220] The third image is composed of all background images in the M+1 first images.

[0221] Optionally, the shooting subject in the first image is a person.

[0222] The processor 710 is specifically configured to:

[0223] For one of the M+1 first images, input the one first image into the first face three-dimensional feature point generation model for processing, and output face three-dimensional feature point information corresponding to a first shooting subject in the one first image through the first face three-dimensional feature point generation model;

[0224] estimate human body three-dimensional key points of the first shooting subject based on the one first image;

[0225] perform color and texture rendering on a three-dimensional contour formed by the face three-dimensional feature points based on the face image of the first shooting subject, to obtain a face three-dimensional image; and perform color and texture rendering on a three-dimensional contour formed by the human body three-dimensional feature points based on the human body image of the first shooting subject, to obtain a human body three-dimensional image;

[0226] perform texture alignment and fusion processing on the face three-dimensional image and the human body three-dimensional image, to obtain a three-dimensional image of the first shooting subject.

[0227] The processor 710 is specifically configured to:

[0228] construct the field of view geometric model based on the first relative spatial positions and M+1 sets of device information;

[0229] The M+1 sets of device information correspond one-to-one to M+1 third electronic devices, and the M+1 third electronic devices include the first electronic device and M second electronic devices.

[0230] Each set of device information includes:

[0231] an offset of the first camera in the one third electronic device relative to the antenna array in the one third electronic device.

[0232] a third electronic device collects the first images, a pointing direction of the first camera;

[0233] The first camera is a camera used by a third electronic device to collect the first images.

[0234] Optionally, the radio frequency unit 701 is further configured to acquire, before synthesizing the M+1 first images to obtain the second image based on the first relative spatial position, M shooting parameters of the first electronic device when the M second electronic devices collect the first images.

[0235] The processor 710 is configured to perform color space correction processing on the first images collected by the M second electronic devices based on the M shooting parameters acquired by the acquisition module.

[0236] The embodiments of the present application provide an electronic device. When the first images collected by M+1 shooting devices (including the first electronic device and the M second electronic devices) need to be synthesized, the first images can be synthesized based on the relative spatial positions among the M+1 shooting devices to obtain a second image including all shooting subjects in the first images. It can be seen that each shooting subject in the second image is collected by a different shooting device, so that each shooting subject in the second image can be clear and without distortion, and thus the image quality of the synthesized image can be improved.

[0237] It should be understood that, in the embodiments of the present application, the input unit 704 can include a graphics processing unit (GPU) 7041 and a microphone 7042. The graphics processing unit 7041 processes image data of still pictures or videos obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 706 can include a display panel 7061, which can be configured in the form of a liquid crystal display, an organic light-emitting diode, etc. The user input unit 707 includes at least one of a touch panel 7071 and other input devices 7072. The touch panel 7071 is also called a touch screen. The touch panel 7071 can include a touch detection device and a touch controller. The other input devices 7072 can include, but are not limited to, a physical keyboard, function keys (such as volume control keys, on-off keys, etc.), a trackball, a mouse, an operation lever, and the like, which will not be described here.

[0238] The memory 709 can be used to store software programs and various data. The memory 709 can mainly include a first storage area storing programs or instructions and a second storage area storing data, wherein the first storage area can store an operating system, application programs or instructions required by at least one function (such as a sound playing function, an image playing function, etc.), and the like. In addition, the memory 709 can include a volatile memory or a non-volatile memory, or the memory 709 can include both a volatile memory and a non-volatile memory. The non-volatile memory can be a Read-Only Memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an Electrically EPROM (EEPROM), or a flash memory. The volatile memory can be a Random Access Memory (RAM), a Static RAM (SRAM), a Dynamic RAM (DRAM), a Synchronous DRAM (SDRAM), a Double Data Rate SDRAM (DDR SDRAM), an Enhanced SDRAM (ESDRAM), a Synch link DRAM (SLDRAM), and a Direct Rambus RAM (DRRAM). The memory 709 in the embodiments of the present application includes but is not limited to these and any other suitable types of memory.

[0239] The processor 710 can include one or more processing units; optionally, the processor 710 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and an application program, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It can be understood that the above-mentioned modem processor can also not be integrated into the processor 710.

[0240] The embodiments of the present application also provide a readable storage medium, the readable storage medium stores programs or instructions, the programs or instructions are executed by a processor to realize various processes of the above-mentioned photographing method embodiments, and the same technical effects can be achieved. To avoid repetition, details are not described here.

[0241] The processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes a computer readable storage medium, such as a computer readable only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0242] The embodiment of the present application further provides a chip, which comprises a processor and a communication interface, the communication interface is coupled with the processor, the processor is used for running programs or instructions to realize the processes of the above-mentioned photographing method embodiments and achieve the same technical effects. To avoid repetition, details are not described herein.

[0243] It should be understood that the chip mentioned in the embodiment of the present application can also be referred to as a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0244] The embodiment of the present application provides a computer program product, which is stored in a storage medium, and is executed by at least one processor to realize the processes of the above-mentioned photographing method embodiments and achieve the same technical effects. To avoid repetition, details are not described herein.

[0245] It should be noted that in this document, the term "comprising" or "including" or any other variant thereof is intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements not only includes those elements, but also includes other elements not explicitly listed or inherent to such process, method, article or device. Without more limitations, the element defined by the statement "comprising a" does not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the method and device in the embodiment of the present application is not limited to the order of performing the functions as shown or discussed, but can also include performing the functions in a substantially simultaneous manner or in a reverse order, for example, the described method can be performed in an order different from the described order, and various steps can also be added, omitted or combined. In addition, the features described with reference to some examples can be combined in other examples.

[0246] Through the above description of the embodiments, those skilled in the art can clearly understand that the above-mentioned example methods can be realized by means of software and a necessary general hardware platform, and of course, can also be realized by hardware, but in many cases, the former is a better embodiment. Based on such understanding, the technical solutions of the present application can be embodied in the form of a computer software product in essence or in the form of a part that contributes to the prior art, which is stored in a storage medium (such as a ROM / RAM, a magnetic disk, or an optical disk) and includes a plurality of instructions for causing a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in the various embodiments of the present application.

[0247] The embodiments of the present application are described above in combination with the drawings, but the present application is not limited to the above-mentioned specific embodiments, and the above-mentioned specific embodiments are only illustrative and not restrictive. Those skilled in the art can make many forms under the inspiration of the present application without departing from the scope of the present application and the scope protected by the claims.

Claims

1. A photographing method characterized by comprising: The method comprises: In the racking mode, the first electronic device estimates a first relative spatial position between the first electronic device and M second electronic devices, M being a positive integer; The first electronic device acquires M+1 first images, the M+1 first images comprising images collected by the first electronic device and images collected by the M second electronic devices; The first electronic device synthesizes the M+1 first images based on the first relative spatial position to obtain a second image; The second image comprises all shooting subjects in the M+1 first images; The first electronic device synthesizes the M+1 first images based on the first relative spatial position to obtain a second image, comprising: The first electronic device constructs a field of view geometric model between the M+1 first images based on the first relative spatial position; The first electronic device constructs a three-dimensional image of all shooting subjects in the M+1 first images; The first electronic device renders the three-dimensional image in the field of view geometric model with a third image as a background; The first electronic device determines a mapping image corresponding to the field of view geometric model as the second image; The third image is synthesized from all background images in the M+1 first images.

2. The method of claim 1, wherein, The first electronic device estimates a first relative spatial position between the first electronic device and M second electronic devices, comprising: The first electronic device receives M first data packets sent by the M second electronic devices, the first data packets comprising a sending time of the first data packet, a departure angle of the first data packet, and a device identifier of a second electronic device; The first electronic device estimates the first relative spatial position between the first electronic device and the M second electronic devices according to transmission parameters of the M first data packets; The transmission parameters of the first data packet comprise the sending time of the first data packet, the departure angle of the first data packet, the arrival time of the first data packet, and the arrival angle of the first data packet.

3. The method of claim 1, wherein, The shooting subject in the first image is a person; The first electronic device constructs a three-dimensional image of all shooting subjects in the M+1 first images, comprising: For one first image in the M+1 first images, the first electronic device inputs the one first image into a first face three-dimensional feature point generation model for processing, and outputs face three-dimensional feature point information of a first shooting subject in the one first image through the first face three-dimensional feature point generation model; The first electronic device estimates human body three-dimensional key points of the first shooting subject based on the one first image; The first electronic device performs color and texture rendering on a three-dimensional contour formed by the face three-dimensional feature points based on a face image of the first shooting subject to obtain a face three-dimensional image, and performs color and texture rendering on a three-dimensional contour formed by the human body three-dimensional feature points based on a human body image of the first shooting subject to obtain a human body three-dimensional image; The first electronic device performs texture alignment and fusion processing on the face three-dimensional image and the human body three-dimensional image to obtain a three-dimensional image of the first shooting subject.

4. The method of claim 1, wherein, The first electronic device constructs a field of view geometric model between the M+1 first images based on the first relative spatial position, including: The first electronic device constructs the field of view geometric model based on the first relative spatial position and M+1 sets of device information; The M+1 sets of device information correspond one-to-one to M+1 third electronic devices, and the M+1 third electronic devices include the first electronic device and the M second electronic devices. Each set of device information includes: An offset of a first camera in a third electronic device relative to an antenna array in the third electronic device; A pointing direction of the first camera when the third electronic device collects the first image; The first camera is the camera used by the third electronic device to collect the first image.

5. An imaging device, characterized by comprising: The device includes an estimation module, an acquisition module, and a synthesis module. The estimation module is configured to estimate a first relative spatial position between a first electronic device and M second electronic devices in a shooting mode, M being a positive integer. The acquisition module is configured to acquire M+1 first images, including images collected by the first electronic device and images collected by the M second electronic devices. The synthesis module is configured to synthesize the M+1 first images based on the first relative spatial position estimated by the estimation module to obtain a second image. The second image includes all shooting subjects in the M+1 first images. The synthesis module specifically includes a construction submodule, a rendering submodule, and a determination submodule. The construction submodule is configured to construct a field of view geometric model between the M+1 first images based on the first relative spatial position. The construction submodule is also configured to construct three-dimensional images of all shooting subjects in the M+1 first images. The rendering submodule is configured to render the three-dimensional images in the field of view geometric model with a third image as a background. The determination submodule is configured to determine a mapping image corresponding to the field of view geometric model constructed by the construction submodule as the second image. The third image is obtained by synthesizing all background images in the M+1 first images.

6. The apparatus of claim 5, wherein, The estimation module specifically includes a receiving submodule and an estimation submodule. The receiving submodule is configured to receive M first data packets sent by the M second electronic devices, the first data packets including a sending time of the first data packet, a departure angle of the first data packet, and a device identifier of a second electronic device. The estimation submodule is configured to estimate the first relative spatial position between the first electronic device and the M second electronic devices according to transmission parameters of the M first data packets. The transmission parameter of the first data packet comprises a sending time of the first data packet, a departure angle of the first data packet, an arrival time of the first data packet, and an arrival angle of the first data packet.

7. The apparatus of claim 5, wherein, The shooting subject in the first image is a person; The constructing sub-module is specifically used for: For one of the M+1 first images, the one first image is input into a first face three-dimensional feature point generation model for processing, and face three-dimensional feature point information corresponding to a first shooting subject in the one first image is output by the first face three-dimensional feature point generation model; Based on the one first image, human body three-dimensional key points of the first shooting subject are estimated; Based on a face image of the first shooting subject, a three-dimensional contour formed by the face three-dimensional feature points is rendered in color and texture to obtain a face three-dimensional image; Based on a body image of the first shooting subject, a three-dimensional contour formed by the body three-dimensional feature points is rendered in color and texture to obtain a body three-dimensional image; The face three-dimensional image and the body three-dimensional image are texture-aligned and fused to obtain a three-dimensional image of the first shooting subject.

8. The apparatus of claim 5, wherein, The constructing sub-module is specifically used for: Based on the first relative spatial position and M+1 sets of device information, the field-of-view geometric model is constructed; The M+1 sets of device information correspond to M+1 third electronic devices one by one, and the M+1 third electronic devices comprise the first electronic device and the M second electronic devices. Each set of device information comprises: an offset of a first camera in one third electronic device relative to an antenna array in the one third electronic device; a pointing direction of the first camera when the one third electronic device collects the first image; The first camera is a camera used by the one third electronic device to collect the first image.

Images