Photographing method and device

Abstract

The present application relates to the technical field of terminal-based photographing. Provided are a photographing method and device. The method is applied to a first device. The method comprises: a first device receiving a photographing preview operation, and in response to the photographing preview operation, displaying a photographing preview interface, wherein the photographing preview interface comprises a preview picture of a target object in a target scene presented by the first device; and the first device displaying, in the photographing preview interface, a three-dimensional virtual object of a photographing device for capturing a target template image. A three-dimensional virtual object is displayed in the process of displaying a photographing preview interface, and the three-dimensional virtual object can clearly prompt and guide a user to move to a position where a target template image is captured, and can accurately assume an attitude for capturing the target template image, such that the user can capture a high-quality image or video.

Description

A shooting method and equipment

[0001] This application claims priority to Chinese patent application filed on February 21, 2025, with application number 202510207281.6 and entitled "A photographing method and apparatus", the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of terminal shooting technology, and in particular to a shooting method and device. Background Technology

[0003] With the continuous iteration of the camera functions of electronic devices and the increasingly better camera performance, taking pictures with the cameras in electronic devices has become a common habit in people's lives. Especially when taking pictures in tourist attractions, recommended buildings, etc., taking high-quality photos or videos (such as taking pictures from a good vantage point and at a suitable angle) has become a demand of ordinary users.

[0004] However, ordinary users do not have professional framing and composition skills, which can easily lead to photos or videos that do not meet their expectations, resulting in a low success rate and a reduced user experience. Summary of the Invention

[0005] This application provides a shooting method and device, which displays a three-dimensional virtual object during the shooting preview interface. The three-dimensional virtual object can clearly prompt and guide the user to move to the position of the shooting target template image and accurately pose for shooting the shooting target template image, so that the user can shoot high-quality images or videos.

[0006] To achieve the above objectives, this application adopts the following technical solution:

[0007] In a first aspect, this application provides a shooting method applied to a first device, the method comprising:

[0008] The first device receives the shooting preview operation and, in response to the shooting preview operation, displays the shooting preview interface; the shooting preview interface includes the first device's preview of the target object in the target scene.

[0009] The shooting preview interface displays a 3D virtual object of the shooting device that captures the target template image. The 3D virtual object is used to indicate the target posture and target position. The target posture and target position are the shooting posture of the shooting device when capturing the target template image and its position in the target scene, respectively. The target template image is an image that the shooting device has captured in advance of the target object in the target scene.

[0010] Thus, in this embodiment of the application, during the display of the shooting preview interface, a three-dimensional virtual object can be shown. This three-dimensional virtual object can clearly prompt and guide the user to move to the position of the target template image and accurately pose for shooting the target template image. During the visual recommendation process, spatial position, direction, and device posture can be indicated to enable the user to capture high-quality images or videos. This improves the success rate of shooting and enhances the user experience.

[0011] In one possible implementation, the shooting preview interface also includes 3D guidance information, which is used to guide the first device to move from its current position to the target position, and / or to guide the first device to change its current posture to the target posture.

[0012] Thus, the embodiments of this application can present three-dimensional guidance information, which can overlay and display indicators such as movement direction and position on the real scene, presenting them to the user more intuitively, so that the user can more easily find the target position and assume the target posture. Especially in complex environments, it can greatly save time in finding the target position and assuming the target posture.

[0013] In one feasible approach, the display position, size, and / or pose of the 3D virtual object in the shooting preview interface changes as the first device moves, and the display pose of the 3D virtual object in the shooting preview interface changes as the pose of the first device changes.

[0014] Thus, the display position, size, and / or posture of the 3D virtual object shown in this embodiment of the application change as the first device moves, and its display posture changes as the posture of the first device changes. This indirectly guides the difference between the position and posture of the first device and the target position and posture. Users can more easily find the target position and pose based on the changes of the 3D virtual object. Especially in complex environments, this can greatly save time in finding the target position and posing the target posture.

[0015] In one feasible approach, the first device can acquire shooting reference information of the target template image, including shooting position and shooting posture information of the shooting device when shooting the target template image. Based on the shooting reference information of the target template image, the first device can display a three-dimensional virtual object of the shooting device that shot the target template image in a shooting preview interface.

[0016] Thus, this embodiment of the application can acquire and display a 3D virtual object in a real-world scene based on the shooting position and posture when capturing the target template image. Users can clearly and accurately perceive the shooting position and posture when capturing the target template image, and the 3D virtual object can guide users to capture the target template image, improving the second user's success rate and shooting experience.

[0017] In one feasible approach, during the acquisition of shooting reference information for the target template image, the first device can send its own location information to the server. This location information is used by the server to determine the target scene. The first device can also receive the shooting reference information for the target template image returned by the server.

[0018] Thus, in this embodiment, the first device can obtain the shooting reference information of the target template image from the server. The server can obtain the shooting reference information of the target template image in a timely manner, maintaining the timeliness of the information. In this way, the first device can also obtain shooting reference information with strong timeliness when obtaining it from the server. At the same time, obtaining shooting reference information from the server avoids data loss due to equipment failure and improves data security.

[0019] In one feasible approach, the shooting position information is the position information of the shooting device in a first spatial coordinate system. The first device can determine a second position information of its current position in the first spatial coordinate system. Based on the second position information and the shooting reference information, the first device can determine the display position and display posture of the 3D virtual object in the shooting preview interface.

[0020] Thus, in this embodiment, the first device can perform the conversion and calibration process of spatial information, enabling the transfer of spatial information between devices and ensuring cross-device consistency. Simultaneously, the first device can determine the display position and posture of the 3D virtual object in the shooting preview interface based on the converted position information and shooting reference information. Users can clearly and accurately perceive the shooting position and posture when shooting the target template image, while the 3D virtual object can guide users to capture the target template image, improving the user's success rate and shooting experience.

[0021] In one possible implementation, the first device can acquire its position and attitude information after movement in response to a movement operation on the first device. If the position and attitude information after movement match the target attitude and target position, the first device outputs a prompt message to prompt the user to perform a shooting operation.

[0022] Thus, this embodiment of the application not only guides users to capture high-quality target template images, but also accurately prompts users at appropriate times when to take the picture, further precisely guiding users to capture high-quality target template images. This enhances the user experience.

[0023] In one feasible approach, the first device can display the target template image or a thumbnail of the target template image in the shooting preview interface.

[0024] Thus, embodiments of this application can display template images or thumbnails corresponding to different shooting positions and postures, enabling users to quickly select a more satisfactory template image from multiple different shooting positions and postures for shooting. This improves shooting flexibility and user experience.

[0025] In one possible approach, while the first device is displaying a target template image or a thumbnail of the target template image in the shooting preview interface, it can respond to an operation on a three-dimensional virtual object in the shooting preview interface by displaying the target template image or a thumbnail of the target template image in the shooting preview interface.

[0026] Thus, the first device in this application embodiment can respond to the user's operation on the three-dimensional virtual object and display the corresponding template image or thumbnail, enabling the user to quickly select a more satisfactory template image for shooting from multiple different shooting positions and postures. This improves the flexibility of shooting and the user experience.

[0027] Secondly, embodiments of this application also provide a shooting method applied to a second device, the method comprising:

[0028] The second device can capture images of target objects in the target scene to obtain target template images and shooting reference information for the target template images; wherein, the shooting reference information includes the shooting position information and shooting posture information of the second device when capturing the target template images.

[0029] The second device sends the shooting reference information of the target template image to the server. The shooting reference information of the target template image is used to obtain the shooting reference information from the server. The first device displays a three-dimensional virtual object in the shooting preview interface of the target scene. The three-dimensional virtual object is used to indicate the target posture and target position. The target posture and target position are the shooting posture and position of the second device when shooting the target template image and the position in the target scene, respectively.

[0030] Thus, the second device in this embodiment can collect shooting reference information of the target template image and synchronize it to the server, facilitating the first device to subsequently display a 3D virtual object in the shooting preview interface using the shooting reference information. The 3D virtual object can clearly prompt and guide the user to move to the position of the target template image and accurately pose for shooting the target template image, enabling the user to capture high-quality images or videos. This improves the success rate of capturing high-quality images and enhances the user experience.

[0031] Thirdly, this application also provides a shooting method applied to a server, the method including:

[0032] The server receives the shooting reference information of the target template image sent by the second device; wherein, the shooting reference information includes the shooting position information and shooting posture information of the second device when shooting the target template image;

[0033] The server receives the location information of the first device sent by the first device, and determines the target scene based on the location information of the first device.

[0034] The server obtains the shooting reference information of the target template image corresponding to the target scene.

[0035] The server sends the shooting reference information of the target template image to the first device. The shooting reference information of the target template image is used by the first device to display a three-dimensional virtual object in the shooting preview interface of the target scene. The three-dimensional virtual object is used to indicate the target posture and target position. The target posture and target position are the shooting posture and position of the second device when shooting the target template image and in the target scene, respectively.

[0036] Thus, the server in this embodiment can receive shooting reference information of the target template image and send it to the first device, facilitating the first device to subsequently display a 3D virtual object in the shooting preview interface of the target scene using the shooting reference information. The 3D virtual object can clearly prompt and guide the user to move to the position of the target template image and accurately pose for shooting the target template image, enabling the user to capture high-quality images or videos. This improves the success rate of capturing images and enhances the user experience.

[0037] Fourthly, embodiments of this application also provide a shooting method applied to a shooting system, the shooting system including a first device and a server, the method including:

[0038] The first device sends its location information to the server, and the location information of the first device is used by the server to determine the target scene.

[0039] The server receives the location information of the first device sent by the first device, and determines the target scene based on the location information of the first device.

[0040] The server obtains the shooting reference information of the target template image corresponding to the target scene.

[0041] The server sends the target template image capture reference information to the first device; the target template image is an image pre-captured by the second device of the target object in the target scene.

[0042] The first device receives the shooting reference information of the target template image, and displays the three-dimensional virtual object of the second device in the shooting preview interface of the target scene based on the shooting reference information of the target template image.

[0043] Among them, the three-dimensional virtual object is used to indicate the target posture and target position, which are the shooting posture of the shooting device when shooting the target template image and the position in the target scene, respectively.

[0044] Thus, in the shooting system proposed in this application embodiment, the first device can obtain shooting reference information from the server and display a 3D virtual object in the shooting preview interface based on the shooting reference information. The 3D virtual object can clearly prompt and guide the user to move to the position of the shooting target template image and accurately pose for the shooting target template image, so that the user can shoot high-quality images or videos. This improves the success rate of shooting and the user experience.

[0045] In one feasible approach, the shooting system further includes a second device, and the method further includes:

[0046] The second device captures a picture of the target object in the target scene, obtaining a target template image and shooting reference information for the target template image. The shooting reference information includes the shooting position and shooting posture information of the second device when capturing the target template image. The second device then sends the shooting reference information of the target template image to the server.

[0047] Thus, the second device in this embodiment can collect shooting reference information of the target template image and synchronize it to the server, facilitating the first device to subsequently display a 3D virtual object in the shooting preview interface using the shooting reference information. The 3D virtual object can clearly prompt and guide the user to move to the position of the target template image and accurately pose for shooting the target template image, enabling the user to capture high-quality images or videos. This improves the success rate of capturing high-quality images and enhances the user experience.

[0048] Fifthly, embodiments of this application also provide a shooting system, which includes a first device and a server.

[0049] The first device is configured to send its location information to the server, and the location information of the first device is used by the server to determine the target scene.

[0050] The server is configured to receive the location information of the first device sent by the first device, and determine the target scene based on the location information of the first device.

[0051] The server is also configured to obtain shooting reference information of the target template image corresponding to the target scene.

[0052] The server is also configured to send shooting reference information of the target template image to the first device; the target template image is an image of the target object in the target scene that has been pre-shot by the second device.

[0053] The first device is configured to receive shooting reference information of the target template image and display the three-dimensional virtual object of the second device in the shooting preview interface of the target scene according to the shooting reference information of the target template image.

[0054] Among them, the three-dimensional virtual object is used to indicate the target posture and target position, which are the shooting posture and position in the target scene when the second device captures the target template image, respectively.

[0055] In some feasible implementations, the shooting system also includes a second device.

[0056] The second device is configured to capture images of target objects in the target scene to obtain a target template image and shooting reference information for the target template image; wherein, the shooting reference information includes the shooting position information and shooting posture information of the second device when capturing the target template image;

[0057] The second device is also configured to send reference information for capturing the target template image to the server.

[0058] In a sixth aspect, embodiments of this application also provide an electronic device, which includes a display screen, a memory, and one or more processors; the display screen is used to display a user interface of a target application, and the memory is coupled to the processor; wherein the memory stores computer program code, which includes computer instructions, and when the computer instructions are executed by the processor, the electronic device performs the shooting method as described in the first aspect above, or performs the shooting method as described in the second aspect above, or performs the shooting method as described in the third aspect above.

[0059] In a seventh aspect, embodiments of this application also provide a computer-readable storage medium storing instructions that, when executed on a computer, cause the computer to perform the shooting method as described in the first aspect above, or the shooting method as described in the second aspect above, or the shooting method as described in the third aspect above.

[0060] Eighthly, embodiments of this application also provide a computer program product comprising instructions that, when executed by an electronic device, cause the electronic device to perform the shooting method as described in the first aspect above, or the shooting method as described in the second aspect above, or the shooting method as described in the third aspect above. Attached Figure Description

[0061] Figure 1 is a schematic diagram of a shooting system provided in an embodiment of this application;

[0062] Figure 2 is a structural schematic diagram of a mobile phone provided in an embodiment of this application;

[0063] Figure 3 is a software structure block diagram of a mobile phone provided in an embodiment of this application;

[0064] Figure 4 is an interactive schematic diagram of a shooting method provided in an embodiment of this application;

[0065] Figure 5 is a schematic diagram of an interface for a target scenario provided in an embodiment of this application;

[0066] Figure 6 is a schematic diagram of collecting information of a first shooting area according to an embodiment of this application;

[0067] Figure 7 is a schematic diagram of collecting information of a second shooting area according to an embodiment of this application;

[0068] Figure 8 is a schematic diagram of a shooting preview interface provided in an embodiment of this application;

[0069] Figure 9 is a schematic diagram of a three-dimensional guide information interface provided in an embodiment of this application;

[0070] Figure 10 is a schematic diagram of a prompting information interface provided in an embodiment of this application;

[0071] Figure 11 is a schematic diagram of an interface showing a thumbnail of a target template image corresponding to a target virtual object, provided in an embodiment of this application.

[0072] Figure 12 is a hardware schematic diagram of a mobile phone provided in an embodiment of this application. Detailed Implementation

[0073] The technical solutions of the embodiments of this application will be described below with reference to the accompanying drawings. In the description of this application, unless otherwise stated, " / " indicates that the objects before and after are in an "or" relationship. For example, A / B can represent A or B. "And / or" in this application is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, and B alone, where A and B can be singular or plural. Furthermore, in the description of this application, unless otherwise stated, "multiple" refers to two or more. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or multiple. In addition, in order to clearly describe the technical solutions of the embodiments of this application, the terms "first" and "second" are used in the embodiments of this application to distinguish the same or similar items with basically the same function and effect.

[0074] Those skilled in the art will understand that the terms "first," "second," etc., do not limit the quantity or order of execution, and that "first," "second," etc., are not necessarily different. Furthermore, in some embodiments of this application, words such as "exemplary" or "for example" are used to indicate that something is being described as an example, illustration, or description. Any embodiment or design scheme described as "exemplary" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or design schemes. Specifically, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner for ease of understanding.

[0075] Furthermore, the device architecture and business scenarios described in the embodiments of this application are for the purpose of more clearly illustrating the technical solutions of the embodiments of this application, and do not constitute a limitation on the technical solutions provided in the embodiments of this application. As those skilled in the art will know, with the evolution of device architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of this application are also applicable to similar technical problems.

[0076] With the continuous iteration of electronic device shooting functions and increasingly better shooting performance, using electronic devices for photography has become a common habit, especially when taking photos at tourist attractions, popular photo spots, and recommended buildings. Capturing high-quality photos or videos (such as those taken from a good vantage point or at a suitable angle) has become a common user demand. Therefore, convenient shooting assistance capabilities are needed to help users find the best framing angles or positions.

[0077] In related technologies, guide photo A is taken by camera B at a position of longitude X and latitude Y. When guide photo A was taken, camera B was facing east, and its pitch angle was one degree downwards. Therefore, the description information corresponding to guide photo A includes the first location information as longitude X and latitude Y, and the first shooting parameter information as camera facing east and camera angled downwards by one degree. However, when multiple recommended framing positions and postures exist for the same location, guidance becomes difficult. Furthermore, if the camera is angled downwards by one degree, users cannot accurately adjust the camera angle downwards, easily resulting in photos or videos that do not meet user expectations, leading to a low success rate and a reduced user experience.

[0078] To address the aforementioned problems, this application provides a shooting method applied to a first device, the method comprising:

[0079] The first device can receive and respond to a shooting preview operation by displaying a shooting preview interface. The shooting preview interface includes a preview of the target object in the target scene by the first device. The first device can also display a three-dimensional virtual object of the shooting device that captured the target template image in the shooting preview interface.

[0080] Among them, the target template image is an image pre-captured by the shooting device of the target object in the target scene; the three-dimensional virtual object is used to indicate the target posture and target position, which are the shooting posture of the shooting device when capturing the target template image and the position in the target scene, respectively.

[0081] Thus, in this embodiment of the application, during the display of the shooting preview interface, a three-dimensional virtual object can be shown. This three-dimensional virtual object can clearly prompt and guide the user to move to the position of the target template image and accurately pose for shooting the target template image. During the visual recommendation process, spatial position, direction, and device posture can be indicated to enable the user to capture high-quality images or videos. This improves the success rate of shooting and enhances the user experience.

[0082] The shooting method provided in this application embodiment can be applied to a shooting system. Referring to Figure 1, a shooting system provided in this application embodiment includes a first device 101 (e.g., a mobile phone that a user wants to shoot a target template image), a second device 102 (e.g., a mobile phone that shoots a target template image), and a server 103.

[0083] In some embodiments, a communication connection is established between the first device 101, the second device 102, and the server 103. The server 103 can serve as an interaction medium between the first device 101 and the second device 102. The server 103 is used to store and manage the spatial information of the target template image in this embodiment, so that the first device and the second device can establish an association between different devices in the same scene based on the spatial information corresponding to the target template image. The server 103 can be implemented as a server cluster consisting of multiple servers, or as a single server.

[0084] In some embodiments, the wireless communication technologies used to establish wireless communication connections include, but are not limited to, at least one of the following: wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT) (e.g., classic Bluetooth or Bluetooth Low Energy (BLE) Bluetooth), near field communication (NFC), Zigbee, frequency modulation (FM), and infrared (IR).

[0085] In some examples, the second device can collect first-shot area information and record recommended shooting poses for target objects in the target scene. The recommended shooting pose includes a recommended shooting position and a recommended shooting posture. For ease of description later, the recommended shooting position will be referred to as the target position, and the recommended shooting posture as the target posture. The second device can use spatial environment perception and positioning to locate itself in a suitable shooting area, collect first-shot area information (also known as spatial anchoring information), and upload it to server 103 for storage.

[0086] Furthermore, the second device can also capture an image of the target template and upload the corresponding shooting reference information to the server 103 for storage. The shooting reference information may include the target position and target posture when the second device captures the target template image.

[0087] When the first device is in the target scene and photographing the target object, it can collect second shooting area information and recommend shooting pose matching. The collected second shooting area information is used to match with the first shooting area information collected by the second device, unifying the different spaces occupied by different devices. Specifically, the first device can download the first shooting area information from the server and identify the environment in the shooting preview interface, matching the current position of the first device with the first shooting area information. That is, matching the current position of the first device with the position of the second device when photographing the target template image into the same space. The first device can also download shooting reference information corresponding to the target template image from the server and display a three-dimensional virtual object in the shooting preview interface based on the shooting reference information corresponding to the target template image, thereby realizing a visualized shooting pose recommendation process.

[0088] It should be noted that the first device mentioned above can be the same device as the second device, or they can be two different devices. The second device can also be referred to as the filming device.

[0089] In some embodiments, the first device 101 and the second device 102 may include at least one of the following: mobile phone, laptop computer, desktop computer, foldable electronic device, tablet computer, desktop computer, laptop computer, handheld computer, Ultra-Mobile Personal Computer (UMPC), netbook, cellular phone, Personal Digital Assistant (PDA), Augmented Reality (AR) device, Virtual Reality (VR) device, Artificial Intelligence (AI) device, wearable device, in-vehicle device, smart home device, or smart city device. This application embodiment does not impose any special limitations on the specific types of the first device 101 and the second device 102.

[0090] The operating systems installed on the first device 101 and the second device 102 include, but are not limited to, those that ... Alternatively, other operating systems may be used. Of course, electronic devices may not have an operating system installed. This application does not limit the specific types of the first device 101 and the second device 102, whether or not an operating system is installed, or the type of operating system if an operating system is installed.

[0091] Of course, the shooting system provided in this application embodiment may also include other electronic devices besides the first device 101, the second device 102, and the server 103. The shooting system provided in this application embodiment includes, but is not limited to, information interaction between three devices, and may also include information interaction between one device and multiple devices. Those skilled in the art can determine the type and number of electronic devices according to actual needs, and these designs do not exceed the protection scope of this application embodiment.

[0092] The first device 101 and the second device 102 in the embodiments of this application can be implemented by different / the same devices.

[0093] For example, taking mobile phones as the first and second devices, Figure 2 shows a structural schematic diagram of mobile phone 100.

[0094] Mobile phone 100 may include processor 110, external memory interface 120, internal memory 121, Universal Serial Bus (USB) interface 130, charging management module 140, power management module 141, battery 142, antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, sensor module 180, buttons 190, motor 191, indicator 192, camera 193, display screen 194, and Subscriber Identification Module (SIM) card interface 195, etc.

[0095] The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and an image sensor 180N.

[0096] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the mobile phone 100. In other embodiments of this application, the mobile phone 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0097] Processor 110 may include one or more processing units, such as an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU). These different processing units may be independent devices or integrated into one or more processors.

[0098] The controller can serve as the central nervous system and command center of the mobile phone 100. Based on the instruction operation code and timing signals, the controller generates operation control signals to control the fetching and execution of instructions.

[0099] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0100] The wireless communication function of mobile phone 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor.

[0101] The wireless communication module 160 can provide solutions for wireless communication applications on the mobile phone 100, including Wireless Local Area Networks (WLAN) (such as Wireless Fidelity (Wi-Fi) networks), Bluetooth (BT), Global Navigation Satellite System (GNSS), Frequency Modulation (FM), Near Field Communication (NFC), and Infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, modulates and filters the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, modulate and amplify them, and then convert them into electromagnetic waves for radiation via antenna 2.

[0102] In some embodiments, antenna 1 of mobile phone 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling mobile phone 100 to communicate with networks and other devices via wireless communication technology. Wireless communication technology may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time-Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. GNSS can include the Global Positioning System (GPS), the Global Navigation Satellite System (GLONASS), the Beidou Navigation Satellite System (BDS), the Quasi-Zenith Satellite System (QZSS), and / or Satellite Based Augmentation Systems (SBAS).

[0103] The mobile phone 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0104] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. In some embodiments, the mobile phone 100 may include one or N displays screens 194, where N is a positive integer greater than 1.

[0105] The mobile phone 100 can achieve shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.

[0106] The ISP (Image Signal Processor) is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, transforming it into an image visible to the naked eye. The ISP can also perform algorithmic optimization on image noise and brightness. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.

[0107] Camera 193 is used to capture still images or videos. An object is projected onto a photosensitive element by generating an optical image through the lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to an ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, or other formats. In some embodiments, mobile phone 100 may include one or N cameras 193, where N is a positive integer greater than 1.

[0108] Here, the camera 193 can be located within the mobile phone 100. Alternatively, it can be a component of the first device. In some implementations, the camera can also be located externally to the first device and connected via wired or wireless means. For example, the camera can connect to the first device via Bluetooth or a mobile hotspot. The first device can control the camera by sending or receiving commands.

[0109] The mobile phone 100 may also include a camera module, which can be located within the camera 193. Alternatively, it can be located in other positions within the mobile phone 100. The camera module includes a lens, a focusing motor, a base, a circuit board, and an image sensor.

[0110] The base is fixedly connected to one side of the circuit board. The focusing motor is located on the side of the base away from the circuit board and is fixedly connected to the periphery of the base. The lens is mounted in the middle of the focusing motor. The image sensor is fixed to the side of the circuit board facing the lens.

[0111] The lens is used to capture the light signal reflected from the subject. The focusing motor is used to drive the lens to move in a direction parallel to the optical axis. The optical axis refers to the line passing through the center of the lens. In some embodiments, the mobile phone 100 can control the focusing motor to move the lens to the focusing position, thereby completing the focusing process.

[0112] In some embodiments, the focusing motor may be a voice coil motor (VCM), a shape memory alloy (SMA) motor, a piezo motor (PM), or a stepper motor (STM), etc.

[0113] The external storage interface 120 can be used to connect an external storage card, such as a Micro SD card, to expand the storage capacity of the mobile phone 100. The external storage card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, music, video, and other files can be saved on the external storage card.

[0114] The mobile phone 100 can achieve audio functions such as music playback and recording through the audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.

[0115] The image sensor 180N can be used to detect objects within the range captured by the camera, with each photosensitive unit corresponding to a pixel in the image sensor. The image sensor 180N may include a color (red, green, blue, RGB) image sensor, a monochrome image sensor, and an infrared image sensor, etc., but this embodiment does not limit the specific type. The image sensor 180N is used to acquire raw images, which may include RGB images, RYB images, monochrome images, and infrared images, etc.

[0116] For ease of description, the 180N image sensor will be used as an example, with an RGB image sensor as well as an example of an RGB image as the original image. For instance, the original image can be a single frame of an RGB image. Each photosensitive unit is covered with an RGB (red, green, blue) filter. Thus, after receiving light, the photosensitive unit generates a corresponding current, the magnitude of which corresponds to the light intensity. Therefore, the electrical signal directly output by the photosensitive unit is analog. This analog electrical signal is then converted into a digital signal, and finally, all the resulting digital signals are output as a digital image matrix to a dedicated DSP processing chip for processing. The RGB image sensor outputs a full-frame image of the captured area in frame format.

[0117] In some embodiments, multiple image sensors can be arranged in the same camera. For example, a single-lens dual-sensor camera integrates both an RGB image sensor and a motion sensor within a single camera. Other examples include dual-lens dual-sensor cameras and single-lens triple-sensor cameras, where these sensors are used to image the same subject. When the number of lenses is less than the number of sensors, a beam splitter can be placed between the lenses and sensors to distribute the light entering through one lens across multiple sensors, ensuring that each sensor receives light. Furthermore, the number of processors in these cameras can be one or more. This application does not specifically limit the arrangement or number of components.

[0118] In other embodiments, only one image sensor may be used in the same camera.

[0119] In some embodiments, camera calibration is typically performed before the image sensor leaves the factory to make the image information acquired by the image sensor more accurate.

[0120] In some embodiments, the camera 193 can capture still images or moving images. The display screen 194 is used to display the still images or moving images, such as in a shooting preview interface.

[0121] The first device provided in this application embodiment can run an operating system (OS). This operating system can be various operating systems used in industry, such as an operating system developed based on OpenHarmony, for example... Or other operating systems, such as The iOS mobile operating system; it can also be various open-source operating systems or their derivatives, such as Linux. This includes other embedded operating systems; it can also refer to future new operating systems, such as AI operating systems based on artificial intelligence. An operating system is a set of interconnected system software programs that manage and control the operation of a primary device, utilize and run hardware and software resources, and provide public services to organize user interactions.

[0122] The operating system in the first device connects downwards to the physical devices of the hardware layer and upwards to provide a runtime environment for application software.

[0123] An operating system typically includes a kernel layer, a middleware layer, and an application layer. The application layer comprises applications, which can include system applications and third-party applications. The middleware layer includes a suite of software providing various services to application developers, or frameworks providing services such as databases, multimedia, and graphics, or capabilities such as distributed scheduling and system scaling.

[0124] For example, the middleware layer may include a framework layer and / or a system service layer. The framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. The system service layer includes the core capabilities of the system and provides services to applications through the framework layer. The kernel layer is the layer between hardware and software. The kernel layer may include hardware drivers and the operating system kernel. In addition to providing hardware drivers, the kernel layer also supports functions such as memory management and system process management.

[0125] The types and forms of first devices we use in our daily lives vary greatly, and the scenarios in which they are applied are also very wide. Therefore, based on the different forms and functions of first devices, different application scenarios, and different user needs, the operating systems used on first devices may also be different. The basic functions implemented by the first device provided in this application can be implemented using a general-purpose operating system or a dedicated operating system.

[0126] To more clearly illustrate the implementation of the embodiments of this application under a specific operating system, the following is shown. Based on the architecture, those skilled in the art can deduce the implementation of the embodiments of this application under other specific operating systems, such as... Implementation under operating systems, etc.

[0127] Figure 3 is a software structure block diagram of the mobile phone 100 according to an embodiment of this application.

[0128] The software architecture of Mobile Phone 100 can be divided into several layers. In some embodiments, from bottom to top, these layers are: kernel layer, system service layer, framework layer, and application layer. Layers communicate with each other through software interfaces. System functions can be tailored, added, or combined at the subsystem level depending on the deployment scenario of different device forms. Each subsystem can also be tailored, added, or combined at the functional level.

[0129] The kernel layer includes the kernel abstraction layer, the kernel subsystem, and the driver subsystem.

[0130] The Kernel Abstraction Layer (KAL) provides basic kernel capabilities to upper layers by shielding the differences between multiple kernels, including but not limited to process / thread management, memory management, file system, network management, and peripheral device management.

[0131] Kernel Subsystem: Supports the selection of a suitable OS kernel for different resource-constrained devices, including but not limited to Linux kernel, HarmonyOS kernel, LiteOS (Lite Operating System), etc.

[0132] Driver Subsystem: The driver framework is the foundation for the open system hardware ecosystem, providing unified peripheral access capabilities and a framework for driver development and management. The driver framework includes: display drivers, camera drivers, audio drivers, Bluetooth drivers, sensor drivers, etc.

[0133] The system service layer comprises the core capabilities of the system, providing services to applications through the framework layer. This layer includes, but is not limited to, the following subsystems:

[0134] The system's basic capability subsystem set provides fundamental capabilities for the operation, scheduling, and migration of distributed applications across multiple devices. This set may include distributed soft bus, distributed data management, distributed task scheduling, and Ark multi-language runtime; it may also include multi-modal input subsystem, graphics subsystem, security subsystem, and AI business subsystem.

[0135] Basic software service subsystem set: provides public and general software services; the basic software service subsystem set may include event notification subsystem, telephone service subsystem, multimedia subsystem, etc.

[0136] Enhanced software service subsystem suite: Provides differentiated enhanced software services for different devices; the enhanced software service subsystem suite may include smart screen proprietary business subsystem, wearable proprietary business subsystem, IoT proprietary business subsystem, etc.

[0137] Hardware service subsystem set: Provides hardware services; the hardware service subsystem set may include location service subsystem, user IAM (Identity and Access Management) subsystem, wearable proprietary hardware service subsystem, biometric identification subsystem, IoT proprietary hardware service subsystem, etc.

[0138] Distributed task scheduling enables distributed service management (discovery, synchronization, registration, and invocation), supporting remote startup, remote invocation, remote connection, and migration of applications across devices.

[0139] Distributed data management enables data synchronization, data storage, data sharing, and data access across all scenarios and devices.

[0140] The distributed soft bus provides communication-related capabilities for seamless interconnection between multiple devices, including: WLAN service capabilities, Bluetooth service capabilities, soft bus, inter-process communication RPC (Remote Procedure Call), and StarFlash communication capabilities.

[0141] Ark Multilingual Runtime is a unified compilation runtime platform designed to support the joint compilation and execution of multiple programming languages ​​and multiple chip platforms.

[0142] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. The framework layer includes: the ArkUI framework (which provides a complete infrastructure for UI development of system applications, including UI functions such as components, layouts, animations, and interactive events, as well as a real-time interface preview tool), the user application framework, and the Ability framework (an Ability is a lightweight application; the Ability framework schedules and manages the operation and lifecycle of Abilities). Different devices may have different operating systems, and therefore support different APIs.

[0143] The HarmonyOS API is designed to support... HarmonyOS API provides a range of open capabilities for application development. It can be configured at the framework layer or independently of it. The HarmonyOS API includes the Audio API, Push API, and Account API, among others.

[0144] Applications can include system apps and extended / third-party apps. System apps can include the desktop, control bar, settings, contacts, input method, gallery, etc., while extended / third-party apps can include social apps, travel apps, etc.

[0145] The following embodiments, with reference to the accompanying drawings, will use mobile phones having the structure shown in FIG2 as examples to illustrate the shooting method provided by the embodiments of this application. Referring to FIG4, the method may include:

[0146] S401, The second device collects information about the first shooting area and the positioning information of the second device corresponding to the target scene.

[0147] The first shooting area information includes key point information of the target object in the target scene.

[0148] In some embodiments of this application, the second device may have an application program (APP) with shooting function, such as a camera application, installed. The first user can use the application to capture pictures and videos.

[0149] The first user can use the camera application on the second device to pre-capture a target template image corresponding to the target object in the target scene, which will then be recommended to the second user who wants to photograph the target object.

[0150] The target template image can be understood as an image generated after photographing the target object, showing a better framing and composition. Therefore, before the first user photographs the target template image, they need to use a second device to collect information about the first shooting area around the target object in the target scene. This helps the second user determine the position and orientation of their shooting device within the target scene when entering to take photos.

[0151] In some examples, the second device can acquire at least one image corresponding to the target object in the target scene, and generate first shooting area information corresponding to the target scene based on the acquired at least one image.

[0152] In one possible implementation, the second device can scan the target object in the target scene using a camera, and use computer vision algorithms to extract feature points from at least one captured image. The extracted feature points are unique identifiers of the target object in the target scene.

[0153] In another possible implementation, the second device may also capture at least one video or image of the target object in the target scene using a camera, and use computer vision algorithms to extract feature points from the captured at least one video or image.

[0154] For example, referring to (A)-(C) in Figure 5, the target scene can be a tourist scene, such as Park A in Beijing. The target object can be Tower A in Park A. The second device can capture three images corresponding to Tower A, for example, capturing three images sequentially from farthest to closest to Tower A. The second device can extract feature points from the above three images and abstract the shooting area corresponding to the images into a spatial coordinate system.

[0155] For example, referring to Figure 6(A), the second device can scan the target object in the target scene using a camera, extract feature points from at least one captured image, and establish a first spatial coordinate system. Using the shooting position of the second device as the origin, the spatial three-dimensional coordinates corresponding to multiple feature points in three images are extracted sequentially. The spatial three-dimensional coordinates corresponding to multiple feature points in the three images constitute the first shooting area information corresponding to the target scene.

[0156] It should be noted that the process of extracting the information of the first shooting area described above can employ methods such as relevant corner detection and convolutional neural networks. This application does not specifically limit the extraction process described above. Furthermore, the specific process of establishing the first spatial coordinate system is not limited.

[0157] In some embodiments of this application, the second device needs to collect current positioning information. Positioning information may include GPS (Global Positioning System) data and / or BeiDou satellite data.

[0158] For example, when the second device is taking a picture of Tower A in Park A in Beijing, it can obtain the location information during the shooting process as "Park A in Beijing" or "Beijing".

[0159] In some embodiments of this application, the second device can also associate the collected first shooting area information and positioning information to clarify the framing environment of the target object in the target scene and the shooting location when the image is captured.

[0160] Understandably, the shooting location refers to the geographical location, or location, where the device takes the image (e.g., Beijing, or Park A in Beijing). This allows for the rapid acquisition of relevant information about the shooting location by combining it with the location data, thereby improving the efficiency of the subsequent recommended shooting process.

[0161] In some embodiments of this application, the second device may also capture at least one video, and determine the first shooting area information and the positioning information of the second device corresponding to the target scene based on the at least one video. This application does not limit the number of images captured by the second device or the specific format of the images.

[0162] S402, The second device sends the first shooting area information and the location information of the second device corresponding to the target scene to the server.

[0163] S403. The server receives and stores the first shooting area information and the positioning information of the second device corresponding to the target scene.

[0164] In some embodiments of this application, the server can receive the first shooting area information corresponding to the target scene and the positioning information of the second device sent by the second device, and store them.

[0165] The first shooting area information may include the spatial three-dimensional coordinates of feature points in at least one image.

[0166] The server can store the information of the first captured area. It can be understood that the spatial three-dimensional coordinates of the feature points in the first captured area information are used to characterize the position of the feature points in the target scene during the image acquisition process by the second device. The server can store and manage this information, ensuring its security and integrity, and providing a foundation for subsequent retrieval and use.

[0167] S404. The second device takes a picture of the target object in the target scene to obtain a target template image and shooting reference information for the target template image.

[0168] The shooting reference information includes the shooting position information and shooting posture information of the second device when shooting the target template image.

[0169] S405. The second device sends the target template image capture reference information to the server.

[0170] The shooting reference information of the target template image is used by the first device to display the three-dimensional virtual object of the second device in the shooting preview interface of the target scene.

[0171] S406. The server receives and stores the shooting reference information of the target template image.

[0172] In some embodiments of this application, a first user can acquire a target template image corresponding to a target object in a target scene using a second device. The second device can respond to the first user's shooting operation by acquiring the target template image and shooting reference information for the target template image. That is, the first user can find a framing position, a shooting position with good composition, and a shooting angle to take a picture and obtain the target template image.

[0173] Specifically, referring to Figure 6(B), the second device can collect the shooting position information and shooting posture information corresponding to the target template image during the process of acquiring the target template image.

[0174] For example, the shooting position information of the target template image can be the position coordinates of the current shooting position of the second device in the first spatial coordinate system. The shooting posture information can be the four data points corresponding to the current shooting posture of the second device in the first spatial coordinate system.

[0175] The second device can utilize sensors to acquire shooting posture information when capturing the target template image. Examples include accelerometers, angular velocity sensors, and magnetometers. Alternatively, the second device can use image recognition and analysis algorithms to process feature points and edge information in the target template image captured by a camera, thereby inferring the shooting posture information when capturing the target template image. Of course, the second device can also combine sensor data collected by sensors with information acquired through computer vision technology to determine the shooting posture information when capturing the target template image. This application does not limit the scope of this embodiment.

[0176] In some embodiments of this application, the second device may send a target template image to the server. The server receives and stores the target template image sent by the second device. The second device may also send shooting reference information of the target template image to the server, and the server receives and stores the shooting reference information of the target template image sent by the second device. Alternatively, the second device may send both the target template image and its shooting reference information to the server, and the server receives and stores both. This application does not limit the scope of these embodiments.

[0177] In this way, the second device can record the target template image and the shooting position and posture when shooting the target template image, and synchronize it to the server, so that the shooting position and posture when shooting the target template image can be accurately recommended to the second user in the subsequent shooting target scene.

[0178] It should be noted that the shooting position of the device mentioned above refers to the spatial position of the device (specifically, a camera) in the target scene when taking photos or videos. Of course, it can also refer to geographical location, such as shooting distance and shooting height. Shooting distance refers to the distance between the camera and the subject. Shooting height refers to the height of the camera above the ground.

[0179] S407. The first device collects information about the second shooting area corresponding to the target scene and the positioning information of the first device.

[0180] The second shooting area information includes key point information corresponding to the target object in the target scene.

[0181] In some embodiments of this application, the first device also has an application with shooting capabilities, such as a camera app, installed. A second user using the first device can use the camera app to capture images and videos. When the second user is in the target scene and wants to photograph the target object, the first device needs to collect information about a second shooting area around the target object in the target scene. This facilitates the subsequent unification of the current spatial location of the first device with the spatial location of the second device, enabling different devices to be associated even if they are in different locations within the same scene.

[0182] In some embodiments of this application, the first device and the second device may be the same device. When they are the same device, the first device can collect and store information about a first shooting area. Subsequently, the first device can also collect information about a second shooting area. Thus, the device can directly unify its current spatial location with its spatial location when capturing the target template image, facilitating association even when the device is in different locations within the same scene at different times.

[0183] In some embodiments of this application, the first device may also collect and store current location information during the process of collecting information about the first shooting area. This way, when the first device is subsequently located in the target scene again and collects information about the second shooting area, it can determine the target scene based on the current location information, thereby obtaining the first shooting area information corresponding to the target scene.

[0184] In some embodiments of this application, the first device can receive a shooting preview operation and, in response to the shooting preview operation, display a shooting preview interface. The shooting preview interface includes a preview image of the target object in the target scene viewed by the first device.

[0185] The shooting preview operation can include user-triggered clicks that initiate the photo or video preview state. For example, a user clicking the camera app icon. Afterwards, the first device enters the photo or video preview state, acquires initial image data, and displays the shooting preview interface.

[0186] For example, after the first device detects a user's click on the camera app icon, it can launch the camera app. After launching the camera app, the first device can enter shooting mode and display a shooting preview interface in preview mode.

[0187] In some examples, the first device may use a camera application to capture at least one image of a target object in a target scene, and generate second shooting area information corresponding to the target scene based on capturing at least one image.

[0188] In one possible implementation, the first device can scan a target object in a target scene using a camera, and use a computer vision algorithm to extract feature points from at least one captured image. The extracted feature points can be unique identifiers of the target object in the target scene.

[0189] For example, referring to Figure 7, the target scene is also Park A in Beijing. The target object can be Tower A in Park A. The first device can acquire three images corresponding to Tower A, such as acquiring three images sequentially from farthest to closest to Tower A. The first device can extract feature points from the above three images and abstract the shooting area corresponding to the image into a spatial coordinate system. Taking the shooting position of the first device as the origin, the spatial three-dimensional coordinates corresponding to multiple feature points in the three images are extracted sequentially to establish a second spatial coordinate system. The spatial three-dimensional coordinates corresponding to multiple feature points in the three images constitute the second shooting area information corresponding to the target scene.

[0190] In another possible implementation, the first device may also capture at least one image of the target object in the target scene using a camera, and use computer vision algorithms to extract feature points from at least one image.

[0191] It is understandable that a second spatial coordinate system can be established using the second shooting area information. With the shooting position of the first device as the origin, the spatial three-dimensional coordinates corresponding to multiple feature points in at least one image are extracted sequentially. The spatial three-dimensional coordinates corresponding to multiple feature points in at least one image constitute the second shooting area information corresponding to the target scene.

[0192] In some embodiments, when the shooting location of the first device is different from the shooting location of the second device, the first spatial coordinate system and the second spatial coordinate system are different. When the shooting location of the first device is the same as the shooting location of the second device, the first spatial coordinate system and the second spatial coordinate system are the same.

[0193] In some embodiments of this application, the first device needs to collect current location information. The location information may include GPS data and / or BeiDou satellite data. For example, when the first device is photographing a target object in a target scene, i.e., photographing Park A in Beijing, the location information obtained during the photographing process could be "Park A in Beijing".

[0194] Similarly, the first device can also capture at least one video and determine the second shooting area information corresponding to the target scene and the positioning information of the first device based on the at least one video. This application embodiment does not limit the number of images captured by the first device or the specific format of the images.

[0195] S408, The first device sends a matching request to the server.

[0196] The matching request is used to request the server to return the first shooting area information, which is then used to match the second shooting area information.

[0197] S409. The server receives the matching request sent by the first device and sends the first shooting area information to the first device.

[0198] In some embodiments of this application, the matching request may carry the location information of the first device. This location information is used by the server to determine the target scene, thereby obtaining the first shooting area information corresponding to the target scene. In other words, the first device sends its location information to the server. Specifically, the server can determine the target scene based on the location information of the first device. The server can also obtain the first shooting area information corresponding to the target scene.

[0199] It is understandable that the target scene and the target object being photographed by the first and second devices are the same, but their shooting positions within the target scene may not be exactly the same. Therefore, the first device can send its current location information to the server, so that the server can subsequently return the shooting area information corresponding to the target scene.

[0200] In some embodiments of this application, the first device can obtain the first shooting area information of the second device through positioning information, and then match the second shooting area information it has collected with the first shooting area information, and match the spatial three-dimensional coordinates it has collected with the spatial three-dimensional coordinates in the first shooting area information, so as to unify the pre-collected space and the space to be shot.

[0201] The first device can determine its current position in a second spatial coordinate system. Specifically, the first device receives first imaging area information sent by the server and determines a spatial mapping relationship based on the first and second imaging area information. The first device can also convert its current position into second position information in the first spatial coordinate system based on the spatial mapping relationship. In other words, the second imaging area information collected by the first device includes the current position information corresponding to its current position, and the first device can convert its own collected three-dimensional coordinates into the second device's first spatial coordinate system.

[0202] The spatial mapping relationship is used to indicate the transformation relationship between the position information of an object in the first spatial coordinate system and the second spatial coordinate system. The current position information of the first device is used to indicate the current position of the first device in the target scene, and the current position information is the position information of the first device in the second spatial coordinate system.

[0203] In some embodiments of this application, the first shooting area information includes the first position information of the second device in the first spatial coordinate system. The first device may also convert the first position information into second position information in the second spatial coordinate system according to a spatial mapping relationship.

[0204] In other words, the first device can convert the three-dimensional coordinates of the space acquired by the second device into its own second spatial coordinate system. The first device can convert the first position information in the first shooting area information into the second position information in the second spatial coordinate system corresponding to the second shooting area information.

[0205] Thus, the first device in this embodiment can perform the conversion and calibration process of spatial information, enabling the transfer of spatial information between devices. This facilitates the accurate display of feature points in the target environment at the same physical location on different devices, ensuring consistency across devices.

[0206] In some embodiments of this application, the server may also perform the above-described spatial information conversion and calibration process.

[0207] In some examples, the server can also receive information about the second shooting area from the first device and match the second shooting area information with the first shooting area information.

[0208] In other words, the spatial three-dimensional coordinates of different devices are transformed into a single coordinate system. For example, the information of the second shooting area is transformed into the first spatial coordinate system where the information of the first shooting area is located. Another example is the transformation of the information of the first shooting area into the second spatial coordinate system where the information of the second shooting area is located.

[0209] Specifically, the first device can send the collected information about the second shooting area to the server. The server receives the information about the second shooting area and matches it with the information about the first shooting area to obtain a matching result. The server then sends the matching result back to the first device.

[0210] In this way, the server can not only store and manage data, but also perform coordinate transformation and calibration processes. While ensuring data security, it also facilitates ensuring that multiple feature points in an image are accurately displayed in the same physical location on different devices, ensuring consistency between the first and second devices.

[0211] In some embodiments of this application, multiple different users can use the same or different second devices to collect multiple different first shooting area information. When spatial information differs during multiple acquisition processes, the second device or server can convert and calibrate the multiple different spatial information to unify the spatial information across the multiple acquisition processes.

[0212] For example, the first shooting area information includes shooting area information A and shooting area information B. User A uses a second device to collect shooting area information A. User B uses a second device to collect shooting area information B. User A and User B are located in different shooting positions. Thus, in a scenario with multiple first shooting area information, there will be two different first spatial coordinate systems, such as spatial coordinate system A and spatial coordinate system B, where spatial coordinate system A is established using shooting area information A, and spatial coordinate system B is established using shooting area information B.

[0213] In one feasible approach, the second device can perform the conversion and calibration process of spatial information during the two acquisition processes.

[0214] User A uses a second device to collect shooting area information A, and the second device sends shooting area information A to the server. When User B uses the second device to collect shooting area information B, the second device can obtain shooting area information A from the server and match shooting area information A with the collected shooting area information B. Of course, the second device can also obtain shooting area information A from the first device; this embodiment does not limit this.

[0215] For example, the second device can map the three-dimensional spatial coordinates located in spatial coordinate system B to spatial coordinate system A, obtaining updated shooting area information B. Then, the second device can send the updated shooting area information B to the server.

[0216] In another possible approach, the server can perform the conversion and calibration process of spatial information during the two acquisition processes.

[0217] User A uses a second device to collect shooting area information A, and the second device sends shooting area information A to the server. User B uses the second device to collect shooting area information B, and the second device sends shooting area information B to the server. The server can map the three-dimensional spatial coordinates of shooting area information B, located in spatial coordinate system B, to spatial coordinate system A, to obtain updated shooting area information B. Then, the server stores the updated shooting area information B.

[0218] In some embodiments, the server may also filter multiple first shooting area information according to preset rules, and send one or more filtered first shooting area information to the first device, so as to facilitate subsequent matching of the filtered one or more first shooting area information with the second shooting area information.

[0219] For example, the preset rules include sorting by time and filtering out the N first shooting area information that is closest to the current time. It should be noted that the embodiments of this application do not limit the specific implementation of the preset rules.

[0220] S410, The first device sends a template retrieval request to the server.

[0221] The template retrieval request is used to request the shooting reference information of the target template image.

[0222] S411. The server receives the template acquisition request sent by the first device and sends the target template image capture reference information to the first device.

[0223] S412, The first device displays a three-dimensional virtual object of the second device in the shooting preview interface, showing the target template image.

[0224] In some embodiments of this application, the template acquisition request may carry the location information of the first device. This location information is used by the server to determine the target scene, thereby acquiring the target template image corresponding to the target scene and the shooting reference information of the target template image. That is, the first device can send its location information to the server, and the server can determine the target scene and find the target template image and the shooting reference information of the target template image corresponding to the target scene based on the location information. The first device can receive the shooting reference information of the target template image returned by the server. The number of target template images can be one or multiple.

[0225] For example, if the location information of the first device is "Park A in Beijing", the server can find multiple target template images corresponding to "Park A in Beijing". The server can find multiple target template images and shooting reference information for the target template images corresponding to the target scene, and send the shooting reference information for the multiple target template images corresponding to the target scene to the first device. Of course, the server can also send multiple target template images corresponding to the target scene to the first device.

[0226] After receiving the shooting reference information of multiple target template images corresponding to the target scene, the first device can filter out the shooting reference information of the target template image corresponding to the target object from the shooting reference information of multiple target template images corresponding to the target scene based on the first shooting area information.

[0227] In other words, "Park A in Beijing" can include multiple subjects, such as Tower A, Tower B, and Tower C. The target scene can correspond to multiple target template images, including the target template image corresponding to Tower A, the target template image corresponding to Tower B, and the target template image corresponding to Tower C. The first device can, based on the acquired first shooting area information, filter out the shooting reference information for the target template image corresponding to Tower A from the shooting reference information of the multiple target template images corresponding to the target scene.

[0228] In some embodiments of this application, the template acquisition request may carry the positioning information of the first device and the second shooting area information. The positioning information of the first device and the second shooting area information are used by the server to determine the target object in the target scene, the target template image corresponding to the target object, and the shooting reference information of the target template image. In this way, the server can receive the template acquisition request sent by the first device and send the shooting reference information of the target template image to the first device.

[0229] It is understandable that the second shooting area information collected by the first device is for tower A. The server can determine the target object in the target scene and the corresponding target template image based on the positioning information of the first device and the second shooting area information.

[0230] For example, the server can search for multiple target template images corresponding to "Park A in Beijing" based on the given information. These multiple target template images may include target template images corresponding to tower A, tower B, and tower C. Next, the server can search for the target template image corresponding to "tower A in Park A in Beijing" from the multiple target template images corresponding to "Park A in Beijing" based on the second shooting area information. The server can find the target template image corresponding to the target object and send the shooting reference information of the target template image corresponding to the target object to the first device. Alternatively, the server can also send the target template image corresponding to the target object to the first device.

[0231] In some embodiments of this application, the template acquisition request can also be an acquisition instruction, which instructs the server to return the shooting reference information of the target template image. The server receives the template acquisition request and, in response, determines the shooting reference information of the target template image corresponding to the target scene. Specifically, the server can determine the target scene based on the template acquisition request. The server can also acquire the shooting reference information of the target template image corresponding to the target scene. This application does not limit whether the template acquisition request carries information or the specific information carried.

[0232] In some embodiments of this application, during the process of acquiring the first shooting area information and the shooting reference information of the target template image, the first device may send the positioning information of the first device to the server and receive the shooting reference information of the target template image returned by the server.

[0233] In other words, after receiving the location information from the first device, the server can determine the target scene corresponding to the first device's location information. The server can also obtain the first shooting area information and the shooting reference information of the target template image corresponding to the target scene. Then, the server can send the first shooting area information and the shooting reference information of the target template image to the first device.

[0234] It should be noted that the embodiments of this application do not limit the specific interaction method between the first device and the server during the process of obtaining the first shooting area information and the shooting reference information of the target template image.

[0235] In some embodiments of this application, the first device can photograph a target object in a target scene to obtain a target template image and shooting reference information for the target template image. The first device can also store the target template image and the shooting reference information. Thus, after performing spatial information conversion and calibration, the first device can locally acquire the target template image and the shooting reference information, enabling subsequent display of a 3D virtual object based on the shooting reference information to guide the second user in photographing the target template image.

[0236] In some embodiments of this application, during the process of capturing images of target objects in a target scene to obtain target template images and shooting reference information for the target template images, the first device can also collect and store current positioning information. Thus, when the first device is subsequently located in the target scene again, it can determine the target scene based on the current positioning information, thereby obtaining the target template image and shooting reference information corresponding to the target scene.

[0237] In some embodiments of this application, after performing the spatial information conversion and calibration process, the first device can obtain the shooting reference information corresponding to the target template image from the server. Based on the shooting reference information of the target template image, the first device can display a three-dimensional virtual object of the second device that captured the target template image in the shooting preview interface.

[0238] Specifically, in response to a target operation, the first device can display a three-dimensional virtual object of the second device that captured the target template image in the shooting preview interface, based on the shooting reference information of the target template image.

[0239] In one possible implementation, the target operation may include manipulation of a target control in the shooting preview interface, wherein the target control may include a function control corresponding to the recommended shooting function. The user can click on the target control, and the first device can respond to the click operation on the target control by displaying a 3D virtual object in the shooting preview interface.

[0240] It should be noted that the target control described above can be located anywhere in the shooting preview interface. The target control can also be displayed after operations are performed on the shooting preview interface. This application does not limit the specific implementation form of the target control.

[0241] In another possible implementation, the target operation may include a preview operation of capturing a target object in the target scene. In response to the target operation, the first device displays a three-dimensional virtual object of the second device capturing the target template image in the preview interface, based on the capture reference information of the target template image.

[0242] The preview operation for capturing a target object in the target scene can include a user's click action to trigger a preview of taking a photo or video of the target object in the target scene. For example, a user can point their phone at the target object in the target scene and click on the camera app icon.

[0243] For example, after the first device detects a user's click on the camera app icon, it can launch the camera app. After launching the camera app, the first device can enter shooting mode and display a 3D virtual object in the shooting preview interface.

[0244] Referring to Figure 8(A), after the first device detects the user's click on the camera icon 801, it launches the camera application and automatically starts the image sensor to acquire initial image data, displaying the shooting preview interface as shown in Figure 8(B). The shooting preview interface includes a three-dimensional virtual object.

[0245] It should be noted that before displaying the shooting preview interface, the first device can use 3D modeling software to create a 3D virtual object and convert it into a format suitable for AR display. The 3D virtual object can be created using 3D models such as mobile phones and cameras. This application embodiment does not specifically limit the display style, such as shape, texture, and material, of the 3D virtual object.

[0246] In some embodiments of this application, the first device can display a three-dimensional virtual object of the second device that captured the target template image in the shooting preview interface based on the target template image.

[0247] Specifically, referring to Figure 8(B), the first device can acquire shooting reference information of the target template image and display a three-dimensional virtual object in the shooting preview interface based on the shooting reference information of the target template image. The shooting reference information includes the shooting position information and shooting posture information of the shooting device when shooting the target template image.

[0248] In one feasible approach, the first device has already completed the spatial information conversion and calibration process, converting its current position into second position information in a first spatial coordinate system. Based on the second position information and the shooting reference information, the first device can determine the display position and posture of the 3D virtual object in the shooting preview interface.

[0249] It is understandable that the shooting position information in the shooting reference information of the target template image is the position information in the first spatial coordinate system. The second position information is the position information corresponding to the current position of the first device in the first spatial coordinate system. Thus, the first device can determine the position of the 3D virtual object in the first spatial coordinate system based on the second position information and the shooting position information in the shooting reference information. This determines the display position of the 3D virtual object in the shooting preview interface. Simultaneously, the first device can also determine the display posture of the 3D virtual object in the shooting preview interface based on the shooting posture information.

[0250] In another possible approach, the first device can also convert the shooting position information in the shooting reference information to the second spatial coordinate system, and determine the position of the three-dimensional virtual object in the second spatial coordinate system based on the converted position information, thereby determining the display position of the three-dimensional virtual object in the shooting preview interface.

[0251] In some embodiments of this application, during the process of determining the display position and posture of the 3D virtual object in the shooting preview interface, the first device first determines the position and posture of the 3D virtual object in the first spatial coordinate system. Specifically, the first device can anchor the 3D virtual object in the real scene, that is, accurately place and fix the 3D virtual object in the real scene (physical scene), so as to establish an accurate spatial relationship between it and the target object in the scene.

[0252] Next, the first device can determine the display position and orientation of the 3D virtual object in the shooting preview interface based on its position and orientation in the first spatial coordinate system. From the camera's perspective, as the camera moves or rotates its viewpoint in the real scene, the display position and orientation of the 3D virtual object in the shooting preview interface will continuously change.

[0253] For example, in a real-world scenario, a three-dimensional virtual object is anchored around tower A, and the spatial relationship between the virtual object and tower A remains constant. However, the display position and orientation of the virtual object in the preview interface of the first device can continuously change.

[0254] Thus, in this embodiment, the first device can perform the conversion and calibration process of spatial information, enabling the transfer of spatial information between devices and ensuring cross-device consistency. Simultaneously, the first device can determine the display position and posture of the 3D virtual object in the shooting preview interface based on the converted position information and shooting reference information. Users can clearly and accurately perceive the shooting position and posture when shooting the target template image, while the 3D virtual object can guide users to capture the target template image, improving the user's success rate and shooting experience.

[0255] In some embodiments of this application, the first device can determine the pose of the three-dimensional virtual object based on the shooting pose information in the shooting reference information of the target template image. Further, the first device can calculate the view matrix and projection matrix based on the position of the three-dimensional virtual object in a first spatial coordinate system or a second spatial coordinate system and the pose of the three-dimensional virtual object, thereby determining the position and pose of the three-dimensional virtual object from the first device's perspective.

[0256] Furthermore, the first device can also use an image rendering engine to render the position and pose of the 3D virtual object into the current real-world scene based on its own shooting parameters (field of view, near clipping plane, and far clipping plane, etc.), so that the position and pose of the 3D virtual object corresponds to the position and pose of the second device when the target template image was captured. In other words, during the rendering process, the first device can project the position and pose of the 3D virtual object from its own perspective from 3D space onto a 2D shooting preview interface.

[0257] Thus, this embodiment of the application can display the shooting position and shooting posture when shooting the target template image in the real scene using a three-dimensional virtual object. The second user can clearly and accurately perceive the shooting position and shooting posture when shooting the target template image, and at the same time, the three-dimensional virtual object can guide the second user to shoot the target template image, improving the second user's success rate and shooting experience.

[0258] In some embodiments of this application, the shooting preview interface further includes three-dimensional guidance information, which is used to guide the first device to move from its current position to a target position, and / or to guide the first device to change its current posture to a target posture.

[0259] The aforementioned three-dimensional guidance information can be implemented as text information, voice information, video information, or virtual objects.

[0260] For example, referring to Figure 9, the shooting preview interface also includes 3D guidance information, which can be represented in the form of AR arrows. The AR arrows guide the first device to the target location and pose. The second user can then control the first device to be in the target location and pose by following the AR arrows.

[0261] It is understandable that the aforementioned three-dimensional guidance information can also be used to indicate position differences and / or attitude differences. Position differences represent the relative relationship between the current position of the first device and the target position, while attitude differences represent the difference between the current attitude of the first device and the target attitude.

[0262] Thus, the embodiments of this application can present three-dimensional guidance information, which can overlay and display indicators such as movement direction and position on the real scene, presenting them to the user more intuitively, so that the user can more easily find the target position and assume the target posture. Especially in complex environments, it can greatly save time in finding the target position and assuming the target posture.

[0263] In some embodiments of this application, the display position, size, and / or posture of the three-dimensional virtual object in the shooting preview interface changes as the first device moves, and the display posture of the three-dimensional virtual object in the shooting preview interface changes as the posture of the first device changes.

[0264] For example, as the first device moves closer to the target position (forward or backward), the display position and size of the 3D virtual object in the shooting preview interface will change. Even if the first device remains in the same position as the target, as the first device moves horizontally (left or right), the display position and orientation of the 3D virtual object in the shooting preview interface will change.

[0265] As another example, as the first device rotates or tilts, the display posture of the 3D virtual object in the shooting preview interface will also rotate or tilt accordingly.

[0266] In some embodiments of this application, the three-dimensional virtual object is also used to indicate position differences and / or posture differences, wherein the position difference represents the relative relationship between the current position of the first device and the target position, and the posture difference represents the difference between the current posture of the first device and the target posture.

[0267] In the embodiments of this application, the three-dimensional virtual object can also indicate positional differences and / or posture differences during the display process.

[0268] For example, the 3D virtual object displayed in the shooting preview interface can change with the position and orientation of the first device. As the first device gets closer to the target location, the size of the 3D virtual object increases. As the first device moves further away from the target location, the size of the 3D virtual object decreases.

[0269] As another example, as the posture of the first device gets closer to the target posture, the three-dimensional virtual object will also rotate, tilt, and perform other actions accordingly to increase the immersion and fun of the virtual content.

[0270] Thus, the display position, size, and / or posture of the 3D virtual object shown in this embodiment of the application change as the first device moves, and its display posture changes as the posture of the first device changes. This indirectly guides the difference between the position and posture of the first device and the target position and posture. Users can more easily find the target position and pose based on the changes of the 3D virtual object. Especially in complex environments, this can greatly save time in finding the target position and posing the target posture.

[0271] In some embodiments of this application, when the three-dimensional virtual object is located outside the shooting preview interface, the first device can display a guide icon on the shooting preview interface, which is used to guide the three-dimensional virtual object located outside the shooting preview interface.

[0272] In some examples, the second device may capture the target template image from a location far from the first device's current location, preventing the 3D virtual object from being displayed in the preview interface. The first device can display guiding indicators, such as arrows pointing to the edge of the display screen, to indicate to the user that the 3D virtual object is outside the preview interface. These indicators can include 2D images and / or 3D models.

[0273] Thus, by displaying guidance icons, this embodiment allows users to recognize and interact with 3D virtual objects even if the object is located outside the interface, increasing the flexibility of the interaction. Simultaneously, the guidance icons can help users quickly locate 3D virtual objects outside the shooting preview interface, avoiding blind searching in complex scenes and improving user efficiency.

[0274] In some embodiments of this application, the first device can acquire its position and attitude information after movement in response to a movement operation on the first device. The first device can also output a prompt message if its position and attitude information after movement matches the target attitude and target position, the prompt message being used to prompt the user to perform a shooting operation.

[0275] The prompts may include text, voice, and video messages. This application does not limit the types of messages provided.

[0276] In other words, when the second user moves based on the 3D virtual object and adjusts the device posture of the first device, the first device can acquire position and posture information in real time during the movement. Simultaneously, the first device can also compare the position and posture information with the target posture and position in real time. When the second user's position and the first device's posture match the target posture and position, the first device prompts the user to take a picture, enabling the second user to capture an image of the target template using the first device.

[0277] For example, referring to Figure 10, the second user can move the first device based on the 3D virtual object in the shooting preview screen. As the position and posture of the first device approach the target position and posture until they match, the first device outputs a prompt message, such as "Please take a picture". Of course, it can also be expressed in the form of vibration sound.

[0278] Thus, this embodiment of the application not only guides users to capture high-quality target template images, but also accurately prompts users at appropriate times when to take the picture, further precisely guiding users to capture high-quality target template images. This enhances the user experience.

[0279] It should be noted that the first user and the second user may be the same user or different users; this application does not limit this.

[0280] In some embodiments of this application, the first device displays a target template image or a thumbnail of the target template image in the shooting preview interface.

[0281] Specifically, the first device can obtain the target template image captured by the second device from the server. Alternatively, when the first and second devices are the same device, the first device can obtain the target template image locally. The first device can display the target template image or a thumbnail of the target template image in the shooting preview interface.

[0282] Thus, embodiments of this application can display template images or thumbnails corresponding to different shooting positions and postures, enabling users to quickly select a more satisfactory template image from multiple different shooting positions and postures for shooting. This improves shooting flexibility and user experience.

[0283] In some examples, the shooting preview interface may include multiple 3D virtual objects, each corresponding to a target template image. Before shooting, the second user can select any one of the multiple 3D virtual objects and click on it to view the corresponding target template image or a thumbnail of the target template image. The first device can respond to the operation on the 3D virtual objects in the shooting preview interface by displaying the target template image or a thumbnail of the target template image in the shooting preview interface.

[0284] For example, in response to a user's click on a target virtual object among multiple 3D virtual objects, the first device displays a thumbnail of the target template image corresponding to the target virtual object in the shooting preview interface. Referring to Figure 11, the shooting preview interface includes two 3D virtual objects. A second user can click on the target virtual object, and the first device, in response to the user's click on the target virtual object, displays a thumbnail of the target template image corresponding to the target virtual object.

[0285] Of course, the first device can also simultaneously display the 3D virtual object and the target template image or a thumbnail of the target template image in the shooting preview interface. This application embodiment does not limit this.

[0286] Thus, the first device in this application embodiment can respond to the user's operation on the three-dimensional virtual object and display the corresponding template image or thumbnail, enabling the user to quickly select a more satisfactory template image for shooting from multiple different shooting positions and postures. This improves the flexibility of shooting and the user experience.

[0287] In some embodiments of this application, the shooting system proposed in this application includes a second device that collects first shooting area information corresponding to the target scene and positioning information of the second device. The second device can also collect a target template image and shooting reference information for the target template image. The first device can collect second shooting area information corresponding to the target scene and display a shooting preview interface.

[0288] The shooting system may also include a third device. This third device can collect information about the first shooting area corresponding to the target scene and the positioning information of the second device. The second device can also collect a target template image and shooting reference information for that image. The first device can collect information about the second shooting area corresponding to the target scene and display a shooting preview interface.

[0289] Of course, the second device can collect information about the first shooting area corresponding to the target scene and the positioning information of the second device, while the third device can collect the target template image and shooting reference information for the target template image. The first device can collect information about the second shooting area corresponding to the target scene and display the shooting preview interface.

[0290] It should be noted that this application does not limit the number of devices included in the shooting system or the processing procedures performed by the devices. Different devices can perform the same processing procedures. The same device can also perform different processing procedures.

[0291] This application also provides a shooting method applied to a second device, the method comprising:

[0292] The target object in the target scene is photographed to obtain a target template image and shooting reference information for the target template image; wherein, the shooting reference information includes the shooting position information and shooting posture information of the second device when shooting the target template image;

[0293] The system sends shooting reference information of the target template image to the server. The shooting reference information of the target template image is used to display a three-dimensional virtual object in the shooting preview interface of the target scene of the first device that obtains shooting reference information from the server. The three-dimensional virtual object is used to indicate the target posture and target position. The target posture and target position are the shooting posture and position of the second device when shooting the target template image and in the target scene, respectively.

[0294] This application also provides a shooting method applied to a server, the method including:

[0295] The system receives shooting reference information of the target template image sent by the second device; wherein, the shooting reference information includes the shooting position information and shooting posture information of the second device when shooting the target template image.

[0296] Receive the location information of the first device sent by the first device, and determine the target scene based on the location information of the first device.

[0297] Obtain the shooting reference information of the target template image corresponding to the target scene.

[0298] The first device sends shooting reference information of the target template image. The shooting reference information of the target template image is used by the first device to display a three-dimensional virtual object in the shooting preview interface of the target scene. The three-dimensional virtual object is used to indicate the target posture and target position. The target posture and target position are the shooting posture and position of the second device when shooting the target template image and the position in the target scene, respectively.

[0299] This application also provides a shooting method, applied to a shooting system, the shooting system including a first device and a server, the method including:

[0300] The first device sends its location information to the server, and the location information of the first device is used by the server to determine the target scene.

[0301] The server receives the location information of the first device sent by the first device, and determines the target scene based on the location information of the first device.

[0302] The server obtains the shooting reference information of the target template image corresponding to the target scene.

[0303] The server sends the target template image to the first device as a reference for capturing the target image. The target template image is an image that the second device has captured in advance of the target object in the target scene.

[0304] The first device receives the shooting reference information of the target template image, and displays the three-dimensional virtual object of the second device in the shooting preview interface of the target scene based on the shooting reference information of the target template image.

[0305] Among them, the three-dimensional virtual object is used to indicate the target posture and target position, which are the shooting posture and position in the target scene when the second device captures the target template image, respectively.

[0306] In some examples, the imaging system also includes a second device, and the method further includes:

[0307] The second device takes a picture of the target object in the target scene to obtain a target template image and shooting reference information of the target template image; wherein, the shooting reference information includes the shooting position information and shooting posture information of the second device when shooting the target template image.

[0308] The second device sends the target template image capture reference information to the server.

[0309] This application also provides a shooting system, which includes a first device and a server.

[0310] The first device is configured to send its location information to the server, and the location information is used by the server to determine the target scene.

[0311] The server is configured to receive the location information of the first device sent by the first device, and determine the target scene based on the location information of the first device.

[0312] The server is also configured to obtain shooting reference information of the target template image corresponding to the target scene.

[0313] The server is also configured to send reference information for capturing a target template image to the first device. The target template image is an image pre-captured by the second device of the target object in the target scene.

[0314] The first device is configured to receive shooting reference information of the target template image, and display the three-dimensional virtual object of the second device in the shooting preview interface of the target scene based on the shooting reference information of the target template image.

[0315] Among them, the three-dimensional virtual object is used to indicate the target posture and target position, which are the shooting posture and position in the target scene when the second device captures the target template image, respectively.

[0316] In some examples, the imaging system also includes a second device.

[0317] The second device is configured to capture images of target objects in the target scene to obtain a target template image and shooting reference information for the target template image; wherein, the shooting reference information includes the shooting position information and shooting posture information of the second device when capturing the target template image.

[0318] The second device is also configured to send reference information for capturing the target template image to the server.

[0319] In some solutions, multiple embodiments of this application can be combined, and the combined solution can be implemented. Optionally, some operations in the process of each method embodiment may be combined, and / or the order of some operations may be changed. Furthermore, the execution order between the steps of each process is merely exemplary and does not constitute a limitation on the execution order between steps; other execution orders are also possible. It is not intended to indicate that the execution order is the only possible order in which these operations can be performed.

[0320] Those skilled in the art will conceive of various ways to reorder the operations described in the embodiments of this application. Furthermore, it should be noted that process details involved in one embodiment of this application are similarly applicable to other embodiments, or different embodiments can be combined.

[0321] Furthermore, some steps in the method embodiments can be equivalently replaced with other possible steps. Alternatively, some steps in the method embodiments may be optional and can be deleted in certain use cases. Or, other possible steps may be added to the method embodiments.

[0322] Furthermore, the various method embodiments can be implemented individually or in combination.

[0323] This application also provides an electronic device, such as the mobile phone described above, as shown in FIG12. The mobile phone may include one or more processors 1210, memory 1220 and communication interface 1230.

[0324] The memory 1220, communication interface 1230, and processor 1210 are coupled together. For example, the memory 1220, communication interface 1230, and processor 1210 can be coupled together via bus 1240.

[0325] The communication interface 1230 is used for data transmission with other devices. The memory 1220 stores computer program code. The computer program code includes computer instructions, which, when executed by the processor 1210, cause the electronic device to perform the relevant method steps in the embodiments of this application.

[0326] Processor 1210 may be a processor or controller, such as a central processing unit (CPU), a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It may implement or execute the various exemplary logic blocks, modules, and circuits described in conjunction with this disclosure. The processor may also be a combination that implements computational functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, etc.

[0327] Bus 1240 can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The aforementioned bus 1240 can be divided into address bus, data bus, control bus, etc. For ease of illustration, only one thick line is used in Figure 12, but this does not indicate that there is only one bus or one type of bus.

[0328] This application also provides an electronic device, which includes a memory and one or more processors; the memory is coupled to the processors; wherein the memory stores computer program code, which includes computer instructions, and when the computer instructions are executed by the processor, the electronic device performs the relevant method steps in the above method embodiments.

[0329] This application also provides a communication device, which includes a memory and one or more processors; the memory is coupled to the processors; wherein the memory stores computer program code, which includes computer instructions, and when the computer instructions are executed by the processor, the communication device performs the relevant method steps in the above method embodiments.

[0330] This application also provides a computer-readable storage medium storing computer program code. When the processor executes the computer program code, the electronic device executes the relevant method steps in the above method embodiments.

[0331] This application also provides a computer program product containing instructions that, when executed on a computer or processor, cause the computer or processor to perform the relevant method steps as described in the above method embodiments.

[0332] This application also provides a chip system, including: a processor coupled to a memory, the memory being used to store programs or instructions, and when the program or instructions are executed by the processor, the chip system enables the methods in any of the above method embodiments.

[0333] Optionally, the chip system may contain one or more processors. These processors can be implemented in hardware or software. When implemented in hardware, the processor can be a logic circuit, integrated circuit, etc. When implemented in software, the processor can be a general-purpose processor, implemented by reading software code stored in memory.

[0334] Optionally, the chip system may contain one or more memories. The memory may be integrated with the processor or disposed separately from it; this application embodiment does not limit this. For example, the memory may be a non-transient processor, such as a read-only memory (ROM), which may be integrated with the processor on the same chip or disposed separately on different chips. This application embodiment does not specifically limit the type of memory or the arrangement of the memory and processor.

[0335] For example, the chip system may be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processor unit (CPU), a network processor (NP), a digital signal processor (DSP), a micro controller unit (MCU), a programmable logic device (PLD), or other integrated chips.

[0336] The electronic devices, computer storage media, or computer program products provided in this application are all used to execute the corresponding methods provided above. Therefore, the beneficial effects they can achieve can be referred to the beneficial effects in the corresponding methods provided above, and will not be repeated here.

[0337] Through the above description of the embodiments, those skilled in the art can clearly understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0338] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another apparatus, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0339] The units described as separate components may or may not be physically separate. A component shown as a unit can be one or more physical units, located in one place or distributed in multiple different locations. Some or all of the units can be selected to achieve the purpose of this embodiment, depending on actual needs.

[0340] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0341] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solutions of the embodiments of this application, or the contributing parts, or all or part of the technical solutions, can be embodied in the form of a software product. This software product is stored in a storage medium and includes several instructions to cause a device (which may be a microcontroller, chip, etc.) or processor to execute all or part of the steps of the methods of the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0342] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A shooting method, characterized in that, Applied to a first device, the method includes: Receive shooting preview operation; In response to the shooting preview operation, a shooting preview interface is displayed; the shooting preview interface includes a preview screen of the target object in the target scene by the first device; The shooting preview interface displays a three-dimensional virtual object of the shooting device that captures the target template image. The three-dimensional virtual object is used to indicate the target posture and target position. The target posture and target position are the shooting posture of the shooting device when capturing the target template image and its position in the target scene, respectively. The target template image is an image that the shooting device has captured in advance of the target object in the target scene.

2. The shooting method according to claim 1, characterized in that, The shooting preview interface also includes three-dimensional guidance information, which is used to guide the first device to move from its current position to the target position, and / or to guide the first device to change its current posture to the target posture.

3. The shooting method according to claim 1, characterized in that, The display position, size, and / or posture of the three-dimensional virtual object in the shooting preview interface change as the first device moves, and the display posture of the three-dimensional virtual object in the shooting preview interface changes as the posture of the first device changes.

4. The method according to any one of claims 1-3, characterized in that, Before displaying the three-dimensional virtual object of the shooting device containing the target template image in the shooting preview interface, the method further includes: Acquire shooting reference information of the target template image, the shooting reference information including shooting position information and shooting posture information of the shooting device when shooting the target template image; The three-dimensional virtual object of the shooting device that displays the target template image in the shooting preview interface includes: Based on the shooting reference information of the target template image, a three-dimensional virtual object of the shooting device that shot the target template image is displayed in the shooting preview interface.

5. The method according to claim 4, characterized in that, The acquisition of the target template image shooting reference information includes: The location information of the first device is sent to the server, and the location information of the first device is used by the server to determine the target scene; Receive the shooting reference information of the target template image returned by the server.

6. The method according to claim 4 or 5, characterized in that, The shooting location information is the location information of the shooting device in a first spatial coordinate system, and the method further includes: Determine the second position information of the current position of the first device in the first spatial coordinate system; The step of displaying a three-dimensional virtual object of the shooting device that captured the target template image in the shooting preview interface based on the shooting reference information of the target template image includes: Based on the second location information and the shooting reference information, the display position and display posture of the three-dimensional virtual object in the shooting preview interface are determined.

7. The method according to any one of claims 1-6, characterized in that, The method further includes: In response to a movement operation on the first device, the position and attitude information of the first device after movement are obtained; If the position and attitude information of the first device after it has moved match the target attitude and the target position, a prompt message is output, which is used to prompt the user to perform a shooting operation.

8. The method according to any one of claims 1-7, characterized in that, The method further includes: The target template image or a thumbnail of the target template image is displayed in the shooting preview interface.

9. The method according to claim 8, characterized in that, Displaying the target template image or a thumbnail of the target template image in the shooting preview interface includes: In response to an operation on the three-dimensional virtual object in the shooting preview interface, the target template image or a thumbnail of the target template image is displayed in the shooting preview interface.

10. A shooting method, characterized in that, Applied to a second device, the method includes: The target object in the target scene is photographed to obtain a target template image and shooting reference information of the target template image; wherein, the shooting reference information includes the shooting position information and shooting posture information of the second device when shooting the target template image; The shooting reference information of the target template image is sent to the server. The shooting reference information of the target template image is used by the first device that obtains the shooting reference information from the server to display a three-dimensional virtual object in the shooting preview interface of the target scene. The three-dimensional virtual object is used to indicate the target posture and the target position. The target posture and the target position are respectively the shooting posture and the position in the target scene when the second device shoots the target template image.

11. A shooting method, characterized in that, Applied to a server, the method includes: Receive shooting reference information of a target template image sent by a second device; wherein, the shooting reference information includes shooting position information and shooting posture information of the second device when shooting the target template image; Receive the location information of the first device sent by the first device, and determine the target scene based on the location information of the first device; Obtain the shooting reference information of the target template image corresponding to the target scene; The first device is sent with shooting reference information of the target template image. The shooting reference information of the target template image is used by the first device to display a three-dimensional virtual object in the shooting preview interface of the target scene. The three-dimensional virtual object is used to indicate the target posture and the target position. The target posture and the target position are respectively the shooting posture of the second device when shooting the target template image and the position in the target scene.

12. A shooting method, characterized in that, Applied to a shooting system, the shooting system including a first device and a server, the method includes: The first device sends its location information to the server, and the location information of the first device is used by the server to determine the target scene; The server receives the location information of the first device sent by the first device, and determines the target scene based on the location information of the first device; The server obtains the shooting reference information of the target template image corresponding to the target scene; The server sends shooting reference information of the target template image to the first device; the target template image is an image pre-shot by the second device of the target object in the target scene; The first device receives the shooting reference information of the target template image, and displays the three-dimensional virtual object of the second device in the shooting preview interface of the target scene according to the shooting reference information of the target template image; The three-dimensional virtual object is used to indicate the target posture and target position, which are the shooting posture when the second device captures the target template image and its position in the target scene, respectively.

13. The method according to claim 12, characterized in that, The shooting system further includes the second device, and the method further includes: The second device captures a target object in the target scene to obtain the target template image and the shooting reference information of the target template image; wherein, the shooting reference information includes the shooting position information and shooting posture information of the second device when capturing the target template image; The second device sends the target template image capture reference information to the server.

14. A shooting system, characterized in that, The shooting system includes a first device and a server. The first device is configured to send its location information to the server, the location information of which is used by the server to determine the target scene. The server is configured to receive the location information of the first device sent by the first device, and determine the target scene based on the location information of the first device; The server is also configured to acquire shooting reference information of the target template image corresponding to the target scene; The server is also configured to send shooting reference information of the target template image to the first device; The target template image is an image pre-captured by the second device of the target object in the target scene; The first device is configured to receive shooting reference information of the target template image, and display a three-dimensional virtual object of the second device in the shooting preview interface of the target scene according to the shooting reference information of the target template image; The three-dimensional virtual object is used to indicate the target posture and target position, which are the shooting posture when the second device captures the target template image and its position in the target scene, respectively.

15. The shooting system according to claim 14, characterized in that, The shooting system also includes the second device. The second device is configured to capture images of a target object in the target scene to obtain a target template image and shooting reference information of the target template image; wherein, the shooting reference information includes shooting position information and shooting posture information of the second device when capturing the target template image; The second device is also configured to send the target template image capture reference information to the server.

16. An electronic device, characterized in that, The electronic device includes a display screen, a memory, and one or more processors; the display screen is used to display a user interface of a target application, and the memory is coupled to the processors; wherein the memory stores computer program code, the computer program code including computer instructions, which, when executed by the processor, cause the electronic device to perform the shooting method as described in any one of claims 1-9, or the shooting method as described in claim 10, or the shooting method as described in claim 11.

17. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores instructions that, when executed on a computer, cause the computer to perform the shooting method as described in any one of claims 1-9, or the shooting method as described in claim 10, or the shooting method as described in claim 11.

18. A computer program product, characterized in that, The computer program product includes instructions that, when executed by an electronic device, cause the electronic device to perform the shooting method as described in any one of claims 1-9, or the shooting method as described in claim 10, or the shooting method as described in claim 11.

Images