Photographing method and electronic device

Abstract

Embodiments of the present application provide a photographing method and an electronic device. The method comprises: in a case where the electronic device is located outside a first preset position range, displaying a first preview interface of a camera application, the first preview interface comprising first guide information; the first guide information is used to guide the electronic device to be moved into the first preset position range; in a case where the electronic device is located within the first preset position range, displaying a second preview interface of the camera application, the second preview interface comprising second guide information; the second guide information is used to guide a photographing angle of the electronic device to be adjusted to a first preset angle range. The present application can reduce the difficulty of photographing, does not require professional photographing skills, and can obtain an image with a good photographing effect.

Description

Technical Field

[0001] This application relates to the field of electronic technology, specifically to a shooting method and an electronic device. Background Technology

[0002] As people's living standards improve, travel has become an increasingly common leisure activity. During their travels, people can use their mobile phones to take various photos anytime, anywhere to create lasting memories.

[0003] However, since most people lack professional photography skills, it is difficult for them to take high-quality photos. Summary of the Invention

[0004] This application provides a shooting method and electronic device that can reduce the difficulty of shooting, eliminate the need for professional shooting skills, and obtain images with good shooting results.

[0005] To achieve the above objectives, this application adopts the following technical solution:

[0006] In a first aspect, this application provides a shooting method applied to an electronic device. The method includes: when the electronic device is located outside a first preset position range, displaying a first preview interface of a camera application, the first preview interface including first guidance information; the first guidance information being used to guide the electronic device to be moved to the first preset position range; and when the electronic device is located within the first preset position range, displaying a second preview interface of the camera application, the second preview interface including second guidance information, the second guidance information being used to guide the shooting angle of the electronic device to be adjusted to the first preset viewing angle range.

[0007] The first preset location range (i.e., the best shooting location below) refers to the optimal shooting location area for the first preset scenic spot. In other words, shooting the first preset scenic spot within the first preset location range will yield images with better shooting results.

[0008] For example, the first preset location range can be described using latitude and longitude coordinates. For instance, taking the Great Wall as the first preset scenic spot, the first preset location range is from 116°0′53.1″ to 116°0′57.1″ east longitude and from 40°21′36.46″ to 40°21′39.46″ north latitude.

[0009] The first preset viewing angle range (i.e., the best shooting position in the following text) refers to the optimal shooting angle range for the first preset scenic spot. In other words, shooting the first preset scenic spot within the first preset viewing angle range will yield images with better shooting results.

[0010] For example, the shooting perspective includes at least one of shooting height, shooting distance, and shooting angle. Accordingly, the first preset shooting perspective range may include at least one of a preset shooting height range (i.e., the optimal shooting height hereinafter), a preset shooting distance range (i.e., the optimal shooting distance hereinafter), and a preset shooting angle range (i.e., the optimal shooting angle hereinafter).

[0011] The first preview interface is the camera application's shooting preview interface, as shown in Shooting Preview Interface 2 below.

[0012] The first guidance information, also known as the position guidance information below, may, for example, include information about the direction of movement of the electronic device. For instance, it may include directional information from the current position of the electronic device to a first preset position range.

[0013] The second preview interface is also the shooting preview interface of the camera application, that is, the updated shooting preview interface after the position of the electronic device changes.

[0014] The second guidance information, also known as the camera position guidance information below, may, for example, include at least one of height guidance information, distance guidance information, and angle guidance information. Specifically, the height guidance information guides the adjustment of the electronic device's shooting height to a preset shooting height range. The distance guidance information guides the adjustment of the electronic device's shooting distance to a preset shooting distance range. The angle guidance information guides the adjustment of the electronic device's shooting angle to a preset shooting angle range.

[0015] In this embodiment, during the shooting process using an electronic device, when the electronic device is outside a first preset position range, first guidance information is displayed on the camera application's preview interface to guide the user to move the electronic device to the first preset position range. After the electronic device is moved to the first preset position range, second guidance information is displayed on the camera application's preview interface to guide the user to adjust the electronic device's shooting angle to the first preset viewing angle range. In this way, guidance information can be displayed in real-time on the preview interface during the shooting process to help the user adjust the position of the electronic device and the shooting angle, thereby reducing the difficulty of shooting, eliminating the need for professional shooting skills, and achieving good image quality. Furthermore, this method enhances user interaction and improves the user's shooting experience.

[0016] Optionally, the first guidance information includes at least one of image information, text information, voice information, virtual reality information, and augmented reality information. The second guidance information includes at least one of image information, text information, voice information, virtual reality information, and augmented reality information.

[0017] In this way, when displaying guidance information in the camera app's preview interface, multiple methods can be combined to present the guidance information, which can improve the presentation effect of the guidance information and guide users to find the best shooting angle and shooting position more quickly, thereby enhancing the user experience.

[0018] In one possible implementation of the first aspect, the method further includes: acquiring a first image in response to a user's shooting operation when the electronic device is located outside a first preset position range and / or the shooting angle of the electronic device is outside the first preset viewing angle range; acquiring a second image in response to a user's shooting operation when the electronic device is located within the first preset position range and the shooting angle of the electronic device is within the first preset viewing angle range; the quality of the second image is higher than the quality of the first image.

[0019] For example, the shooting operation can be a click operation on the shooting control in the preview interface.

[0020] By combining this implementation method, after adjusting the position and shooting angle of the electronic device according to the guidance information, it is possible to obtain images with better shooting results. The shooting difficulty is low, which can improve the user's shooting experience.

[0021] In one possible implementation of the first aspect, the second image is acquired by a camera application based on first preset shooting parameters.

[0022] The first preset shooting parameters (i.e., the best shooting parameters below) refer to the shooting parameters that can achieve better shooting results under the current shooting environment.

[0023] Optionally, the first preset shooting parameters include at least one of the following: exposure parameters, white balance, vividness, contrast, brightness, saturation, color temperature, hue, sharpness, halo, and filter.

[0024] In this embodiment, guidance information is displayed on the preview interface of the camera application, guiding the user to adjust the position of the electronic device and the shooting angle. Simultaneously, in response to the user's shooting operation, the image is enhanced based on the first preset shooting parameters, further improving image quality. Furthermore, the user does not need to adjust shooting parameters, reducing the difficulty of shooting and helping the user capture images with better shooting results.

[0025] In one possible implementation of the first aspect, the method further includes: displaying first notification information when the electronic device is located within a second preset location range; the second preset location range includes the first preset location range; and displaying recommendation information (i.e., shooting recommendation information hereinafter) in response to the user's operation on the first notification information; the recommendation information includes the first preset location range and / or the first preset viewing angle range.

[0026] The second preset location range can be understood as the geographical location range corresponding to a scenic spot. Correspondingly, the first preset location range can be understood as the optimal shooting location range for that scenic spot. For example, taking the Great Wall as an example, the second preset location range is the geographical location range of the Great Wall, and the first preset location range can be the geographical location range corresponding to the North Eighth Tower of the Great Wall.

[0027] The first notification message (i.e., notification message 1 below) is used to notify the electronic device that it is within the second preset location range and to prompt the user to use the recommended information.

[0028] In this way, upon arriving at a scenic spot, the camera app on the electronic device can push relevant recommendations to the user, guiding them to take photos according to the recommendations. This helps users find various photo spots, enriches the functionality of the camera app, and enhances the user's shooting experience.

[0029] In addition, before pushing recommendation information, the electronic device can first push a first notification to inform the user that it is within a second preset location range, prompting the user to use the recommendation information. Furthermore, the user can choose whether or not to push recommendation information based on their needs. This way, while providing users with shooting recommendations, it avoids disturbing them and improves the user experience.

[0030] For details on this implementation method, please refer to the following text. Figure 7 Related explanations.

[0031] In one possible implementation of the first aspect, the recommendation information also includes a first preset shooting orientation and / or a first preset shooting time.

[0032] Shooting position refers to the orientation of the electronic device relative to the subject being shot. The first preset shooting position (i.e., the best shooting position below) can be understood as the shooting position that yields the best shooting results when shooting at the first preset scenic spot.

[0033] The first preset shooting time (i.e., the optimal shooting time below) refers to the shooting time when a good shooting effect can be obtained when shooting the first preset spot 1. For example, the first preset shooting time refers to a period of day with good lighting conditions.

[0034] In one possible implementation of the first aspect, the first preview interface of the camera application is displayed as follows: when the electronic device is within a first preset location range, a second notification message (i.e., notification message 3 below) is displayed; the second notification message is used to notify the electronic device that it is within the first preset location range and prompts the user to launch the camera application; in response to the user's operation on the second notification message, the camera application is launched and the first preview interface is displayed.

[0035] In this embodiment of the application, when the electronic device is within the range of the first preset position, the electronic device can display the second notification information. In this way, the user can launch the camera application and enter the shooting preview interface by operating the second notification information. That is to say, the user does not need to close the notification information and then launch the camera application through the camera application icon, making the operation more convenient.

[0036] For details on this implementation method, please refer to the following text. Figure 8 For further explanation, please refer to the relevant explanations in S202 to S205 below.

[0037] In one possible implementation of the first aspect, the first preview interface includes a third image, and the first preview interface for displaying the camera application includes: acquiring the current first location information and the current first environment information of the electronic device; determining first guidance information based on the third image, the first location information, and the first environment information; the second preview interface includes a fourth image, and the second preview interface for displaying the camera application includes: acquiring the current second location information and the current second environment information of the electronic device; determining second guidance information based on the fourth image, the second location information, and the second environment information.

[0038] The third image is a preview image, as shown in Preview Image 1 below.

[0039] Optionally, the first environmental information includes at least one of weather information, temperature information, and light intensity information; the second environmental information includes at least one of weather information, temperature information, and light intensity information. Weather information may include seasonal information and weather type. Seasonal information may include, for example, spring, summer, autumn, and winter. Weather type may include, for example, sunny, cloudy, overcast, rainy, foggy, snowy, etc.

[0040] In this embodiment, the third image can represent visual features, and the first location information and the first environment information can represent environmental features in different dimensions. Therefore, by combining the image, location information, and environment information, the accuracy of the first preset location range and the first preset viewing angle range can be improved, thereby improving the accuracy of the guidance information and enhancing the guidance effect. For details on this implementation, please refer to the relevant descriptions in S206 to S211 below.

[0041] In one possible implementation of the first aspect, determining the first guidance information based on the third image, the first location information, and the first environment information includes: determining the first guidance information based on the third image, the first location information, and the first environment information using an image recommendation model.

[0042] In this embodiment, a pre-trained image recommendation model is used, which combines image, location information and environmental information, to more accurately predict recommendation information. Based on the recommendation information, guidance information is presented more accurately, and data processing efficiency is improved.

[0043] For details on this implementation method, please refer to the relevant explanations in S208 to S211 below.

[0044] In one possible implementation of the first aspect, the aforementioned image recommendation model includes a multimodal segmentation layer, an embedding layer, an encoder, and an output layer. The determination of first guidance information based on the image recommendation model, according to a third image, first location information, and first environment information, includes: the multimodal segmentation layer segmenting the third image, first location information, and first environment information into blocks to obtain multiple image blocks corresponding to the third image, a first text block corresponding to the first location information, and multiple second text blocks corresponding to the first environment information; the embedding layer performing linear transformation processing on each image block and adding spatial location encoding to each image block to obtain multiple image embedding vectors; the embedding layer performing embedded representation on each text block and adding type encoding to each text block to obtain multiple text embedding vectors, where each text block includes a first text block and multiple second text blocks; the encoder aligning and fusing the multiple image embedding vectors and multiple text embedding vectors to output multimodal features; the output layer outputting prediction results based on the multimodal features, and determining recommendation information based on the prediction results, where the recommendation information includes a first preset location range; and determining the first guidance information based on the first preset location range.

[0045] In this embodiment, data from different modalities, such as visual and text, are correlated. This allows for the combination of visual features and multi-dimensional environmental features to predict recommendation information, improving prediction accuracy. Furthermore, the data from different modalities, such as visual and text, is segmented. During prediction, image blocks with different visual features, text blocks with different dimensions, and related image blocks and text blocks can be interacted and fused, thereby improving prediction accuracy and obtaining more accurate recommendation information. Based on this recommendation information, guidance information is then presented more accurately.

[0046] For details on this implementation method, please refer to the following text. Figure 13 Related explanations.

[0047] In one possible implementation of the first aspect, the recommended information further includes at least one of the following: a first preset viewing angle range, a first preset shooting location, a first preset shooting time, a second preset shooting parameters, and information about the scenic area corresponding to the first location information.

[0048] In one possible implementation of the first aspect, the second preset shooting parameters include at least one of exposure parameters, white balance, vividness, contrast, brightness, saturation, color temperature, hue, sharpness, halo, and filter.

[0049] Secondly, this application provides an apparatus included in an electronic device, which has the function of implementing the behaviors of the electronic device in the first aspect and possible implementations thereof. The function can be implemented by hardware or by hardware executing corresponding software. The hardware or software includes one or more modules or units corresponding to the above-described functions. For example, a receiving module or unit, a processing module or unit, etc.

[0050] Thirdly, this application provides an electronic device, which includes a processor, a memory, and an interface; the processor, memory, and interface cooperate with each other to enable the electronic device to execute any one of the methods in the first aspect of the technical solution.

[0051] Fourthly, this application provides a chip including a processor. The processor is used to read and execute a computer program stored in a memory to perform the methods in the first aspect and any possible implementation thereof.

[0052] Optionally, the chip may also include memory, which is connected to the processor via circuitry or wires.

[0053] Optionally, the chip may also include a communication interface.

[0054] Fifthly, this application provides a computer-readable storage medium storing a computer program, which, when executed by an electronic device, causes the electronic device to perform any one of the methods in the first aspect of the technical solution.

[0055] Sixthly, this application provides a computer program product, which includes computer program code that, when executed on an electronic device, causes the electronic device to perform any one of the methods in the first aspect of the technical solution. Attached Figure Description

[0056] Figure 1 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application;

[0057] Figure 2 This is a software structure block diagram of the electronic device provided in the embodiments of this application;

[0058] Figure 3 This is an application scenario diagram of an example shooting method provided in the embodiments of this application;

[0059] Figure 4This is a schematic diagram of the interactive flow of opening a camera APP according to an embodiment of this application;

[0060] Figure 5 This is a schematic diagram of the interaction flow of enabling location permissions for a camera app, as provided in an embodiment of this application.

[0061] Figure 6 This is another example of the interactive flow diagram of the process of enabling location permissions for a camera APP provided in the embodiments of this application;

[0062] Figure 7 This is a schematic diagram of the interactive flow of the process of pushing recommendation information by shooting an example, provided in an embodiment of this application;

[0063] Figure 8 This is a schematic diagram of the interactive process of an example of intelligent guided shooting provided in an embodiment of this application;

[0064] Figure 9 This is a comparative illustration of an example of captured images;

[0065] Figure 10 This is a flowchart illustrating an example of a shooting method provided in an embodiment of this application;

[0066] Figure 11 This is a schematic diagram illustrating an example of an image recommendation model predicting shooting recommendation information provided in an embodiment of this application;

[0067] Figure 12 This is a flowchart illustrating another example of a shooting method provided in an embodiment of this application;

[0068] Figure 13 This is a schematic diagram illustrating another example of an image recommendation model predicting shooting recommendation information provided in an embodiment of this application. Detailed Implementation

[0069] The technical solutions of the embodiments of this application will be described below with reference to the accompanying drawings. In the description of the embodiments of this application, unless otherwise stated, " / " means "or," for example, A / B can mean A or B; "and / or" in this text is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Furthermore, in the description of the embodiments of this application, "multiple" refers to two or more than two.

[0070] Hereinafter, the terms "first," "second," and "third" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first," "second," or "third" may explicitly or implicitly include one or more of that feature.

[0071] References to "one embodiment" or "some embodiments" as described in this application specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this application specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0072] As people's living standards improve, travel has become an increasingly common leisure activity. Among these, "check-in" style travel has gained popularity. During their journeys, people enjoy taking photos with their phones anytime, anywhere to create lasting memories.

[0073] However, sightseeing-style travel requires a high level of photography skill. For example, people need to find the right time and place to take photos, and adjust the shooting parameters to capture high-quality pictures.

[0074] However, most people lack professional photography skills and find it difficult to take high-quality photos.

[0075] In view of this, this application provides a shooting method. When shooting a scenic spot, the electronic device can acquire preview images, geographical location information of the electronic device's location, weather information, temperature information, the name of the scenic spot, and scenic spot evaluation information, etc., and determine shooting recommendation information based on this acquired information. The shooting recommendation information includes optimal framing information, optimal shooting time information, and optimal shooting parameters. That is, when shooting a scenic spot, based on image data representing visual features and environmental data representing geographical location, shooting environment, and the scenic spot itself, shooting recommendation information with better shooting effects can be obtained. After obtaining the shooting recommendation information, the user is guided to shoot based on the optimal framing information, which reduces the difficulty of shooting, eliminates the need for professional shooting skills, and can obtain images with good shooting effects. Furthermore, based on the optimal shooting parameters, image enhancement processing can be performed to further improve image quality.

[0076] It should be noted that the above environmental data can be in text format, and will be referred to hereafter as environmental text data.

[0077] The shooting method provided in this application can be applied to electronic devices that can install applications (APPs), such as mobile phones, tablets, wearable devices, in-vehicle devices, augmented reality (AR) / virtual reality (VR) devices, laptops, ultra-mobile personal computers (UMPCs), netbooks, and personal digital assistants (PDAs). This application does not impose any restrictions on the specific type of electronic device.

[0078] For example, Figure 1 This is a schematic diagram of the structure of an electronic device 100 provided in an embodiment of this application. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0079] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0080] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0081] The controller can serve as the central nervous system and command center of the electronic device 100. It can generate operation control signals based on instruction operation codes and timing signals to control the fetching and execution of instructions. In some examples, when capturing images, the controller can acquire preview images, geographical location information of the electronic device, weather information, temperature information, the name and evaluation information of the scenic spot to be captured, and determine shooting recommendations based on this information. The controller can also provide intelligent guidance for shooting based on the shooting recommendations, and enhance the images based on the shooting recommendations.

[0082] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0083] The wireless communication function of electronic device 100 can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor, and baseband processor.

[0084] Electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0085] Electronic device 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.

[0086] The ISP (Image Signal Processor) is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, transforming it into an image visible to the naked eye. The ISP can also perform algorithmic optimization of image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.

[0087] Camera 193 is used to capture still images or videos. An object is projected onto a photosensitive element by generating an optical image through the lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to an ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, or other formats. In some embodiments, the electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.

[0088] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. Thus, electronic device 100 can play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0089] An NPU (Neural Processing Unit) is a computational processor for neural networks (NNs). By borrowing the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can rapidly process input information and continuously learn on its own. NPUs enable intelligent cognitive applications in electronic devices, such as image recognition, facial recognition, speech recognition, and text understanding.

[0090] The software system of electronic device 100 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This application embodiment uses the layered architecture Android system as an example to exemplify the software structure of electronic device 100.

[0091] Figure 2 This is a software structure block diagram of an electronic device 100 according to an embodiment of this application. The layered architecture divides the software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.

[0092] The application layer can include a series of application packages. For example... Figure 2 As shown, the application package can include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and settings.

[0093] In some examples, the camera app is used to implement the shooting method provided in the embodiments of this application. For example, the camera app acquires a preview image (or a reference image), the geographical location information of the electronic device, weather information, temperature information, the name of the scenic spot to be photographed, and scenic spot evaluation information, and determines shooting recommendation information based on this acquired information. The camera app can also perform intelligent guided shooting based on the shooting recommendation information, and enhance the image based on the shooting recommendation information.

[0094] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0095] like Figure 2As shown, the application framework layer may include a window manager, content providers, a view system, a phone manager, a resource manager, and a notification manager. The window manager manages window programs. It can obtain the screen size, determine if a status bar is present, lock the screen, and capture the screen. The content provider stores and retrieves data, making this data accessible to the application. Data may include video, images, audio, made and received phone calls, browsing history and bookmarks, and a phone book. The view system includes visual controls, such as controls for displaying text and controls for displaying images. The view system can be used to build the application. The display interface can consist of one or more views. For example, a display interface including a text notification icon may include a view for displaying text and a view for displaying images. The phone manager provides communication functions for the electronic device 100, such as managing call status (including connection, hang-up, etc.). The resource manager provides the application with various resources, such as localized strings, icons, images, layout files, video files, etc. The notification manager allows the application to display notification information in the status bar, which can be used to convey informational messages and can disappear automatically after a short pause without user interaction. For example, the notification manager is used to notify users of download completions and message alerts. The notification manager can also display notifications as icons or scrolling text in the system's top status bar, such as notifications from background applications, or as dialog boxes on the screen. Examples include displaying text messages in the status bar, emitting alert sounds, causing electronic devices to vibrate, and flashing indicator lights.

[0096] In some examples, the application framework layer may include location services, weather services, and other application services. Specifically, the camera app can use location services to obtain the phone's geographic location. The camera app can use weather services to obtain weather and temperature information. The camera app can also use other application services within the application framework layer to obtain reference images and reviews of tourist attractions from other applications. These other application services could be, for example, travel applications, social applications, or map applications. Of course, other applications could also be, for example, travel apps, social apps, or map apps.

[0097] The Android runtime consists of the core libraries and the virtual machine. The Android runtime is responsible for scheduling and managing the Android system. The core libraries comprise two parts: one part contains the functionalities that the Java language needs to call, and the other part contains the core Android libraries.

[0098] The application layer and application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.

[0099] The system library can include multiple functional modules, such as a surface manager, media libraries, 3D graphics processing libraries (e.g., OpenGL ES), and a 2D graphics engine (e.g., SGL). The surface manager manages the display subsystem and provides fusion of 2D and 3D layers for multiple applications. The media libraries support playback and recording of various common audio and video formats, as well as still image files. The media libraries support multiple audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, and PNG. The 3D graphics processing libraries are used for 3D graphics drawing, image rendering, compositing, and layer processing. The 2D graphics engine is the drawing engine for 2D graphics.

[0100] The kernel layer is the layer between hardware and software. The kernel layer contains at least the display driver, camera driver, audio driver, and sensor driver.

[0101] For ease of understanding, the following embodiments of this application will be described using the following methods: Figure 1 and Figure 2 Taking the electronic device with the structure shown as an example, the shooting method provided in the embodiments of this application will be specifically described in conjunction with the accompanying drawings and application scenarios.

[0102] Before introducing the shooting method provided in the embodiments of this application, the application scenarios of the shooting method will be explained first.

[0103] Taking a mobile phone as an example, the camera app on a mobile phone has an image recommendation function (also known as a "picture-finding-people" function). For example... Figure 3As shown, when the image recommendation function of a mobile phone's camera app is enabled, the phone can acquire visual data (such as images or videos of scenic spots) and environmental text data across multiple dimensions. The phone can interact with a cloud-based image recommendation server, sending the acquired visual data and environmental text data to the server. The image recommendation server, using its deployed image recommendation model, determines shooting recommendations based on the visual data and environmental text data, and sends these recommendations to the phone. The phone can then guide the user to take photos based on optimal framing information and enhance the image based on optimal shooting parameters to improve image quality and reduce shooting difficulty. It should be noted that the image recommendation model can also be deployed on the device side, i.e., on the mobile phone itself. Environmental text data can include, for example, geographical location information, weather information, temperature information, scenic spot names, and scenic spot reviews. Shooting recommendation information can include optimal framing information, optimal shooting time, optimal shooting parameters, and scenic spot descriptions.

[0104] The following section, with reference to the accompanying diagram, explains how to enable the image recommendation function in a camera app.

[0105] In this embodiment of the application, the camera APP of the electronic device can provide an entry point for the image recommendation function, and the image recommendation function of the camera APP can be enabled through the entry point of the image recommendation function.

[0106] In some examples, we continue to use mobile phones as an example of electronic devices, such as... Figure 4 As shown in (a), the phone can display a desktop 11. The desktop 11 can include icons for multiple apps installed on the phone, such as icons for a clock app, a calendar app, a phone app, and a camera app (icon 111). In response to a user's tap on the camera app icon 111, the phone can display... Figure 4 Interface 12, shown in (b) above, is the camera app's shooting interface (also known as the shooting preview interface). The central area of ​​interface 12 is the image preview area 121. For example, an icon 122 for "Meitu Find People" can be displayed above the image preview area 121. This icon 122 indicates whether the "Meitu Find People" function is enabled. At this time, the "Meitu Find People" icon 122 is in a closed state, indicating that the "Meitu Find People" function is not enabled. A settings control 123 can also be displayed above the image preview area 121. In response to the user's click on the settings control 123, the phone can display... Figure 4Interface 13, shown in (c), is the camera settings interface. Interface 13 may include settings related to taking photos, such as "Photo Ratio," "Smart Photography," and "Filter Recommendation." Interface 13 may also include settings related to shooting videos, such as "Video Resolution," "Video Frame Rate," and "High-Efficiency Video Format." Interface 13 may also include general settings, such as "AI Photography" and "Find People in Images" settings 131. The "Find People in Images" settings 131 displays a switch control 132 for this function. Through the switch control 132, the "Find People in Images" function of the camera app can be turned on and off. At this time, the switch control 132 is in the off state. In response to the user's trigger operation on the switch control 132, the camera app turns on the "Find People in Images" function, that is, it turns on the image recommendation function. At this time, the phone can display... Figure 4 In interface 14 shown in (d), compared to interface 13, the switch control 132 of the "Meitu Find People" setting 131 is switched from the off state to the on state. Interface 14 may also include a "Back" control 141. In response to the user's click on the "Back" control 141, the phone can display as shown in the image. Figure 4 Interface 15, shown in (e), returns to the camera app's shooting interface. Figure 4 The difference between interface 12 shown in (b) is that the "Meitu Find People" icon 122 in interface 15 has changed from the closed state to the open state, which means that the "Meitu Find People" function has been enabled.

[0107] In other examples, upon entering Figure 4 After the user clicks on the "Find People with Meitu" icon 122, as shown in (b) of the image, the camera app activates the "Find People with Meitu" function, which is the image recommendation function. At this time, the phone can display the following: Figure 4 Interface 15 is shown in (e).

[0108] It is understood that in this embodiment, the camera app implements the image recommendation function based on the geographical location information of the mobile phone. In other words, the camera app's image recommendation function can only be enabled when location permissions are granted.

[0109] The following is an illustrative explanation of the process of enabling location permissions for a camera app.

[0110] In some examples, Figure 5 This is a schematic diagram illustrating an example of the interaction process for enabling location permissions for a camera app, provided in an embodiment of this application. Please refer to... Figure 5 On the phone display Figure 5After the user triggers the switch control 132 on interface 13 (a) in the image, the camera app can detect whether its location permission is enabled. If the camera app's location permission is enabled, the "Meitu Find People" function is enabled, that is, the image recommendation function is enabled. At this time, the phone can display... Figure 5 Interface 14 is shown in (b) above. If the camera app's location permissions are not enabled, the phone can display... Figure 5 Interface 21 (c) may include a pop-up window 211 displaying the text "Please enable location permissions for the camera app" and a "Go to Enable" control 212. In response to the user's click on the "Go to Enable" control 212, the phone may display the following... Figure 5 Interface 22, shown in (d) above, is the location permission settings interface for the camera app. Interface 22 may include the text "Allow access to location information," and also includes various access methods, such as "Deny" access and "Allow" access 221. In response to the user's selection of "Allow" access 221, the camera app is allowed to access location information; that is, the camera app's location permission is enabled. After the camera app's location permission is enabled, the phone may display something like... Figure 5 Interface 23 is shown in (e) in the diagram. Unlike interface 22, the "Deny" access method is not selected, while the "Allow" access method 221 is selected. Interface 23 may include a "Back" control 231. In response to the user's click on the "Back" control 231, the phone can display as shown in the diagram. Figure 5 Interface 14 is shown in (b) of the diagram.

[0111] In some examples, such as Figure 5 As shown in (d), interface 22 may also include an "Allow access while using the APP" access method 222. Of course, after entering interface 22, in response to the user's selection of the "Allow access while using the APP" access method 222, location permissions for the camera APP can also be enabled. Users can set the access method for the camera APP's location information according to their actual needs; this embodiment does not specifically limit this.

[0112] In other words, when enabling the "Meitu Find People" feature, you can first check if the camera app's location permissions are enabled. If the camera app's location permissions are enabled, then the "Meitu Find People" feature will be enabled. If the camera app's location permissions are not enabled, you will be redirected to the camera app's location permission settings interface to enable the camera app's location permissions first.

[0113] In other examples, you can enable the camera app's location permissions before activating its "Find People in Photos" feature. For example, Figure 6This is another example of an interactive flow diagram illustrating the process of enabling location permissions for a camera app, provided in an embodiment of this application. Figure 6 As shown in (a), the phone's desktop 11 can include icons for multiple apps installed on the phone, such as icons for the clock app, calendar app, phone app, and settings app (icon 112). In response to a user's click on the settings app icon 112, the phone can display... Figure 6 The interface 31 shown in (b) is the phone's settings interface. Interface 31 may include multiple phone settings, such as "Desktop & Personalization" settings, "Display & Brightness" settings, and "Sound & Vibration" settings. These settings may also include a "Privacy" setting 311. In response to the user's selection of the "Privacy" setting 311, the phone can display... Figure 6 Interface 32, shown in (c) above, is the privacy settings interface. Figure 6 As shown in (c), in area 1 of interface 32, icons 321 for location permissions, camera permissions, microphone permissions, and contacts permissions are displayed, along with records of location access data from various applications within the past 7 days, such as the amount of location permission access data from map apps, browser apps, social apps, weather apps, and video apps. In area 2 of interface 32, settings 322 for "Permission Management," "Location Services," and "Privacy Space" are displayed. In response to the user's click on the "Permission Management" setting 322, the phone can display... Figure 6 Interface 33, shown in (d) above, is a permission management interface. For example, interface 33 may include multiple permission settings, such as "Location Information" permission setting 331, "Camera" permission setting, "Microphone" permission setting, and "Contacts" permission setting. In response to a user's click on the "Location Information" permission setting 331, the phone can display... Figure 6 Interface 34, shown in (e) above, is the location permission settings interface. Interface 34 can include location permission settings for various applications installed on the phone, such as location permission settings for a map app, a browser app, a social media app, and a camera app (341). In response to a user's click on the camera app's location permission settings (341), the phone can display... Figure 6Interface 35, shown in (f), is the location permission settings interface for the camera app. Similar to interface 22, interface 35 can include an "Allow" access option 351 and an "Allow while using the app" access option 352. In response to the user's selection of the "Allow" access option 351, the camera app is allowed to access location information; that is, the camera app's location permission is enabled. Of course, after entering interface 35, in response to the user's selection of the "Allow while using the app" access option 352, the camera app's location permission can also be enabled.

[0114] In some examples, such as Figure 6 As shown in (b), interface 31 may also include an "Application" settings item, which also provides an entry point for "Permission Management". In response to the user's selection of the "Permission Management" entry point, the location permissions of the camera app can also be set. It is understood that users can select different entry points to set the location permissions of the camera app according to their actual needs, and this embodiment does not make specific limitations on this.

[0115] The above provides an illustrative explanation of how to enable the image recommendation function in a camera app. The following section explains the application scenarios of this function.

[0116] Application Scenario 1: Pushing shooting recommendation information

[0117] During a user's trip, the camera app can enable its image recommendation function. Once enabled, the camera app runs in the background and obtains the phone's current location information (1). The camera app can determine if a corresponding attraction (1) exists. If such an attraction exists, the camera app displays an image recommendation notification for the user to confirm whether to receive the recommendation. Upon confirmation, the camera app obtains an image of the attraction (e.g., image 1), its name, and rating information (1), as well as current weather and temperature information (1). The camera app then sends the image (1) and multi-dimensional environmental text data to the image recommendation server. The image recommendation server uses an image recommendation model to generate a shooting recommendation message (1) based on the image (1) and the multi-dimensional environmental text data, and sends this message to the phone's camera app. The camera app then displays the shooting recommendation message (1). The multi-dimensional environmental text data can include, for example, the location information (1), weather information (1), temperature information (1), the name of the attraction (1), and the rating information (1).

[0118] For example, during a user's trip, the camera app obtains the phone's current location location information 1 (e.g., 116°02′E, 40°36′N). When it is determined that the attraction 1 corresponding to this location information 1 is the Great Wall, the camera app can send a notification such as... Figure 7 Notification message 1, shown in (a) above, is an image recommendation notification message, allowing the user to confirm whether to perform image recommendations (i.e., Meitu recommendations). Figure 7 As shown in (a), notification message 1 is an image recommendation notification message, allowing the user to confirm whether to accept image recommendations (i.e., Meitu recommendations). It may include the text "You have arrived at the Great Wall, do you accept Meitu recommendations?", and may include an "OK" control 41 and a "Cancel" control 42. In response to the user's click on the "OK" control 41, the camera app can obtain the scenic image of the Great Wall, the scenic spot name (i.e., the Great Wall), and scenic spot evaluation information (e.g., North Eight Tower is worth checking out), as well as the current weather information 1 (e.g., sunny) and temperature information 1 (e.g., 22℃). The camera app can send the obtained scenic image and environmental text data of the Great Wall to the image recommendation server. The image recommendation server uses the image recommendation model to generate shooting recommendation information 1 based on the obtained image 1 and multi-dimensional environmental text data, and sends shooting recommendation information 1 to the camera app on the phone. The camera app can display as follows: Figure 7 Notification message 2, shown in (b) above, displays shooting recommendation information 1, such as the scenic spot being the North Eighth Tower of the Great Wall; the best shooting location being 116°0′57.1″E, 40°21′39.46″N; and the best shooting times being 6:18 AM and 7:37 PM. Users can then follow the shooting recommendation information 1 to go to the best shooting location for taking photos.

[0119] Additionally, the photo recommendation information 1 may include a description of the Great Wall and a "View Detailed Explanation" control 43. In response to the user clicking the "View Detailed Explanation" control 43, the phone can display the description of the Great Wall's attractions. In response to the user clicking the "Cancel" control 42, the camera app cancels the current photo recommendation.

[0120] Application Scenario 2: Intelligent Shooting Guidance

[0121] After the camera app pushes shooting recommendation information 1 according to the aforementioned embodiment, the user goes to the best shooting location in shooting recommendation information 1 to take pictures of the corresponding scenic spot. While taking pictures, the camera app can obtain a preview image, as well as the phone's current geographical location information 2, weather information 2, and temperature information 2, and determine the scenic spot's rating information corresponding to geographical location information 2. Then, the camera app sends the obtained preview image and multi-dimensional environmental text data to the image recommendation server. The image recommendation server uses an image recommendation model to generate shooting recommendation information 2 based on the obtained preview image and multi-dimensional environmental text data, and sends shooting recommendation information 2 to the phone's camera app. Shooting recommendation information 2 may include the best shooting location, best shooting position, and best shooting parameters. Based on the best shooting location and best shooting position, the camera app determines shooting guidance information and displays the shooting guidance information (i.e., location guidance information and position guidance information) on the shooting preview interface to guide the user in taking pictures.

[0122] For example, taking the North Eighth Tower of the Great Wall as scenic spot 1, please refer to [link / reference]. Figure 8 During the user's journey to the North Eighth Tower of the Great Wall, the camera app obtains the phone's current location location information 2 and determines whether location information 2 meets the shooting location conditions (see S203 below for details). If location information 2 meets the shooting location conditions, the phone can display... Figure 8 The interface 51 shown in (a) may include a notification message 3, which prompts the user to take an image. For example, the notification message 3 may include the text "You are about to reach the best shooting location at the North Eighth Tower of the Great Wall. Please open the camera app to take an image," to prompt the user to take a picture. The notification message 3 may also include an "Open Camera" control 511. The "Open Camera" control 511 serves as the entry point to the camera shooting interface, allowing the user to open the camera by triggering the "Open Camera" control 511. In response to the user's click on the "Open Camera" control 511, the phone may display... Figure 8 Interface 52, shown in (b) above, is the camera preview interface. The camera preview interface can display various shooting guidance information to guide the user in adjusting the shooting position and camera angle.

[0123] Of course, users can also open the camera by clicking notification message 3. In some examples, after going to the North Eighth Tower of the Great Wall, users can also actively open the camera app, such as in response to clicking the camera app icon on interface 51, entering the shooting preview interface, i.e., interface 52.

[0124] Next, continue to combine Figure 8 The process of guiding the filming is illustrated. For example... Figure 8 As shown in (b), interface 52 includes an image preview area displaying a preview image 521. A viewfinder 522 is also displayed within the image preview area, indicating the position of the subject (e.g., the Great Wall) in the image. This allows users to adjust the phone to position the subject within the viewfinder 522 during shooting for better results. The current geographic location information 2 (e.g., 116°0′55.1″E, 40°21′37.46″N) is displayed in the lower right corner of the image preview area. If the phone's location is not the optimal shooting position for the North Eighth Tower of the Great Wall, the text "Optimal shooting position not reached, please select a new shooting position" is displayed in the image preview area, along with a location guidance indicator 523 to guide the user to move the phone to the optimal shooting position. For example, the location guidance indicator 523 could be a navigation arrow to prompt the user to move the phone forward, backward, left, or right to the optimal shooting position. In response to the phone's movement, the phone can display... Figure 8 Interface 53, shown in (c), is also a camera preview interface. Unlike interface 52, interface 53 displays the adjusted geographical location information 3, such as 116°0′57.1″E, 40°21′39.46″N. Naturally, the preview image in interface 53 also changes accordingly.

[0125] It is understandable that after obtaining the phone's current location information 3, the camera app can determine again whether the phone's location is the best shooting position for the North Eighth Tower of the Great Wall. If the phone's location is still not the best shooting position for the North Eighth Tower of the Great Wall, the corresponding location guidance icon will be displayed to guide the user to continue adjusting the phone's location.

[0126] After adjusting the phone's location to the optimal shooting position at the North Eighth Tower of the Great Wall, the text "Optimal shooting position reached" will be displayed on interface 53. Typically, this text will be displayed for a certain period (e.g., several seconds) before disappearing.

[0127] Next, the camera app obtains the phone's current shooting height. If the current shooting height is not the optimal shooting height, the phone can display something like this. Figure 8Interface 54, shown in (d), is also the camera preview interface. Unlike interface 53, interface 54 displays a height adjustment indicator 541, which indicates the vertical direction of the phone's movement. For example, the height adjustment indicator 541 is presented as an upward arrow. The camera app also obtains the phone's current shooting distance. If the current shooting distance is not the optimal shooting distance, a distance adjustment indicator 542 is displayed in interface 54 to prompt the user to adjust the shooting distance. For example, the distance adjustment indicator 542 is presented as the text "Move further away." The camera app also obtains the phone's current shooting angle (including pitch and rotation). If the current shooting angle is not the optimal shooting angle, a guide indicator 543 corresponding to the pitch angle and a guide indicator 544 corresponding to the rotation angle are displayed in interface 54. Users can adjust the shooting position according to the height adjustment indicator 541, the distance adjustment indicator 542, the guide indicator 543 corresponding to the pitch angle, and the guide indicator 544 corresponding to the rotation angle. After adjusting the phone's camera position to the optimal shooting position, the phone can display... Figure 8 The interface 55 shown in (e) may include the text "Adjust to the best shooting position, please take the picture" to prompt the user to take the picture.

[0128] Specifically, during the process of adjusting the phone's shooting position, when the shooting height is adjusted to the optimal shooting height, the phone can cancel the display of the height adjustment indicator 541 and display the text "Currently the optimal shooting height". When the shooting distance is adjusted to the optimal shooting distance, the phone can cancel the display of the distance adjustment indicator 542 and display the text "Currently the optimal shooting distance". When the phone's tilt angle is adjusted to the optimal tilt angle, the phone can cancel the display of the tilt angle guidance indicator 543 and display the text "Currently the optimal tilt angle". When the phone's horizontal rotation angle is adjusted to the optimal horizontal rotation angle, the phone can cancel the display of the horizontal rotation angle guidance indicator 544 and display the text "Currently the optimal horizontal rotation angle". In other words, after a series of adjustments, the phone is in the optimal shooting position.

[0129] It should be noted that during the process of adjusting the phone's location (i.e., shooting position) and camera angle, the phone can obtain real-time geolocation information, as well as corresponding preview images, weather information, temperature information, and attraction reviews. Based on this information, new shooting recommendations are generated, and the aforementioned shooting guidance information is updated accordingly.

[0130] It should be noted that the camera app can use AR, VR, voice, and other methods to output the above-mentioned guidance signs to guide users to find the best shooting position and the best shooting angle.

[0131] like Figure 8 As shown in (e), interface 55 also includes a shooting control 551. In response to the user's click on the shooting control 551, the camera app takes a picture of the North Eighth Tower of the Great Wall according to the optimal shooting parameters to obtain an image with better shooting effect.

[0132] In some examples, when the phone's location is not adjusted to the optimal shooting position, or when the phone's current shooting position is not adjusted to the optimal shooting position, in response to the user's click on the shooting control 551, the camera app takes a picture of the North Eighth Tower of the Great Wall according to the optimal shooting parameters to obtain... Figure 8 The image shown in (f) is shown in the figure.

[0133] For example, Figure 9 This is a comparative illustration of captured images. Combined with... Figure 9 This paper compares and explains the images obtained by the shooting method provided in the embodiments of this application with those obtained by existing methods. Taking rainy or foggy weather as an example, the Great Wall was photographed using existing methods, resulting in... Figure 9 Image (a) shows the image. It can be seen that when shooting in the existing way, the user needs to adjust the shooting parameters, but it is impossible to generate optimal shooting parameters. Furthermore, the image is not enhanced based on the optimal shooting parameters during image acquisition. Therefore, the quality of the captured image is poor, and the subject (i.e., the Great Wall) in the image is blurry. By shooting the Great Wall according to the shooting method provided in the embodiments of this application, the following results are obtained: Figure 9 The image shown in (b) is an example of this application. As can be seen, in this embodiment, when capturing an image, the optimal shooting parameters can be predicted based on the preview image and environmental information. Furthermore, when acquiring the image, enhancement processing is performed on the image based on the optimal shooting parameters, thereby improving image quality. For example, it can better present the image effects of rainy or foggy weather.

[0134] The above is an illustrative description of the application scenarios of the shooting method provided in the embodiments of this application. The following description continues to use a mobile phone as an example to illustrate the shooting method provided in the embodiments of this application.

[0135] Based on the aforementioned application scenarios, the shooting method provided in this application embodiment can include two processes: pushing shooting recommendation information and intelligently guiding shooting. The implementation process of these two processes will be illustrated below, taking the deployment of an image recommendation model on the cloud as an example.

[0136] 1. Push shooting recommendation information

[0137] Figure 10 This is a schematic flowchart illustrating an example of an imaging method provided in an embodiment of this application. Figure 10 As shown, in this shooting method, the process of pushing shooting recommendation information may include the following steps:

[0138] S101, in response to user operation 1, the camera app enables the image recommendation function.

[0139] In this embodiment, the camera app has an image recommendation function. After enabling the image recommendation function, the camera app can generate shooting recommendation information based on images and multi-dimensional environmental text data. This guides users to shoot according to the recommendations to obtain images with better shooting results. The multi-dimensional environmental text data may include, for example, geographical location information, weather information, temperature information, the name of the attraction, and attraction reviews.

[0140] Operation 1 can be used to trigger the image recommendation function of the camera app. For example, Operation 1 can be used to... Figure 4 The click operation of the switch control 132 on the "Meitu Find People" setting 131 shown in (c) above. For example, operation 1 could also be a click operation on... Figure 4 The click operation of the "Meitu Find People" icon 122 shown in (b) is an example. For instance, operation 1 can also be an operation to activate the image recommendation function of the camera app via voice instruction, or operation 1 can also be an operation to activate the image recommendation function of the camera app via gesture recognition instruction. The type of operation 1 is not specifically limited in this embodiment.

[0141] It is understood that in this embodiment, the camera app implements the image recommendation function based on the geographical location information of the mobile phone. Therefore, before S101, it is necessary to enable the camera app's location permissions. The process of enabling the camera app's location permissions can be found in the aforementioned... Figure 5 For related explanations, or please refer to the aforementioned Figure 6 The relevant explanations will not be repeated here.

[0142] S102, When the image recommendation function is enabled, the camera app obtains the geographical location information of the phone's location 1.

[0143] Location information 1 refers to the latitude and longitude of the phone's current location. For example, if a user is visiting the Great Wall, the latitude and longitude of the phone's current location (i.e., location information 1) could be 116°0′57.1″E, 40°21′35.46″N.

[0144] Specifically, the camera app can obtain the phone's location information through the location service of the application framework layer. In some examples, the camera app can obtain the phone's location information according to preset rules. For instance, the camera app obtains the phone's location information at regular intervals.

[0145] S103, the camera app determines whether there is a scenic spot 1 corresponding to the geographical location information 1. If there is a scenic spot 1 corresponding to the geographical location information 1, then execute S104; otherwise, return to S102.

[0146] Specifically, after obtaining the location information 1, the camera app can determine whether there is a scenic spot 1 corresponding to the location information 1. If there is a scenic spot 1 corresponding to the location information 1, the camera app can generate shooting recommendation information 1 based on the location information 1, the image, and other environmental information (such as weather information, temperature information, etc.). If there is no scenic spot 1 corresponding to the location information 1, the camera app can re-obtain the location information 1 of the phone's current location and determine again whether there is a scenic spot 1 corresponding to the re-obtained location information 1 (i.e., return to execute S102).

[0147] Specifically, a scenic spot database is pre-established, which can include the names of multiple scenic spots and the corresponding geographical locations of each scenic spot. After obtaining geographical location information 1, the camera app compares geographical location information 1 with the geographical locations of each scenic spot in the database to determine the geographical location range to which geographical location information 1 belongs. The scenic spot corresponding to the geographical location range to which geographical location information 1 belongs is identified as scenic spot 1, and the name of scenic spot 1 is obtained.

[0148] In some examples, after determining the attraction 1 corresponding to the geographic location information 1, the camera app can send notification message 1. Notification message 1 is an image recommendation notification message, allowing the user to confirm whether to perform image recommendation (i.e., photo recommendation). In response to confirming the image recommendation, the camera app can perform image recommendation based on the geographic location information 1 (i.e., execute subsequent steps S104 to S110).

[0149] For example, taking the Great Wall as an example, such as... Figure 7 As shown in (a), notification message 1 may include the text "You have arrived at the Great Wall, do you accept Meitu's recommendation?", and may include an "OK" control 41 and a "Cancel" control 42. Confirming the image recommendation can be done by clicking the "OK" control 41. Of course, this example is only one implementation of notification message 1; the camera app can also send notification message 1 through other implementations, and this application embodiment does not specifically limit this.

[0150] S104, the camera app captures image 1 containing the location 1.

[0151] In some examples, the camera app can retrieve image 1 from the phone's photo album. For instance, the camera app searches the album for images corresponding to location information 1, and identifies the image with location information 1 as the subject of the attraction 1. In some examples, the camera app can retrieve images related to attraction 1 from other applications through other application services in the application framework layer. These other application services could be, for example, travel application services, social application services, map application services, etc. Of course, these other applications could be, for example, travel apps, social apps, map apps, etc.

[0152] S105, the camera app obtains the current weather information 1 and temperature information 1.

[0153] For example, weather information 1 may include seasonal information and weather type. Seasonal information may include, for example, spring, summer, autumn, and winter. Weather type may include, for example, sunny, cloudy, overcast, rainy, foggy, snowy, etc.

[0154] Temperature information 1 refers to the temperature information corresponding to the current location of the mobile phone.

[0155] Specifically, the camera app can obtain weather information1 and temperature information1 through the weather service in the application framework layer.

[0156] S106, Camera App obtains attraction rating information for attraction 1.

[0157] The scenic spot evaluation information can be either comments on images of scenic spot 1 or comments on scenic spot 1 itself. For example, taking the Great Wall as an example, scenic spot evaluation information 1 could include "North Eight Tower is recommended for taking photos!" or "The Great Wall is beautiful in spring".

[0158] In some examples, the camera app can obtain attraction rating information 1 from other applications through other application services in the application framework layer.

[0159] It should be noted that the acquisition process of Image 1 (i.e., S104 above), the acquisition process of Weather Information 1 and Temperature Information 1 (i.e., S105 above), and the acquisition process of Scenic Spot Evaluation Information 1 (i.e., S106 above) can be performed according to... Figure 10 The execution order shown can also be followed in other orders, such as first executing the acquisition process of weather information 1 and temperature information 1, then executing the acquisition process of image 1, then executing the acquisition process of scenic spot evaluation information 1, or executing them simultaneously. In this embodiment of the application, the execution order of the acquisition process of image 1, the acquisition process of weather information 1 and temperature information 1, and the acquisition process of scenic spot evaluation information 1 is not limited.

[0160] S107, the camera app sends image 1, location information 1, weather information 1, temperature information 1, name of attraction 1, and attraction evaluation information 1 to the image recommendation server.

[0161] S108, the image recommendation server uses the image recommendation model to generate shooting recommendation information 1 based on image 1, geographical location information 1, weather information 1, temperature information 1, the name of scenic spot 1, and scenic spot evaluation information 1.

[0162] The image recommendation model is pre-trained and can predict shooting recommendation information based on visual data (such as images) and multi-dimensional environmental text data. The process of predicting shooting recommendation information 1 using the image recommendation model can be found later in the text. Figure 11 The relevant explanations will not be repeated here.

[0163] For example, the image recommendation model can be a convolutional neural network model, such as the vision transformer (VIT) model. For example, the image recommendation model can also be a deep neural network model, a feedforward neural network model, a feedback neural network model, a fully connected neural network model, or other network models. This application embodiment does not limit the specific network model used.

[0164] In this embodiment, the shooting recommendation information 1 refers to shooting information that can yield better shooting results when shooting at scenic spot 1. For example, the shooting recommendation information 1 may include optimal framing information, optimal shooting time, optimal shooting parameters, and scenic spot explanation information.

[0165] For example, the best framing information may include at least one of the best shooting position, best shooting angle, and best shooting orientation.

[0166] The optimal shooting location (i.e., the first preset location range) refers to the area where attraction 1 is best photographed; in other words, the optimal shooting location can be understood as a range of locations. Taking photos of attraction 1 from the optimal shooting location will yield better results.

[0167] For example, the best shooting location can be represented by the location name or by latitude and longitude coordinates.

[0168] For example, taking the Great Wall as an example (scenic spot 1), the best shooting location is the North Eighth Tower, with coordinates ranging from 116°0′53.1″ to 116°0′57.1″ east longitude and 40°21′36.46″ to 40°21′39.46″ north latitude. Alternatively, taking the Great Wall as an example again, the best shooting location is between the South Fourth and South Fifth Towers, with coordinates ranging from 115°59′31″ to 115°59′52″ east longitude and 40°21′09″ to 40°21′15″ north latitude.

[0169] For example, taking Mount Hua (attraction 1) as an example, the best shooting location is the North Peak, with coordinates of 34.489326 to 34.489526 N and 110.068126 to 110.068326 E. Alternatively, taking Mount Hua (attraction 1) as an example, the best shooting location is the East Peak's Chaoyang Terrace, with coordinates of 34.477861 N and 110.084789 E.

[0170] The optimal shooting position (i.e., the first preset viewing angle range) is related to the phone's shooting angle. The optimal shooting position refers to the best shooting angle for scenic spot 1. The optimal shooting angle can be understood as a range of views.

[0171] For example, the optimal shooting position can include the optimal shooting height, optimal shooting distance, and optimal shooting angle. Shooting height refers to the vertical height of the phone above the ground. Accordingly, the optimal shooting height can be understood as the shooting height that provides a good shooting effect when shooting scenic spot 1. Shooting distance refers to the horizontal distance between the phone and the subject being photographed. Accordingly, the optimal shooting distance is the shooting distance that provides a good shooting effect when shooting scenic spot 1. Shooting angle refers to the phone's pitch angle and horizontal rotation angle when shooting the scenic spot. Accordingly, the optimal shooting angle is the shooting angle that provides a good shooting effect when shooting scenic spot 1. Of course, the optimal shooting angle can also include the optimal pitch angle and the optimal horizontal rotation angle.

[0172] It should be noted that the best shooting height, best shooting distance, and best shooting angle can all be understood as a range.

[0173] Shooting position refers to the orientation of the phone relative to the subject. For example, the phone is located to the east of the subject. The best shooting position can be understood as the shooting position that yields the best results when shooting at point 2.

[0174] The best time to shoot refers to the time of day when you can get the best shooting results when photographing scenic spot 1. For example, the best time to shoot is the period of day when the lighting conditions are good.

[0175] For example, taking the Great Wall as an example (scenic spot 1), the best shooting location is the North Eighth Tower of the Great Wall, with the best shooting time being 07:00-08:30. Similarly, taking Mount Hua as an example (scenic spot 1), the best shooting location is the Chaoyang Terrace on the East Peak; and taking the Great Wall as an example (scenic spot 1), the best shooting location is the North Eighth Tower of the Great Wall, with the best shooting times being 05:00-08:30 and 17:00-18:30.

[0176] Optimal shooting parameters (such as the first preset shooting parameters or the second preset shooting parameters) refer to the camera parameters that can achieve better shooting results when shooting scenic spot 1 under different weather conditions. For example, optimal shooting parameters may include exposure parameters, white balance, vividness, contrast, brightness, saturation, color temperature, hue, sharpness, halo, filters, etc.

[0177] S109, The image recommendation server sends shooting recommendation information to the camera app 1.

[0178] S110, the camera app displays shooting recommendation information 1.

[0179] For example, a camera app can push shooting recommendations via notification messages. For instance, such as... Figure 7 As shown in (b), after receiving the shooting recommendation information 1 sent by the image server, the camera APP sends a notification message 2. In response to the user's viewing operation of the notification message 2, the camera APP runs in the foreground and displays the shooting recommendation information 1.

[0180] It should be noted that in practical applications, the camera app runs in the background and obtains location information, images, weather information, temperature information, and attraction reviews, so as to push shooting recommendations based on the location information, images, weather information, temperature information, and attraction reviews.

[0181] In this embodiment, upon arriving at a scenic spot, the camera app can push relevant recommendation information to the user to guide them in taking photos according to the recommendations. This helps users find various photo spots, enriches the functionality of the camera application, and enhances the user's shooting experience.

[0182] Additionally, before pushing recommendation information, the electronic device can first send a notification message 1 to prompt the user that they can use the recommendation information. This allows users to choose whether or not to receive recommendation information based on their needs. While providing users with shooting recommendation information, this avoids disturbing them and improves the user experience.

[0183] The above is a schematic explanation of the process of pushing recommended information based on shooting. Below, we will combine... Figure 11The process of predicting shooting recommendation information 1 using an image recommendation model (i.e., S108 above) is illustrated.

[0184] like Figure 11 As shown, the image recommendation model can include a multimodal segmentation layer, an embedding layer (patch and position embedding), an encoder, and an output layer. When predicting recommended information, image 1 and multiple environmental text data are input into the multimodal segmentation layer. The environmental text data can include geographic location information 1, weather information 1, temperature information 1, the name of the attraction 1, and attraction rating information 1. The multimodal segmentation layer segments image 1 to obtain multiple image patches 1 and outputs multiple image patches 1 and multiple environmental text data. The embedding layer performs a linear transformation on each image patch 1 to obtain multiple image embedding vectors and adds spatial location encoding to each image embedding vector. Additionally, the embedding layer performs embedding representation on each environmental text data to obtain multiple text vectors and adds type encoding to each text vector. The type encoding can be, for example, [geographic location], [weather], [temperature], [attraction name], or [attraction rating]. The encoder uses a multi-head cross-modal self-attention mechanism to align and fuse vectors from different modalities (i.e., image embedding vectors and text vectors) to output multimodal features. The output layer, based on multimodal features, outputs prediction result 1 (such as a classification label). Based on the pre-established mapping relationship between the prediction result and the best shooting information, a set of best shooting information corresponding to prediction result 1 is determined, thus obtaining shooting recommendation information 1.

[0185] Understandably, the best shooting information can include the best framing information, the best shooting time, the best shooting parameters, and information about the scenic spot.

[0186] In some examples, the multimodal segmentation layer segments image 1 and multiple environmental text data into blocks, resulting in multiple image blocks 1 corresponding to preview image 1, text blocks 1 corresponding to geographic location information 1, and multiple text blocks 2 corresponding to other environmental text data. The other environmental text data may include weather information 1, temperature information 1, the name of the attraction 1, and attraction evaluation information 1. The embedding layer performs a linear transformation on each image block 1 and adds spatial location encoding to each image block 1, resulting in multiple image embedding vectors. The embedding layer performs embedded representation on each text block and adds type encoding to each text block, resulting in multiple text embedding vectors. The encoder aligns and fuses the multiple image embedding vectors and multiple text embedding vectors, outputting multimodal features.

[0187] In some examples, the encoder aligns multiple image embedding vectors when aligning vectors of different modalities. This allows multiple image patches to be associated, enabling interaction between them. Furthermore, the encoder can also align image embedding vectors with text vectors, associating image patches with ambient text data to achieve bidirectional interaction between images and ambient text data.

[0188] For example, image blocks containing the subject are associated with text data related to the scenic spot, such as geographical location information, scenic spot name, and / or scenic spot rating information. Similarly, image blocks of the background area are associated with text data related to the shooting environment conditions, such as weather information and / or temperature information.

[0189] In this embodiment, data from different modalities, such as visual and text, are correlated. This allows for the combination of visual features and multi-dimensional environmental features to predict recommendation information, improving prediction accuracy. Furthermore, the data from different modalities, such as visual and text, is segmented. During prediction, image blocks with different visual features, text blocks with different dimensions, and related image blocks and text blocks can be interacted and fused, thereby improving prediction accuracy and obtaining more accurate recommendation information. Based on this recommendation information, guidance information is then presented more accurately.

[0190] 2. Intelligent shooting guidance

[0191] After the camera app pushes shooting recommendation information according to the aforementioned embodiment, the user goes to the best shooting location in the shooting recommendation information to take pictures of the corresponding scenic spot. During the image shooting process, the camera app can guide the user to take pictures with better shooting quality based on the best shooting location.

[0192] Figure 12 This is a schematic flowchart illustrating another example of an imaging method provided in this application. Figure 12 As shown, in this shooting method, the intelligent guided shooting process may include the following steps:

[0193] S201, in response to user operation 1, the camera app enables the image recommendation function.

[0194] S202, When the image recommendation function is enabled, the camera app obtains the geographical location information of the phone's location 2.

[0195] Among them, geolocation information 2 refers to the latitude and longitude information of the current location of the mobile phone.

[0196] Specifically, the implementation process of S201 and S202 can be found in the implementation process of S101 and S102 in the aforementioned embodiments, and will not be repeated here.

[0197] S203, the camera app determines whether the location information 2 meets the shooting location conditions. If the location information 2 meets the shooting location conditions, then execute S204; otherwise, execute S202.

[0198] The shooting location condition indicates that the phone's location is close to the optimal shooting location, meaning the user is about to reach that location. For example, geographic location information 2 satisfies the shooting location condition if the distance between geographic location information 2 and the optimal shooting location is less than a preset distance threshold.

[0199] In practical applications, after generating shooting recommendation information (such as shooting recommendation information 1), the camera app can store the shooting recommendation information. After obtaining the geolocation information 2, it can compare the geolocation information 2 with the best shooting location (i.e., latitude and longitude range) in the pre-stored shooting recommendation information to determine whether the geolocation information 2 meets the shooting location conditions, that is, to determine whether the phone's location is close to the best shooting location.

[0200] S204, the camera app sends notification message 3, which prompts the user to take an image.

[0201] For example, such as Figure 8 As shown in (a), notification message 3 may include the text "You are about to reach the best shooting location at the North Eighth Tower of the Great Wall. Please open the camera app to take a picture" to prompt the user to take a picture. Notification message 3 may also include an "Open Camera" control 511. The "Open Camera" control 511 is the entry point to the camera shooting interface, so that the user can open the camera by triggering the "Open Camera" control 511.

[0202] S205, in response to the user's operation 2 on notification message 3, the camera APP displays the shooting preview interface 1 and displays the preview image 1 in the shooting preview interface 1.

[0203] Operation 2 can be used to trigger access to the camera app's shooting preview interface. The shooting preview interface could be, for example, as shown below. Figure 8 Interface 52 is shown in (b) of the diagram. For example, operation 2 can be performed on... Figure 8 The image (a) shows a user's click on the "Open Camera" control 511. For example, operation 2 could also be a... Figure 8The click operation of notification message 3 shown in (a) is illustrated. For example, operation 2 can also be an operation to open the camera app via voice instruction, or operation 1 can also be an operation to open the camera app via gesture recognition instruction. In this embodiment of the application, the type of operation 2 is not specifically limited.

[0204] In this embodiment of the application, when the geographical location information 2 meets the shooting location conditions, the camera APP sends a notification message 3. In this way, the user can launch the camera APP and enter the shooting preview interface by operating the notification message 3. That is to say, the user does not need to close the notification message and then launch the camera application through the camera APP icon, making the operation more convenient.

[0205] S206, the camera app determines the attraction 2 corresponding to the geographical location information 2 based on the geographical location information 2, and obtains the attraction evaluation information 2 of the attraction 2.

[0206] In this context, the scenic spot corresponding to geographical location information 2 can be understood as the scenic spot corresponding to the best shooting location matched by geographical location information 2.

[0207] The scenic spot evaluation information can be comments on images of scenic spot 2, or comments on scenic spot 2 itself. For example, taking the Great Wall as an example, scenic spot evaluation information 2 could include "North Eight Tower recommended for checking in!" or "The Great Wall is beautiful in spring".

[0208] Specifically, a scenic spot database is pre-established, which can include the names of multiple scenic spots and the corresponding geographical locations of each scenic spot. After obtaining geographical location information 2, the camera app compares geographical location information 2 with the geographical locations of each scenic spot in the database to determine the geographical location range to which geographical location information 2 belongs. The scenic spot corresponding to the geographical location range to which geographical location information 2 belongs is identified as scenic spot 2, and the name of scenic spot 2 is obtained.

[0209] It should be noted that the process of obtaining scenic spot evaluation information 2 in S206 can be referred to the process of obtaining scenic spot evaluation information 1 in the aforementioned embodiment S106, and will not be repeated here.

[0210] S207, the camera app obtains the current weather information 2 and temperature information 2.

[0211] For example, weather information 2 may include seasonal information and weather type. Seasonal information may include, for example, spring, summer, autumn, and winter. Weather type may include, for example, sunny, cloudy, overcast, rainy, foggy, snowy, etc.

[0212] Temperature information 2 refers to the temperature information corresponding to the current location of the mobile phone.

[0213] It should be noted that the specific implementation process of S207 can be found in the specific implementation process of the aforementioned embodiment S105, and will not be repeated here.

[0214] It should be noted that the processes for acquiring the preview image 1 (i.e., S205), the scenic spot evaluation information 2 (S206), and the weather information 2 and temperature information 2 (i.e., S207) can be performed according to... Figure 12 The execution order shown can also be followed in other orders, such as first executing the acquisition process of weather information 2 and temperature information 2, then executing the acquisition process of preview image 1, then executing the acquisition process of scenic spot evaluation information 2, or executing them simultaneously. In this embodiment of the application, the execution order of the acquisition process of preview image 1, the acquisition process of scenic spot evaluation information 2, and the acquisition process of weather information 2 and temperature information 2 is not limited.

[0215] S208, the camera app sends preview image 1, location information 2, weather information 2, temperature information 2, name of attraction 2, and attraction rating information 2 to the image recommendation server.

[0216] S209, The image recommendation server uses the image recommendation model to generate shooting recommendation information 2 based on the preview image 1, geographical location information 2, weather information 2, temperature information 2, name of scenic spot 2 and scenic spot evaluation information 2.

[0217] In this embodiment of the application, the shooting recommendation information 2 refers to the shooting information that can obtain better shooting results when shooting at the scenic spot 2.

[0218] For example, similar to the shooting recommendation information 1 in the aforementioned embodiment, shooting recommendation information 2 may also include the best framing information, the best shooting time, the best shooting parameters, and scenic spot explanation information.

[0219] For example, the best framing information may include at least one of the best shooting position, best shooting angle, and best shooting orientation.

[0220] The optimal shooting location (i.e., the first preset location range) refers to the area where scenic spot 2 is best photographed; in other words, the optimal shooting location can be understood as a range of locations. Shooting scenic spot 2 from the optimal shooting location will yield better results.

[0221] The optimal shooting position (i.e., the first preset viewing angle range) is related to the phone's shooting angle. The optimal shooting position refers to the best shooting angle for scenic spot 2. The optimal shooting angle can be understood as a range of views.

[0222] For example, the optimal shooting position can include the optimal shooting height, optimal shooting distance, and optimal shooting angle. Shooting height refers to the vertical height of the phone above the ground. Accordingly, the optimal shooting height can be understood as the shooting height that provides a better shooting effect when shooting scenic spot 2. Shooting distance refers to the horizontal distance between the phone and the subject being photographed. Accordingly, the optimal shooting distance is the shooting distance that provides a better shooting effect when shooting scenic spot 2. Shooting angle refers to the phone's pitch and horizontal rotation angles when shooting the scenic spot. Accordingly, the optimal shooting angle is the shooting angle that provides a better shooting effect when shooting scenic spot 2. Of course, the optimal shooting angle can also include the optimal pitch and horizontal rotation angles.

[0223] It should be noted that the best shooting height, best shooting distance, and best shooting angle can all be understood as a range.

[0224] Shooting position refers to the orientation of the phone relative to the subject. For example, the phone is located to the east of the subject. The best shooting position can be understood as the shooting position that yields the best results when shooting at point 2.

[0225] The best time to shoot refers to the time of day when you can get the best shooting results when photographing location 2. For example, the best time to shoot is the period of day when the lighting conditions are good.

[0226] Optimal shooting parameters refer to the camera parameters that yield the best shooting results when photographing point 2 under different weather conditions. For example, optimal shooting parameters may include exposure parameters, white balance, vividness, contrast, brightness, saturation, color temperature, hue, sharpness, halo, and filters.

[0227] S210, The image recommendation server sends shooting recommendation information to the camera app 2.

[0228] S211, the camera app generates location guidance information based on geolocation information 2 and the best shooting position, and determines camera position guidance information based on the current shooting position and the best shooting position.

[0229] Location guidance information (i.e., primary guidance information) is used to guide the user to adjust the phone's location to the optimal shooting position. For example, location guidance information may include the phone's direction of movement. For instance, it could indicate the direction from the phone's current location to the optimal shooting position. Specifically, the direction of movement can be represented by an arrow, such as... Figure 8 The location guide sign 523 is shown in (b) of the diagram.

[0230] Specifically, based on the geographic location information 2 and the latitude and longitude range corresponding to the best shooting position, the positional relationship between the current location of the mobile phone and the best shooting position is determined. Based on the positional relationship between the current location of the mobile phone and the best shooting position, the direction of position adjustment can be determined, that is, the position guidance information is obtained.

[0231] Camera position guidance information (i.e., second guidance information) is used to guide the user to adjust the current shooting position to the optimal shooting position. For example, the current shooting position may include the current shooting height, current shooting distance, and current shooting angle. Correspondingly, the camera position guidance information may include at least one of height guidance information, distance guidance information, and angle guidance information. The height guidance information is used to guide the user to adjust the electronic device's shooting height to a preset shooting height range. For example, the height guidance information may be directional information pointing from the phone's current shooting height to the optimal shooting height.

[0232] Optionally, the height guidance information may include at least one of the following: image information, text information, voice information, virtual reality information, and augmented reality information. Taking image information as an example, the height guidance information can be... Figure 8 The height adjustment mark 541 is shown in (d) in the figure.

[0233] Distance guidance information is used to guide the electronic device to adjust its shooting distance to a preset shooting distance range. For example, distance guidance information can be directional information pointing from the phone's current shooting distance to the optimal shooting distance.

[0234] Optionally, the distance guidance information may include at least one of the following: image information, text information, voice information, virtual reality information, and augmented reality information. Taking text information as an example, the distance guidance information can be... Figure 8 The text "move a little further away" is shown in (d) in the middle.

[0235] Angle guidance information is used to guide the adjustment of the electronic device's shooting angle to a preset shooting angle range. Angle guidance information indicates how to adjust the phone's pitch and yaw angles. For example, angle guidance information can be directional information pointing from the phone's current shooting angle to the optimal shooting angle.

[0236] Angle guidance information can include at least one of the following: image information, text information, voice information, virtual reality information, and augmented reality information. Taking image information as an example, angle guidance information can be obtained through… Figure 8 The pitch angle (d) is indicated by guide mark 543 and the horizontal rotation angle by guide mark 544.

[0237] Specifically, height guidance information is determined based on the current shooting height and the optimal shooting height. Distance guidance information is determined based on the current shooting distance and the optimal shooting distance. Angle guidance information is determined based on the current shooting angle and the optimal shooting angle.

[0238] S212, the camera app displays shooting preview interface 2, and displays location guidance information and camera position guidance information in shooting preview interface 2.

[0239] For a detailed implementation of S212, please refer to the aforementioned embodiments regarding... Figure 8 The explanation will not be repeated here.

[0240] It should be noted that the camera app can use AR, VR, voice, and other methods to output the above location guidance information and camera position guidance information to guide users to find the best shooting position and the best shooting position.

[0241] S213, in response to adjustments to the shooting position and camera angle, the camera app displays the shooting preview interface 3 and updates the preview image.

[0242] It should be noted that during the process of adjusting the phone's location (i.e., shooting position) and camera angle, the phone can obtain real-time geolocation information, as well as corresponding preview images, weather information, temperature information, and attraction reviews. Based on this information, new shooting recommendations are generated, and the aforementioned shooting guidance information is updated accordingly.

[0243] S214, in response to user input operation 3, the camera APP takes a picture of the scenic spot 2 according to the optimal shooting parameters and obtains image 2.

[0244] Operation 3 is the operation that triggers the capture of an image. For example, operation 3 could be... Figure 8 The clicking operation of the shooting control 551 shown in (e) is illustrated. For example, operation 3 can also be an operation of shooting an image by voice instruction, or operation 1 can also be an operation of shooting an image by gesture recognition. In this embodiment of the application, the type of operation 3 is not specifically limited.

[0245] For example, optimal shooting parameters may include exposure parameters, white balance, vividness, contrast, brightness, saturation, color temperature, hue, sharpness, halo, filters, etc.

[0246] In some examples, when the phone's location is not adjusted to the optimal shooting position, or when the phone's current shooting position is not adjusted to the optimal shooting position, in response to the user's input operation 3, the camera app takes a picture of the scenic spot 2 according to the optimal shooting parameters, and obtains image 3.

[0247] In this embodiment, during the shooting process, shooting recommendation information with better shooting effects is obtained based on image data representing visual features and environmental data representing geographical location, shooting environment, and the scenic spot to be photographed, among other dimensions. After obtaining the shooting recommendation information, the user is guided to take pictures based on the best framing information. This reduces the difficulty of shooting, eliminates the need for professional shooting skills, and allows for obtaining images with good shooting effects. Furthermore, image enhancement processing is performed based on the optimal shooting parameters to further improve image quality.

[0248] In addition, when displaying guidance information, multiple methods can be combined to present the information, which can improve the presentation effect of the guidance information and guide users to find the best shooting angle and position more quickly, thereby enhancing the user experience.

[0249] The above is a schematic explanation of the intelligent guided shooting process. Below, we will combine... Figure 13 The process of predicting shooting recommendation information 2 using an image recommendation model (i.e., S209 above) is illustrated.

[0250] like Figure 13 As shown, the image recommendation model can include a multimodal segmentation layer, an embedding layer, an encoder, and an output layer. When predicting recommended information, a preview image 1 and multiple environmental text data are input into the multimodal segmentation layer. These environmental text data can include geographic location information 2, weather information 2, temperature information 2, the name of the attraction 2, and attraction rating information 2. The multimodal segmentation layer segments the preview image 1 to obtain multiple image patches 2 and outputs multiple image patches 2 and multiple environmental text data. The embedding layer performs a linear transformation on each image patch 2 to obtain multiple image embedding vectors and adds spatial location encoding to each image embedding vector. Furthermore, the embedding layer performs embedding representation on each environmental text data to obtain multiple text vectors and adds type encoding to each text vector. The type encoding can be, for example, [geographic location], [weather], [temperature], [attraction name], or [attraction rating]. The encoder uses a multi-head cross-modal self-attention mechanism to align and fuse vectors from different modalities (i.e., image embedding vectors and text vectors) to output multimodal features. The output layer, based on multimodal features, outputs prediction result 2 (such as classification label). Based on the pre-established mapping relationship between the prediction result and the best shooting information, a set of best shooting information corresponding to prediction result 2 is determined, thus obtaining shooting recommendation information 2.

[0251] Understandably, the best shooting information can include the best framing information, the best shooting time, the best shooting parameters, and information about the scenic spot.

[0252] In some examples, the multimodal segmentation layer segments the preview image 1 and multiple environmental text data into blocks, resulting in multiple image blocks 2 corresponding to preview image 1, text blocks 3 corresponding to geographic location information 2, and multiple text blocks 4 corresponding to other environmental text data. The other environmental text data may include weather information 2, temperature information 2, the name of the attraction 2, and attraction evaluation information 2. The embedding layer performs a linear transformation on each image block 1 and adds spatial location encoding to each image block 1, resulting in multiple image embedding vectors. The embedding layer performs embedded representation on each text block and adds type encoding to each text block, resulting in multiple text embedding vectors. The encoder aligns and fuses the multiple image embedding vectors and multiple text embedding vectors, outputting multimodal features.

[0253] In some examples, the encoder aligns multiple image embedding vectors when aligning vectors of different modalities. This allows multiple image patches to be associated, enabling interaction between them. Furthermore, the encoder can also align image embedding vectors with text vectors, associating image patches with ambient text data to achieve bidirectional interaction between images and ambient text data.

[0254] For example, image blocks containing the subject are associated with text data related to the scenic spot, where the environmental text data related to the scenic spot may be, for example, geographical location information, scenic spot name, and / or scenic spot rating information. Similarly, image blocks of the background area are associated with text data related to the shooting environment conditions, where the text data related to the shooting environment conditions may be, for example, weather information and / or temperature information.

[0255] In this embodiment, data from different modalities, such as visual and text, are correlated. This allows for the combination of visual features and multi-dimensional environmental features to predict recommendation information, improving prediction accuracy. Furthermore, the data from different modalities, such as visual and text, is segmented. During prediction, image blocks with different visual features, text blocks with different dimensions, and related image blocks and text blocks can be interacted and fused, thereby improving prediction accuracy and obtaining more accurate recommendation information. Based on this recommendation information, guidance information is then presented more accurately.

[0256] The above is a schematic explanation of the process of pushing shooting recommendation information and the intelligent guidance shooting process. The following is a schematic explanation of the training process of the image recommendation model.

[0257] The training process of an image recommendation model may include the following steps:

[0258] First, multiple sets of training data are acquired. Each set of training data includes a sample data set, a reference data set, and the shooting recommendation information corresponding to the reference data set.

[0259] The sample data set includes sample images and corresponding environmental data such as geographical location, weather, name of the attraction, and rating information. The reference data set includes reference images and corresponding environmental data such as geographical location, weather, name of the attraction, and rating information. Shooting recommendations for this reference data set may include reference framing information, shooting data, shooting parameters, and attraction descriptions. The reference images are pre-annotated and represent images with good shooting results.

[0260] For example, the data source for the sample data set could be user-generated content. This includes sample data obtained from various social media platforms. Similarly, the data source for the reference data set could be a professional photography website.

[0261] Then, for each set of training data, the sample data set is input into the initial image recommendation model to obtain the multimodal features corresponding to the sample data set, and the corresponding reference data set is input into the initial image recommendation model to obtain the multimodal features corresponding to the reference data set. The multimodal features corresponding to the sample data set and the multimodal features corresponding to the reference data set are compared, and the parameters of the initial image recommendation model are adjusted based on the comparison results until the model converges, thus obtaining the image recommendation model.

[0262] By combining visual features with environmental features from multiple dimensions for model training, the accuracy of image recommendation model predictions can be improved.

[0263] The foregoing has detailed examples of the imaging methods provided in the embodiments of this application. It is understood that, in order to achieve the above functions, the electronic device includes hardware and / or software modules corresponding to the execution of each function. Those skilled in the art should readily recognize that, based on the units and algorithm steps of the examples described in conjunction with the embodiments disclosed herein, this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed by hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in conjunction with the embodiments, but such implementation should not be considered beyond the scope of this application.

[0264] This application embodiment can divide the electronic device into functional modules according to the above method example. For example, each function can be divided into a separate functional module, such as a detection unit, a processing unit, a display unit, etc., or two or more functions can be integrated into one module. The integrated module can be implemented in hardware or as a software functional module. It should be noted that the module division in this application embodiment is illustrative and only represents one logical functional division. In actual implementation, there may be other division methods.

[0265] It should be noted that all relevant content of each step involved in the above method embodiments can be referenced from the functional description of the corresponding functional module, and will not be repeated here.

[0266] The electronic device provided in this embodiment is used to perform the above-described shooting method, and therefore can achieve the same effect as the above-described implementation method.

[0267] When using integrated units, the electronic device may further include a processing module, a storage module, and a communication module. The processing module is used to control and manage the operation of the electronic device. The storage module supports the execution of stored program code and data. The communication module supports communication between the electronic device and other devices.

[0268] The processing module can be a processor or a controller. It can implement or execute various exemplary logic blocks, modules, and circuits described in conjunction with the disclosure of this application. The processor can also be a combination that implements computing functions, such as a combination of one or more microprocessors, a digital signal processor (DSP), and a microprocessor, etc. The storage module can be a memory. The communication module can specifically be a radio frequency circuit, a Bluetooth chip, a Wi-Fi chip, or other devices that interact with other electronic devices.

[0269] In one embodiment, when the processing module is a processor and the storage module is a memory, the electronic device involved in this embodiment can be a device having... Figure 1 The device with the structure shown.

[0270] This application also provides a computer-readable storage medium storing a computer program that, when executed by a processor, causes the processor to perform the shooting method of any of the above embodiments.

[0271] This application also provides a computer program product that, when run on a computer, causes the computer to perform the aforementioned steps to implement the shooting method described in the above embodiments.

[0272] In addition, embodiments of this application also provide an apparatus, which may specifically be a chip, component or module. The apparatus may include a connected processor and a memory; wherein the memory is used to store computer execution instructions, and when the apparatus is running, the processor may execute the computer execution instructions stored in the memory to cause the chip to execute the imaging methods in the above-described method embodiments.

[0273] In this embodiment, the electronic device, computer-readable storage medium, computer program product or chip are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can be referred to the beneficial effects of the corresponding methods provided above, and will not be repeated here.

[0274] Through the above description of the embodiments, those skilled in the art will understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0275] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another apparatus, or some features may be ignored or not executed. Furthermore, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0276] The units described as separate components may or may not be physically separate. A component shown as a unit can be one or more physical units; that is, it can be located in one place or distributed in multiple different locations. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0277] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0278] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solutions of the embodiments of this application, in essence, or the parts that contribute to the prior art, or all or part of the technical solutions, can be embodied in the form of a software product. This software product is stored in a storage medium and includes several instructions to cause a device (which may be a microcontroller, chip, etc.) or processor to execute all or part of the steps of the methods of the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0279] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A shooting method, characterized in that, Applied to electronic devices, the method includes: When the electronic device is located outside the first preset location range, a first preview interface of the camera application is displayed. The first preview interface includes first guidance information. The first guidance information is used to guide the electronic device to be moved to the first preset location range. When the electronic device is located within the first preset position range, a second preview interface of the camera application is displayed. The second preview interface includes second guidance information, which is used to guide the electronic device to adjust its shooting angle to the first preset angle range.

2. The method according to claim 1, characterized in that, The shooting perspective includes at least one of shooting height, shooting distance, and shooting angle.

3. The method according to claim 1 or 2, characterized in that, The first guidance information includes at least one of image information, text information, voice information, virtual reality information, and augmented reality information; The second guidance information includes at least one of image information, text information, voice information, virtual reality information, and augmented reality information.

4. The method according to any one of claims 1-3, characterized in that, The method further includes: When the electronic device is located outside the first preset position range, and / or when the shooting angle of the electronic device is outside the first preset viewing angle range, the first image is acquired in response to the user's shooting operation; When the electronic device is located within the first preset position range and the shooting angle of the electronic device is within the first preset viewing angle range, a second image is acquired in response to the user's shooting operation; the quality of the second image is higher than that of the first image.

5. The method according to claim 4, characterized in that, The second image was acquired by the camera application based on the first preset shooting parameters.

6. The method according to any one of claims 1-5, characterized in that, The method further includes: When the electronic device is located within a second preset location range, a first notification message is displayed; the second preset location range includes the first preset location range; the first notification message is used to notify the electronic device that it is located within the second preset location range and to prompt the user to use recommended information; In response to the user's operation on the first notification information, recommended information is displayed; the recommended information includes the first preset location range and / or the first preset viewing angle range.

7. The method according to claim 6, characterized in that, The recommended information also includes a first preset shooting location and / or a first preset shooting time.

8. The method according to any one of claims 1-7, characterized in that, The first preview interface of the display camera application includes: When the electronic device is within the first preset location range, a second notification message is displayed; the second notification message is used to notify the electronic device that it is within the first preset location range and prompts the user to launch the camera application. In response to the user's action on the second notification information, the camera application is launched and the first preview interface is displayed.

9. The method according to any one of claims 1-8, characterized in that, The first preview interface includes a third image, and the first preview interface for displaying the camera application includes: Obtain the current first location information and the current first environmental information of the electronic device; The first guidance information is determined based on the third image, the first location information, and the first environment information; The second preview interface includes a fourth image, and the second preview interface displaying the camera application includes: Obtain the current second location information and the current second environment information of the electronic device; The second guidance information is determined based on the fourth image, the second location information, and the second environment information.

10. The method according to claim 9, characterized in that, The first environmental information includes at least one of weather information, temperature information, and light information; The second environmental information includes at least one of weather information, temperature information, and light information.

11. The method according to claim 9 or 10, characterized in that, Determining the first guidance information based on the third image, the first location information, and the first environment information includes: Based on the image recommendation model, the first guidance information is determined according to the third image, the first location information, and the first environment information.

12. The method according to claim 11, characterized in that, The image recommendation model includes a multimodal segmentation layer, an embedding layer, an encoder, and an output layer. The determination of the first guidance information based on the image recommendation model, according to the third image, the first location information, and the first environment information, includes: The multimodal segmentation layer performs segmentation processing on the third image, the first location information, and the first environment information to obtain multiple image blocks corresponding to the third image, a first text block corresponding to the first location information, and multiple second text blocks corresponding to the first environment information. The embedding layer performs a linear transformation on each image block and adds spatial location encoding to each image block to obtain multiple image embedding vectors; The embedding layer performs embedded representation on each text block and adds type encoding to each text block to obtain multiple text embedding vectors. The text block includes the first text block and the multiple second text blocks. The encoder aligns and fuses the plurality of image embedding vectors and the plurality of text embedding vectors to output multimodal features; The output layer outputs prediction results based on the multimodal features, and determines recommendation information based on the prediction results, wherein the recommendation information includes the first preset location range; The first guidance information is determined based on the first preset location range.

13. The method according to claim 12, characterized in that, The recommended information also includes at least one of the following: a first preset viewing angle range, a first preset shooting location, a first preset shooting time, a second preset shooting parameters, and information about the scenic area corresponding to the first location information.

14. The method according to claim 13, characterized in that, The second preset shooting parameters include at least one of the following: exposure parameters, white balance, vividness, contrast, brightness, saturation, color temperature, hue, sharpness, halo, and filter.

15. An electronic device, characterized in that, include: Processor, memory, and interface; The processor, the memory, and the interface cooperate with each other to enable the electronic device to perform the method as described in any one of claims 1 to 14.

16. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes instructions that, when executed on an electronic device, cause the electronic device to perform the method as described in any one of claims 1 to 14.

Images