Image shooting method and electronic equipment

Abstract

The embodiment of the invention discloses an image shooting method and electronic equipment, relates to the field of electronic equipment, and aims to shoot photos meeting personalized requirements of users so as to improve the shooting efficiency of the electronic equipment. The method comprises the steps that a preview interface of a camera application is displayed on a touch screen, the preview interface comprises a view-finding window, and the view-finding window comprises a shot picture captured by a camera; in response to the first operation, determining a shot picture in the view-finding window as a reference image; displaying the reference image on the touch screen; a first contour line and a second contour line are determined, the first contour line is a contour line of a first shooting target in the reference image, and the second contour line is generated in response to input of a user in the reference image; displaying a preview interface of the camera application, and displaying the first contour line in the view-finding window; if it is detected that the first shooting target in the view-finding window coincides with the first contour line, displaying a second contour line in the view-finding window; and shooting the shooting picture in the view finding window.

Description

[0001] This application is a divisional application. The application number of the original application is 201880078654.2, and the original application date is August 10, 2018. The entire content of the original application is incorporated into this application by reference. Technical Field

[0002] The present application relates to the field of electronic equipment, and in particular to an image capturing method and electronic equipment. Background Art

[0003] Electronic devices (e.g., mobile phones, tablet computers, etc.) are generally integrated with shooting components (e.g., cameras, etc.) for quickly taking photos and recording videos through the electronic devices. After the user turns on the camera, the electronic device can display the shooting picture captured by the camera in a viewfinder in real time, and the user can select a suitable shooting position and shooting angle to compose the shooting picture in the viewfinder.

[0004] In some photo-taking scenarios, users hope that other people (such as passersby) can take photos with personalized composition for them. However, the passersby who help may not accurately understand the user's expectations for the composition of the photo, resulting in failure to take photos that meet the user's personalized needs, and the photo-taking efficiency of the electronic device is correspondingly reduced. Summary of the invention

[0005] The present application provides an image capturing method and an electronic device, which can convey the subject's composition expectations to the photographer when taking pictures, so that the photographer can take pictures that meet the user's personalized needs, thereby improving the shooting efficiency of the electronic device.

[0006] In order to achieve the above objectives, this application adopts the following technical solutions:

[0007] In a first aspect, the present application provides an image capturing method, which can be implemented in an electronic device with a touch screen and a camera, the method may include: the electronic device displays a preview interface of a camera application on the touch screen, the preview interface includes a viewfinder window, and the viewfinder window includes a captured image captured by the camera; in response to a first operation, the electronic device determines the captured image in the viewfinder window as a reference image, and displays the reference image on the touch screen; the electronic device determines a first contour line and a second contour line, the first contour line is a contour line of a first shooting target in the above-mentioned reference image, and the second contour line is generated by the electronic device in response to a user input in the reference image; further, the electronic device may display the preview interface of the camera application and display the captured image in its viewfinder window The electronic device may display the first contour line in the viewfinder window to guide the photographer to compose the first shooting target in the shooting picture according to the first contour line; if the electronic device detects that the first shooting target in the viewfinder window coincides with the first contour line, indicating that the composition of the first shooting target at this time meets the user's expectations, the electronic device may display the second contour line in the viewfinder window to compose the second shooting target in the shooting picture according to the second contour line; when the first shooting target in the viewfinder window coincides with the first contour line, and the second shooting target coincides with the second contour line, the electronic device may take a picture of the shooting picture in the viewfinder window to obtain a first shooting picture, and the first shooting picture obtained at this time coincides with the composition of the first shooting target and the second shooting target marked in the reference image. Figure 1 So as to take photos that meet the user's composition expectations and meet the user's needs for taking personalized photos.

[0008] In a possible design method, when the electronic device displays the second contour line in the viewfinder window, the method may further include: the electronic device continues to display the first contour line in the viewfinder window. That is, the viewfinder window may display the first contour line and the second contour line at the same time, which facilitates the photographer to accurately compose the picture and further improves the shooting efficiency of the electronic device. Of course, the electronic device may also stop displaying the first contour line in the viewfinder window.

[0009] In a possible design method, if the electronic device detects that the first shooting target in the viewfinder coincides with the first contour line, the method may further include: if the photographer moves the electronic device again, the first shooting target will leave the first contour line, so the electronic device may present a prompt message, and the prompt message is used to prompt the photographer to stop moving the electronic device. The prompt message may be a sound prompt or a prompt box may be displayed on the touch screen.

[0010] In a possible design method, after the electronic device displays the preview interface of the camera application and displays the first contour line in the viewfinder, the method may also include: the electronic device detects a first position relationship between the first shooting target and the first contour line in the viewfinder; the electronic device prompts the photographer to adjust the shooting position of the electronic device according to the first position relationship, so that the first shooting target in the viewfinder can coincide with the first contour line as soon as possible, thereby satisfying the user's composition expectations for the first shooting target.

[0011] In a possible design method, when the electronic device displays the second contour line in the viewfinder, the method further includes: the electronic device sends a prompt message to the wearable device, the prompt message including the shooting picture in the viewfinder and the second contour line in the reference image, so that the wearable device displays the second contour line in the shooting picture. In this way, the user can adjust his or her specific position in the shooting picture according to the picture content displayed by the wearable device until the user overlaps with the second contour line in the shooting picture.

[0012] In a possible design method, when the electronic device displays a second contour line in the viewfinder, the method also includes: the electronic device detects a second position relationship between the second shooting target and the second contour line in the viewfinder; the electronic device determines the movement direction of the subject entering the second contour line based on the second position relationship; the electronic device sends the movement direction of the subject entering the second contour line to the wearable device, so that the wearable device prompts the subject to adjust the shooting position so that the second shooting target in the viewfinder can overlap with the second contour line as soon as possible, thereby meeting the user's composition expectations for the second shooting target.

[0013] In a possible design method, an electronic device determines a first contour line and a second contour line, including: the electronic device determines a first position of a first photographed target in the reference image, and determines a second position of a second photographed target in the reference image; the electronic device extracts the contour line of the first position in the reference image as the first contour line, and extracts the contour line of the second position as the second contour line.

[0014] The electronic device determines the first position of the first shooting target in the reference image, specifically including: the electronic device identifies the position of the scene in the reference image, and determines the position of the scene as the first position of the first shooting target in the reference image. The electronic device determines the second position of the second shooting target in the reference image, specifically including: in response to the user's selection operation in the reference image, the electronic device determines the position selected by the user as the second position of the second shooting target in the reference image. In this way, the electronic device can automatically determine the position of the second shooting target in subsequent shooting according to the user's gesture, thereby improving the processing efficiency of the electronic device.

[0015] In a possible design method, the electronic device takes a picture of the shooting picture in the viewfinder window to obtain a first shooting picture, including: in response to a second operation input by the user, the electronic device takes a picture of the shooting picture in the viewfinder window to obtain a first shooting image; or, when it is detected that the first shooting target in the viewfinder window coincides with the first contour line, and the second shooting target coincides with the second contour line, the electronic device automatically takes a picture of the shooting picture in the viewfinder window to obtain the first shooting image. That is, the electronic device can perform the shooting task in response to the user's shooting operation, and can also automatically perform the shooting task when it is detected that the first shooting target and the second shooting target meet the user's composition expectations.

[0016] In one possible design method, when the electronic device displays a first contour line in the viewfinder, the position of the first contour line in the viewfinder is the same as the position of the first contour line in the reference image; when the electronic device displays a second contour line in the viewfinder, the position of the second contour line in the viewfinder is the same as the position selected by the user for the second shooting target in the reference image.

[0017] In a possible design method, after the electronic device takes a picture of the shooting picture in the viewfinder window and obtains the first shooting picture, the method further includes: the electronic device displays a preview interface of the first shooting picture; in response to a touch operation of the user in the preview interface of the first shooting picture, the electronic device displays a first contour line and a second contour line in the first shooting picture. In this way, the user can very intuitively see whether the shooting effect of the first shooting picture meets his / her own composition expectations, thereby improving the user experience.

[0018] In a possible design method, after the electronic device takes a picture of the shooting picture in the viewfinder window and obtains the first shooting picture, it also includes: the electronic device displays a preview interface of the camera application, and displays a third contour line of the third shooting target in its viewfinder window, and the third contour line is generated by the electronic device in response to the user's input in the reference image. For example, the third shooting target can be the first user, and the second shooting target can be the second user; then, when the first shooting target coincides with the first contour line, and the third shooting target coincides with the third contour line, the electronic device can take a picture of the shooting picture in the viewfinder window to obtain a second shooting image; and after the electronic device fuses the first shooting image and the second shooting image, it can obtain a group photo of the first user and the second user, thereby improving the shooting efficiency when taking group photos.

[0019] In a second aspect, the present application provides an image capturing method, which can be implemented in a mobile phone with a touch screen and a camera, the method comprising: the mobile phone displays a preview interface of a camera application on the touch screen, the preview interface including a viewfinder and a preset button, the viewfinder including a shot picture captured by the camera, and the preset button is used to capture a reference image; in response to a user clicking the preset button, the mobile phone can determine the captured shot picture as a reference image and display the reference image on the touch screen; the mobile phone extracts a first contour line of a scene in the reference image; in response to a user's first selection operation in the reference image, the mobile phone can determine a first user in the reference image. The mobile phone determines a first position of a second user in the reference image and extracts a second contour line of the first position in the reference image; in response to a second selection operation of the user in the reference image, the mobile phone can determine a second position of a second user in the reference image and extract a third contour line of the second position in the reference image; the mobile phone displays a preview interface of the camera application and displays the first contour line in its viewfinder window; if it is detected that the scene in the viewfinder window coincides with the first contour line, the mobile phone can display the first contour line and the second contour line in the viewfinder window; and the mobile phone can send a first prompt message to the wearable device of the first user, the first prompt message including the captured picture in the viewfinder window and the third contour line in the reference image. the first contour line and the second contour line of the camera; after receiving the first prompt information, the wearable device may display the first contour line and the second contour line in the shooting picture; when the first shooting target keeps overlapping with the first contour line, if it is detected that the first user in the above-mentioned viewfinder window overlaps with the second contour line, the mobile phone may display a shutter button; in response to the first operation input by the user on the shutter button, the mobile phone may take a picture of the shooting picture in the above-mentioned viewfinder window to obtain a first shot image; further, the mobile phone may display a preview interface of the camera application, and display the first contour line and the third contour line in the above-mentioned viewfinder window; and the mobile phone may send a second prompt information to the wearable device of the second user, The second prompt information includes the shooting picture in the above-mentioned viewfinder and the first contour line and the third contour line in the reference image; after receiving the second prompt information, the wearable device can display the first contour line and the third contour line in the shooting picture; when the first shooting target keeps overlapping with the first contour line, if it is detected that the second user in the above-mentioned viewfinder coincides with the third contour line, the mobile phone can re-display the shutter button; in response to the second operation input by the user on the shutter button, the mobile phone can take a photo of the shooting picture in the above-mentioned viewfinder to obtain a second shot image; after the mobile phone fuses the first shot image and the second shot image, a group photo of the first user and the second user is obtained.

[0020] In a third aspect, the present application provides an electronic device comprising: one or more cameras, a touch screen, one or more processors, a memory, and one or more programs; wherein the processor is coupled to the memory, and the one or more programs are stored in the memory, and when the electronic device is running, the processor executes the one or more programs stored in the memory so that the electronic device performs any of the image capture methods described above.

[0021] In a fourth aspect, the present application provides a computer storage medium comprising computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes an image capture method as described in any one of the first aspect, the second aspect, or possible implementations of the first aspect.

[0022] In a fifth aspect, the present application provides a computer program product. When the computer program product runs on a computer, it enables the computer to execute an image capture method as described in any one of the first aspect, the second aspect, or possible implementations of the first aspect.

[0023] It can be understood that the electronic device described in the third aspect, the computer storage medium described in the fourth aspect, and the computer program product described in the fifth aspect are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 A schematic diagram of the structure of an electronic device provided in this application Figure 1 ;

[0025] Figure 2 A schematic diagram of the principle of taking photos provided for this application;

[0026] Figure 3 A schematic diagram of the architecture of an operating system in an electronic device provided by the present application;

[0027] Figure 4 An application scenario diagram of an image capturing method provided in this application Figure 1 ;

[0028] Figure 5 An application scenario diagram of an image capturing method provided in this application Figure 2 ;

[0029] Figure 6 An application scenario diagram of an image capturing method provided in this application Figure 3 ;

[0030] Figure 7 An application scenario diagram of an image capturing method provided in this application Figure 4 ;

[0031] Figure 8 An application scenario diagram of an image capturing method provided in this application Figure 5 ;

[0032] Fig. 9 An application scenario diagram of an image capturing method provided in this application Figure 6 ;

[0033] Fig.10 An application scenario diagram of an image capturing method provided in this application Figure 7 ;

[0034] Fig.11 An application scenario diagram of an image capturing method provided in this application Figure 8 ;

[0035] Fig.12 An application scenario diagram of an image capturing method provided in this application Figure 9 ;

[0036] Fig.13 An application scenario diagram of an image capturing method provided in this application Figure 10 ;

[0037] Fig.14 An application scenario diagram of an image capturing method provided in this application Figure 10 one;

[0038] Fig.15 An application scenario diagram of an image capturing method provided in this application Figure 10 two;

[0039] Fig.16 An application scenario diagram of an image capturing method provided in this application Figure 10 three;

[0040] Fig.17 An application scenario diagram of an image capturing method provided in this application Figure 10 Four;

[0041] Fig.18 An application scenario diagram of an image capturing method provided in this application Figure 10 five;

[0042] Fig.19 An application scenario diagram of an image capturing method provided in this application Figure 10 six;

[0043] Fig. 20 An application scenario diagram of an image capturing method provided in this application Figure 10 seven;

[0044] Fig.21 An application scenario diagram of an image capturing method provided in this application Figure 10 eight;

[0045] Fig. 22 An application scenario diagram of an image capturing method provided in this application Figure 10 Nine;

[0046] Fig.23 An application scenario diagram of an image capturing method provided in this application Figure 2 ten;

[0047] Fig.24 An application scenario diagram of an image capturing method provided in this application Figure 2 eleven;

[0048] Fig.25 An application scenario diagram of an image capturing method provided in this application Figure 2 twelve;

[0049] Fig.26 An application scenario diagram of an image capturing method provided in this application Figure 2 Thirteen;

[0050] Fig. 27 An application scenario diagram of an image capturing method provided in this application Figure 2 fourteen;

[0051] Fig.28 An application scenario diagram of an image capturing method provided in this application Figure 2 fifteen;

[0052] Fig.29 A schematic diagram of a flow chart of an image capturing method provided in this application;

[0053] Fig.30 A schematic diagram of the structure of an electronic device provided in this application Figure 2 . DETAILED DESCRIPTION

[0054] The implementation of this embodiment will be described in detail below with reference to the accompanying drawings.

[0055] The image capturing method provided in this embodiment can be applied to any electronic device with a camera function. For example, the electronic device can be a mobile phone, a tablet computer, a desktop, a laptop, a notebook computer, an ultra-mobile personal computer (UMPC), a handheld computer, a netbook, a personal digital assistant (PDA), a wearable electronic device, a virtual reality device, etc. The specific form of the electronic device is not particularly limited in the following embodiments.

[0056] Figure 1 A schematic structural diagram of an electronic device 100 is shown.

[0057] The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a USB interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a SIM card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0058] It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0059] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processor (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0060] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0061] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0062] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0063] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple groups of I2C buses. The processor 110 may be coupled to the touch sensor 180K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces. For example: the processor 110 may be coupled to the touch sensor 180K through the I2C interface, so that the processor 110 communicates with the touch sensor 180K through the I2C bus interface, thereby realizing the touch function of the electronic device 100.

[0064] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to achieve communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit an audio signal to the wireless communication module 160 via the I2S interface to achieve the function of answering a call through a Bluetooth headset.

[0065] The PCM interface can also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface to realize the function of answering calls via a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0066] The UART interface is a universal serial data bus for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to implement the Bluetooth function. In some embodiments, the audio module 170 can transmit an audio signal to the wireless communication module 160 through the UART interface to implement the function of playing music through a Bluetooth headset.

[0067] The MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to implement the shooting function of the electronic device 100. The processor 110 and the display screen 194 communicate via the DSI interface to implement the display function of the electronic device 100.

[0068] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 with the camera 193, the display 194, the wireless communication module 160, the audio module 170, the sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0069] The USB interface 130 is an interface that complies with the USB standard specification, and can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface can be used to connect a charger to charge the electronic device 100, and can also be used to transfer data between the electronic device 100 and a peripheral device. It can also be used to connect headphones to play audio through the headphones. The interface can also be used to connect other electronic devices, such as AR devices, etc.

[0070] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present invention is only a schematic illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0071] The charging management module 140 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger through a USB interface. In some wireless charging embodiments, the charging management module 140 may receive wireless charging input through a wireless charging coil of the electronic device 100. While the charging management module 140 is charging the battery 142, it may also power the electronic device through the power management module 141.

[0072] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.

[0073] The wireless communication function of the electronic device 100 can be implemented through the antenna module 1, the antenna module 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0074] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antennas. For example, a cellular network antenna can be reused as a wireless local area network diversity antenna. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0075] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0076] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0077] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of the signal, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0078] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0079] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0080] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be LCD (liquid crystal display), OLED (organic light-emitting diode), active-matrix organic light-emitting diode or active-matrix organic light-emitting diode (AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diodes (quantum dot light-emitting diodes, QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens, where N is a positive integer greater than 1.

[0081] The electronic device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

[0082] ISP is used to process the data fed back by camera 193. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to ISP for processing and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, ISP can be set in camera 193.

[0083] In an embodiment, the camera 193 is used to capture a static image or a video. In some embodiments, the electronic device 100 may include 1 or N cameras, where N is a positive integer greater than 1. The camera 193 may be a front camera or a rear camera. Figure 2 As shown, the camera 193 generally includes a lens and a photosensitive element (sensor), and the photosensitive element can be any photosensitive device such as CCD (Charge-coupled Device) or CMOS (Complementary Metal Oxide Semiconductor).

[0084] During the shooting process, the reflected light of the scene can generate an optical image after passing through the lens, and the optical image is projected onto the photosensitive element, which converts the received light signal into an electrical signal. Then, the camera 193 sends the obtained electrical signal to the DSP (Digital Signal Processing) module for digital signal processing, and finally obtains a digital image. The digital image can be output on the electronic device 100 through the display screen 194, or the digital image can be stored in the internal memory 121.

[0085] The video codec is used to compress or decompress digital video. The electronic device 100 may support one or more video codecs. In this way, the electronic device 100 may play or record videos in multiple coding formats, such as MPEG1, MPEG2, MPEG3, MPEG4, etc.

[0086] NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. Through NPU, applications such as intelligent cognition of electronic device 100 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.

[0087] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing music, video and other files in the external memory card.

[0088] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0089] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0090] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110.

[0091] The speaker 170A, also called a "speaker", is used to convert an audio electrical signal into a sound signal. The electronic device 100 can listen to music or listen to a hands-free call through the speaker 170A.

[0092] The receiver 170B, also called a "earpiece", is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a call or voice message, the voice can be received by placing the receiver 170B close to the human ear.

[0093] Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting his mouth close to microphone 170C to input the sound signal into microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In other embodiments, the electronic device 100 can be provided with two microphones, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones to realize sound signal collection, noise reduction, and can also identify the sound source, realize directional recording function, etc.

[0094] The earphone interface 170D is used to connect a wired earphone, and the earphone interface may be a USB interface, or a 3.5 mm open mobile terminal platform (OMTP) standard interface, or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0095] The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be set on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. The capacitive pressure sensor can be a parallel plate including at least two conductive materials. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the electronic device 100 detects the touch operation intensity according to the pressure sensor 180A. The electronic device 100 can also calculate the touch position according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, an instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, an instruction to create a new short message is executed.

[0096] The gyro sensor 180B can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., x, y, and z axes) can be determined by the gyro sensor 180B. The gyro sensor 180B can be used for anti-shake shooting. For example, when the shutter is pressed, the gyro sensor 180B detects the angle of the electronic device 100 shaking, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shaking of the electronic device 100 through reverse movement to achieve anti-shake. The gyro sensor 180B can also be used for navigation and somatosensory game scenes.

[0097] The air pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 100 calculates the altitude through the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation.

[0098] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip leather case. In some embodiments, when the electronic device 100 is a flip phone, the electronic device 100 can detect the opening and closing of the flip cover according to the magnetic sensor 180D. Then, according to the detected opening and closing state of the leather case or the opening and closing state of the flip cover, the flip cover can be automatically unlocked.

[0099] The acceleration sensor 180E can detect the magnitude of the acceleration of the electronic device 100 in all directions (generally three axes). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the electronic device and is applied to applications such as horizontal and vertical screen switching and pedometers.

[0100] The distance sensor 180F is used to measure the distance. The electronic device 100 can measure the distance by infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 can use the distance sensor 180F to measure the distance to achieve fast focusing.

[0101] The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 100 emits infrared light outward through the light emitting diode. The electronic device 100 uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 can determine that there is no object near the electronic device 100. The electronic device 100 can use the proximity light sensor 180G to detect that the user holds the electronic device 100 close to the ear to talk, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used in leather case mode and pocket mode to automatically unlock and lock the screen.

[0102] The ambient light sensor 180L is used to sense the ambient light brightness. The electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the electronic device 100 is in a pocket to prevent accidental touches.

[0103] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.

[0104] The temperature sensor 180J is used to detect temperature. In some embodiments, the electronic device 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the electronic device 100 reduces the performance of a processor located near the temperature sensor 180J to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the electronic device 100 heats the battery 142 to avoid abnormal shutdown of the electronic device 100 due to low temperature. In other embodiments, when the temperature is lower than another threshold, the electronic device 100 performs a boost on the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature.

[0105] The touch sensor 180K is also called a "touch panel". The touch sensor 180K can be set on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be set on the surface of the electronic device 100, which is different from the position of the display screen 194.

[0106] The bone conduction sensor 180M can obtain a vibration signal. In some embodiments, the bone conduction sensor 180M can obtain a vibration signal of a vibrating bone block of the vocal part of the human body. The bone conduction sensor 180M can also contact the human pulse to receive a blood pressure beat signal. In some embodiments, the bone conduction sensor 180M can also be set in an earphone. The audio module 170 can parse out a voice signal based on the vibration signal of the vibrating bone block of the vocal part obtained by the bone conduction sensor 180M to realize a voice function. The application processor can parse the heart rate information based on the blood pressure beat signal obtained by the bone conduction sensor 180M to realize a heart rate detection function.

[0107] The key 190 includes a power key, a volume key, etc. The key may be a mechanical key or a touch key. The electronic device 100 may receive key input and generate key signal input related to user settings and function control of the electronic device 100.

[0108] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 194, motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

[0109] Indicator 192 may be an indicator light, which may be used to indicate charging status, power changes, messages, missed calls, notifications, etc.

[0110] The SIM card interface 195 is used to connect a subscriber identity module (SIM). The SIM card can be connected to and separated from the electronic device 100 by inserting it into the SIM card interface or pulling it out from the SIM card interface. The electronic device 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support NanoSIM cards, Micro SIM cards, SIM cards, and the like. Multiple cards can be inserted into the same SIM card interface at the same time. The types of the multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

[0111] The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. In the embodiment of the present invention, the Android system of the layered architecture is taken as an example to exemplify the software structure of the electronic device 100.

[0112] Figure 3 1 is a software structure block diagram of the electronic device 100 according to an embodiment of the present invention.

[0113] The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system library, and the kernel layer.

[0114] The application layer can include a series of application packages.

[0115] like Figure 3 As shown, the application package may include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message and other applications.

[0116] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0117] like Figure 3As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0118] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0119] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0120] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

[0121] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including connecting, hanging up, etc.).

[0122] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0123] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.

[0124] Android Runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system.

[0125] The core library consists of two parts: one is the function that needs to be called by the Java language, and the other is the Android core library.

[0126] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0127] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0128] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0129] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0130] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0131] A 2D graphics engine is a drawing engine for 2D drawings.

[0132] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0133] The following is an illustrative description of the workflow of the software and hardware of the electronic device 100 in conjunction with a photo-taking scenario.

[0134] When the touch sensor 180K receives a touch operation, the corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the touch operation into raw input events (including touch coordinates, timestamp of the touch operation, and other information). The raw input events are stored in the kernel layer. The application framework layer obtains the raw input events from the kernel layer and identifies the controls corresponding to the input events. For example, if the touch operation is a touch single-click operation and the control corresponding to the single-click operation is the control of the camera application icon, the camera application can call the interface of the application framework layer to start the camera application, and then start the camera driver by calling the kernel layer, capture each frame of the shooting picture through the camera, and display the captured shooting picture in real time in the preview interface of the camera application.

[0135] Subsequently, when the touch sensor 180K detects a touch operation in which the user clicks the shutter button in the preview interface, the corresponding hardware interrupt is also sent to the kernel layer, and the kernel layer generates an original input event of the click operation. Then, the application framework layer obtains the original input event from the kernel layer and identifies that the control corresponding to the click operation is the shutter button. Then, the camera application can store the captured image in the preview interface as a captured photo in the internal memory 121.

[0136] In this embodiment, in order to take a photo that meets the user's composition expectations when taking photos, the user can first open the camera application to take a reference image, and the composition of the shooting target (such as scenery or people) in the reference image is what the user wants. In addition, the user can also mark the position where he wants himself to appear (i.e., the position of the person) in the reference image. In this way, the electronic device can extract the first contour line of the shooting target in the reference image and the second contour line of the marked position of the person through the corresponding image processing algorithm. Subsequently, the electronic device can superimpose the first contour line and the second contour line on the shooting picture captured by the camera for composition guidance, so as to take a photo that meets the user's composition expectations.

[0137] An image capturing method provided by the following embodiment will be described in detail below with reference to the accompanying drawings, taking a mobile phone as an example of an electronic device.

[0138] For example, when user A (i.e., the subject) wants to take a photo with a certain shooting target (e.g., a scene or a person), he can first open the camera of the mobile phone to adjust the composition of the shooting picture. Figure 4 As shown, assuming that user A wants to take a photo with the shooting target 401, user A can input an operation of opening the camera to the electronic device. For example, the operation can be clicking the camera application icon. In response to the user's operation of opening the camera, the mobile phone can start the camera application and open the camera, and enter the preview interface 402 of the camera application. The preview interface 402 may include a viewfinder window 403, and the viewfinder window 403 displays the shooting picture 1 captured by the camera in real time. It can be understood that the shooting picture in the viewfinder window 403 can change in real time.

[0139] In addition to the viewfinder window 403, the preview interface 402 may also include other buttons such as a shutter button, a filter button, and a camera switch button. Figure 5 As shown in (a) of FIG. 5 , the electronic device may set a “shooting assistant” function button 501 in the preview interface 402 of the camera application; or Figure 5 As shown in (b), a "shooting assistant" shooting mode 502 can be set in the preview interface 402 of the camera application. When it is detected that the user (for example, user A) clicks the "shooting assistant" function button 501 or enters the "shooting assistant" shooting mode 502, it means that user A needs to start the image shooting method provided in this embodiment to shoot photos that meet personalized composition expectations.

[0140] At this time, if Figure 6As shown, the mobile phone can prompt the user to adjust the current shooting picture (i.e., shooting picture 1) to the user's desired composition mode in the preview interface 402 of the camera application, and click the shutter button 601 to shoot. In this way, user A can change the shooting angle, shooting position or shooting lens according to the prompt, and adjust the shooting picture 1 in the preview interface 402 to the shooting picture 2, and the composition mode of the shooting target 401 in the shooting picture 2 is the composition mode desired by user A. In addition, after the mobile phone displays the shooting picture 2 in the preview interface 402, user A can click the shutter button 601 to take a photo. Then, in response to the operation of user A clicking the shutter button 601, the mobile phone can use the shooting picture 2 captured by the camera at this time as a reference image for subsequent help of user A to take photos, and store the reference image in the mobile phone.

[0141] In other embodiments, Figure 7 As shown, after turning on the camera of the mobile phone, user A can also adjust the shooting picture 1 in the preview interface 402 to the shooting picture 2 desired by user A. Furthermore, if it is detected that user A clicks the function button 501 of "shooting assistant" in the preview interface 402, it means that the user hopes to use the shooting picture 2 displayed in the current preview interface 402 as a reference image for subsequent help of user A to take pictures. In response to the operation of user A clicking the button 501, the mobile phone can perform the shooting operation, and at the same time, the mobile phone can also use the captured shooting picture 2 as a reference image for subsequent help of user A to take pictures. That is, the function button 501 of "shooting assistant" integrates the functions of the shutter button and the function of opening the image shooting method provided by the present application.

[0142] In other embodiments, the mobile phone may also be configured to automatically generate a signal after the user clicks the shutter button 601 to take a photo. Figure 8 As shown, the mobile phone displays a preview interface 702 of the photo 701 taken this time. The preview interface 702 includes the photo 701 taken this time and the above-mentioned "shooting assistant" function button 501. If it is detected that user A clicks the function button 501 in the preview interface 702, the mobile phone can use the currently displayed photo 701 as a reference image, so that the reference image can be used later to guide other users (such as user B) to take photos for user A.

[0143] In some embodiments, after the mobile phone obtains the reference image taken by user A through the above embodiments, the mobile phone may display a preview interface 801 of the reference image. Fig. 9 As shown, taking the reference image as the above-mentioned captured image 2 as an example, the mobile phone can prompt user A to mark the position 802 of the person he wants to be photographed in the captured image 2 in the preview interface 801. If the person to be photographed is user A himself, user A can mark the specific position (i.e., the person position 802) that he wants to appear in the captured image 2 in the captured image 2.

[0144] There are many ways for user A to mark the person position 802 in the reference image. In some embodiments, the position and size of the person position 802 can be manually set by user A. Fig. 9 As shown, user A can mark a specific person position 802 in the shooting picture 2 by smearing. After the mobile phone detects the smearing operation of user A in the shooting picture 2, it can record the coordinates of the boundary line of the area smeared by user A, so as to determine the area within the boundary line as the person position 802. For another example, Fig.10 As shown, the mobile phone can display a selection box 901 in the preview interface 801, and the selection box 901 can be in the shape of a rectangle, a circle, an ellipse or a human figure. After user A selects the selection box 901, the position and size of the selection box 901 can be adjusted in the camera screen 2, and the mobile phone can determine the area where the selection box 901 is located in the camera screen 2 as the above-mentioned person position 802. Through the solution of the above-mentioned embodiment, the mobile phone can provide the user with a personalized photo composition according to the user's needs, so as to guide subsequent photo taking, thereby improving the user experience.

[0145] In other embodiments, the position and size of the character position 802 may also be automatically set by the mobile phone. Fig.11 As shown in (a) of FIG. 1 , user A can click on the position where the person to be photographed is desired to appear in the shooting picture 2, for example, click on point Y in the shooting picture 2. In response to the click operation of user A in the shooting picture 2, the mobile phone can calculate the composition ratio in the shooting picture 2, and generate a person position 802 that satisfies the composition ratio in the shooting picture 2 according to the preset body shape data of an ordinary user (or user A). For example, Fig.11 As shown in (b), the character position 802 includes the Y point clicked by user A, thereby minimizing the phenomenon that the composition ratio in the shot screen 2 is destroyed due to the character position 802 manually circled by the user. In other embodiments, the mobile phone can also automatically determine the character position 802 in the shot screen 2 according to the composition ratio in the shot screen 2 after determining that the shot screen 2 is a reference image, and the user does not need to perform any operation at this time. Of course, after the mobile phone automatically generates the above-mentioned character position 802, the user can also manually adjust the position and size of the character position 802 in the shot screen 2, and this embodiment does not impose any restrictions on this. Through the scheme of the above-mentioned embodiment, the mobile phone can automatically determine the character position according to the user's gesture, thereby improving the processing efficiency of the mobile phone.

[0146] In some other embodiments, user A may also mark multiple (2 or more) person positions in the shooting picture 2. Fig.12As shown, if user A wants to appear in the shooting screen 2 at the same time as his friend and be located at different positions in the shooting screen 2, user A can mark the first person position 1101 and the second person position 1102 in the shooting screen 2 sequentially or simultaneously. This embodiment does not impose any restrictions on this.

[0147] In some embodiments, after the mobile phone obtains the reference image (such as the above-mentioned shot 2) taken by user A, Fig.13 As shown, the mobile phone can also prompt user A to select the scene position 805 where the shooting target is located in the shooting picture 2 in the preview interface 801 of the shooting picture 2. The shooting target can be a building, plant, etc. that the user wants to shoot. The user can mark the specific position of the shooting target in the shooting picture 2. Fig.13 As shown, user A can mark a specific shooting target in the shooting screen 2 by smearing or clicking. Taking the smearing operation as an example, after the mobile phone detects the smearing operation of user A in the shooting screen 2, the coordinates of the boundary line of the area smeared by user A can be recorded, so as to determine the area within the boundary line as the scene position 805.

[0148] Since the positions of shooting targets such as buildings and plants are generally fixed in subsequent photos, but the subject (such as user A) can move, after the mobile phone determines the scene position 805 and the person position 802 in the above-mentioned shooting picture 2, different identifiers can be used to record these two positions. For example, the mobile phone can determine the identifier of the scene position 805 in the shooting picture 2 as 00, and determine the identifier of the person position 802 in the shooting picture 2 as 01. In this way, when taking photos later, the mobile phone can prompt the photographer to adjust the composition of the shooting target in the shooting picture according to the identifier of the scene position 805, and prompt the subject to adjust his position in the shooting picture through the identifier of the person position 802, so as to adjust the composition of the shooting picture to the composition that matches the subject's expectations as soon as possible.

[0149] Still Figure 9-12As shown, after user A marks the above-mentioned person's position in the preview interface 801 of the shooting screen 2, he can click the "Next" button 803 in the preview interface 801. Of course, if user A does not mind the specific position of the person being photographed in the shooting screen 2, user A may not mark the above-mentioned person's position in the shooting screen 2, that is, after the mobile phone displays the preview interface 801 of the shooting screen 2, user A may not mark the person's position 802 in the shooting screen 2, but directly click the "Next" button 803 in the preview interface 801. In another case, if user A is not satisfied with the currently captured reference image (i.e., the shooting screen 2), user A can also click the "Retake Photo" button 804 in the preview interface 801. If the mobile phone detects that user A clicks the "Retake Photo" button 804, the mobile phone can reopen the camera and display the preview interface of the shooting screen captured by the camera until user A captures a satisfactory reference image.

[0150] In some embodiments, if the mobile phone detects that the user clicks the "Next" button 803 in the preview interface 801, it means that the user has confirmed to use the shooting picture 2 in the preview interface 801 as the reference image for the next photo. Then, the mobile phone can use the corresponding image processing algorithm to extract the first contour line of the shooting target in the shooting picture 2.

[0151] For example, Fig.13 As shown in FIG. 1 , if user A has marked the scene position 805 where the shooting target is located in the shooting picture 2, the mobile phone can perform image recognition on the image in the scene position 805 to determine the shooting target 401 in the shooting picture 2. Fig.14 As shown, the mobile phone may use the coordinates of the boundary line of the scene position 805 recorded by the user A when marking the scene position 805 as the first contour line 1201 .

[0152] For another example, the mobile phone can also automatically identify the shooting target in the shooting screen 2 through the corresponding image recognition algorithm. For example, the mobile phone can take the scenery or person located in the center of the shooting screen 2 as the shooting target. For another example, the user can manually click on the shooting target 401 in the shooting screen 2. After the mobile phone detects the user's click operation, it means that the user takes the image near the click position as the shooting target 401. Then, the mobile phone can perform edge detection on the image near the click position, thereby detecting the first contour line 1201 of the shooting target 401. In addition, the mobile phone can display the generated first contour line 1201 in the shooting screen 2 by bolding or highlighting. Alternatively, the user can also manually draw the first contour line 1201 of the shooting target 401 in the shooting screen 2, and this embodiment does not impose any restrictions on this.

[0153] In addition, Fig.14As shown, if the above-mentioned shooting picture 2 includes the person position marked by user A (for example, the above-mentioned person position 802), the mobile phone can also extract the second contour line 1202 of the person position 802 in the shooting picture 2. For example, the mobile phone can use the coordinates of the boundary line of the person position 802 recorded by user A when marking the person position 802 as the second contour line 1202.

[0154] Among them, the image processing algorithm used by the mobile phone when extracting the above-mentioned first contour line 1201 (or the second contour line 1202) may specifically include an image segmentation algorithm, an edge detection algorithm, a convolutional neural network algorithm, etc., and this embodiment does not impose any restrictions on this.

[0155] In this way, after user A takes a reference image that meets his or her own composition expectations, the mobile phone can generate outlines of the shooting target and the position of the characters in the reference image. These outlines can be displayed in the preview interface displayed by the mobile phone the next time a photo is taken. In this way, when other users (such as user B) use the mobile phone to take photos for user A, they can follow the guidance of these outlines to arrange the shooting target in the first outline 1201 and user A in the second outline 1202, thereby taking photos that meet user A's composition expectations.

[0156] For example, Fig.14 As shown in FIG. 1 , after the mobile phone generates the first contour line 1201 of the photographing target 401 and the second contour line 1202 of the person position 802, if it is detected that user A clicks the "Next" button 1203, it means that user A has confirmed to use the first contour line 1201 and the second contour line 1202 as reference lines for the next photographing. Then, the mobile phone responds to the operation of user A clicking the button 1203 this time, as shown in FIG. Fig.15 As shown in (a) of FIG. 1 , the mobile phone can return from the preview interface of the shooting screen 2 to the preview interface 1301 of the camera application. At this time, the mobile phone opens the camera again and displays the shooting screen 3 captured by the camera. Fig.15 As shown in (a) in the figure, when the mobile phone displays the shooting picture 3 captured by the camera, the first outline 1201 of the shooting target 401 can be superimposed and displayed on the upper layer of the shooting picture 3 to guide the photographer to compose the picture according to the first outline 1201.

[0157] like Fig.15As shown in (a) in FIG. 3 , since the first contour line 1201 that matches the composition expectation of the photographing target 401 by the user A is displayed in the photographing screen 3, when the user A hands the mobile phone to another user (for example, the user B), the user B can also readjust the photographing screen according to the guidance of the first contour line 1201, so that the photographing target 401 coincides with the first contour line 1201 in the photographing screen 3. For example, the mobile phone can calculate the degree of coincidence between the photographing target 401 and the first contour line 1201 in the photographing screen 3. When the degree of coincidence between the photographing target 401 and the first contour line 1201 is greater than a threshold value (for example, 90%), the mobile phone can determine that the photographing target 401 in the photographing screen 3 coincides with the first contour line 1201.

[0158] The above-mentioned overlap degree may refer to: the degree of overlap between the photographic target (e.g., photographic target 401) and the area where the contour line (e.g., first contour line 1201) is located in the viewfinder. For example, the ratio of the area of ​​the photographic target 401 in the first contour line 1201 to the area of ​​the area where the first contour line 1201 is located may be determined as the overlap degree between the photographic target 401 and the first contour line 1201. When the overlap degree is higher, it means that the proportion of the photographic target 401 in the first contour line 1201 is larger, and it is more in line with the composition expectation of the user A for the photographic target 401.

[0159] When the mobile phone displays the shooting picture 3 including the first contour line 1201, it can also detect the positional relationship between the shooting target 401 in the shooting picture 3 and the first contour line 1201 in real time. In this way, if the shooting target 401 in the shooting picture 3 deviates from the first contour line 1201, the mobile phone can prompt the photographer (for example, user B) to adjust the shooting angle of the mobile phone accordingly. Fig.15 As shown in (a) in FIG. 1 , if the photographing target 401 is biased to the left side of the second contour line 1202, the mobile phone may prompt the photographer to move the mobile phone to the left.

[0160] It can be understood that when the electronic device displays the first contour line in the viewfinder window, the position of the first contour line in the viewfinder window is the same as the position of the first contour line in the reference image.

[0161] It should be noted that the above-mentioned photographer may be user A himself in addition to user B. For example, user A may use a tripod to fix the mobile phone, and then adjust the position of the mobile phone so that the shooting target 401 enters the first contour line 1201 of the shooting screen 3. Subsequently, user A may enter the shooting screen 3, and use a remote control or a timed shooting function to take a photo of himself and the shooting target 401.

[0162] When the mobile phone detects that the shooting target 401 completely enters the first contour line 1201 of the shooting screen 3, as shown in FIG. Fig.15As shown in (b) in FIG. 3 , at this time, the composition of the shooting target 401 in the shooting screen 3 has satisfied the expectations of user A. If the photographer moves the phone again, the shooting target 401 will leave the first contour line 1201. Therefore, the phone can prompt the photographer to stop moving the phone in the preview interface 1301 of the shooting screen 3. At the same time, the phone can also superimpose the second contour line 1202 of the above-mentioned person position 802 on the shooting screen 3, so as to subsequently guide the subject (i.e., user A) to coincide with the second contour line 1202 in the viewfinder. At this time, the phone can continue to display the above-mentioned first contour line 1201 in the shooting screen 3, or hide the above-mentioned first contour line 1201 in the shooting screen 3.

[0163] For example, Fig.15 As shown in (c) in the figure, the mobile phone can send a prompt message to the wearable device (such as a smart watch) of user A. The prompt message can be the specific picture content in the shooting picture 3. For example, the prompt message includes the picture content captured by the mobile phone camera in real time and the second contour line 1202 in the above reference image. After receiving the prompt message, the smart watch can display the prompt message on the display screen of the smart watch. When user A moves, the picture content in the shooting picture 3 captured by the mobile phone camera changes accordingly, and correspondingly, the picture content displayed by the smart watch also changes accordingly. In this way, user A can adjust his specific position in the shooting picture 3 according to the picture content displayed by the smart watch until user A coincides with the second contour line 1202 in the shooting picture 3.

[0164] In addition, when the smart watch displays the shooting picture 3 including the second contour line 1202, it can also detect the positional relationship between the user A and the second contour line 1202 in real time. In this way, if the user A in the shooting picture 3 deviates from the second contour line 1202, the smart watch can prompt the user A to adjust his position accordingly. Fig.15 As shown in (c) in FIG. 1 , if user A leans to the right side of the second contour line 1202, the smart watch may display a moving arrow 1302 to prompt user A to move left. Of course, the moving arrow 1302 may also be generated by the mobile phone and sent to the smart watch, and this embodiment does not impose any limitation on this.

[0165] Alternatively, if the wearable device is a Bluetooth headset, the prompt information may be audio information prompting user A to move. After receiving the prompt information, the Bluetooth headset may play the prompt information, so that user A may move according to the prompt information and enter the second contour line 1202 of the shooting picture 3.

[0166] When the mobile phone detects that the shooting target 401 in the viewfinder coincides with the first contour line 1201, and the user A coincides with the second contour line 1202, as shown in FIG. Fig.17 As shown, the mobile phone can also prompt the photographer (i.e., user B) to click the shutter button 601 to start taking pictures. For example, the mobile phone can prompt user B to start taking pictures by voice, vibration, highlighting the first contour line 1201 and the second contour line 1202, etc. At this time, the position of user A and the position of the shooting target 401 in the photo taken by the mobile phone are both marked by the user in the reference image in advance, so the photo taken by the mobile phone fully meets the composition expectation of user A and meets the user's demand for taking personalized photos.

[0167] In other embodiments, Fig.28 As shown in (a) of FIG. 1 , after the mobile phone returns to the preview interface 1301 of the camera application, in addition to displaying the first contour line 1201 and the second contour line 1202 in the viewfinder, the shutter button 601 may not be displayed first. The mobile phone can detect in real time the first position relationship between the shooting target 401 in the viewfinder and the first contour line 1201, and the second position relationship between the user A and the second contour line 1202. When it is determined that the shooting target 401 in the viewfinder coincides with the first contour line 1201, and the user A coincides with the second contour line 1202, as shown in FIG. Fig.28 As shown in (b) in FIG. 1 , the mobile phone can display a shutter button 601 in the preview interface 1301. That is, when the composition mode of the captured image in the viewfinder window is different from the composition mode set by user A in the reference image, the mobile phone will not display the shutter button 601, so that the photographer cannot take a photo when the captured image does not meet the expectations of user A; only when the composition mode of the captured image in the viewfinder window is the same as the composition mode set by user A in the reference image, the shutter button 601 will be displayed, so that the photographer can take photos that meet the personalized needs of user A.

[0168] In another case, after the mobile phone detects that the shooting target 401 in the viewfinder coincides with the first outline 1201, if it is detected that the user A in the viewfinder gradually coincides with the second outline 1202, the mobile phone may gradually display the shutter button 601 in the preview interface 1301. For example, the mobile phone may gradually deepen the color of the shutter button 601 until the shutter button 601 is completely displayed after the user A in the viewfinder coincides with the second outline 1202.

[0169] Of course, the mobile phone can also display the shutter button 601 in the preview interface 1301 when displaying the preview interface 1301 of the camera application. However, when the shooting target 401 does not coincide with the first contour line 1201, or the user A does not coincide with the second contour line 1202, the shutter button 601 cannot respond to the shooting operation input by the user. When it is detected that the shooting target 401 in the viewfinder coincides with the first contour line 1201, and the user A coincides with the second contour line 1202, if it is detected that the user inputs the shooting operation to the shutter button 601, the mobile phone can respond to the shooting operation to take a picture of the shooting screen in the viewfinder. In this way, the operation of taking a picture is avoided in error because the user's composition expectation is not met.

[0170] In other embodiments, Fig.16 As shown, when the mobile phone displays the real-time captured shooting picture 3 in the preview interface 1301 of the camera application, the already generated first contour line 1201 and second contour line 1202 can also be superimposed and displayed on the upper layer of the shooting picture 3 to guide the photographer to compose the picture according to the first contour line 1201 and the second contour line 1202.

[0171] Since the first contour line 1201 and the second contour line 1202 that match the composition expectation of user A are displayed in the shooting picture 3, when user A hands the mobile phone to another user (for example, user B), Fig.17 As shown, user B can also readjust the shooting screen according to the guidance of the first contour line 1201 and the second contour line 1202, so that the mobile phone can arrange the shooting target 401 within the first contour line 1201 of the shooting screen 3, and arrange the user A within the second contour line 1202 of the shooting screen 3. At this time, if it is detected that user B clicks the shutter button 601, the mobile phone can take a photo that matches the composition expectation of user A (i.e., shooting screen 4).

[0172] It should be noted that, although the mobile phone displays the first contour line 1201 and the second contour line 1202 when shooting the above-mentioned shooting picture 4, since the camera of the mobile phone does not actually capture the first contour line 1201 and the second contour line 1202, the first contour line 1201 and the second contour line 1202 may not be displayed in the photo actually taken by the mobile phone (i.e., shooting picture 4); of course, in other embodiments, the above-mentioned contour lines may also be displayed in the photos taken by the mobile phone.

[0173] In addition, if Fig.18As shown, when the mobile phone displays the preview interface of the shooting screen 4, if user A wants to check whether the effect of user B's shooting meets his / her composition expectations, user A can also perform preset operations such as long pressing or heavy pressing on the shooting screen 4. In response to the above preset operations, the mobile phone can re-display the first contour line 1201 and the second contour line 1202 in the shooting screen 4. When it is detected that the user's finger leaves the shooting screen 4, or after the first contour line 1201 and the second contour line 1202 are displayed for a preset time, the mobile phone can hide the first contour line 1201 and the second contour line 1202 displayed in the shooting screen 4. In this way, user A can very intuitively see whether the effect of user B's shooting meets his / her composition expectations, thereby improving the user experience.

[0174] In other embodiments, Fig.19 As shown, when the mobile phone displays the shooting picture 3 including the first contour line 1201 and the second contour line 1202, it can also detect in real time the positional relationship between the shooting target 401 in the shooting picture 3 in the preview interface 1301 and the first contour line 1201, as well as the positional relationship between the position of the person being shot (i.e., user A) in the shooting picture 3 and the second contour line 1202. In this way, if the shooting target 401 or user A in the shooting picture 3 deviates from the corresponding contour line, the mobile phone can prompt the photographer (i.e., user B) to adjust the shooting angle of the mobile phone accordingly. For example, Fig.19 As shown, if the photographing target 401 is biased to the left side of the second contour line 1202, the mobile phone may prompt the photographer to move the mobile phone to the left.

[0175] In some other embodiments, the mobile phone can also set the priority between the shooting target 401 and the subject. If the priority of the shooting target 401 is higher than the priority of the subject, it means that user A is more concerned about the composition of the shooting target 401 in the shooting picture 3. Then, if Fig. 20 As shown in (a) in FIG. 3 , if the mobile phone detects that the shooting target 401 is biased to the left side of the first contour line 1201, and the user A is biased to the right side of the second contour line 1202, the mobile phone can prompt the photographer to move the mobile phone to the left, so as to preferentially make the shooting target 401 enter the first contour line 1201 of the shooting screen 3. When the shooting target 401 is detected to enter the first contour line 1201 of the shooting screen 3, the mobile phone can prompt the photographer to start shooting.

[0176] Correspondingly, if the priority of the subject is higher than that of the shooting target, it means that user A is more concerned about the composition of the subject in the shooting picture 3. Then, if Fig. 20As shown in (b) in FIG. 3 , if the mobile phone detects that the shooting target 401 in the shooting screen 3 is biased to the right side of the first contour line 1201, and the user A is biased to the left side of the second contour line 1202, the mobile phone can prompt the photographer to move the mobile phone to the left, so as to preferentially allow the user A to enter the second contour line 1202 of the shooting screen 3. When it is detected that the user A enters the second contour line 1202 of the shooting screen 3, the mobile phone can prompt the photographer to start taking pictures.

[0177] In other embodiments, in addition to prompting the photographer to move the phone to adjust the composition of the captured image 3, the mobile phone can also prompt the subject to move to adjust the composition of the captured image 3. Fig.21 As shown, if the mobile phone detects in the shooting screen 3 that the shooting target 401 has entered the first contour line 1201, and the user A is biased to the right side of the second contour line 1202, the mobile phone can play a voice to guide the user A to move to the left until the user A enters the second contour line 1202.

[0178] In the above embodiment, the mobile phone takes the picture 2 taken by user A as the reference image. In other embodiments of the present application, if user A clicks Figure 5 The function button 501 of "Photography Assistant" shown in (a) of FIG. 1 is displayed, or user A enters Figure 5 The shooting mode 502 of the "shooting assistant" shown in (b) is as follows Fig. 22 As shown, the mobile phone can also prompt the user to mark the position 802 of the person who wants to be photographed when displaying the preview interface 402 of the camera application. At this time, user A can directly mark the position 802 of the person in the shooting picture 1 displayed in real time on the preview interface 402. For example, user A marks the position 802 of the person by smearing. Fig. 22 As shown, since the shooting picture 1 is a dynamic picture captured by the camera in real time, the mobile phone can use the picture when the user A's finger touches the shooting picture 1 as a reference image, or the mobile phone can also use the picture when the user A's finger leaves the shooting picture 1 as a reference image. Of course, the mobile phone can also use any picture of the user A in the process of painting the shooting picture 1 as a reference image, and this embodiment does not impose any restrictions on this.

[0179] In this way, after adjusting the composition of the shot, user A can directly mark the position of the person being photographed in the preview interface of the camera application, triggering the phone to use the current shot as a reference image to help user A take photos later.

[0180] After user A marks the person's position 802 in the preview interface 402 of the camera application, the mobile phone can still generate the first outline of the shooting target 401 and the second outline of the person's position 802 according to the method in the above embodiment, and display the first outline and the second outline in real time in the preview interface 402 of the camera application. In this way, user A can stay in the preview interface 402 of the camera application to complete a series of operations such as determining the reference image, marking the person's position 802, generating the first outline and the second outline, and using the first outline and the second outline to guide the photographer to take pictures, so as to improve the shooting efficiency when taking pictures.

[0181] In addition, each time the mobile phone uses the first contour line and the second contour line extracted from the reference image (such as the above-mentioned shooting picture 2) to take a photo, the first contour line and the second contour line can be deleted. In other words, each time the user uses the shooting method provided by this embodiment to take a photo, it is necessary to generate a reference image in real time, and extract the first contour line and the second contour line from the reference image to guide the subsequent user to take photos.

[0182] Alternatively, the mobile phone may store the reference image, or the first contour line and the second contour line in the reference image, locally on the mobile phone or in a cloud server. In this way, when the mobile phone subsequently takes photos similar to or the same as the reference image, the first contour line and the second contour line in the reference image may be used again to take photos, thereby saving the user's time in taking photos of the same scene and improving the efficiency of taking photos.

[0183] For example, Fig.23 As shown in (a) of FIG. 4 , the mobile phone can also set a button 404 in the preview interface 402 of the camera application. The button 404 can be used to instruct the mobile phone to display the stored contour lines in the viewfinder window 403. Then, when the mobile phone enters the preview interface 402 of the camera application, the generated contour lines can be not displayed in the viewfinder window 403. If it is detected that the user clicks the above button 404, Fig.23 As shown in (b) in the figure, the mobile phone can display a menu 405 of various contour lines in the preview interface 402. The user can select the desired contour line to be displayed in the menu 405. If it is detected that the user selects a contour line in the menu 405 (for example, the first contour line 1201 mentioned above), the mobile phone can superimpose and display the first contour line 1201 in the shooting interface displayed in the current viewfinder window 403, so that the user can compose the shooting picture through the first contour line 1201. In another case, if it is detected that the user clicks the above button 404, the mobile phone can also superimpose and display the most recently generated contour line in the viewfinder window 403, and the embodiment of the present application does not impose any limitation on this.

[0184] In addition to the method of extracting the first contour line and the second contour line from the reference image to guide the photographer to take a photo, the mobile phone can also perform semi-transparent processing on the determined reference image. Fig.24 As shown, after the mobile phone determines that the reference image is the shot picture 2, the shot picture 2 (including the person position 802 in the shot picture 2) can be semi-transparent by adjusting the transparency of the shot picture 2. Then, the mobile phone can overlay the transparent shot picture 2 on the upper layer of the shot picture 3 being previewed in the camera application, and the photographer can see the shot picture 3 actually captured by the camera through the transparent shot picture 2.

[0185] At this time, the transparent shooting picture 2 has the same function as the first contour line and the second contour line mentioned above, and can be used to adjust the composition of the shooting target and the subject in the shooting picture 3, so that the photographer can take photos that meet the expected effects of the subject.

[0186] In other embodiments of the present application, the above-mentioned image shooting method can also be applied to a group photo shooting scene. For example, when user A and a friend (such as user C) want to take a group photo, they can still Fig.12 As shown, user A can mark two character positions in the reference image (i.e., shot 2), namely, a first character position 1101 and a second character position 1102. The first character position 1101 is the position where user A wants to appear in shot 2, and the second character position 1102 is the position where user C wants to appear in shot 2.

[0187] So, if Fig.25 As shown, the contours extracted by the mobile phone from the shot picture 2 include the first contour 2101 of the shot target 401, the second contour 2102 of the first person position 1101, and the third contour 2103 of the second person position 1102. Then, in the subsequent shooting process, the mobile phone can display the first contour 2101, the second contour 2102, and the third contour 2103 in the shot picture being previewed by the camera application (for example, in the shot picture 5).

[0188] During the first photo shoot, Fig.25 As shown, user C can be the photographer and place the shooting target 401 in the first outline 2101 of the shooting screen 5, and place user A in the second outline 2102 of the shooting screen 5. Then, user C can click the shutter button 601 to shoot. At this time, the shooting screen 5 shot by the mobile phone is the first image.

[0189] During the second photo shoot, Fig.26As shown, user A can be the photographer and place the shooting target 401 in the first outline 2101 of the shooting screen 6, and place user C in the third outline 2103 of the shooting screen 6. Then, user A can click the shutter button 601 to shoot. At this time, the shooting screen 6 shot by the mobile phone is the second image.

[0190] Subsequently, the mobile phone fuses the first image and the second image to obtain a group photo that meets the composition expectations of both user A and user C. Fig. 27 As shown, since the shooting angles of the shooting pictures 5 and 6 shot according to the first contour line 2101, the second contour line 2102 and the third contour line 2103 are substantially the same, the mobile phone can splice the half image of the shooting picture 5 containing the user A with the half image of the shooting picture 6 containing the user C to obtain a group photo of the user A and the user C. This group photo image processing method is relatively simple in algorithm implementation, and there is no need to ask another person to help take photos when multiple people are taking group photos, thereby improving the shooting efficiency when taking group photos.

[0191] In combination with the above embodiments and corresponding drawings, this embodiment provides an image capturing method. Figure 1 or Figure 3 The electronic device (such as a mobile phone, tablet computer, etc.) shown in the figure is implemented. Fig.29 As shown, the method may include the following steps:

[0192] S2801. The electronic device displays a preview interface of a camera application on a touch screen. The preview interface includes a viewfinder window, and a shooting picture captured by a camera is displayed in the viewfinder window.

[0193] For example, the preview interface of the camera application is generally the main interface entered after the electronic device opens the camera application. For example, the preview interface of the camera application can be Figure 4-Figure 7 The preview interface 402 shown in FIG. The preview interface 402 includes a viewfinder window 403 for displaying the shooting picture captured by the camera of the electronic device, for example Figure 4 or Figure 5 It can be understood that the shooting picture in the viewfinder window can be dynamically changed.

[0194] S2802: In response to the first operation, the electronic device determines the captured image in the viewfinder as a reference image.

[0195] The first operation may be a photo taking operation, etc. The first operation may be manually triggered by a user or automatically performed by the electronic device.

[0196] In addition to the above-mentioned viewfinder window, the preview interface of the camera application may also include a preset button. For example, the preset button may be Figure 7 The function button 501 of "Photography Assistant" is shown. The preset button can be used to take a reference image to help the user take photos later. Figure 7 As shown, when it is detected that the user clicks the "shooting assistant" function button 501, the electronic device can determine the shooting picture 2 captured in the viewfinder at this time as a reference image, and display the reference image on the touch screen. In other words, the "shooting assistant" function button 501 integrates the functions of the shutter button and the function of opening the image shooting method provided by the present application.

[0197] Of course, the preview interface of the camera application may also include a shutter button, and the user may click the shutter button to cause the electronic device to determine the captured image (eg, captured image 2) in the viewfinder as a reference image. This embodiment does not impose any restrictions on this.

[0198] S2803: The electronic device displays the reference image on the touch screen.

[0199] In step S2803, after the electronic device captures the reference image, Figures 9 to 13 As shown, the electronic device may display a preview interface 801 of the reference image so that the user can determine at which specific position of the reference image the photographed target is to be displayed.

[0200] S2804: The electronic device determines a first contour line and a second contour line, wherein the first contour line is a contour line of the first photographed target in the reference image, and the second contour line is generated by the electronic device in response to user input in the reference image.

[0201] In step S2804, after the electronic device displays the reference image, the electronic device may Fig.14 The electronic device can then extract the contour line of the first position in the reference image to obtain Fig.14 The first contour line 1201 is shown in .

[0202] Furthermore, after the electronic device displays the reference image, the user can also manually mark the position (i.e., the second position) where the user wants the second shooting target to appear in the reference image. Figures 9 to 11 As shown, the second shooting target may be user A, and user A may input a selection operation (such as a click operation, a smear operation, etc.) into the reference image. In response to the selection operation input by user A, the electronic device may display the position selected by user A, i.e. Figures 9 to 11The person position 802 shown in FIG. 8 is determined as the second position of the second shooting target in the reference image. Then, the electronic device can extract the contour line of the second position in the reference image to obtain Fig.14 The second contour line 1202 is shown in .

[0203] It should be noted that the number of the above-mentioned shooting targets can be one or more. Fig.12 As shown, after user A marks the second position 1101 of the second photographed object in the reference image (i.e., photographed screen 2), user A may continue to mark the position (i.e., third position 1102) where the third photographed object appears in the reference image (i.e., photographed screen 2). Then, the electronic device may extract the contour line of the third position in the reference image to obtain the third contour line.

[0204] S2805: The electronic device displays a preview interface of the camera application and displays the first contour line in its viewfinder window.

[0205] When the electronic device displays the first contour line in the viewfinder window, the position of the first contour line in the viewfinder window is the same as the position of the first contour line in the reference image.

[0206] For example, Fig.15 As shown in (a) of FIG. 1 , after the electronic device generates the first contour line 1201 and the second contour line 1202, it can return to the preview interface 1301 of the camera application, and display the shooting picture 3 captured by the camera in the viewfinder window of the preview interface 1301. At the same time, the electronic device can also superimpose the first contour line 1201 on the shooting picture 3, so as to guide the photographer to compose the shooting picture 3 according to the first contour line 1201.

[0207] When displaying the first contour line 1201, the electronic device can also detect the positional relationship (i.e., the first positional relationship) between the first shooting target 401 and the first contour line 1201 in the viewfinder in real time. For example, the first shooting target 401 deviates from the right side of the first contour line 1201, and the first shooting target 401 deviates from the right side of the first contour line 1201. In this way, the electronic device can prompt the photographer to adjust the shooting position of the electronic device according to the first positional relationship, so that the first shooting target 401 can overlap with the first contour line 1201.

[0208] S2806: If it is detected that the first shooting target in the viewfinder window coincides with the first contour line, the electronic device displays the second contour line in the viewfinder window.

[0209] When the electronic device displays the second contour line in the viewfinder window, the position of the second contour line in the viewfinder window is the same as the position selected by the user for the second shooting target in the reference image.

[0210] like Fig.15 As shown in (b) in FIG. 1 , when the first shooting target 401 in the viewfinder coincides with the first contour line 1201, it means that the composition of the first shooting target 401 in the shooting screen 3 has satisfied the user's composition expectation. Then, the electronic device may present a prompt message, which is used to prompt the photographer to stop moving the electronic device. The prompt message may be presented in the form of text, voice, or animation, and this embodiment does not impose any limitation on this.

[0211] And, still Fig.15 As shown in (b) of FIG. 3 , when the first photographic target 401 in the viewfinder window coincides with the first outline 1201, the electronic device may further display a second outline 1202 of the second photographic target in the viewfinder window, thereby guiding the composition of the second photographic target in the photographing screen 3 through the second outline 1202. Of course, when displaying the second outline 1202, the electronic device may continue to display the first outline 1201, or may hide the first outline 1201 in the viewfinder window.

[0212] In addition, when the second shooting target is user A, the electronic device may also send a first prompt message to the wearable device of user A, and the first prompt message includes the shooting picture 3 in the viewfinder and the second contour line 1202. After receiving the first prompt message, the wearable device may display the first prompt message. In this way, user A may adjust his position according to the positional relationship between the second contour line 1202 and the shooting picture 3 displayed by the wearable device, so that the second shooting target (i.e. user A) can overlap with the second contour line 1202 in the viewfinder.

[0213] For example, the electronic device (or wearable device) can detect in real time the positional relationship (i.e., the second positional relationship) between the user A and the second contour line 1202 in the viewfinder window. In this way, the electronic device (or wearable device) can prompt the user A (the person being photographed) to adjust his / her shooting position according to the second positional relationship, so that the user A can overlap with the second contour line 1202 in the viewfinder window.

[0214] S2807: When the first shooting target coincides with the first contour line, and the second shooting target coincides with the second contour line, the electronic device takes a picture of the shooting screen in the viewfinder to obtain a first shot image.

[0215] When the first shooting target and the first contour line remain coincident, if it is detected that the second shooting target in the viewfinder coincides with the second contour line, it means that the composition of the first shooting target and the second shooting target in the current shooting picture meets the composition expectation set by user A in the reference image. At this time, the electronic device can automatically take a photo, that is, save the shooting picture in the viewfinder as the first shooting image, or prompt the user to click the shutter button to take a photo. If a second operation input by the user is detected, the electronic device saves the shooting picture in the viewfinder at this time as the first shooting image.

[0216] In some embodiments, after the electronic device captures the first captured image, it can also display a preview interface of the first captured image. If it is detected that the user performs a preset touch operation in the first captured image, such as a long press operation, a heavy press operation, etc., the electronic device displays the first contour line and the second contour line in the captured first captured image. In this way, the user can very intuitively see whether the shooting effect of the first captured image meets his or her composition expectations, thereby improving the user experience.

[0217] In some other embodiments, the above method may further include:

[0218] S2808: The electronic device returns to the preview interface of the camera application and displays the third outline of the third shooting target in its viewfinder window.

[0219] When the electronic device displays the third contour line in the viewfinder window, the position of the third contour line in the viewfinder window is the same as the position selected by the user for the third shooting target in the reference image.

[0220] like Fig.26 As shown, taking the third shooting target as user C and the second shooting target as user A as an example, if the electronic device also determines the third contour line 2103 of the third shooting target (i.e., user C) in the above step S2804, the electronic device can return to the preview interface of the camera application again after shooting the first shooting image including user A and the first shooting target 401. The viewfinder window of the preview interface displays the real-time shooting picture 6 captured by the camera.

[0221] And, still Fig.26 As shown, the electronic device may also display a third outline 2103 of the user C in its viewfinder window, thereby guiding the composition of the third shooting target in the shooting picture 6 through the third outline 2103. Of course, when displaying the third outline 2103, the electronic device may continue to display the first outline and the second outline in the viewfinder window, or may hide the first outline and the second outline in the viewfinder window.

[0222] Similar to step S2806, the electronic device may also send a second prompt message to the wearable device of user C, the second prompt message including the shooting picture 6 in the viewfinder window and the third contour line 2103. After receiving the second prompt message, the wearable device may display the second prompt message. In this way, user C may adjust his position according to the positional relationship between the third contour line 2103 and the shooting picture 6 displayed by the wearable device, so that the third shooting target (i.e., user C) can overlap with the third contour line 2103 in the viewfinder window.

[0223] S2809: When the first shooting target coincides with the first contour line, and the third shooting target coincides with the third contour line, the electronic device takes a picture of the shooting image in the viewfinder to obtain a second shooting image.

[0224] When the first photographic target and the first contour line remain coincident, if it is detected that the third photographic target in the viewfinder coincides with the third contour line, it means that the composition of the first photographic target and the third photographic target in the current photographic image meets the composition expectation set by the user C in the reference image. At this time, the electronic device can automatically take a photo, or take a photo in response to the user clicking the shutter button to take a photo, so as to save the photographic image in the current viewfinder as the second photographed image.

[0225] S2810: The electronic device fuses the first captured image and the second captured image to obtain a group photo of the first user and the second user.

[0226] In step S2810, the electronic device may fuse the first captured image with the second captured image. Fig. 27 As shown, after the images are fused, a group photo that meets the composition expectations of both user A and user C can be obtained. In this way, when taking a group photo with multiple people, a photo that meets the personalized needs of each subject can be taken, thereby improving the shooting efficiency.

[0227] The present application embodiment discloses an electronic device, including a processor, a memory connected to the processor, an input device, and an output device. The input device and the output device can be integrated into one device. For example, a touch-sensitive surface can be used as an input device, a display screen can be used as an output device, and the touch-sensitive surface and the display screen can be integrated into a touch screen. In this case, Fig.30As shown, the electronic device may include: one or more cameras 3000, a touch screen 3001, wherein the touch screen 3001 includes a touch-sensitive surface 3006 and a display screen 3007; one or more processors 3002; a memory 3003; one or more applications (not shown); and one or more computer programs 3004, and the above components may be connected via one or more communication buses 3005. The one or more computer programs 3004 are stored in the memory 3003 and configured to be executed by the one or more processors 3002, and the one or more computer programs 3004 include instructions, which may be used to execute the following: Fig.29 And each step in the corresponding embodiment.

[0228] Through the description of the above implementation methods, technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. The specific working process of the system, device and unit described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0229] Each functional unit in each embodiment of the present application can be integrated into a processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of software functional units.

[0230] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as flash memory, mobile hard disk, read-only memory, random access memory, disk or optical disk.

[0231] The above is only a specific implementation of the embodiment of the present application, but the protection scope of the embodiment of the present application is not limited thereto, and any changes or replacements within the technical scope disclosed in the embodiment of the present application should be included in the protection scope of the embodiment of the present application. Therefore, the protection scope of the embodiment of the present application should be based on the protection scope of the claims.

Claims

1. An image capturing method, characterized in that: The method is implemented in an electronic device having a touch screen and a camera, and includes: The electronic device displays a preview interface of a camera application on the touch screen, wherein the preview interface includes a viewfinder window, and the viewfinder window includes a shooting picture captured by the camera; In response to the first operation, the electronic device determines the captured image in the viewfinder as a reference image; The electronic device displays the reference image on the touch screen; The electronic device determines a first contour line, where the first contour line is a contour line of a first photographed object in the reference image; In response to a selection operation by a user in the reference image, the electronic device determines the position selected by the user as a second position of a second photographic target in the reference image, and extracts a contour line of the second position in the reference image as the second contour line; The electronic device displays the preview interface of the camera application and displays the first contour line in the viewfinder window; If it is detected that the first photographing target in the viewfinder window coincides with the first contour line, the electronic device displays the second contour line in the viewfinder window; When a first photographing target in the viewfinder coincides with the first contour line, and a second photographing target coincides with the second contour line, displaying the shutter button; In response to a second operation inputted by the user on the shutter button, the electronic device takes a picture of the shooting picture in the viewfinder to obtain a first shooting picture; When the electronic device displays the second contour line in the viewfinder window, the method further includes: The electronic device sends prompt information to the wearable device, where the prompt information includes a captured image in the viewfinder and a second contour line in the reference image, so that the wearable device displays the second contour line in the captured image.

2. The image capturing method according to claim 1, characterized in that: When the electronic device displays the second contour line in the viewfinder window, the method further includes: The electronic device continues to display the first contour line in the viewfinder window.

3. The image capturing method according to claim 1 or 2, characterized in that: If it is detected that the first photographing target in the viewfinder window coincides with the first contour line, the method further includes: The electronic device presents prompt information, and the prompt information is used to prompt the photographer to stop moving the electronic device.

4. The image capturing method according to any one of claims 1 to 3, characterized in that: After the electronic device displays the preview interface of the camera application and displays the first contour line in the viewfinder window, the method further includes: The electronic device detects a first positional relationship between the first photographic target and the first contour line in the viewfinder window; The electronic device prompts the photographer to adjust the shooting position of the electronic device according to the first position relationship.

5. The image capturing method according to claim 4, characterized in that: When the electronic device displays the second contour line in the viewfinder window, the method further includes: The electronic device detects a second positional relationship between the second photographic target and the second contour line in the viewfinder window; The electronic device determines the moving direction of the photographed person entering the second contour line according to the second position relationship; The electronic device sends the moving direction of the subject entering the second contour line to the wearable device, so that the wearable device prompts the subject to adjust the shooting position.

6. The image capturing method according to any one of claims 1 to 5, characterized in that: The electronic device determines a first contour line, including: Determining, by the electronic device, a first position of the first photographed target in the reference image; The electronic device extracts the contour line of the first position in the reference image as the first contour line.

7. The image capturing method according to claim 6, characterized in that: The electronic device determines a first position of the first photographed target in the reference image, including: The electronic device identifies a position of a scene in the reference image, and determines the position of the scene as a first position of the first photographic target in the reference image.

8. The image capturing method according to any one of claims 1 to 7, characterized in that: The electronic device takes a picture of the shooting picture in the viewfinder window to obtain a first shooting picture, including: In response to a second operation input by the user, the electronic device takes a picture of the shooting picture in the viewfinder window to obtain a first shooting image; or, When it is detected that the first shooting target in the viewfinder window coincides with the first contour line, and the second shooting target coincides with the second contour line, the electronic device automatically takes a picture of the shooting screen in the viewfinder window to obtain a first shot image.

9. The image capturing method according to any one of claims 1 to 8, characterized in that: When the electronic device displays the first contour line in the viewfinder window, the position of the first contour line in the viewfinder window is the same as the position of the first contour line in the reference image; When the electronic device displays the second contour line in the viewfinder window, the position of the second contour line in the viewfinder window is the same as the position selected by the user for the second photographic target in the reference image.

10. The image capturing method according to any one of claims 1 to 9, characterized in that: After the electronic device takes a picture of the shooting picture in the viewfinder window to obtain a first shooting picture, the method further includes: The electronic device displays a preview interface of the first captured image; In response to a user's touch operation in the preview interface of the first photographed image, the electronic device displays the first contour line and the second contour line in the first photographed image.

11. The image capturing method according to any one of claims 1 to 10, characterized in that: After the electronic device takes a picture of the shooting picture in the viewfinder window to obtain a first shooting picture, the method further includes: The electronic device displays a preview interface of the camera application, and displays a third contour line of a third shooting target in the viewfinder window, wherein the third contour line is generated by the electronic device in response to a user input in the reference image, the third shooting target is a first user, and the second shooting target is a second user; After the first shooting target coincides with the first contour line, and the third shooting target coincides with the third contour line, the electronic device takes a picture of the shooting picture in the viewfinder to obtain a second shooting image; The electronic device obtains a group photo of the first user and the second user after fusing the first captured image with the second captured image.

12. An electronic device, characterized in that: include: A touch screen, wherein the touch screen comprises a touch-sensitive surface and a display; one or more processors; one or more memories; One or more cameras; and one or more computer programs, wherein the one or more computer programs are stored in the one or more memories, and the one or more computer programs include instructions, which, when executed by the electronic device, cause the electronic device to perform the following steps: Displaying a preview interface of a camera application on the touch screen, wherein the preview interface includes a viewfinder window, and the viewfinder window includes a shooting picture captured by the camera; In response to a first operation, determining the captured image in the viewfinder window as a reference image; displaying the reference image on the touch screen; Determine a first contour line, where the first contour line is a contour line of a first photographed object in the reference image; In response to a selection operation by a user in the reference image, the electronic device determines the position selected by the user as a second position of a second photographic target in the reference image, and extracts a contour line of the second position in the reference image as the second contour line; Display the preview interface of the camera application, and display the first contour line in the viewfinder window; If it is detected that the first photographing target in the viewfinder window coincides with the first contour line, displaying the second contour line in the viewfinder window; When a first photographing target in the viewfinder coincides with the first contour line, and a second photographing target coincides with the second contour line, displaying the shutter button; In response to a second operation input by the user on the shutter button, taking a picture of the shooting picture in the viewfinder window to obtain a first shooting picture; When the electronic device displays the second contour line in the viewfinder window, the electronic device is further configured to execute: Prompt information is sent to the wearable device, where the prompt information includes a captured image in the viewfinder and a second contour line in the reference image, so that the wearable device displays the second contour line in the captured image.

13. The electronic device according to claim 12, characterized in that: When the electronic device displays the second contour line in the viewfinder window, the electronic device is further configured to execute: The first contour line continues to be displayed in the viewfinder window.

14. The electronic device according to claim 12 or 13, characterized in that: If it is detected that the first shooting target in the viewfinder window coincides with the first contour line, the electronic device is further configured to execute: Present prompt information, where the prompt information is used to prompt the photographer to stop moving the electronic device.

15. The electronic device according to any one of claims 12 to 14, characterized in that: After the electronic device displays the preview interface of the camera application and displays the first contour line in the viewfinder window, the electronic device is further configured to execute: Detecting a first positional relationship between the first photographing target and the first contour line in the framing window; The photographer is prompted to adjust the shooting position of the electronic device according to the first position relationship.

16. The electronic device according to claim 15, characterized in that: When the electronic device displays the second contour line in the viewfinder window, the electronic device is further configured to execute: Detecting a second positional relationship between the second photographic target and the second contour line in the framing window; determining a moving direction of the photographed person entering the second contour line according to the second position relationship; The moving direction of the subject entering the second contour line is sent to the wearable device, so that the wearable device prompts the subject to adjust the shooting position.

17. The electronic device according to any one of claims 12 to 16, characterized in that: The electronic device determines a first contour line, specifically comprising: Determining a first position of the first photographed object in the reference image; A contour line of the first position is extracted from the reference image as the first contour line.

18. The electronic device according to claim 17, characterized in that: The electronic device determines a first position of the first photographed target in the reference image, specifically comprising: The position of a scene in the reference image is identified, and the position of the scene is determined as a first position of the first photographed object in the reference image.

19. The electronic device according to any one of claims 12 to 18, characterized in that: The electronic device photographs the shooting picture in the viewfinder window to obtain a first shooting picture, specifically including: In response to a second operation input by the user, taking a picture of the shooting picture in the viewfinder window to obtain a first shooting image; or, When it is detected that the first shooting target in the viewfinder window coincides with the first contour line, and the second shooting target coincides with the second contour line, a shooting picture in the viewfinder window is automatically photographed to obtain a first shooting image.

20. The electronic device according to any one of claims 12 to 19, characterized in that: After the electronic device takes a picture of the shooting picture in the viewfinder window to obtain a first shooting picture, the electronic device is further used to execute: Displaying a preview interface of the first captured image; In response to a user's touch operation in the preview interface of the first photographed image, the first contour line and the second contour line are displayed in the first photographed image.

21. The electronic device according to any one of claims 12 to 19, characterized in that: After the electronic device takes a picture of the shooting picture in the viewfinder window to obtain a first shooting picture, the electronic device is further used to execute: displaying a preview interface of the camera application, and displaying a third outline of a third shooting target in the viewfinder window, wherein the third outline is generated by the electronic device in response to a user input in the reference image, the third shooting target is the first user, and the second shooting target is the second user; After the first photographic target coincides with the first contour line, and the third photographic target coincides with the third contour line, photographing the photographic image in the viewfinder window to obtain a second photographic image; After the first photographed image and the second photographed image are fused, a group photo of the first user and the second user is obtained.

22. A computer-readable storage medium, wherein instructions are stored in the computer-readable storage medium, characterized in that: When the instruction is executed on an electronic device, the electronic device executes an image capturing method as claimed in any one of claims 1 to 11.

23. A computer program product comprising instructions, characterized in that When the computer program product runs on an electronic device, the electronic device executes an image capturing method according to any one of claims 1 to 11.

Images