Photographing method, device, electronic device, and readable storage medium
Patent Information
- Application Number
- JP2023544407
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2021-01-22
- Filing Date
- 2022-01-18
- Publication Date
- 2025-03-05
- Estimated Expiration
- 2042-01-18
AI Technical Summary
【0011】 本出願の実施例では、ユーザの第1入力を受信し、前記第1入力が、第1プレビュー画像における第1オブジェクトの表示状態を調整するためのものであり、前記第1プレビュー画像が第1カメラによって捕捉された画像であり、前記第1入力に応答して、第2プレビュー画像を表示し、前記第2プレビュー画像が、メインカメラによって捕捉された画像を処理することで得られたものであり、前記第2プレビュー画像に表示状態が変化した第1オブジェクトが含まれ、そして前記第2プレビュー画像の表示情報に従って、N個のカメラによって捕捉されたN個の画像に対して画像処理を行い、第1目標画像を得て、ここで、前記N個のカメラは、少なくとも前記メインカメラを含み、Nは正の整数である。このことから分かるように、本発明の実施形態によれば、目標画像とカメラによって捕捉された画像とが異なるように、カメラによって捕捉された画像におけるオブジェクトの表示状態を調整することができる。このようにして、従来技術におけるイメージングがカメラによって捕捉された画像であることに比べて、イメージングの柔軟性が高められる。
Smart Images

Figure 0007640718000001 
Figure 0007640718000002 
Figure 0007640718000003
Abstract
Description
[Technical field]
[0001] (CROSS REFERENCE TO RELATED APPLICATIONS) This application claims priority to Chinese Patent Application No. 202110087293.1, filed in China on January 22, 2021, the entire contents of which are incorporated herein by reference.
[0002] The present application relates to the technical field of image processing, and specifically to a photographing method, device, electronic device, and readable storage medium. [Background technology]
[0003] With the development of the photographing function of electronic devices, more and more users use electronic devices to photograph and record every moment of their lives. At present, the imaging of electronic devices is the image captured by the camera, that is, the imaging is consistent with the actual scene. It can be seen that the imaging method in the prior art is single. Summary of the Invention [Problem to be solved by the invention]
[0004] The embodiments of the present application aim to provide an imaging method, an apparatus, an electronic device, and a readable storage medium that can solve the problem of the single imaging method in the prior art. [Means for solving the problem]
[0005] In a first aspect, embodiments of the present application include receiving a first input from a user, the first input being for adjusting a display state of a first object in a first preview image, the first preview image being an image captured by a first camera; displaying a second preview image in response to the first input, the second preview image being obtained by processing an image captured by a main camera, the second preview image including the first object whose display state has changed; performing image processing on the N images captured by the N cameras according to the display information of the second preview image to obtain a first target image; The N cameras include at least the main camera, where N is a positive integer.
[0006] In a second aspect, embodiments of the present application include a first receiving module for receiving a first input from a user, the first input being for adjusting a display state of a first object in a first preview image, the first preview image being an image captured by a first camera; a first display module for displaying a second preview image in response to the first input, the second preview image being obtained by processing an image captured by a main camera, the second preview image including a first object whose display state has changed; and a first processing module for performing image processing on the N images captured by the N cameras according to display information of the second preview image to obtain a first target image; The photographing device includes the N cameras including at least the main camera, where N is a positive integer.
[0007] In a third aspect, an embodiment of the present application provides an electronic device comprising a processor, a memory, and a program or command stored in the memory and executable on the processor, the program or command, when executed by the processor, achieving steps of the method according to the first aspect.
[0008] In a fourth aspect, an embodiment of the present application provides a readable storage medium having stored thereon a program or instructions which, when executed by a processor, effectuate steps of the method according to the first aspect.
[0009] In a fifth aspect, an embodiment of the present application provides a chip including a processor and a communication interface, the communication interface and the processor being coupled to execute programs or commands to implement the method according to the first aspect.
[0010] In a sixth aspect, embodiments of the present application provide a computer program product stored on a non-volatile storage medium and executed by at least one processor to implement the steps of the method according to the first aspect. Effect of the Invention
[0011] In an embodiment of the present application, a first input of a user is received, the first input is for adjusting a display state of a first object in a first preview image, the first preview image is an image captured by a first camera, and in response to the first input, a second preview image is displayed, the second preview image is obtained by processing an image captured by a main camera, the second preview image includes a first object whose display state has been changed, and image processing is performed on N images captured by N cameras according to the display information of the second preview image to obtain a first target image, where the N cameras include at least the main camera, and N is a positive integer. As can be seen from this, according to an embodiment of the present invention, the display state of an object in an image captured by a camera can be adjusted so that the target image and the image captured by the camera are different. In this way, the flexibility of imaging is enhanced compared with the imaging in the prior art being an image captured by a camera. [Brief description of the drawings]
[0012] [Figure 1] 1 is a flowchart of a photographing method provided in an embodiment of the present application. [Figure 2a] FIG. 1 is a schematic diagram (part 1) of an image provided in an example of the present application. [Figure 2b] FIG. 2 is a schematic diagram (part 2) of an image provided in an example of the present application. [Figure 2c] FIG. 3 is a schematic diagram of an image provided in an example of the present application (part 3). [Figure 2d] FIG. 4 is a schematic diagram of an image provided in an example of the present application (part 4). [Figure 2e] FIG. 5 is a schematic diagram of an image provided in an example of the present application (part 5). [Figure 3a] FIG. 6 is a schematic diagram of an image provided in an example of the present application (part 6). [Figure 3b] This is a schematic diagram (part 7) of an image provided in the examples of the present application. [Figure 3c] This is a schematic diagram (part 8) of an image provided in the examples of the present application. [Figure 3d] This is a schematic diagram (part 9) of an image provided in the examples of the present application. [Figure 3e] This is a schematic diagram (number 10) of an image provided in the examples of the present application. [Figure 4] FIG. 1 is a schematic diagram (part 1) of a display state adjustment control provided in an embodiment of the present application. [Figure 5a] FIG. 2 is a schematic diagram (part 2) of a display state adjustment control provided in an embodiment of the present application. [Figure 5b] FIG. 3 is a schematic diagram (part 3) of a display state adjustment control provided in an embodiment of the present application. [Figure 6] FIG. 2 is a configuration diagram of an imaging device provided in an embodiment of the present application. [Figure 7] FIG. 1 is a configuration diagram (part 1) of an electronic device provided in an embodiment of the present application. [Figure 8] FIG. 2 is a configuration diagram (part 2) of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0013] Hereinafter, the technical solutions in the embodiments of the present application will be described clearly and completely with reference to the drawings in the embodiments of the present application, and it should be understood that the described embodiments are only a part of the embodiments of the present application, and are not all of the embodiments. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without any creative efforts belong to the protection scope of the present application.
[0014] The terms "first", "second", etc. in the specification and claims of this application are not intended to describe a particular order or sequence, but are intended to distinguish between similar targets. It should be understood that the terms used in this manner may be substituted for each other where appropriate so that the embodiments of this application can be implemented in an order other than that shown or described herein, and that the targets distinguished by "first" and "second" generally belong to one category, and the number of targets is not limited, for example, the first target may be one or more. In addition, in the specification and claims, "and / or" indicates at least one of the connected targets, and the symbol " / " generally indicates that the related targets are in an "or" relationship.
[0015] Hereinafter, the photographing method provided in the embodiment of the present invention will be described in detail with reference to specific examples and application scenarios with reference to the drawings.
[0016] The photographing method provided in the embodiments of the present application can be performed by an electronic device that includes at least one camera.
[0017] When an electronic device includes two or more cameras, the different cameras may have different focusing ranges (also called zoom rates) in order to clearly capture objects at different distances.
[0018] It can be understood that different focusing ranges correspond to different object distance shooting ranges. Therefore, in concrete implementation, the electronic device can select a camera to shoot a target object according to the object distance of the target object, and the object distance shooting range corresponding to the focusing range of the camera to shoot the target object includes the object distance of the target object.
[0019] For example, assuming that the electronic device includes a standard camera, an ultra-wide-angle camera, and a telephoto camera, the focusing range of the ultra-wide-angle camera is a first focusing range, which is suitable for photographing an object whose object distance is equal to or greater than 0 and less than a first predetermined distance threshold, i.e., the object distance shooting range corresponding to the first focusing range is [0, first predetermined distance threshold), the focusing range of the standard camera is a second focusing range, which is suitable for photographing an object whose object distance is equal to or greater than the first predetermined distance threshold and less than a second predetermined distance threshold, i.e., the object distance shooting range corresponding to the second focusing range is [first predetermined distance threshold, second predetermined distance threshold), and the focusing range of the telephoto camera is a third focusing range, which is suitable for photographing an object whose object distance is equal to or greater than the second predetermined distance threshold, i.e., the object distance shooting range corresponding to the second focusing range is [second predetermined distance threshold, ∞).
[0020] If the object distance of the target object to be photographed is less than the first preset distance threshold, the electronic device can select the ultra-wide-angle camera to photograph the target object.
[0021] In addition, when an electronic device includes two or more cameras, one of the cameras can be set as the main camera of the electronic device, and the other camera can be set as the auxiliary camera of the electronic device. The settings of the main camera and the auxiliary camera can be determined according to actual needs, and the embodiments of the present application are not limited thereto. For example, assuming that an electronic device includes the above-mentioned standard camera, ultra-wide-angle camera, and telephoto camera, the standard camera can be the main camera of the electronic device, and the ultra-wide-angle camera and the telephoto camera can be the auxiliary cameras of the electronic device.
[0022] In practical applications, the electronic device may be a mobile phone, a tablet personal computer, a laptop computer also called a notebook computer, a personal digital assistant (PDA), a personal digital assistant, a netbook, an ultra-mobile personal computer (UMPC), a mobile Internet device (MID), a wearable device or a vehicle-mounted equipment (VUE), a pedestrian-mounted equipment (PUE), etc.
[0023] 1, which is a flowchart (part 1) of the imaging method provided in the embodiment of the present application. As shown in FIG. 1, the imaging method may include steps 101, 102 and 103.
[0024] In step 101, a first input from a user is received, the first input being for adjusting a display state of a first object in a first preview image, the first preview image being an image captured by a first camera.
[0025] Adjusting the display state of the first object in the first preview image adjusting a display size of the first object in the first preview image, such as by enlarging or reducing the first object in the first preview image; adjusting a display position of the first object in the first preview image, for example, by moving the first object in the first preview image up, down, left, or right.
[0026] The first camera may be a main camera or an auxiliary camera of an electronic device.
[0027] In step 102, in response to the first input, a second preview image is displayed, the second preview image being obtained by processing an image captured by the main camera, the second preview image including the first object whose display state has changed.
[0028] In a specific implementation, the step of displaying a second preview image in response to the first input includes: adjusting a display state of the first preview image or adjusting a display state of a first object in the first preview image in response to the first input to obtain a first processed image; performing a fourth image processing on the first processed image to obtain a fourth intermediate image, the fourth intermediate image including only fourth pixel information in the first processed image, the fourth pixel information being pixel information corresponding to the first object in the first processed image; acquiring a fourth image, the fourth image being an image captured by the main camera at a second time; performing a fifth image processing on the fourth image to obtain a fifth intermediate image, the fifth intermediate image including all pixel information except for a fifth pixel information in the fourth image, the fifth pixel information being pixel information corresponding to the first object in the fourth image; combining the fourth intermediate image and the fifth intermediate image to obtain a second preview image; displaying the second preview image; The second time is a time earlier than the input time of the first input, or the second time is a time later than the input time of the first input.
[0029] Furthermore, if the second time is earlier than the input time of the first input, the fourth image may be an image captured by the main camera from the end of its corresponding buffer queue, and if the second time is later than the input time of the first input, the fourth image may be an image output by the main camera sensor after receiving light.
[0030] In this optional embodiment, in a first implementation manner, the first input can adjust a display state of the entire image of the first preview image to realize adjusting a display state of a first object in the first preview image, in which the first processed image is the first preview image after the display state has been adjusted, that is, the objects in the first processed image have all changed relative to the first preview image.
[0031] In a second implementation manner, the first input may adjust only a display state of the first object in the first preview image without affecting display states of other objects in the first preview image, in which only the first object in the first processed image changes relative to the first preview image, and other objects do not change relative to the first preview image.
[0032] After acquiring a first processed image, the electronic device can obtain a fourth intermediate image by deleting all pixel information other than the fourth pixel information in the first processed image.
[0033] Moreover, the electronic device can obtain a fifth intermediate image by acquiring the fourth image and deleting fifth pixel information in the fourth image.
[0034] After obtaining the fourth intermediate image and the fifth intermediate image, the electronic device can combine the fourth intermediate image and the fifth intermediate image to obtain a second preview image.
[0035] The electronic device can then display a second preview image so that the user can check the first object whose display state has changed through the second preview image.
[0036] It should be noted that when there is a blank area in the second preview image, before displaying the second preview image, the electronic device can use adjacent pixel information of the blank area, in a manner not limited to interpolation processing, to perform pixel filling for the blank area in the second preview image, thereby improving the imaging effect.
[0037] For ease of understanding, the following will be illustratively described with reference to Figures 2a to 2e.
[0038] In the following example, it is assumed that the image captured by each camera contains two objects, a "cloud" and a "person," and the "cloud" is the first object and the "person" is the second object. Adjusting the display state of the first object in the first preview image is expressed as enlarging the first object in the first preview image.
[0039] The display in FIG. 2a shows a first preview image 20 captured by a first camera, the first preview image 20 including a first object and a second object whose display state does not change.
[0040] When the first input is received, the electronic device can respond to the first input by enlarging the first preview image 20 to obtain a first processed image 21 as shown in FIG. 2b, in which the first processed image 21 includes an enlarged first object and an enlarged second object.
[0041] In FIG. 2c a fourth intermediate image 22 is shown which contains the first object after enlargement.
[0042] In FIG. 2d a fifth intermediate image 23 is shown containing the second object in a changed display state.
[0043] FIG. 2e shows a second preview image 24 including the enlarged first object and the second object in a changed display state.
[0044] In step 103, image processing is performed on the N images captured by the N cameras according to the display information of the second preview image to obtain a first target image.
[0045] In one specific implementation, the electronic device performs image processing on the N images captured by the N cameras in response to a photographing input according to the display information of the second preview image to obtain a first target image. In another specific implementation, the electronic device performs image processing on the N images captured by the N cameras periodically according to the display information of the second preview image based on a preset frequency to obtain a first target image.
[0046] The N cameras include at least the main camera, where N is a positive integer. Optionally, if the first camera is the main camera, the N cameras include the main camera. If the first camera is a first auxiliary camera, the N cameras include the main camera and the first auxiliary camera, where a focusing range of the first auxiliary camera is different from a focusing range of the main camera. Optionally, the display information may include at least one of, but is not limited to, a display effect, a display size, and a display position.
[0047] In this step, the display information of the first target image is the same as the display information of the second preview image. Optionally, the display information of the first object of the first target image is the same as the display information of the first object of the second preview image, and the display information of other objects of the first target image may be the same as or different from the display information of the second preview image, and may be specifically determined according to the actual situation, and the embodiment of the present application is not limited thereto. Thus, the first target image also includes the first object whose display state has changed, so that the first target image is different from the image captured by the camera, and the flexibility of imaging is enhanced.
[0048] When the display information of the first target image meets the user's requirements, the user can understand that the electronic device can perform a photographing input so that the electronic device outputs the first target image that meets the user's requirements. Thus, imaging can be performed to meet the user's requirements, and the utilization rate of imaging can be improved.
[0049] The photographing method of this embodiment includes receiving a first input from a user, the first input being for adjusting a display state of a first object in a first preview image, the first preview image being an image captured by a first camera, and displaying a second preview image in response to the first input, the second preview image being obtained by processing an image captured by a main camera, the second preview image including a first object whose display state has changed, and performing image processing on N images captured by N cameras according to display information of the second preview image to obtain a first target image, where the N cameras include at least the main camera, and N is a positive integer. As can be seen from this, this embodiment can adjust the display state of an object in an image captured by a camera so that the target image and the image captured by the camera are different. In this way, the flexibility of imaging is enhanced compared to the imaging in the prior art being an image captured by a camera. Also, imaging can be made to meet the requirements of a user, and the utilization rate of imaging can be improved.
[0050] In an embodiment of the present application, optionally, when the first camera and the main camera are not the same camera, before the step of receiving a first input from a user, the method further comprises: displaying a fifth preview image, the fifth preview image being an image captured by the main camera; receiving a fifth user input for the first object in the fifth preview image; obtaining a first object distance corresponding to the first object in response to the fifth input; determining a target camera that matches the first object according to the first object distance; If the target camera is the first camera, displaying the first preview image.
[0051] In this optional embodiment, the electronic device can display an image captured by the main camera in the display area when the capture function is turned on.
[0052] In order to capture objects at different distances clearly, taking into consideration that different cameras have different focusing ranges, the electronic device can switch cameras to improve imaging clarity when capturing objects at different object distances. For example, but not limited to, to obtain clearer near-view or far-view images, the electronic device can call a near-focus camera to capture a near-view image or a far-focus camera to capture a far-view image.
[0053] In this optional embodiment, the fifth input acting on the first object indicates that the user intends to adjust the viewing state of the first object, and thus the electronics can invoke a target camera that matches the first object before adjusting the viewing state of the first object to capture a clearer first object.
[0054] The electronic device can store in advance a correspondence relationship between each camera and an object distance shooting range, and the correspondence relationship is such that for an object in a certain object distance shooting range, an image corresponding to the object captured by a camera corresponding to the object distance shooting range is the clearest. In this way, after receiving the fifth input, the electronic device can obtain a first object distance corresponding to a first object, i.e., an object distance of an object (real entity) corresponding to the first object (imaging of an object), in response to the fifth input, and thereby determine a target camera that is suitable for the first object according to the first object distance.
[0055] In a specific implementation, the electronic device can determine a camera corresponding to an object distance shooting range to which the first object distance belongs as a target camera, and if the target camera is the first camera, the electronic device can display an image captured by the first camera, i.e., the first preview image.
[0056] In this optional embodiment, the electronic device can determine an object for which the user wishes to adjust the display state based on a user input, and according to an object distance corresponding to the object, can call up a display area to display an image captured by a target camera corresponding to the object, and can further adjust the display state of the object according to the image to improve imaging clarity.
[0057] In an embodiment of the present application, after the user adjusts the display state of the first object in the first preview image by the first input, the user can continue to adjust the display state of other objects in the image captured by the camera by other inputs, which is specifically described as follows:
[0058] Optionally, after the step of displaying a second preview image in response to the first input, the method further comprises: receiving a second user input, the second input for selecting a second object in the second preview image; displaying a third preview image in response to the second input, the third preview image being an image captured by a second camera; receiving a third input from a user, the third input being for adjusting a display state of a second object in the third preview image; displaying a fourth preview image in response to the third input, the fourth preview image being obtained by processing an image captured by a main camera, the fourth preview image including a first object whose display state has changed and a second object whose display state has changed; The method further includes performing image processing on the N images captured by the N cameras according to the display information of the fourth preview image to obtain a second target image.
[0059] In this alternative embodiment, the second camera may be a camera that matches the second object. The second input acting on the second object indicates that the user intends to adjust the display state of the second object. Therefore, in order to capture the second object more clearly, the electronic device may call a target camera that matches the second object before adjusting the display state of the second object, and display an image captured by the target camera for the user to adjust the display state of the second object by the input.
[0060] The step of displaying a fourth preview image in response to the third input includes: adjusting a display state of the third preview image or adjusting a display state of a second object in the third preview image in response to the third input to obtain a second processed image; performing a sixth image processing on the second processed image to obtain a sixth intermediate image, the sixth intermediate image including only sixth pixel information in the second processed image, the sixth pixel information being pixel information corresponding to the second object in the second processed image; performing a seventh image processing on the second preview image to obtain a seventh intermediate image, the seventh intermediate image including all pixel information except for a seventh pixel information in the fourth image, and the seventh pixel information being pixel information corresponding to the second object in the second preview image; and combining the sixth intermediate image and the seventh intermediate image to obtain a fourth preview image.
[0061] It should be noted that the method of obtaining the fourth preview image is similar to the principle of obtaining the second preview image. For details, please refer to the above description. Here, detailed description is omitted.
[0062] For ease of understanding, an exemplary description will be given below with reference to Figs. 2a to 3e.
[0063] In the following example, it is assumed that the images captured by each camera include two objects, a "cloud" and a "person," and the "cloud" is the first object and the "person" is the second object. Adjusting the display state of the second object in the second preview image is expressed as shrinking the second object in the second preview image.
[0064] The display in FIG. 3a shows a third preview image 30 captured by a third camera. 3 The preview image 30 includes a first object and a second object whose display state does not change.
[0065] When the third input is received, the electronic device can respond to the third input by reducing the third preview image 30 to obtain a second processed image 31 as shown in FIG. 3b, in which the second processed image 31 includes a reduced first object and a reduced second object.
[0066] In FIG. 3c a sixth intermediate image 32 is shown which includes the second object after reduction.
[0067] FIG. 3d shows a seventh intermediate image 33 obtained by performing a seventh image processing on the second preview image 34 in FIG. 2e and including the first object after enlargement.
[0068] In FIG. 3e a fourth preview image 34 is shown which includes the first object after enlargement and the second object without being reduced.
[0069] In this optional embodiment, the user adjusts the display state of the first object in the first preview image by the first input, and then adjusts the display state of the second object in the third preview image by the third input. Thus, the electronic device performs image processing on the N images captured by the N cameras according to the display information of the fourth preview image to obtain a second target image.
[0070] The N cameras can satisfy any one of the following a), b), and c).
[0071] a) When the first camera and the second camera are both the main camera, the N cameras include the main camera.
[0072] b) When the first camera (or the second camera) is a first auxiliary camera and the second camera (or the first camera) is the main camera, the N cameras include the main camera and the first auxiliary camera (or the second camera), and the focusing range of the first auxiliary camera is different from the focusing range of the main camera.
[0073] c) When the first camera is a first auxiliary camera and the second camera is a second auxiliary camera, the N cameras include the main camera, the first auxiliary camera and the third camera, and the focusing ranges of the first auxiliary camera, the second auxiliary camera and the main camera are each different.
[0074] In this optional embodiment, in one implementation manner, the electronic device can synthesize the first intermediate image, the second intermediate image, and the third intermediate image in accordance with the display information in the fourth preview image in response to a shooting input to obtain a second target image. In another implementation manner, the electronic device can synthesize the first intermediate image, the second intermediate image, and the third intermediate image periodically in accordance with the display information in the fourth preview image based on a preset frequency to obtain a second target image.
[0075] The display information of the second target image is the same as the display information of the fourth preview image. Optionally, the display information of the first object and the second object of the second target image is the same as the display information of the first object and the second object in the fourth preview image, and the display information of other objects of the second target image may be the same as or different from the display information of the fourth preview image, and may be specifically determined according to the actual situation, and the embodiment of the present application is not limited thereto. Thus, the first target image also includes the first object whose display state has changed and the second object whose display state has changed, so that the second target image is different from the image captured by the camera, and the flexibility of imaging is enhanced.
[0076] Regarding c), optionally, the step of processing the N images captured by the N cameras according to the display information of the fourth preview image to obtain a target image includes: acquiring a first image, a second image, and a third image, wherein the first image is an image captured by the main camera at a first time, the second image is an image captured by the first auxiliary camera at the first time, and the third image is an image captured by the second auxiliary camera at the first time; performing a first image processing on the first image to obtain a first intermediate image, the first intermediate image including all pixel information in the first image except for first pixel information, the first pixel information being pixel information corresponding to the first object and the second object in the first image; performing a second image processing on the second image to obtain a second intermediate image, the second intermediate image including only second pixel information in the second image, the second pixel information being pixel information corresponding to the first object in the second image; performing a third image processing on the third image to obtain a third intermediate image, the third intermediate image including only third pixel information in the second image, the third pixel information being pixel information corresponding to the second object in the third image; and synthesizing the first intermediate image, the second intermediate image, and the third intermediate image according to display information in the fourth preview image to obtain a second target image. The first time is a time earlier than an input time of the photographed input, or the first time is a time later than an input time of the photographed input.
[0077] Alternatively, in a system in which the electronic device acquires the second target image in response to a photographic input, the first time may be earlier than the input time of the photographic input, or the first time is later than the input time of the photographic input. In a system in which the electronic device acquires the second target image periodically, the first time may be earlier than a start time of the period, or the first time is later than a start time of the period.
[0078] If the first time is earlier than the input time of the shooting input (or the start time of the cycle), the first image may be an image captured by the main camera from the end of its corresponding buffer queue, the second image may be an image captured by the first camera from the end of its corresponding buffer queue, and the third image may be an image captured by the second auxiliary camera from the end of its corresponding buffer queue.
[0079] If the first time is later than the input time of the photographed input (or the start time of the cycle), the first image may be an image output by the sensor of the main camera after it receives light, the second image may be an image output by the sensor of the first auxiliary camera after it receives light, and the third image may be an image output by the sensor of the second auxiliary camera after it receives light.
[0080] Specifically, when realizing this, the electronic device can obtain a first intermediate image by deleting first pixel information in the first image, can obtain a second intermediate image by deleting all pixel information other than the second pixel information in the second image, and can obtain a third intermediate image by deleting all pixel information other than the third pixel information in the third image.
[0081] After acquiring the first intermediate image, the second intermediate image, and the third intermediate image, the electronic device can synthesize the first intermediate image, the second intermediate image, and the third intermediate image according to display information in the fourth preview image to obtain a second target image.
[0082] It should be noted that when there is a blank area in the second target image, the electronic device can use adjacent pixel information of the blank area in a manner not limited to interpolation processing to perform pixel filling for the blank area of the second preview image, thereby improving the imaging effect.
[0083] The following describes the first input of an embodiment of the present application.
[0084] Optionally, prior to the step of receiving a first user input, the method further comprises: receiving a fourth user input for a first object in the first preview image; and displaying, in response to the fourth input, a first display state adjustment control associated with the first object in the first preview image; The step of receiving a first user input comprises: receiving a first user input to the first display state adjustment control; Different objects in the first preview image are associated with different view state adjustment controls.
[0085] In this optional embodiment, a fourth input can trigger the electronic device to display a first display state adjustment control associated with the first object before the user executes the first input.
[0086] In a specific implementation, the fourth input may be, but is not limited to, a slide input whose input trajectory surrounds the first object, or a tap input that taps the first object.
[0087] Further, the step of receiving a first user input to the first display state adjustment control further comprises: receiving a first input from a user to the first sub-control or the second sub-control when the first display state adjustment control includes a first sub-control and a second sub-control, the first sub-control being for adjusting a display size of one object, and the second sub-control being for adjusting a display position of one object; When the first display state adjustment control includes a first display mode and a second display mode, the method includes a step of receiving a first input from a user to the first display state adjustment control in the first display mode or the first display state adjustment control in the second display mode, where in the first display mode, the first display state adjustment control is for adjusting a display size of one object, and in the second display mode, the first display state adjustment control is for adjusting a display position of one object.
[0088] For ease of understanding, an exemplary description is given below with reference to Figs. 4 to 5b.
[0089] In Fig. 4, the first display state adjustment control includes a first sub-control 41 and a second sub-control 42. In particular, when a user wants to adjust the display size of the first object, this can be achieved by touching the first sub-control 41 of the first display state adjustment control, and when a user wants to adjust the display position of the first object, this can be achieved by touching the second sub-control 42 of the first display state adjustment control. In this way, a user can adjust the display size and display position of an object by touching different sub-controls, thereby increasing the independence of the display state adjustment of an object and reducing the false trigger rate of the display state adjustment.
[0090] In Fig. 5a and Fig. 5b, the first display state adjustment control includes a first display mode and a second display mode, where the first display state adjustment control shown in Fig. 5a is in the first display mode, and the first display state adjustment control shown in Fig. 5b is in the second display mode. In concrete implementation, when a user wants to adjust the display size of the first object, he can perform an input to trigger the electronic device to set the first display state adjustment control to the first display mode, and when a user wants to adjust the display position of the first object, he can perform an input to trigger the electronic device to set the first display state adjustment control to the second display mode. In this way, a user can realize the adjustment of the display size and display position of an object through different display modes of one display state adjustment control, thereby reducing the number of settings of the control.
[0091] In the following, an application scenario will be exemplarily described in which the first input is a user's input to the first display state adjustment control, and the first display state adjustment control includes a first display mode and a second display mode.
[0092] The electronic device can use multiple cameras to capture the same scene, and realize distance switching between distant and near scenes by adjusting the magnification factor bar (i.e., the first display state adjustment control in the first display mode). The electronic device can realize fusion of scenes captured by multiple cameras with different magnification factors to realize distance switching. For example, two cameras can be used to capture simultaneously and control the magnification factor of an object, which can be used for a scene where a user wants to capture a close-up. For example, if a user takes a photo of an entire fruit tree and wants to enlarge a close-up of one fruit on the tree, the user can enlarge the fruit, and a fusion process can be performed on the enlarged image part of the fruit and the image of the entire fruit tree, thereby enabling a close-up of a particular area or detail of the object in the entire scene.
[0093] Electronic devices may be equipped with multiple cameras to achieve a sliding zoom effect. Current devices are not limited to three cameras, but may include an ultra-wide-angle lens (Ultra), a wide-angle lens (Wide) or a telephoto lens (Tele), each lens having a different focal length and a different lens coverage range, which can be selected and applied according to the distance to the target object. For example, when the distance to the target object is relatively close, the ultra-wide-angle lens is suitable for capturing video, when the distance to the target object is medium, the wide-angle lens is suitable for capturing video, and when the distance to the target object is relatively far, the telephoto lens is suitable for capturing video.
[0094] When multiple cameras are installed in an electronic device, the cameras installed in the electronic device may be a combination of an ultra-wide-angle lens and a wide-angle lens, a combination of a wide-angle lens and a telephoto lens, or a combination of an ultra-wide-angle lens, a wide-angle lens and a telephoto lens. The combination of different lenses can be applied to different shooting range needs, for example, for the combination of an ultra-wide-angle lens and a wide-angle lens, when the zoom rate applied to the wide-angle lens is in the range of 1 to 2, if it is lower than the range, the imaging may become unclear, and when it is necessary to further capture an image with a clear zoom rate of less than 1, it is necessary to switch the wide-angle lens to the ultra-wide-angle lens to obtain a better shooting effect.
[0095] The electronic device can use multiple cameras mounted thereon to capture distant and close scenes using different cameras, thereby achieving relatively good clarity. A specific implementation of the electronic device includes the following steps 1 and 2.
[0096] In step 1, while shooting, the user can adjust and control the zoom factor of the far-focus camera by touching a drag factor bar associated with an object in the distance.
[0097] As shown in Figure 5a, when the user touches the screen, a multiplier bar appears, which is the adjustable multiplier range. Alternatively, the multiplier adjustment range may be 1 to 4, or may be divided into 40 intervals, for example, the multiplier may be 1.1, 1.2, 1.3...
[0098] In step 2, during shooting, the user can adjust and control the zoom factor of the near-focus camera by touching the drag factor bar bound to the near-view object.
[0099] For distance and near selection, the user can circle the distance and near object to be processed on the screen, then tap on the object within the circle and a multiplication bar appears.
[0100] A different camera is selected depending on the distance of the object touched by the user. For example, if the object touched by the user belongs to the close range, the focusing point is in the close range, and the distance of the object can be measured by laser ranging or binocular ranging. If it is determined to be a close range, the close-focus camera is called. Regarding the threshold for determining this distance, if the distance to the focused object is less than 1m, it is a close range and the close-focus camera is called, and if it is more than 1m, it is a distant range and the far-focus camera is called. The specific threshold setting is determined by the focal length of the camera.
[0101] Touching a close view calls up a close-focus camera, which has a small focal length, allowing the close view to be captured relatively clearly. Touching a distant view calls up a far-focus camera, which has a long focal length, allowing the distant view to be captured relatively clearly. As is well known, when a terminal captures an object close to it, the imaging of the object becomes larger, and when an object farther away from the terminal is captured, the imaging of the object becomes smaller as the distance increases. Therefore, in order to change the effective distance of this capture, the object may be enlarged or reduced.
[0102] Therefore, if a user wishes to enlarge or reduce the distance between a distant object and a near object, touching the near object may set the reduction factor, for example the slide bar to 1.2, indicating that the object will be reduced to 1.2 times the original size, and touching the distant object may set the enlargement factor, for example the magnification bar to 2.5, indicating that the object will be enlarged to 2.5 times the original size.
[0103] The image processing process is as follows: according to the object magnification ratio selected by the user, two cameras are used for processing to generate two digital zoom frames, one of which is a far-view enlarged frame and the other is a near-view reduced frame; a far-focus camera is used to generate one unprocessed base frame, and the objects corresponding to the enlarged and reduced frames are cut out and merged into the corresponding positions of the base frame to cover the original object; the edges of the merged object and the surrounding pixels may be interpolated to make the edge transition smoother, and finally synthesized into one photo.
[0104] By changing the magnification of the foreground and background, the distance between the foreground and background is changed, as shown in Figure 3e, where the effect is shown after the nearby person is reduced and the distant clouds are enlarged.
[0105] As can be seen, the user can adjust the display size of the object in the image by the multiplication bar, and realize the distance switching between the distant view and the near view. Also, the electronic device can capture the image of the object at different object distances by different cameras, and ensure the clarity of the distant view and the near view.
[0106] If the user wants to change the position of an object in the image, double tapping the multiplier bar will display a coordinate axis (i.e., the first display state adjustment control in the second display mode), which is an orientation coordinate and can be used to change the position of the object in the image.
[0107] In concrete implementation, touching the distant view and the near view triggers the electronic device to display the coordinate axis next to it, as shown in FIG. 5b. The x-axis and y-axis of the coordinate axis represent the horizontal position and the vertical position, respectively, and the origin is the original position of the object. The user may slide the position coordinates of the x-axis and y-axis, respectively. For example, if the user slides the x-axis to 1 and the y-axis to 2, the position will be coordinate (1,2), which indicates that the object has moved 1m horizontally to the right and then 2m vertically up. If the user's position is (-0.1,-0.5), it indicates that the object has first moved 1cm horizontally to the left and then moved 5cm vertically down. If the user slides only the x-axis, the object will move only horizontally, and if the user slides only the y-axis, the object will move only vertically.
[0108] After adjusting the orientation of the near and far view, the near and far objects can be cropped according to the different orientations adjusted by the user, and image fusion of the corresponding positions can be performed independently, and the remaining part of the crop can be filled with the surrounding difference.
[0109] As can be seen, the coordinate axes allow the user to adjust the position of an object in an image, and furthermore, allow the user to more flexibly adjust the distance between the foreground and background of an object.
[0110] It should be noted that in another embodiment, the first input may be an input whose input position includes the first object. Furthermore, the first input may be an input whose initial input position is the first object. In this case, a user can start executing the first input on an object whose display state is to be adjusted. In this way, the electronic device can determine that the first object is an object corresponding to the initial input position of the first input. For example, if a user wants to adjust the display state of a first object, the user can start executing the first input on the display position of the first object, triggering the electronic device to adjust the display state of the first object.
[0111] It is understood that the multiple optional embodiments introduced in the examples of the present application may be realized in combination with each other or alone, and the examples of the present application are not limited thereto.
[0112] The subject of the photographing method provided in the embodiment of the present application may be a photographing device, or a control module for executing the photographing method in the photographing device. In the embodiment of the present application, the photographing device provided in the embodiment of the present application will be described by taking the photographing method executed by the photographing device as an example.
[0113] Please refer to FIG. 6, which is a block diagram of the imaging device provided in the embodiment of the present application.
[0114] As shown in FIG. 6, the imaging device 600 includes: a first receiving module 601 for receiving a first input from a user, the first input being for adjusting a display state of a first object in a first preview image, the first preview image being an image captured by a first camera; a first display module 602 for displaying a second preview image in response to the first input, the second preview image being obtained by processing an image captured by a main camera, the second preview image including a first object whose display state has changed; and a first processing module 603 for performing image processing on the N images captured by the N cameras according to the display information of the second preview image to obtain a first target image; The N cameras include at least the main camera, where N is a positive integer.
[0115] Optionally, when the first camera is the main camera, the N cameras include the main camera; When the first camera is a first auxiliary camera, the N cameras include the main camera and the first auxiliary camera, and a focusing range of the first auxiliary camera is different from a focusing range of the main camera; The display information includes at least one of a display effect, a display size, and a display position.
[0116] Optionally, the imaging device 600 is a second receiving module for receiving a second input from a user, the second input being for selecting a second object in the second preview image; a second display module for displaying a third preview image in response to the second input, the third preview image being an image captured by a second camera; and a third receiving module for receiving a third input from a user, the third input being for adjusting a display state of a second object in the third preview image; a third display module for displaying a fourth preview image in response to the third input, the fourth preview image being obtained by processing an image captured by a main camera, the fourth preview image including a first object whose display state has changed and a second object whose display state has changed; and The fourth preview image further includes a second processing module for performing image processing on the N images captured by the N cameras according to the display information of the fourth preview image to obtain a second target image.
[0117] Alternatively, when the first camera is a first auxiliary camera, the second camera is a second auxiliary camera, and the first auxiliary camera, the second auxiliary camera, and the main camera all have different focus ranges, the N cameras include the main camera, the first auxiliary camera, and the second auxiliary camera; The second processing module is an acquisition unit for acquiring a first image, a second image, and a third image, wherein the first image is an image captured by the main camera at a first time, the second image is an image captured by the first auxiliary camera at the first time, and the third image is an image captured by the second auxiliary camera at the first time; a first processing unit for performing a first image processing on the first image to obtain a first intermediate image, the first intermediate image including all pixel information other than first pixel information in the first image, and the first pixel information being pixel information corresponding to the first object and the second object in the first image; a second processing unit for performing a second image processing on the second image to obtain a second intermediate image, the second intermediate image including only second pixel information in the second image, the second pixel information being pixel information corresponding to the first object in the second image; a third processing unit for performing a third image processing on the third image to obtain a third intermediate image, the third intermediate image including only third pixel information in the second image, and the third pixel information being pixel information corresponding to the second object in the third image; a synthesis unit for synthesizing the first intermediate image, the second intermediate image, and the third intermediate image according to display information in the fourth preview image to obtain a second target image; The first time is a time earlier than an input time of the photographed input, or the first time is a time later than an input time of the photographed input.
[0118] Optionally, the imaging device 600 is a fourth receiving module for receiving a fourth input from a user for a first object in the first preview image; a fourth display module for displaying a first display state adjustment control associated with the first object in the first preview image in response to the fourth input; The first receiving module 601 specifically includes: a first display state adjustment control configured to receive a first input from a user to the first display state adjustment control; Different objects in the first preview image are associated with different view state adjustment controls.
[0119] Optionally, the first receiving module 601 specifically comprises: receiving a first input from a user to the first sub-control or the second sub-control when the first display state adjustment control includes a first sub-control and a second sub-control, the first sub-control being for adjusting a display size of one object, and the second sub-control being for adjusting a display position of one object; When the first display state adjustment control includes a first display mode and a second display mode, the method is used for receiving a first input from a user to the first display state adjustment control in the first display mode or the first display state adjustment control in the second display mode, wherein in the first display mode, the first display state adjustment control is for adjusting a display size of one object, and in the second display mode, the first display state adjustment control is for adjusting a display position of one object.
[0120] Optionally, when the first camera and the main camera are not the same camera, before the step of receiving a first input from a user, the photographing device 600: a fifth display module for displaying a fifth preview image, the fifth preview image being an image captured by the main camera; a fifth receiving module for receiving a fifth input from a user for the first object in the fifth preview image; an acquisition module for acquiring a first object distance corresponding to the first object in response to the fifth input; a determination module for determining a target camera that matches the first object according to the first object distance; and a sixth display module for displaying the first preview image when the target camera is the first camera.
[0121] The photographing device in the embodiment of the present application may be a device, a component in a terminal, an integrated circuit or a chip. The device may be an electronic device.
[0122] The photographing device in the embodiment of the present application may be a device having an operating system, which may be the Android operating system, the ios operating system, or other possible operating systems, and is not specifically limited in the embodiment of the present application.
[0123] The imaging device 600 provided in the embodiment of the present application can realize each process realized in the method embodiment of Fig. 1, and achieve the same technical effects, and in order to avoid repetition, detailed description will be omitted here.
[0124] Optionally, as shown in Fig. 7, the embodiment of the present application further provides an electronic device 700. The electronic device includes a processor 701, a memory 702, and a program or command stored in the memory 702 and executable on the processor 701, and when the program or command is executed by the processor 701, each process of the method embodiment of Fig. 1 above is realized, and the same technical effect can be achieved. In order to avoid repetition, detailed description is omitted here.
[0125] FIG. 8 is a hardware structure schematic diagram of a terminal for implementing an embodiment of the present application.
[0126] The electronic device 800 includes components such as, but not limited to, a radio frequency unit 801, a network module 802, an audio output unit 803, an input unit 804, a sensor 805, a display unit 806, a user input unit 807, an interface unit 808, a memory 809, and a processor 810.
[0127] Those skilled in the art can understand that the electronic device 800 may further include a power source (e.g., a battery) that supplies electricity to each component, and the power source is logically connected to the processor 810 by a power management system, so that the power management system can realize functions such as charge / discharge management and power consumption management. The structure of the electronic device shown in FIG. 8 does not limit the electronic device, and the electronic device may include more or fewer components than those shown, or a combination of some components, or a different component arrangement, and detailed description thereof will be omitted here.
[0128] It should be understood that in the embodiment of the present application, the input unit 804 may include a graphics processing unit (GPU) 8041 for processing image data of a static image or a video captured by an image capture device (e.g., a camera) in a video capture mode or an image capture mode, and a microphone 8042. The display unit 806 may include a display panel 8061, which may be arranged in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 807 includes a touch panel 8071 and other input devices 8072. The touch panel 8071 is also called a touch screen. The touch panel 8071 may include two parts: a touch detection device and a touch controller. The other input devices 8072 may include, but are not limited to, a physical keyboard, a function button (e.g., a volume control button, a switch button, etc.), a trackball, a mouse, and a control lever, and a detailed description thereof is omitted here. The memory 809 may be used to store software programs and various data, including, but not limited to, applications and an operating system. The processor 810 may be integrated with an application processor that mainly processes an operating system, a user interface, applications, etc., and a modem processor that mainly processes wireless communication. It is understandable that the modem processor does not have to be integrated with the processor 810.
[0129] The processor 810 is receiving a first user input by a user input unit 807, the first input being for adjusting a display state of a first object in a first preview image, the first preview image being an image captured by a first camera; displaying, by a display unit 806, a second preview image in response to the first input, the second preview image being obtained by processing an image captured by a main camera, the second preview image including the first object whose display state has changed; performing image processing on the N images captured by the N cameras according to the display information of the second preview image to obtain a first target image; The N cameras include at least the main camera, where N is a positive integer.
[0130] Optionally, when the first camera is the main camera, the N cameras include the main camera; When the first camera is a first auxiliary camera, the N cameras include the main camera and the first auxiliary camera, and a focusing range of the first auxiliary camera is different from a focusing range of the main camera; The display information includes at least one of a display effect, a display size, and a display position.
[0131] Optionally, the processor 810 further comprises: receiving a second user input by a user input unit 807, the second input being for selecting a second object in the second preview image; displaying, by a display unit 806, a third preview image in response to the second input, the third preview image being an image captured by a second camera; receiving a third input from a user by a user input unit 807, the third input being for adjusting a display state of a second object in the third preview image; displaying a fourth preview image by a display unit 806 in response to the third input, the fourth preview image being obtained by processing an image captured by a main camera, the fourth preview image including a first object whose display state has changed and a second object whose display state has changed; performing image processing on the N images captured by the N cameras according to the display information of the fourth preview image to obtain a second target image.
[0132] Alternatively, when the first camera is a first auxiliary camera, the second camera is a second auxiliary camera, and the first auxiliary camera, the second auxiliary camera, and the main camera all have different focus ranges, the N cameras include the main camera, the first auxiliary camera, and the second auxiliary camera; The processor 810 further comprises: acquiring a first image, a second image, and a third image, wherein the first image is an image captured by the main camera at a first time, the second image is an image captured by the first auxiliary camera at the first time, and the third image is an image captured by the second auxiliary camera at the first time; performing a first image processing on the first image to obtain a first intermediate image, the first intermediate image including all pixel information in the first image except for first pixel information, the first pixel information being pixel information corresponding to the first object and the second object in the first image; performing a second image processing on the second image to obtain a second intermediate image, the second intermediate image including only second pixel information in the second image, the second pixel information being pixel information corresponding to the first object in the second image; performing a third image processing on the third image to obtain a third intermediate image, the third intermediate image including only third pixel information in the second image, the third pixel information being pixel information corresponding to the second object in the third image; synthesizing the first intermediate image, the second intermediate image, and the third intermediate image according to display information in the fourth preview image to obtain a second target image; The first time is a time earlier than an input time of the photographed input, or the first time is a time later than an input time of the photographed input.
[0133] Optionally, the processor 810 further comprises: receiving a fourth input by a user input unit 807 for a first object in the first preview image; displaying, in response to the fourth input, by a display unit 806, in the first preview image, a first display state adjustment control associated with the first object; receiving a first user input for the first display state adjustment control by a user input unit 807; Different objects in the first preview image are associated with different view state adjustment controls.
[0134] Optionally, the processor 810 further comprises: receiving a first user input to the first sub-control or the second sub-control by a user input unit 807 when the first display state adjustment control includes a first sub-control and a second sub-control, the first sub-control being for adjusting a display size of one object, and the second sub-control being for adjusting a display position of one object; When the first display state adjustment control includes a first display mode and a second display mode, the method includes the steps of: receiving a first user input to the first display state adjustment control in the first display mode or the first display state adjustment control in the second display mode by a user input unit 807, wherein in the first display mode, the first display state adjustment control is for adjusting a display size of one object, and in the second display mode, the first display state adjustment control is for adjusting a display position of one object.
[0135] Optionally, when the first camera and the main camera are not the same camera, the processor 810 further comprises: displaying a fifth preview image by a display unit 806, the fifth preview image being an image captured by the main camera; receiving a fifth user input for the first object in the fifth preview image by a user input unit 807; obtaining a first object distance corresponding to the first object in response to the fifth input; determining a target camera that matches the first object according to the first object distance; If the target camera is the first camera, displaying the first preview image by a display unit 806.
[0136] It should be noted that the electronic device 800 in this embodiment can realize each process in the method embodiment of Fig. 1 and achieve the same technical effects, and detailed description will be omitted here to avoid repetition.
[0137] The embodiment of the present application further provides a readable storage medium, which stores a program or command, and when the program or command is executed by a processor, each process of the embodiment of the above-mentioned photographing method is realized, and the same technical effect can be achieved. In order to avoid repetition, detailed description is omitted here.
[0138] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.
[0139] The embodiment of the present application further provides a chip. The chip includes a processor and a communication interface, and the communication interface and the processor are coupled to each other, and the processor executes programs or commands to realize each process of the embodiment of the above-mentioned photographing method, and can achieve the same technical effect. In order to avoid repetition, detailed description is omitted here. It should be understood that the chip mentioned in the embodiment of the present application may be called a system level chip, a system chip, a chip system, a system on chip, etc.
[0140] It should be noted that in this specification, the terms "comprise", "consist of" or any other variations are intended to include a non-exclusive inclusion, whereby a process, method, article, or apparatus that includes a set of elements includes not only those elements, but also other elements not expressly stated or inherent to such process, method, article, or apparatus. Unless otherwise specified, an element limited by the phrase "comprises a" does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes the element. It should also be noted that the scope of the method and apparatus in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may include performing functions substantially simultaneously or in the reverse order depending on such functions, for example, the described method may be performed in a different order than described, and various steps may be added, omitted, or combined. Also, features described with reference to any example may be combined in other examples.
[0141] From the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be realized in the form of a combination of software and a necessary common hardware platform, and of course, they can be realized by hardware, but in many cases the former is a more preferred embodiment. Based on this view, the technical solution of the present application can be substantially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM / RAM, magnetic disk, optical disk) and includes a number of commands that cause a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in the embodiments of the present application.
[0142] Although the examples of the present application have been described above with reference to the drawings, the present application is not limited to the above-mentioned specific embodiments, which are merely illustrative and not limiting. Based on the suggestions of the present application, many forms that a person skilled in the art can make without departing from the spirit of the present application and the scope of protection of the claims are all within the scope of protection of the present application. [Explanation of symbols]
[0143] 600 Imaging Device 601 First receiving module 602 First display module 603 First Processing Module 700 Electronic equipment 701 Processor 702 Memory 801 High Frequency Unit 802 Network Module 803 Audio Output Unit 804 Input Unit 8041 Graphics Processing Unit 8042 Microphone 805 Sensors 806 Display Unit 8061 Display Panel 807 User Input Unit 8071 Touch Panel 8072 Other input devices 808 Interface Unit 809 Memory 810 Processor
Claims
1. receiving a first input from a user, the first input being for adjusting a display state of a first object in a first preview image, the first preview image being an image captured by a first camera; displaying a second preview image in response to the first input, the second preview image being obtained by processing an image captured by a main camera, the second preview image including the first object whose display state has changed; performing a fusion process on the N images captured by the N cameras according to the display information of the second preview image to obtain a first target image; display information of the first object in the first target image is the same as display information of the first object in the second preview image; The N cameras include at least the main camera, where N is a positive integer, When the first camera is the main camera, the N cameras include the main camera, When the first camera is a first auxiliary camera, the N cameras include the main camera and the first auxiliary camera, and a focusing range of the first auxiliary camera is different from a focusing range of the main camera; The display information includes at least one of a display effect, a display size, and a display position.
2. after the step of displaying a second preview image in response to the first input; receiving a second user input, the second input for selecting a second object in the second preview image; displaying a third preview image in response to the second input, the third preview image being an image captured by a second camera; receiving a third input from a user, the third input being for adjusting a display state of a second object in the third preview image; displaying a fourth preview image in response to the third input, the fourth preview image being obtained by processing an image captured by a main camera, the fourth preview image including a first object whose display state has changed and a second object whose display state has changed; The method of claim 1 , further comprising: performing a fusion process on the N images captured by the N cameras according to display information of the fourth preview image to obtain a second target image.
3. When the first camera is a first auxiliary camera, the second camera is a second auxiliary camera, and the first auxiliary camera, the second auxiliary camera, and the main camera all have different focusing ranges, the N cameras include the main camera, the first auxiliary camera, and the second auxiliary camera, The step of processing the N images captured by the N cameras according to the display information of the fourth preview image to obtain a target image includes: acquiring a first image, a second image, and a third image, wherein the first image is an image captured by the main camera at a first time, the second image is an image captured by the first auxiliary camera at the first time, and the third image is an image captured by the second auxiliary camera at the first time; performing a first image processing on the first image to obtain a first intermediate image, the first intermediate image including all pixel information in the first image except for first pixel information, the first pixel information being pixel information corresponding to the first object and the second object in the first image; performing a second image processing on the second image to obtain a second intermediate image, the second intermediate image including only second pixel information in the second image, the second pixel information being pixel information corresponding to the first object in the second image; performing a third image processing on the third image to obtain a third intermediate image, the third intermediate image including only third pixel information in the second image, the third pixel information being pixel information corresponding to the second object in the third image; synthesizing the first intermediate image, the second intermediate image, and the third intermediate image according to display information in the fourth preview image to obtain a second target image; The method of claim 2 , wherein the first time is earlier than an input time of the photographed input, or the first time is later than an input time of the photographed input.
4. Prior to the step of receiving a first user input, receiving a fourth user input for a first object in the first preview image; and displaying, in response to the fourth input, a first display state adjustment control associated with the first object in the first preview image; The step of receiving a first user input comprises: receiving a first user input to the first display state adjustment control; The method of claim 1 , wherein different objects in the first preview image are associated with different view state adjustment controls.
5. The step of receiving a first user input to the first display state adjustment control includes: receiving a first input from a user to the first sub-control or the second sub-control when the first display state adjustment control includes a first sub-control and a second sub-control, the first sub-control being for adjusting a display size of one object, and the second sub-control being for adjusting a display position of one object; 5. The method of claim 4, further comprising: if the first display state adjustment control includes a first display mode and a second display mode, receiving a first input from a user to a first display state adjustment control in the first display mode or a first display state adjustment control in the second display mode, wherein in the first display mode, the first display state adjustment control is for adjusting a display size of one object, and in the second display mode, the first display state adjustment control is for adjusting a display position of one object.
6. When the first camera and the main camera are not the same camera, before the step of receiving a first input from a user, displaying a fifth preview image, the fifth preview image being an image captured by the main camera; receiving a fifth user input for the first object in the fifth preview image; obtaining a first object distance corresponding to the first object in response to the fifth input; determining a target camera that matches the first object in response to the first object distance; The method of claim 1 , further comprising: if the target camera is the first camera, displaying the first preview image.
7. a first receiving module for receiving a first input from a user, the first input being for adjusting a display state of a first object in a first preview image, the first preview image being an image captured by a first camera; a first display module for displaying a second preview image in response to the first input, the second preview image being obtained by processing an image captured by a main camera, the second preview image including a first object whose display state has changed; and a first processing module for performing a fusion process on the N images captured by the N cameras according to the display information of the second preview image to obtain a first target image; display information of the first object in the first target image is the same as display information of the first object in the second preview image; The N cameras include at least the main camera, where N is a positive integer, When the first camera is the main camera, the N cameras include the main camera, When the first camera is a first auxiliary camera, the N cameras include the main camera and the first auxiliary camera, and a focusing range of the first auxiliary camera is different from a focusing range of the main camera; An imaging device, wherein the display information includes at least one of a display effect, a display size, and a display position.
8. a second receiving module for receiving a second input from a user, the second input being for selecting a second object in the second preview image; a second display module for displaying a third preview image in response to the second input, the third preview image being an image captured by a second camera; and a third receiving module for receiving a third input from a user, the third input being for adjusting a display state of a second object in the third preview image; a third display module for displaying a fourth preview image in response to the third input, the fourth preview image being obtained by processing an image captured by a main camera, the fourth preview image including a first object whose display state has changed and a second object whose display state has changed; and 8. The photographing apparatus according to claim 7, further comprising: a second processing module for performing a fusion process on the N images captured by the N cameras according to the display information of the fourth preview image to obtain a second target image.
9. When the first camera is a first auxiliary camera, the second camera is a second auxiliary camera, and the first auxiliary camera, the second auxiliary camera, and the main camera all have different focusing ranges, the N cameras include the main camera, the first auxiliary camera, and the second auxiliary camera, The second processing module is an acquisition unit for acquiring a first image, a second image, and a third image, wherein the first image is an image captured by the main camera at a first time, the second image is an image captured by the first auxiliary camera at the first time, and the third image is an image captured by the second auxiliary camera at the first time; a first processing unit for performing a first image processing on the first image to obtain a first intermediate image, the first intermediate image including all pixel information other than a first pixel information in the first image, the first pixel information being pixel information corresponding to the first object and the second object in the first image; a second processing unit for performing a second image processing on the second image to obtain a second intermediate image, the second intermediate image including only second pixel information in the second image, the second pixel information being pixel information corresponding to the first object in the second image; a third processing unit for performing a third image processing on the third image to obtain a third intermediate image, the third intermediate image including only third pixel information in the second image, the third pixel information being pixel information corresponding to the second object in the third image; a synthesis unit for synthesizing the first intermediate image, the second intermediate image, and the third intermediate image according to display information in the fourth preview image to obtain a second target image; The photographing apparatus according to claim 8 , wherein the first time is a time earlier than an input time of the photographed input, or the first time is a time later than an input time of the photographed input.
10. a fourth receiving module for receiving a fourth input from a user for a first object in the first preview image; a fourth display module for displaying a first display state adjustment control associated with the first object in the first preview image in response to the fourth input; The first receiving module specifically includes: a first display state adjustment control configured to receive a first input from a user; The imaging device of claim 7 , wherein different objects in the first preview image are associated with different view state adjustment controls.
11. The first receiving module specifically includes: receiving a first input from a user to the first sub-control or the second sub-control when the first display state adjustment control includes a first sub-control and a second sub-control, the first sub-control being for adjusting a display size of one object, and the second sub-control being for adjusting a display position of one object; 11. The photographing device of claim 10, further comprising: a step of receiving a first input from a user to a first display state adjustment control in the first display mode or a first display state adjustment control in the second display mode when the first display state adjustment control includes a first display mode and a second display mode, wherein in the first display mode, the first display state adjustment control is for adjusting a display size of one object, and in the second display mode, the first display state adjustment control is for adjusting a display position of one object.
12. When the first camera and the main camera are not the same camera, before the step of receiving a first input from a user, a fifth display module for displaying a fifth preview image, the fifth preview image being an image captured by the main camera; a fifth receiving module for receiving a fifth input from a user for the first object in the fifth preview image; an acquisition module for acquiring a first object distance corresponding to the first object in response to the fifth input; a determination module for determining a target camera that matches the first object according to the first object distance; The photographing device of claim 7 , further comprising: a sixth display module for displaying the first preview image when the target camera is the first camera.
13. 7. An electronic device comprising a processor, a memory, and a program or command stored in the memory and executable on the processor, the step of the photographing method according to claim 1 being realized when the program or command is executed by the processor.
14. A readable storage medium having stored thereon a program or command that, when executed by a processor, implements the steps of the imaging method according to any one of claims 1 to 6.
Citation Information
Patent Citations
Shooting method and device
CN110445978A
Shooting control method and device, electronic equipment and storage medium
CN111988522A
Mobile terminal and method for controlling the same
EP3136705A2
Electronic apparatus and image processing method
JP2015126326A
Assist for orienting a camera at different zoom levels
US20190082101A1