Photographing method, photographing device and electronic device

Abstract

This application discloses a photographing method, a photographing device and an electronic device, which belong to the imaging technical field, and includes: collecting a first image with a first camera and collecting a second image with a second camera, the first image including a current photographed scene, and the second camera is used to collect a motion trajectory of a target moving object, the first image including the target moving object; and synthesizing the first image and the second image to output a target image.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS

[0001] This application claims priority to Chinese patent application No. 202011379813.8, entitled "Photography Method, Photographing Apparatus and Electronic Device," filed on November 30, 2020, the entire contents of which are incorporated herein by reference. [Technical field]

[0002] The present application relates to the field of imaging technology, and more particularly to an imaging method, an imaging device, and an electronic device. [Background technology]

[0003] The light painting camera is a photographing mode, which is used to photograph band-like dynamic effects in certain dynamic scenes, such as starry sky, waterfalls, streams, road vehicles, and illuminating objects. In the realization process of this application, the inventors have found that the prior art has at least the following problems: On the one hand, the current light painting camera consumes large power during the photographing process, and the heat generated by the equipment is serious; on the other hand, when the motion trajectory of the light beam is unsatisfactory, the current light painting camera cannot adjust the motion trajectory of the light beam, and can only re-shoot. Summary of the Invention [Problem to be solved by the invention]

[0004] An objective of the embodiments of the present application is to provide a photographing method that reduces power consumption in light painting camera mode and facilitates a user's customization of the motion trajectory of a target motion object. [Means for solving the problem]

[0005] In order to solve the above technical problems, the present application is realized as follows.

[0006] According to a first aspect, an embodiment of the present application provides a method of imaging, the method comprising: Acquiring a first image with a first camera and acquiring a second image with a second camera, the first image including a current scene, the second camera being used to acquire a motion trajectory of a target motion object, the first image including the target motion object; and image-compositing the first image and the second image to output a target image.

[0007] According to a second aspect, an embodiment of the present application provides an imaging device, the device comprising: A first acquisition module for acquiring a first image with a first camera and acquiring a second image with a second camera, the first image including a current scene, the second camera being used for acquiring a motion trajectory of a target motion object, the first image including the target motion object; A first synthesis module for image-synthesizing the first image and the second image to output a target image.

[0008] According to a third aspect, an embodiment of the present application provides an electronic device, the electronic device comprising a processor, a memory, and a program or instructions stored in the memory and operable to run on the processor, the program or instructions being executed by the processor to implement steps of the method according to the first aspect.

[0009] According to a fourth aspect, an embodiment of the present application provides a readable storage medium having stored thereon a program or instructions which, when executed by a processor, implements steps of the method according to the first aspect.

[0010] According to a fifth aspect, an embodiment of the present application provides a chip, the chip including a processor and a communication interface, the communication interface coupled to the processor, the processor running a program or instructions and used to implement the method according to the first aspect.

[0011] According to a sixth aspect, an embodiment of the present application provides an electronic device, the electronic device being configured to perform the steps of the imaging method according to the first aspect.

[0012] According to a seventh aspect, an embodiment of the present application provides a computer program product, the computer program product being capable of implementing steps of the imaging method according to the first aspect when executed by a processor. Effect of the Invention

[0013] In the embodiment of the present application, by independently obtaining the background image and the motion trajectory of the target motion object of the light painting photograph, the user can customize the motion trajectory of the target motion object, enhance the operability and hobby of the light painting camera shooting mode, improve the effect of the final finished photo, and reduce the number of frames collected for the current shooting scene, which helps to reduce hardware power consumption. [Brief description of the drawings]

[0014] [Figure 1] 1 is a flowchart of a photographing method according to an embodiment of the present application. [Diagram 2] 1 is a schematic diagram of an interface for displaying a preview image collected by a first camera according to an embodiment of the present application; [Diagram 3] 11A-11C are schematic diagrams of an interface for displaying a preview image collected by a second camera according to an embodiment of the present application. [Figure 4] 1A-1C are schematic diagrams of an interface for displaying preview images collected by a first camera and a second camera according to an embodiment of the present application. [Diagram 5] FIG. 2 is a schematic diagram of an interface for playing a first video and a second video according to an embodiment of the present application; [Figure 6] 2 is a detailed flowchart of a photographing method according to an embodiment of the present application. [Figure 7] FIG. 11 is a schematic diagram of an interface for displaying a second image according to an embodiment of the present application; [Figure 8] FIG. 2 is a second schematic diagram of an interface displaying a second image according to an embodiment of the present application. [Figure 9] FIG. 3 is a third schematic diagram of an interface displaying a second image according to an embodiment of the present application. [Figure 10] FIG. 4 is a fourth schematic diagram of an interface displaying a second image according to an embodiment of the present application. [Figure 11] FIG. 2 is a second schematic diagram of an interface for playing a first video and a second video according to an embodiment of the present application. [Figure 12] FIG. 3 is a third schematic diagram of an interface for playing a first video and a second video according to an embodiment of the present application. [Figure 13] 1 is a structural diagram of a photographing device according to an embodiment of the present application; [Figure 14] 1 is a structural schematic diagram of an electronic device according to an embodiment of the present application; [Figure 15] FIG. 2 is a second schematic diagram of hardware of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0015] The following clearly and completely describes the technical solutions in the embodiments of the present application with reference to the drawings in the embodiments of the present application, and obviously, the described embodiments are only some of the embodiments of the present application, and not all of the embodiments. All other embodiments obtained based on the embodiments of the present application without the need for creative efforts by those skilled in the art are within the scope of protection of the present application.

[0016] The terms "first," "second," etc. in the specification and claims of this application are intended to distinguish between similar objects and are not intended to describe a particular order or sequence. It is to be understood that the data so used may be interchanged where appropriate, such that the embodiments of this application may be performed in an order other than that shown or described herein. Note that "and / or" in the specification and claims indicates at least one of the objects connected, and the character " / " generally indicates that the related objects are in an "or" relationship.

[0017] In the conventional technology, the light painting camera shooting modes all use an RGB sensor to capture frames, and then use an algorithm to process the images in the background to generate interesting images within a fixed short period of time. In actual shooting, frames need to be constantly captured and processed for the current shooting scene, which leads to serious problems with power consumption and heat generation of the equipment. In addition, the motion trajectory of the moving object and the negative film are completely bound and cannot be effectively separated, and the motion trajectory of the moving object cannot be adjusted independently, which makes the operability relatively poor.

[0018] Hereinafter, a photographing method, a photographing device, an electronic device, and a readable storage medium according to the embodiments of the present application will be described in detail with reference to the drawings through specific embodiments and application scenes.

[0019] The embodiments of the present application provide a photographing method, and the execution body of the photographing method may be a terminal having a photographing function, including but not limited to a mobile terminal, a camera, or a control device of a terminal, etc.

[0020] This photography method is used to capture light painting photographs, which include the motion trajectories of light rays.

[0021] As shown in FIG. 1, the imaging method includes steps 110 and 120.

[0022] Step 110: collect a first image with a first camera and collect a second image with a second camera, the first image includes a screen of a current shooting scene, the second camera is used to collect a motion trajectory of a target moving object, and the first image includes the target moving object.

[0023] It should be noted that the first image is used to generate a background image of the light painting photograph, for example by editing the first image to obtain the background image of the light painting photograph, which includes other scenes than the motion trajectory of the target motion object in the light painting photograph.

[0024] Taking the photographing of a street corner night scene including traffic flow as an example, the first image may include essentially static objects such as a road, a fence on the road, plants and buildings on the road side, or the first image may further include a moving object with a relatively weak light intensity, such as a pedestrian, and the second image may only include the motion trajectory of the vehicle headlights on a moving vehicle, which may be represented as one or more light bands.

[0025] The first camera may be an RGB sensor.

[0026] The second camera is used to collect the motion trajectory of the target moving object, and in practical implementation, the second camera may be a DVS (Dynamic Vision Sensor).

[0027] DVS captures dynamic changes in a scene using an event-driven approach. Unlike traditional cameras, DVS does not have the concept of a "frame". When a change occurs in the real scene, DVS generates some pixel-level output, i.e., an event.

[0028] On the other hand, DVS has very low latency that can reach the microsecond level, with very little demand on data storage and computing resources, and it can only record moving objects and has no sensing ability to stationary background scenes.

[0029] On the other hand, in some scenes, the brightness of the moving target is relatively low, e.g., a waterfall that is not illuminated by strong light, and the RGB sensor cannot effectively capture its motion trajectory, while the DVS can accurately capture this motion trajectory.

[0030] That is, the capture of the motion trajectory of the moving object in the DVS not only has no fixed time limit, but also consumes less power.

[0031] The second image may be a motion trajectory of the target motion object in the light painting photograph, or a motion trajectory of the target motion object in the light painting photograph may be generated based on the second image.

[0032] The first camera and the second camera are used to capture objects in the same scene.

[0033] Taking the photography of a waterfall as an example, the water flow of the waterfall is the target moving object, the first image includes the water flow of the waterfall and other background within the lens range, such as still stones, trees, etc., the second camera is used to collect the motion trajectory of the waterfall water flow, and the second image includes only the motion trajectory of the waterfall water flow.

[0034] In some embodiments, prior to acquiring a first image with a first camera and a second image with a second camera in step 110, the imaging method includes: Receiving an input to activate a user's camera; The method may further include activating the first camera and the second camera in response to an input activating the cameras.

[0035] Here, the input for activating the user's camera may be expressed as at least one of a touch input, a voice input, and an entity button input, and the description thereof will be omitted here.

[0036] In this step, the terminal activates the first and second cameras simultaneously when it receives this input.

[0037] In actual implementation, the above step 110 may be an automatic trigger, for example, when photographing the flow of traffic on the road at night, a photosensitive sensor is installed in the terminal, and when the photosensitive sensor detects that the light intensity is greater than the target intensity value, it controls the first camera and the second camera to automatically turn on to collect the above first image and second image.

[0038] Of course, the above step 110 may also be manually triggered.

[0039] For example, in a scene that is manually photographed by a user, before the above step 110, The method may further include receiving a user input to initiate the capture.

[0040] It should be noted that in this step, the capture-triggering input is used to trigger the first camera and the second camera to collect images.

[0041] Here, the input for starting the photographing may be expressed as at least one of the following methods.

[0042] First, the input that initiates the capture may be expressed as a touch input, including but not limited to a click input, a swipe input, a press input, and the like.

[0043] In this embodiment, receiving a user input to initiate capture may be expressed as receiving a user touch operation on a display area of ​​the terminal display screen.

[0044] In order to reduce the rate of user error, the action area of ​​this input can be limited to a specific area, for example, the lower middle area of ​​the display area of ​​the terminal display screen, or a target control can be displayed on the current interface while a shooting preview interface is displayed on the current interface, and touching the target control can realize an input that launches shooting.

[0045] Second, the input that initiates the capture may be represented as an entity button input.

[0046] In this embodiment, an entity button corresponding to photographing is provided on the body of the terminal, and receiving a user input to initiate photographing may be represented as receiving an input in which the user presses the corresponding entity button.

[0047] Third, the input that triggers the capture may be expressed as a voice input.

[0048] In this embodiment, the terminal can trigger the first camera and the second camera to capture images when it receives a voice command, for example "take light painting".

[0049] Of course, in other embodiments, the input that triggers the capture may be expressed in other forms, including, but not limited to, text input, and may be specifically determined according to actual needs, and the embodiments of the present application are not limited thereto.

[0050] After receiving an input to initiate image capture, the terminal can control the first camera to capture a first image and control the second camera to capture a second image in response to the input to initiate image capture.

[0051] The first and second cameras may begin acquisition synchronously, or the second camera begins acquiring the second image after the first camera finishes acquiring the first image, or the first camera acquires the first image after the second camera finishes acquiring the second image.

[0052] In some embodiments, the imaging method includes: Receiving a user input to stop capturing images; The method may further include controlling a second camera to stop image collection in response to the input to stop image capture, and generating a second image based on images collected by the second camera between the input to start image capture and the input to stop image capture.

[0053] It should be noted that in this step, the stop capture input is used to trigger the second camera to end image acquisition.

[0054] Here, the input for stopping shooting may be expressed as at least one of the following methods.

[0055] First, the input to stop shooting may be expressed as a touch input, including but not limited to a click input, a swipe input, a press input, and the like.

[0056] In this embodiment, receiving a user input to stop capturing may be expressed as receiving a touch input on a display area of ​​the user's terminal display screen.

[0057] In order to reduce the rate of user error, the action area of ​​this input can be limited to a specific area, for example, the lower middle area of ​​the display area of ​​the terminal display screen, or when a shooting preview interface is displayed on the current interface, a target control can be displayed on the current interface, and an input to stop shooting can be realized by touching the target control.

[0058] Second, the input to stop filming may be represented as an entity button input.

[0059] In this embodiment, an entity button corresponding to photographing is provided on the body of the terminal, and receiving an input from the user to stop photographing may be represented as receiving an input from the user pressing the corresponding entity button.

[0060] Third, the input to stop recording may be expressed as a voice input.

[0061] In this embodiment, the terminal can trigger the second camera to end image capture when it receives a voice command, such as "light painting completed."

[0062] Of course, in other embodiments, the input to stop shooting may be expressed in other forms, including but not limited to text input, and may be specifically determined according to actual needs, and the embodiments of the present application are not limited thereto.

[0063] Of course, in some alternative embodiments, the second camera may also be controlled to terminate image acquisition through automatic identification techniques.

[0064] For example, if the processor identifies that the target moving object stops moving (remains stationary within the target time) or disappears (no light can be collected), it controls the second camera to stop image collection.

[0065] Step 120: image-compositing the first image and the second image to output a target image.

[0066] In this step, the terminal can synthesize the first image and the second image based on the collected first image and second image, and output a synthesized target image, where the target image is a light painting photograph.

[0067] The size of the first image and the second image may be the same, and step 120 may be realized in the following manner: all pixels on the motion trajectory in the second image are used to replace the pixels of the target area in the first image, and the target area is an area whose position corresponds to the area where the motion trajectory is located in the first image.

[0068] Due to pixel replacement, the whole synthesis process is computationally simple, and the transition between the motion trajectory and the background image in the synthesized target image is smooth.

[0069] This approach essentially involves using pixels in the second image that correspond to the motion trajectory to replace pixels in the corresponding locations in the first image.

[0070] For example, for any one pixel of the motion trajectory in the second image, the coordinate position in the second image is (a, b). In this step, it is necessary to replace the pixel in the first image whose coordinate position is (a, b) with the pixel in the second image whose coordinate position is (a, b). By performing the above method for each pixel of the motion trajectory in the second image, the synthesis of the two images can be realized.

[0071] The method of combining the first image and the second image is as follows.

[0072] (1) Mark the first image as A and the second image as B; (2) In B, all other areas are transparent except for the motion trajectory. (3) And A and B are the same size, (4) B can be directly overlaid on A, and the pixel points in A can be directly replaced with the trajectory parts in B; (5) After replacing and covering, save the image and the first and second images will be combined. It should be noted that in the above shooting method, the background image of the light painting photograph and the motion trajectory of the target motion object are collected independently, thus enabling editing or adjustment of the motion trajectory of the target motion object.

[0073] The photographing method according to the embodiment of the present application may be used in a light painting photographing scene, and by independently obtaining the background image and the motion trajectory of the target motion object of the light painting photograph, the user can customize the motion trajectory of the target motion object, enhance the operability and hobby of the light painting camera photographing mode, improve the effect of the final finished photograph, and reduce the number of frames collected for the current photographing scene, which is helpful in reducing the hardware power consumption.

[0074] In some embodiments, after acquiring a first image with a first camera and a second image with a second camera in step 110, the imaging method includes: receiving a first input for a second image of a user; adjusting trajectory parameters of the motion trajectory in the second image in response to the first input, and outputting the second image after the trajectory parameters have been adjusted; Step 120, image-compositing the first image and the second image, includes image-compositing the first image and the second image after adjusting the trajectory parameters.

[0075] Here, the first input may be expressed in at least one of the following ways:

[0076] First, the first input may be expressed as a touch input, including but not limited to a click input, a swipe input, a press input, and the like.

[0077] In this embodiment, receiving the user's first input may be expressed as receiving a touch operation on a display area of ​​the user's terminal display screen.

[0078] The display area of ​​the terminal display screen can display a target control, which can include various image editing menus, including but not limited to zoom, sharpness adjustment, palette, brightness adjustment, etc., and a first input can be realized by touching the target control.

[0079] Second, the first input may be represented as a voice input.

[0080] In this embodiment, the terminal can trigger the motion trajectory of the target motion object to zoom in by 20% when receiving a voice, for example, "zoom in by 20 percent."

[0081] Of course, in other embodiments, the first input may be expressed in other forms, including but not limited to character input, and may be specifically determined according to actual needs, and the embodiments of the present application are not limited thereto.

[0082] The display effect of the movement trajectory in the second image can be changed by adjusting the trajectory parameters of the movement trajectory in the second image, where the trajectory parameters include at least one parameter characterizing a trajectory attribute of the movement trajectory, and the trajectory parameters include at least one of color, size, position, angle, breakpoint, and brightness, but are not limited to these.

[0083] Correspondingly, adjusting the trajectory parameters of the motion trajectory in the second image includes, but is not limited to, any one of the following:

[0084] (1) Change the color of the motion trajectory. For example, when photographing a waterfall, the original color of the motion trajectory is mostly white, and the motion trajectory can be adjusted to blue or green by selecting the color of the palette on the display area of ​​the terminal display screen, thereby showing the reflection of the waterfall against the blue sky or trees, and enhancing the color effect of the target motion object; (2) Change the size of the motion trajectory, for example, sometimes there is one very large one in the current screen.

number

number

number

[0085] In the conventional technology, when taking light painting photographs, the motion trajectory of the target motion object and the negative film are completely bound, and if the motion trajectory of the target motion object is not satisfactory, the only thing that can be done is to take the photograph again.

[0086] The photography method in the embodiment of the present application allows the movement trajectory of the light beam to be independently edited or adjusted, making the photography experience more flexible and interesting, and the effect of the finished photo better.

[0087] It should be noted that whether editing is required can be realized by a preset setting, or the default is that no editing is required, and the editing option is provided after the shooting is completed.

[0088] In step 110, before acquiring a first image with the first camera and a second image with the second camera, the imaging method further comprises: This may include displaying a capture preview interface.

[0089] In actual implementation, when a user's input to activate the camera is received, a capture preview interface may be displayed in response to the input.

[0090] In this step, when the terminal receives this input, the display area of ​​the terminal display screen displays a shooting preview interface to facilitate assisting the user in viewfinding.

[0091] Here, the shooting preview interface may be expressed in at least one of the following ways.

[0092] First, as shown in FIG. 2, the capture preview interface is used to display a preview image Picture A captured by the first camera.

[0093] In this manner, the shooting preview interface may only display the preview image collected by the first camera, thus providing a relatively large finding reference map for the background image of the light painting photograph, making it easier to realize the overall composition.

[0094] Second, as shown in FIG. 3, the capture preview interface is used to display a preview image Picture B captured by the second camera.

[0095] In this manner, the shooting preview interface may only display the preview image collected by the second camera, thus providing a relatively large finding reference map for the motion trajectory in the light painting photograph, and facilitating the user to adjust the position and ratio of the target motion object in the photograph before the actual shooting.

[0096] Third, as shown in FIG. 4, the shooting preview interface includes a first shooting preview sub-interface and a second shooting preview sub-interface.

[0097] The first shooting preview sub-interface is used to display a preview image Picture A collected by the first camera, and the second shooting preview sub-interface is used to display a preview image Picture B collected by the second camera.

[0098] In such a manner, the shooting preview interface is displayed in a split screen, and the two sub-interfaces display the preview images collected by the first camera and the second camera, respectively, thus facilitating the user to adjust the position and ratio of the target motion object in the photo before the official shooting, and also facilitating the user to adjust the overall composition and layout of the photo before the official shooting.

[0099] In the following, the embodiments of the present application will be specifically described from two different realization angles.

[0100] First, the first camera collects only the first image.

[0101] In such a case, in the process of acquiring the first image and the second image, the photographing method may further include controlling the first camera to stop image acquisition when generation of the motion trajectory begins.

[0102] In this way, the actual operating time of the first camera to collect a complete shooting scene is shorter, which helps to reduce the power consumption of the terminal.

[0103] As can be seen, in this embodiment, when receiving a user's input to start shooting, the first camera and the second camera both start to collect images, and when the generation of the motion trajectory begins, the first camera is controlled to stop collecting images, and the second camera continues to collect the motion trajectory of the target moving object, so that in the entire shooting process, the first camera can capture at least one frame, which can minimize power consumption and not affect the finished light painting photo.

[0104] As shown in FIG. 6, in such a case, the specific realization flow of this imaging method is as follows.

[0105] Step 601: Open the camera. At this time, the first camera (sensor A) and the second camera (sensor B) open the preview simultaneously. The first camera (sensor A) normally displays a preview image of the current screen, while the second camera (sensor B) displays no image because there is no moving object in the current screen.

[0106] Step 602: Before the shooting starts, the user may set whether editing is required; (1) If the user chooses not to edit, when the final shooting is completed, a target image (i.e., a light painting photo) is automatically generated, and each trajectory attribute of the motion trajectory is the same as that collected by the second camera; (2) If the user chooses to edit, after the shooting is completed, the first image (negative film) and the second image (motion trajectory photo) are output, and the user adjusts the trajectory parameters of the motion trajectory in the second image and clicks synthesis to synthesize it together with the first image to present the final target image (i.e., light painting photo); Step 603: The user clicks take a picture, and at this time the first camera (sensor A) is normally exposed and captures the first image (negative film).

[0107] Step 604: When the second camera (sensor B) detects that the generation of the motion trajectory starts, control the first camera (sensor A) to stop image acquisition, and the second camera (sensor B) always records the motion trajectory of the target motion object; Step 605: After the motion trajectory collection is completed, click Finish; Step 606: If the user selects that no editing is required in step 602, directly combine the first image and the second image, and output the target image (ie, the light painting photograph).

[0108] If the user selects that editing is required in step 602, step 607 is performed; Step 607: Adjust the trajectory parameters of the motion trajectory; The shooting method of the embodiment of the present application may also be used in a scene where a person holds a fluorescent stick in his / her hand to draw certain letters or images in the air, and before generating a target image, customized editing can be easily performed on the motion trajectory of the target motion object, so that the effect of the final formed target image is better.

[0109] The photographer holds a fluorescent stick in his hand and shoots it in the air.

number

[0110] The second image may be edited independently of the first image in the following manner.

[0111] (1) Adjust the size by dragging the ratio of the motion trajectory in the current screen. As shown in FIG. 7, the ratio of the motion trajectory in the second image is too small. Touch the zoom control and select the target control representing zooming to enlarge the motion trajectory. Or touch two points on the second image at the same time and drag them away from each other to enlarge the motion trajectory. As shown in FIG. 8, that is, the second image after the motion trajectory is enlarged. (2) As shown in FIG. 8, the motion trajectory in the second image after enlargement is offset to the upper left area of ​​the second image. By pressing the motion trajectory and swiping on the screen, the position of the motion trajectory can be adjusted. As shown in FIG. 9, that is, the second image after the motion trajectory is moved, and the motion trajectory moves to the middle area. (3) Because the letter "i" is difficult to draw, a person holding a highlighter stick in his hand can draw the letter "1" directly. The second image collected is actually

number

number

[0112] Of course, the color, brightness, angle, etc. of the movement trajectory may be further adjusted as necessary, and will not be described further here.

[0113] Step 608: Synthesize the second image and the first image after adjusting the trajectory parameters to generate a target image (i.e., a light painting photograph), and then end the process.

[0114] It should be noted that step 602 may occur after step 605 .

[0115] Second, a first camera collects a first image and a first video, and a second camera collects a second image and a second video.

[0116] In such a case, in the process of acquiring the first image and the second image, the photographing method further includes: Collecting a first video and a second video, where the first video includes a screen of a current shooting scene, and the second video is used to record a process of a target moving object forming a moving trajectory; If a second user input is received, synchronously playing the first video and the second video in response to the second input.

[0117] As can be appreciated, in this embodiment, a first video may be collected by a first camera and a second video may be collected by a second camera, or the first video may even be collected by a third camera and the second video may be collected by a fourth camera.

[0118] In the following, an example will be described in which a first video is collected by a first camera and a second video is collected by a second camera.

[0119] As can be seen, in this embodiment, when a user input is received to initiate shooting, the first camera and the second camera both start collecting images, and after the first camera collects the first image, the first camera continues to collect a first video until a user input is received to stop shooting, and in response to the input to stop shooting, the first camera is controlled to stop collecting video and the second camera is controlled to stop collecting video, and finally a first image, a second image, a first video and a second video can be obtained, and the first image, the second image, the first video and the second video can all be stored in a photo gallery, and the first video and the second video are automatically associated.

[0120] In this way, this shooting method can not only output a target image, but also output a first video and a second video to characterize the target image generation process, and by synchronously playing the first video and the second video, an intuitive presentation of the target image generation process can be realized, which has strong hobby characteristics and very high commercial prospects.

[0121] In such a case, the specific implementation flow of this photographing method is as follows.

[0122] Step 701: Open the camera. At this time, the first camera (sensor A) and the second camera (sensor B) open the preview simultaneously. The first camera (sensor A) normally displays a preview image of the current screen, while the second camera (sensor B) displays no image because there is no moving object in the current screen.

[0123] Step 702: The user may set whether editing is required before shooting begins; (1) If the user chooses not to edit, when the final shooting is completed, a target image (i.e., a light painting photo) is automatically generated, and each trajectory attribute of the motion trajectory is the same as that collected by the second camera; (2) If the user chooses to edit, after the shooting is completed, the first image (negative film) and the second image (motion trajectory photo) are output, and the user adjusts the trajectory parameters of the motion trajectory in the second image and clicks synthesis to synthesize it together with the first image to present the final target image (i.e., light painting photo); Step 703: The user clicks on the capture button, and at this time the first camera (sensor A) is normally exposed, captures the first image (negative film), and starts recording, finally generating the first video (video A); Step 704: The second camera (sensor B) constantly records the motion trajectory of the target motion object, and records the motion trajectory generation screen to generate a second video (video B); Step 705: After the movement trajectory collection is completed, click Finish; Step 706: If the user selects that no editing is required in step 702, directly composite the first image and the second image, and output a target image (i.e., a light painting photograph) and the associated first video and second video.

[0124] If the user selects that editing is required in step 702, step 707 is performed; Step 707: Adjust the trajectory parameters of the motion trajectory. For the adjustment method, refer to the description in the previous embodiment.

[0125] Step 708: Synthesize the second image and the first image after adjusting the trajectory parameters to generate a target image (i.e., a light painting photograph) and associated first and second videos, and then finish.

[0126] It should be noted that step 702 may occur after step 705 .

[0127] The method may further include, when a second input from the user is received, synchronously playing the first video and the second video in response to the second input.

[0128] In this step, the second input is used to synchronously play the first video and the second video on the playback interface, and as shown in FIG. 5, the playback interface includes a first playback sub-interface and a second playback sub-interface, where the first playback sub-interface is used to play the first video (Video A), and the second playback sub-interface is used to play the second video (Video B), and the two videos are displayed in a split screen, and the entire process of generating the target image can be viewed by comparing the two videos.

[0129] Here, the second input may be expressed in at least one of the following ways:

[0130] The first and second inputs may be expressed as touch inputs, including but not limited to click inputs, swipe inputs, and press inputs.

[0131] In this embodiment, receiving the user's second input may be expressed as receiving a touch operation on the display area of ​​the user's terminal display screen.

[0132] For example, in a photo gallery, by clicking a first video, or by clicking a second video, or the first video and the second video are displayed on the same control, clicking this control can achieve synchronous playback of the first video and the second video in split screen.

[0133] The second input may be represented as a voice input.

[0134] In this embodiment, the terminal can synchronously play the first video and the second video in split screen when receiving a voice, for example, "play the light painting photo video."

[0135] Of course, in other embodiments, the second input may be expressed in other forms, including but not limited to character input, and may be specifically determined according to actual needs, and the embodiments of the present application are not limited thereto.

[0136] The above-mentioned shooting method is highly operable and interesting, and can obtain a relatively good effect when the light source is relatively poor, and can obtain a true video depicting the motion trajectory of the moving target and a dynamic generated image of the motion trajectory.

[0137] It should be noted that the content of the second video has two representation formats as follows:

[0138] The first and second video frames include a continuous trajectory of the target moving object in a time period from the start of acquisition to the time corresponding to the video frame.

[0139] In this embodiment, the i-th video frame of the second video includes a motion trajectory of the target motion object in an i-th time period, the i-th time period being a time period between the first time period and the i-th time period, the first time period being a time period for collecting the first video frame, and the i-th time period being a time period for collecting the i-th video frame; Here, i is a positive integer, and the i-th video frame is any one of the video frames in the second video.

[0140] The photographer holds a fluorescent stick 1101 in his hand and shoots it in the air.

number

number

[0141] In the above method, when the first video and the second video are played synchronously, the first video is used to present the screen of all objects in the shooting scene, and the second video is used to present the continuous generation process of the motion trajectory of the target motion object from none to presence to completion, which can realize an intuitive presentation of the target image generation process and help improve the hobby of photography.

[0142] Second, a video frame of the second video includes display position information of the target moving object at a time corresponding to the current frame.

[0143] The display position information represents the position of the moving object in the current frame at the time corresponding to the current frame, and in the current frame, the display position information is displayed as a light spot.

[0144] In this embodiment, the i-th video frame of the second video is a captured image of the target moving object at an i-th time instant, the i-th time instant being the time instant at which the i-th video frame is captured; Here, i is a positive integer, and the i-th video frame is any one of the video frames in the second video.

[0145] The photographer holds a fluorescent stick 1101 in his hand and shoots it in the air.

number

number

[0146] In the above method, when the first video and the second video are played synchronously, the first video is used to present the screen of all objects in the shooting scene, and the second video is used to present the position change process of the target moving object, and the screen of the target moving object in the second video is closer to the real scene, which can realize the contrast presentation of background and foreground in the target image generation process, and is helpful to improve the hobby of shooting.

[0147] It should be explained that for the imaging method according to the embodiment of the present application, the execution body may be an imaging device, or may be a control module for loading and executing the imaging method in the imaging device.

[0148] An embodiment of the present application further provides an imaging device.

[0149] As shown in FIG. 13, the imaging device includes a first acquisition module 1310 and a first synthesis module 1320 .

[0150] The first acquisition module 1310 is used to acquire a first image with a first camera and acquire a second image with a second camera, the first image includes a screen of a current shooting scene, the second camera is used to acquire a motion trajectory of a target moving object, the first image includes the target moving object; The first synthesis module 1320 is used for image synthesis of the first image and the second image, and outputting a target image.

[0151] In some embodiments, the imager further comprises: a first receiving module for receiving a first input for a second image of a user; a first adjustment module for adjusting trajectory parameters of the motion trajectory in the second image in response to the first input and outputting the second image after the trajectory parameters have been adjusted; The first synthesis module 1320 is further used to synthesize the first image and the second image after the trajectory parameter adjustment; Here, the trajectory parameters include at least one parameter that characterizes a trajectory attribute of the motion trajectory.

[0152] In some embodiments, the first image and the second image are the same size; The first synthesis module 1320 is further used to replace pixels of a target area in the first image with all pixels on the motion trajectory in the second image, the target area being an area at a position corresponding to the area in the first image where the motion trajectory is located.

[0153] In some embodiments, the imager further comprises: and a first display module for displaying a capture preview interface. Wherein, the capture preview interface is used to display a preview image collected by the first camera; Or, the capture preview interface is used to display a preview image collected by the second camera; Or, the shooting preview interface includes a first shooting preview sub-interface and a second shooting preview sub-interface, the first shooting preview sub-interface is used to display a preview image collected by the first camera, and the second shooting preview sub-interface is used to display a preview image collected by the second camera.

[0154] In some embodiments, the imager further comprises: It may include a first control module for controlling the first camera to stop image acquisition when generation of the motion trajectory begins.

[0155] In some embodiments, the imager further comprises: A second acquisition module for acquiring a first video and a second video, where the first video includes a screen of a current shooting scene, and the second video is used to record the motion process of a target motion object; The video processing device may include a first playback module for, when a second user input is received, synchronously playing the first video and the second video in response to the second input.

[0156] In some embodiments, the i-th video frame of the second video includes a motion trajectory of the target motion object in an i-th time period, the i-th time period being a time period between the first time and the i-th time period, the first time period being a time period for collecting the first video frame, and the i-th time period being a time period for collecting the i-th video frame; Or, the i-th video frame of the second video is a captured image of the target moving object at an i-th time instant, where the i-th time instant is a time instant at which the i-th video frame is captured; Here, i is a positive integer, and the i-th video frame is any one of the video frames in the second video.

[0157] The photographing device according to the embodiment of the present application can realize customization of the motion trajectory of the target motion object by independently acquiring the background image and the motion trajectory of the target motion object of the light painting photograph, enhance the operability and hobby of the light painting camera photographing mode, improve the effect of the final finished photo, and reduce the number of frames collected for the current photographing scene, thereby helping to reduce hardware power consumption.

[0158] The photographing device in the embodiment of the present application may be a device, or may be a component, integrated circuit, or chip in a terminal. The device may be a mobile electronic device or a non-mobile electronic device. For example, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palmtop computer, an in-vehicle electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), and the non-mobile electronic device may be a personal computer (PC), a television (TV), a deposit machine, or a self-service machine, and the embodiment of the present application is not specifically limited.

[0159] The photographing device in the embodiment of the present application may be a device having an operating system, which may be an Android operating system, an iOS operating system, or other possible operating systems, and the embodiment of the present application is not specifically limited.

[0160] The imaging device according to the embodiments of the present application can realize each process realized by the imaging device in the method embodiments of FIG. 1 or FIG. 6, and will not be further described here to avoid repetition of description.

[0161] As shown in Fig. 14, the embodiment of the present application further provides an electronic device 140, which includes a processor 142, a memory 141, and a program or instruction stored in the memory 141 and operable on the processor 142, which, when executed by the processor 142, can realize each process of the embodiment of the above-mentioned photographing method and achieve the same technical effect. In order to avoid repetition, no further description will be given here.

[0162] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices described above.

[0163] FIG. 15 is a schematic diagram of the hardware structure of an electronic device for implementing an embodiment of the present application.

[0164] The electronic device 1500 includes components such as, but not limited to, a radio frequency unit 1501, a network module 1502, an audio output unit 1503, an input unit 1504, a sensor 1505, a display unit 1506, a user input unit 1507, an interface unit 1508, a memory 1509, and a processor 1510.

[0165] As can be understood by those skilled in the art, the electronic device 1500 may further include a power source (e.g., a battery) for powering each component, and the power source may be logically connected to the processor 1510 by a power management system, so that the power management system can realize functions such as charge / discharge management and power consumption management. The structure of the electronic device shown in FIG. 15 does not constitute a limitation on the electronic device, and the electronic device may include more or less components than the number of components shown, or a combination of some components, or a different arrangement of components, and will not be further described here.

[0166] Wherein, the input unit 1504 is used to collect a first image with a first camera and collect a second image with a second camera, the first image includes a screen of a current shooting scene, the second camera is used to collect a motion trajectory of a target moving object, the first image includes the target moving object; The processor 1510 is used for image synthesis of the first image and the second image and outputting a target image; The electronic device according to the embodiment of the present application can realize the user's customization of the motion trajectory of the target motion object by independently obtaining the background image and the motion trajectory of the target motion object of the light painting photograph, enhance the operability and hobby of the light painting camera shooting mode, improve the effect of the final finished photo, and reduce the number of frames collected for the current shooting scene, which helps to reduce hardware power consumption.

[0167] In some embodiments, the user input unit 1507 is used to receive a first input for the second image of a user; The processor 1510 is further adapted to adjust a trajectory parameter of the motion trajectory in the second image in response to the first input, and output a second image after the trajectory parameter adjustment; The processor 1510 is further used for image synthesis of the first image and the second image after the trajectory parameter adjustment; Here, the trajectory parameters include at least one parameter that characterizes a trajectory attribute of the motion trajectory.

[0168] In some embodiments, the first image and the second image are the same size, and the processor 1510 is further used to replace pixels of a target area in the first image with all pixels on the motion trajectory in the second image, the target area being an area at a position corresponding to the area in the first image where the motion trajectory is located.

[0169] In some embodiments, the display unit 1506 is used to display a capture preview interface; wherein the capture preview interface is used to display a preview image collected by the first camera; Alternatively, the capture preview interface is used to display a preview image collected by the second camera; Or, the shooting preview interface includes a first shooting preview sub-interface and a second shooting preview sub-interface, the first shooting preview sub-interface is used to display a preview image collected by the first camera, and the second shooting preview sub-interface is used to display a preview image collected by the second camera.

[0170] In some embodiments, the processor 1510 is further adapted to control the first camera to stop image acquisition when generation of the motion trajectory begins.

[0171] In some embodiments, the input unit 1504 is further used to collect a first video and a second video, the first video including a screen of a current shooting scene, and the second video is used to record a process of the target moving object forming the movement trajectory; The display unit 1506 is further used for, when receiving a second input from a user, synchronously playing the first video and the second video in response to the second input.

[0172] It should be noted that in this embodiment, the above electronic device 1500 can realize each process in the method embodiments in the embodiments of the present application and achieve the same beneficial effects, and will not be described further here in order to avoid repetition of description.

[0173] It should be understood that in the embodiment of the present application, the input unit 1504 may include a graphics processor (Graphics Processing Unit, GPU) 15041 and a microphone 15042, and the graphics processor 15041 processes image data of a static image or a video obtained by an image capture device (e.g., a camera) in a video capture mode or an image capture mode. The display unit 1506 may include a display panel 15061, and the display panel 15061 may be arranged in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1507 includes a touch panel 15071 and other input devices 15072. The touch panel 15071 is also called a touch screen. The touch panel 15071 may include two parts: a touch detection device and a touch controller. The other input devices 15072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control buttons, switch buttons, etc.), a trackball, a mouse, and an operation lever, which will not be described further herein. The memory 1509 may be used to store software programs and various data, including but not limited to application programs and an operating system. The processor 1510 may integrate an application processor and a modem processor, where the application processor is mainly for processing the operating system, the user interface, and the application programs, etc., and the modem processor is mainly for processing wireless communication. As can be understood, the modem processor may not be integrated into the processor 1510.

[0174] The embodiments of the present application further provide a readable storage medium, on which a program or instruction is stored, which, when executed by a processor, can realize each process of the above-mentioned photographing method embodiment and achieve the same technical effect. In order to avoid repetition, no further description will be given here.

[0175] Here, the processor is the processor in the electronic device described in the above embodiment. Examples of the readable storage medium include a non-transitory computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0176] The embodiments of the present application further provide an electronic device, which is configured to perform each process of the embodiments of the above-mentioned photographing method, and can achieve the same technical effects. In order to avoid repetition, it will not be further described here.

[0177] The embodiments of the present application further provide a computer program product, which can be executed by a processor to realize each process of the embodiment of the above-mentioned shooting method, and can achieve the same technical effect. In order to avoid repetition, no further description will be given here.

[0178] The embodiment of the present application further provides a chip, the chip includes a processor and a communication interface, the communication interface is coupled with the processor, the processor runs a program or instruction, and is used to realize each process of the embodiment of the above-mentioned photographing method, and can achieve the same technical effect. In order to avoid repetition, no further description will be given here.

[0179] It should be understood that the chips referred to in the embodiments of the present application may be referred to as system level chips, system chips, chip systems, or systems on chips.

[0180] It should be explained that in this specification, the terms "comprise", "include", or any other variants thereof are intended to cover the non-exclusive "comprise", whereby a process, method, article, or apparatus that includes a set of elements includes not only those elements, but also other elements not expressly listed or inherent to such process, method, article, or apparatus. In the absence of further limitations, an element limited by the phrase "comprises a" does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes this element. It should be pointed out that the scope of the method and apparatus in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may include performing functions in an essentially simultaneous manner or in reverse order based on the functions involved, for example, the described method can be performed in a different order than described, and various steps can be added, omitted, or combined. Also, features described with reference to some examples can be combined in other examples.

[0181] From the above description of the embodiments, it is clear to those skilled in the art that the methods of the above embodiments can be realized in the form of software and a necessary general-purpose hardware platform. Of course, they can also be realized in hardware, but in many cases the former is a more preferred embodiment. Based on this understanding, the technical solution of the present application may be substantially or in part embodied in the form of a software product. The computer software product is stored in a storage medium (e.g., ROM / RAM, magnetic disk, optical disk) and includes some instructions for causing a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0182] The above describes the embodiments of the present application with reference to the drawings, but the present application is not limited to the above specific embodiments. The above specific embodiments are merely illustrative and not limiting. Those skilled in the art can take many forms suggested by the present application without departing from the spirit and scope of the claims of the present application, and all of them belong to the protection scope of the present application.

Claims

1. A method of photographing, comprising: Acquiring a first image with a first camera and acquiring a second image with a second camera, the first image including a current scene, the second camera being used to acquire a motion trajectory of a target moving object, the second camera including a dynamic vision sensor (DVS), and the first image including the target moving object; image-compositing the first image and the second image to output a target image; A method of capturing an image, wherein the first image is used to generate a background image for the target image.

2. After acquiring a first image with the first camera and acquiring a second image with the second camera, the method of imaging includes: receiving a first input for the second image from a user; adjusting a trajectory parameter of the motion trajectory in the second image in response to the first input, and outputting the second image after the trajectory parameter adjustment; The image synthesis of the first image and the second image includes: image synthesis of the first image and the second image after the trajectory parameter adjustment; The imaging method according to claim 1 , wherein the trajectory parameters include at least one parameter that characterizes a trajectory attribute of the motion trajectory.

3. the first image and the second image have the same size; The image synthesis of the first image and the second image includes:

2. The imaging method of claim 1, further comprising replacing pixels of a target area in the first image with all pixels on the motion trajectory in the second image, the target area being an area at a position corresponding to an area in the first image where the motion trajectory is located.

4. Prior to acquiring a first image with the first camera and a second image with the second camera, the method includes: Further comprising: displaying a shooting preview interface; wherein the capture preview interface is used to display a preview image collected by the first camera; Alternatively, the capture preview interface is used to display a preview image collected by the second camera; Or, the shooting preview interface includes a first shooting preview sub-interface and a second shooting preview sub-interface, the first shooting preview sub-interface is used to display a preview image collected by the first camera, and the second shooting preview sub-interface is used to display a preview image collected by the second camera. The shooting method of claim 1,

5. In the process of acquiring the first image and the second image, the photographing method includes: The imaging method according to claim 1 , further comprising controlling the first camera to stop image acquisition when generation of the motion trajectory begins.

6. In the process of acquiring the first image and the second image, the photographing method includes: Collecting a first video and a second video, where the first video includes a screen of a current shooting scene, and the second video is used to record the process of the target moving object forming the moving trajectory; The method of claim 1 , further comprising, when a second input from a user is received, synchronously playing the first video and the second video in response to the second input.

7. The i-th video frame of the second video includes a motion trajectory of the target motion object in an i-th time period, the i-th time period being a time period between a first time period and an i-th time period, the first time period being a time period when a first video frame is collected, and the i-th time period being a time period when the i-th video frame is collected; or the i-th video frame of the second video is a captured image of the target moving object at an i-th time instant, the i-th time instant being a time instant at which the i-th video frame is captured; 7. The method of claim 6, wherein i is a positive integer and the i-th video frame is any one of the video frames in the second video.

8. An imaging device, a first acquisition module for acquiring a first image with a first camera and acquiring a second image with a second camera, the first image including a current scene, the second camera being used to acquire a motion trajectory of a target moving object, the second camera including a dynamic vision sensor (DVS), the first image including the target moving object; a first synthesis module for performing image synthesis on the first image and the second image to output a target image; The first image is used to generate a background image for the target image.

9. a first receiving module for receiving a first input for the second image of a user; a first adjustment module for adjusting a trajectory parameter of the motion trajectory in the second image in response to the first input, and outputting the second image after the trajectory parameter adjustment; wherein the first synthesis module is further used to perform image synthesis of the first image and the second image after the trajectory parameter adjustment; The imaging apparatus according to claim 8 , wherein the trajectory parameters include at least one parameter that characterizes a trajectory attribute of the motion trajectory.

10. the first image and the second image have the same size; 9. The imaging device of claim 8, wherein the first synthesis module is further used to replace pixels of a target area in the first image with all pixels on the motion trajectory in the second image, the target area being an area at a position corresponding to an area in the first image where the motion trajectory is located.

11. further comprising a first display module for displaying a shooting preview interface; wherein the capture preview interface is used to display a preview image collected by the first camera; Alternatively, the capture preview interface is used to display a preview image collected by the second camera; Or, the photographing device of claim 8, wherein the photographing preview interface includes a first photographing preview sub-interface and a second photographing preview sub-interface, the first photographing preview sub-interface is used to display a preview image collected by the first camera, and the second photographing preview sub-interface is used to display a preview image collected by the second camera.

12. The imaging device of claim 8 , further comprising a first control module for controlling the first camera to stop image acquisition when generation of the motion trajectory begins.

13. A second acquisition module for acquiring a first video and a second video, the first video including a screen of a current shooting scene, and the second video being used for recording the motion process of the target motion object; 12. The photographing device of claim 8, further comprising: a first playback module for, when a second input of a user is received, synchronously playing the first video and the second video in response to the second input.

14. The i-th video frame of the second video includes a motion trajectory of the target motion object in an i-th time period, the i-th time period being a time period between a first time period and an i-th time period, the first time period being a time period when a first video frame is collected, and the i-th time period being a time period when the i-th video frame is collected; or the i-th video frame of the second video is a captured image of the target moving object at an i-th time instant, the i-th time instant being a time instant at which the i-th video frame is captured; The imaging device of claim 13 , wherein i is a positive integer, and the i-th video frame is any one of the video frames in the second video.

15. An electronic device comprising a processor, a memory, and a program or instructions stored in the memory and operable on the processor, the electronic device realizing the photographing method according to any one of claims 1 to 7 when the program or instructions are executed by the processor.

16. A readable storage medium having a program or instructions stored therein, the program or instructions being executed by a processor to implement the imaging method according to any one of claims 1 to 7.

Images