A high dynamic range image photographing method, device and storage medium

Abstract

The present disclosure relates to a method, device and storage medium for taking high dynamic range images. The image processing method includes: in response to the image acquisition device starting the interlaced exposure sensor to take high dynamic range images, controlling the interlaced exposure sensor to expose to obtain a first exposure image, a second exposure image and a third exposure image; if an image taking instruction is received, outputting the first exposure image, the second exposure image and the third exposure image for high dynamic range photographic image synthesis; based on the first exposure image, the second exposure image and the third exposure image, performing high dynamic range photographic image synthesis to obtain a high dynamic range photographic image. Through the present disclosure, a high dynamic range photographic image with higher definition can be obtained.

Description

Technical Field

[0001] The present disclosure relates to the technical field of high dynamic range image photography, and in particular to a high dynamic range image photography method, device and storage medium. Background Art

[0002] With the development of science and technology, image acquisition, as a way of information exchange and transmission, has been used by people in all aspects of daily life.

[0003] In the related art, a short exposure image and a medium exposure image can be obtained by exposing with a staggered exposure sensor, and the obtained short exposure image and medium exposure image are synthesized to obtain a high dynamic range image required by the user. However, in the related art, the synthesized high dynamic range image has low definition and has many ghost images. Summary of the invention

[0004] In order to overcome the problems existing in the related art, the purpose of the present disclosure is to provide a high dynamic range image shooting method, device and storage medium, which can obtain a high dynamic range image with higher definition through high dynamic range image synthesis.

[0005] In order to achieve the above objectives, the technical solutions adopted in this disclosure are as follows:

[0006] According to a first aspect of an embodiment of the present disclosure, a high dynamic range image photographing method is provided, which is applied to an image acquisition device, wherein the image acquisition device includes an interlaced exposure sensor, and the high dynamic range image photographing method includes:

[0007] In response to the image acquisition device starting the interlaced exposure sensor to perform high dynamic range image photography, the interlaced exposure sensor is controlled to expose to obtain a first exposure image, a second exposure image, and a third exposure image; if an image photography instruction is received, the first exposure image, the second exposure image, and the third exposure image for high dynamic range photography image synthesis are output; based on the first exposure image, the second exposure image, and the third exposure image, high dynamic range photography image synthesis is performed to obtain a high dynamic range photography image.

[0008] In one embodiment, the outputting of a first exposure image, a second exposure image, and a third exposure image for high dynamic range camera image synthesis includes: outputting a first exposure image with a first exposure time, a second exposure image with a second exposure time, and a third exposure image with a third exposure time; wherein the first exposure time is within a first exposure time range, the second exposure time is within a second exposure time range, and the third exposure time is within a third exposure time range; the maximum exposure time within the first exposure time range is less than the minimum exposure time within the second exposure time range, and the maximum exposure time within the second exposure time range is less than the minimum exposure time within the third exposure time range.

[0009] In one embodiment, the high dynamic range image shooting method further includes: in the image preview stage, based on the first exposure image and the second exposure image, performing high dynamic range preview image synthesis to obtain a high dynamic range preview image; the first exposure image has a first exposure time, the second exposure image has a second exposure time, the first exposure time is within a first exposure time range, and the second exposure time is within a second exposure time range; the maximum exposure time within the first exposure time range is less than the minimum exposure time within the second exposure time range, and the maximum exposure time within the second exposure time range is less than the minimum exposure time within the third exposure time range.

[0010] In one embodiment, in an image preview stage, a high dynamic range preview image is synthesized based on a first exposure image and a second exposure image to obtain a high dynamic range preview image, including: if an image preview instruction is received, a first exposure image with a first exposure time, a second exposure image with a second exposure time, and a third exposure image with a fourth exposure time are output; wherein the sum of the exposure times among the first exposure time, the second exposure time, and the fourth exposure time is less than a preview exposure time threshold, the fourth exposure time is less than a preset exposure time, and the preset exposure time is less than the third exposure time, and the third exposure time is within the range of the third exposure time; the third exposure image is discarded, and a high dynamic range preview image is synthesized based on the first exposure image and the second exposure image to obtain a high dynamic range preview image.

[0011] In one embodiment, in the image preview stage, a high dynamic range preview image is synthesized based on a first exposure image and a second exposure image to obtain a high dynamic range preview image, including: if an image preview instruction is received, a first exposure image with a first exposure time and a second exposure image with a second exposure time are output; based on the first exposure image and the second exposure image, a high dynamic range preview image is synthesized to obtain a high dynamic range preview image.

[0012] According to a second aspect of an embodiment of the present disclosure, a high dynamic range image photographing device is provided, which is applied to an image acquisition device, wherein the image acquisition device includes an interlaced exposure sensor, and the high dynamic range image photographing device includes:

[0013] A control unit, in response to the image acquisition device starting the interlaced exposure sensor to perform high dynamic range image photography, controls the interlaced exposure sensor to expose to obtain a first exposure image, a second exposure image, and a third exposure image; an output unit, upon receiving an image photography instruction, outputs the first exposure image, the second exposure image, and the third exposure image for high dynamic range photography image synthesis; a synthesis unit, based on the first exposure image, the second exposure image, and the third exposure image, performs high dynamic range photography image synthesis to obtain a high dynamic range photography image.

[0014] In one embodiment, the output unit outputs a first exposure image, a second exposure image, and a third exposure image for high dynamic range camera image synthesis in the following manner: outputting a first exposure image with a first exposure time, a second exposure image with a second exposure time, and a third exposure image with a third exposure time; wherein the first exposure time is within a first exposure time range, the second exposure time is within a second exposure time range, and the third exposure time is within a third exposure time range; the maximum exposure time within the first exposure time range is less than the minimum exposure time within the second exposure time range, and the maximum exposure time within the second exposure time range is less than the minimum exposure time within the third exposure time range.

[0015] In one embodiment, the synthesis unit is also used to: in the image preview stage, perform high dynamic range preview image synthesis based on the first exposure image and the second exposure image to obtain a high dynamic range preview image; the first exposure image has a first exposure time, the second exposure image has a second exposure time, the first exposure time is within a first exposure time range, and the second exposure time is within a second exposure time range; the maximum exposure time within the first exposure time range is less than the minimum exposure time within the second exposure time range, and the maximum exposure time within the second exposure time range is less than the minimum exposure time within the third exposure time range.

[0016] In one embodiment, in the image preview stage, the synthesis unit synthesizes a high dynamic range preview image based on the first exposure image and the second exposure image to obtain a high dynamic range preview image in the following manner: if an image preview instruction is received, a first exposure image with a first exposure time, a second exposure image with a second exposure time, and a third exposure image with a fourth exposure time are output; wherein the sum of the exposure times among the first exposure time, the second exposure time, and the fourth exposure time is less than a preview exposure time threshold, the fourth exposure time is less than a preset exposure time, and the preset exposure time is less than the third exposure time, and the third exposure time is within the range of the third exposure time; the third exposure image is discarded, and a high dynamic range preview image is synthesized based on the first exposure image and the second exposure image to obtain a high dynamic range preview image.

[0017] In one embodiment, in the image preview stage, the synthesis unit performs high dynamic range preview image synthesis based on the first exposure image and the second exposure image to obtain the high dynamic range preview image in the following manner: if an image preview instruction is received, a first exposure image with a first exposure time and a second exposure image with a second exposure time are output; based on the first exposure image and the second exposure image, a high dynamic range preview image synthesis is performed to obtain the high dynamic range preview image.

[0018] According to a third aspect of an embodiment of the present disclosure, a high dynamic range image photographing device is provided, comprising:

[0019] a processor; a memory for storing instructions executable by the processor;

[0020] Wherein, the processor is configured to: execute the high dynamic range image photography method described in the first aspect or any one of the embodiments of the first aspect.

[0021] According to a fourth aspect of an embodiment of the present disclosure, a storage medium is provided, in which instructions are stored. When the instructions in the storage medium are executed by a processor of an image acquisition device, the image acquisition device is enabled to execute the high dynamic range image photography method described in the first aspect or any one of the embodiments of the first aspect.

[0022] The technical solution provided by the embodiments of the present disclosure may include the following beneficial effects: in response to the image acquisition device starting the interlaced exposure sensor to take high dynamic range images, the interlaced exposure sensor is controlled to expose to obtain three frames of exposure images. If an image taking instruction is received, three frames of exposure images for high dynamic range photographic image synthesis are output. The three frames of exposure images are synthesized for high dynamic range photographic images to obtain a high dynamic range photographic image. By using the three frames of images output by the interlaced exposure sensor at the same time to perform high dynamic range photographic image synthesis, the obtained high dynamic range photographic image can have a higher definition.

[0023] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0025] Figure 1 The figure is a flow chart of a method for photographing a high dynamic range image according to an exemplary embodiment.

[0026] Figure 2 The figure is a flow chart of another high dynamic range image photographing method according to an exemplary embodiment.

[0027] Figure 3 The present invention is a flow chart of a method for obtaining a high dynamic range preview image according to an exemplary embodiment.

[0028] Figure 4 The figure is a flow chart of another method for obtaining a high dynamic range preview image according to an exemplary embodiment.

[0029] Figure 5 The present invention is a schematic diagram of a process of obtaining a high dynamic range preview image according to an exemplary embodiment.

[0030] Figure 6 The figure is a schematic diagram of another process of obtaining a high dynamic range preview image according to an exemplary embodiment.

[0031] Figure 7 The figure is a block diagram of a high dynamic range image photographing device according to an exemplary embodiment.

[0032] Figure 8 The invention is a block diagram of a device for taking high dynamic range images according to an exemplary embodiment. DETAILED DESCRIPTION

[0033] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0034] The high dynamic range image shooting method provided by the embodiment of the present disclosure can be applied to the scene of high dynamic range (HDR) image shooting by an image acquisition device equipped with a stagger exposure sensor. In particular, the image acquisition device with the stagger exposure sensor can control the stagger exposure sensor to expose images with different exposure times during the high dynamic range image shooting process.

[0035] In the related art, in a high dynamic range image shooting method, when performing high dynamic range image shooting, the staggered exposure sensor can be controlled to expose two frames of images (a short exposure image and a medium exposure image). The two frames of images obtained are synthesized for high dynamic range photography to obtain a high dynamic range photography image. The high dynamic range photography image obtained by synthesizing high dynamic range photography images through this method has low clarity. In another high dynamic range image shooting method provided by the related art, when performing high dynamic range image shooting, the staggered exposure sensor can be controlled to expose two frames of images (a short exposure image and a medium exposure image). The two frames of images obtained are synthesized for high dynamic range photography with the long exposure image obtained by subsequent exposure to obtain a high dynamic range photography image. Since the long exposure image used in the process of synthesizing high dynamic range photography images by this method is obtained by subsequent exposure, the obtained high dynamic range photography image will produce more ghost images.

[0036] In view of this, the embodiment of the present disclosure provides a high dynamic range image shooting method, which can control the staggered exposure sensor to expose three frames of images (short exposure image, medium exposure image and long exposure image) when performing high dynamic range image shooting. The three frames of images output at the same time are synthesized for high dynamic range shooting to obtain a high dynamic range shooting image. The clarity of the high dynamic range shooting image can be improved through the present disclosure.

[0037] Figure 1 is a flow chart of a method for photographing a high dynamic range image according to an exemplary embodiment. Figure 1 As shown, the high dynamic range image photographing method is used in an image acquisition device equipped with an interlaced exposure sensor, and includes the following steps.

[0038] In step S11, in response to the image acquisition device starting the interlaced exposure sensor to take high dynamic range images, the interlaced exposure sensor is controlled to expose to obtain a first exposure image, a second exposure image and a third exposure image.

[0039] In the embodiment of the present disclosure, the first exposure image, the second exposure image, and the third exposure image may be understood as exposure images with different exposure times.

[0040] In step S12, when an image capturing instruction is received, a first exposure image, a second exposure image, and a third exposure image for high dynamic range image synthesis are output.

[0041] In step S13, a high dynamic range photographic image is synthesized based on the first exposure image, the second exposure image and the third exposure image to obtain a high dynamic range photographic image.

[0042] In the disclosed embodiment, the first exposure image, the second exposure image, and the third exposure image used for high dynamic range photo synthesis are output simultaneously. The first exposure image, the second exposure image, and the third exposure image are synthesized for high dynamic range photo synthesis to obtain a high dynamic range photo image with higher definition, thereby reducing ghosting of the high dynamic range photo image.

[0043] In one example, the first exposure image, the second exposure image, and the third exposure image obtained by controlling the staggered exposure sensor to expose may be exposure images with different exposure times.

[0044] In the embodiment of the present disclosure, for the convenience of description, the short exposure duration is referred to as the first exposure duration, the medium exposure duration is referred to as the second exposure duration, and the long exposure duration is referred to as the third exposure duration.

[0045] Figure 2 is a flow chart of a method for photographing a high dynamic range image according to an exemplary embodiment. Figure 2 As shown, the implementation process of step S21 and step S23 in the high dynamic range image shooting method provided by the embodiment of the present disclosure is the same as Figure 1 The execution methods of step S11 and step S13 are similar and will not be described again.

[0046] In step S22, when an image capturing instruction is received, a first exposure image with a first exposure time, a second exposure image with a second exposure time, and a third exposure image with a third exposure time are output.

[0047] The first exposure duration is within a first exposure duration range, the second exposure duration is within a second exposure duration range, and the third exposure duration is within a third exposure duration range. The maximum exposure duration in the first exposure duration range is less than the minimum exposure duration in the second exposure duration range, and the maximum exposure duration in the second exposure duration range is less than the minimum exposure duration in the third exposure duration range.

[0048] In the high dynamic range image shooting method provided by the embodiment of the present disclosure, the exposure images obtained by the staggered exposure sensor exposure can be exposure images with different exposure times. The high dynamic range shooting image synthesis by the exposure images with different exposure times can further improve the clarity of the high dynamic range shooting image.

[0049] In the embodiment of the present disclosure, in the image preview stage, the first exposure image and the second exposure image may be synthesized into a high dynamic range preview image to obtain a high dynamic range preview image.

[0050] The first exposure image has a first exposure duration, the second exposure image has a second exposure duration, the first exposure duration is within a first exposure duration range, and the second exposure duration is within a second exposure duration range. The maximum exposure duration in the first exposure duration range is less than the minimum exposure duration in the second exposure duration range, and the maximum exposure duration in the second exposure duration range is less than the minimum exposure duration in the third exposure duration range.

[0051] In the embodiment of the present disclosure, when outputting a first exposure image, a second exposure image, and a third exposure image, the first exposure image and the second exposure image may be selected for high dynamic range preview image synthesis without selecting the third exposure image, thereby reducing power consumption of high dynamic range preview image synthesis.

[0052] Figure 3 is a flow chart of a method for obtaining a high dynamic range preview image according to an exemplary embodiment. Figure 3 As shown, the following steps are included.

[0053] In step S31 , when an image preview instruction is received, a first exposure image with a first exposure time, a second exposure image with a second exposure time, and a third exposure image with a fourth exposure time are output.

[0054] Among them, the sum of the exposure times of the first exposure time, the second exposure time and the fourth exposure time is less than the preview exposure time threshold, the fourth exposure time is less than the preset exposure time, and the preset exposure time is less than the third exposure time, and the third exposure time is within the third exposure time range.

[0055] In step S32, the third exposure image is discarded, and a high dynamic range preview image is synthesized based on the first exposure image and the second exposure image to obtain a high dynamic range preview image.

[0056] In the embodiment of the present disclosure, by reducing the exposure time of the third exposure image, the preview screen frame rate of the high dynamic range preview image can be guaranteed.

[0057] In one example, since the third exposure image is captured with the fourth exposure time, the third exposure image will produce more ghost images. Therefore, the third exposure image can be discarded in the process of synthesizing the high dynamic range preview image to ensure the clarity of the high dynamic range preview image. In addition, only using the first exposure image and the second exposure image for high dynamic range preview image synthesis can reduce the power consumption of the image acquisition device and improve the efficiency of high dynamic range preview image synthesis.

[0058] In another example, when an image preview instruction is received, a first exposure image and a second exposure image may be output, and a high dynamic range preview image may be obtained by synthesizing the first exposure image and the second exposure image.

[0059] Figure 4 is a flow chart of a method for obtaining a high dynamic range preview image according to an exemplary embodiment. Figure 4 As shown, the following steps are included.

[0060] In step S41 , when an image preview instruction is received, a first exposure image having a first exposure time length and a second exposure image having a second exposure time length are output.

[0061] In step S42, a high dynamic range preview image is synthesized based on the first exposure image and the second exposure image to obtain a high dynamic range preview image.

[0062] In the embodiment of the present disclosure, when an image preview instruction is received, the first exposure image and the second exposure image may be output without outputting the third exposure image, thereby reducing power consumption of the exposure image output.

[0063] The high dynamic range image shooting method provided by the embodiment of the present disclosure can ensure the preview screen frame rate of the high dynamic range preview image, and the synthesized high dynamic range preview image has higher clarity.

[0064] Figure 5 FIG. 1 is a flow chart showing a method of obtaining a high dynamic range preview image according to an exemplary embodiment. Figure 5As shown, in the image preview stage, the interlaced exposure sensor outputs a short exposure frame image (first exposure duration), a medium exposure frame image (second exposure duration) and a long exposure frame image (fourth exposure duration). In order to ensure that the preview image is continuous and not stuck, it is usually necessary to ensure that the frame rate of the preview image is not less than the frame rate threshold (for example, 30FPS). Therefore, it is necessary to ensure that the sum of the exposure durations between the long exposure frame image, the medium exposure frame image and the short exposure frame image is less than the preview exposure duration threshold (for example, 33ms). For example, the exposure duration (fourth exposure duration) of the long exposure frame image can be set to be less than the preset exposure duration. This method can make the exposure duration of the long exposure frame image small enough to satisfy the requirement that the sum of the exposure durations between the short exposure frame image, the medium exposure frame image and the long exposure frame image can be less than the preview exposure duration threshold. In order to ensure the synthesis effect of the high dynamic range preview image, the long exposure frame image obtained by exposure with the fourth exposure duration can be discarded, and the short exposure frame image and the medium exposure image obtained by exposure are used to synthesize the high dynamic range preview image to obtain the desired high dynamic range preview image. In addition, when taking photos using an image acquisition device with an interlaced exposure sensor, the frame rate does not need to be guaranteed for high dynamic range photographic images. Therefore, the sum of the exposure times between the short exposure frame image, the medium exposure frame image, and the long exposure frame image can exceed the preview exposure time threshold. For example, when an image photographing instruction is received, the exposure time of the long exposure frame image can be restored to the normal exposure time (third exposure time), and the short exposure frame image (first exposure time), the medium exposure frame image (second exposure time), and the long exposure frame image (third exposure time) are output through the interlaced exposure sensor. The short exposure frame image, the medium exposure frame image, and the long exposure frame image are synthesized for high dynamic range photographic images to obtain the desired high dynamic range photographic image.

[0065] Figure 6 FIG. 1 is a flow chart showing a method of obtaining a high dynamic range preview image according to an exemplary embodiment. Figure 6 As shown, in the image preview stage, the interlaced exposure sensor outputs a short exposure frame image (first exposure duration) and a medium exposure frame image (second exposure duration). The output short exposure frame image and the medium exposure frame image are synthesized to obtain the desired high dynamic range preview image. In addition, when taking photos using an image acquisition device with an interlaced book exposure sensor, the interlaced exposure sensor outputs a short exposure frame image (first exposure duration), a medium exposure frame image (second exposure duration) and a long exposure frame image (third exposure duration). The output short exposure frame image, the medium exposure frame image and the long exposure frame image are synthesized for high dynamic range photography, to obtain a high dynamic range photography image.

[0066] In the high dynamic range image shooting method provided in the embodiment of the present disclosure, when performing high dynamic range image shooting, the interlaced exposure sensor can be controlled to expose to obtain short exposure frame images, medium exposure frame images and long exposure frame images. When the long exposure frame is not needed to participate in the high dynamic range image synthesis (high dynamic range preview image synthesis), only the short exposure frame image and the medium exposure frame image are output, and the long exposure frame image is not output. When the long exposure frame is needed to participate in the high dynamic range image synthesis (high dynamic range photography image synthesis), the short exposure frame image, the medium exposure frame image and the long exposure frame image are output. This method can ensure that when the output of two frames of images switches to the output of three frames of images, the preview interface does not pause, and dynamic and smooth switching from two frames to three frames is achieved.

[0067] In an example, Figure 5 as well as Figure 6 As shown, when the interlaced exposure sensor is exposed to obtain a short exposure frame image, a medium exposure frame image, and a long exposure frame image, the reference frame image can be determined in the short exposure frame image, the medium exposure frame image, and the long exposure frame image, respectively. In one embodiment, the reference frame image with the same exposure time can be synthesized with the adjacent frame image to obtain a reference frame with higher definition. Furthermore, the reference frame image corresponding to the obtained short exposure frame image, the medium exposure frame image, and the long exposure frame image can be output, and a high dynamic range image synthesis is performed through the output reference frame image to obtain a high dynamic range image.

[0068] In the embodiment of the present disclosure, in the image preview stage, the short exposure frame image and the medium exposure frame image obtained by staggered sensor exposure can be used to synthesize the high dynamic range preview image to obtain the high dynamic range preview image. When a photo command is received, the short exposure frame image, the medium exposure frame image and the long exposure frame image obtained by staggered sensor exposure can be used to synthesize the high dynamic range photo image to obtain the high dynamic range photo image. The present disclosure can improve the clarity of the high dynamic range photo image, and the process of switching from the image preview stage to the photo is smooth and continuous without any lag.

[0069] Based on the same concept, the embodiment of the present disclosure also provides a high dynamic range image photographing device.

[0070] It is understandable that in order to achieve the above functions, the high dynamic range image photography device provided by the embodiment of the present disclosure includes hardware structures and / or software modules corresponding to the execution of each function. In combination with the units and algorithm steps of each example disclosed in the embodiment of the present disclosure, the embodiment of the present disclosure can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the technical solution of the embodiment of the present disclosure.

[0071] Figure 7 FIG. 1 is a block diagram of a high dynamic range image photographing device according to an exemplary embodiment. Figure 7 The device 100 includes a control unit 101, an output unit 102 and a synthesis unit 103.

[0072] The control unit 101, in response to the image acquisition device starting the interlaced exposure sensor to take high dynamic range images, controls the interlaced exposure sensor to expose to obtain a first exposure image, a second exposure image, and a third exposure image. The output unit 102, upon receiving an image taking instruction, outputs the first exposure image, the second exposure image, and the third exposure image for high dynamic range image synthesis. The synthesis unit 103, based on the first exposure image, the second exposure image, and the third exposure image, performs high dynamic range image synthesis to obtain a high dynamic range image.

[0073] In one embodiment, the output unit 102 outputs the first exposure image, the second exposure image, and the third exposure image for high dynamic range camera image synthesis in the following manner: outputting the first exposure image with a first exposure time, the second exposure image with a second exposure time, and the third exposure image with a third exposure time. The first exposure time is within the first exposure time range, the second exposure time is within the second exposure time range, and the third exposure time is within the third exposure time range. The maximum exposure time within the first exposure time range is less than the minimum exposure time within the second exposure time range, and the maximum exposure time within the second exposure time range is less than the minimum exposure time within the third exposure time range.

[0074] In one embodiment, the synthesis unit 103 is further used to: in the image preview stage, based on the first exposure image and the second exposure image, synthesize a high dynamic range preview image to obtain a high dynamic range preview image. The first exposure image has a first exposure time, the second exposure image has a second exposure time, the first exposure time is within the first exposure time range, and the second exposure time is within the second exposure time range. The maximum exposure time in the first exposure time range is less than the minimum exposure time in the second exposure time range, and the maximum exposure time in the second exposure time range is less than the minimum exposure time in the third exposure time range.

[0075] In one embodiment, in the image preview stage, the synthesis unit 103 synthesizes the high dynamic range preview image based on the first exposure image and the second exposure image in the following manner to obtain the high dynamic range preview image: if an image preview instruction is received, the first exposure image with the first exposure time, the second exposure image with the second exposure time, and the third exposure image with the fourth exposure time are output. The sum of the exposure times among the first exposure time, the second exposure time, and the fourth exposure time is less than the preview exposure time threshold, the fourth exposure time is less than the preset exposure time, and the preset exposure time is less than the third exposure time, and the third exposure time is within the third exposure time range. The third exposure image is discarded, and the high dynamic range preview image is synthesized based on the first exposure image and the second exposure image to obtain the high dynamic range preview image.

[0076] In one embodiment, in the image preview stage, the synthesis unit 103 synthesizes the high dynamic range preview image based on the first exposure image and the second exposure image to obtain the high dynamic range preview image in the following manner: if an image preview instruction is received, the first exposure image with the first exposure time and the second exposure image with the second exposure time are output. Based on the first exposure image and the second exposure image, the high dynamic range preview image is synthesized to obtain the high dynamic range preview image.

[0077] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0078] Figure 8 1 is a block diagram of a device 200 for high dynamic range image photography according to an exemplary embodiment. For example, the device 200 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0079] Reference Figure 8, the device 200 may include one or more of the following components: a processing component 202 , a memory 204 , a power component 206 , a multimedia component 208 , an audio component 210 , an input / output (I / O) interface 212 , a sensor component 214 , and a communication component 216 .

[0080] The processing component 202 generally controls the overall operation of the device 200, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 202 may include one or more processors 220 to execute instructions to perform all or part of the steps of the above-described method. In addition, the processing component 202 may include one or more modules to facilitate interaction between the processing component 202 and other components. For example, the processing component 202 may include a multimedia module to facilitate interaction between the multimedia component 208 and the processing component 202.

[0081] The memory 204 is configured to store various types of data to support operations on the device 200. Examples of such data include instructions for any application or method operating on the device 200, contact data, phone book data, messages, pictures, videos, etc. The memory 204 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0082] The power component 206 provides power to the various components of the device 200. The power component 206 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 200.

[0083] The multimedia component 208 includes a screen that provides an output interface between the device 200 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 208 includes a front camera and / or a rear camera. When the device 200 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0084] The audio component 210 is configured to output and / or input audio signals. For example, the audio component 210 includes a microphone (MIC), and when the device 200 is in an operation mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 204 or sent via the communication component 216. In some embodiments, the audio component 210 also includes a speaker for outputting audio signals.

[0085] I / O interface 212 provides an interface between processing component 202 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0086] The sensor assembly 214 includes one or more sensors for providing various aspects of the status assessment of the device 200. For example, the sensor assembly 214 can detect the open / closed state of the device 200, the relative positioning of components, such as the display and keypad of the device 200, the sensor assembly 214 can also detect the position change of the device 200 or a component of the device 200, the presence or absence of user contact with the device 200, the orientation or acceleration / deceleration of the device 200 and the temperature change of the device 200. The sensor assembly 214 can include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 214 can also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 214 can also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor or a temperature sensor.

[0087] The communication component 216 is configured to facilitate wired or wireless communication between the device 200 and other devices. The device 200 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 216 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 216 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0088] In an exemplary embodiment, the apparatus 200 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to perform the above method.

[0089] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 204 including instructions, and the instructions can be executed by the processor 220 of the device 200 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0090] It is to be understood that in the present disclosure, "plurality" refers to two or more than two, and other quantifiers are similar. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the associated objects before and after are in an "or" relationship. The singular forms "a", "the" and "the" are also intended to include plural forms, unless the context clearly indicates other meanings.

[0091] It is further understood that the terms "first", "second", etc. are used to describe various information, but such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other, and do not indicate a specific order or degree of importance. In fact, the expressions "first", "second", etc. can be used interchangeably. For example, without departing from the scope of the present disclosure, the first information can also be referred to as the second information, and similarly, the second information can also be referred to as the first information.

[0092] It can be further understood that, unless otherwise specified, “connection” includes a direct connection without other components between the two, and also includes an indirect connection with other components between the two.

[0093] It is further understood that, although the operations are described in a specific order in the drawings in the embodiments of the present disclosure, it should not be understood as requiring the operations to be performed in the specific order shown or in a serial order, or requiring the execution of all the operations shown to obtain the desired results. In certain environments, multitasking and parallel processing may be advantageous.

[0094] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0095] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A high dynamic range image photographing method, characterized in that: Applied to an image acquisition device, the image acquisition device includes an interlaced exposure sensor, and the high dynamic range image shooting method includes: In response to the image acquisition device starting the interlaced exposure sensor to take high dynamic range images, the interlaced exposure sensor is controlled to expose to obtain a first exposure image, a second exposure image, and a third exposure image; If an image shooting instruction is received, a first exposure image, a second exposure image and a third exposure image for high dynamic range image synthesis are output; Based on the first exposure image, the second exposure image and the third exposure image, high dynamic range photographic image synthesis is performed to obtain a high dynamic range photographic image; The method further comprises: In the image preview stage, a high dynamic range preview image is synthesized based on the first exposure image and the second exposure image to obtain a high dynamic range preview image; The first exposure image has a first exposure duration, the second exposure image has a second exposure duration, the third exposure image has a third exposure duration, the first exposure duration is within a first exposure duration range, the second exposure duration is within a second exposure duration range, and the third exposure duration is within a third exposure duration range; The maximum exposure duration in the first exposure duration range is smaller than the minimum exposure duration in the second exposure duration range, and the maximum exposure duration in the second exposure duration range is smaller than the minimum exposure duration in the third exposure duration range.

2. The high dynamic range image photographing method according to claim 1, characterized in that: The output of the first exposure image, the second exposure image and the third exposure image for high dynamic range photographic image synthesis includes: A first exposure image having a first exposure time length, a second exposure image having a second exposure time length, and a third exposure image having a third exposure time length are output.

3. The high dynamic range image photographing method according to claim 1, characterized in that: In the image preview stage, a high dynamic range preview image is synthesized based on the first exposure image and the second exposure image to obtain a high dynamic range preview image, including: If an image preview instruction is received, outputting a first exposure image with a first exposure time, a second exposure image with a second exposure time, and a third exposure image with a fourth exposure time; The sum of the exposure durations of the first exposure duration, the second exposure duration, and the fourth exposure duration is less than a preview exposure duration threshold, the fourth exposure duration is less than a preset exposure duration, and the preset exposure duration is less than a third exposure duration, and the third exposure duration is within the third exposure duration range; The third exposure image is discarded, and a high dynamic range preview image is synthesized based on the first exposure image and the second exposure image to obtain a high dynamic range preview image.

4. The high dynamic range image photographing method according to claim 1, characterized in that: In the image preview stage, a high dynamic range preview image is synthesized based on the first exposure image and the second exposure image to obtain a high dynamic range preview image, including: If an image preview instruction is received, outputting a first exposure image having a first exposure time and a second exposure image having a second exposure time; Based on the first exposure image and the second exposure image, a high dynamic range preview image is synthesized to obtain a high dynamic range preview image.

5. A high dynamic range image photographing device, characterized in that: Applied to an image acquisition device, the image acquisition device includes an interlaced exposure sensor, and the high dynamic range image photography device includes: a control unit, in response to the image acquisition device starting the interlaced exposure sensor to take high dynamic range images, controlling the interlaced exposure sensor to expose to obtain a first exposure image, a second exposure image, and a third exposure image; an output unit, which, upon receiving an image shooting instruction, outputs a first exposure image, a second exposure image, and a third exposure image for high dynamic range image synthesis; a synthesis unit, performing high dynamic range photographic image synthesis based on the first exposure image, the second exposure image and the third exposure image to obtain a high dynamic range photographic image; The synthesis unit is also used for: In the image preview stage, a high dynamic range preview image is synthesized based on the first exposure image and the second exposure image to obtain a high dynamic range preview image; The first exposure image has a first exposure duration, the second exposure image has a second exposure duration, the third exposure image has a third exposure duration, the first exposure duration is within a first exposure duration range, the second exposure duration is within a second exposure duration range, and the third exposure duration is within a third exposure duration range; The maximum exposure duration in the first exposure duration range is smaller than the minimum exposure duration in the second exposure duration range, and the maximum exposure duration in the second exposure duration range is smaller than the minimum exposure duration in the third exposure duration range.

6. The high dynamic range image photographing device according to claim 5, characterized in that: The output unit outputs the first exposure image, the second exposure image and the third exposure image for high dynamic range photographic image synthesis in the following manner: A first exposure image having a first exposure time length, a second exposure image having a second exposure time length, and a third exposure image having a third exposure time length are output.

7. The high dynamic range image photographing device according to claim 5, characterized in that: In the image preview stage, the synthesis unit synthesizes the high dynamic range preview image based on the first exposure image and the second exposure image in the following manner to obtain the high dynamic range preview image: If an image preview instruction is received, outputting a first exposure image with a first exposure time, a second exposure image with a second exposure time, and a third exposure image with a fourth exposure time; The sum of the exposure durations of the first exposure duration, the second exposure duration, and the fourth exposure duration is less than a preview exposure duration threshold, the fourth exposure duration is less than a preset exposure duration, and the preset exposure duration is less than a third exposure duration, and the third exposure duration is within the third exposure duration range; The third exposure image is discarded, and a high dynamic range preview image is synthesized based on the first exposure image and the second exposure image to obtain a high dynamic range preview image.

8. The high dynamic range image photographing device according to claim 5, characterized in that: In the image preview stage, the synthesis unit synthesizes the high dynamic range preview image based on the first exposure image and the second exposure image in the following manner to obtain the high dynamic range preview image: If an image preview instruction is received, outputting a first exposure image having a first exposure time and a second exposure image having a second exposure time; Based on the first exposure image and the second exposure image, a high dynamic range preview image is synthesized to obtain a high dynamic range preview image.

9. A high dynamic range image photographing device, characterized in that: include: processor; a memory for storing processor-executable instructions; Wherein, the processor is configured to: execute the high dynamic range image photography method described in any one of claims 1 to 4.

10. A storage medium, characterized in that: The storage medium stores instructions. When the instructions in the storage medium are executed by a processor of an image acquisition device, the image acquisition device is enabled to execute the high dynamic range image shooting method described in any one of claims 1 to 4.

Images