Imaging device

Abstract

To easily record image data in an imaging apparatus that can record data on a recording medium.SOLUTION: An imaging apparatus (100) includes an imaging unit (115), a storage unit (125), an image processing unit (120), and a control unit (135). The imaging unit captures a subject image and generates imaging data. The storage unit temporarily holds the imaging data. The image processing unit executes image processing on the captured data to generate image data. The control unit records the image data on a recording medium (142). The control unit searches the recording medium for image data saved from the storage unit, and when the saved image data is searched for, the control unit reads the saved image data to the storage unit. Then, the image processing unit is caused to execute the image processing for the imaging data.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to an imaging device capable of recording data on an external non-volatile recording medium. [Background technology]

[0002] Patent Document 1 discloses a flash process performed in an imaging device such as a digital camera. This flash process is a process for writing data from an image buffer to a recording medium and erasing the data in the buffer during shutdown processing such as when a low battery level is detected during operation involving wireless transmission of the digital camera. This makes it possible to safely perform shutdown processing during wireless transmission of image data. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2007-158604 A Summary of the Invention [Problem to be solved by the invention]

[0004] The present disclosure provides an imaging device capable of recording data on a recording medium, which makes it easy to record image data. [Means for solving the problem]

[0005] In one aspect of the present disclosure, an imaging device capable of recording data on an external non-volatile recording medium is provided. The imaging device includes an imaging unit that captures an image of a subject to generate imaging data, a storage unit that temporarily stores the imaging data, an image processing unit that performs image processing on the imaging data to generate image data, and a control unit that records the image data on the recording medium. The control unit searches the recording medium for the presence of imaging data that has been saved from the storage unit, and when it is found that the saved imaging data is present, the control unit reads the saved imaging data into the storage unit and causes the image processing unit to perform image processing on the imaging data.

[0006] In another aspect of the present disclosure, when the power is turned off with the imaging data saved from the storage unit to the recording medium, the control unit of the imaging device terminates the operation of the device without performing image processing on the saved imaging data, and when the power is turned on thereafter, the control unit causes the image processing unit to execute image processing on the saved imaging data.

[0007] In yet another aspect of the present disclosure, a control unit of an imaging device holds imaging results by the imaging unit for a predetermined period of time before an instruction to start imaging is given, and when an instruction to start imaging is given, causes an image processing unit to generate image data including an image captured before the instruction to start imaging is given based on the held imaging results. Before the instruction to start imaging is given, the control unit records data on a recording medium so as to hold the imaging results for the predetermined period of time. Effect of the Invention

[0008] According to the imaging device and the method for recording image data in the present disclosure, it is possible to facilitate recording of image data in an imaging device capable of recording data on a recording medium. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram showing a configuration of a digital camera according to a first embodiment of the present disclosure. [Diagram 2] FIG. 1 is a diagram for explaining the overall operation of the digital camera according to the first embodiment during continuous shooting; [Diagram 3] 1 is a flowchart illustrating a process performed when photographing a picture in the digital camera according to the first embodiment; [Figure 4] Table showing examples of evacuation decision conditions in a modification of the first embodiment [Diagram 5] FIG. 1 is a diagram illustrating a data structure used in a method for recording image data according to the first embodiment; [Figure 6A] 1 is a flowchart for explaining a search operation in the digital camera according to the first embodiment. [Figure 6B] 1 is a flowchart illustrating a readback process in the digital camera according to the first embodiment; [Figure 7] FIG. 13 is a diagram illustrating an example of the type of image data recorded in the second embodiment; [Figure 8] Table showing examples of evacuation decision conditions in the second embodiment [Figure 9] 11 is a flowchart illustrating a readback process in the digital camera according to the second embodiment. [Figure 10] A flowchart for explaining the operation when the power is turned off in the digital camera according to the third embodiment. [Figure 11] A flowchart for explaining the operation when the power is turned off in the digital camera according to the fourth embodiment. [Figure 12] A flowchart for explaining the operation when the power is turned on in the digital camera according to the fourth embodiment. [Figure 13] A flowchart for explaining a pre-recording operation in a digital camera according to a fifth embodiment. [Figure 14] FIG. 13 is a diagram for explaining a storage area in a digital camera according to a fifth embodiment. [Figure 15] 13 is a flowchart illustrating a buffering process in a pre-recording operation according to the fifth embodiment. [Figure 16] 13 is a flowchart illustrating a shooting and recording process in a pre-recording operation according to the fifth embodiment. [Figure 17] Flowchart for explaining the pre-recording operation in the digital camera according to the sixth embodiment [Figure 18]13 is a flowchart illustrating a buffering process in a pre-recording operation according to the sixth embodiment. [Figure 19] A flowchart illustrating a shooting and recording process in a pre-recording operation according to a sixth embodiment. [Figure 20] FIG. 13 is a diagram showing a configuration of a digital camera according to a modified example. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, the embodiments will be described in detail with reference to the drawings as appropriate. However, more detailed explanations than necessary may be omitted. For example, detailed explanations of already well-known matters or duplicate explanations of substantially identical configurations may be omitted. This is to avoid the following explanation becoming unnecessarily redundant and to facilitate understanding by those skilled in the art. Note that the applicant provides the accompanying drawings and the following explanation so that those skilled in the art can fully understand the present disclosure, and does not intend for them to limit the subject matter described in the claims.

[0011] (Embodiment 1) In the first embodiment, a digital camera that can accommodate a memory card will be described as an example of an imaging device according to the present disclosure. The present inventor has focused on the remarkable increase in read / write speeds in recording media such as memory cards in recent years, and has devised a method for recording image data in a digital camera that utilizes a recording medium in a previously unimaginable way.

[0012] 1. Configuration The configuration of the digital camera according to the first embodiment will be described with reference to FIG.

[0013] 1 is a diagram showing the configuration of a digital camera 100 according to this embodiment. The digital camera 100 of this embodiment includes an image sensor 115, an image processing engine 120, a display monitor 130, and a control unit 135. The digital camera 100 also includes a buffer memory 125, a card slot 140, a flash memory 145, an operation unit 150, and a USB connector 155. The digital camera 100 also includes, for example, an optical system 110 and a drive unit 112.

[0014] The optical system 110 includes a focus lens, a zoom lens, an optical image stabilization lens (OIS), an aperture, a shutter, etc. The focus lens is a lens for changing the focus state of a subject image formed on the image sensor 115. The zoom lens is a lens for changing the magnification of a subject image formed by the optical system. The focus lens, etc. are each composed of one or more lenses.

[0015] The driving unit 112 drives various lenses, an aperture, and a shutter in the optical system 110. The driving unit 112 includes a DC motor, a stepping motor, a servo motor, an ultrasonic motor, or the like.

[0016] The image sensor 115 captures an image of a subject formed via the optical system 110 and generates RAW data. The RAW data is an example of imaging data that indicates an image captured by the image sensor 115 using pixel values ​​in a Bayer array. The image sensor 115 generates RAW data of a new frame at a predetermined frame rate (e.g., 30 frames / second), for example. The timing of generating the RAW data and the electronic shutter operation in the image sensor 115 are controlled by the control unit 135. The image sensor 115 can use various image sensors, such as a CMOS image sensor, a CCD image sensor, or an NMOS image sensor.

[0017] The image sensor 115 performs operations such as capturing still images and capturing through images. The through images are mainly moving images, and are displayed on the display monitor 130 so that the user can determine a composition for capturing a still image. The through images and still images are each an example of a captured image in this embodiment. The image sensor 115 is an example of an imaging section in this embodiment.

[0018] The image processing engine 120 performs various processes on the imaging data output from the image sensor 115 to generate image data, or performs various processes on the image data to generate an image to be displayed on the display monitor 130. The various processes include, but are not limited to, YC conversion, white balance correction, gamma correction, electronic zoom, compression, and expansion. The image processing engine 120 may be configured with a hardwired electronic circuit, or may be configured with a microcomputer, processor, or the like using a program. The image processing engine 120 is an example of an image processing unit in this embodiment.

[0019] The display monitor 130 is an example of a display unit that displays various information. For example, the display monitor 130 displays an image (through image) represented by image data captured by the image sensor 115 and processed by the image processing engine 120. The display monitor 130 also displays a menu screen or the like that allows the user to perform various settings on the digital camera 100. The display monitor 130 can be configured, for example, by a liquid crystal display device or an organic EL device.

[0020] Operation unit 150 is a general term for hard keys such as operation buttons and operation levers provided on the exterior of digital camera 100, and accepts operations by the user. Operation unit 150 includes, for example, a release button, a mode dial, and a touch panel. When operation unit 150 accepts an operation by the user, it transmits an operation signal corresponding to the user operation to control unit 135.

[0021] The control unit 135 centralizes and controls the operation of the entire digital camera 100. The control unit 135 includes a CPU and the like, and the CPU executes a program (software) to realize a predetermined function. Instead of a CPU, the control unit 135 may include a processor configured with a dedicated electronic circuit designed to realize the predetermined function. That is, the control unit 135 can be realized by various processors such as a CPU, MPU, GPU, DSU, FPGA, and ASIC. The control unit 135 may be configured with one or more processors. Furthermore, the control unit 135 may be configured as a single semiconductor chip together with the image processing engine 120 and the like.

[0022] The buffer memory 125 is an example of a volatile storage unit that functions as a work memory for the image processing engine 120 and the control unit 135. The buffer memory 125 is realized by a dynamic random access memory (DRAM) or the like. The flash memory 145 is a non-volatile storage medium in which various programs and the like are stored. Although not shown, the control unit 135 may have various internal memories, for example, a built-in ROM. The ROM stores various programs executed by the control unit 135. The control unit 135 may also have a built-in RAM (an example of a storage unit) that functions as a work area for the CPU.

[0023] The card slot 140 is a means for inserting a removable memory card 142. The card slot 140 is capable of electrically and mechanically connecting to the memory card 142, and is an example of an interface unit in this embodiment.

[0024] The memory card 142 is an external memory equipped with an internal recording element such as a flash memory, and is an example of a non-volatile recording medium. The memory card 142 can store data such as image data generated by the image processing engine 120. The memory card 142 is, for example, a CFexpress card, an SDexpress card, an SD card, or an XQD card, and has a predetermined read / write speed (for example, 1 GB / sec or faster). The digital camera 100 may be provided with an indicator such as a dedicated LED that notifies whether communication with the memory card 142 is in progress.

[0025] The USB connector 155 is an interface module (circuit) that connects to a USB connector of another device via a USB cable. The control unit 135 can transmit and receive various data to and from other devices via the USB connector 155 and the USB cable. The USB connector 155 is an example of an interface unit that transmits and receives data to and from an external storage device such as an SSD drive, which is an example of a recording medium. The interface unit is not limited to the USB standard, and may transmit and receive data in accordance with various communication standards. The digital camera 100 may be communicatively connected to an external device by a so-called tether connection or the like in various wired or wireless communication methods.

[0026] 2. Operation The operation of digital camera 100 configured as above will now be described.

[0027] 2-1. Overall operation The overall operation of the digital camera 100 according to this embodiment during continuous shooting will be described with reference to Fig. 2. Fig. 2 shows a schematic diagram of the operation sequence of each part of the digital camera 100 during continuous shooting.

[0028] During continuous shooting, the digital camera 100 repeats image capturing operations at a predetermined continuous shooting interval T0 in the image sensor 115, and sequentially generates RAW data showing each captured image in a Bayer array as the result of each capture, as shown in Fig. 2. The continuous shooting interval T0 is a time interval of, for example, 1 / 10 to 1 / 50 seconds.

[0029] The RAW data for each of the multiple imaging operations is sequentially written, for example, into buffer memory 125 as an input to image processing engine 120 (S1-1 to S1-(n+2)). Hereinafter, steps S1-1 to S1-(n+2) for each of the operations will be collectively referred to as step S1 (the same applies to S2 to S7 below). A writing period T1 to buffer memory 125 required for one step S1 is set according to the writing speed of buffer memory 125 and the amount of RAW data, and is shorter than, for example, the continuous shooting interval T0.

[0030] In the example of FIG. 2, the image processing engine 120 sequentially performs image processing (S2-1 to S2-3) for developing the RAW data input initially (S1-1 to S1-3). In this embodiment, an example will be described in which JPEG data is generated from the RAW data as an example of image data for recording by the image processing of step S2. The processing period T2 required for one step S2 is set according to the amount of input data and the processing speed of the image processing, and the longer it is, for example, the larger the amount of RAW data representing one captured image. For example, the processing period T2 can be longer than the continuous shooting interval T0.

[0031] The JPEG data obtained by each image processing (S2-1 to S2-3) is written to the memory card 142 (S3-1 to S3-3). The period T3 required for one writing in step S3 is set according to the writing speed of the memory card 142 and the amount of JPEG data. In this embodiment, it is assumed that the writing period T3 to the memory card 142 is shorter than the continuous shooting interval T0 (and the processing period T2) and longer than the writing period T1 to the buffer memory 125.

[0032] During continuous shooting in steps S1 to S3 as described above, RAW data is input more frequently than the image processing engine 120 outputs JPEG data, so the amount of data stored in the buffer memory 125 continues to increase. This may result in a situation where the free space in the buffer memory 125 required to continue continuous shooting is insufficient, that is, the buffer memory 125 is depleted, making it difficult to continue continuous shooting. In this case, the shooting operation may stop, resulting in a loss of a shooting opportunity, or the duration of continuous shooting or the number of consecutive shots may be limited.

[0033] Therefore, in the digital camera 100 of this embodiment, a method for recording image data that utilizes the memory card 142 as a data buffer is provided as follows. In the recording method of this embodiment, the digital camera 100 saves RAW data to the memory card 142 as a data buffer, for example, when shooting in a first state in which a predetermined saving condition is satisfied. The saving condition is a condition for saving RAW data to the memory card 142, and is set appropriately from the viewpoint of avoiding exhaustion of the buffer memory 125, for example. Furthermore, in a second state in which the saving condition is released after the RAW data is saved, the digital camera 100 reads back the saved RAW data, executes image processing for development such as JPEG conversion, and records the development result in the memory card 142.

[0034] 2 shows an example in which the first state in which the save condition is satisfied occurs immediately before step S1-n. In this example, digital camera 100 writes RAW data from the nth time onwards (S1-n to S1-(n+2)) to memory card 142 and saves it from buffer memory 125 (S4-1 to S4-3). A period T4 during which data is written to memory card 142 in one step S4 is shorter than, for example, the continuous shooting interval T0.

[0035] 2 goes into a second state in which the saving condition is cleared immediately before step S5-1. Digital camera 100 then reads back the RAW data saved from memory card 142 (S5-1). Digital camera 100 performs image processing on the read back RAW data similar to that in step S2 (S6-1), and writes the resulting JPEG data to memory card 142 similar to that in step S3 (S7-1).

[0036] According to the above operations of steps S4 to S7, RAW data is saved during continuous shooting (S4), making it easier to avoid depletion of buffer memory 125. This makes it possible to extend the duration of continuous shooting and ease the limit on the number of consecutive shots. Also, the saved RAW data can be read back (S5 to S7) at any time, for example, during or after shooting, when there is sufficient free space in buffer memory 125.

[0037] The process during shooting (S1 to S4) and the read-back process (S5 to S7) in the overall operation of the digital camera 100 will be described below.

[0038] 2-2. Processing during shooting FIG. 3 is a flowchart illustrating a process performed by the digital camera 100 of this embodiment when photographing an image.

[0039] 3 illustrates an example of processing executed by control unit 135 of digital camera 100 during the operation of steps S1 to S4 performed for one imaging operation of image sensor 115 during continuous shooting, for example. The processing illustrated in this flowchart starts when, for example, the release button of operation unit 150 is pressed in a state in which memory card 142 has a predetermined amount or more of free space (an example of a saving condition), or at each period such as continuous shooting interval T0 while the release button is pressed. The predetermined amount is set to, for example, equal to or greater than the amount of RAW data, from the viewpoint of enabling the saving of RAW data.

[0040] In the flowchart of Fig. 3, first, the control unit 135 performs a release process to cause the image sensor 115 to perform one imaging operation (S11). In the release process, the control unit 135 performs exposure control using an electronic shutter or a mechanical shutter. At this time, the image sensor 115 outputs RAW data indicating one captured image, which is one shot. The process of step S11 is repeated at each continuous shooting interval T0 during continuous shooting.

[0041] Next, the control unit 135 acquires the RAW data output from the image sensor 115, and performs control to write the RAW data into the buffer memory 125 (S12). The process of step S12 corresponds to step S1 in FIG.

[0042] Thereafter, the control unit 135 judges whether or not the free space remaining in the buffer memory 125 without being written is equal to or larger than a predetermined threshold (S13). The threshold is set to a reference data amount for saving RAW data in order to avoid exhaustion of the free space. In this example, the free space in the buffer memory 125 being less than the threshold is an example of a saving condition.

[0043] In step S13, for example, RAW data of a plurality of captured images in continuous shooting may be waiting for image processing (S2 in FIG. 2) and accumulated in the buffer memory 125. The judgment in step S13 is made to determine whether or not to save the RAW data.

[0044] For example, if the free space is equal to or greater than the threshold (YES in S13), it is considered that the buffer memory 125 will not be depleted even if the RAW data is not saved. In this case, the control unit 135 executes image processing for developing the target RAW data in the buffer memory 125, and creates, for example, a JPEG file (S14).

[0045] The image processing in step S14 corresponds to step S2 in Fig. 2, and includes, for example, de-Bayer and JPEG compression processing. The image processing may include various processes that the image processing engine 120 can execute, such as YC conversion processing. Various information for development used to execute such processing is stored, for example, in the buffer memory 125. The image processing engine 120 performs image processing on the RAW data stored in the buffer memory 125 sequentially while appropriately referring to the information, to generate, for example, JPEG data. The control unit 135 sets a file name using a number according to the shooting order according to, for example, the DCF standard, and adds a header section to the JPEG data to create a JPEG file (S14).

[0046] 2, the control unit 135 performs control to write the created JPEG file to the memory card 142 (S15). The control unit 135 transmits a write command and the like to the memory card 142 via the card slot 140.

[0047] On the other hand, if the free space is less than the threshold value (NO in S13), it is considered better to save the RAW data in order to avoid exhaustion of the buffer memory 125. In this case, the control unit 135 does not perform the process of step S14, and instead manages the development information related to the RAW data to be processed that is to be saved (S16).

[0048] The development information is various information used when performing image processing for developing the saved RAW data afterwards, and includes, for example, image vertical and horizontal sizes, format, color arrangement information, recording format, image quality correction parameters, etc. In step S16, the control unit 135 acquires, as the development information to be managed, for example, various information to be used by the image processing engine 120 when the processing of step S14 is performed on the RAW data to be processed, and stores it in the buffer memory 125. The data structure used for management in step S16 will be described later.

[0049] Next, the control unit 135 performs control to write the RAW data to be processed to the memory card 142 by a write command or the like via the card slot 140, corresponding to step S4 in FIG. 2 (S17).

[0050] In step S17, for example, the RAW data is written to the memory card 142 in a file format (dedicated for saving) different from a complete RAW file. For example, the control unit 135 includes in the file name at the time of saving a number according to the shooting order as a reservation for the file name at the time of development. This reservation number may be included in the development information. In addition, the development information may be held and managed in the buffer memory 125, or may be written to the memory card 142 in association with the RAW data in step S17. In addition, the saved RAW data files may be stored together in a folder dedicated for saving on the memory card 142.

[0051] When the control unit 135 controls writing to the memory card 142 in step S15 or step S17, the process shown in the flowchart of Fig. 3 ends. The control unit 135 executes the process shown in this flowchart, for example, for the number of shots taken in continuous shooting.

[0052] According to the above-described processing during shooting, before the free space in the buffer memory 125 runs out (NO in S13), the undeveloped RAW data is saved to the memory card 142 (S16, S17), thereby preventing the free space from running out.

[0053] Also, as long as there is sufficient free space (YES in S13), JPEG files are created and recorded (S14, S15) without saving the RAW data to the memory card 142. This avoids a situation in which the amount of data written to the memory card 142 increases too much due to excessive saving, and allows efficient processing from shooting to recording.

[0054] In the above step S13, an example has been described in which the free space of the buffer memory 125 is used as an example of a condition for determining whether or not to save the RAW data, but the condition for saving, i.e., the condition for saving, is not particularly limited to this. For example, the number of images shot during continuous shooting may be used as a condition for saving during continuous shooting. For example, the control unit 135 may proceed to YES in step S13 if the number of consecutive imaging operations during continuous shooting is less than a predetermined number, and proceed to NO in step S13 and perform saving (S4) if the number of consecutive imaging operations is equal to or greater than the predetermined number. The predetermined number can be set appropriately from the viewpoint of avoiding exhaustion of the buffer memory 125, etc.

[0055] The type of memory card 142 connected to the digital camera 100 may also be used as the saving condition. Such a modified example is shown in Fig. 4. Fig. 4 is a table illustrating the saving decision conditions in a modified example of this embodiment. In this example, saving / not saving is classified according to the type of memory card 142. As exemplified in Fig. 4, saving of RAW data (S4) may be executed when a memory card 142 having a relatively high writing speed is inserted into the card slot 140.

[0056] 2-2-1. Incomplete RAW files The data structure used for management in step S16 above will be described with reference to Fig. 5. Fig. 5 illustrates an example of a data structure used in the image data recording method of this embodiment.

[0057] Fig. 5A shows an example of a data structure used in this method. The data structure shown in Fig. 5A is composed of an incomplete RAW file 50 that includes both the RAW data to be saved and management information such as development information.

[0058] The incomplete RAW file 50 is not a final file format to be provided to the user, but is a file in a format that stores RAW data for temporary saving. Hereinafter, a file in a format that has been developed and image processed and can be referenced by the user, such as a JPEG file, is referred to as a "complete file." The incomplete RAW file 50 has a dedicated extension that is different from various complete files (e.g., ".bayer"). The incomplete RAW file 50 is an example of a file format, that is, an incomplete file, that manages imaging data in a recording medium such as the memory card 142 in a saving state in which image processing on imaging data such as RAW data has not been completed.

[0059] The incomplete RAW file 50 of this example includes a main body section 52 in which RAW data to be saved is stored, and a management information section 51 that constitutes, for example, a header section of the incomplete RAW file 50. The management information section 51 includes developing information and header information as an example of management information related to the incomplete RAW file 50.

[0060] The development information in the management information section 51 includes various parameters that are preset for image processing for developing the incomplete RAW file 50 into image data of a preset complete file. The header information is information that constitutes the header section of the complete file after development, and includes, for example, exif information obtained based on the time when the incomplete RAW file 50 was shot.

[0061] 5A is used, the control unit 135 generates the management information section 51 in step S16, and saves the RAW data by recording the incomplete RAW file 50 on the memory card 142 in step S17. According to the data structure of this example, the RAW data to be saved and management information such as its development information are combined into one incomplete RAW file 50, so that the RAW data to be saved is managed in association with the management information. This data structure makes it possible to realize a new recording method for temporarily saving RAW data as in this embodiment.

[0062] The data structure for managing the saved RAW data as described above is not limited to the example shown in Fig. 5(A). Fig. 5(B) shows another example of the data structure used in this method.

[0063] The data structure illustrated in Fig. 5(B) manages the saved RAW data using two files: an incomplete RAW file 60 and a management information file 61. The incomplete RAW file 60 in this example corresponds to the main body portion 52 of the incomplete RAW file 50 in the example of Fig. 5(A). The management information file 61 corresponds to the management information portion 51.

[0064] In this example, the control unit 135 generates a management information file 61 in step S16, and records an incomplete RAW file 60 consisting of the RAW data to be saved on the memory card 142 in step S17. At this time, the management information file 61 may be stored in the memory card 142 or in the buffer memory 125.

[0065] 5B, the incomplete RAW file 60 and the management information file 61 are associated with each other by, for example, the control unit 135 giving the files 60 and 61 the same file name excluding the file extension, or by including information for identifying the incomplete RAW file 60 in the management information file 61. By managing in this manner, when developing the saved RAW data later, the management information file 61 associated with the incomplete RAW file 60 can be referenced, and the desired complete file can be obtained.

[0066] 2-3. Readback processing and search operations 2 and the search operation for searching for the saved RAW data in order to execute the read-back process will be described below with reference to Figures 6A and 6B. Figure 6A is a flowchart for explaining the search operation in digital camera 100 of this embodiment. Figure 6B is a flowchart illustrating the read-back process in this embodiment.

[0067] The flowchart shown in Fig. 6A starts during or after a shooting operation such as continuous shooting, for example. Each process shown in the flowcharts of Fig. 6A and 6B corresponds to steps S5 to S7 in Fig. 2 which are performed for each piece of RAW data of a captured image, and is executed by, for example, the control unit 135 of the digital camera 100. The process of the flowchart in Fig. 6A is executed repeatedly, for example, at a predetermined cycle.

[0068] In the flowchart of Fig. 6A, the control unit 135 searches the memory card 142 to determine whether or not there is saved RAW data (S201). For example, the control unit 135 searches for a file having an identifier of the saved RAW data, such as an extension for an incomplete RAW file, among the files stored in the memory card 142. Alternatively, the control unit 135 may search for the presence or absence of saved RAW data based on whether or not a data file is stored in a folder dedicated to saving in the memory card 142. The search in step S201 may also be performed by, for example, referring to the development information managed in step S16 of Fig. 3.

[0069] The control unit 135 determines whether or not there is saved RAW data based on the search result of step S201 (S202). If it is determined that there is saved RAW data (YES in S202), a read-back process is executed to develop one sheet of RAW data (S203). The read-back process (S203) in this embodiment is illustrated in FIG. 6B.

[0070] In the readback process (S203) illustrated in Fig. 6B, first, the control unit 135 judges whether the free space of the buffer memory 125 is equal to or larger than a predetermined threshold (S21). The threshold in step S21 is set from the viewpoint of ensuring free space that can prevent the buffer memory 125 from running out even when RAW data is read back, and is set to, for example, equal to or larger than the threshold in step S13 in Fig. 3.

[0071] When the free space in the buffer memory 125 is not equal to or greater than the threshold (NO in S21), the control unit 135 performs the determination in step S21, for example, at a predetermined interval. As a result, the readback of the RAW data (S5 in FIG. 2) is put on hold until the free space in the buffer memory 125 is secured.

[0072] When the free space of the buffer memory 125 is equal to or greater than the threshold value (YES in S21), the control unit 135 performs control to read the saved RAW data from the memory card 142 to the buffer memory 125 (S22). The control unit 135 transmits a read command or the like from the card slot 140 to the memory card 142.

[0073] The process of step S22 corresponds to step S5 in Fig. 2. The order read out in step S22 may be, for example, ascending or descending order of the numbers included in the file names, or may be another order. In the following, an example will be described in which JPEG is specified as the recording format in the development information corresponding to the read RAW data.

[0074] The control unit 135, corresponding to step S6 in Fig. 2, causes the image processing engine 120 to perform image processing on the read RAW data to create a JPEG file (S23). The processing of step S23 is performed in the same manner as step S14 in Fig. 3 by appropriately referring to the managed development information. In addition, a reservation number such as the file name before development is used for the file name after development. This makes it possible to reproduce the shooting order even in the case of subsequent development.

[0075] Next, the control unit 135 performs control to write the JPEG file generated by the image processing engine 120 to the memory card 142 by transmitting a write command via the card slot 140, corresponding to step S7 in FIG. 2 (S24).

[0076] Furthermore, the control unit 135 erases the RAW data that has been subjected to the above processing and the corresponding information for development in the memory card 142 (S25). After that, the read-back processing (S203) shown in Fig. 6B and the processing shown in the flowchart of Fig. 6A are terminated.

[0077] Returning to Fig. 6A, when the control unit 135 determines that there is no RAW data saved in the memory card 142 (NO in S202), the control unit 135 ends the process of the flowchart in Fig. 6A. The control unit 135 executes the process of this flowchart again, for example, at a predetermined cycle.

[0078] According to the above search operation and read-back process, after the RAW data is saved to the memory card 142 (S4 in FIG. 2), the existence of the saved incomplete RAW file can be detected after the fact, and the saved incomplete RAW file can be developed into a complete image file at an appropriate timing. For example, after the continuous shooting operation is completed, or even during the operation, when there is sufficient free space (YES in S21), the saved RAW data is developed and recorded (S22 to S24). Even if a plurality of RAW data are saved, the saved RAW data can be developed sequentially by repeating the process of the flowchart in FIG. 6A and then FIG. 6B.

[0079] 3. Summary As described above, in this embodiment, the digital camera 100, which is an example of an imaging device, includes the image sensor 115, which is an example of an imaging section, the buffer memory 125, which is an example of a storage section, the image processing engine 120, which is an example of an image processing section, the card slot 140, which is an example of an interface section, and the control section 135. The image sensor 115 captures an image of a subject and generates RAW data, which is an example of imaging data. The buffer memory 125 temporarily stores the imaging data. The image processing engine 120 executes image processing on the imaging data and generates JPEG data, etc., as an example of image data. The card slot 140 is detachably connected to the memory card 142, which is an example of an external recording medium. The control section 135 records the image data in the memory card 142. When the memory card 142 is connected to the card slot 140 and the image sensor 115 captures an image (S1), the control section 135 writes the imaging data to the memory card 142 (S4). The control unit 135 reads out the imaging data from the memory card 142 (S5), causes the image processing engine 120 to execute image processing (S6), and records the image data obtained by the image processing on the memory card 142 (S7).

[0080] According to the digital camera 100 described above, by saving the image data to the memory card 142 when shooting, it is possible to avoid a situation in which the processing load becomes excessive, such as buffer depletion, and to facilitate recording of image data in the digital camera 100, in which the memory card 142 is detachable.

[0081] In this embodiment, when the image sensor 115 captures an image in a first state that satisfies the save condition for saving the imaging data to the memory card 142 (S1-n to S1-(n+2)), the control unit 135 writes the imaging data to the memory card 142 (S4-1 to S4-3). At this time, the saved imaging data can be read back (S5) as appropriate, for example, when the state is not the first state.

[0082] In this embodiment, in the first state in which RAW data can be saved during continuous shooting or the like, the time interval T0 during which the image sensor 115 continuously captures images is equal to or longer than the period T4 during which the image data from one capture is written to the memory card 142. This makes it possible to save the image data faster than it is input, making it easier to solve buffer depletion.

[0083] In this embodiment, the buffer memory 125 has a write speed faster than that of the memory card 142. When the image sensor 115 captures an image in a second state different from the first state (S1-1 to S1-3), the control unit 135 holds the captured image data in the buffer memory 125, causes the image processing engine 120 to execute image processing (S2-1 to S2-3), and records the image data obtained by the image processing in the memory card 142 (S3-1 to S3-3). This makes it possible to efficiently record the image data without saving the captured image data excessively.

[0084] In this embodiment, the first state may be a state in which the free space in the buffer memory 125 is less than a predetermined threshold value (NO in S13). The second state may be a state in which the free space is equal to or greater than the threshold value (NO in S13). The first and second states may be defined based on at least one of the number of consecutive imaging operations (number of shots) and the type of memory card 142 connected to the card slot 140.

[0085] In this embodiment, when the free space in the buffer memory 125 is equal to or greater than a predetermined threshold value (YES in S21), the control unit 135 reads out the captured image data from the memory card 142 (S22) and causes the image processing engine 120 to execute image processing (S24). As a result, image processing for generating image data is performed when there is sufficient free space, and the image data can be recorded efficiently.

[0086] In this embodiment, the imaging data written to the memory card 142, i.e., the saved RAW data, is managed in the data structure of the incomplete RAW files 50, 60 that associates the imaging data with management information such as development information including image processing parameters for generating image data of a complete file from the imaging data (FIGS. 5(A) and (B)). This allows for a recording method in which the saved RAW data can be developed later, and image data can be recorded efficiently.

[0087] In this embodiment, there is provided a method for recording image data in digital camera 100 to which memory card 142 can be detachably attached. This method includes a step (S1) of capturing an image of a subject and generating captured image data when memory card 142 is connected to digital camera 100, a step (S4) of writing the captured image data to memory card 142, a step (S5) of reading the captured image data from memory card 142, a step (S6) of performing image processing on the captured image data to generate image data, and a step (S7) of recording the image data obtained by the image processing on memory card 142.

[0088] The above-described method of recording image data makes it easy to record image data in the digital camera 100 to which the memory card 142 can be attached and detached. This embodiment provides a program for causing the control unit 135 of the digital camera 100 to execute the above-described method of recording image data. This program may be provided by being stored in various storage media such as the flash memory 145, or may be provided via a communications network.

[0089] The digital camera 100 in this embodiment is an example of an imaging device capable of recording data in a memory card 142 as an example of an external non-volatile recording medium. The digital camera 100 includes an image sensor 115 as an example of an imaging section, a buffer memory 125, an image processing engine 120 as an example of an image processing section, and a control unit 135. The control unit 135 searches the memory card 142 to determine whether or not there is imaging data saved from the buffer memory 125 (S201). If the control unit 135 finds that there is saved imaging data (YES in S202), it reads the saved imaging data into the buffer memory 125 and causes the image processing engine 120 to execute image processing for developing the imaging data (S203). This allows the imaging data saved in the memory card 142 to be searched for later, making it easier to record image data.

[0090] In this embodiment, the control unit 135 writes the imaging data to the memory card 142 in a file format for managing the imaging data in the memory card 142, that is, in an incomplete file, as a state in which the imaging data is in an evacuation state in which image processing for the imaging data is not completed, and evacuates the imaging data from the buffer memory 125. By using such an incomplete file, it is possible to facilitate recording of image data.

[0091] (Embodiment 2) In the first embodiment, an example in which the JPEG format is used as the recording format of image data has been described, but other recording formats, such as the RAW format, may be used. In the second embodiment, a method of recording image data using various recording formats including the RAW format will be described.

[0092] Hereinafter, the description of the configuration and operation similar to those of the digital camera 100 according to the first embodiment will be omitted as appropriate, and the digital camera 100 according to this embodiment will be described.

[0093] FIG. 7 illustrates the types of image data recorded in this embodiment. The method of recording image data in this embodiment can employ various recording formats such as JPEG, RAW, and HLG as the recording format of image data. A file in each recording format includes, for example, a header section and a body section. For example, the body section of a JPEG file includes compressed JPEG data. The body section of a RAW file includes RAW data (image capture data) in a Bayer array. Furthermore, the RAW file includes JPEG data for thumbnails in addition to the header section and body section.

[0094] When recording various kinds of image files that can ultimately be viewed by the user in part or in whole during shooting, the same problems as those described above may occur due to the processing time and processing load required for each. In contrast, according to the image data recording method of the present embodiment, the processing load during shooting can be reduced by saving the captured image data, and the above problems can be solved.

[0095] The image data recording method of this embodiment is not necessarily limited to still images, but may be applied to moving images. For example, moving image files in various recording formats such as MOV and MP4 are examples of image data in this embodiment. Also, the various files illustrated in FIG. 7 are each examples of complete files. Furthermore, various formats such as TIFF or PNG can be applied instead of JPEG.

[0096] In addition, in the image data recording method of this embodiment, a plurality of recording formats may be used in combination, for example, a RAW file and a JPEG file may be created for one piece of captured image data. The user can set such a recording format by operating the operation unit 150 using, for example, a setting menu in the digital camera 100.

[0097] In the first embodiment, the judgment conditions for whether or not to save the imaging data are exemplified in step S13 in Fig. 3, but various items in the setting menu may be used for such judgment. An example of the judgment conditions for saving in this embodiment will be described with reference to Fig. 8.

[0098] 8 illustrates a table that specifies the decision conditions for evacuation in this embodiment. In this example, evacuation / not evacuation is classified according to the recording format of the image data, the operation mode related to continuous shooting of the digital camera 100, and various recording formats. As the operation modes, a single shot mode for normal shooting that is not continuous shooting, and a low-speed continuous shooting mode, a medium-speed continuous shooting mode, and a high-speed continuous shooting mode as various types of continuous shooting are illustrated. The continuous shooting interval in the low-speed continuous shooting mode is longer than that in the medium-speed continuous shooting mode. The continuous shooting interval in the high-speed continuous shooting mode is shorter than that in the medium-speed continuous shooting mode.

[0099] For example, by storing a table such as that shown in FIG. 8 in advance in flash memory 145 of digital camera 100, control unit 135 can refer to such table and determine whether or not to back up the data according to the information set in the setting menu.

[0100] The method of recording image data according to this embodiment can also be applied to normal still image shooting, not continuous shooting, such as the single shot mode illustrated in Fig. 8. Even in such a case, the user may give instructions to shoot at high speed, or the processing load for one shot may be large. In response to this, by performing the same process as that shown in Figs. 3 and 5 of the first embodiment, the imaging data can be saved during shooting, and the image data can be easily recorded afterwards.

[0101] In the method for recording image data according to this embodiment, when imaging data is saved, the development information is managed (S16 in FIG. 3) in the same manner as the process during shooting according to embodiment 1. At this time, the control unit 135 can set the recording format of the development information by referring to the setting information in the setting menu, for example.

[0102] Fig. 9 is a flow chart illustrating the read-back process in the digital camera 100 of this embodiment. In the read-back process of this example, in addition to the same processes as in the first embodiment (S21 to S25 in Fig. 6B), the control unit 135 references the development information to determine the recording format for developing the read-back RAW data (S22b). Fig. 9 illustrates, as an example, a flow when the recording format is (i) JPEG or (ii) RAW.

[0103] If the recording format is JPEG (S22b(i)), the same processing as that from step S23 onward in the first embodiment is performed. On the other hand, if the recording format is RAW (S22b(ii)), the control unit 135 creates a RAW file from the read-back RAW data (S23b) instead of steps S23 and S24, and writes it to the memory card 142 (S24b). In step S23b, the control unit 135 causes the image processing engine 120 to execute image processing for generating JPEG data for a thumbnail, or adds a header section to the main body of the RAW file as the above-mentioned RAW data. Although not shown in the figures, image files can be created in the same manner as above for other recording formats.

[0104] In the digital camera 100 of this embodiment, the first state in which the captured image data can be saved may be defined based on the imaging operation mode, such as single shooting or continuous shooting, and the recording format of the image data, etc. The first state can also be defined by any one or a combination of the number of shots, the type of recording medium such as the connected memory card 142, the operation mode, and the recording format of the image data.

[0105] (Embodiment 3) In each of the above embodiments, an example has been described in which the read-back process of the saved imaging data is started during or after the digital camera 100 is in operation (see FIG. 6A), but the start timing of the read-back process is not particularly limited to this. In the third embodiment, an example of the read-back process when the power is turned off (shut off) will be described with reference to FIG.

[0106] Hereinafter, the description of the configuration and operation similar to those of the digital camera 100 according to the first and second embodiments will be omitted as appropriate, and the digital camera 100 according to this embodiment will be described.

[0107] 10 is a flowchart for explaining the operation when the power is turned off in the digital camera 100 of the third embodiment. In this embodiment, the control unit 135 detects an instruction to turn off the power (i.e., an instruction to stop operation) based on, for example, a user operation input in the operation unit 150 (S30). The detection in step S30 may be performed based on, for example, the remaining battery power in the digital camera 100.

[0108] In this embodiment, when the control unit 135 detects an instruction to power off the digital camera 100 (YES in S30), it stops some operations in the digital camera 100, including the display monitor 130 (S31). On the other hand, the supply of power to the parts used for the readback process, such as the communication system with the memory card 142, is maintained at the time of step S31.

[0109] For example, the control unit 135 stops the supply of power to components that consume relatively large amounts of power, such as the display monitor 130 and the image sensor 115 (S31). For example, a user who has performed a power-off operation can recognize that the power to the digital camera 100 has been turned off based on the fact that the display monitor 130 has stopped operating and is in an off state.

[0110] Next, the control unit 135 searches the memory card 142 (S32) and determines whether or not there is saved RAW data (S33), for example, in the same manner as in steps S201 and S202 of Fig. 6A. If there is saved RAW data (YES in S33), the control unit 135 performs a read-back process similar to each of the above embodiments (S34), and returns to step S32.

[0111] Through steps S32 to S34, with the display monitor 130 turned off (S31), all RAW data saved to the memory card 142 after the power-off instruction is read back, and the corresponding image data is recorded on the memory card 142. At this time, from the viewpoint of preventing a situation in which the memory card 142 is erroneously removed, the control unit 135 may turn on an LED or the like for the memory card 142 while steps S32 to S34 are being executed.

[0112] When there is no more saved RAW data (NO in S20), the control unit 135 performs a termination process to end the operation of the entire digital camera 100 (S35). For example, the power supply to the parts that were maintained at the time of step S31 is stopped. After executing the termination process (S35), the control unit 135 ends the process shown in this flowchart. This causes the power of the digital camera 100 to be turned off.

[0113] According to the above process, it is possible to convert all RAW data saved in the memory card 142 into image data for recording without leaving it after the power is turned off. By stopping the operation of the display monitor 130 and the like during this conversion (S31), it is possible to reduce the user's dissatisfaction at having to wait for the power to be turned off. Note that the process of step S31 may be omitted, and for example, the operation of the display monitor 130 and the like may be stopped at the point of step S35.

[0114] As described above, when an instruction to stop the operation of the digital camera 100 is input, for example, before image processing for development (YES in S30), the control unit 135 may read the imaging data from the memory card 142 and cause the image processing engine 120 to perform image processing (S34).

[0115] The digital camera 100 of this embodiment may further include a display monitor 130, which is an example of a display unit that displays an image. When the power is turned off in a state where the imaging data has been saved from the buffer memory 125 to the memory card 142 (YES in S30), the control unit 135 stops the operation of the display monitor 130 (S31). With the operation of the display monitor 130 stopped, the control unit 135 causes the image processing engine 120 to execute image processing for development (S34). The control unit 135 records image data obtained by the image processing in the memory card 142, and then ends the operation of the digital camera 100 (S35). In this way, when image processing for development is executed while the power is off, the display monitor 130 is turned off, and it is possible to suppress the user's dissatisfaction that may occur when the power is off.

[0116] (Embodiment 4) In the third embodiment, an example of operation has been described in which all saved RAW data is developed by read-back processing when the power is turned off of the digital camera 100. In the fourth embodiment, an example of operation in which the power can be turned off flexibly will be described with reference to FIGS.

[0117] Hereinafter, the description of the configuration and operation similar to those of the digital cameras 100 according to the first to third embodiments will be omitted as appropriate, and the digital camera 100 according to this embodiment will be described.

[0118] Fig. 11 is a flowchart for explaining the operation when the power is turned off in the digital camera 100 of the fourth embodiment. Fig. 12 is a flowchart for explaining the operation when the power is turned on in this embodiment.

[0119] In the digital camera 100 of this embodiment, when the power is turned off, if it is deemed that too much time will be spent developing the incomplete RAW file saved to the memory card 142, the digital camera 100 turns off the power without developing the file. For example, when the power is turned on thereafter, the digital camera 100 develops the incomplete RAW file left on the memory card 142. This allows the digital camera 100 to be powered off swiftly.

[0120] 11 shows an example of operation in which the control unit 135 of the digital camera 100 of this embodiment performs the processes of steps S30 to S35 similar to those performed when the power is off in embodiment 3 (FIG. 10). At this time, for example, if there is saved RAW data (YES in S33), the control unit 135 determines whether the number of saved RAW data pieces is equal to or greater than a predetermined threshold (S36).

[0121] The threshold value in step S36 indicates a standard for the amount of data when the number of saved RAW data sheets is too large and development time is expected to be prolonged, and is set in advance, for example, in digital camera 100. The threshold value may be set by a user operation using a setting menu of digital camera 100, etc.

[0122] In this embodiment, when the control unit 135 determines that the number of saved RAW data is equal to or greater than the threshold value (YES in S36), it skips the read-back process (S34) and proceeds to the end process (S35). This allows the power to the digital camera 100 to be turned off without waiting for the development time, even if many incomplete RAW files have been saved to the memory card 142.

[0123] On the other hand, if the control unit 135 determines that the number of saved RAW data is less than the threshold value (NO in S36), the process proceeds to read-back processing (S34). As a result, if the development time of the RAW data saved to the memory card 142 is not long, the power of the digital camera 100 can be turned off after development.

[0124] 12 starts when a user performs an operation to turn on the power of the digital camera 100. First, the control unit 135 performs various processes for starting up the digital camera 100 (S41).

[0125] For example, after execution of the startup process (S41), the control unit 135 searches the memory card 142 to determine whether or not there is saved RAW data (S42), similar to the first embodiment (S201 in FIG. 6A). If the control unit 135 determines that there is saved RAW data (YES in S43), it performs a read-back process (S44), similar to each of the above embodiments. The processes from step S42 onwards are repeated, for example, until there is no saved RAW data left (NO in S43).

[0126] According to the above process, the power to the digital camera 100 is turned off in an instant, and the incomplete RAW file remaining in the memory card 142 when the power was turned off can be developed when the power is turned on thereafter.

[0127] In the above-described operation when the power is turned off, the threshold value in step S36 may be zero. When the power is turned off (YES in S31), the read back process (S34) may not be performed and the termination process (S35) may be performed.

[0128] Furthermore, the communication state between the digital camera 100 and an external device may be taken into consideration as to whether to prioritize the quick power-off as described above or to prioritize the development of the incomplete RAW file saved in the memory card 142. For example, if there is saved RAW data (YES in S33), and the digital camera 100 is in a state of being connected to an external PC or the like in a predetermined setting for so-called tethered shooting, the control unit 135 may proceed to the read-back process S34 without making the determination in step S36. The predetermined setting is, for example, a setting for automatically transferring an image file of the development result (i.e., a complete file) in a tethered connection. In this case, development may be prioritized, and the power may be turned off after the transfer of the development result is completed.

[0129] As described above, in digital camera 100 of this embodiment, when the power is turned off with the imaging data saved from buffer memory 125 to memory card 142 (YES in S30), control unit 135 ends the operation of digital camera 100 without performing image processing on the saved imaging data (S35). After the power is turned on thereafter, control unit 135 causes image processing engine 120 to execute image processing on the saved imaging data (S44). This allows digital camera 100 to be powered off flexibly even with the imaging data saved to memory card 142, making it easier to record image data in digital camera 100.

[0130] In this embodiment, when the power is turned off (YES in S30), if the amount of imaging data saved to the memory card 142 is less than a predetermined amount (NO in S36), the control unit 135 causes the image processing engine 120 to execute image processing on the saved imaging data (S34), but if the amount of saved imaging data is equal to or greater than the predetermined amount (YES in S36), the control unit 135 ends the operation of the digital camera 100 without performing image processing on the saved imaging data (S35).Therefore, if it is considered that development of the saved imaging data will take a long time, the image processing for development can be selectively skipped, making it easier to record the image data.

[0131] (Embodiment 5) In the fifth embodiment, an example in which a method of recording image data is applied to the pre-recording function of the digital camera 100 will be described with reference to FIGS.

[0132] Hereinafter, the description of the configuration and operation similar to those of the digital cameras 100 according to the first to fourth embodiments will be omitted as appropriate, and the digital camera 100 according to this embodiment will be described.

[0133] 1. Pre-recording function The pre-recording function of digital camera 100 is a function that records videos or still images including images captured before the user starts shooting. This function allows the user to prevent missing photo opportunities. For example, the user can enable or disable the pre-recording function by operating the setting menu of digital camera 100 or a specified button. Furthermore, when the pre-recording function is enabled, the period to be recorded going back from the command to start shooting (hereinafter referred to as the "pre-recording period") is set in advance by user operation, initial setting, etc.

[0134] 2. Pre-recording operation The operation for realizing the pre-recording function in the digital camera 100 of this embodiment will be described below.

[0135] Fig. 13 is a flowchart for explaining the pre-recording operation in the digital camera 100 of this embodiment. The process shown in the flowchart in Fig. 13 starts when the pre-recording function of the digital camera 100 has been enabled, for example, by a user operation.

[0136] First, the control unit 135 causes the image sensor 115 to perform an image capturing operation (S51), and performs a process of holding RAW data generated as an image capturing result of the image sensor 115, i.e., a buffering process (S52). The control unit 135 determines, for example, whether or not an instruction to start shooting has been input by a user operation on the operation unit 150 (S53). The instruction to start shooting may be for shooting a still image or may be for shooting a video.

[0137] When an instruction to start shooting has not been input (NO in S53), the control unit 135 repeats the processes of steps S51 to S53 at a predetermined cycle (for example, 1 / 30 to 1 / 60 seconds). In the case of shooting moving images, the predetermined cycle may be a preset frame cycle of the moving image. According to the buffering process (S52) repeated in steps S51 to S53, captured RAW data is sequentially accumulated before a user issues an instruction to start shooting (NO in S53).

[0138] In the buffering process (S52) of this embodiment, RAW data is stored not only in the buffer memory 125 but also in the memory card 142. This ensures a larger storage area for storing RAW data than when only the buffer memory 125 is used, and makes it possible to lengthen the time that can be traced back by the pre-recording function (i.e., the pre-recording period). The buffering process (S52) of this embodiment will be described in detail later.

[0139] When an instruction to start shooting is input (YES in S53), the control unit 135 executes a shooting and recording process to perform the instructed shooting (S54). In the shooting and recording process (S54), image data including the imaging result from the pre-recording period before the shooting start instruction is recorded based on the data held by the buffering process. The shooting and recording process (S54) will be described in detail later.

[0140] When the control unit 135 completes the shooting and recording process (S54), it ends the process shown in this flowchart.

[0141] According to the above process, it is possible to perform pre-recording operation with a long pre-recording period by storing data of the image capture result before an instruction to start shooting is issued in a storage area using memory card 142. The storage area in digital camera 100 of this embodiment will be described with reference to FIG.

[0142] 14, in the digital camera 100 of this embodiment, a storage area R1 for pre-recording and a storage area R10 for shooting are provided in the buffer memory 125. Furthermore, in the memory card 142, a storage area R2 for pre-recording and a storage area R20 for recording are provided.

[0143] The pre-recording storage areas R1, R2 in each memory 125, 142 are storage areas for accumulating RAW data in the buffering process (S52) of the pre-recording operation. The shooting storage area R10 in the buffer memory 125 is used as a work area for executing the shooting and recording process (S54). The recording storage area R20 in the memory card 142 stores the processing results of the shooting and recording process (S54).

[0144] The storage areas of the memories 125 and 142 are not particularly limited to those described above. For example, the buffer memory 125 may further be provided with a storage area for writing to or reading back from the storage area R2 for pre-recording of the memory card 142.

[0145] In the pre-recording operation of this embodiment, the storage area R2 for pre-recording in the memory card 142 can be set to be larger than the storage area R1 for pre-recording in the buffer memory 125. This makes it possible to extend the pre-recording period. The storage areas R1 and R2 for pre-recording are managed by dividing them into areas that can store, for example, one piece of RAW data.

[0146] The storage area R1 for pre-recording in the buffer memory 125 includes n divided areas R1a. Each divided area R1a in the buffer memory 125 is managed in association with an index i1=0 to n-1. The storage area R2 for pre-recording in the memory card 142 includes N divided areas R2a (for example, N>n). Each divided area R2a in the memory card 142 is managed in association with an index i2=0 to N-1.

[0147] In the buffering process (S52) of this embodiment, the pre-recording storage area R1 of the buffer memory 125 and the pre-recording storage area R2 of the memory card 142 are used in a ring buffer format. An example of such a process will be described below.

[0148] 2-1. Buffering process FIG. 15 is a flowchart illustrating the buffering process (S52 in FIG. 13) in the pre-recording operation of the present embodiment. The process shown in this flowchart is executed every time an imaging result is obtained (S51) before an instruction to start shooting in the pre-recording operation. Hereinafter, for example, in the buffer memory 125, the pre-recording indexes i1 and i2 of the respective memories 125 and 142 can be set in order from the initial value "0" to the end i1 = n and i2 = N, respectively, in order to specify the write destination.

[0149] First, the control unit 135 refers to the index i1 stored in the buffer memory 125, for example, and determines whether the pre-recording index i1 of the buffer memory 125 is at the end (i1 = n) (S61). If i1 < n (NO in S61), the control unit 135 records the RAW data captured in step S51 of FIG. 13 in the divided area R1a corresponding to the value of the index i1 in the pre-recording storage area R1 of the buffer memory 125 (S62).

[0150] Next, the control unit 135 increments the stored index i1, for example (S63). Thereafter, the control unit 135 ends the buffering process (S52 in FIG. 13) and proceeds to the process of step S53. As a result, in the next buffering process (S52), the RAW data of the new imaging result is recorded with reference to the incremented index i1.

[0151] When RAW data is recorded in all of the pre-recording divided areas R1a of the buffer memory 125, the pre-recording index i1 reaches the end i1 = n. If i1 = n (YES in S61), the control unit 135 refers to the pre-recording index i2 of the memory card 142 stored in the buffer memory 125, for example, and determines whether the index i2 is at the end (i2 = N) (S64).

[0152] When i2 < N (NO in S64), the control unit 135 records the RAW data captured in step S51 in the divided area R2a corresponding to the value of index i2 in the storage area R2 for pre-recording of the memory card 142 (S65). In step S65, the RAW data is recorded as an incomplete file during evacuation. Next, the control unit 135 increments the stored index i2 (S66) and ends the buffering process (S52 in FIG. 13).

[0153] For example, when the pre-recording index i1 of the buffer memory 125 reaches the end immediately (NO in S64), the new RAW data is recorded in the leading divided area R2a corresponding to i2 = 0 in the storage area R2 for pre-recording of the memory card 142 (S65). Also, for new RAW data after the next time until the index i2 reaches the end i2 = N (NO in S64), it is sequentially recorded in the storage area R2 for pre-recording of the memory card 142 (S65).

[0154] When i2 reaches N (YES in S64), the control unit 135 rewrites and initializes the stored indices i1 and i2 to the initial values "0" respectively (S67). At this time, the control unit 135 performs the process of step S62 on the leading divided area R1a corresponding to i1 = 0 in the storage area R1 for pre-recording of the buffer memory 125. In steps S62 and S65, when data is stored in the corresponding divided areas R1a and R2a, the control unit overwrites the new RAW data.

[0155] According to the above buffering process (S52), it is possible to continuously hold the RAW data of the imaging results from the current time within the range of the storage area R1 for pre-recording of the buffer memory 125 and the storage area R2 for pre-recording of the memory card 142.

[0156] In the above description, an example has been described in which the buffering process (S52) uses the storage areas R1 and R2 for pre-recording provided in each of the memories 125 and 142. The storage area R1 for pre-recording in the buffer memory 125 does not have to be provided, and the storage area R2 for pre-recording may be provided only in the memory card 142. In this case, the processes of steps S61 to S63 in the flowchart in FIG. 15 are omitted.

[0157] 2-2. Shooting and recording processing The shooting and recording process (S54) in the pre-recording operation in Fig. 13 will be described with reference to Fig. 16. The following describes the shooting and recording process (S54) in an example in which a command to start shooting a still image is input in step S53 in Fig. 13.

[0158] 16 is a flowchart illustrating the shooting and recording process (S54) in the pre-recording operation of this embodiment. The process shown in this flowchart is executed in a state where RAW data of the result of prior imaging is stored in the storage areas R1 and R2 for pre-recording in each of the memories 125 and 142.

[0159] First, the control unit 135 causes the image sensor 115 to perform an image capturing operation (S71) in accordance with an instruction to capture a still image (S53), and acquires RAW data of the captured image. The control unit 135 records the RAW data acquired in step S71 in, for example, the storage area R10 for capturing an image in the buffer memory 125 (S72).

[0160] Thereafter, the control unit 135 causes the image processing engine 120 to execute image processing such as development on the RAW data stored in the pre-recording memory area R1 of the buffer memory 125, and creates an image file of the captured image, such as a JPEG file (S73).

[0161] The control unit 135 also operates the image processing engine 120 on the RAW data stored in the pre-recording storage area R2 of the memory card 142 to create an image file (S74). The processing of step S74 is performed in the same manner as step S73, by reading the RAW data from the memory card 142 to the buffer memory 125.

[0162] The control unit 135 also operates the image processing engine 120 on the RAW data recorded in the shooting storage area R10 in the same manner as in step S73, and creates an image file (S75). The order of the processes in steps S73 to S75 is not particularly limited, and may be various orders.

[0163] Furthermore, the control unit 135 writes each of the image files created in steps S73 to S75 to the recording storage area R20 of the memory card 142 (S76). The file name of each image file includes a shooting order number according to, for example, the DCF standard. For example, the control unit 135 can assign file names such as those described above by referring to the indexes i1 and i2 of the divided areas R1a and R2a in which RAW data was last recorded in the pre-recording storage areas R1 and R2 before the instruction to start shooting (S53) was given.

[0164] After recording the image file of the developed result (S76), the control unit 135 ends the shooting and recording process (S54) and the process shown in the flowchart of FIG.

[0165] According to the above shooting and recording process (S54), it is possible to obtain an image capture result that is similar to that obtained by performing continuous shooting going back for the pre-recording period before the instruction to start shooting a still image is given.

[0166] 16, the shooting and recording process of the pre-recording operation for still images has been described, but the pre-recording operation of this embodiment can also be applied to moving images. In the pre-recording operation for moving images of this embodiment, for example, after an instruction to start shooting is given in the same process as above, the moving image is encoded in the image development process. At this time, the control unit 135 can specify the time order in the encoding by, for example, referring to the indexes i1 and i2 of the divided areas R1a and R2a for pre-recording that were recorded last.

[0167] 3. Summary As described above, in digital camera 100 of this embodiment, control unit 135 holds the imaging results by image sensor 115 for the pre-recording period (predetermined period) before an instruction to start shooting is given (S51 to S53). When an instruction to start shooting is given (YES in S53), control unit 135 causes image processing engine 120 to generate image data including images captured before the instruction to start shooting is given, based on the held imaging results (S54). Before an instruction to start shooting is given (NO in S53), control unit 135 records data on memory card 142 so as to hold the imaging results for the pre-recording period (S52).

[0168] According to the above digital camera 100, by applying a method of recording image data using memory card 142 to the pre-recording operation, it is possible to increase the amount of data that can hold the image capture results before an instruction to start shooting is issued, thereby ensuring a long pre-recording period. In this way, in digital camera 100, which has a removable memory card 142, it is possible to easily record image data such as the capture results of the pre-recording operation.

[0169] In this embodiment, before an instruction to start shooting is given (NO in S53), control unit 135 records data in a file format that is managed as a saving state in which image processing on the imaging data is not complete, i.e., an incomplete file, on memory card 142 so as to hold the imaging results for the pre-recording period (S65). This makes it possible to save data held before a shooting instruction is given in the pre-recording operation to memory card 142, making it easier to record image data.

[0170] (Embodiment 6) In the sixth embodiment, an example of a pre-recording operation in which a complete file is used instead of an incomplete file for buffering will be described with reference to FIGS.

[0171] Hereinafter, the description of the configuration and operation similar to those of the digital cameras 100 according to the first to fifth embodiments will be omitted as appropriate, and the digital camera 100 according to this embodiment will be described.

[0172] Fig. 17 is a flowchart for explaining the pre-recording operation in the digital camera 100 of embodiment 6. Fig. 18 is a flowchart illustrating the buffering process in the pre-recording operation of this embodiment. Fig. 19 is a flowchart illustrating the shooting and recording process (S54A) in the pre-recording operation of this embodiment.

[0173] In the digital camera 100 of this embodiment, in a pre-recording operation for moving images, when storing the image capture results before an instruction to start shooting is issued (S51 to S53) as in the fifth embodiment, the RAW data of the image capture results is encoded (S55) as shown in Fig. 17. Accordingly, in this embodiment, a buffering process (S52A) and an image capture and recording process (S54A) are performed instead of steps S52 and S54 in the fifth embodiment.

[0174] In the buffering process (S52) of the fifth embodiment, RAW data is recorded in the pre-recording storage areas R1, R2 of each of the memories 125, 142 (S62, S65 in FIG. 15). In the buffering process (S52A) of this embodiment, when the control unit 135 performs steps S61 to S67 similar to those of the fifth embodiment, instead of steps S62 and S65, it records encoded data in each of the memories 125, 142 as shown in FIG. 18. This makes it possible to reduce the amount of data held per frame in the buffering process, and, for example, makes it possible to extend the pre-recording period.

[0175] In the shooting and recording process (S54A) of this embodiment, the control unit 135 writes (S81) the encoded data stored in the buffer memory 125 in the buffering process (S52A) as a moving image file to the memory card 142 as shown in Fig. 19. For example, the moving image file is configured so that the time order of the encoded data stored in the memory card 142 in the buffering process (S52A) and the above data match.

[0176] Furthermore, the control unit 135 causes the image sensor 115 to perform an image capturing operation (S82) in accordance with an instruction to start capturing a moving image (S53 in FIG. 17). The control unit 135 encodes the frames of the captured image (S83) and writes the resulting encoded data to the memory card 142 (S84). The writing in step S84 is performed, for example, so as to include new data in the above-mentioned moving image file. The control unit 135 repeats the processes from step S82 onwards, for example, when an instruction to end capturing a moving image has not been input via the operation unit 150 (NO in S85).

[0177] When an instruction to end video shooting is input (YES in S85), the control unit 135 completes the video file being recorded, and ends the shooting and recording process (S54A) and the process shown in the flowchart of FIG.

[0178] According to the above process, when performing buffering processing (S52A) for the pre-recording operation using memory card 142, the pre-recording function can be realized by efficient processing such as holding encoded data (that is, the complete file).

[0179] As described above, in digital camera 100 of this embodiment, before an instruction to start shooting is given (NO in S53), control unit 135 records data obtained as a result of image processing on the captured data to memory card 142 so as to hold the image capture results for a predetermined period (S65A). This also makes it possible to use memory card 142 to hold data in the pre-recording operation, making it easier to record image data such as the capture results of the pre-recording operation.

[0180] In this embodiment, the instruction to start shooting may be an instruction to start shooting a moving image. Before the instruction to start shooting is given (NO in S53), the data recorded on the memory card 142 may be data that has been subjected to video encoding as image processing for the captured image data (S65A). This makes it easier to record image data in the pre-recording operation of the moving image.

[0181] (Other embodiments) As described above, the first to sixth embodiments have been described as examples of the technology disclosed in the present application. However, the technology in the present disclosure is not limited to these, and can be applied to embodiments in which modifications, substitutions, additions, omissions, etc. are appropriately performed. In addition, it is also possible to combine the components described in the above embodiments to form new embodiments. Therefore, other embodiments will be exemplified below.

[0182] In the above embodiments 1 to 6, in the first state where the save condition is satisfied during continuous shooting or the like, the continuous interval T0 is equal to or longer than the period T4 for writing to the memory card 142 in one step S4, but this embodiment is not particularly limited to the above. In this embodiment, if the sum of the processing period T2 for image processing and the period T3 for recording the resulting image data is equal to or longer than the period T4 for saving the captured image data, the captured image data may be saved.

[0183] That is, in digital camera 100 of this embodiment, in the first state, the period (T2+T3) during which image processing is performed on the captured image data and the image data resulting from the image processing is recorded on memory card 142 may be longer than the period T4 during which the captured image data is written to memory card 142. Even in this case, a situation in which buffer memory 125 becomes depleted due to the long period (T2+T3) required for image processing can be avoided by saving the captured image data, making it easier to record image data.

[0184] In each of the above embodiments, an example in which one memory card 142 is used as an example of a recording medium has been described, but the present invention is not limited to this, and for example, multiple memory cards may be used. This modified example will be described with reference to FIG.

[0185] FIG. 20 is a diagram showing the configuration of a digital camera 100A according to a modified example. The digital camera 100A according to this modified example has a card slot 140A into which a plurality of memory cards 142a, 142b can be inserted. The plurality of memory cards 142a, 142b may be the same type or different types. In this embodiment, the digital camera 100A may save RAW data to one memory card 142a, and record image data after image processing of the RAW data to the other memory card 142b. This also makes it easier to record image data in the digital camera 100A, as in the above embodiments.

[0186] In addition, in each of the above-described embodiments, the memory card 142 is exemplified as a recording medium. In this embodiment, the recording medium used in the method for recording image data, i.e., the recording medium on which the imaging device can record data, is not limited to a memory card, and may be, for example, an external storage device such as an SSD drive. For example, by using a storage device capable of writing data at high speed, it is possible to save the imaging data and facilitate recording of image data, as in each of the above-described embodiments.

[0187] In addition, in each of the above embodiments, an example has been described in which image processing is not performed on the RAW data when the RAW data is saved, but in this embodiment, some image processing may be performed. For example, the digital camera 100 of this embodiment may perform minimum image processing to generate an image for auto review for temporarily checking the shooting result even when saving the RAW data. The minimum image processing may be, for example, generating a low-resolution image for display. This allows the user to check the shooting result of the saved RAW data by the auto review function. Image processing to be performed and image processing not to be performed when saving the RAW data can be appropriately set, for example, from the viewpoint of processing period.

[0188] In addition, in each of the above embodiments, an example has been described in which a data structure such as the incomplete RAW files 50 and 60 is used when saving RAW data from the viewpoint of avoiding depletion of the buffer memory 125. In this embodiment, the data structure may also be used when saving imaging data such as RAW data from another viewpoint. Even in this case, a complete file can be obtained by performing image processing for subsequent development using the data structure, making it easier to record image data in accordance with a new recording method. For this reason, in this embodiment, the following imaging device is provided.

[0189] That is, the imaging device of this embodiment includes an imaging section that captures an image of a subject and generates imaging data, an image processing section that executes image processing on the imaging data and generates image data, an interface section that is detachably connected to an external recording medium, and a control section that records the image data on the recording medium, and the control section writes the imaging data on the recording medium, and the imaging data is managed in a data structure that associates the imaging data with management information that includes parameters of image processing for generating image data from the imaging data. This imaging device also makes it easy to record image data in an imaging device with a detachable recording medium.

[0190] In addition, in each of the above embodiments, the digital camera 100 including the optical system 110 and the drive unit 112 has been exemplified. The imaging device of the present embodiment does not need to include the optical system 110 and the drive unit 112, and may be, for example, an interchangeable lens type camera.

[0191] In addition, in each of the above embodiments, a digital camera has been described as an example of an imaging device, but the imaging device of the present disclosure may be any electronic device having an image capturing function (e.g., a video camera, a smartphone, a tablet terminal, etc.).

[0192] As described above, the embodiments have been described as examples of the technology in the present disclosure, and the accompanying drawings and detailed description have been provided for this purpose.

[0193] Therefore, among the components described in the attached drawings and the detailed description, not only are there components essential for solving the problem, but there may also be components that are not essential for solving the problem in order to illustrate the above technology. Therefore, the fact that such non-essential components are described in the attached drawings or the detailed description should not be interpreted as immediately indicating that such non-essential components are essential.

[0194] Furthermore, since the above-described embodiments are intended to illustrate the technology in the present disclosure, various modifications, substitutions, additions, omissions, and the like can be made within the scope of the claims or their equivalents. [Industrial Applicability]

[0195] The present disclosure is applicable to various imaging devices capable of recording data on a recording medium. [Explanation of symbols]

[0196] 100,100A Digital Camera 115 Image Sensor 120 Image Processing Engine 125 Buffer Memory 135 Control Unit 140,140A Card Slot 142, 142a, 142b Memory cards 155 USB connector

Claims

1. An imaging device capable of recording data on an external non-volatile recording medium, an imaging unit that captures an image of a subject and generates imaging data; A storage unit that temporarily stores the imaging data; an image processing unit that performs image processing on the imaging data to generate image data; a control unit that records the image data on the recording medium, the control unit writes the imaging data to the recording medium in a file format for evacuation that manages the imaging data on the recording medium as an evacuation state in which image processing for the imaging data has not been completed, and evacuates the imaging data from the storage unit; The control unit is a data search for the file format for saving is performed to search whether or not the imaging data in the file format saved from the storage unit is present in the recording medium; When the saved imaging data is found to exist, the saved imaging data is read into the storage unit, and image processing is performed on the imaging data by the image processing unit. Imaging device.

2. The control unit is saving, together with the imaging data, development information used when performing image processing on the image data, onto the recording medium; Using the development information, the image processing unit executes image processing on the saved imaging data. The imaging device according to claim 1 .

3. Further comprising a display unit for displaying an image, When the power is turned off in a state in which the imaging data is saved from the storage unit to the recording medium, the control unit causing the image processing unit to execute image processing on the saved imaging data while the operation of the display unit is stopped; The image data obtained by the image processing is recorded on the recording medium, and then the operation of the device is terminated. The imaging device according to claim 1 .

4. An imaging device capable of recording data on an external non-volatile recording medium, an imaging unit that captures an image of a subject and generates imaging data; A storage unit that temporarily stores the imaging data; an image processing unit that performs image processing on the imaging data to generate image data; a control unit that records the image data on the recording medium, The control unit is When the power is turned off in a state in which the imaging data is saved from the storage unit to the recording medium, When the amount of the imaging data saved to the recording medium is less than a predetermined amount, the image processing unit executes image processing on the saved imaging data; if the saved imaging data is equal to or greater than the predetermined amount, ending operation of the imaging device without performing image processing on the saved imaging data; Then, when the power is turned on, the image processing unit executes image processing on the saved image data. Imaging device.

5. An imaging device capable of recording data on an external non-volatile recording medium, an imaging unit that captures an image of a subject and generates imaging data; A storage unit that temporarily stores the imaging data; an image processing unit that performs image processing on the imaging data to generate image data; a control unit that records the image data on the recording medium, The control unit is When the power supply is turned off and then turned on in a state in which the imaging data has been saved to the recording medium, a search is performed to determine whether or not the imaging data saved from the storage unit is present in the recording medium based on information recorded in the recording medium; When the saved imaging data is found to exist, the saved imaging data is read into the storage unit, and image processing is performed on the imaging data by the image processing unit. Imaging device.

Images