Imaging device, control method for the same, and program

Abstract

To prevent an imaging apparatus from becoming inoperable even when a display interface of the imaging apparatus is only HDMI output and is connected to a device that does not support HDMI RAW.SOLUTION: The imaging apparatus includes first generating means for generating RAW image data, second generating means for developing the RAW image data to generate developed data, output means for outputting the RAW image data or the developed data to the outside, and control means for controlling to output the RAW image data or the development data by the output means on the basis of the mounting state of display means which is attachable to and detachable from the imaging apparatus and displays the developed data with respect to the imaging apparatus and settings related to the output of the output means.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to an imaging device, a control method for the imaging device, and a program.

Background Art

[0002] As a technique for an imaging device to transfer a RAW image externally, there is a technique of arranging Bayer data of a RAW image in an image area in a video format of YCC4:2:2 of HDMI (registered trademark) and outputting it to an external device. The external device that receives this interprets that the Bayer data of the RAW image is arranged in the image area in the input HDMI YCC4:2:2 video format, and can record the Bayer data of the RAW image, develop it, and display it on a monitor. Such a device is defined as an HDMI RAW-compatible device.

[0003] On the other hand, since HDMI is a general-purpose format, there is also a device that interprets an HDMI signal in which Bayer data of a RAW image is arranged in an image area in a video format of YCC4:2:2 as a YCC4:2:2 format signal and tries to perform monitor display as it is. Since the image data in the YCC format and the RAW image data have different data formats, a broken image is displayed on the monitor of such a device. Such a device is defined as an HDMI RAW-incompatible device.

[0004] Patent Document 1 discloses a technique for changing the main body operation by connecting an external device, and describes a technique for changing the operation mode related to key input operations according to the type of the connected USB keyboard.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0006] In addition to HDMI output, an imaging device generally has a configuration having a display unit such as a liquid crystal panel. Therefore, even when a broken image is displayed in HDMI output, it is possible to perform operations on the display unit such as a liquid crystal panel. However, in recent years, due to demands for miniaturization of devices, there are imaging devices in which a display unit such as a liquid crystal panel can be attached to and detached from the imaging device. In such an imaging device, when the display unit such as a liquid crystal panel is removed, the display interface in the removed state depends only on the HDMI output. If the HDMI output shows a broken image, the operation of the imaging device becomes impossible. The present invention aims to prevent the imaging device from becoming inoperable even when the display interface of the imaging device depends only on the HDMI output and the imaging device is connected to a device that does not support HDMI RAW.

Means for Solving the Problems

[0007] The imaging device according to the present invention includes a first generation means for generating RAW image data, a second generation means for developing the RAW image data to generate developed data, an output means for outputting the RAW image data or the developed data to the outside, and a mounting state of the display means that is detachable from the imaging device and displays the developed data with respect to the imaging device, and based on the setting regarding the output of the output means, control means for controlling the RAW image data or the developed data to be output by the output means.

Effects of the Invention

[0008] According to the present invention, even when the display interface of the imaging device depends only on the HDMI output and the imaging device is connected to a device that does not support HDMI RAW, it is possible to prevent the imaging device from becoming inoperable.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Embodiments for Carrying Out the Invention

[0010] Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[0011] <First Embodiment> FIG. 1(A) is a block diagram showing a configuration example of the imaging device 100. The lens unit 101 is an optical system composed of a fixed lens group for focusing, a zoom lens group, a diaphragm, a correction lens group, and the like. The correction lens group is a lens group that has both the function of correcting the imaging position shifted by the movement of the zoom lens group and the function of performing focus adjustment. The lens unit 101 forms a subject image on the imaging surface of the image sensor 102 described later. The lens unit 101 is detachable from the imaging device 100.

[0012] The image sensor 102 is an imaging element such as a CCD image sensor or a CMOS image sensor, and converts light into electric charges to generate (capture) an imaging signal. Note that the area captured by the image sensor 102 may be the entire area of the image sensor 102 or a partial area, and can be switched according to the settings of the imaging device 100. The imaging signal generated by the image sensor 102 is output to, for example, the image processing unit 103. Note that as the imaging element, a so-called dual pixel type in which all pixels on the imaging surface are each composed of a pair of light receiving elements and a pair of optical images formed by microlenses at each pixel can be photoelectrically converted by the pair of light receiving elements may be used.

[0013] The image processing unit 103 performs various processes on the imaging signal acquired from the image sensor 102. The image processing unit 103 is an example of the first generation means and the second generation means. As shown in FIG. 1(B), the image processing unit 103 includes a RAW data correction processing unit 121, a development processing unit 122, and a developed data correction processing unit 123. The RAW data correction processing unit 121 has a function of converting the imaging signal output from the image sensor 102 into RAW image data (RAW image) and performing RAW development processes such as interpolation processing and image quality adjustment processing on the converted RAW image data. The development processing unit 122 has a function of developing the RAW image data generated by the RAW data correction processing unit 121 to generate image data in YCC format (developed data). The developed data correction processing unit 123 has a function of performing correction processes such as distortion correction on the developed data and performing resizing processing. Note that the data processed by each block is stored in the RAM 111 or output to other blocks.

[0014] The display resizing unit 104 performs resizing processing on the image data in YCC format stored in the RAM 111 to generate display image data. The display resizing unit 104 stores the generated display image data in the RAM 111. The recording resizing unit 105 performs resizing processing on the image data in YCC format stored in the RAM 111 to generate recording image data. The recording resizing unit 105 stores the generated recording image data in the RAM 111.

[0015] The on-screen display (OSD) generation unit 106 generates OSD data related to the on-screen display (OSD, display information). The OSD generation unit 106 stores the generated OSD data in the RAM 111. The OSD data includes OSD data such as various setting menus, titles, and time. The OSD data stored in the RAM 111 is, for example, synthesized with the display image data stored in the RAM 111 and then displayed on the display unit 107 or output externally from the external output unit 115. The display unit 107 is a display member for displaying the display image data and the OSD (display information). The display unit 107 is, for example, a liquid crystal panel or an organic EL panel. The display unit 107 is detachable from the imaging device 100 and is connected to the imaging device 100 via the connection unit 117.

[0016] The microcomputer (hereinafter also referred to as the microcontroller) 108 controls the entire imaging device 100. The microcontroller 108 is an example of a control means. The operation switch group 109 is an operation member for the user to perform operation inputs. The operation switch group 109 also includes a switch for selecting any one of a camera mode for performing camera shooting, a playback mode for playback, and a power-off mode for turning off the power.

[0017] The ROM (Read Only Memory) 110 is, for example, a flash ROM, and stores programs executed by the microcontroller 108 and the like. A partial area of the ROM 110 is used for backup to hold the state of the system and the like. The RAM (Random Access Memory) 111 is a volatile memory used as a work memory by the microcontroller 108, the image processing unit 103, the compression / decompression unit 114, and the like. A memory area for display output (hereinafter also referred to as VRAM for display output) and a memory area for HDMI output (hereinafter also referred to as VRAM for HDMI output) are provided, for example, in the RAM 111.

[0018] The memory card controller 112 records the moving image data generated by the compression / expansion unit 114 and output to the RAM 111 onto the memory card 113 in a format compatible with a computer such as the FAT file system. The memory card 113 is a removable recording medium for the imaging device 100 and can also be attached to a computer or the like other than the imaging device 100. The compression / expansion unit 114 encodes the image data stored in the RAM 111 (for example, MPEG compression) to generate moving image data and outputs it to the RAM 111.

[0019] The external output unit 115 is an interface compliant with the HDMI (registered trademark) standard and outputs the display image data output by the image processing unit 103 to the RAM 111 externally. The external output unit 115 can output the display image data as signals of standards such as 4K60P and 2K60P. The external output unit 115 is an example of output means. The bus 116 is a bus for data exchange between each part of the imaging device 100.

[0020] Next, with reference to FIG. 2, the output switching process of RAW image data using an HDMI signal (video signal compliant with the HDMI standard) and YCC format image data (developed data) using an HDMI signal in the present embodiment will be described. FIG. 2 is a flowchart showing a processing example of the imaging device 100 in the first embodiment. Each process in the flowchart of FIG. 2 is controlled by the microcomputer 108 of the imaging device 100 executing a program stored in the ROM 110.

[0021] The process of the flowchart shown in FIG. 2 starts, for example, when the imaging device 100 is instructed to start up by an operation input from the operation switch group 109 or the like. In step S201, the microcomputer 108 of the imaging device 100 receives an instruction to start up the imaging device 100 from the operation switch group 109 and turns on the power of the imaging device 100 (ON). As a result, power is supplied to each part of the imaging device 100, and the imaging device 100 is started up.

[0022] In step S202, the microcomputer 108 determines whether the previous menu setting is the HDMI RAW output mode. The previous menu setting is the mode information that the imaging device 100 was operating in before starting in step S201, and includes the HDMI RAW output mode, the HDMI YCC output mode, etc. regarding HDMI output via the external output unit 115. The HDMI RAW output mode is an operation mode in which RAW image data is arranged in the image area in the YCC format video format and output by an HDMI signal. Also, the HDMI YCC output mode is an operation mode in which YCC format image data (developed data) is arranged in the image area in the YCC format video format and output by an HDMI signal. This mode information is retained in the RAM 111 when the mode is switched. Also, the mode information is retained in, for example, the ROM 110 when the power of the imaging device 100 is turned off (OFF). If the microcomputer 108 determines that the previous menu setting is the HDMI RAW output mode (YES), the process proceeds to step S203. If the microcomputer 108 determines that the previous menu setting is not the HDMI RAW output mode (NO), the process proceeds to step S206.

[0023] In step S203, the microcomputer 108 checks the connection state of the output device to the imaging device 100. The output device is a device that displays video and OSD from the imaging device 100, and includes a sink device (HDMI receiver) connected via the external output unit 115 by HDMI and a detachable display unit 107 attached to the imaging device 100. Here, if the HDMI sink device is not connected, the processing of the flowchart shown in FIG. 2 ends. If the HDMI sink device is connected, the imaging device 100 communicates with the sink device (HDMI receiver) using a DDC (Display Data Channel) signal, acquires the EDID of the sink device, and stores it in the RAM 111. This EDID of the sink device includes information such as the signal format information that the sink device can receive and whether it corresponds to the signal format of the HDMI RAW output described later.

[0024] In step S204, the microcomputer 108 determines whether the display unit 107 is attached to the imaging device 100 (whether an output device other than an HDMI sink device is attached). If the microcomputer 108 determines that the display unit 107 is attached to the imaging device 100 (YES), the process proceeds to step S205. On the other hand, if the microcomputer 108 determines that the display unit 107 is not attached to the imaging device 100 (the connected output device is only an HDMI sink device) (NO), the process proceeds to step S206.

[0025] In step S205, the microcomputer 108 controls each block of the imaging device 100 to perform HDMI RAW output. The process of this HDMI RAW output will be described with reference to FIG. 3.

[0026] In step S301, the microcomputer 108 controls the image sensor 102 or the like to capture RAW image data (RAW image) related to the subject image. Hereinafter, "RAW image data" is also simply referred to as "RAW data". The captured RAW data is held in the RAM 111.

[0027] In step S302, the microcomputer 108 controls the image processing unit 103 to perform gamma processing on the RAW data captured in step S301.

[0028] In step S303, the microcomputer 108 controls the image processing unit 103 to write the RAW data that has undergone gamma processing in step S302 as RAW data for HDMI RAW output to the HDMI output VRAM.

[0029] Here, with reference to FIGS. 4 and 5, the RAW data written to the RAM 111 will be described. In FIG. 4(A), 400 shows the entire RAW data for HDMI RAW output written to the RAM 111 in step S303. The RAW data is composed of data in the effective pixel area 401 and data in the additional pixel area 402. As shown in FIG. 4(A), the additional pixel area 402 is an area where several pixels are added to the upper, lower, left, and right sides of the effective pixel area 401, and the pixels in this additional pixel area 402 are used when developing the upper, lower, left, and right ends of the effective pixel area 401. Due to such a configuration, the data written in step S303 is the sum of the effective pixel area and the additional pixel area as shown in FIG. 4(B). For example, in the case of 4K RAW data, data for a total of 4120 x 2176 pixels, obtained by adding 12 pixels in the left and right additional pixel areas and 8 pixels in the upper and lower additional pixel areas to the 4096 x 2160 pixels in the effective pixel area, is written to the RAM 111.

[0030] FIG. 5 is a diagram for explaining the details of the RAW data written to the RAM 111 in step S303. In FIG. 5, as shown at 500, the RAW data is configured in an R / Gr / Gb / B Bayer array. For 4K RAW data, as shown at 501, this Bayer array is arranged 2060 in the horizontal direction (4120 pixels as pixel data), and as shown at 502, 1088 in the vertical direction (2176 pixels as pixel data). Note that the data size is 4120 (horizontal) x 2176 (vertical) x 12 (bit depth) ÷ 8 (from bits to bytes) = 13447680 bytes.

[0031] Returning to FIG. 3, in step S304, the microcomputer 108 controls the image processing unit 103 to perform RAW data correction processing on the RAW data captured in step S301. This RAW data correction processing includes pre-development lens correction processing (such as peripheral light amount correction processing, magnification chromatic aberration correction, etc.) and processing such as white balance. The data used for the pre-development lens correction processing is stored in advance in the ROM 110 for each type of lens. The microcomputer 108 determines the parameters of the pre-development lens correction processing based on the stored data and the type of the lens unit 101 attached to the imaging device 100.

[0032] In step S305, the microcomputer 108 controls the image processing unit 103 to perform development processing on the image data corrected in step S304. This development processing includes processing such as Debayer, γ processing, and color bleeding correction. Regarding the color bleeding correction, the microcomputer 108 determines the correction processing parameters based on the data stored in the ROM 110 in advance and the type of the lens unit 101 attached to the imaging device 100. By performing the development processing, the RAW data becomes data in the YCC4:2:2 format. The image data (developed data) after the development processing is stored in the RAM 111.

[0033] In step S306, the microcomputer 108 controls the image processing unit 103 to perform development data correction processing such as distortion correction on the data in the YCC4:2:2 format generated in step S305 and stored in the RAM 111. Regarding this distortion correction, the microcomputer 108 also determines the distortion correction parameters based on the data stored in the ROM 110 in advance and the type of the lens unit 101 attached to the imaging device 100. The developed and corrected data (in the YCC4:2:2 format) corrected in step S306 is stored in the RAM 111.

[0034] In step S307, the microcomputer 108 writes metadata corresponding to the RAW data to an area after the RAW data written to the RAM 111 (VRAM for HDMI output) in step S303. The metadata includes, for example, data (correction information) used for the correction process of the corresponding RAW data.

[0035] Here, with reference to FIGS. 6 and 7, the memory area for HDMI output (VRAM for HDMI output) to which data is written in step S303 and step S307 will be described.

[0036] FIG. 6 is a diagram for explaining the VRAM for HDMI output when outputting video data in the YCC4:2:2 format of 4096x2160 pixels at 12 bits via an HDMI signal. As shown in FIG. 6, this memory area 600 has an image area of 4096 pixels in the horizontal direction as shown in 602 and 2160 pixels in the vertical direction as shown in 603. And in FIG. 6, as shown by 601, the image data is composed of units of 2 pixels (for every 2 Y data, there is 1 Cb and 1 Cr data), and the size of each data is 12 bits for each of the Y, Cb, and Cr data. The data size of one line (horizontal direction) in this VRAM for HDMI output is 4096 (horizontal) x 2 (since there are 4 data (2 Ys, 1 Cb, and 1 Cr) for 2 pixels) x 12 (bit depth) ÷ 8 (from bits to bytes) = 12288 bytes. Also, for the entire VRAM for HDMI output, the data size is 4096 (horizontal) x 2160 (vertical) x 2 (4 data for 2 pixels) x 12 (bit depth) ÷ 8 (from bits to bytes) = 26542080 bytes.

[0037] FIG. 7 is a diagram for explaining the state in which RAW data is written in step S303 and metadata is written in step S307 with respect to the VRAM for HDMI output (image area in the video format of YCC4:2:2) described in FIG. 6. Note that the size of the RAW data is 4120 (horizontal) x 2176 (vertical) x 12 (bit depth) ÷ 8 (from bits to bytes) = 13447680 bytes as described with reference to FIG. 5.

[0038] In FIG. 7, as shown at 701, for the image area where each data column of Cb, Y, Cr, and Y in the HDMI output VRAM is arranged, Bayer data (the data in the first column is R and Gr data, and the data in the second column is Gr and B data) is arranged without gaps. The size of the RAW data is 13,447,680 bytes, and the data size of one line in the HDMI output VRAM is 12,288 bytes. Therefore, in FIG. 7, as shown at 702, the RAW data with a bit depth of 12 bits and a size of 4120x2176 pixels can be stored in 1095 lines (13,447,680÷12,288 = 1094.375) in the HDMI output VRAM. And since the area after the RAW data (lines 1096 to 2160 in the HDMI output VRAM) is an empty area, as shown at 703, metadata corresponding to the RAW data arranged up to the 1095th line is arranged in this image area. The metadata includes, for example, the γ data of the RAW data (γ in step S302). Also, the metadata includes, for example, the parameters used in the development process and correction process in the imaging device 100 (the parameters of the RAW data correction process in step S304, the parameters of the development process in step S305, and the parameters of the developed data correction process in step S306).

[0039] Returning to FIG. 3, in step S308, the microcomputer 108 determines whether the display unit 107 is attached to the imaging device 100. If the microcomputer 108 determines that the display unit 107 is attached to the imaging device 100 (YES), the process proceeds to step S309. On the other hand, if the microcomputer 108 determines that the display unit 107 is not attached to the imaging device 100 (NO), the process proceeds to step S311.

[0040] In step S309, the microcomputer 108 controls the display resizing unit 104 to resize the post-development correction data (in the YCC4:2:2 format) stored in the RAM 111 in step S306 to the display size on the display unit 107. Then, the microcomputer 108 writes the post-development correction data resized to the display size on the display unit 107 to the VRAM for display output.

[0041] In step S310, the microcomputer 108 outputs the data for display output written to the VRAM for display output in step S309 to the display unit 107. As a result, the image data for display output is displayed on the display unit 107.

[0042] In step S311, the microcomputer 108 controls the external output unit 115 to output the data for HDMI output stored in the VRAM for HDMI output to the sink device via the HDMI signal. This HDMI output is in a format where RAW data is arranged in the image area in the YCC4:2:2 format 12-bit video format as described above. When this data is input to a sink device compatible with HDMI RAW, the sink device interprets this data as RAW data. Therefore, after developing the RAW data 702 with reference to the information of the metadata 703, display processing and recording processing are performed. On the other hand, when this data is input to a sink device not compatible with HDMI RAW, the sink device interprets this data as YCC data. Since the RAW data 702 and the metadata 703 are not YCC data, a broken image is displayed on the corresponding device as scrambled data. The above is the explanation of the processing of HDMI RAW output.

[0043] Returning to FIG. 2, in step S206, the microcomputer 108 controls each block of the imaging device 100 to perform HDMI YCC output. The processing of this HDMI YCC output will be described with reference to FIG. 8.

[0044] In step S801, the microcomputer 108 controls the image sensor 102 or the like to capture RAW data (RAW image) related to the subject image. The captured RAW data is held in the RAM 111.

[0045] In step S802, the microcomputer 108 controls the image processing unit 103 to perform gamma processing on the RAW data captured in step S801.

[0046] In step S803, the microcomputer 108 controls the image processing unit 103 to perform RAW data correction processing on the RAW data captured in step S801. The RAW data correction processing in this step S803 is the same as the RAW data correction processing in step S304 of FIG. 3.

[0047] In step S804, the microcomputer 108 controls the image processing unit 103 to perform development processing on the image data subjected to correction processing in step S803. The development processing in this step S804 is the same as the development processing in step S305 of FIG. 3.

[0048] In step S805, the microcomputer 108 controls the image processing unit 103 to perform development data correction processing such as distortion correction on the data in the YCC4:2:2 format generated in step S804 and stored in the RAM 111. The development data correction processing in this step S805 is the same as the development data correction processing in step S306 of FIG. 3. The development corrected data (in the YCC4:2:2 format) corrected in step S805 is stored in the RAM 111.

[0049] In step S806, the microcomputer 108 controls the display resizing unit 104 to resize the development corrected data (in the YCC4:2:2 format) stored in the RAM 111 in step S805 to the display size on the sink device connected via HDMI. Then, the microcomputer 108 writes the development corrected data resized to the display size on the sink device to the HDMI output VRAM.

[0050] In step S807, the microcomputer 108 determines whether the display unit 107 is attached to the imaging device 100. If the microcomputer 108 determines that the display unit 107 is attached to the imaging device 100 (YES), the process proceeds to step S808. On the other hand, if the microcomputer 108 determines that the display unit 107 is not attached to the imaging device 100 (NO), the process proceeds to step S810.

[0051] In step S808, the microcomputer 108 controls the display resizing unit 104 to resize the post-development correction data (in the YCC4:2:2 format) stored in the RAM 111 in step S805 to the display size on the display unit 107. Then, the microcomputer 108 writes the post-development correction data resized to the display size on the display unit 107 to the VRAM for display output.

[0052] In step S809, the microcomputer 108 outputs the display output data written to the VRAM for display output in step S808 to the display unit 107. As a result, the image data for display output is displayed on the display unit 107.

[0053] In step S810, the microcomputer 108 controls the external output unit 115 to output the HDMI output data stored in the HDMI output VRAM to the sink device via the HDMI signal. Since this HDMI output is data in the YCC4:2:2 format as described above, correct data (image) is displayed regardless of whether the sink device supports HDMI RAW or not. The above is the description of the process of HDMI YCC output.

[0054] Returning to FIG. 2, in step S207, the microcomputer 108 receives the menu settings instructed to the imaging device 100 via the operation switch group 109. The menu settings are the designation of the operation mode of the imaging device 100 and include the setting of the HDMI RAW output mode or the HDMI YCC output mode regarding the HDMI output.

[0055] In step S208, the microcomputer 108 determines whether the HDMI RAW output mode is set as the operation mode of the imaging device 100. If the microcomputer 108 determines that the HDMI RAW output mode is set (YES), the process proceeds to step S209. If the microcomputer 108 determines that the HDMI RAW output mode is not set (NO), the process shown in the flowchart of FIG. 2 ends.

[0056] In step S209, the microcomputer 108 performs HDMI RAW setting processing. After performing the HDMI RAW setting processing, the process shown in the flowchart of FIG. 2 ends. The HDMI RAW setting processing in this step S209 will be described below with reference to FIGS. 9(A) to 9(C).

[0057] As the HDMI RAW setting processing in step S209 of FIG. 2, the microcomputer 108 executes, for example, HDMI RAW setting process A shown in FIG. 9(A). FIG. 9(A) is a flowchart showing the flow of HDMI RAW setting process A as an example of the HDMI RAW setting processing. In the HDMI RAW setting process A shown in FIG. 9(A), in step S901, the microcomputer 108 controls each block of the imaging device 100 to perform HDMI RAW output. The HDMI RAW output performed here is the same as the HDMI RAW output described with reference to FIG. 3. Then, the process ends.

[0058] Also, the microcomputer 108 may execute, for example, HDMI RAW setting process B shown in FIG. 9(B) as the HDMI RAW setting processing in step S209 of FIG. 2. FIG. 9(B) is a flowchart showing the flow of HDMI RAW setting process B as an example of the HDMI RAW setting processing.

[0059] In the HDMI RAW setting process B shown in FIG. 9(B), in step S921, the microcomputer 108 checks the connection state of the output device to the imaging device 100. The processing in this step S921 is the same as the processing in step S203 of FIG. 2.

[0060] In step S922, the microcomputer 108 determines whether the display unit 107 is attached to the imaging device 100. If the microcomputer 108 determines that the display unit 107 is attached to the imaging device 100 (YES), the process proceeds to step S923. On the other hand, if the microcomputer 108 determines that the display unit 107 is not attached to the imaging device 100 (NO), the process proceeds to step S924.

[0061] In step S923, the microcomputer 108 controls each block of the imaging device 100 to perform HDMI RAW output. The HDMI RAW output performed here is the same as the HDMI RAW output described with reference to FIG. 3. Thereafter, the process ends.

[0062] In step S924, the microcomputer 108 controls each block of the imaging device 100 to perform HDMI YCC output. The HDMI YCC output performed here is the same as the HDMI YCC output described with reference to FIG. 8. Thereafter, the process ends.

[0063] Also, the microcomputer 108 may execute, for example, the HDMI RAW setting process C shown in FIG. 9(C) as the HDMI RAW setting process in step S209 of FIG. 2. FIG. 9(C) is a flowchart showing the flow of the HDMI RAW setting process C as an example of the HDMI RAW setting process.

[0064] In the HDMI RAW setting process C shown in FIG. 9(C), in step S941, the microcomputer 108 checks the connection state of the output device to the imaging device 100. The process in this step S941 is the same as the process in step S203 of FIG. 2.

[0065] In step S942, the microcomputer 108 determines whether the display unit 107 is attached to the imaging device 100. If the microcomputer 108 determines that the display unit 107 is attached to the imaging device 100 (YES), the process proceeds to step S947. On the other hand, if the microcomputer 108 determines that the display unit 107 is not attached to the imaging device 100 (NO), the process proceeds to step S943.

[0066] In step S943, the microcomputer 108 controls the OSD generation unit 106 to generate OSD data regarding the warning display OSD. The generated data is held in the RAM 111 as the warning OSD. Thereafter, the microcomputer 108 controls the external output unit 115 to output the warning OSD as a signal in the YCC4:2:2 format to the sink device via the HDMI signal. As a result, the warning OSD is displayed on the sink device connected via HDMI. An example of the warning OSD output in this step S943 is shown in FIG. 10(A). Here, an example in the case where the display unit 107 is a liquid crystal panel is shown. As shown in FIG. 10(A), a warning prompting the attachment of the liquid crystal panel as the display unit 107 to the imaging device 100 is displayed on the warning OSD 1001. Further, for example, a button 1002 for notifying the attachment of the liquid crystal panel and a button 1003 for instructing the switching to the HDMI RAW mode without attaching the liquid crystal panel are displayed.

[0067] In step S944, the microcomputer 108 determines whether the display unit 107 is attached to the imaging device 100. That is, the microcomputer 108 determines whether the display unit 107 is attached to the imaging device 100 when the warning OSD in step S943 is being displayed. If the microcomputer 108 determines that the display unit 107 is attached to the imaging device 100 (YES), the process proceeds to step S947. On the other hand, if the microcomputer 108 determines that the display unit 107 is not attached to the imaging device 100 (NO), the process proceeds to step S945.

[0068] In step S945, the microcomputer 108 controls the OSD generation unit 106 to generate OSD data related to the warning display OSD. The generated data is stored in the RAM 111 as the warning OSD. Then, the microcomputer 108 controls the external output unit 115 to output the warning OSD as a signal in YCC 4:2:2 format to the sink device via the HDMI signal. As a result, the warning OSD is displayed on the sink device connected by HDMI. An example of the warning OSD output in this step S945 is shown in Fig. 10(B). As shown in Fig. 10(B), the warning OSD 1011 displays that an image cannot be displayed on an HDMI RAW-incompatible device. Also, buttons 1012 and 1013 for selecting whether to switch to the HDMI RAW output mode are displayed.

[0069] In step S946, the microcomputer 108 determines whether the switch to the HDMI RAW output mode (button 1012) was selected in step S945. If the microcomputer 108 determines that the switch to the HDMI RAW output mode was selected (button 1012 was selected) (YES), the process proceeds to step S947. If the microcomputer 108 determines that the switch to the HDMI RAW output mode is not selected (button 1013 was selected) (NO), the process proceeds to step S948.

[0070] In step S947, the microcomputer 108 controls each block of the imaging device 100 to perform HDMI RAW output. The HDMI RAW output performed here is the same as the HDMI RAW output described with reference to Fig. 3. Then, the process ends.

[0071] In step S948, the microcomputer 108 controls each block of the imaging device 100 to perform HDMI YCC output. The HDMI YCC output performed here is the same as the HDMI YCC output described with reference to Fig. 8. Then, the process ends.

[0072] In this embodiment, the microcomputer 108 controls whether the external output unit 115 outputs RAW image data or developed data (image data in YCC format) based on the mounting state of the display unit 107 on the imaging device 100 and the setting instructions regarding HDMI output. Even when the HDMI RAW output mode is selected, if the display unit 107 is not mounted on the imaging device 100, the microcomputer 108 controls to perform HDMI output for outputting developed data in the HDMI YCC output mode. Thereby, even when the display unit 107 is not mounted on the imaging device 100, the display interface of the imaging device 100 is only by HDMI output, and the imaging device 100 is connected to a device not compatible with HDMI RAW, it is possible to prevent the imaging device 100 from becoming inoperable.

[0073] In the above description, each process has been performed starting from the power-on of the imaging device 100 (step S201), but it is not limited thereto. For example, each process after step S201 may be executed starting from the change in the setting of the imaging device 100, such as changing the size of the video signal captured by the image sensor 102.

[0074] <Second Embodiment> The second embodiment will be described. In the first embodiment, when the display unit 107 is not connected to the imaging device 100, even if the HDMI RAW output mode is selected, HDMI output is performed in the HDMI YCC output mode. Thereby, the imaging device 100 that prevents the imaging device 100 from becoming inoperable even when connected to a device not compatible with HDMI RAW has been described.

[0075] In the second embodiment, when the HDMI RAW output mode is selected while the display unit 107 is not connected to the imaging device 100, HDMI output is performed in the HDMI RAW output mode. Then, while performing HDMI output in the HDMI RAW output mode, it is prevented that the device becomes inoperable or is erroneously operated when connected to a device that does not support HDMI RAW. The configuration of the imaging device 100 in the second embodiment is the same as the configuration of the imaging device 100 in the first embodiment described above, and thus the description thereof is omitted. Hereinafter, the operation of the imaging device 100 in the second embodiment will be described.

[0076] Referring to FIG. 11, the operation of the imaging device 100 in the second embodiment will be described. FIG. 11 is a flowchart showing an example of processing of the imaging device 100 in the second embodiment. Each process in the flowchart of FIG. 11 is controlled by the microcomputer 108 of the imaging device 100 executing a program stored in the ROM 110.

[0077] The process of the flowchart shown in FIG. 11 is started, for example, when the imaging device 100 is instructed to start up by an operation input from the operation switch group 109 or the like. In step S1101, the microcomputer 108 of the imaging device 100 receives an instruction to start up the imaging device 100 from the operation switch group 109 and turns on the power of the imaging device 100 (ON). As a result, power is supplied to each part of the imaging device 100, and the imaging device 100 is started up.

[0078] In step S1102, the microcomputer 108 determines whether the previous menu setting is the HDMI RAW output mode. The previous menu setting is the mode information that the imaging device 100 was operating in before starting in step S1101, and there are HDMI RAW output modes, HDMI YCC output modes, etc. related to HDMI output via the external output unit 115. This mode information is retained in the RAM 111 when the mode is switched. Also, the mode information is retained in, for example, the ROM 110 when the power of the imaging device 100 is turned off (OFF). If the microcomputer 108 determines that the previous menu setting is not the HDMI RAW output mode (NO), the process proceeds to step S1103. If the microcomputer 108 determines that the previous menu setting is the HDMI RAW output mode (YES), the process proceeds to step S1104.

[0079] In step S1103, the microcomputer 108 controls each block of the imaging device 100 to perform HDMI YCC output. The HDMI YCC output performed here is the same as the HDMI YCC output described with reference to FIG. 8.

[0080] In step S1104, the microcomputer 108 checks the connection state of the output device to the imaging device 100. The processing in this step S1104 is the same as the processing in step S203 of FIG. 2.

[0081] In step S1105, the microcomputer 108 determines whether the display unit 107 is attached to the imaging device 100 (whether an output device other than the HDMI sink device is attached). If the microcomputer 108 determines that the display unit 107 is attached to the imaging device 100 (YES), the process proceeds to step S1106. On the other hand, if the microcomputer 108 determines that the display unit 107 is not attached to the imaging device 100 (NO), the process proceeds to step S1107.

[0082] In step S1106, the microcomputer 108 controls each block of the imaging device 100 to perform HDMI RAW output. The HDMI RAW output performed here is the same as the HDMI RAW output described with reference to FIG. 3.

[0083] In step S1107, the microcomputer 108 performs HDMI RAW output processing at startup. The HDMI RAW output processing at startup in this step S1107 will be described below with reference to FIGS. 12(A) to 12(C).

[0084] As the HDMI RAW output processing at startup in step S1107 of FIG. 11, the microcomputer 108 executes, for example, the HDMI RAW output processing A shown in FIG. 12(A). FIG. 12(A) is a flowchart showing the flow of the HDMI RAW output processing A as an example of the HDMI RAW output processing at startup.

[0085] In the HDMI RAW output processing A shown in FIG. 12(A), in step S1201, the microcomputer 108 controls each block of the imaging device 100 to perform HDMI RAW output. The HDMI RAW output performed here is the same as the HDMI RAW output described with reference to FIG. 3.

[0086] In step S1202, the microcomputer 108 sets to prohibit accepting operations other than the power ON / OFF operation of the imaging device 100 among the operation inputs from the operation switch group 109. Then, the process ends. By processing in this way, it is possible to prevent an incorrect operation in which the user operates the imaging device 100 via the operation switch group 109 or the like when the operation UI is not visible.

[0087] Also, the microcomputer 108 may execute, for example, the HDMI RAW output processing B shown in FIG. 12(B) as the HDMI RAW output processing at startup in step S1107 of FIG. 11. FIG. 12(B) is a flowchart showing the flow of the HDMI RAW output processing B as an example of the HDMI RAW output processing at startup.

[0088] In the HDMI RAW output process B shown in FIG. 12(B) at startup, in step S1221, the microcomputer 108 determines whether the imaging device 100 has been started multiple times with the setting in the HDMI RAW output mode. If the microcomputer 108 determines that the imaging device 100 has been started multiple times with the setting in the HDMI RAW output mode (YES), the process proceeds to step S1224. If the microcomputer 108 determines otherwise (NO), the process proceeds to step S1222.

[0089] In step S1222, the microcomputer 108 controls each block of the imaging device 100 to perform HDMI RAW output. The HDMI RAW output performed here is the same as the HDMI RAW output described with reference to FIG. 3. In step S1223, the microcomputer 108 sets to prohibit accepting operations other than the power ON / OFF operation of the imaging device 100 among the operation inputs from the operation switch group 109. Then, the process ends.

[0090] In step S1224, the microcomputer 108 controls each block of the imaging device 100 to perform HDMI YCC output. The HDMI YCC output performed here is the same as the HDMI YCC output described with reference to FIG. 8. In step S1225, the microcomputer 108 controls the entire imaging device 100 to set to accept operation inputs from the operation switch group 109.

[0091] In step S1226, the microcomputer 108 controls the OSD generation unit 106 to generate OSD data related to the warning display OSD. The generated data is stored in the RAM 111 as the warning OSD. Then, the microcomputer 108 controls the external output unit 115 to output the warning OSD as a YCC4:2:2 signal to the sink device via the HDMI signal. As a result, the warning OSD is displayed on the sink device connected via HDMI. An example of the warning OSD output in this step S1226 is shown in Fig. 13(A). As shown in Fig. 13(A), the warning OSD 1301 displays that the HDMI output has been switched to the HDMI YCC output mode. Then, the process ends.

[0092] By processing in this way, even when the HDMI RAW output mode is set and the power is turned on / off multiple times, the main body operation (return from the HDMI RAW output mode) becomes possible by switching to the HDMI YCC output mode.

[0093] Also, the microcomputer 108 may execute, for example, the startup HDMI RAW output process C shown in Fig. 12(C) as the startup HDMI RAW output process in step S1107 of Fig. 11. Fig. 12(C) is a flowchart showing the flow of the startup HDMI RAW output process C as an example of the startup HDMI RAW output process.

[0094] In the startup HDMI RAW output process C shown in Fig. 12(C), in step S1241, the microcomputer 108 controls each block of the imaging device 100 to perform HDMI YCC output. The HDMI YCC output performed here is the same as the HDMI YCC output described with reference to Fig. 8.

[0095] In step S1242, the microcomputer 108 controls the OSD generation unit 106 to generate OSD data related to the warning display OSD. The generated data is stored in the RAM 111 as the warning OSD. Then, the microcomputer 108 controls the external output unit 115 to output the warning OSD as a signal in YCC4:2:2 format to the sink device via the HDMI signal. As a result, the warning OSD is displayed on the sink device connected by HDMI. An example of the warning OSD output in this step S1242 is shown in Fig. 13(B). Here, an example where the display unit 107 is a liquid crystal panel is shown. As shown in Fig. 13(B), the warning OSD 1311 displays that it is the setting of the HDMI RAW output mode and recommends connecting the liquid crystal panel or switching to the HDMI YCC output mode. Also, the warning OSD 1311 displays that it will automatically switch to the HDMI RAW output mode after a while.

[0096] In step S1243, the microcomputer 108 determines whether the user has operated the operation switch group 109 to instruct switching to the HDMI YCC output mode regarding the operation of the imaging device 100. If the microcomputer 108 determines that the switching to the HDMI YCC output mode has not been instructed (NO), the process proceeds to step S1244. If the microcomputer 108 determines that the switching to the HDMI YCC output mode has been instructed (YES), the process proceeds to step S1249.

[0097] In step S1244, the microcomputer 108 determines whether a predetermined time has elapsed since the imaging device 100 was activated. If the microcomputer 108 determines that a predetermined time has elapsed since the imaging device 100 was activated (YES), the process proceeds to step S1245. If the microcomputer 108 determines that a predetermined time has not elapsed since the imaging device 100 was activated (NO), the process returns to step S1242.

[0098] In step S1245, the microcomputer 108 controls each block of the imaging device 100 to perform HDMI RAW output. The HDMI RAW output performed here is the same as the HDMI RAW output described with reference to FIG. 3.

[0099] In step S1246, the microcomputer 108 sets to prohibit accepting operations other than the power ON / OFF operation of the imaging device 100 among the operation inputs from the operation switch group 109.

[0100] In step S1247, the microcomputer 108 determines whether the display unit 107 is attached to the imaging device 100. If the microcomputer 108 determines that the display unit 107 is attached to the imaging device 100 (YES), the process proceeds to step S1248. On the other hand, if the microcomputer 108 determines that the display unit 107 is not attached to the imaging device 100 (NO), the process returns to step S1246.

[0101] In step S1248, the microcomputer 108 controls the entire imaging device 100 to set to be able to accept operation inputs from the operation switch group 109. Then, the process ends.

[0102] In step S1249, the microcomputer 108 controls each block of the imaging device 100 to perform HDMI YCC output. The HDMI YCC output performed here is the same as the HDMI YCC output described with reference to FIG. 8. Then, the process ends.

[0103] By processing in this way, even when setting the HDMI RAW output mode, it becomes possible to perform the main body operation (return from the HDMI RAW output mode) by outputting in the HDMI YCC output mode for a predetermined time at startup.

[0104] According to the present embodiment, when the HDMI RAW output mode is selected in a state where the display unit 107 is not connected to the imaging device 100, the microcomputer 108 controls the HDMI output to be performed in the HDMI RAW output mode. Also, at this time, the microcomputer 108 temporarily controls the HDMI output to be performed in the HDMI RAW output mode, or controls not to accept operations other than operations related to power while performing the HDMI output of RAW image data in the HDMI RAW output mode. Thereby, even when connected to a device that does not support HDMI RAW in a state where the display unit 107 is not connected to the imaging device 100, it is possible to prevent the imaging device 100 from becoming inoperable or being erroneously operated.

[0105] In the above description, each process has been performed starting from the power-on of the imaging device 100 (step S1101), but it is not limited to this. For example, each process after step S1101 may be executed starting from the change in the setting of the imaging device 100, such as changing the size of the video signal captured by the image sensor 102.

[0106] Note that the present invention is not limited to these specific embodiments, and various forms within the scope not departing from the gist of the present invention are also included in the present invention. Also, a part of the above-described embodiments may be appropriately combined.

[0107] (Other Embodiments of the Present Invention) The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. Also, it can be realized by a circuit (for example, ASIC) that realizes one or more functions.

[0108] Note that the above-described embodiments are merely examples of the implementation of the present invention, and the technical scope of the present invention should not be construed in a limited manner by these. That is, the present invention can be implemented in various forms without departing from its technical idea or its main features.

[0109] The disclosure of this embodiment includes the following configurations and methods, etc. (Configuration 1) A first generation means for generating RAW image data, A second generation means for developing the RAW image data to generate developed data, An output means for outputting the RAW image data or the developed data to the outside, An imaging device having a control means for controlling the output means to output the RAW image data or the developed data based on the mounting state of the display means, which is detachable from the imaging device and displays the developed data, with respect to the imaging device and the settings related to the output of the output means. (Configuration 2) The imaging device according to Configuration 1, wherein the control means controls the output means to output the developed data if the display means is not attached to the imaging device when the setting at the start of the imaging device is a setting to output the RAW image data from the output means. (Configuration 3) The imaging device according to Configuration 2, wherein the control means controls the output means to output the RAW image data when an instruction to output the RAW image data from the output means is given after the imaging device is started. (Configuration 4) The imaging device according to Configuration 2 or 3, wherein the control means controls the output means to output the RAW image data when a predetermined time has elapsed after the imaging device is started. (Configuration 5) The control means controls to output the RAW image data by the output means, and sets to prohibit accepting an operation on the imaging device, the imaging device according to Configuration 3 or 4. (Configuration 6) The control means sets to prohibit accepting an operation other than an operation related to power supply on the imaging device, the imaging device according to Configuration 5. (Configuration 7) When the display means is attached to the imaging device in a state where the control means sets to prohibit accepting an operation on the imaging device, the control means sets to enable accepting an operation on the imaging device, the imaging device according to Configuration 5 or 6. (Configuration 8) When a setting to output the RAW image data from the output means is instructed while the display means is not attached to the imaging device, the control means controls to output the developed data by the output means, the imaging device according to any one of Configurations 1 to 7. (Configuration 9) When the display means is attached to the imaging device in a state where a setting to output the RAW image data is instructed, the control means controls to output the RAW image data by the output means, the imaging device according to Configuration 8. (Configuration 10) When a setting to output the RAW image data from the output means is instructed while the display means is not attached to the imaging device, the control means controls to output, by the output means, display information for performing a warning display prompting attachment of the display means to the imaging device, the imaging device according to any one of Configurations 1 to 9. (Configuration 11) When the display means is attached to the imaging device while the warning display is being displayed, the control means controls to output the RAW image data by the output means, the imaging device according to Configuration 10. (Configuration 12) When the control means is started multiple times with a setting to output the RAW image data from the output means in a state where the display means is not attached to the imaging device, the control means controls to output the developed data by the output means. The imaging device according to any one of Configurations 1 to 11. (Configuration 13) When the startup setting of the imaging device is a setting to output the RAW image data from the output means, if the display means is not attached to the imaging device, the control means controls to output the RAW image data by the output means and sets the acceptance of operations on the imaging device to be prohibited. The imaging device according to Configuration 1. (Configuration 14) The control means sets the acceptance of operations on the imaging device other than operations related to the power supply of the imaging device to be prohibited. The imaging device according to Configuration 13. (Configuration 15) When the control means sets the acceptance of operations on the imaging device to be prohibited and the display means is attached to the imaging device, the control means sets the acceptance of operations on the imaging device to be possible. The imaging device according to Configuration 13 or 14. (Method 1) A first generation step of generating RAW image data; A second generation step of developing the RAW image data to generate developed data; An output step of outputting the RAW image data or the developed data to the outside by an output means; Based on the attachment state of the display means, which is detachable from the imaging device and displays the developed data, to the imaging device and the setting related to the output of the output means, a control step of controlling to output the RAW image data or the developed data by the output means. A control method for an imaging device. (Program 1) To the computer of the imaging device, A first generation step of generating RAW image data; A second generation step of developing the RAW image data to generate developed data; An output step of outputting the RAW image data or the developed data to the outside by output means A program for causing execution of a control step of controlling to output the RAW image data or the developed data by the output means based on a mounting state of the display means that is detachable from the imaging device and displays the developed data with respect to the imaging device and settings regarding output of the output means

Explanation of Signs

[0110] 100: Imaging device 101: Lens unit 102: Image sensor 103: Image processing unit 104: Resizing unit for display 105: Resizing unit for recording 106: OSD generation unit 107: Display unit 108: Microcomputer 109: Operation switch group 110: ROM 111: RAM 112: Memory card controller 113: Memory card 114: Compression / expansion unit 115: External output unit 116: Bus

Claims

1. a first generation means for generating RAW image data; a second generation means for developing the RAW image data to generate developed data; an output means for outputting the RAW image data or the developed data to the outside; an imaging device, a control means for controlling the RAW image data or the developed data to be output by the output means based on the attached state of the display means for displaying the developed data with respect to the imaging device, which is detachable from the imaging device, and the setting regarding the output of the output means. The imaging device is characterized by having these components.

2. When the setting at the startup of the imaging device is to output the RAW image data from the output means, if the display means is not attached to the imaging device, the control means controls the developed data to be output by the output means. The imaging device according to Claim 1 is characterized by this.

3. After the imaging device is started up, when an instruction to output the RAW image data from the output means is given, the control means controls the RAW image data to be output by the output means. The imaging device according to Claim 2 is characterized by this.

4. When a predetermined time has elapsed since the imaging device was started up, the control means controls the RAW image data to be output by the output means. The imaging device according to Claim 2 is characterized by this.

5. The control means controls the RAW image data to be output by the output means and sets the acceptance of operations on the imaging device to be prohibited. The imaging device according to Claim 3 is characterized by this.

6. The control means sets the acceptance of operations other than operations related to the power supply of the imaging device to be prohibited. The imaging device according to Claim 5 is characterized by this.

7. In a state where the control means has set the acceptance of operations on the imaging device to be prohibited, when the display means is attached to the imaging device, the control means sets the acceptance of operations on the imaging device to be possible. The imaging device according to Claim 5 is characterized by this.

8. When the display means is not attached to the imaging device and an instruction to output the RAW image data from the output means is given, the control means controls the developed data to be output by the output means. The imaging device according to Claim 1 is characterized by this.

9. The imaging device according to claim 8, wherein the control means controls to output the RAW image data by the output means when the display means is attached to the imaging device in a state where a setting to output the RAW image data is instructed.

10. The imaging device according to claim 1, wherein the control means controls to output, by the output means, display information for performing a warning display prompting attachment of the display means to the imaging device when a setting to output the RAW image data from the output means is instructed while the display means is not attached to the imaging device.

11. The imaging device according to claim 10, wherein when the display means is attached to the imaging device while the warning display is being displayed, the control means controls to output the RAW image data by the output means.

12. The imaging device according to claim 1, wherein the control means controls to output the developed data by the output means when the imaging device is started up a plurality of times with a setting to output the RAW image data from the output means while the display means is not attached to the imaging device.

13. The imaging device according to claim 1, wherein when the startup setting of the imaging device is a setting to output the RAW image data from the output means, if the display means is not attached to the imaging device, the control means controls to output the RAW image data by the output means and sets the acceptance of operations on the imaging device to be prohibited.

14. The imaging device according to claim 13, wherein the control means sets the acceptance of operations other than operations related to the power supply of the imaging device to be prohibited.

15. The imaging device according to claim 13, wherein the control means sets the acceptance of operations on the imaging device to be possible when the display means is attached to the imaging device while the acceptance of operations on the imaging device is set to be prohibited.

16. A first generation step of generating RAW image data; A second generation step of developing the RAW image data to generate developed data; An output step of outputting the RAW image data or the developed data to the outside by an output means; A control method for an imaging device, comprising a control step of controlling to output the RAW image data or the developed data by the output means based on a mounting state of a display means that is detachable from the imaging device and displays the developed data with respect to the imaging device, and a setting related to the output of the output means.

17. A program for causing a computer of an imaging device to execute a first generation step of generating RAW image data, a second generation step of developing the RAW image data to generate developed data, an output step of externally outputting the RAW image data or the developed data by an output means, and a control step of controlling to output the RAW image data or the developed data by the output means based on a mounting state of a display means that is detachable from the imaging device and displays the developed data with respect to the imaging device, and a setting related to the output of the output means.

Images