Imaging apparatus, control method for the same, and program

Abstract

To prevent a user from recognizing a device malfunction or erroneous operation when RAW image data is output to an unsupported device.SOLUTION: An imaging apparatus has first generating means for generating RAW image data, arrangement means for arranging the generated RAW image data and metadata corresponding to the RAW image data in an image region of a video format in YCC format and arranging at least one of developed data obtained by developing the RAW image data and display information indicating that the RAW image data is being output, in a region of the image region where neither the RAW image data nor the metadata is arranged, and output means for outputting the generated RAW image data, the metadata, the developed data, and display information arranged by the arrangement means.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to an imaging device, a control method of the imaging device, and a program.

Background Art

[0002] As a method of simultaneously outputting an image and information related to the image, a technique of embedding metadata corresponding to the image data in the image data is known. Patent Document 1 discloses a technique of embedding metadata (watermark information) in one or a plurality of chrominance portions of video data.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] An object of the present invention is to prevent a device failure or malfunction from being recognized by a user when RAW image data is output to a device that does not support it.

Means for Solving the Problems

[0005] The imaging device according to the present invention includes: a first generation unit that generates RAW image data; an arrangement unit that arranges the generated RAW image data and metadata corresponding to the RAW image data in an image area in a video format of YCC format, and arranges at least one of developed data obtained by developing the RAW image data in an area where the RAW image data and the metadata are not arranged in the image area and display information indicating that the RAW image data is output; and an output unit that outputs the RAW image data, the metadata, the developed data, and the display information arranged by the arrangement unit.

Effects of the Invention

[0006] According to the present invention, when RAW image data is output to a device that does not support it, it is possible to prevent the device from malfunctioning or operating incorrectly and being recognized by the user.

Brief Description of the Drawings

[0007]

Figure 1

Figure 2A

Figure 2B

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Embodiments for Carrying Out the Invention

[0008] Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[0009] FIG. 1 is a block diagram showing a configuration example of an imaging device 100. The lens unit 101 is an optical system composed of a fixed lens group for focusing, a zoom lens group, a diaphragm, a correction lens group, etc. The correction lens group is a lens group having both a function of correcting the imaging position shifted by the movement of the zoom lens group and a function of performing focus adjustment. The lens unit 101 forms a subject image on the imaging surface of the image sensor 102 described later. The lens unit 101 is detachable from the imaging device 100.

[0010] The image sensor 102 is an imaging device such as a CCD image sensor or a CMOS image sensor, which converts light into charges to generate an imaging signal. The imaging signal generated by the image sensor 102 is output to, for example, the image processing unit 103. Note that, as the imaging device, a so-called dual pixel type in which all pixels on the imaging surface are each composed of a pair of light receiving elements and the pair of optical images formed by the microlenses in each pixel can be photoelectrically converted by the pair of light receiving elements may be used.

[0011] The image processing unit 103 has a function of converting the imaging signal output from the image sensor 102 into RAW image data (RAW image). Further, the image processing unit 103 has a function of performing RAW development processing such as interpolation processing and image quality adjustment processing on the converted RAW image data to generate YCC format image data (developed data) corresponding to the RAW image data, and a function of resizing the YCC format image data. Data such as the RAW image data and the YCC format image data obtained by the image processing unit 103 are stored in the RAM 111 or output to other blocks. The image processing unit 103 is an example of the first generation means and the second generation means.

[0012] The display resizing unit 104 performs a resizing process on the YCC format image data stored in the RAM 111 to generate display image data. The display resizing unit 104 stores the generated display image data in the RAM 111. The recording resizing unit 105 performs a resizing process on the YCC format image data stored in the RAM 111 to generate recording image data. The recording resizing unit 105 stores the generated recording image data in the RAM 111.

[0013] The on-screen display (OSD) generation unit 106 generates OSD data related to the on-screen display (OSD, display information to be superimposed). The OSD generation unit 106 stores the generated OSD data in the RAM 111. The OSD data includes OSD data such as various setting menus, titles, and time. The OSD generation unit 106 is an example of a third generation means. The OSD data stored in the RAM 111 is, for example, synthesized with the display image data stored in the RAM 111 and then displayed on the display unit 107 or output to the outside from the external output unit 115. The display unit 107 is a display member for displaying the display image data and the OSD (display information). The display unit 107 is, for example, a liquid crystal panel or an organic EL panel. Note that the display unit 107 may be configured to be detachable from the imaging device 100.

[0014] The microcomputer (hereinafter also referred to as the microcontroller) 108 controls the entire imaging device 100. The microcontroller 108 is an example of an arrangement means and a determination means. The operation switch group 109 is an operation member for the user to perform operation inputs. The operation switch group 109 also includes a switch for selecting any one of a camera mode for performing camera shooting, a playback mode for playback, and a power-off mode for turning off the power.

[0015] The ROM (Read Only Memory) 110 is, for example, a flash ROM and stores programs executed by the microcontroller 108 and the like. A partial area of the ROM 110 is used for backup to hold the state of the system and the like. The RAM (Random Access Memory) 111 is a volatile memory used as a work memory by the microcontroller 108, the image processing unit 103, the compression / decompression unit 114, and the like. A memory area for display output (hereinafter also referred to as display output VRAM) and a memory area for HDMI output (hereinafter also referred to as HDMI output VRAM) are provided, for example, in the RAM 111.

[0016] The memory card controller 112 records the moving image data generated by the compression / expansion unit 114 and output to the RAM 111 onto the memory card 113 according to a format compatible with a computer such as the FAT file system. The memory card 113 is a removable recording medium for the imaging device 100 and can also be attached to a computer or the like other than the imaging device 100. The compression / expansion unit 114 encodes the image data stored in the RAM 111 (for example, MPEG compression) to generate moving image data and outputs it to the RAM 111.

[0017] The external output unit 115 outputs the display image data output by the image processing unit 103 to the RAM 111 externally. The external output unit 115 is an interface compliant with, for example, the HDMI (registered trademark) standard or the SDI standard. The external output unit 115 can output the display image data as a signal of a standard such as 4K60P or 2K60P. The bus 116 is a bus for data exchange between each part of the imaging device 100.

[0018] Next, with reference to FIGS. 2A and 2B, a process in which the imaging device 100 outputs RAW data and information related to the RAW data using an HDMI signal (a video signal compliant with the HDMI standard) will be described. FIGS. 2A and 2B are flowcharts showing processing examples of the imaging device 100. Each process in the flowcharts of FIGS. 2A and 2B is controlled by the microcomputer 108 of the imaging device 100 executing a program stored in the ROM 110.

[0019] In step S201, the microcomputer 108 of the imaging device 100 determines whether a menu operation using the operation switch group 109 has been performed. This menu operation is an operation for setting the operation of the imaging device 100. For example, it is an operation for setting the resolution of the video signal captured by the image sensor 102 or setting the bit rate encoded by the compression / decompression unit 114. Also, through this menu operation, HDMI RAW output mode setting and the like, which will be described later, are also performed. When the microcomputer 108 determines that a menu operation has been performed (YES), the microcomputer 108 stores the information set by the menu operation as mode information in the RAM 111, and the process proceeds to step S202. When the microcomputer 108 determines that no menu operation has been performed (NO), the process proceeds to step S203.

[0020] In step S202, the microcomputer 108 performs mode setting processing and controls each block in the imaging device 100 to transition to the mode set in step S201.

[0021] In step S203, the microcomputer 108 refers to the information held in the RAM 111 and determines whether HDMI has been connected. HDMI connection means a state in which the HDMI connection process described later has been completed, and the information in this state is held in the RAM 111 by the processing in step S205. When the microcomputer 108 determines that HDMI has been connected (YES), the process proceeds to step S206. When the microcomputer 108 determines that HDMI has not been connected (NO), the process proceeds to step S204.

[0022] In step S204, the microcomputer 108 controls the external output unit 115 to determine whether a hot plug detection signal (HPD) conforming to the HDMI standard is detected and whether the signal lines of the TMDS signal conforming to the HDMI standard are pulled up. If the microcomputer 108 determines that the hot plug detection signal is detected and the signal lines of the TMDS signal are pulled up (YES), the microcomputer 108 determines that there is an HDMI connection, and the process proceeds to step S205. Otherwise (NO), the microcomputer 108 determines that there is no HDMI connection and ends the processes shown in FIGS. 2A and 2B.

[0023] In step S205, the microcomputer 108 performs HDMI connection processing. In the HDMI connection processing, the microcomputer 108 controls the external output unit 115 to obtain the EDID of a sink device (HDMI receiver such as a monitor, a projector, or a recorder) connected to the external output unit 115 via HDMI. The EDID is information of the sink device connected via the external output unit 115 and is composed of data of video formats supported by the sink device, vendor-specific data, and the like. The microcomputer 108 stores the obtained EDID in the RAM 111. Then, the process proceeds to step S206.

[0024] In step S206, the microcomputer 108 determines whether the imaging device 100 is in the camera mode. The camera mode is a mode in which various signal processes are performed on video data collected by the lens unit 101 and captured by the image sensor 102, and the processed data is recorded on the memory card 113, displayed on the display unit 107, or output to the external output unit 115. Note that, in addition to the camera mode, the imaging device 100 also has a playback mode in which video data recorded on the memory card 113 is displayed on the display unit 107 or output to the external output unit 115. If the microcomputer 108 determines that the imaging device 100 is in the camera mode (YES), the process proceeds to step S207. On the other hand, if the microcomputer 108 determines that the imaging device 100 is not in the camera mode (NO), the microcomputer 108 ends the processes shown in FIGS. 2A and 2B.

[0025] In step S207, the microcomputer 108 refers to the mode information held in the RAM 111, controls the image sensor 102, etc. according to the mode information, and captures RAW image data (RAW image) related to the subject image. Hereinafter, "RAW image data" is also simply referred to as "RAW data". The captured RAW data is held in the RAM 111.

[0026] In step S208, the microcomputer 108 controls the image processing unit 103 to perform gamma processing on the RAW data captured in step S207.

[0027] In step S209, the microcomputer 108 refers to the mode information held in the RAM 111 and determines whether the imaging device 100 is in the HDMI RAW output mode. The HDMI RAW output mode is a mode in which the imaging device 100 outputs the RAW data captured in step S207 and subjected to gamma processing in step S208 to an external sink device via the external output unit 115. If the microcomputer 108 determines that the imaging device 100 is in the HDMI RAW output mode (YES), the process proceeds to step S210. If the microcomputer 108 determines that the imaging device 100 is not in the HDMI RAW output mode (NO), the process proceeds to step S211.

[0028] In step S210, the microcomputer 108 controls the image processing unit 103 to write the RAW data subjected to gamma processing in step S208 as RAW data for HDMI RAW output to the HDMI output VRAM.

[0029] Here, with reference to FIGS. 3 and 4, the RAW data written to the RAM 111 will be described. In FIG. 3(A), 300 indicates the entire RAW data for HDMI RAW output written to the RAM 111 in step S210. The RAW data is composed of data in the Effective Pixel Area 301 and data in the Additional Pixel Area 302. As shown in FIG. 3(A), the Additional Pixel Area 302 is an area where several pixels are added to the left, right, top, and bottom of the Effective Pixel Area 301, and the pixels in this Additional Pixel Area 302 are used when developing the upper, lower, left, and right ends of the Effective Pixel Area 301. Due to such a configuration, the data written in step S210 is the sum of the Effective Pixel Area and the Additional Pixel Area as shown in FIG. 3(B). For example, in the case of 4K RAW data, data for a total of 4120 x 2176 pixels, obtained by adding 12 pixels in the left and right Additional Pixel Areas and 8 pixels in the upper and lower Additional Pixel Areas to the 4096 x 2160 pixels in the Effective Pixel Area, is written to the RAM 111.

[0030] FIG. 4 is a diagram for explaining the details of the RAW data written to the RAM 111 in step S210. In FIG. 4, as shown at 400, the RAW data is configured in an R / Gr / Gb / B Bayer array. The 4K RAW data has this Bayer array arranged 2060 in the horizontal direction (4120 pixels as pixel data) as shown at 401 and 1088 in the vertical direction (2176 pixels as pixel data) as shown at 402. Note that the data size is 4120 (horizontal) x 2176 (vertical) x 12 (bit depth) ÷ 8 (from bits to bytes) = 13447680 bytes.

[0031] Returning to FIG. 2A, in step S211, the microcomputer 108 controls the image processing unit 103 to perform RAW data correction processing on the RAW data captured in step S207. This RAW data correction processing includes pre-development lens correction processing (such as peripheral light amount correction processing, magnification chromatic aberration correction, etc.) and processing such as white balance. The data used for the pre-development lens correction processing is stored in the ROM 110 in advance for each lens type, and the microcomputer 108 determines the parameters of the pre-development lens correction processing based on this stored data and the type of the lens unit 101 mounted on the imaging device 100.

[0032] In step S212, the microcomputer 108 controls the image processing unit 103 to perform development processing on the image data that has been subjected to the correction processing in step S211. This development processing includes processing such as Debayer, γ processing, and color bleeding correction. Regarding the color bleeding correction, the microcomputer 108 determines the correction processing parameters based on the data stored in the ROM 110 in advance and the type of the lens unit 101 mounted on the imaging device 100. By performing the development processing, the RAW data becomes data in the YCC4:2:2 format. The image data (developed data) after the development processing is stored in the RAM 111.

[0033] In step S213, the microcomputer 108 controls the image processing unit 103 to perform development data correction processing such as distortion correction on the data in the YCC4:2:2 format generated in step S212 and stored in the RAM 111. Regarding this distortion correction, the microcomputer 108 also determines the distortion correction parameters based on the data stored in the ROM 110 in advance and the type of the lens unit 101 mounted on the imaging device 100. The developed and corrected data (in the YCC4:2:2 format) corrected in step S213 is stored in the RAM 111.

[0034] In step S214, the microcomputer 108 refers to the mode information held in the RAM 111 to determine whether the imaging device 100 is in the HDMI RAW output mode. If the microcomputer 108 determines that the imaging device 100 is in the HDMI RAW output mode (YES), the process proceeds to step S220 shown in FIG. 2B. If the microcomputer 108 determines that the imaging device 100 is not in the HDMI RAW output mode (NO), the process proceeds to step S215.

[0035] In step S215, the microcomputer 108 controls the display resizing unit 104 to resize the post-development correction data (in the YCC4:2:2 format) stored in the RAM 111 to the size for HDMI output. Then, the microcomputer 108 writes the post-development correction data resized to the size for HDMI output to the VRAM for HDMI output.

[0036] In step S216, the microcomputer 108 controls the external output unit 115 to output the data for HDMI output written to the VRAM for HDMI output in step S215 to the sink device via an HDMI signal.

[0037] In step S217, the microcomputer 108 determines whether the display unit 107 is attached to the imaging device 100. If the microcomputer 108 determines that the display unit 107 is attached to the imaging device 100 (YES), the process proceeds to step S218. On the other hand, if the microcomputer 108 determines that the display unit 107 is not attached to the imaging device 100 (NO), the process returns to step S201.

[0038] In step S218, the microcomputer 108 controls the display resizing unit 104 to resize the post-development correction data (in the YCC4:2:2 format) stored in the RAM 111 to the display size of the display unit 107. Then, the microcomputer 108 writes the post-development correction data resized to the display size of the display unit 107 to the VRAM for display output.

[0039] In step S219, the microcomputer 108 outputs the display output data written to the display output VRAM in step S218 to the display unit 107. As a result, the image data for display output is displayed on the display unit 107. Thereafter, the process returns to step S201.

[0040] In step S220 shown in FIG. 2B, the microcomputer 108 writes the metadata corresponding to the RAW data to the area after the RAW data written to the RAM 111 (HDMI output VRAM) in step S210. The metadata includes, for example, data (correction information) used for the correction process of the corresponding RAW data.

[0041] Here, with reference to FIGS. 5 and 6, the memory area (HDMI output VRAM) for HDMI output to which data is written in steps S210 and S220 will be described.

[0042] FIG. 5 is a diagram for explaining the HDMI output VRAM when outputting 4096x2160 pixel YCC4:2:2 format 12-bit video data by an HDMI signal. As shown in FIG. 5, this memory area 500 has an image area of 4096 pixels in the horizontal direction as shown in 502 and 2160 pixels in the vertical direction as shown in 503. And in FIG. 5, as shown by 501, the image data is composed in units of 2 pixels (for two Y data, there is one Cb and one Cr data each), and the size of each data is 12 bits for each of the Y, Cb, and Cr data. The data size of one line (horizontal direction) in this HDMI output VRAM is 4096 (horizontal) x 2 (since there are 4 data (2 Ys, 1 Cb, and 1 Cr in 2 pixels)) x 12 (bit depth) ÷ 8 (from bits to bytes) = 12288 bytes. Also, for the entire HDMI output VRAM, the data size is 4096 (horizontal) x 2160 (vertical) x 2 (4 data in 2 pixels) x 12 (bit depth) ÷ 8 (from bits to bytes) = 26542080 bytes.

[0043] FIG. 6 is a diagram for explaining a state in which RAW data is written in step S210 and metadata is written in step S220 with respect to the VRAM for HDMI output (image area in the video format of YCC4:2:2). Note that the size of the RAW data is 4120 (horizontal) x 2176 (vertical) x 12 (bit depth) ÷ 8 (from bit to byte) = 13447680 bytes as described with reference to FIG. 4.

[0044] In FIG. 6, as shown at 601, Bayer data (the data of R and Gr in the first column, and the data of Gr and B in the second column) is arranged without gaps in the image area where each data column of Cb, Y, Cr, and Y in the VRAM for HDMI output is arranged. The size of the RAW data is 13447680 bytes, and the data size of one line in the VRAM for HDMI output is 12288 bytes. Therefore, in FIG. 6, as shown at 602, the RAW data with a bit depth of 12 bits and 4120 x 2176 pixels can be stored in 1095 lines (13447680 ÷ 12288 = 1094.375) in the VRAM for HDMI output. And since the area after the RAW data (lines 1096 to 2160 in the VRAM for HDMI output) is an empty area, as shown at 603, the metadata corresponding to the RAW data arranged up to the 1095th line is arranged in this image area. The metadata includes, for example, the γ data of the RAW data (γ in step S209). Also, the metadata includes, for example, the parameters used in the development process and correction process in the imaging device 100 (parameters of the RAW data correction process in step S211, parameters of the development process in step S212, parameters of the developed data correction process in step S213).

[0045] Returning to FIG. 2B, in step S221, the microcomputer 108 analyzes the EDID of the sink device acquired in step S205 and held in the RAM 111, and determines whether the sink device is a non-HDMI RAW compatible device. If the microcomputer 108 determines that the sink device is a non-HDMI RAW compatible device (YES), the process proceeds to step S222. If the microcomputer 108 determines that the sink device is not a non-HDMI RAW compatible device, that is, it is an HDMI RAW compatible device (NO), the process proceeds to step S224.

[0046] Note that an HDMI RAW compatible device is a device that can record RAW data mapped to the image area in the YCC 4:2:2 format 12-bit video format of HDMI described in FIG. 6, develop it, and display it on a monitor. That is, it is a device compatible with RAW image data. Also, a non-HDMI RAW compatible device is a device that cannot perform operations like the aforementioned compatible device and interprets RAW data mapped to the image area in the YCC 4:2:2 format 12-bit video format of HDMI as YCC data. That is, it is a device incompatible with RAW image data. Note that since the data formats of RAW data and YCC data are different, if RAW data is interpreted as YCC data and processed, a broken image will be displayed for the RAW data part.

[0047] In step S222, the microcomputer 108 controls the image processing unit 103 to resize the developed and corrected data (in the YCC 4:2:2 format) generated in step S213 and stored in the RAM 111. Then, the microcomputer 108 writes the resized developed and corrected data as YCC 4:2:2 format image data to the empty area of the HDMI output VRAM where metadata was written in step S220.

[0048] Regarding the process in step S222, it will be described with reference to FIG. 7. 701 shown in FIG. 7(A) is the post-development correction data (in the YCC4:2:2 format) stored in the RAM 111 in step S213, and its size is 4096x2160 pixels. As shown in FIG. 7(B), in the HDMI output VRAM, RAW data is arranged from the first line to the 1095th line as shown by 711 by the process in step S210. Also, by the process in step S220, metadata is arranged on the 1096th line as shown by 712. Since the areas from the 1097th line to the 2160th line in the HDMI output VRAM are empty areas, the microcomputer 108 reduces and arranges the YCC format image data in this empty area. Specifically, as shown by 713, the post-development correction data (in the YCC4:2:2 format) stored in the RAM 111 in step S213 is resized to a size of 2018x1064 pixels by the image processing unit 103 and arranged in the empty area as YCC reduction data. Since this image is in the YCC format, it can be displayed even on devices that do not support the display of the RAW data in 711 (HDMI RAW non-compatible devices). Note that the area 714 where none of the RAW data, metadata, and YCC reduction data is arranged is used as a composite area for OSD display described later.

[0049] In step S223, the microcomputer 108 controls the OSD generation unit 106 to generate OSD data regarding the warning display OSD. The details regarding this OSD will be described later with reference to FIG. 8.

[0050] In step S224, the microcomputer 108 determines whether the imaging device 100 is in the recording state. The recording state refers to the operation of resizing the post-development correction data stored in the RAM 111 in step S213 to the recording size by the recording resizing unit 105, compressing it by the compression / decompression unit 114, and then recording it on the memory card 113 via the memory card controller 112. If the microcomputer 108 determines that the imaging device 100 is in the recording state (YES), the process proceeds to step S225. On the other hand, if the microcomputer 108 determines that the imaging device 100 is not in the recording state (NO), the process proceeds to step S228.

[0051] In step S225, the microcomputer 108 analyzes the EDID of the sink device acquired in step S205 and held in the RAM 111, and determines whether the sink device is not compatible with HDMI RAW. If the microcomputer 108 determines that the sink device is not compatible with HDMI RAW (YES), the process proceeds to step S226. If the microcomputer 108 determines that the sink device is compatible with HDMI RAW (NO), the process proceeds to step S227.

[0052] In step S226, the microcomputer 108 controls the OSD generation unit 106 to add an OSD indicating "Rec command not issued" to the warning display OSD to generate OSD data. The content regarding this OSD will be described later with reference to FIG. 8. Here, the Rec command (recording command) is an operation for the HDMI source device to notify the sink device that it is in the recording state. For example, the microcomputer 108 can control the external output unit 115 to control a specific bit of the VSIF (Vender-Specific InfoFrame) to a high level or a low level and output it, thereby notifying the information as the Rec command. Here, although an OSD display indicating that the Rec command is not issued is performed without outputting the Rec command, an OSD display indicating that the Rec command is being issued to the HDMI RAW-incompatible device may be performed after superimposing the Rec command. Thereafter, the process proceeds to step S228.

[0053] In step S227, the microcomputer 108 controls the external output unit 115 to send a Rec command to the source device. After that, the process proceeds to step S228.

[0054] In step S228, the microcomputer 108 analyzes the EDID of the sink device acquired in step S205 and held in the RAM 111, and determines whether the sink device is a non-HDMI RAW compatible device. If the microcomputer 108 determines that the sink device is a non-HDMI RAW compatible device (YES), the process proceeds to step S229. If the microcomputer 108 determines that the sink device is an HDMI RAW compatible device (NO), the process proceeds to step S230.

[0055] In step S229, the microcomputer 108 controls the OSD generation unit 106 to generate OSD data related to the OSD of the mode change UI. The content related to this OSD will be described later with reference to FIG. 8.

[0056] In step S230, the microcomputer 108 determines whether the display unit 107 is attached to the imaging device 100. If the microcomputer 108 determines that the display unit 107 is attached to the imaging device 100 (YES), the process proceeds to step S231. On the other hand, if the microcomputer 108 determines that the display unit 107 is not attached to the imaging device 100 (NO), the process proceeds to step S235.

[0057] In step S231, the microcomputer 108 controls the display resizing unit 104 to resize the post-development correction data (in the YCC4:2:2 format) stored in the RAM 111 to the display size of the display unit 107. Then, the microcomputer 108 writes the post-development correction data resized to the display size of the display unit 107 to the VRAM for display output.

[0058] In step S232, the microcomputer 108 determines whether OSD data related to OSD display was generated in any of steps S223, S226, and S229. If the microcomputer 108 determines that OSD data related to OSD display was generated (YES), the process proceeds to step S233. If the microcomputer 108 determines that OSD data related to OSD display was not generated (NO), the process proceeds to step S234.

[0059] In step S233, the microcomputer 108 controls the image processing unit 103 to synthesize the OSD data generated in steps S223, S226, and S229 with the display output VRAM in which the post-development correction data was written in step S231. This content will be described later with reference to FIG. 8.

[0060] In step S234, the microcomputer 108 outputs the display output data stored in the display output VRAM to the display unit 107. As a result, the display unit 107 displays the display output image data. Then, the process proceeds to step S237.

[0061] In step S235, the microcomputer 108 determines whether OSD data related to OSD display was generated in any of steps S223, S226, and S229. If the microcomputer 108 determines that OSD data related to OSD display was generated (YES), the process proceeds to step S236. If the microcomputer 108 determines that OSD data related to OSD display was not generated (NO), the process proceeds to step S237.

[0062] In step S236, the microcomputer 108 controls the image processing unit 103 to synthesize the OSD data generated in steps S223, S226, and S229 with the HDMI output VRAM. Here, the OSD data is synthesized in the region (OSD synthesis region) 714 shown in FIG. 7(B). Then, the process proceeds to step S237.

[0063] In step S237, the microcomputer 108 controls the external output unit 115 to output the HDMI output data stored in the HDMI output VRAM to the sink device via an HDMI signal.

[0064] In step S238, the microcomputer 108 determines whether or not it has generated the OSD of the mode change UI and displayed the mode change UI in step S229. The microcomputer 108 determines that the mode change UI has been displayed if it has performed at least one of the display on the display unit 107 or the display on the sink device via the HDMI signal through the external output unit 115. If the microcomputer 108 determines that the mode change UI has been displayed (YES), the process proceeds to step S239. If the microcomputer 108 determines that the mode change UI has not been displayed (NO), the process returns to step S201.

[0065] In step S239, the microcomputer 108 determines whether or not a mode change has been instructed for the imaging device 100 via the operation switch group 109. If the microcomputer 108 determines that a mode change has been instructed (YES), the process proceeds to step S240. If the microcomputer 108 determines that a mode change has not been instructed (NO), the process returns to step S201.

[0066] In step S240, the microcomputer 108 controls each functional unit of the imaging device 100 to perform a mode change process. This mode change includes the switching processes of the camera mode and the playback mode described above, the switching processes of the HDMI RAW output mode and the YCC output mode, and the like. After performing the mode change process, the process returns to step S201.

[0067] Referring to FIG. 8, each of the above-described OSDs will be described. FIG. 8(A) is a diagram showing an example of the OSD generated in step S223. The OSD 801 shown in FIG. 8(A) is an OSD for warning display, and warns that the imaging device 100, which is the source device, is outputting RAW data by an HDMI signal to the sink device in the HDMI RAW output mode. Thereby, it is possible to recognize that RAW data is being output by the HDMI signal, and even if a broken image is displayed in a portion corresponding to the RAW data on an HDMI RAW-incompatible device, it is possible to prevent the user from recognizing it as a device failure or malfunction.

[0068] FIGS. 8(B) and 8(C) are diagrams showing an example of the OSD generated in step S226. The OSD 811 shown in FIG. 8(B) is an OSD when the Rec command is not output in step S226, and warns that although the imaging device 100 is recording, the Rec command is not being output because it is connected to an HDMI RAW-incompatible device. Further, the OSD 821 shown in FIG. 8(C) is an OSD when the Rec command is output in step S226, and warns that although the Rec command is being output, it cannot be recorded correctly because it is connected to an HDMI RAW-incompatible device.

[0069] FIG. 8(D) is a diagram showing an example of the OSD generated in step S229. The OSD 831 shown in FIG. 8(D) is an OSD that prompts the user for an operation instruction on whether to return the HDMI output from the HDMI RAW output mode to the YCC output mode because it is connected to an HDMI RAW-incompatible device. Here, when it is selected by the user operation to return to the YCC output, for example, an OSD 832 for selecting the resolution and frame rate for performing the YCC output is generated. Note that this selection result is reflected in the resizing process in step S215. Thereby, when an HDMI RAW-incompatible device is connected, it is possible to switch from the HDMI RAW output mode to the YCC output mode and appropriately display the captured image.

[0070] FIG. 8(E) is a diagram showing an example of a display image that is OSD synthesized in step S233 and displayed on the display unit 107 in step S234. As shown in FIG. 8(E), the OSDs generated in steps S223, S226, and S229 are superimposed on the image data 841 resized in step S231. By displaying such a display image, it is possible to recognize that RAW data is being output by the HDMI signal, and even if a broken image is displayed on the connected HDMI RAW-incompatible device, it can be understood that it is not due to a device failure or malfunction. Also, when an HDMI RAW-incompatible device is connected, it becomes possible to switch from the HDMI RAW output mode to the YCC output mode and appropriately display the captured image on the HDMI RAW-incompatible device.

[0071] FIG. 8(F) is a diagram showing an example of data that is OSD - synthesized in step S236 and output to a sink device by an HDMI signal in step S237. The output data 851 first has RAW data 852 arranged, and then metadata 853 is arranged in the subsequent area. Then, in the empty area after arranging the RAW data 852 and the metadata 853, YCC reduction data 854 written in step S222 and OSD data 855, 856 generated in steps S223, S226, and S229 are arranged. When this data is input to an HDMI RAW - compatible sink device, the sink device interprets this data as RAW data. Therefore, after developing the RAW data 852 with reference to the information of the metadata 853, display processing and recording processing are performed. On the other hand, when this data is input to an HDMI RAW - incompatible sink device, the sink device interprets this data as YCC data. Therefore, since the RAW data 852 and the metadata 853 are not YCC data, a broken image is displayed on the corresponding device as distorted data. On the other hand, since the YCC reduction data 854 and the OSD data 855, 856 are YCC data, they can be correctly displayed even on an HDMI RAW - incompatible device. As a result, even when the user displays RAW data on an HDMI RAW - incompatible device, the user can recognize that the video is distorted because the imaging device 100 is operating in the HDMI RAW output mode. Therefore, it is possible to prevent the user from recognizing a failure or malfunction of the HDMI RAW - incompatible device. Also, it becomes possible for the user to reset the imaging device 100 to the desired mode.

[0072] When the imaging device 100 in the present embodiment outputs RAW image data in the HDMI RAW output mode, it arranges and outputs development data and display information related to the HDMI RAW output mode in the empty area. As a result, when RAW image data is output in the HDMI RAW output mode to an HDMI RAW-incompatible device that does not support RAW image data, the development data and display information are normally displayed on the HDMI RAW-incompatible device. Therefore, even if a broken image is displayed in the RAW image data portion, it is possible to prevent the user from recognizing it as a failure or malfunction of the HDMI RAW-incompatible device.

[0073] In the above-described embodiment, when outputting RAW image data in the HDMI RAW output mode, all of the resized development data (YCC reduction data) 854, OSD 855, and OSD 856 are arranged. However, the present invention is not limited to this. Instead of all of the YCC reduction data 854, OSD 855, and OSD 856, a part of these may be arranged and output. By arranging even any one of them, the user can recognize that RAW image data is being output in the HDMI RAW output mode, and it is possible to prevent the user from recognizing it as a failure or malfunction of the device.

[0074] (Other Embodiments of the Present Invention) The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiment to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. Further, it can also be realized by a circuit (for example, an ASIC) that realizes one or more functions.

[0075] Note that the above-described embodiments are merely examples of specific implementations for carrying out the present invention, and the technical scope of the present invention should not be construed in a limited manner by these. That is, the present invention can be implemented in various forms without departing from its technical idea or its main features.

[0076] The disclosure of this embodiment includes the following configurations, methods, etc. (Configuration 1) A first generation means for generating RAW image data, placing the generated RAW image data and the metadata corresponding to the RAW image data in an image area in a video format of YCC format, and arranging at least one of the developed data obtained by developing the RAW image data in an area where the RAW image data and the metadata are not arranged in the image area and display information indicating that the RAW image data is output, An imaging device, comprising: output means for outputting the RAW image data, the metadata, the developed data, and the display information arranged by the arranging means. (Configuration 2) The imaging device according to Configuration 1, further comprising second generation means for developing the RAW image data to generate the developed data. (Configuration 3) The imaging device according to Configuration 1 or 2, further comprising third generation means for generating the display information. (Configuration 4) The arranging means further arranges display information for selecting whether to switch to arrange the developed data in an image area in a video format of YCC format according to the video format of YCC format in an area where the RAW image data and the metadata are not arranged in the image area. The imaging device according to any one of Configurations 1 to 3. (Configuration 5) When the device receiving the output of the output means is a device corresponding to the RAW image data, the arranging means does not arrange the developed data and the display information in an area where the RAW image data and the metadata are not arranged in the image area. The imaging device according to any one of Configurations 1 to 4. (Configuration 6) An imaging apparatus according to Configuration 5, comprising determination means for determining whether the device is a device corresponding to the RAW image data based on information acquired from a device that receives the output of the output means. (Configuration 7) Detachable from the imaging apparatus, having display means for displaying the development data, When the display means is not attached to the imaging apparatus, the arranging means arranges the display information in an area where the RAW image data and the metadata are not arranged in the image area. The imaging apparatus according to any one of Configurations 1 to 5, characterized in that. (Configuration 8) Having issuing means for issuing a recording command for recording the output of the output means to an external device, When the device that receives the output of the output means is a device that does not support the RAW image data, the issuing means does not issue the recording command. The imaging apparatus according to any one of Configurations 1 to 7, characterized in that. (Configuration 9) Having issuing means for issuing a recording command for recording the output of the output means to an external device, When the device that receives the output of the output means is a device that does not support the RAW image data, the recording command is added to the display information as being in the process of being issued, and the issuing means issues the recording command. The imaging apparatus according to any one of Configurations 1 to 7, characterized in that. (Configuration 10) First generation means for generating RAW image data, Arranging means for arranging the generated RAW image data and metadata corresponding to the RAW image data in an image area in a YCC format video format, and developing the RAW image data according to the YCC format video format in an area where the RAW image data and the metadata are not arranged in the image area. Selecting whether to switch to arrange the developed data in the image area in the YCC format video format. The arranging means for arranging the display information to be selected. An imaging apparatus, comprising: output means for outputting the RAW image data, the metadata, and the display information arranged by the arrangement means. (Configuration 11) When it is selected to switch the development data to be arranged in an image area in a YCC format video format according to the YCC format video format, a display for allowing selection of the resolution and frame rate related to the development data is performed. The imaging apparatus according to Configuration 10, characterized in that. (Method 1) A generation step of generating RAW image data; An arrangement step of arranging the generated RAW image data and the metadata corresponding to the RAW image data in an image area in a YCC format video format, and arranging at least one of development data obtained by developing the RAW image data in an area where the RAW image data and the metadata are not arranged in the image area and display information indicating that the RAW image data is being output; A control method for an imaging apparatus, comprising: an output step of outputting the RAW image data, the metadata, the development data, and the display information arranged in the arrangement step. (Method 2) A generation step of generating RAW image data; An arrangement step of arranging the generated RAW image data and the metadata corresponding to the RAW image data in an image area in a YCC format video format, and arranging display information for selecting whether to switch the development data obtained by developing the RAW image data according to the YCC format video format in an area where the RAW image data and the metadata are not arranged in the image area to be arranged in the image area in the YCC format video format; A control method for an imaging apparatus, comprising: an output step of outputting the RAW image data, the metadata, and the display information arranged in the arrangement step. (Program 1) On a computer of an imaging apparatus, A generation step of generating RAW image data; In an image area in a video format of the YCC format, arrange the generated RAW image data and the metadata corresponding to the RAW image data, and arrange at least one of the developed data obtained by developing the RAW image data in an area where the RAW image data and the metadata are not arranged in the image area and display information indicating that the RAW image data is output. An arrangement step; A program for executing an output step of outputting the RAW image data, the metadata, the developed data, and the display information arranged in the arrangement step. (Program 2) On the computer of the imaging device, A generation step of generating RAW image data; In an image area in a video format of the YCC format, arrange the generated RAW image data and the metadata corresponding to the RAW image data, and select whether to switch to arrange the developed data obtained by developing the RAW image data in accordance with the video format of the YCC format in an area where the RAW image data and the metadata are not arranged in the image area in the image area of the video format of the YCC format. An arrangement step of arranging display information; A program for executing an output step of outputting the RAW image data, the metadata, and the display information arranged in the arrangement step.

Explanation of Signs

[0077] 100: Imaging device 101: Lens unit 102: Image sensor 103: Image processing unit 104: Display resizing unit 105: Recording resizing unit 106: OSD generation unit 107: Display unit 108: Microcomputer 109: Operation switch group 110: ROM 111: RAM 112: Memory card controller 113: Memory card 114: Compression / expansion unit 115: External output unit 116: Bus

Claims

1. a first generation means for generating RAW image data; placing the generated RAW image data and the metadata corresponding to the RAW image data in an image area in a YCC format video format, and arranging at least one of development data obtained by developing the RAW image data in an area where the RAW image data and the metadata are not arranged in the image area and display information indicating that the RAW image data is output; an arranging means; An imaging device comprising: an output means for outputting the RAW image data, the metadata, the developed data, and the display information arranged by the arranging means.

2. The imaging device according to claim 1, further comprising a second generation means for developing the RAW image data to generate the developed data.

3. The imaging device according to claim 1, further comprising a third generation means for generating the display information.

4. The arranging means further arranges display information for selecting whether to switch to arrange the developed data in an image area in a YCC format video format according to the YCC format video format in an area where the RAW image data and the metadata are not arranged in the image area. The imaging device according to claim 1.

5. When the device receiving the output of the output means is a device corresponding to the RAW image data, the arranging means does not arrange the developed data and the display information in an area where the RAW image data and the metadata are not arranged in the image area. The imaging device according to claim 1.

6. The imaging device according to claim 5, further comprising a determination means for determining whether the device is a device corresponding to the RAW image data based on information obtained from the device receiving the output of the output means.

7. detachable from the imaging device, having display means for displaying the developed data, When the display means is not attached to the imaging device, the arranging means arranges the display information in an area where the RAW image data and the metadata are not arranged in the image area. The imaging device according to claim 1.

8. having an issuing means for issuing a recording command for recording the output of the output means to an external device, The imaging device according to claim 1, wherein when the device receiving the output of the output means is a device incompatible with the RAW image data, the issuing means does not issue the recording command.

9. having an issuing means for issuing a recording command for recording the output of the output means to an external device, The imaging device according to claim 1, wherein when the device receiving the output of the output means is a device incompatible with the RAW image data, the recording command being issued is added to the display information, and the issuing means issues the recording command.

10. a first generating means for generating RAW image data; an arranging means for arranging the generated RAW image data and the metadata corresponding to the RAW image data in an image area in a YCC format video format, and selecting whether to switch to arrange the developed data obtained by developing the RAW image data in accordance with the YCC format video format in the area of the image area where the RAW image data and the metadata are not arranged in the image area; an imaging device comprising: an output means for outputting the RAW image data, the metadata, and the display information arranged by the arranging means.

11. The imaging device according to claim 10, wherein when it is selected to switch to arrange the developed data in accordance with the YCC format video format in the image area in the YCC format video format, a display for selecting the resolution and frame rate related to the developed data is performed.

12. a generating step of generating RAW image data; an arranging step of arranging the generated RAW image data and the metadata corresponding to the RAW image data in an image area in a YCC format video format, and arranging at least one of the developed data obtained by developing the RAW image data and display information indicating that the RAW image data is being output in the area of the image area where the RAW image data and the metadata are not arranged; a control method for an imaging device, comprising: an output step of outputting the RAW image data, the metadata, the developed data, and the display information arranged in the arranging step.

13. a generating step of generating RAW image data; In an image area in a YCC format video format, arrange the generated RAW image data and metadata corresponding to the RAW image data, and develop the RAW image data in an area in the image area where the RAW image data and the metadata are not arranged according to the YCC format video format. Select whether to switch to arrange the developed data in the image area in the YCC format video format, and arrange display information for selection. An imaging device control method characterized by having an output step of outputting the RAW image data, the metadata, and the display information arranged in the arranging step.

14. On the computer of the imaging device, A generation step of generating RAW image data; In an image area in a YCC format video format, arrange the generated RAW image data and metadata corresponding to the RAW image data, and arrange at least one of the developed data obtained by developing the RAW image data in an area in the image area where the RAW image data and the metadata are not arranged and display information indicating that the RAW image data is being output. An arranging step; A program for causing the computer to execute an output step of outputting the RAW image data, the metadata, the developed data, and the display information arranged in the arranging step.

15. On the computer of the imaging device, A generation step of generating RAW image data; In an image area in a YCC format video format, arrange the generated RAW image data and metadata corresponding to the RAW image data, and select whether to switch to arrange the developed data obtained by developing the RAW image data according to the YCC format video format in an area in the image area where the RAW image data and the metadata are not arranged. An arranging step of arranging display information for selection; A program for causing the computer to execute an output step of outputting the RAW image data, the metadata, and the display information arranged in the arranging step.

Images