Imaging device, control method for imaging device, and program

Abstract

To output image data that is not RAW data such that display information such as icons and menu screens can be checked on a receiving side according to an operation state, even in the setting of outputting RAW data.SOLUTION: An imaging device includes output means that output RAW data or development data generated by processing the RAW data to an external device, and control means that outputs the RAW data by the output means when an operation state regarding image recording is a recording state in the setting of outputting the RAW data, and controls development data to be output by the output means when the development data is not in the recording state.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to an imaging device, a control method for the imaging device, and a program.

Background Art

[0002] An image captured by an imaging device may be output to an external device using an external output terminal of the imaging device, and the captured image may be confirmed on an external monitor or recorded on the external monitor itself. At this time, the image data to be output externally is specified in the output format on the imaging device side, or the information of the receiving device is acquired and the output format is changed to a format that can be received by the receiving device. Patent Document 1 describes a technique for transmitting image data captured by an imaging device to a receiving device via an HDMI (registered trademark) transmission path as RAW data without converting it to YCC format image data.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in Patent Document 1, when the receiving device supports RAW data and RAW data output is selected in the HDMI output selection menu, the imaging device always outputs RAW data to the receiving device via the HDMI transmission path regardless of the operating state or the like. When outputting this RAW data, display information such as icons and menu screens cannot be output to the receiving device, so the receiving device that receives the RAW data cannot display icons, menu screens, etc. and cannot confirm the information.

[0005] The present invention aims to enable the output of image data other than RAW data, even when the system is set to output RAW data, so that the receiving end can check display information such as icons and menu screens depending on the operating state. [Means for solving the problem]

[0006] The imaging device according to the present invention includes an output means for outputting RAW data or developed data generated by developing RAW data to an external source, and a control means for controlling the output means to output the RAW data if the operation state for recording an image is in the recording state, and to output the developed data if it is not in the recording state. Furthermore, the control means controls the output means to output the RAW data and a recording command indicating that it is in recording mode when the recording state is reached. It is characterized by the following: [Effects of the Invention]

[0007] According to the present invention, even when the system is set to output RAW data, it becomes possible to output image data other than RAW data, depending on the operating state, so that the receiving side can check display information such as icons and menu screens. [Brief explanation of the drawing]

[0008] [Figure 1] This figure shows an example of the configuration of an imaging device. [Figure 2] This is a flowchart showing the processing of the imaging device in Embodiment 1. [Figure 3] This is a diagram to explain RAW data. [Figure 4] This is a diagram to explain the details of the RAW data. [Figure 5] This is a diagram illustrating an example of on-screen display. [Figure 6] This is a diagram illustrating the memory area for HDMI output. [Figure 7] This diagram illustrates the state in which RAW data is stored in the memory area for HDMI output. [Figure 8]This diagram illustrates the state in which RAW data is stored in the memory area for HDMI output. [Figure 9] This is a diagram illustrating an example of the display in Embodiment 1. [Figure 10] This figure shows an example of the configuration of a receiving device. [Figure 11] This flowchart shows an example of processing by the imaging device in Embodiment 2. [Figure 12] This is a diagram illustrating an example of the display in Embodiment 2. [Figure 13] This flowchart shows an example of processing by the receiving device in Embodiment 2. [Modes for carrying out the invention]

[0009] Embodiments of the present invention will be described below with reference to the drawings.

[0010] <Embodiment 1> Figure 1 is a block diagram showing an example configuration of the imaging device 100. The lens unit 101 is an optical system composed of a fixed lens group for light collection, a variable magnification lens group, an aperture, and a corrective lens group. The corrective lens group has both the function of correcting the image formation position that has shifted due to the movement of the variable magnification lens group and the function of adjusting the focus. The lens unit 101 forms an image of the subject on the image formation plane of the image sensor 102, which will be described later. The lens unit 101 is detachable from the imaging device 100.

[0011] The image sensor 102 is an imaging element such as a CCD image sensor or a CMOS image sensor, which converts light into electric charge to generate an imaging signal. The imaging signal generated by the image sensor 102 is output to, for example, the image processing unit 103. Alternatively, a so-called dual-pixel type image sensor may be used, in which all pixels on the imaging surface are each composed of a pair of light-receiving elements, and a pair of optical images formed by microlenses at each pixel can be photoelectrically converted by the pair of light-receiving elements.

[0012] The image processing unit 103 converts the imaging signal output from the image sensor 102 into RAW data (RAW image). Further, the image processing unit 103 performs RAW development processing such as interpolation processing and image quality adjustment processing on the converted RAW data to generate developed data corresponding to the RAW data. In this embodiment, it is assumed that the developed data is image data in the YCC4:2:2 format. That is, the RAW data in this embodiment is the image data before the image data in the YCC4:2:2 format is converted. The RAW data (RAW image) and the developed data (image data in the YCC4:2:2 format) obtained by the image processing unit 103 are stored in the RAM 111.

[0013] The display resizing unit 104 performs resizing processing on the image data stored in the RAM 111 to generate display image data. The display resizing unit 104 stores the generated display image data in the RAM 111. The recording resizing unit 105 performs resizing processing on the image data stored in the RAM 111 to generate recording image data. The recording resizing unit 105 stores the generated recording image data in the RAM 111.

[0014] The on-screen display (OSD) generation unit 106 generates OSD data related to an on-screen display (OSD) such as icons and menu screens. The OSD generation unit 106 stores the generated OSD data in the RAM 111. The OSD data includes OSD data such as various setting menus, titles, and time. The OSD data stored in the RAM 111 is, for example, combined with the display image data stored in the RAM 111 and displayed on the display unit 107 or output to the outside from the external output unit 115. The display unit 107 is a display member for displaying the display image data and the OSD. The display unit 107 is, for example, a liquid crystal panel.

[0015] The microcomputer (hereinafter also referred to as the microcontroller) 108 controls the entire imaging device 100. The operation switch group 109 is an operation member for the user to perform operation inputs. Also, the operation switch group 109 includes a switch for selecting any one of a camera mode for performing camera shooting, a playback mode for playback, and a power-off mode for turning off the power.

[0016] The ROM (Read Only Memory) 110 is, for example, a flash ROM, and stores programs executed by the microcontroller 108 and the like. Also, a partial area of the ROM 110 is used for backup to hold the state of the system and the like. The RAM (Random Access Memory) 111 is a volatile memory used as a work memory by the microcontroller 108, the image processing unit 103, the compression / decompression unit 114, and the like.

[0017] The memory card controller 112 records the moving image data generated by the compression / decompression unit 114 and output to the RAM 111 on the memory card 113 according to a format compatible with a computer such as the FAT file system. The memory card 113 is a removable recording medium for the imaging device 100, and can also be attached to a computer or the like other than the imaging device 100. The compression / decompression unit 114 encodes the image data stored in the RAM 111 (for example, MPEG compression) to generate moving image data and outputs it to the RAM 111.

[0018] The external output unit 115 outputs the image data and the like output by the image processing unit 103 to the RAM 111 to the outside. The external output unit 115 is, for example, an interface compliant with the HDMI standard, the SDI standard, or the like. The external output unit can output image data as signals of standards such as 4K60P and 2K60P. The bus 116 is a bus for data exchange between each part of the imaging device 100.

[0019] Next, referring to Figure 2, the process by which the imaging device 100 in Embodiment 1 outputs image data obtained by imaging will be described. In this embodiment, the imaging device 100 is equipped with an interface compliant with the HDMI standard as an external output unit 115, and outputs image data to the outside using a signal compliant with the HDMI standard (hereinafter also referred to as an HDMI signal). In addition, in this embodiment, image data in YCC4:2:2 format is generated as development data. Figure 2 is a flowchart of the processing of the imaging device 100 in Embodiment 1. Each process in the flowchart of Figure 2 is controlled by the microcontroller 108 of the imaging device 100 executing a program stored in the ROM 110.

[0020] In step S201, the microcontroller 108 determines whether a menu operation has been performed using the operation switch group 109. This menu operation is an operation to set the operation of the imaging device 100, such as setting the resolution of the video signal to be captured by the image sensor 102 or setting the bitrate to be encoded by the compression / decompression unit 114. This menu operation also allows for the setting of HDMI RAW mode, on-screen display settings, recording command settings, etc., which will be described later. If the microcontroller 108 determines that a menu operation has been performed (YES in step S201), the microcontroller 108 stores the information set by the menu operation as mode information in the RAM 111 and proceeds to step S202. If the microcontroller 108 determines that no menu operation has been performed (NO in step S201), the process proceeds to step S203.

[0021] In step S202, the microcontroller 108 performs mode setting processing and controls each functional unit within the imaging device 100 to transition to the mode or state set in step S201.

[0022] In step S203, the microcontroller 108 refers to the information stored in RAM 111 and determines whether or not an HDMI connection is established. An HDMI connection means that the HDMI connection process described later has been completed, and this information is stored in RAM 111 by the processing in step S205. If the microcontroller 108 determines that an HDMI connection is established (YES in step S203), the process proceeds to step S206. If the microcontroller 108 determines that an HDMI connection is not established (NO in step S203), the process proceeds to step S204.

[0023] In step S204, the microcontroller 108 controls the external output unit 115 to determine whether the hot-plug detection signal (HPD) according to the HDMI standard is detected and whether the TMDS signal line according to the HDMI standard is pulled up. If the microcontroller 108 determines that the hot-plug detection signal is detected and the TMDS signal line is pulled up (YES in step S204), the microcontroller 108 determines that there is an HDMI connection and proceeds to step S205. Otherwise (NO in step S204), the microcontroller 108 determines that there is no HDMI connection and terminates the process shown in Figure 2.

[0024] In step S205, the microcontroller 108 performs HDMI connection processing. In HDMI connection processing, the microcontroller 108 controls the external output unit 115 to obtain the EDID (Extended Display Identification Data) of the sink device connected to the external output unit 115 via HDMI. EDID is information about the sink device connected via the external output unit 115, and consists of data on the video format supported by the sink device and vendor-specific data. The microcontroller 108 stores the obtained EDID in the RAM 111.

[0025] In step S206, the microcontroller 108 determines whether the imaging device 100 is in camera mode. Camera mode is a mode in which various signal processing is performed on image data collected by the lens unit 101 and captured by the image sensor 102, and the data is recorded on the memory card 113, displayed on the display unit 107, or output to the external output unit 115. In addition to camera mode, the imaging device 100 also has a playback mode in which image data recorded on the memory card 113 is displayed on the display unit 107 or output to the external output unit 115. If the microcontroller 108 determines that the imaging device 100 is in camera mode (YES in step S206), the process proceeds to step S207. On the other hand, if the microcontroller 108 determines that the imaging device 100 is not in camera mode (NO in step S206), the microcontroller 108 terminates the process shown in Figure 2.

[0026] In step S207, the microcontroller 108 refers to the mode information stored in the RAM 111 and controls the image sensor 102, etc., according to the mode information to capture RAW data (RAW image) related to the subject image. The captured RAW data is stored in the RAM 111.

[0027] In step S208, the microcontroller 108 refers to the mode information stored in the RAM 111 to determine whether the imaging device 100 is in HDMI RAW mode. HDMI RAW mode is a mode in which the imaging device 100 outputs the RAW data captured in step S207 and gamma-processed in step S209 to an external sink device via the external output unit 115. If the microcontroller 108 determines that it is in HDMI RAW mode (YES in step S208), the process proceeds to step S209. If the microcontroller 108 determines that it is not in HDMI RAW mode (NO in step S208), the process proceeds to step S211.

[0028] In step S209, the microcontroller 108 controls the image processing unit 103 to perform gamma processing on the RAW data captured in step S207.

[0029] In step S210, the microcontroller 108 controls the image processing unit 103 to write the RAW data that underwent gamma processing in step S209 to the memory area for HDMI output (HDMI output VRAM) in RAM 111.

[0030] Here, with reference to Figures 3 and 4, the RAW data written to RAM 111 will be explained. In Figure 3(a), 300 represents the entirety of the RAW data written to RAM 111 in step S210. The RAW data 300 consists of data from the Effective Pixel Area 301 and data from the Additional Pixel Area 302. As shown in Figure 3(a), the Additional Pixel Area 302 is an area where several pixels are added to the top, bottom, left, and right of the Effective Pixel Area 301, and the pixels of this Additional Pixel Area 302 are used when developing the top, bottom, left, and right edges of the Effective Pixel Area 301. Due to this configuration, the data written in step S210 is the sum of the Effective Pixel Area and the Additional Pixel Area, as shown in Figure 3(b). For example, in the case of 4K RAW data, the effective image area of ​​4096x2160 pixels is plus 12 pixels from the left and right surplus pixel areas and 8 pixels from the top and bottom surplus pixel areas, for a total of 4120x2176 pixels of data written to RAM111.

[0031] Figure 4 is a diagram illustrating the details of the RAW data written to RAM 111 in step S210. In Figure 4, as shown at 400, the RAW data consists of a Bayer array of R / Gr / Gb / B. 4K RAW data is composed of 2060 of these Bayer arrays arranged horizontally (4120 pixels as pixel data) as shown at 401, and 1088 of them arranged vertically (2176 pixels as pixel data) as shown at 402. The data size is 4120 (horizontal) x 2176 (vertical) x 12 (bit depth) ÷ 8 (bits to bytes) = 13,447,680 bytes.

[0032] Returning to Figure 2, in step S211, the microcontroller 108 controls the image processing unit 103 to perform RAW data correction processing on the RAW data captured in step S207. This RAW data correction processing includes pre-development lens correction processing (peripheral illumination correction processing, chromatic aberration correction, etc.) and white balance processing. The data used for pre-development lens correction processing is stored in the ROM 110 in advance for each type of lens, and the microcontroller 108 determines the parameters for pre-development lens correction processing based on this stored data and the type of lens unit 101 mounted on the imaging device 100.

[0033] In step S212, the microcontroller 108 controls the image processing unit 103 to perform development processing on the image data that has undergone correction processing in step S211. This development processing includes processes such as Debayer, gamma processing, and chromatic aberration correction. For chromatic aberration correction, the microcontroller 108 determines the correction processing parameters based on data previously stored in the ROM 110 and the type of lens unit 101 attached to the imaging device 100. After development processing, the RAW data becomes data in YCC4:2:2 format. The image data in YCC4:2:2 format after development processing (developed data) is stored in the RAM 111.

[0034] In step S213, the microcontroller 108 controls the image processing unit 103 to perform development data correction processing, such as distortion correction, on the YCC4:2:2 format image data generated in step S212 and stored in RAM 111. For this distortion correction, the microcontroller 108 determines the distortion correction parameters based on data previously held in ROM 110 and the type of lens unit 101 attached to the imaging device 100. The development-corrected data (in YCC4:2:2 format) corrected in step S213 is stored in RAM 111.

[0035] In step S214, the microcontroller 108 refers to the mode information stored in the RAM 111 to determine whether the imaging device 100 is in HDMI RAW mode. If the microcontroller 108 determines that it is in HDMI RAW mode (YES in step S214), the process proceeds to step S215. If the microcontroller 108 determines that it is not in HDMI RAW mode (NO in step S214), the process proceeds to step S217.

[0036] In step S215, the microcontroller 108 refers to the mode information stored in the RAM 111 to determine whether the imaging device 100 is in on-screen display mode. On-screen display mode is a mode in which information about the imaging device, such as shooting, settings, and operating status, is superimposed on the image using icons, menu screens, and strings (text format), based on the mode information and operating status stored in the RAM 111.

[0037] Figures 5(a) to 5(c) illustrate an example of on-screen display where information is superimposed on an image. Various display information 501 to 507 is superimposed on an image 500 captured by the image sensor 102. In the example shown in Figures 5(a) to 5(c), 501 is information on the usable time of the power supply (battery, etc.) supplying power to the imaging device 100, and 502 is information on the remaining recording time of the memory card 113. Also, 503 is information on the recording operation status of the imaging device 100, and 504 is an audio level meter indicating the status of audio input. Furthermore, 505, 506, and 507 are information on the current shutter speed, ISO value, color information, and bit depth of the imaging device 100, respectively. Note that the example shown in Figures 5(a) to 5(c) is just one example, and the information that can be superimposed on an image is not limited to this; for example, the recording resolution of the image may also be displayed.

[0038] On-screen displays include not only the full display shown in Figure 5(a), but also displays that show only the recording settings as shown in Figure 5(b), and displays that show only the recording operation status as shown in Figure 5(c). The display of each piece of information (show / hide) can also be set individually. The on-screen display mode determined in step S215 refers to a state in which at least one piece of information is superimposed on the image 500. If the microcontroller 108 determines that the imaging device 100 is in on-screen display mode (YES in step S215), the process proceeds to step S216. On the other hand, if the microcontroller 108 determines that the imaging device 100 is not in on-screen display mode (NO in step S215), the process proceeds to step S220.

[0039] In step S216, the microcontroller 108 refers to the mode information stored in RAM 111 to determine whether the imaging device 100 is in recording operation and whether the recording command indicating the recording operation status of the imaging device 100 is in recording state. The recording command indicating the recording operation status of the imaging device 100 includes recording state (REC) and recording standby state (STBY, STANDBY). If the microcontroller 108 determines that the recording command is in recording state (REC) (YES in step S216), the process proceeds to step S220. If the microcontroller 108 determines that the recording command is not in recording state (REC), i.e., in recording standby state (STBY, STANDBY) (NO in step S216), the process proceeds to step S218.

[0040] Here, the recording command switches between recording state and recording standby state in conjunction with the recording start and recording end processes of the captured image, which are executed in response to the recording control operation using the operation switch group 109. The recording command changes from the recording standby state to the recording state when the recording start process of the captured image is executed, and changes from the recording state to the recording standby state when the recording end process of the captured image is executed. By outputting this recording command together with the output signal of the imaging device 100, an external receiving device connected to the imaging device 100 can recognize that the imaging device 100 has performed recording start and recording end operations. The external receiving device connected to the imaging device 100 records the image data input using the HDMI signal according to the recording command output from the imaging device 100. In other words, when the recording command output from the imaging device 100 switches from the recording standby state to the recording state, the external receiving device connected to the imaging device 100 starts recording the input image data. Also, when the recording command output from the imaging device 100 switches from the recording state to the recording standby state, the external receiving device connected to the imaging device 100 stops recording the input image data.

[0041] In step S217, the microcontroller 108 refers to the mode information stored in the RAM 111 to determine whether the imaging device 100 is in on-screen display mode. If the microcontroller 108 determines that the imaging device 100 is in on-screen display mode (YES in step S217), the process proceeds to step S218. If the microcontroller 108 determines that the imaging device 100 is not in on-screen display mode (NO in step S217), the process proceeds to step S219.

[0042] In step S218, the microcontroller 108 overlays on-screen information onto the developed data stored in RAM 111 after the developed data correction process was performed in step S213. On-screen information is information related to the shooting, settings, and operating status of the imaging device that can be displayed overlaid on the image, and is configured to be displayed overlaid on the image. On-screen information consists of icons, menu screens, and strings (text format).

[0043] In step S219, the microcontroller 108 controls the display resize unit 104 to resize the developed data and write it to the memory area for HDMI output (HDMI output VRAM) in RAM 111. The developed data resized by the display resize unit 104 in step S219 is either the developed data after development correction generated in step S213, or the developed data with on-screen information superimposed, generated in step S218. The data written to RAM 111 is in YCC4:2:2 format, as explained with reference to Figure 6. After processing in step S219, the process proceeds to step S220.

[0044] Here, with reference to Figures 6 to 8, the memory area for HDMI output (HDMI output VRAM) to which data is written in steps S210 and S219 will be described.

[0045] Figure 6 is a diagram illustrating the memory area for HDMI output (HDMI output VRAM) when outputting 4096x2160 pixel YCC4:2:2 format 12-bit image data via an HDMI signal. As shown in Figure 6, this memory area 600 has an image area of ​​4096 pixels horizontally as shown in 602 and 2160 pixels vertically as shown in 603. In Figure 6, as shown in 601, the image data is composed of 2-pixel units (one Cb and one Cr data for every two Y data), and the size of each data is 12 bits for each of the Y, Cb, and Cr data. The data size of one line (horizontally) in this HDMI output memory area is 4096 (horizontally) x 2 (because there are 4 data (2 Y, 1 Cb, and 1 Cr) in 2 pixels) x 12 (bit depth) ÷ 8 (bits to bytes) = 12288 bytes. Furthermore, the total data size for the memory area used for HDMI output is 4096 (width) x 2160 (height) x 2 (4 data points per 2 pixels) x 12 (bit depth) ÷ 8 (bits to bytes) = 26,542,080 bytes.

[0046] Figure 7 illustrates the state in which RAW data is stored in the memory area for HDMI output (HDMI output VRAM) as described in Figure 6, in step S210. The size of the RAW data is 4120 (width) x 2176 (height) x 12 (bit depth) ÷ 8 (bits to bytes) = 13,447,680 bytes, as explained in Figure 4.

[0047] In Figure 7, as shown in 701, Bayer data (the first column contains R and Gr data, and the second column contains Gr and B data) is placed without gaps in the image area where the Cb, Y, Cr, and Y data columns are arranged in the memory area for HDMI output. The size of the RAW data is 13,447,680 bytes, and the data size of one line in the memory area for HDMI output is 12,288 bytes. Therefore, as shown in 702 in Figure 7, 1095 lines (13,447,680 ÷ 12,288 = 1094.375) in the memory area for HDMI output can store RAW data with a bit depth of 12 bits at 4120x2176 pixels. The area after the RAW data (lines 1096 to 2160 in the memory area for HDMI output) becomes an empty area, so metadata corresponding to the RAW data placed up to line 1095 may be placed in this area, for example, as shown in 703. For example, the γ data of the RAW data (γ in step S209) may be placed there. Additionally, for example, parameters used in the development and correction processes in the imaging device 100 (parameters for RAW data correction processing in step S211, parameters for development processing in step S212, and parameters for development data correction processing in step S213) may be included.

[0048] Figure 7 illustrates the case where the RAW data written in step S210 fits into the memory area for HDMI output (HDMI output VRAM). In contrast, Figure 8 will explain the case where the RAW data written in step S210 does not fit into the memory area for HDMI output.

[0049] In Figure 8, 801 is RAW data with 8224x4336 pixels and a bit depth of 10 bits. Internally, as explained with reference to Figure 4, it is composed of a Bayer array of R, Gr, Gb, and B. The data size of this RAW data 801 is 8224 (width) x 4336 (height) x 10 (bit depth) ÷ 8 (bits to bytes) = 44,574,080 bytes. Therefore, this RAW data 801 cannot fit into the memory area (26,542,080 bytes) corresponding to 4096x2160 pixels with a bit depth of 12 bits. For this reason, the RAW data 801 is divided into two parts vertically, and the RAW data is stored in the memory area for HDMI output for two frames. For example, in Figure 8, as shown in 802, the RAW data up to 2176 lines of RAW data 801 is placed in the first frame, and as shown in 803, the remaining lines of RAW data 801 are placed in the second frame.

[0050] In Figure 8, 804 is the memory area for HDMI output (first frame) where the RAW data is placed. The data size of the upper half (2176 lines) of the RAW data 801, which is 8224x4336 pixels with a bit depth of 10 bits, is 8224 (width) x 2176 (height) x 10 (bit depth) ÷ 8 (bits to bytes) = 22,369,280 bytes. Therefore, the data of the upper half of the RAW data 801 can be stored in 1821 lines (22,369,280 ÷ 12288 = 1820.41) in the memory area corresponding to 4096x2160 pixels with a bit depth of 12 bits, as shown in 805. Lines 1822 to 2160 in the memory area 804 for HDMI output are free space, so metadata corresponding to the RAW data may be placed there, for example, as shown in 806.

[0051] 807 is the memory area for HDMI output where the RAW data is placed (second frame). The data size of the lower half (2160 lines) of RAW data 801, which is 8224x4336 pixels with a bit depth of 10 bits, is 8224 (width) x 2160 (height) x 10 (bit depth) ÷ 8 (bits to bytes) = 22,204,800 bytes. Therefore, the data of the lower half of RAW data 801 can be stored in 1808 lines (22,204,800 ÷ 12288 = 1807.031) in the memory area corresponding to 4096x2160 pixels with a bit depth of 12 bits, as shown in 808. Lines 1809 to 2160 in the memory area 807 for HDMI output are free space, so metadata corresponding to the RAW data may be placed there, for example, as shown in 809. In this way, if the RAW data does not fit into the memory area for HDMI output, the RAW data is split vertically and placed in the memory area for HDMI output (HDMI output VRAM).

[0052] Returning to Figure 2, in step S220, the microcontroller 108 controls the display resize unit 104 to resize the developed data and write it to the memory area for display output (display output VRAM) in RAM 111. The developed data resized by the display resize unit 104 in step S220 is either the developed data after development correction generated in step S213, or the developed data with on-screen information superimposed, generated in step S218. The data written to RAM 111 is in YCC4:2:2 format, as explained with reference to Figure 6.

[0053] In step S221, the microcontroller 108 outputs the display output data that was written to the display output memory area (display output VRAM) in RAM 111 in step S220 to the display unit 107. Since the display unit 107 supports the display of image data in YCC4:2:2 format, an image corresponding to the display output data is displayed.

[0054] In step S222, the microcontroller 108 controls the external output unit 115 to output HDMI output data to the external receiving device via an HDMI signal from the HDMI output memory area (HDMI output VRAM) in the RAM 111. Here, the signal output in step S222 will be as follows, depending on the mode and recording operation status of the imaging device 100.

[0055] (1) When the imaging device 100 is in HDMI RAW mode (set to output RAW data) (1-1) If the recording command indicating the recording operation status is recording status (REC), or if the imaging device 100 is not in on-screen display mode, RAW data is written to the memory area for HDMI output in step S210. Therefore, a signal is output in which the RAW data is mapped (or stored) to the image area in the YCC4:2:2 format (12-bit) video format. Here, the YCC4:2:2 format (12-bit) video format is the video format specified in the HDMI standard. Note that the video format may also be referred to as the transmission format or output format. (1-2) If the imaging device 100 is in on-screen display mode and the recording command indicating the recording operation status is in recording standby state (STBY, STANDBY), the resized developed data from step S219 is written to the memory area for HDMI output. On-screen information is superimposed on this developed data from step S218. Therefore, an image signal in YCC4:2:2 format with superimposed on-screen information is output.

[0056] (2) When the imaging device 100 is not in HDMI RAW mode (not set to output RAW data) The memory area for HDMI output contains the resized developed data written in step S219. This developed data is either the developed data that has undergone the developed data correction process in step S213, or the developed data on which on-screen information has been superimposed in step S218. Therefore, an image signal in YCC4:2:2 format with on-screen information superimposed according to the settings is output.

[0057] Subsequently, the microcontroller 108 repeatedly executes the processes from step S201 onward until it determines in step S204 that there is no HDMI connection, or in step S206 that it is not in camera mode.

[0058] As described above, according to Embodiment 1, when the imaging device 100 is in HDMI RAW mode and the recording command indicating the recording operation state is in the recording state, it outputs RAW data to the outside using the HDMI signal. Also, when the imaging device 100 is in HDMI RAW mode and the recording command is in the recording standby state, it outputs image data in YCC4:2:2 format that can superimpose display information such as icons and menu screens to the outside using the HDMI signal. Furthermore, when the imaging device 100 is in HDMI RAW mode but is not in on-screen display mode, it outputs RAW data to the outside using the HDMI signal.

[0059] Thus, even when the imaging device 100 is in HDMI RAW mode, it can output display information such as icons and menu screens by controlling it to output image data in YCC4:2:2 format when it is in recording standby mode. Therefore, even when the imaging device 100 is in HDMI RAW mode, the receiving side can display icons and menu screens to check information, and can check the status of the imaging device 100 when necessary.

[0060] In step S222 of Figure 2, if the device is in HDMI RAW mode and in recording standby mode, it outputs data in a YCC format different from the set mode. Therefore, it is possible to notify the user that the output format will switch due to the recording command. Figures 9(a) and 9(b) show examples of displays that notify the user that the output to the HDMI transmission path has been changed to YCC format when the device is set to HDMI RAW mode. For example, in Figure 9(a), as shown in 901, it is possible to notify the user in text that the output to the HDMI transmission path will switch due to the recording start operation (REC operation) that switches the recording command. Alternatively, for example, in Figure 9(a), as shown in 902, the output format may be displayed as an icon referring to the current status, or as shown in 903, the output format to the HDMI transmission path according to the recording operation status may be displayed on the screen.

[0061] In the embodiment described above, the output format to the HDMI transmission path was controlled by a recording command indicating the recording operation status. However, the output format may also be switched by on-screen display modes with different amounts of information displayed. For example, among the on-screen displays shown in Figure 5, the display showing only the recording status in Figure 5(c) can be communicated by a recording command, so RAW data may be written to the memory area for HDMI output and output regardless of the recording command. Furthermore, while the above explanation assumes that the development data is image data in YCC4:2:2 format, it is not limited to this format and may be image data in other YCC formats.

[0062] <Embodiment 2> Some imaging devices have auxiliary functions (assist functions) that are useful for checking captured image data. When the imaging device is set to HDMI RAW mode and outputting RAW data to the receiving device via the HDMI transmission path, some auxiliary functions (assist functions) cannot be used. Therefore, when outputting RAW data, the receiving device that receives the RAW data cannot check the image with those auxiliary functions (assist functions) applied. In this embodiment 2, if an operation to enable an unusable function is performed on the imaging device in HDMI RAW mode, the receiving device connected via HDMI will enable that function if it has an equivalent function. By controlling it in this way, even in HDMI RAW mode, the receiving device can check the image with functions equivalent to those unusable on the imaging device. In the following, the same points as in the first embodiment described above will be omitted from the explanation, and only the differences from the first embodiment described above will be explained.

[0063] Figure 10 is a block diagram showing an example configuration of the receiving device 1000. The receiving device 1000 is connected to the imaging device 100 via HDMI and receives and displays image data via the HDMI transmission path.

[0064] The receiver 1001 receives a signal compliant with the HDMI standard (HDMI signal). The image data received by the receiver 1001 becomes the input to the receiver 1000. The image data received by the receiver 1001 is stored in the RAM 1008. The image processing unit 1002 performs various image processing on the image data received by the receiver 1001. The image processing unit 1002 stores the processed image data in the RAM 1008.

[0065] The display resizing unit 1003 resizes the image data stored in the RAM 1008 to generate display image data in order to output the image data to the display unit 1004 and the external output unit 1009. The display resizing unit 1003 stores the generated display image data in the RAM 1008. The display unit 1004 is a display component for displaying the display image data stored in the RAM 1008. The display unit 1004 is, for example, a liquid crystal panel.

[0066] The microcomputer (MPC) 1005 controls the entire receiving device 1000. The operation switch group 1006 is an operating component for user input. ROM 1007 is, for example, flash ROM, and stores programs executed by the MPC 1005. A portion of ROM 1007 is also used for backup purposes, to hold system status and other data. RAM 1008 is volatile memory used as work memory by the MPC 1005 and the image processing unit 1002, etc.

[0067] The external output unit 1009 outputs display image data, etc., that the image processing unit 1002 has output to the RAM 1008. The external output unit 1009 is an interface compliant with, for example, the HDMI standard or the SDI standard. The external output unit 1009 can output display image data in signals of standards such as 4K60P and 2K60P. The bus 1010 is a bus that exchanges data between the various parts of the receiving device 1000.

[0068] Figure 11 is a flowchart showing the processing performed by the imaging device 100 when an operation is performed to enable a function of the imaging device 100 while the imaging device 100 is in HDMI RAW mode. Each process in the flowchart of Figure 11 is controlled by the microcontroller 108 of the imaging device 100 executing a program stored in the ROM 110.

[0069] In step S1101, the microcontroller 108 determines whether a menu operation has been performed using the operation switch group 109. This menu operation is an operation to set the operation of the imaging device 100, such as setting the resolution of the video signal to be captured by the image sensor 102 or setting the bitrate to be encoded by the compression / decompression unit 114. Menu operations also include operations to enable various auxiliary functions (assist functions) of the imaging device 100. If the microcontroller 108 determines that a menu operation has been performed (YES in step S1101), the process proceeds to step S1102; otherwise (NO in step S1101), the process waits in step S1101.

[0070] Here, the auxiliary functions (assist functions) of the imaging device 100 include, for example, Magnification, Anamorphic, False Color, Zebra, Waveform Monitor (WFM), and Marker. Magnification is a function that enlarges and displays a certain area within the image, and is used, for example, to check the focus position of fine details such as a person's eyes when there are limitations on the display area, such as a small panel. Anamorphic is a function that adjusts the displayed image by correcting the image displayed on a display unit such as an LCD panel when shooting with an anamorphic lens that can compress and capture a horizontally elongated image. False Color is a function that superimposes a false color corresponding to the brightness level on each pixel of the image, and allows the exposure of the image to be captured to be checked. Zebra is a function that superimposes diagonal lines according to the brightness level of the image being captured, and notifies the user of areas where overexposure has occurred, for example, the brightness of the image can be grasped by the combination of left and right diagonal lines superimposed. Waveform Monitor (WFM) is a function that plots the brightness values ​​of an image on the Y-axis and the horizontal position of the image on the X-axis, displaying the brightness distribution in the image as a waveform. Markers are a function that displays markers such as crosshairs, frames, and horizontal and vertical lines on an image during shooting. Markers are used as a guide for composition during shooting, for example, to indicate the area where you want to capture the subject during shooting, or to display markers where text overlays will be placed during post-production to prevent the subject from being obscured.

[0071] In step S1102, the microcontroller 108 determines whether the menu operated in step S1101 is a function that is mutually exclusive (unavailable) in HDMI RAW mode. In the imaging device 100 in this embodiment, for example, the Magnification, Anamorphic, False Color, Zebra, Waveform Monitor (WFM), and Marker functions mentioned above are functions that are mutually exclusive (unavailable) in HDMI RAW mode. If the microcontroller 108 determines that the operated menu is a function that is mutually exclusive (unavailable) in HDMI RAW mode (YES in step S1102), the process proceeds to step S1103. On the other hand, if the microcontroller 108 determines that the operated menu is a function that is not mutually exclusive (usable) in HDMI RAW mode (NO in step S1102), the process proceeds to step S1109.

[0072] In step S1103, the microcontroller 108 controls the external output unit 115 to determine whether the hot-plug detection signal (HPD) according to the HDMI standard is detected and whether the TMDS signal line according to the HDMI standard is pulled up. If the microcontroller 108 determines that the hot-plug detection signal is detected and the TMDS signal line is pulled up (YES in step S1103), the microcontroller 108 determines that an HDMI connection is in place and proceeds to step S1104. Otherwise (NO in step S1103), the microcontroller 108 determines that there is no HDMI connection and terminates the process shown in Figure 11.

[0073] In step S1104, the microcontroller 108 controls the external output unit 115 to obtain the EDID of the receiving device 1000 connected to the external output unit 115 via HDMI. The EDID is information about the HDMI-connected sink device and consists of data such as the video formats and functions supported by the sink device, as well as vendor-specific data. The microcontroller 108 stores the obtained EDID of the receiving device 1000 in the RAM 111.

[0074] In step S1105, the microcontroller 108 refers to the EDID of the receiving device 1000, which was acquired in step S1104 and stored in RAM 111, and determines whether the receiving device 1000 has a function corresponding to the function operated in step S1101. For example, the imaging device 100 has a function correspondence table between the imaging device 100 and the receiving device 1000, as shown in Table 1, and searches for a function that the receiving device 1000 has that corresponds to the currently operated function based on the EDID acquired from the receiving device 1000. If the microcontroller 108 determines that the receiving device 1000 has the corresponding function (YES in step S1105), the process proceeds to step S1106. If the microcontroller 108 determines that the receiving device 1000 does not have the corresponding function (NO in step S1105), the microcontroller 108 terminates the process shown in Figure 11.

[0075] [Table 1]

[0076] In step S1106, the microcontroller 108 determines whether the image data being output to the receiving device 1000 via the HDMI transmission line is output as RAW data. If the microcontroller 108 determines that the image data is output as RAW data (YES in step S1106), the process proceeds to step S1107. If the microcontroller 108 determines that the image data is not output as RAW data (NO in step S1106), the process proceeds to step S1109.

[0077] In step S1107, the microcontroller 108 sends a signal to the receiver 1000 to control the function of the receiver 1000 corresponding to the function operated in step S1101. At this time, the signal to be sent may be in the form of a CEC command that the receiver 1000 can interpret, or it may be written as a signal that the receiver 1000 can interpret in the metadata section, as shown by 703 in Figure 7. For example, the imaging device 100 and the receiver 1000 have a table of corresponding functions as shown in Table 1, and the ID that identifies the function and information for control such as enable or disable are written to the metadata and sent. For example, when enabling the waveform monitor function shown in Table 1, the imaging device 100 writes the data "Moni2" and "1" (enabled) to the metadata section and sends it to the receiver 1000.

[0078] In step S1108, the microcontroller 108 receives the control result from the receiving device 1000 based on the control signal transmitted to the receiving device 1000 in step S1107. Figures 12(a) to 12(c) show examples of displays of the control results received from the receiving device 1000. For example, the imaging device 100 may display the control result of the corresponding function in the receiving device 1000 as text, as shown in 1201 in Figure 12(a). Alternatively, the imaging device 100 may transmit the control signal without checking whether the receiving device 1000 has the corresponding function, and display the control result of the corresponding function in the receiving device 1000 and the reason for it simultaneously as text, as shown in 1202 in Figure 12(b). In the example shown in Figure 12(b), it is displayed that the corresponding function could not be enabled because the receiving device 1000 was an incompatible monitor that did not have the corresponding function. Furthermore, the display format of the control results is not limited to text display; for example, as shown in 1203 in Figure 12(c), they may be displayed as icons. Also, as shown in 1204 in Figure 12(c), the control results of functions including other output destinations may be displayed as a list on the screen.

[0079] In step S1109, the microcontroller 108 controls the system to enable the functions of the imaging device 100 that were operated in step S1101.

[0080] By having the imaging device 100 perform the processes described above, functions that are unavailable when outputting RAW data via the HDMI transmission path can be enabled on the HDMI-connected receiving device 1000, making it possible to perform more settings solely through the operation of the imaging device 100.

[0081] Next, the operation of the receiving device 1000, which is connected to the imaging device 100 via HDMI, will be described. Figure 13 is a flowchart of the processing performed by the receiving device 1000, which is connected to the imaging device 100 via HDMI, and which performs the processing shown in Figure 11. Each process in the flowchart of Figure 13 is controlled by the microcontroller 1005 of the receiving device 1000 executing a program stored in the ROM 107.

[0082] In step S1301, the microcontroller 1005 controls the receiver 1001 to receive the HDMI signal output from the imaging device 100. The received HDMI signal is then stored in the RAM 1008. The signal received in step S1301 may be either a YCC format image data signal or a RAW data signal, but the processing described below applies to the case where a RAW data signal is received.

[0083] In step S1302, the microcontroller 1005 refers to the HDMI signal received in step S1301 and stored in RAM 1008, and determines whether the received HDMI signal contains control signals for functions of the receiving device 1000. Here, the control signals may be transmitted superimposed on the HDMI signal as CEC commands, or they may be written to the metadata portion of the HDMI signal and transmitted. If the microcontroller 1005 determines that the received HDMI signal contains control signals for functions of the receiving device 1000 (YES in step S1302), the process proceeds to step S1203. If the microcontroller 1005 determines that the received HDMI signal does not contain control signals for functions of the receiving device 1000 (NO in step S1302), the process shown in Figure 13 ends.

[0084] In step S1303, the microcontroller 1005 controls the function specified by the HDMI signal received in step S1301. For example, if the metadata portion of the received HDMI signal contains the signals "Moni2" and "1" as shown in the example in Table 1, the microcontroller 1005 controls the receiver 1000 to enable its waveform monitor function.

[0085] In step S1304, the microcontroller 1005 transmits to the imaging device 100 the result of the control of the function by the control signal included in the HDMI signal received in step S1301.

[0086] According to the second embodiment, functions that cannot be enabled on the imaging device 100 during HDMI RAW mode can be enabled on the receiving device 1000, and images with those functions applied can be viewed on the receiving device. For example, auxiliary functions (assist functions) such as waveform monitors and markers, which are useful for checking captured image data, can be viewed on the receiving device 100.

[0087] In this embodiment, the control result of the function controlled by the control signal is transmitted from the receiving device 1000 to the imaging device 100 and displayed on the imaging device 100. However, this process of displaying the control result is not mandatory and is optional.

[0088] It should be noted that the present invention is not limited to these specific embodiments, and various forms that do not depart from the spirit of the invention are also included in the present invention. Furthermore, the embodiments described above are merely examples of one embodiment, and it is possible to combine these embodiments as appropriate.

[0089] (Other embodiments of the present invention) The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by a process in which one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more functions.

[0090] It should be noted that the embodiments described above are merely examples of how the present invention can be implemented, and the technical scope of the present invention should not be interpreted as being limited by them. In other words, the present invention can be implemented in various forms without departing from its technical concept or its main features.

[0091] The disclosure of this embodiment includes the following configurations and methods, etc. (Composition 1) An output means for outputting RAW data, or developed data generated by developing RAW data, to an external source, When the setting is to output the aforementioned RAW data, a control means controls the output means to output the aforementioned RAW data if the operation state for recording the image is in the recording state, and to output the aforementioned developed data if it is not in the recording state. An imaging device characterized by having the following features. (Configuration 2) The imaging apparatus according to Configuration 1, characterized in that the control means controls the output of the developed data by superimposing display information onto the developed data when outputting the developed data, and by outputting the RAW data without superimposing the display information when outputting the RAW data. (Composition 3) The imaging apparatus according to configuration 1 or 2, characterized in that the control means controls the output means to output the RAW data and a recording command indicating that it is in a recording state when the recording state is in place. (Composition 4) The imaging device according to configuration 2, characterized in that the display information superimposed on the developed data when the recording state is not being used includes information that notifies that the system will switch to outputting the RAW data when the recording state is activated. (Composition 5) The imaging apparatus according to any one of configurations 1 to 4, characterized in that the control means is set to output the RAW data, and controls the output means to output the RAW data when display information is not to be displayed. (Composition 6) The imaging apparatus according to any one of configurations 1 to 5, characterized in that the development data is image data in YCC format generated based on the RAW data. (Composition 7) The imaging apparatus according to configuration 6, characterized in that the control means controls the RAW data to be placed in an image area in the YCC video format and output. (Composition 8) The imaging device according to any one of configurations 1 to 7, characterized in that the output means outputs the RAW data or the developed data to the outside using a signal compliant with the HDMI standard. (Composition 9) The imaging apparatus according to configuration 2, characterized in that the display information includes at least one of the recording resolution, color information, bit depth, and ISO value. (Composition 10) The imaging apparatus according to any one of configurations 1 to 9, characterized in that the control means controls the receiving device that receives the RAW data to transmit a control signal to enable the function corresponding to the unusable function when an operation is performed to enable a function that cannot be used by the imaging apparatus when the RAW data is output. (Composition 11) The imaging apparatus according to configuration 10, characterized in that the control means determines whether the receiving device has a function corresponding to the unusable function, and controls the device to transmit the control signal according to the result of the determination. (Composition 12) The imaging device according to configuration 10 or 11, characterized in that the control signal is transmitted as metadata for a signal compliant with the HDMI standard. (Composition 13) The imaging device according to configuration 10 or 11, characterized in that the control signal is transmitted as a CEC command in a signal compliant with the HDMI standard. (Composition 14) An imaging device according to any one of configurations 10 to 13, characterized in that it displays the control result of the function of the receiving device by the control signal. (Method 1) An output process in which RAW data, or developed data generated by developing RAW data, is output externally by an output means, A control step that, when the setting is to output the aforementioned RAW data, controls the output means to output the aforementioned RAW data if the operation state for recording the image is in the recording state, and to output the aforementioned developed data if it is not in the recording state, A control method for an imaging device, characterized by having the following features. (Program 1) In the imaging device's computer, An output step in which RAW data, or developed data generated by developing RAW data, is output to an external source using an output means, A control step that controls the output means to output the RAW data if the setting is to output the RAW data, if the operation state for recording the image is in the recording state, and to output the developed data if it is not in the recording state. A program to execute. [Explanation of symbols]

[0092] 100: Imaging device 103, 1002: Image processing unit 104, 1003: Display resizing unit 105: Recording resizing unit 106: OSD generation unit 107, 1004: Display unit 108, 1005: Microcontroller 109, 1006: Operation switch group 110, 1007: ROM 111, 1008: RAM 115, 1009: External output unit 1000: Receiving device 1001: Receiving unit

Claims

1. An output means for outputting RAW data, or developed data generated by developing RAW data, to an external source, When the setting is to output the aforementioned RAW data, a control means controls the output of the aforementioned RAW data by the output means if the operation state related to image recording is in the recording state, and the output of the aforementioned developed data by the output means if it is not in the recording state. It has, The imaging apparatus is characterized in that the control means controls the output means to output the RAW data and a recording command indicating that it is in a recording state when the recording state is in place.

2. The imaging apparatus according to claim 1, characterized in that the control means controls the output of the developed data by superimposing display information onto the developed data when outputting the developed data, and by outputting the RAW data without superimposing the display information when outputting the RAW data.

3. The imaging device according to claim 2, wherein the display information superimposed on the developed data when the recording state is not in place includes information that notifies that the system will switch to outputting RAW data when the recording state is established.

4. The imaging apparatus according to claim 1, characterized in that the control means is set to output the RAW data, and controls the output means to output the RAW data when display information is not to be displayed.

5. The imaging apparatus according to any one of claims 1 to 4, characterized in that the development data is image data in YCC format generated based on the RAW data.

6. The imaging apparatus according to claim 5, characterized in that the control means controls the RAW data to be placed in an image area in the YCC video format and output.

7. The imaging apparatus according to claim 5, characterized in that the output means outputs the RAW data or the developed data to the outside using a signal compliant with the HDMI standard.

8. The imaging apparatus according to claim 2, characterized in that the display information includes at least one of the recording resolution, color information, bit depth, and ISO value.

9. The imaging apparatus according to any one of claims 1 to 4, characterized in that, when an operation is performed to enable a function that cannot be used in the imaging apparatus, the control means controls the receiving device that receives the RAW data to transmit a control signal to enable the function corresponding to the unusable function when the RAW data is output.

10. The imaging apparatus according to claim 9, characterized in that the control means determines whether the receiving device has a function corresponding to the unusable function, and controls the device to transmit the control signal according to the result of the determination.

11. The imaging apparatus according to claim 9, characterized in that the control signal is transmitted as metadata for a signal compliant with the HDMI standard.

12. The imaging apparatus according to claim 9, characterized in that the control signal is transmitted as a CEC command in a signal compliant with the HDMI standard.

13. The imaging device according to claim 9, characterized in that it displays the control result of the function of the receiving device by the control signal.

14. An output process in which RAW data, or developed data generated by developing RAW data, is output to an external source using an output means, A control step that, when the setting is to output the RAW data, controls the output means to output the RAW data if the operation state for recording the image is in the recording state, and to output the developed data if it is not in the recording state. It has, A control method for an imaging device, characterized in that, in the control step, when the recording state is reached, the output means is controlled to output the RAW data and a recording command indicating that the recording state is reached.

15. In the imaging device's computer, An output step in which RAW data, or developed data generated by developing RAW data, is output to an external source using an output means, A control step that controls the output means to output the RAW data if the setting is to output the RAW data, if the operation state for recording the image is in the recording state, and to output the developed data if it is not in the recording state. Make it run, The program is characterized in that, in the control step, when the recording state is reached, the output means is controlled to output the RAW data and a recording command indicating that the recording state is reached.

Images