Camera device, camera system, control method and storage medium

Abstract

The present invention provides an imaging device, an imaging system, a control method and a storage medium. The imaging device includes: an image sensing unit including an image sensor and configured to perform imaging and output an image signal by photoelectrically converting an optical image formed on an imaging surface; and a setting unit configured to set shooting parameters to be used when the image sensing unit performs imaging. The setting unit sets different shooting parameters to be used when the image sensing unit performs imaging, between a case where image processing of the image signal using an external image processing device can be performed and a case where image processing of the image signal using an external image processing device cannot be performed.

Description

Technical Field

[0001] The present invention relates to an imaging apparatus, an imaging system, a control method thereof, and a storage medium, and in particular, to a technique for performing image processing using an image processing device external to the imaging apparatus. Background Art

[0002] Conventionally, image processing such as NR processing for removing noise components is applied to images captured by an image capture device to correct the images into high-quality images. In order to obtain high-quality images using NR processing, shooting parameters such as aperture value, shutter speed, ISO sensitivity, etc. need to be determined when shooting, taking into account the noise reduction effect of NR processing. For example, increasing ISO sensitivity increases the intensity of noise components, but the shutter speed can be increased so that the influence of camera shake and subject shake is reduced. Therefore, when shooting a moving subject in a dark environment, it is desirable to increase ISO sensitivity within an acceptable range of the intensity of the noise component after NR processing, and it is desirable to determine shooting parameters such as shutter speed and aperture value.

[0003] In addition, there is a case where image processing for a captured image is performed not in the image capturing device but in an image processing device external to the image capturing device. For example, Japanese Patent Laid-Open No. 2007-116291 discloses a technique in which an image captured by the image capturing device and model information of the image capturing device are transmitted to an external image processing device, and the external image processing device performs image quality correction on the transmitted image based on image quality correction parameters recorded for each model of the image capturing device.

[0004] In addition, in recent years, with the development of advanced image processing technology using statistical feature quantities, etc., advanced image processing that is difficult to perform in the camera device is performed by an image processing device outside the camera device. This makes it possible to obtain higher quality images. In this case, it is necessary to determine shooting parameters at the time of shooting, taking into account the results of the image processing performed by the external image processing device (for example, the degree of noise reduction).

[0005] However, in conventional technology, it has been impossible to separately determine optimal shooting parameters suitable for a case where image processing is performed within an image pickup apparatus and a case where image processing is performed in an image processing apparatus outside the image pickup apparatus. Summary of the invention

[0006] The present invention has been made in consideration of the above circumstances, and determines a photographing parameter corresponding to image processing and suitable for a photographing scene.

[0007] According to the present invention, there is provided an imaging device, comprising: an image sensing component, which comprises an image sensor and is configured to perform imaging and output an image signal by photoelectrically converting an optical image formed on an imaging surface; and a setting component, which is configured to set shooting parameters to be used when the image sensing component performs imaging, wherein the setting component sets different shooting parameters to be used when the image sensing component performs imaging, between a case where image processing of the image signal can be performed using an external image processing device and a case where image processing of the image signal cannot be performed using the external image processing device.

[0008] In addition, according to the present invention, there is provided an imaging system, which includes an imaging device and an image processing device, wherein the imaging device includes: an image sensing component, which includes an image sensor and is configured to perform imaging and output an image signal by photoelectrically converting an optical image formed on an imaging surface; a first image processing component, which is configured to perform image processing on the image signal; a first determination component, which is configured to determine shooting parameters corresponding to the image processing performed by the first image processing component to be used when the image sensing component is imaging; and a first communication component, which is configured to send and receive information with the image processing device, and the image processing device includes: a second communication component, which is configured to send and receive information with the imaging device; a second image processing component, which is configured to perform image processing on an image signal received from the outside; and a second determination component, which is configured to determine, based on the information received from the imaging device, an amount of change in at least one of the shooting parameters corresponding to the image processing performed by the second image processing component.

[0009] In addition, according to the present invention, a control method for a camera device is provided, which includes: an image sensing step for performing camera imaging and outputting an image signal by photoelectrically converting an optical image formed on an imaging surface; and a setting step for setting shooting parameters to be used during camera imaging, wherein, in the setting step, different shooting parameters to be used during camera imaging are set between a case where image processing of the image signal can be performed using an external image processing device and a case where image processing of the image signal cannot be performed using the external image processing device.

[0010] In addition, according to an embodiment of the present disclosure, a control method for a camera system is provided, wherein the camera system includes a camera device and an image processing device, wherein the camera device is configured to perform camera imaging by photoelectric conversion of an optical image formed on an imaging surface, output an image signal and perform image processing on the image signal, and the image processing device is configured to perform image processing on an image signal received from the outside, and the control method includes: a first determination step for determining in the camera device shooting parameters corresponding to the image processing performed by the camera device to be used during camera imaging; and a second determination step for determining in the image processing device, based on information received from the camera device, a change amount of at least one of the shooting parameters corresponding to the image processing performed by the image processing device.

[0011] In addition, according to an embodiment of the present disclosure, a non-temporary computer-readable storage medium is provided, which stores a program that can be executed by a computer, wherein the program includes a program code for causing the computer to execute a control method of a camera device, the control method including: an image sensing step for performing camera imaging and outputting an image signal by photoelectrically converting an optical image formed on an imaging surface; and a setting step for setting shooting parameters to be used during camera imaging, wherein different shooting parameters to be used during camera imaging are set between a case where image processing of the image signal can be performed using an external image processing device and a case where image processing of the image signal cannot be performed using the external image processing device.

[0012] In addition, according to an embodiment of the present disclosure, a non-temporary computer-readable storage medium is provided, which stores a program that can be executed by a computer, wherein the program includes a program code for causing the computer to execute a control method of a camera system, the camera system includes a camera device and an image processing device, the camera device is configured to perform camera imaging by photoelectric conversion of an optical image formed on an imaging surface, output an image signal and perform image processing on the image signal, the image processing device is configured to perform image processing on an image signal received from the outside, and the control method includes: a first determination step for determining in the camera device shooting parameters corresponding to the image processing performed by the camera device to be used during camera imaging; and a second determination step for determining in the image processing device, based on information received from the camera device, a change amount of at least one of the shooting parameters corresponding to the image processing performed by the image processing device.

[0013] Further features of the present invention will become apparent from the following description of exemplary embodiments (with reference to the attached drawings). BRIEF DESCRIPTION OF THE DRAWINGS

[0014] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention.

[0015] Figure 1 is a diagram showing a configuration of an imaging system according to an embodiment of the present invention;

[0016] Figure 2 is a block diagram showing a functional configuration of an image pickup apparatus according to an embodiment;

[0017] Figure 3 is a diagram showing a functional configuration of an external image processing apparatus according to an embodiment;

[0018] Figure 4 is a diagram showing an example of a user attribute information table according to an embodiment;

[0019] Figure 5A is a flowchart showing the processing of the image pickup apparatus according to the first embodiment;

[0020] Figure 5B is a flowchart showing the processing of the external image processing device according to the first embodiment;

[0021] Figure 6 is a diagram showing an example of an EV graph according to the first embodiment;

[0022] Figure 7 is a diagram showing an example of the amount of change of the shooting parameters according to the first embodiment;

[0023] Fig. 8A is a flowchart showing the processing of the imaging apparatus according to the second embodiment;

[0024] Figure 8B is a flowchart showing the processing of the external image processing apparatus according to the second embodiment; and

[0025] Fig. 9 is a diagram showing an example of the amount of change of the shooting parameters according to the second embodiment. DETAILED DESCRIPTION

[0026] Hereinafter, the embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments are not intended to limit the scope of the claimed invention, and are not limited to inventions requiring combinations of all features described in the embodiments. Two or more of the multiple features described in the embodiments may be appropriately combined. In addition, the same reference numerals are given to the same or similar configurations, and their repeated descriptions are omitted.

[0027] <First Embodiment>

[0028] A first embodiment of the present invention will be described.

[0029] In the first embodiment of the present invention, an image pickup system that controls shooting parameters in an image pickup apparatus based on user attribute information on an external image processing apparatus will be described.

[0030] Figure 1 : is a diagram showing a configuration example of an image pickup system including an image pickup apparatus according to a first embodiment of the present invention.

[0031] The imaging system includes an imaging apparatus 101 for capturing images, a communication network 102 , and an external image processing apparatus 103 constituted by a server, etc. The imaging apparatus 101 can communicate with the external image processing apparatus 103 via the network 102 .

[0032] Next, we will refer to Figure 2 The functional configuration of the imaging apparatus 101 is described.

[0033] The optical system 201 is composed of a lens group including a zoom lens and a focus lens, and forms a subject image on an imaging surface of the image sensing circuit 202. The optical system 201 is provided with an operation member (not shown) which is directly operated by a user to control the zoom position and focus position of the optical system 201.

[0034] The image sensing circuit 202 is, for example, an image sensor such as a CCD or CMOS sensor, and performs photoelectric conversion on an optical image formed on an imaging surface of the image sensing circuit 202 by the optical system 201. The obtained analog image signal is converted into digital image data by an A / D conversion circuit (not shown), and the image sensing circuit 202 outputs the digital image data as RAW image data. The RAW image data output from the image sensing circuit 202 is temporarily stored in the RAM 209.

[0035] The image processing circuit 203 applies various image processing such as white balance adjustment, color interpolation, gamma processing, and NR processing to the RAW image data stored in the RAM 209 , and generates a resultant image of the image processing (for example, a JPEG image).

[0036] The control circuit 207 is, for example, a CPU, and reads a control program for each block included in the image pickup apparatus 101 from the ROM 208, loads the control program to the RAM 209, and executes the control program. In this way, the control circuit 207 controls the operation of each block included in the image pickup apparatus 101. For example, based on the brightness information of the shooting scene and an EV chart described later, shooting parameters such as the aperture value of the optical system 201, the shutter speed and ISO sensitivity of the image sensing circuit 202 are determined, and the operation of each block is controlled. In addition, as will be described later, the control circuit 207 determines the shooting parameters by further using update information of the shooting parameters transmitted from the external image processing apparatus 103.

[0037] The ROM 208 is an electrically erasable / recordable nonvolatile memory, and stores operation programs for the respective blocks included in the imaging apparatus 101 and parameters necessary for the operation of the respective blocks. In addition, as will be described later, user ID information related to the use of an external image processing apparatus is recorded.

[0038] The RAM 209 is a rewritable volatile memory, and is used to load programs executed by the control circuit 207 and the like, temporarily store data generated by operations of various blocks provided in the imaging apparatus 101 , and the like.

[0039] The recording circuit 204 is a removable memory card or the like. The recording circuit 204 records the image data processed by the image processing circuit 203 via the RAM 209 .

[0040] The display circuit 205 is a display device such as an LCD, and displays images stored in the RAM 209 , images recorded in the recording circuit 204 , an operation user interface for receiving instructions from a user, and the like.

[0041] The instruction input circuit 211 includes a touch panel and an operation button, and receives instructions from the user. In addition, the instruction input circuit 211 includes a shutter button (not shown), and the user can give instructions for shooting by, for example, half-pressing the shutter button to turn on the switch SW1 and by, for example, fully pressing the shutter button to turn on the switch SW2.

[0042] The communication circuit 210 communicates with the external image processing device 103 via the network 102, and transmits, for example, ID information (to be described later) indicating user attributes related to the use of the external image processing device 103, and RAW image data recorded on the recording circuit 204 to the external image processing device 103. In addition, as will be described later, the communication circuit 210 receives information related to the amount of change with respect to the shooting parameter from the external image processing device 103.

[0043] Next, we will refer to Figure 3 The shown block diagram describes the functional configuration of the external image processing device 103 .

[0044] The external image processing circuit 301 applies various image processing such as white balance adjustment, color interpolation, gamma processing, and NR processing to the input RAW image data. It is assumed that at least a part of the image processing applied here is performed by using an algorithm different from the image processing applied in the image processing circuit 203 of the image pickup apparatus 101. In the present embodiment, as an example, it will be described that the algorithm of the NR processing is different from the algorithm used in the image processing circuit 203, and the algorithms and contents of other image processing are common to the image pickup apparatus 101 and the external image processing apparatus 103. In addition, it will be described that a greater noise reduction effect than the NR processing performed in the image pickup apparatus 101 can be achieved by the NR processing performed in the external image processing apparatus 103.

[0045] The user attribute determination circuit 302 determines the user attribute by referring to the user attribute information for the use of the external image processing apparatus 103 which is recorded in advance in association with the ID information, with respect to the input ID information.

[0046] The shooting parameter conversion circuit 303 determines the amount of change of the shooting parameter in the imaging apparatus 101 based on the user attribute information determined by the user attribute determination circuit 302 .

[0047] The external communication circuit 304 communicates with the imaging apparatus 101 via the network 102, and receives, for example, RAW image data and ID information from the imaging apparatus 101. In addition, the external communication circuit 304 transmits information on shooting parameters determined by the shooting parameter conversion circuit 303 to the imaging apparatus 101, and the like.

[0048] ROM 305 is an electrically erasable / recordable nonvolatile memory and stores operation programs for each block included in the external image processing apparatus 103 and parameters required for the operation of each block. In addition, in ROM 305, user attribute information related to the use of the external image processing apparatus 103 is recorded in association with ID information.

[0049] The RAM 306 is a rewritable volatile memory, and is used to load programs executed by various parts of the external image processing apparatus 103 , temporarily store generated data, and the like.

[0050] Next, we will refer to Figure 4An example of user attribute information recorded in the external image processing device 103 is described. In the user attribute information table 401, column 402 indicates ID information of each user, and column 403 indicates information showing the use authority of the image processing in the external image processing circuit 301. For example, if user registration is required before using the image processing in the external image processing circuit 301, information on whether or not user registration has been performed for each user is recorded in advance.

[0051] Next, we will refer to Figure 5A and Figure 5B The flowchart describes the operation of the imaging system in the first embodiment. Figure 5A shows the processing in the imaging device 101, and Figure 5B The processing in the external image processing device 103 is shown.

[0052] First, in step S501, the camera 101 starts normal camera preparation. Specifically, when the user turns on the camera 101, the control circuit 207 of the camera 101 obtains the brightness information of the shooting scene and determines the shooting parameters. In this embodiment, the case of selecting the Av priority mode will be described as an example, wherein in the Av priority mode, the user specifies and sets the aperture value (Av value).

[0053] Will refer to Figure 6 The Ev graph shown describes the method of determining shooting parameters performed here, in particular the method of determining ISO sensitivity, shutter speed and aperture value.

[0054] exist Figure 6 , reference numeral 601 denotes brightness information (Bv value) of a photographing scene. Reference numeral 602 denotes a shutter speed (Tv value), and shows a Tv value used when the ISO sensitivity ranges from 800 to 12800. Reference numeral 603 denotes an aperture value (Av value), and shows an Av value used when the ISO sensitivity ranges from 800 to 12800.

[0055] When the ISO sensitivity is set to automatic, the ISO sensitivity value predetermined by the designer for each Bv value based on the noise characteristics at each sensitivity and the prediction of the noise reduction effect after the NR process is applied is used. Here, the case where the Av value set by the user is 4.0 and the Bv value calculated by the control circuit 207 is 7 will be described as an example. In addition, under the above conditions, it is assumed that the ISO sensitivity in automatic is pre-designed to 1600. In this case, a Tv value of 1 / 125 is determined as a shooting parameter. In short, the ISO sensitivity is 1600, the Tv value is 1 / 125, and the Av value is 4.0.

[0056] For ISO sensitivity setting when ISO sensitivity is set to Auto, increasing ISO sensitivity and increasing Tv value has the advantage of reducing the influence of camera shake and subject motion blur, but on the other hand, has the disadvantage of increasing image noise. In view of this trade-off, it is recommended to design the Ev chart so that the Tv value is set as fast as possible within the allowable range of the noise level in consideration of the noise reduction effect of NR processing.

[0057] In step S502, it is determined whether the user has set an external cooperative shooting mode, where the external cooperative shooting mode is a shooting mode including image processing by the external image processing device 103. If the mode is not set, the process proceeds to step S503, and a normal shooting operation is performed. In step S503, as a normal shooting operation, an image is shot according to a shooting instruction of the user. Here, after the shooting operation is performed to shoot RAW image data, a series of image processing is performed by the image processing circuit 203, and the process proceeds to step S511.

[0058] On the other hand, if the external cooperative shooting mode is set, the process proceeds to step S504, and a series of image capturing operations are started using image processing of the external image processing apparatus 103. In step S504, ID information related to the use of the external image processing apparatus 103 is transmitted from the communication circuit 210 of the image capturing apparatus 101 to the external image processing apparatus 103 via the network 102, and the process proceeds to step S505.

[0059] In the external image processing device 103, the ID information is waited in step S520, and when the ID information is received, the process proceeds to step S521. In step S521, the user attribute determination circuit 302 uses the received ID information as a key, by referring to Figure 4 , to determine whether image processing in the external image processing device 103 can be used. If the user attribute information indicates affirmative, the process proceeds to step S522 to acquire information indicating the amount of change in the shooting parameter in the image pickup device 101. If the user attribute information indicates negative, the process proceeds to step S523.

[0060] Based on the characteristic difference between the image processing in the imaging apparatus 101 and the image processing in the external image processing circuit 301 , the change amount of the shooting parameter is determined in advance and stored. Figure 7 An example of the amount of change of the shooting parameter is shown.

[0061] Figure 7The horizontal axis of the graph in represents the selection of ISO sensitivity determined by the camera device 101 in normal camera operation. The vertical axis represents the amount of change in ISO sensitivity in the external cooperative shooting mode, and shows that the shooting parameters are updated in the direction of increasing the ISO sensitivity by a predetermined amount at high sensitivity compared to normal sensitivity. This means that in the camera mode using the NR processing in the external image processing circuit 301, it is controlled so that the image is shot at a higher ISO sensitivity than usual. Through this change, the shutter speed (Tv value) can be set faster than the increase in ISO sensitivity, so that the influence of camera shake and subject motion blur can be suppressed.

[0062] On the other hand, in step S523, since the image processing in the external image processing apparatus 103 cannot be used, it is determined to send that the image processing in the external image processing apparatus 103 cannot be used.

[0063] In step S524, the information about the information determined in step S522, Figure 7 The information of the amount of change of the shooting parameters shown is sent, or the fact that the image processing in the external image processing apparatus 103 is not available as determined in step S23 is sent.

[0064] The image pickup apparatus 101 waits in step S505 until it receives information on the amount of change in the shooting parameters or the fact that the image processing in the external image processing apparatus 103 cannot be used. Then, in step S506, when the received content is not the information on the amount of change in the shooting parameters, that is, in the case where the image processing in the external image processing apparatus 103 cannot be used, the process proceeds to step S503 to perform a normal image pickup operation.

[0065] On the other hand, if the received content is information about the amount of change in the shooting parameters, the process proceeds to step S507, and the shooting parameters are updated based on the received information. Figure 6 In the Ev graph shown, when the shutter speed (Tv value) selected in the normal image pickup operation is Tv value 1 / 125, Tv value 1 / 250 is reselected, where Tv value 1 / 250 is a value when the ISO sensitivity is increased by one level. That is, the shooting parameters in the normal image pickup operation are ISO sensitivity 1600, Tv value 1 / 125, and Av value 4.0, while the shooting parameters in the external cooperative shooting mode are ISO sensitivity 3200, Tv value 1 / 250, and Av value 4.0.

[0066] In step S508, the image pickup apparatus 101 captures an image using the updated shooting parameters. Here, processing is performed until the RAW image data output from the image sensing circuit 202 is recorded in the recording circuit 204.

[0067] Next, in step S509 , the imaging apparatus 101 transmits the recorded RAW image data to the external image processing apparatus 103 via the network 102 .

[0068] The external image processing apparatus 103 waits until receiving RAW image data from the imaging apparatus 101 in step S525, and when receiving the RAW image data, in step S526, performs image processing on the received RAW image data by the external image processing circuit 301 and generates image data.

[0069] In step S527, the external image processing apparatus 103 transmits the generated image data to the camera apparatus 101 via the network 102. Note that, instead of transmitting the generated image data to the camera apparatus 101, the external image processing apparatus 103 may record the generated image data on a recording medium (not shown) so that the user can freely access the recorded image data.

[0070] The imaging apparatus 101 waits until the processed image data is received from the external image processing apparatus 103 in step S510 , and when the image data is received, records the received image data in the recording circuit 204 in step S511 .

[0071] As described above, according to the first embodiment, when image processing using an external image processing device is performed, appropriate shooting parameters can be determined by reflecting the characteristics of the image processing to be performed in the external image processing device, thereby improving the image quality of the captured image. In addition, even if the external image processing device is not used or cannot be used, shooting parameters suitable for the characteristics of the image processing to be performed in the image processing device can be determined.

[0072] In the present embodiment, the case where NR processing is applied by an external image processing device has been described as an example, but the content of the image processing in the present invention is not limited to this. For example, aberration correction can be performed to correct aberrations generated when the aperture of the lens is set to a state close to full open. In this case, if the aberration is corrected in the external image processing device, the aperture of the lens can be controlled to change more toward the open side than usual. In this way, even if the shooting scene is dark, a sufficient amount of light can be received because the aperture is changed toward the open side, and a high-resolution image can be captured. That is, any image processing can be applied as long as image processing having characteristics different from those of the image processing performed in the camera device is applied in the external image processing device.

[0073] In addition, in the present embodiment, the case of controlling the ISO sensitivity in the Av priority shooting mode has been described as an example of controlling the shooting parameters, but the method of controlling the shooting parameters in the present invention is not limited to this. For example, in a shooting mode with an ISO sensitivity automatic mode, if an upper limit of the ISO sensitivity to be used is set, the shooting parameters can be controlled in such a way as to increase the upper limit.

[0074] In the above description, it is explained that when it is determined that image processing can be used based on the user attributes, the external image processing device 103 determines whether Figure 7 The change amount of the shooting parameter shown in the figure is sent to the image capturing apparatus 101 and the change amount is notified, however, the present invention is not limited to this. The shooting parameter can be sent from the image capturing apparatus 101 to the external image processing apparatus 103, and if image processing can be used, the external image processing apparatus 103 can change the sent shooting parameter and send the changed shooting parameter to the image capturing apparatus 101. Alternatively, only the change amount of the sent shooting parameter can be sent to the image capturing apparatus 101.

[0075] Furthermore, in the present embodiment, it is explained that after capturing an image, the obtained RAW image signal is sent from the image capturing apparatus 101 to the external image processing apparatus 103, and the image processing is performed on the RAW image signal in the external image processing apparatus 103. However, the timing of applying the image processing to the RAW image signal in the present invention is not limited thereto, and for example, only the user attribute information related to the use of the external image processing apparatus 103 and the processing related to the update of the shooting parameters may be sent at the time of capturing an image, and the image processing in the external image processing apparatus 103 may be performed after capturing an image. For example, the RAW image recorded on the recording medium in the image capturing apparatus 101 may be transferred to the user's PC, and then sent from the user's PC to the external image processing apparatus 103 to which the image processing is applied.

[0076] In addition, in the present embodiment, the case where the camera 101 and the external image processing device 103 transmit and receive information via the network 102 has been described as an example, however, the transmission and reception between the camera 101 and the external image processing device 103 is not limited thereto. For example, a configuration may be used in which an edge device such as a smartphone is used as the external image processing device 103, and the camera 101 and the edge device directly communicate with each other via wired or wireless communication.

[0077] Furthermore, instead of a RAW image, an image (e.g., a JPEG image) to which image processing is applied by the imaging apparatus 101 may be transmitted to the external image processing apparatus 103. In this case, the external image processing apparatus 103 applies image processing such as NR processing to the transmitted image (e.g., a JPEG image).

[0078] In addition, in the present embodiment, the following case is described as an example: the user attribute determination circuit 302 for determining user attribute information related to the use of the external image processing device 103 and the external image processing circuit 301 for applying image processing are configured in the same device. However, the configuration of the external image processing device in the present invention is not limited to this. For example, the user attribute determination circuit can be configured to communicate with the camera device 101 via a network, and the external image processing circuit 301 can be configured as software executed on a PC in the user's home.

[0079] Furthermore, in the present embodiment, as an example, the update of the shooting parameters determined by the external image processing device 103 is automatically applied to the camera 101, and the updated shooting parameters are used for shooting. However, the control method of the shooting parameters is not limited to this. For example, the amount of change of the shooting parameters determined by the external image processing device 103 may be notified to the user on the display circuit of the camera 101 as a recommended value, and the shooting parameters may be updated according to the user's selection. That is, any method that utilizes the information about the converted shooting parameters may be used as long as the method is used to perform a process of converting the user attribute information related to the use of the external image processing device 103 into the information about the shooting parameters.

[0080] <Second Embodiment>

[0081] Next, a second embodiment of the present invention will be described. Figures 1 to 3 The descriptions are the same, so their descriptions will be omitted here.

[0082] In the first embodiment described above, a case has been described where the amount of change in shooting parameters is determined based on user attribute information related to use of the external image processing apparatus 103. In contrast, a case where shooting parameters are changed based on shooting information related to shooting by the imaging apparatus 101 will be described.

[0083] As in the case described in the first embodiment, even if the NR processing in the external image processing apparatus 103 has a good noise reduction effect, there is a case where the difference in noise reduction effects performed in the image pickup apparatus 101 and the external image processing apparatus 103 is small depending on the shooting scene and the subject. In this case, in order to appropriately determine the amount of change in the shooting parameter, it is necessary to use information on the shooting scene and the shot image.

[0084] Next, we will refer to Fig. 8A and Figure 8B The image pickup operation in the second embodiment is described. Fig. 8A shows the processing in the imaging device 101, and Figure 8B FIG. 1 shows the processing in the external image processing device 103. Fig. 8A and Figure 8B In the process shown, Figure 5A and Figure 5B The same processes as those described are given the same step numbers, and descriptions thereof will be omitted as appropriate.

[0085] In step S804 , the imaging apparatus 101 captures an image in preparation for imaging, acquires RAW image data, and applies image processing to the acquired RAW image data in the image processing circuit 203 to generate image data.

[0086] In step S805 , the imaging apparatus 101 transmits the RAW image data acquired in step S804 and the image data subjected to image processing to the external image processing apparatus 103 as shooting information.

[0087] In step S820 , the external image processing circuit 301 waits for reception of shooting information, and when it receives image information, the process advances to step S821 , and the external image processing circuit 301 applies NR processing to the received RAW image data.

[0088] In step S822, the shooting parameter conversion circuit 303 determines the amount of change in the shooting parameter, and specifically, the shooting parameter conversion circuit 303 compares the degree of noise between the image data subjected to image processing sent from the image pickup device 101 and the image data subjected to external image processing generated by the external image processing circuit 301 (between image signals). For example, when the difference between the two images is calculated, the difference indicates the difference in noise reduction effect between the image pickup device 101 and the external image processing device 103. Therefore, the degree of noise can be compared by using the amplitude of the signal of the difference as the noise evaluation value.

[0089] The shooting parameter conversion circuit 303 calculates the noise evaluation value and the Fig. 9 The characteristics shown determine the updated contents of the shooting parameters. Fig. 9, the horizontal axis represents the calculated noise evaluation value, and the vertical axis represents the amount of change in ISO sensitivity in levels. For example, if the calculated noise evaluation value is greater than the value indicated by reference numeral 902 in the figure, the amount of change in ISO sensitivity is determined to be one level. In this case, compared with a normal image pickup operation, the ISO sensitivity can be increased and the shutter speed can be set faster, so the influence of camera shake and subject blur can be reduced, thereby improving the image quality. On the other hand, if the calculated noise evaluation value is less than the value indicated by reference numeral 901 in the figure, it is determined that the ISO sensitivity has not changed.

[0090] Then, in step S823, if the amount of change in the shooting parameter is determined in step S822, the external image processing circuit 301 transmits the amount of change in the shooting parameter to the imaging apparatus 101. On the other hand, if it is determined in step S822 that the shooting parameter is not changed, the external image processing circuit 301 transmits a notification to the imaging apparatus 101 that the shooting parameter is not changed.

[0091] In step S806, the imaging apparatus 101 waits for information on the amount of change in the shooting parameters, and when it receives the information on the amount of change in the shooting parameters, the process proceeds to step S507, whereupon the imaging apparatus 101 refers to the image capture device 101. Figure 5A On the other hand, when the imaging device receives a notification that the shooting parameters are not to be changed, the process proceeds to step S503, and then the imaging device 101 performs a reference Figure 5A Description of the process.

[0092] As described above, according to the second embodiment, it is possible to determine, for each photographing scene, photographing parameters that reflect the characteristics of image processing to be performed in an external image processing apparatus.

[0093] Note that the second embodiment is described by using as an example a case where RAW image data obtained during preparation for image capture and image data subjected to image processing in the image capture apparatus 101 are sent as capture information to the external image processing apparatus 103 and used to determine the amount of change in the capture parameter. However, the present invention is not limited to the image data sent from the image capture apparatus 101 to the external image processing apparatus 103. For example, information on the brightness of the capture scene, information on the type of the subject, and information on the characteristics of the edge and texture components contained in the subject may be sent as the capture information, and the result of the image processing applied by the external image apparatus may be estimated based on the capture information.

[0094] In addition, in the present embodiment, a case has been described in which both RAW image data and an image processing result image to which the image processing of the camera device 101 is applied are sent, however, only the RAW image signal may be sent to an external image processing device, and the external image processing device 103 may apply the same image processing as the camera device 101 to the RAW image signal and may use the resulting image as the image processing result image.

[0095] Furthermore, in the present embodiment, the configuration in which the external image processing device 103 determines the amount of change in the shooting parameter of the camera 101 has been described as an example, but the present invention is not limited thereto. For example, when the camera 101 can confirm that the image processing performed by the external image processing device 103 will be used, the camera 101 can change the shooting parameter according to a predetermined rule. Specifically, when it is confirmed that the image processing performed by the external image processing device 103 will be used, the camera 101 can process so that the Ev chart is changed to increase the ISO sensitivity upper limit that can be set by one level as the ISO sensitivity increases by one level, and so on. If the NR processing performed by the external image processing device 103 can be used, the ISO sensitivity of the shooting parameter can be increased, and if the aberration correction processing can be used, the aperture of the shooting parameter can be moved to the open side. In addition, if both the NR processing and the aberration correction processing performed by the external image processing device 103 can be used, the ISO sensitivity can be increased, and the aperture can be moved to the open side. That is, the shooting parameter can be changed according to the type of image processing used in the external image processing device 103.

[0096] As a method for the camera 101 to confirm whether to use the image processing performed by the external image processing device 103, various methods can be conceived. For example, a method in which the camera 101 communicates with the external image processing device to authenticate the user, and a method in which the user inputs an authentication code obtained from the external image processing device 103 into the camera 101 can be conceived. Alternatively, a configuration can be used in which the user is caused to select whether to use the image processing performed by the external image processing device on a setting menu of the camera 101. With this configuration, since the camera 101 itself changes the shooting parameters, it is not always necessary to set the shooting parameter conversion circuit 303 in the external image processing device 103.

[0097] In addition, in the present embodiment, the case where the image pickup device 101 and the external image processing device 103 are configured separately has been described as an example, but the configuration of the image pickup device 101 in the present invention is not limited to this. For example, the image pickup device 101 may be provided with a plurality of image processing circuits, wherein the processing contents of at least some of the image processing circuits are different from each other. In this case, based on the characteristics of the image processing circuit used during normal image pickup operation, the shooting parameters are set, and when another image processing circuit is to be used, the shooting parameters can be updated to the shooting parameters set based on the characteristics of the image processing of the image processing circuit to be used. In this way, even if multiple types of image processing with different characteristics are selectively used according to the characteristics, the shooting parameters can be determined according to the characteristics of the corresponding types of image processing.

[0098] Furthermore, in the present embodiment, the case where RAW image data is sent to the external image processing device 103 during the preparation for image capture when the image capture operation starts has been described as an example, but the present invention does not limit the timing of sending RAW image data to this. For example, the sending of the shooting information and the updating of the shooting parameters may be performed in the case where it is detected during the preparation for image capture that the shooting scene or the subject has changed significantly, or in the case where the shooting parameters to be used have changed significantly. In addition, the sending of the shooting information and the updating of the shooting parameters may be performed in the case where the ISO sensitivity is set to be equal to or higher than a predetermined threshold, or in the case where it is predicted that the desired image quality may not be achieved when normal image processing in the image capture device is applied (such as in the case where camera shake or motion blur is detected in the captured image).

[0099] Other embodiments

[0100] The embodiments of the present invention can also be implemented by the following method: the software (program) that performs the functions of the above-mentioned embodiments is provided to a system or device via a network or various storage media, and the computer or central processing unit (CPU) or microprocessing unit (MPU) of the system or device reads and executes the program.

[0101] Although the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications, equivalent structures and functions.

Claims

1. A camera device, comprising: an image sensing section including an image sensor and configured to capture an image by photoelectrically converting an optical image formed on an image capturing surface and output an image signal; as well as a setting component configured to set shooting parameters to be used when the image sensing component captures an image, wherein the setting means sets, based on information obtained from the external image processing device, shooting parameters different from shooting parameters set when the image processing of the image signal using the external image processing device can be performed, and The information is an amount of change of a shooting parameter relative to a shooting parameter set in a case where image processing cannot be applied to the image signal in the external image processing device.

2. The imaging device according to claim 1, wherein: The shooting parameters include at least one of ISO sensitivity, shutter speed and aperture value of the lens. 3 . The imaging apparatus according to claim 1 , further comprising a communication section configured to transmit and receive information with the external image processing apparatus.

4. The imaging device according to claim 3, wherein: The communication section receives, from the external image processing apparatus, information indicating whether image processing can be applied to the image signal in the external image processing apparatus.

5. The imaging device according to claim 4, wherein: The communication means sends the ID information of the camera device to the external image processing device, The external image processing device determines whether image processing can be applied to the image signal in the external image processing device based on the ID information transmitted from the camera device.

6. The imaging device according to claim 3, wherein: The communication component sends to the external image processing device shooting parameters that are set when image processing cannot be applied to the image signal in the external image processing device, and receives from the external image processing device shooting parameters that are set when image processing can be applied to the image signal in the external image processing device.

7. The imaging device according to claim 1, wherein: The external image processing device determines information for the setting section to set the photographing parameter based on a difference between the image signal that has been image-processed and the image signal that has not been image-processed. 8 . The imaging apparatus according to claim 7 , further comprising an image processing section configured to perform image processing using an algorithm different from an algorithm of image processing in the external image processing apparatus.

9. The imaging device according to any one of claims 1 to 3, wherein: The setting section determines whether image processing can be applied to the image signal in the external image processing device according to a user input.

10. The imaging device according to claim 9, wherein: The setting means determines that it is possible to apply image processing to the image signal in the external image processing device when an authentication code for performing image processing in the external image processing device is input.

11. A camera system, comprising a camera device and an image processing device, wherein: The camera device comprises: an image sensing section including an image sensor and configured to capture an image by photoelectrically converting an optical image formed on an image capturing surface and output an image signal; A first image processing component configured to perform image processing on the image signal; a first determining means configured to determine a shooting parameter corresponding to the image processing performed by the first image processing means to be used when the image sensing means captures an image; and a first communication component configured to transmit and receive information with the image processing device, and The image processing device comprises: a second communication component configured to send and receive information with the camera device; a second image processing section configured to perform image processing on an image signal received from the outside; and A second determination section is configured to determine, based on the information received from the image pickup device, an amount of change of at least one of the shooting parameters corresponding to the image processing performed by the second image processing section.

12. A method for controlling a camera device, comprising: An image sensing step for photographing and outputting an image signal by photoelectrically converting an optical image formed on an imaging surface; as well as The setup steps are used to set the shooting parameters to be used when shooting. wherein, in the setting step, when image processing of the image signal using an external image processing device can be performed, shooting parameters different from shooting parameters set when image processing of the image signal using the external image processing device cannot be performed are set based on information obtained from the external image processing device; and The information is an amount of change of a shooting parameter relative to a shooting parameter set in a case where image processing cannot be applied to the image signal in the external image processing device.

13. A control method for an imaging system, the imaging system comprising an imaging device and an image processing device, the imaging device being configured to perform imaging by photoelectric conversion of an optical image formed on an imaging surface, output an image signal, and perform image processing on the image signal, the image processing device being configured to perform image processing on an image signal received from outside, the control method comprising: A first determination step is used to determine, in the camera device, shooting parameters corresponding to image processing performed by the camera device to be used when shooting; as well as A second determination step is for determining, in the image processing device, based on the information received from the imaging device, an amount of change of at least one of the imaging parameters corresponding to the image processing performed by the image processing device.

14. A non-transitory computer-readable storage medium storing a program executable by a computer, wherein the program includes a program code for causing the computer to execute a control method of an imaging device, the control method comprising: An image sensing step for photographing and outputting an image signal by photoelectrically converting an optical image formed on an imaging surface; as well as The setup steps are used to set the shooting parameters to be used when shooting. wherein, in a case where image processing of the image signal using an external image processing device can be performed, shooting parameters different from shooting parameters set in a case where image processing of the image signal using the external image processing device cannot be performed are set based on information obtained from the external image processing device, and The information is an amount of change of a shooting parameter relative to a shooting parameter set in a case where image processing cannot be applied to the image signal in the external image processing device.

15. A non-transitory computer-readable storage medium storing a program executable by a computer, wherein the program includes a program code for causing the computer to execute a control method of an imaging system, the imaging system including an imaging device and an image processing device, the imaging device being configured to perform imaging by photoelectrically converting an optical image formed on an imaging surface, output an image signal, and perform image processing on the image signal, the image processing device being configured to perform image processing on an image signal received from the outside, the control method comprising: A first determination step is used to determine, in the camera device, shooting parameters corresponding to image processing performed by the camera device to be used when shooting; as well as A second determination step is for determining, in the image processing device, based on the information received from the imaging device, an amount of change of at least one of the imaging parameters corresponding to the image processing performed by the image processing device.

Images